The accurate computation of the key properties of Markov chains and Markov renewal processes

来源 :The 24th International Workshop on Matrices and Statistics(第 | 被引量 : 0次 | 上传用户:msdn_sdk
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
  Based upon the Grassman, Taksar and Heyman algorithm [1] and the equivalent Sheskin State Reduction algorithm [2] for finding the stationary distribution of a finite irreducible Markov chain, Kohlas [3] developed a procedure for finding the mean first passage times (MFPTs) (or absorption probabilities) in Markov renewal processes. The method is numerically stable as it doesnt involve subtraction. It works well for focusing on the MFPTs from any state to a fixed state but it is not ideally suited for a global expression for the MFPT matrix. We present some refinements to the Kohlas algorithm that we specialize to the case of Markov chains. We utilise MatLab to find expressions for the MFPT matrix. A consequence of our procedure is that the stationary distribution does not need to be derived in advance but is found from the MFPTs. This also leads to an expression for the group inverse of I-P where P is the transition matrix of the embedded Markov chain. Some comparisons, using some test problems from the literature, with other techniques using generalized matrix inverses and perturbation techniques are also presented. References: [1] Grassman W.K., Taksar M.I., and Heyman D.P., Regenerative analysis and steady state distributions for Markov chains, Oper. Res. 33, (1985), 1107-1116. [2] Sheskin T.J., AMarkov partitioning algorithm for computing steady state probabilities, Oper. Res. 33 (1985), 228-235. [3] Kohlas J. Numerical computation of mean first passage times and absorption probabilities in Markov and semi-Markov models, Zeit fur Oper Res, 30, (1986), 197-207.
其他文献
  The need to estimate structured covariance matrices arises in a variety of applications and the problem is widely studied in statistics. A new method is pro
会议
Blood vessel systems and leaf venations are typical biological transport networks. The energy consumption for such a system to perform its biological functions
会议
The growth of solid tumors can be described at a number of different scales from the cell to the organ scales. For a large number of cells, the fluid mechanical
会议
I will discuss our recent model [1] that incorporates cell proliferation with differentiation into different cell types, allowing backward de-differentiation [2
会议
Any coupled network of nonlinear oscillators has a potential to exhibit largescale collective patterns and waves, which are often much larger than that of the c
会议
Cancer remains a leading cause of death with current therapeutic methods. Novel therapies are therefore in urgent needs. One potential method is to use bacteria
会议
会议
We will describe work on epithelial wound healing in drosophila pupae and some more recent work on gap closure in monolayers of MDCK cells or keratinocytes. The
会议
  We propose Partial Correlation Screening (PCS) as a new row-by-row approach. To estimate the i-th row of Ω, 1 ≤ i ≤ p, PCS uses a Screen step and a Clean
会议
In eukaryotes, the absence of telomerase results in telomere shortening, leading to replicative senescence, an arrested state that prevents further cell divisio
会议