Hostname: page-component-76fb5796d-qxdb6 Total loading time: 0 Render date: 2024-04-29T06:08:09.512Z Has data issue: false hasContentIssue false
  • English
  • Français

On the equivalence of certain Markov chains

Published online by Cambridge University Press:  14 July 2016

Pedro Vit
Pedro Vit*
Affiliation:
CIMAS, Universidad Nacional Autónoma de México
Get access Rights & Permissions [Opens in a new window]

Abstract

It is shown that an irreducible and aperiodic Markov chain can be altered preserving irreducibility without altering the nature of the chain in the sense that, the modified chain is transient (recurrent) if and only if the original chain is transient (recurrent). Furthermore, it is shown by means of a counterexample that ergodicity (null-recurrence) is not preserved.

An interesting application of this result is a simple proof of Pakes's generalization of Foster's criterion for a chain to be recurrent.

Keywords

EQUIVALENT MARKOV CHAINSFOSTER'S CRITERION FOR RECURRENCEPAKES'S CRITERION FOR RECURRENCETRANSFORMATION OF MARKOV CHAINS
Type
Short Communications
Information
Journal of Applied Probability , Volume 13 , Issue 2 , June 1976 , pp. 357 - 360
Copyright
Copyright © Applied Probability Trust 1976 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Foster, F. G. (1953) On the stochastic matrices associated with certain queuing processes. Ann. Math. Statist. 24, 355–360.Google Scholar
Pakes, A. G. (1969) Some conditions for ergodicity and recurrence of Markov chains Operat. Res. 17, 1058–1061.Google Scholar