Hostname: page-component-8448b6f56d-cfpbc Total loading time: 0 Render date: 2024-04-19T02:18:21.967Z Has data issue: false hasContentIssue false
  • English
  • Français

THE DEVIATION MATRIX OF A CONTINUOUS-TIME MARKOV CHAIN

Published online by Cambridge University Press:  22 May 2002

Pauline Coolen-Schrijner  and
Erik A. van Doorn
Pauline Coolen-Schrijner
Affiliation:
Department of Mathematical Sciences, University of Durham, Durham, UK, E-mail: pauline.schrijner@durham.ac.uk
Erik A. van Doorn
Affiliation:
Faculty of Mathematical Sciences, University of Twente, Enschede, The Netherlands, E-mail: doorn@math.utwente.nl
Get access Rights & Permissions [Opens in a new window]

Abstract

The deviation matrix of an ergodic, continuous-time Markov chain with transition probability matrix P(·) and ergodic matrix Π is the matrix D ≡ ∫0∞(P(t) − Π) dt. We give conditions for D to exist and discuss properties and a representation of D. The deviation matrix of a birth–death process is investigated in detail. We also describe a new application of deviation matrices by showing that a measure for the convergence to stationarity of a stochastically increasing Markov chain can be expressed in terms of the elements of the deviation matrix of the chain.

Type
Research Article
Information
Probability in the Engineering and Informational Sciences , Volume 16 , Issue 3 , July 2002 , pp. 351 - 366
Copyright
© 2002 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)