Skip to main content

Bisimulations for non-deterministic labelled Markov processes


We extend the theory of labelled Markov processes to include internal non-determinism, which is a fundamental concept for the further development of a process theory with abstraction on non-deterministic continuous probabilistic systems. We define non-deterministic labelled Markov processes (NLMP) and provide three definitions of bisimulations: a bisimulation following a traditional characterisation; a state-based bisimulation tailored to our ‘measurable’ non-determinism; and an event-based bisimulation. We show the relations between them, including the fact that the largest state bisimulation is also an event bisimulation. We also introduce a variation of the Hennessy–Milner logic that characterises event bisimulation and is sound with respect to the other bisimulations for an arbitrary NLMP. This logic, however, is infinitary as it contains a denumerable . We then introduce a finitary sublogic that characterises all bisimulations for an image finite NLMP whose underlying measure space is also analytic. Hence, in this setting, all the notions of bisimulation we consider turn out to be equal. Finally, we show that all these bisimulation notions are different in the general case. The counterexamples that separate them turn out to be non-probabilistic NLMPs.

Hide All
Billingsley, P. (1995) Probability and Measure, Wiley-Interscience.
Bohnenkamp, H., D'Argenio, P. R., Hermanns, H. and Katoen, J.-P. (2006) MoDeST: A compositional modeling formalism for real-time and stochastic systems. IEEE Trans. Softw. Eng. 32 812830.
Bravetti, M. (2002) Specification and Analysis of Stochastic Real-Time Systems, Ph.D. thesis, Università di Bologna, Padova, Venezia.
Bravetti, M. and D'Argenio, P. R. (2004) Tutte le algebre insieme: Concepts, discussions and relations of stochastic process algebras with general distributions. In: Validation of Stochastic Systems. Springer-Verlag Lecture Notes in Computer Science 2925 4488.
van Breugel, F. (2005) The metric monad for probabilistic nondeterminism. Draft.
Cattani, S. (2005) Trace-based Process Algebras for Real-Time Probabilistic Systems, Ph.D. thesis, University of Birmingham.
Cattani, S., Segala, R., Kwiatkowska, M. Z. and Norman, G. (2005) Stochastic transition systems for continuous state spaces and non-determinism. In: Proceedings FoSSaCS 2005. Springer-Verlag Lecture Notes in Computer Science 3441 125139.
Celayes, P. (2006) Procesos de Markov etiquetados sobre espacios de Borel estándar. Master's thesis, FaMAF, Universidad Nacional de Córdoba.
Clarke, E. M., Grumberg, O. and Peled, D. (1999) Model Checking, MIT Press.
Danos, V., Desharnais, J., Laviolette, F. and Panangaden, P. (2006) Bisimulation and cocongruence for probabilistic systems. Information and Computation 204 503523.
D'Argenio, P. R. (1999) Algebras and Automata for Timed and Stochastic Systems, Ph.D. thesis, Department of Computer Science, University of Twente.
D'Argenio, P. R. and Katoen, J.-P. (2005) A theory of stochastic systems, Part I: Stochastic automata, and Part II: Process algebra. Information and Computation 203 1–38, 3974.
D'Argenio, P. R., Wolovick, N., Terraf, P. S. and Celayes, P. (2009) Nondeterministic labeled markov processes: Bisimulations and logical characterization. In: Quantitative Evaluation of Systems, International Conference on, IEEE Computer Society 1120.
Desharnais, J. (1999) Labeled Markov Process, Ph.D. thesis, McGill University.
Desharnais, J. and Panangaden, P. (2003) Continuous stochastic logic characterizes bisimulation of continuous-time Markov processes. J. Log. Algebr. Program. 56 (1-2)99115.
Desharnais, J., Edalat, A. and Panangaden, P.Bisimulation for labelled Markov processes. Information and Computation 179 (2)163193.
Doberkat, E.-E. (2007) Stochastic relations. Foundations for Markov transition systems, Studies in Informatics Series, Chapman and Hall.
Giry, M. (1981) A categorical approach to probability theory. In: Categorical Aspects of Topology and Analysis. Springer-Verlag Lecture Notes in Mathematics 915 6885.
van Glabeek, R. J. (2001) The linear time–branching time spectrum I. The semantics of concrete, sequential processes. In: Bergstra, J. A., Ponse, A. and Smolka, S. A. (eds.) Handbook of Process Algebra, North-Holland399.
Kechris, A. S. (1995) Classical Descriptive Set Theory, Graduate Texts in Mathematics 156Springer-Verlag.
Larsen, K. G. and Skou, A. (1991) Bisimulation through probabilistic testing. Information and Computation 94 (1)128.
Milner, R. (1989) Communication and Concurrency, Prentice Hall.
Naimpally, S. (2003) What is a hit-and-miss topology? Topological Commentary 8 (1).
Parma, A. and Segala, R. (2007) Logical characterizations of bisimulations for discrete probabilistic systems. In: Proceedings FoSSaCS 07. Springer-Verlag Lecture Notes in Computer Science 4423 287301.
Puterman, M. L. (1994) Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley-Interscience.
Segala, R. (1995) Modeling and Verification of Randomized Distributed Real-Time Systems, Ph.D. thesis, Massachusetts Institute of Technology.
Strulo, B. (1993) Process Algebra for Discrete Event Simulation, Ph.D. thesis, Department of Computing, Imperial College, University of London.
Vardi, M. Y. (1985) Automatic verification of probabilistic concurrent finite-state programs. In: Proceedings 26th FOCS, IEEE Computer Society 327338.
Viglizzo, I. D. (2005) Coalgebras on Measurable Spaces, Ph.D. thesis, Department of Mathematics, Indiana University.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Mathematical Structures in Computer Science
  • ISSN: 0960-1295
  • EISSN: 1469-8072
  • URL: /core/journals/mathematical-structures-in-computer-science
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Full text views

Total number of HTML views: 0
Total number of PDF views: 15 *
Loading metrics...

Abstract views

Total abstract views: 167 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 20th March 2018. This data will be updated every 24 hours.