Hostname: page-component-6766d58669-wvcvf Total loading time: 0 Render date: 2026-05-22T15:14:56.470Z Has data issue: false hasContentIssue false
  • English
  • Français

DYNAMIC ANALYSIS OF A MULTIVARIATE REWARD PROCESS DEFINED ON THE UMCP WITH APPLICATION TO OPTIMAL PREVENTIVE MAINTENANCE POLICY PROBLEMS IN MANUFACTURING

Published online by Cambridge University Press:  28 March 2013

Jia-Ping Huang  and
Ushio Sumita
Jia-Ping Huang
Affiliation:
Department of Econometrics and OR, FEWEB, VU University Amsterdam, De Boelelaan 1105, 1081 HV Amsterdam, The Netherlands E-mail: j.huang@vu.nl
Ushio Sumita
Affiliation:
Division of Policy and Planning Sciences, Faculty of Engineering, Information and Systems, University of Tsukuba, 1-1-1 Tennoudai, Tsukuba, Ibaraki 305-8573, Japan E-mail: sumita@sk.tsukuba.ac.jp
Get access Rights & Permissions [Opens in a new window]

Abstract

The unified multivariate counting process (UMCP), previously studied by the same authors, enables one to describe most of the existing counting processes in terms of its components, thereby providing a comprehensive view for such processes often defined separately and differently. The purpose of this paper is to study a multivariate reward process defined on the UMCP. By examining the probabilistic flow in its state space, various transform results are obtained. The asymptotic behavior, as t→∞, of the expected univariate reward process in a form of a product of components of the multivariate reward process is studied. As an application, a manufacturing system is considered, where the cumulative profit given a preventive maintenance policy is described as a univariate reward process defined on the UMCP. The optimal preventive maintenance policy is derived numerically by maximizing the cumulative profit over the time interval [0, T].

Information

Type
Research Article
Information
Probability in the Engineering and Informational Sciences , Volume 27 , Issue 2 , April 2013 , pp. 187 - 208
Copyright
Copyright © Cambridge University Press 2013

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

1.Barlow, R. & Hunter, L. (1960). Optimum preventive maintenance policies. Operations Research 8: 90–100.CrossRefGoogle Scholar
2.Çınlar, E. (1969). Markov renewal theory. Advances in Applied Probability 1: 123–187.CrossRefGoogle Scholar
3.Çınlar, E. (1975). Markov renewal theory: a survey. Management Science 21: 727–752.CrossRefGoogle Scholar
4.Feller, W. (1950). An introduction to probability theory and its applications, vol. 1. New York: Wiley.Google Scholar
5.Flehinger, B.J. (1962). A general model for the reliability analysis of systems under various preventive maintenance policies. The Annals of Mathematical Statistics 33: 137–156.CrossRefGoogle Scholar
6.Heffes, H. & Lucantoni, D.M. (1986). A Markov modulated characterization of packetized voice and data traffic and related statistical multiplexer performance. IEEE Journal on Selected Areas in Communications 4: 856–868.CrossRefGoogle Scholar
7.Jewell, W.S. (1963). Markov-renewal programming. i: formulation, finite return models. Operations Research 11: 938–948.CrossRefGoogle Scholar
8.Keilson, J. (1966). A limit theorem for passage times in ergodic regenerative processes. The Annals of Mathematical Statistics 37: 866–870.CrossRefGoogle Scholar
9.Keilson, J. (1969). On the matrix renewal function for markov renewal processes. The Annals of Mathematical Statistics 40: 1901–1907.CrossRefGoogle Scholar
10.Keilson, J. & Wishart, D.M.G. (1964). A central limit theorem for processes defined on a finite Markov. Proceedings of the Cambridge Philosophical Society 60: 547–567.CrossRefGoogle Scholar
11.Keilson, J. & Wishart, D.M.G. (1965). Boundary problems for additive processes defined on a finite Markov chain (Homogeneous additive process defined on Markov chain with boundary states modification, noting Green function and passage time density). Proceedings of the Cambridge Philosophical Society 61: 173–190.CrossRefGoogle Scholar
12.Lucantoni, D.M. (1991). New results on the single server queue with a batch Markovian arrival process. Stochastic Models 7: 1–46.CrossRefGoogle Scholar
13.Lucantoni, D.M., Meier-Hellstern, K.S. & Neuts, M.F. (1990). A single server queue with server vacations and a class of non-renewal arrival processes. Advances in Applied Probability 22: 676–705.CrossRefGoogle Scholar
14.Malik, M.A.K. (1979). Reliable preventive maintenance scheduling. A I I E Transactions 11: 221–228.CrossRefGoogle Scholar
15.Masuda, Y. (1993). Partially observable semi-markov reward processes. Journal of Applied Probability 30: 548–560.CrossRefGoogle Scholar
16.Masuda, Y. & Sumita, U. (1987). Analysis of a counting process associated with a semi-Markov process: number of entries into a subset of state space. Advances in Applied Probability 19: 767–783.CrossRefGoogle Scholar
17.Masuda, Y. & Sumita, U. (1991). A multivariate reward process defined on a semi-Markov process and its first-passage-time distributions. Journal of Applied Probability 28: 360–373.CrossRefGoogle Scholar
18.McLean, R.A. & Neuts, M.F. (1967). The integral of a step function defined on a semi-Markov process. SIAM Journal on Applied Mathematics 15: 726–737.CrossRefGoogle Scholar
19.Pierskalla, W.P. & Voelker, J.A. (1976). A survey of maintenance models: The control and surveillance of deteriorating systems. Naval Research Logistics Quarterly 23: 353–388.CrossRefGoogle Scholar
20.Pyke, R. (1961a). Markov renewal processes: definitions and preliminary properties. The Annals of Mathematical Statistics 32: 1231–1242.CrossRefGoogle Scholar
21.Pyke, R. (1961b). Markov renewal processes with finitely many states. The Annals of Mathematical Statistics 32: 1243–1259.CrossRefGoogle Scholar
22.Pyke, R. & Schaufele, R. (1964). Limit theorems for Markov renewal processes. The Annals of Mathematical Statistics 35: 1746–1764.CrossRefGoogle Scholar
23.Ross, S.M. (1996). Stochastic processes. New York: Wiley, 2nd ed.Google Scholar
24.Smith, W.L. (1955). Regenerative stochastic processes. Proceedings of the Royal Society of London. Series A, Mathematical and Physical Sciences 232:6–13.Google Scholar
25.Stefanov, V.T. (2006). Exact distributions for reward functions on semi-Markov and Markov additive processes. Journal of Applied Probability 43: 1053–1065.CrossRefGoogle Scholar
26.Sumita, U. & Huang, J.-P. (2009). Dynamic analysis of a unified multivariate counting process and its asymptotic behavior. International Journal of Mathematics and Mathematical Sciences vol.2009: Article ID 219532, 43p. Doi:10.1155/2009/219532.CrossRefGoogle Scholar
27.Sumita, U. & Masuda, Y. (1987). An alternative approach to the analysis of finite semi-Markov and related processes. Stochastic Models 3: 67–87.Google Scholar
28.Sumita, U. & Shanthikumar, J.G. (1988). An age-dependent counting process generated from a renewal process. Advances in Applied Probability 20: 739–755.CrossRefGoogle Scholar
29.Valdez-Flores, C. & Feldman, R.M. (1989). A survey of preventive maintenance models for stochastically deteriorating single-unit systems. Naval Research Logistics 36: 419–446.3.0.CO;2-5>CrossRefGoogle Scholar
30.Wang, H. (2002). A survey of maintenance policies of deteriorating systems. European Journal of Operational Research 139: 469–489.CrossRefGoogle Scholar