We consider a system with a finite state space subject to continuous-time Markovian deterioration while running that leads to failure. Failures are instantaneously detected. This system is submitted to sequential checking and preventive maintenance: up states are divided into ‘good’ and ‘degraded’ ones and the system is sequentially checked through perfect and instantaneous inspections until it is found in a degraded up state and stopped to allow maintenance (or until it fails). Time between inspections is random and is chosen at each inspection according to the current degradation degree of the system. Markov renewal equations fulfilled by the reliability of the maintained system are given and an exponential equivalent is derived for the reliability. We prove the existence of an asymptotic failure rate for the maintained system, which we are able to compute. Sufficient conditions are given for the preventive maintenance policy to improve the reliability and the asymptotic failure rate of the system. A numerical example illustrates our study.

We introduce a new class of lifetime distributions exhibiting a notion of positive ageing, called the ℳ-class, which is strongly related to the well-known ℒ-class. It is shown that distributions in the ℳ-class cannot have an undesirable property recently observed in an example of an ℒ-class distribution by Klar (2002). Moreover, it is shown how these and related classes of life distributions can be characterized by expected remaining lifetimes after a family of random times, thus extending the notion of NBUE. We give examples of ℳ-class distributions by using simple sufficient conditions, and we derive reliability bounds for distributions in this class.

We study the genealogical structure of a population with stochastically fluctuating size. If such fluctuations, after suitable rescaling, can be approximated by a nice continuous-time process, we prove weak convergence in the Skorokhod topology of the scaled ancestral process to a stochastic time change of Kingman's coalescent, the time change being given by an additive functional of the limiting backward size process.

Strings are generated by sequences of independent draws from a given alphabet. For a given pattern H of length l and an integer n ≥ l, our goal is to maximize the probability of stopping on the last appearance of the pattern H in a string of length n (if any), given that, if we choose to stop on an occurrence of H, we must do so right away. This contrasts with the goals of several other investigations on patterns in strings such as computing the expected occurrence time and the probability of finding exactly r patterns in a string of fixed length. Several motivations are given for our problem ranging from relatively simple best choice problems to more difficult stopping problems allowing for a variety of interesting applications. We solve this problem completely in the homogeneous case for uncorrelated patterns. However, several of these results extend immediately to the inhomogeneous case. In the homogeneous case, optimal success probabilities are shown to vary, depending on characteristics of the pattern, essentially between the value 1/e and a new asymptotic constant 0.619…. These results demonstrate a considerable difference between the true optimal success probability compared with what a first approximation by heuristic arguments would yield. It is interesting to see that the so-called odds algorithm which gives the optimal rule for l = 1 yields an excellent approximation of the optimal rule for any l. This is important for applications because the odds algorithm is very convenient. We finally give a detailed asymptotic analysis for the homogeneous case.

In this paper, we investigate sooner and later waiting time problems for patterns S0 and S1 in multistate Markov dependent trials. The probability functions and the probability generating functions of the sooner and later waiting time random variables are studied. Further, the probability generating functions of the distributions of distances between successive occurrences of S0 and between successive occurrences of S0 and S1 and of the waiting time until the rth occurrence of S0 are also given.

In this paper, we consider the total variation distance between the distributions of two random sums SM and SN with different random summation indices M and N. We derive upper bounds, some of which are sharp. Further, bounds with so-called magic factors are possible. Better results are possible when M and N are stochastically or stop-loss ordered. It turns out that the solution of this approximation problem strongly depends on how many of the first moments of M and N coincide. As approximations, we therefore choose suitable finite signed measures, which coincide with the distribution of the approximating random sum SN if M and N have the same first moments.

We study irreducible time-homogenous Markov chains with finite state space in discrete time. We obtain results on the sensitivity of the stationary distribution and other statistical quantities with respect to perturbations of the transition matrix. We define a new closeness relation between transition matrices, and use graph-theoretic techniques, in contrast with the matrix analysis techniques previously used.

In this paper, we consider the random-scan symmetric random walk Metropolis algorithm (RSM) on ℝd. This algorithm performs a Metropolis step on just one coordinate at a time (as opposed to the full-dimensional symmetric random walk Metropolis algorithm, which proposes a transition on all coordinates at once). We present various sufficient conditions implying V-uniform ergodicity of the RSM when the target density decreases either subexponentially or exponentially in the tails.

A new theorem on the existence of an invariant initial distribution for a Markov chain evolving on a Polish space is proved. As an application of the theorem, sufficient conditions for the existence of integrated ARCH processes are established. In the case where these conditions are violated, the top Lyapunov exponent is shown to be zero.

A new structure with the special property that an instantaneous reflection barrier is imposed on the ordinary birth—death processes is considered. An easy-checking criterion for the existence of such Markov processes is first obtained. The uniqueness criterion is then established. In the nonunique case, all the honest processes are explicitly constructed. Ergodicity properties for these processes are investigated. It is proved that honest processes are always ergodic without necessarily imposing any extra conditions. Equilibrium distributions for all these ergodic processes are established. Several examples are provided to illustrate our results.

We analyse in this paper the fluid weighted fair queueing system with two classes of customers, who arrive according to Poisson processes and require arbitrarily distributed service times. In a first step, we express the Laplace transform of the joint distribution of the workloads in the two virtual queues of the system by means of unknown Laplace transforms. Such an unknown Laplace transform is related to the distribution of the workload in one queue provided that the other queue is empty. We explicitly compute the unknown Laplace transforms by means of a Wiener—Hopf technique. The determination of the unknown Laplace transforms can be used to compute some performance measures characterizing the system (e.g. the mean waiting time for each class) which we compute in the exponential service case.

This paper is devoted to a study of the integral of the workload process of the single server queue, in particular during one busy period. Firstly, we find asymptotics of the area 𝒜 swept under the workload process W(t) during the busy period when the service time distribution has a regularly varying tail. We also investigate the case of a light-tailed service time distribution. Secondly, we consider the problem of obtaining an explicit expression for the distribution of 𝒜. In the general GI/G/1 case, we use a sequential approximation to find the Laplace—Stieltjes transform of 𝒜. In the M/M/1 case, this transform is obtained explicitly in terms of Whittaker functions. Thirdly, we consider moments of 𝒜 in the GI/G/1 queue. Finally, we show asymptotic normality of .

Let X1, X2, …, Xn be a sequence of independent, identically distributed positive integer random variables with distribution function F. Anderson (1970) proved a variant of the law of large numbers by showing that the sample maximum moves asymptotically on two values if and only if F satisfies a ‘clustering’ condition, In this article, we generalize Anderson's result and show that it is robust by proving that, for any r ≥ 0, the sample maximum and other extremes asymptotically cluster on r + 2 values if and only if Together with previous work which considered other asymptotic properties of these sample extremes, a more detailed asymptotic clustering structure for discrete order statistics is presented.

For multiple-server finite-buffer systems with batch Poisson arrivals, we explore how the distribution of the number of losses during a busy period changes with the buffer size and the initial number of customers. We show that when the arrival rate equals the maximal service rate (ρ = 1), as the buffer size increases the number of losses in a busy period increases in the convex sense, and when ρ > 1, as the buffer size increases the number of busy period losses increases in the increasing convex sense. Also, the number of busy period losses is stochastically increasing in the initial number of customers. A consequence of our results is that, when ρ = 1, the mean number of busy period losses equals the mean batch size of arrivals regardless of the buffer size. We show that this invariance does not extend to general arrival processes.

We consider a multiarmed bandit problem, where each arm when pulled generates independent and identically distributed nonnegative rewards according to some unknown distribution. The goal is to maximize the long-run average reward per pull with the restriction that any previously learned information is forgotten whenever a switch between arms is made. We present several policies and a peculiarity surrounding them.

We derive the asymptotic joint normality, by a martingale approach, for the numbers of upper records, lower records and inversions in a random sequence.

In this paper, the generalized burn-in and replacement model considered by Cha (2001) is further extended to the case in which the probability of Type II failure is time dependent. Two burn-in procedures are considered and they are compared in cases when both the procedures are applicable. Under some mild conditions on the failure rate function r(t) and the Type II failure probability function p(t), the problems of determining optimal burn-in time and optimal replacement policy are considered.