We introduce a continuous-time Markov chain model for the evolution of microsatellites, simple sequence repeats in DNA. We prove the existence of a unique stationary distribution for our model, and fit the model to data from approximately 106 base pairs of DNA from fruit flies, mice, and humans. The slippage rates from the best fit for our model are consistent with experimental findings.

The number Yn of offspring of the most prolific individual in the nth generation of a Bienaymé–Galton–Watson process is studied. The asymptotic behaviour of Yn as n → ∞ may be viewed as an extreme value problem for i.i.d. random variables with random sample size. Limit theorems for both Yn and EYn provided that the offspring mean is finite are obtained using some convergence results for branching processes as well as a transfer limit lemma for maxima. Subcritical, critical and supercritical branching processes are considered separately.

An open hierarchical (manpower) system divided into a totally ordered set of k grades is discussed. The transitions occur only from one grade to the next or to an additional (k+1)th grade representing the external environment of the system. The model used to describe the dynamics of the system is a continuous-time homogeneous Markov chain with k+1 states and infinitesimal generator R = (rij) satisfying rij = 0 if i > j or i + 1 < j ≤ k (i, j = 1,…,k+1), the transition matrix P between times 0 and 1 being P = expR. In this paper, two-wave panel data about the hierarchical system are considered and the resulting fact that, in general, the maximum-likelihood estimated transition matrix cannot be written as an exponential of an infinitesimal generator R having the form described above. The purpose of this paper is to investigate when this can be ascribed to the effect of sampling variability.

Repetitive Markov processes form a class of processes where the generator matrix has a particular repeating form. Many queueing models fall in this category such as M/M/1 queues, quasi-birth-and-death processes, and processes with M/G/1 or GI/M/1 generator matrices. In this paper, a new iterative scheme is proposed for computing the stationary probabilities of such processes. An infinite state process is approximated by a finite state process by lumping an infinite number of states into a super-state. What we call the feedback rate, the conditional expected rate of flow from the super-state to the remaining states, given the process is in the super-state, is approximated simultaneously with the steady state probabilities. The method is theoretically developed and numerically tested for quasi-birth-and-death processes. It turns out that the new concept of the feedback rate can be effectively used in computing the stationary probabilities.

We study the records and related variables for sequences with linear trends. We discuss the properties of the asymptotic rate function and relationships between the distribution of the long-term maxima in the sequence and that of a particular observation, including two characterization type results. We also consider certain Markov chains related to the process of records and prove limit theorems for them, including the ergodicity theorem in the regular case (convergence rates are given under additional assumptions), and derive the limiting distributions for the inter-record times and increments of records.

A trivariate equality of laws given by Doney and Yor is extended to a quadrivariate version. Some related explicit density calculations are carried out. It is shown that a bivariate case which has been used to establish the Dassios–Port–Wendel equality of laws is in fact equivalent to it.

Following Tweedie (1988), this paper constructs a special test function which leads to sufficient conditions for the stationarity and finiteness of the moments of a general non-linear time series model, the double threshold ARMA conditional heteroskedastic (DTARMACH) model. The results are applied to two well-known special cases, the GARCH and threshold ARMA (TARMA) models. The condition for the finiteness of the moments of the GARCH model is simple and easier to check than the condition given by Milhøj (1985) for the ARCH model. The condition for the stationarity of the TARMA model is identical to the condition given by Brockwell et al. (1992) for a special case, and verifies their conjecture that the moving average component does not affect the stationarity of the model. Under an additional irreducibility assumption, the geometric ergodicity of the GARCH and TARMA models is also established.

In a similar spirit to the probabilistic generalization of Taylor's theorem by Massey and Whitt [13], we give a probabilistic analogue of the mean value theorem. The latter is shown to be useful in various contexts of reliability theory. In particular, we provide various applications to the evaluation of the mean total profits of devices having random lifetimes, to the mean total-time-on-test at an arbitrary order statistic of a random sample of lifetimes, and to the mean maintenance cost for the second room of queueing systems in steady state characterized by two serial waiting rooms.

In this paper we describe a model for survival functions. Under this model a system is subject to shocks governed by a Poisson process. Each shock to the system causes a random damage that grows in time. Damages accumulate additively and the system fails if the total damage exceeds a certain capacity or threshold. Various properties of this model are obtained. Sufficient conditions are derived for the failure rate (FR) order and the stochastic order to hold between the random lifetimes of two systems whose failures can be described by our proposed model.

Let {Yn | n=1,2,…} be a stochastic process and M a positive real number. Define the time of ruin by T = inf{n | Yn > M} (T = +∞ if Yn ≤ M for n=1,2,…). We are interested in the ruin probabilities for large M. Define the family of measures {PM | M > 0} by PM(B) = P(T/M ∊ B) for B ∊ ℬ (ℬ = Borel sets of ℝ). We prove that for a wide class of processes {Yn}, the family {PM} satisfies a large deviations principle. The rate function will correspond to the approximation P(T/M ≈ x) ≈ P(Y⌈xM⌉/M ≈ 1) for x > 0. We apply the result to a simulation problem.

We obtain characterizations of densities on the real line and provide solutions to stochastic equations using the Gibbs sampler. Particular stochastic equations considered are of the type X =dB(X+C) and X =dBX+C.

On the basis of the Karlin and McGregor result, which states that the transition probability functions of a birth and death process can be expressed via the introduction of an orthogonal polynomial system and a spectral measure, we investigate in this paper how the Laplace transforms and the distributions of different transient characteristics related to excursions of a birth and death process can be expressed by means of the basic orthogonal polynomial system and the spectral measure. This allows us in particular to give a probabilistic interpretation of the series introduced by Stieltjes to study the convergence of the fundamental continued fraction associated with the system. Throughout the paper, we pay special attention to the case when the birth and death process is ergodic. Under the assumption that the spectrum of the spectral measure is discrete, we show how the distributions of different random variables associated with excursions depend on the fundamental continued fraction, the orthogonal polynomial system and the spectral measure.

We consider the distribution of the number of generations to extinction in subcritical branching processes, with particular emphasis on applications to the spread of infectious diseases. We derive the generation distributions for processes with Bernoulli, geometric and Poisson offspring, and discuss some of their distributional and inferential properties. We present applications to the spread of infection in highly vaccinated populations, outbreaks of enteric fever, and person-to-person transmission of human monkeypox.

A random mapping (Tn;q) of a finite set V, V = {1,2,…,n}, into itself assigns independently to each i ∊ V its unique image j ∊ V with probability q if i = j and with probability P = (1-q)/(n−1) if i ≠ j. Three versions of epidemic processes on a random digraph GT representing (Tn;q) are studied. The exact probability distributions of the total number of infected elements as well as the threshold functions for these epidemic processes are determined.

This paper aims to show how certain known martingales for epidemic models may be derived using general techniques from the theory of stochastic integration, and hence to extend the allowable infection and removal rate functions of the model as far as possible. Denoting by x, y the numbers of susceptible and infective individuals in the population, then we assume that new infections occur at rate βxyxy and infectives are removed at rate γxyy, where the ratio βxy / γxy can be written in the form q(x+y) / xp(x) for appropriate functions p,q. Under this condition, we find equations giving the distribution of the number of susceptibles remaining in the population at appropriately defined stopping times. Using results on Abel–Gontcharoff pseudopolynomials we also derive an expression for the expectation of any function of the number of susceptibles at these times, as well as considering certain integrals over the course of the epidemic. Finally, some simple examples are given to illustrate our results.

Consider a monotone system with independent alternating renewal processes as component processes, and assume the component uptimes are exponentially distributed. In this paper we study the asymptotic properties of the distribution of the rth downtime of the system, as the failure rates of the components converge to zero. We show that this distribution converges, and the limiting function has a simple form. Thus we have established an easy computable approximation formula for the downtime distribution of the system for highly available systems. We also show that the steady state downtime distribution, i.e. the downtime distribution of a system failure occurring after an infinite run-in period, converges to the same limiting function as the failure rates converge to zero.

Markovian algorithms for estimating the global maximum or minimum of real valued functions defined on some domain Ω ⊂ ℝd are presented. Conditions on the search schemes that preserve the asymptotic distribution are derived. Global and local search schemes satisfying these conditions are analysed and shown to yield sharper confidence intervals when compared to the i.i.d. case.

In a superfair red and black gambling house where the player must bet at least 2 units at each stage, a gambler wishes to maximize the probability of reaching a goal integer N before reaching zero. For win probability p > 1/2, when N is even, an optimal strategy is to bet 3 units when you have 3 units or N − 3 units and to bet 2 units otherwise. When N is odd, there are two strategies which are optimal depending on the value of the win probability p. When p is smaller than a certain value, p*, the above strategy is optimal, and when p is larger than this value, the timid strategy is optimal.

The random triangle model is a Markov random graph model which, for parameters p ∊ (0,1) and q ≥ 1 and a graph G = (V,E), assigns to a subset, η, of E, a probability which is proportional to p|η|(1-p)|E|-|η|qt(η), where t(η) is the number of triangles in η. It is shown that this model has maximum entropy in the class of distributions with given edge and triangle probabilities.

Using an analogue of the correspondence between the Fortuin-Kesteleyn random cluster model and the Potts model, the asymptotic behavior of the random triangle model on the complete graph is examined for p of order n−α, α > 0, and different values of q, where q is written in the form q = 1 + h(n) / n. It is shown that the model exhibits an explosive behavior in the sense that if h(n) ≤ c log n for c < 3α, then the edge probability and the triangle probability are asymptotically the same as for the ordinary G(n,p) model, whereas if h(n) ≥ c' log n for c' > 3α, then these quantities both tend to 1. For critical values, h(n) = 3α log n + o(log n), the probability mass divides between these two extremes.

Moreover, if h(n) is of higher order than log n, then the probability that η = E tends to 1, whereas if h(n) = o(log n) and α > 2/3, then, with a probability tending to 1, the resulting graph can be coupled with a graph resulting from the G(n,p) model. In particular these facts mean that for values of p in the range critical for the appearance of the giant component and the connectivity of the graph, the way in which triangles are rewarded can only have a degenerate influence.

Disaster arrival in a queuing system with negative arrivals causes all customers to leave the system instantaneously. Here we obtain a queue-length and virtual waiting (sojourn) time distribution for the more complicated system BMAP/SM/1 with MAP input of disasters.