We present a method of deriving the limiting distributions of the number of occurrences of success (S) runs of length k for all types of runs under the Markovian structure with stationary transition probabilities. In particular, we consider the following four bestknown types. 1. A string of S of exact length k preceded and followed by an F, except the first run which may not be preceded by an F, or the last run which may not be followed by an F. 2. A string of S of length k or more. 3. A string of S of exact length k, where recounting starts immediately after a run occurs. 4. A string of S of exact length k, allowing overlapping runs. It is shown that the limits are convolutions of two or more distributions with one of them being either Poisson or compound Poisson, depending on the type of runs in question. The completely stationary Markov case and the i.i.d. case are also treated.

We investigate the asymptotic sample path behaviour of a randomly perturbed discrete-time dynamical system. We consider the case where the trajectories of the non-perturbed dynamical system are attracted by a finite number of limit sets and characterize a case where this property remains valid for the perturbed dynamical system when the perturbation converges to zero. For this purpose, no further assumptions on the perturbation are needed and our main condition applies to the limit sets of the non-perturbed dynamical system. When the limit sets reduce to limit points we show that this main condition is more general than the usual assumption of the existence of a Lyapunov function for the non-perturbed dynamical system. An application to an epidemic model is given to illustrate our results.

It is shown by means of several examples that probability metrics are a useful tool to study the asymptotic behaviour of (stochastic) recursive algorithms. The basic idea of this approach is to find a ‘suitable' probability metric which yields contraction properties of the transformations describing the limits of the algorithm. In order to demonstrate the wide range of applicability of this contraction method we investigate examples from various fields, some of which have already been analysed in the literature.

Shot noise processes form an important class of stochastic processes modeling phenomena which occur as shocks to a system and with effects that diminish over time. In this paper we present extreme value results for two cases — a homogeneous Poisson process of shocks and a non-homogeneous Poisson process with periodic intensity function. Shocks occur with a random amplitude having either a gamma or Weibull density and dissipate via a compactly supported impulse response function. This work continues work of Hsing and Teugels (1989) and Doney and O'Brien (1991) to the case of random amplitudes.

Let ψ(u) be the ruin probability in a risk process with initial reserve u, Poisson arrival rate β, claim size distribution B and premium rate p(x) at level x of the reserve. Let y(x) be the non-zero solution of the local Lundberg equation . It is shown that is non-decreasing and that log ψ(u) ≈ –I(u) in a slow Markov walk limit. Though the results and conditions are of large deviations type, the proofs are elementary and utilize piecewise comparisons with standard risk processes with a constant p. Also simulation via importance sampling using local exponential change of measure defined in terms of the γ(x) is discussed and some numerical results are presented.

We consider the distribution of the free coordinates of a time-homogeneous Markov process at the time of its first passage into a prescribed stopping set. This calculation (for an uncontrolled process) is of interest because under some circumstances it enables one to calculate the optimal control for a related controlled process. Scaling assumptions are made which allow the application of large deviation techniques. However, the first-order evaluation obtained by these techniques is often too crude to be useful, and the second-order correction term must be calculated. An expression for this correction term as an integral over time is obtained in Equation (20). The integration can be performed in some cases to yield the conclusions of Theorems 1 and 2, expressed in Equations (7) and (9). Theorem 1 gives the probability density of the state vector (to the required degree of approximation) at a prescribed time for a class of processes we may reasonably term linear. Theorem 2 evaluates (without any assumption of linearity) the ratio of this density to the probability density of the coordinates under general stopping rules.

We consider positive matrices Q, indexed by {1,2, …}. Assume that there exists a constant 1 L < ∞ and sequences u1< u2< · ·· and d1d2< · ·· such that Q(i, j) = 0 whenever i < ur < ur + L < j or i > dr + L > dr > j for some r. If Q satisfies some additional uniform irreducibility and aperiodicity assumptions, then for s > 0, Q has at most one positive s-harmonic function and at most one s-invariant measure µ. We use this result to show that if Q is also substochastic, then it has the strong ratio limit property, that is

for a suitable R and some R–1-harmonic function f and R–1-invariant measure µ. Under additional conditions µ can be taken as a probability measure on {1,2, …} and exists. An example shows that this limit may fail to exist if Q does not satisfy the restrictions imposed above, even though Q may have a minimal normalized quasi-stationary distribution (i.e. a probability measure µ for which R–1µ = µQ).

The results have an immediate interpretation for Markov chains on {0,1,2, …} with 0 as an absorbing state. They give ratio limit theorems for such a chain, conditioned on not yet being absorbed at 0 by time n.

We consider a multiserver queuing process specified by i.i.d. interarrival time, batch size and service time sequences. In the case that different servers have different service time distributions we say the system is heterogeneous. In this paper we establish conditions for the queuing process to be characterized as a geometrically Harris recurrent Markov chain, and we characterize the stationary probabilities of large queue lengths and waiting times. The queue length is asymptotically geometric and the waiting time is asymptotically exponential. Our analysis is a generalization of the well-known characterization of the GI/G/1 queue obtained using classical probabilistic techniques of exponential change of measure and renewal theory.

We continue our investigation of the batch arrival-heterogeneous multiserver queue begun in Part I. In a general setting we prove the positive Harris recurrence of the system, and with no additional conditions we prove logarithmic tail limits for the stationary queue length and waiting time distributions.

We present a stochastic model for the movement of a white blood cell both in uniform concentration of chemoattractant and in the presence of a chemoattractant gradient. It is assumed that the rotational velocity is proportional to the weighted difference of the occupied receptors in the two halves of the cell and that each of the receptors stays free or occupied for an exponential length of time. We define processes corresponding to a cell with 2nß + 1 receptors (receptor sites). In the case of constant concentration, we show that the limiting process for the rotational velocity is an Ornstein–Uhlenbeck process. Its drift coefficient depends on the parameters of the exponential waiting times and its diffusion coefficient depends in addition also on the weight function. In the inhomogeneous case, the velocity process has a diffusion limit with drift coefficient depending on the concentration gradient and diffusion coefficient depending on the concentration and the weight function.

We consider a discrete-time stochastically perturbed dynamical system on the Polish space given by the recurrence formula Xn = S(Xn–1, Yn), where Yn are i.i.d. random elements. We prove the existence of unique stationary measure and versions of classical limit theorems for the process (Xn).

The DNA of higher animals replicates by an interesting mechanism. Enzymes recognise specific sites randomly scattered on the molecule and establish a bidirectional process of unwinding and replication from these sites. We investigate the limiting distribution of the completion time for this process by considering related coverage problems investigated by Janson (1983) and Hall (1988).

In the present paper we study the number of occurrences of non-overlapping success runs of length in a sequence of (not necessarily identical) Bernoulli trials arranged on a circle. An exact formula is given for the probability function, along with some sharp bounds which turn out to be very useful in establishing limiting (Poisson convergence) results. Certain applications to statistical run tests and reliability theory are also discussed.

Consider a sequence of possibly dependent random variables having the same marginal distribution F, whose tail 1−F is regularly varying at infinity with an unknown index − α < 0 which is to be estimated. For i.i.d. data or for dependent sequences with the same marginal satisfying mixing conditions, it is well known that Hill's estimator is consistent for α−1 and asymptotically normally distributed. The purpose of this paper is to emphasize the central role played by the tail empirical process for the problem of consistency. This approach allows us to easily prove Hill's estimator is consistent for infinite order moving averages of independent random variables. Our method also suffices to prove that, for the case of an AR model, the unknown index can be estimated using the residuals generated by the estimation of the autoregressive parameters.

Models for epidemic spread of infections are formulated by defining intensities for relevant counting processes. It is assumed that an infected individual passes through k stages of infectivity. The times spent in the different stages are random. Many well-known models for the spread of infections can be described in this way. The models can also be applied to describe other processes of epidemic character (such as models for rumour spreading). Asymptotic results are derived both for the size and for the duration of the epidemic.

Using an approach similar to that of Guivarc'h and Hardy (1988), we show that the local limit theorem holds for a Markov chain on a countable state space, with non-uniform ergodicity, when the recurrence is fast enough. We present a detailed study of a typical example, the reflected random walk on the positive half-line with negative mean and finite exponential moment. The results can be extended to some random walks on ℕ.

Non-parametric estimators of the distribution of the grain of the Boolean model are considered. The technique is based on the study of point processes of tangent points in different directions related to the Boolean model. Their second- and higher-order characteristics are used to estimate the mean body and the distribution of the typical grain. Central limit theorems for the improved estimator of the intensity and surface measures of the Boolean model are also proved.

We consider the composition of random i.i.d. affine maps of a Hilbert space to itself. We show convergence of the nth composition of these maps in the Wasserstein metric via a contraction argument. The contraction condition involves the operator norm of the expectation of a bilinear form. This is contrasted with the usual contraction condition of a negative Lyapunov exponent. Our condition is stronger and easier to check. In addition, our condition allows us to conclude convergence of second moments as well as convergence in distribution.

Consider the convex hull of n independent, identically distributed points in the plane. Functionals of interest are the number of vertices Nn, the perimeter Ln and the area An of the convex hull. We study the asymptotic behaviour of these three quantities when the points are standard normally distributed. In particular, we derive the variances of Nn, Ln and An for large n and prove a central limit theorem for each of these random variables. We enlarge on a method developed by Groeneboom (1988) for uniformly distributed points supported on a bounded planar region. The process of vertices of the convex hull is of central importance. Poisson approximation and martingale techniques are used.

The paper deals with large trunk line systems of the type appearing in telephone networks. There are many nodes or input sources, each pair of which is connected by a trunk line containing many individual circuits. Traffic arriving at either end of a trunk line wishes to communicate to the node at the other end. If the direct route is full, a rerouting might be attempted via an alternative route containing several trunks and connecting the same endpoints. The basic questions concern whether to reroute, and if so how to choose the alternative path. If the network is ‘large’ and fully connected, then the overflow traffic which is offered for rerouting to any trunk comes from many other trunks in the network with no one dominating. In this case one expects that some sort of averaging method can be used to approximate the rerouting requests and hence simplify the analysis. Essentially, the overflow traffic that a trunk offers the network for rerouting is in some average sense similar to the overflow traffic offered to that trunk. Indeed, a formalization of this idea involves the widely used (but generally heuristic) ‘fixed point' approximation method. One sets up the fixed point equations for appropriate rerouting strategies and then solves them to obtain an approximation to the system loss. In this paper we work in the heavy traffic regime, where the external offered traffic to any trunk is close to the service capacity of that trunk. It is shown that, as the number of links and circuits within each link go to infinity and for a variety of rerouting strategies, the system can be represented by an averaged limit. This limit is a reflected diffusion of the McKean–Vlasov (propagation of chaos) type, where the driving terms depend on the mean values of the solution of the equation. The averages occur due to the symmetry of the network and the averaging effects of the many interactions. This provides a partial justification for the fixed point method. The concrete dynamical systems flavor of the approach and the representations of the limit processes provide a useful way of visualizing the system and promise to be useful for the development of numerical methods and further analysis.