We investigate the asymptotic sample path behaviour of a randomly perturbed discrete-time dynamical system. We consider the case where the trajectories of the non-perturbed dynamical system are attracted by a finite number of limit sets and characterize a case where this property remains valid for the perturbed dynamical system when the perturbation converges to zero. For this purpose, no further assumptions on the perturbation are needed and our main condition applies to the limit sets of the non-perturbed dynamical system. When the limit sets reduce to limit points we show that this main condition is more general than the usual assumption of the existence of a Lyapunov function for the non-perturbed dynamical system. An application to an epidemic model is given to illustrate our results.

We consider a stochastic model for the spread of an epidemic amongst a closed homogeneously mixing population, in which there are several different types of infective, each newly infected individual choosing its type at random from those available. The model is based on the carrier-borne model of Downton (1968), as extended by Picard and Lefèvre (1990). The asymptotic distributions of final size and area under the trajectory of infectives are derived as the initial population becomes large, using arguments based on those of Scalia-Tomba (1985), (1990). We then use our limiting results to compare the asymptotic final size distribution of our model with that of a related multi-group model, in which the type of each infective is assigned deterministically.

Asymptotic formulas for means and variances of a multitype decomposable age-dependent supercritical branching process are derived. This process is a generalization of the Kendall–Neyman–Scott two-stage model for tumor growth. Both means and variances have exponential growth rates as in the case of the Markov branching process. But unlike Markov branching, these asymptotic moments depend on the age of the original individual at the start of the process and the life span distribution of the progenies.

Under the assumptions of the neutral infinite alleles model, K (the total number of alleles present in a sample) is sufficient for estimating θ (the mutation rate). This is a direct result of the Ewens sampling formula, which gives a consistent, asymptotically normal estimator for θ based on K. It is shown that the same estimator used to estimate θ under neutrality is consistent and asymptotically normal, even when the assumption of selective neutrality is violated.

Let X(t) be a non-homogeneous birth and death process. In this paper we develop a general method of estimating bounds for the state probabilities for X(t), based on inequalities for the solutions of the forward Kolmogorov equations. Specific examples covered include simple estimates of Pr(X(t) < j | X(0) = k) for the M(t)/M(t)/N/0 and M(t)/M(t)/N queue-length processes.

In this paper we prove the validity of the Volterra integral equation for the evaluation of first-passage-time probability densities through varying boundaries, given by Buonocore et al. [1], for the case of diffusion processes not necessarily time-homogeneous. We study, specifically those processes that can be obtained from the Wiener process in the sense of [5]. A study of the kernel of the integral equation, in the same way as that by Buonocore et al. [1], is done. We obtain the boundaries for which closed-form solutions of the integral equation, without having to solve the equation, can be obtained. Finally, a few examples are given to indicate the actual use of our method.

We introduce a stochastic process with discrete time and countable state space that is governed by a sequence of Markov matrices . Each Pm is used for a random number of steps Tm and is then replaced by Pm+1. Tm is a randomized stopping time that may depend on the most recent part of the state history. Thus the global character of the process is non-Markovian.

This process can be used to model the well-known simulated annealing optimization algorithm with randomized, partly state depending cooling schedules. Generalizing the concept of strong stationary times (Aldous and Diaconis [1]) we are able to show the existence of optimal schedules and to prove some desirable properties. This result is mainly of theoretical interest as the proofs do not yield an explicit algorithm to construct the optimal schedules.

Many applications of smoothed perturbation analysis lead to estimators with hazard rate functions of underlying distributions. A key assumption used in proving unbiasedness of the resulting estimator is that the hazard rate function be bounded, a restrictive assumption which excludes all distributions with finite support. Here, we prove through a simple example that this assumption can in fact be removed.

In a coverage problem introduced by Dvoretzky (1956) the circle is covered with lengths The associated indexed martingale can be considered as a set of random densities with respect to Lebesgue measure, of which the limit is a random measure. The total masses of the set constitute a new martingale. From a theorem of Shepp (1972), this martingale does not converge in a space if . If 0 < α < 1 it converges in all spaces , and in this paper we demonstrate that it converges in all spaces Lp for p > 2. We also obtain quite precise estimates for the moments of the total mass of the limit measure, showing that the characteristic function of this total mass is an entire function of order 1/(1 − α). Thus in some sense the mass is distributed in a bounded domain.

We extend large exceedence results for i.i.d. -valued random variables to a class of uniformly recurrent Markov-additive processes and stationary strong-mixing processes. As in the i.i.d. case, the results are proved via large deviations estimates.

We investigate the stationarity of minification processes when the marginal is a discrete distribution. There is a close relationship between the problem considered by Arnold and Isaacson (1976) and the stationarity in minification processes. We give a necessary and sufficient condition for a discrete distribution to be the marginal of a stationary minification process. Members of the Poisson and negative binomial families can be the marginals of stationary minification processes. The geometric minification process is studied in detail, and two characterizations of it based on the structure of the innovation process are given.

Shot noise processes form an important class of stochastic processes modeling phenomena which occur as shocks to a system and with effects that diminish over time. In this paper we present extreme value results for two cases — a homogeneous Poisson process of shocks and a non-homogeneous Poisson process with periodic intensity function. Shocks occur with a random amplitude having either a gamma or Weibull density and dissipate via a compactly supported impulse response function. This work continues work of Hsing and Teugels (1989) and Doney and O'Brien (1991) to the case of random amplitudes.

We present a method of deriving the limiting distributions of the number of occurrences of success (S) runs of length k for all types of runs under the Markovian structure with stationary transition probabilities. In particular, we consider the following four bestknown types. 1. A string of S of exact length k preceded and followed by an F, except the first run which may not be preceded by an F, or the last run which may not be followed by an F. 2. A string of S of length k or more. 3. A string of S of exact length k, where recounting starts immediately after a run occurs. 4. A string of S of exact length k, allowing overlapping runs. It is shown that the limits are convolutions of two or more distributions with one of them being either Poisson or compound Poisson, depending on the type of runs in question. The completely stationary Markov case and the i.i.d. case are also treated.

Let ψ(u) be the ruin probability in a risk process with initial reserve u, Poisson arrival rate β, claim size distribution B and premium rate p(x) at level x of the reserve. Let y(x) be the non-zero solution of the local Lundberg equation . It is shown that is non-decreasing and that log ψ(u) ≈ –I(u) in a slow Markov walk limit. Though the results and conditions are of large deviations type, the proofs are elementary and utilize piecewise comparisons with standard risk processes with a constant p. Also simulation via importance sampling using local exponential change of measure defined in terms of the γ(x) is discussed and some numerical results are presented.

We introduce a model for the healing process of a destroyed region and use some relations to the coverage models. The restoring model depends on the region which is hit n times at random. Each random part of the region which is destroyed is restored at a certain fixed speed, but the restoring process may start after a random delay. We focus mainly on the total healing time until the whole region is restored, and analyse its limit distribution as n tends to ∞. The dependence of this limit distribution on the different ingredients is of interest. We consider two cases with different geometrical influence. One case is restricted to a one-dimensional region, that means the circumference of a circle or the unit interval as region. The results follow from extreme value theory. We discuss also some particular cases and examples.

This work considers items (e.g. books, files) arranged in an array (e.g. shelf, tape) with N positions and assumes that items are requested according to a Markov chain (possibly, of higher order). After use, the requested item is returned to the leftmost position of the array. Successive applications of the procedure above give rise to a Markov chain on permutations. For equally likely items, the number of requests that makes this Markov chain close to its stationary state is estimated. To achieve that, a coupling argument and the total variation distance are used. Finally, for non-equally likely items and so-called p-correlated requests, the coupling time is presented as a function of the coupling time when requests are independent.

Harlow et al. (1983) have given a recursive formula which is fundamental for computing the bundle strength distribution under a general class of load sharing rules called monotone load sharing rules. As the bundle size increases, the formula becomes prohibitively complex and, by itself, does not give much insight into the relationship of the assumed load sharing rule to the overall strength distribution. In this paper, an algorithm is given which gives some additional insight into this relationship. Here it is shown how to explicitly compute the bundle strength survival distribution by using a new type of graph called the loading diagram. The graph is parallel in structure and recursive in nature and so would appear to lend itself to large-scale computation. In addition, the graph has an interesting property (which we refer to as the cancellation property) which is related to the asymptotics of the Weibull as a minimum stable law.

We consider the problem of reorganizing a linear list, when the individual queries consist of accesses to a subset of the elements stored, as opposed to the individual elements themselves. In this paper, which to our knowledge represents the first reported result in this model of query processing, we first propose a simple model for a query generator which emits set queries. Subsequently, we present extensions to the classical move-to-front (MTF) and transposition (TR) rules under this generalized query generation mechanism and analyze their performance.

Formulas for the asymptotic failure rate, long-term average availability, and the limiting distribution of the number of long ‘outages' are obtained for a general class of two-state reliability models for maintained systems. The results extend known formulas for alternating renewal processes to a wider class of point processes that includes sequences of dependent or non-identically distributed operating and repair times.

A trivariate stochastic process is considered, describing a sequence of random shocks {Xn} at random intervals {Yn} with random system state {Jn}. The triviariate stochastic process satisfies a Markov renewal property in that the magnitude of shocks and the shock intervals are correlated pairwise and the corresponding joint distributions are affected by transitions of the system state which occur after each shock according to a Markov chain. Of interest is a system lifetime terminated whenever a shock magnitude exceeds a prespecified level z. The distribution of system lifetime, its moments and a related exponential limit theorem are derived explicitly. A similar transform analysis is conducted for a second type of system lifetime with system failures caused by the cumulative magnitude of shocks exceeding a fixed level z.