We study a reliability system subject to shocks generated by a renewal point process. When a shock occurs, components fail independently of each other with equal probabilities that are random numbers drawn from a distribution that may differ from shock to shock. We first consider the case of a parallel system and derive closed expressions for the Laplace-Stieltjes transform and the expectation of the time to system failure and for its density in the case that the distribution function of the renewal process possesses a density. We then treat a more general system structure, which has some very important special cases, such as k-out-of-n:F systems, and derive analogous formulae.

A curious connection exists between the theory of optimal stopping for independent random variables, and branching processes. In particular, for the branching process Zn with offspring distribution Y, there exists a random variable X such that the probability P(Zn = 0) of extinction of the nth generation in the branching process equals the value obtained by optimally stopping the sequence X1,…, Xn, where these variables are i.i.d. distributed as X. Generalizations to the inhomogeneous and infinite horizon cases are also considered. This correspondence furnishes a simple ‘stopping rule’ method for computing various characteristics of branching processes, including rates of convergence of the nth generation's extinction probability to the eventual extinction probability, for the supercritical, critical and subcritical Galton-Watson process. Examples, bounds, further generalizations and a connection to classical prophet inequalities are presented. Throughout, the aim is to show how this unexpected connection can be used to translate methods from one area of applied probability to another, rather than to provide the most general results.

Stress release processes are special Markov models attempting to describe the behaviour of stress and occurrence of earthquakes in seismic zones. The stress is built up linearly by tectonic forces and released spontaneously when earthquakes occur. Assuming that the risk is an exponential function of the stress, we derive closed form expressions for the stationary distribution of such processes, the moments of the risk, and the autocovariance function of the reciprocal risk process.

We study discrete-time population models where the nearest future of an individual may depend on the individual's life-stage (age and reproduction history) and the current population size. A criterion is given for whether there is a positive probability that the population survives forever. We identify the cases when population size grows exponentially and linearly and show that in the latter population size scaled by time is asymptotically Γ-distributed.

A martingale is used to study extinction probabilities of the Galton-Watson process using a stopping time argument. This same martingale defines a martingale function in its argument s; consequently, its derivative is also a martingale. The argument s can be classified as regular or irregular and this classification dictates very different behavior of the Galton-Watson process. For example, it is shown that irregularity of a point s is equivalent to the derivative martingale sequence at s being closable, (i.e., it has limit which, when attached to the original sequence, the martingale structure is retained). It is also shown that for irregular points the limit of the derivative is the derivative of the limit, and two different types of norming constants for the asymptotics of the Galton-Watson process are asymptotically equivalent only for irregular points.

We study an optimal investment problem in a continuous-time framework where the interest rates follow Cox-Ingersoll-Ross dynamics. Closed form formulae for the optimal investment strategy are obtained by assuming the completeness of financial markets and the CRRA utility function. In particular, we study the behaviour of the solution when time approaches the terminal date.

It is shown that an Ornstein-Uhlenbeck type process associated with a spectrally positive Lévy process can be obtained as the fluctuation limits of both discrete state and continuous state branching processes with immigration.

This article describes new estimates for the second largest eigenvalue in absolute value of reversible and ergodic Markov chains on finite state spaces. These estimates apply when the stationary distribution assigns a probability higher than 0.702 to some given state of the chain. Geometric tools are used. The bounds mainly involve the isoperimetric constant of the chain, and hence generalize famous results obtained for the second eigenvalue. Comparison estimates are also established, using the isoperimetric constant of a reference chain. These results apply to the Metropolis-Hastings algorithm in order to solve minimization problems, when the probability of obtaining the solution from the algorithm can be chosen beforehand. For these dynamics, robust bounds are obtained at moderate levels of concentration.

The paper concerns the asymptotic distributions of cluster functionals of extreme events in a dth-order stationary Markov chain {Xn, n = 1,2,…} for which the joint distribution of (X1,…,Xd+1) is absolutely continuous. Under some distributional assumptions for {Xn}, we establish weak convergence for a class of cluster functionals and obtain representations for the asymptotic distributions which are well suited for simulation. A number of examples important in applications are presented to demonstrate the usefulness of the results.

The classical technique of uniformization (or randomization) for bounded continuous-time Markov chains and Markov reward structures is extended to dynamic systems generated by arbitrary non-negative generators. Most notably, these include so-called input-output models in economic analysis. The results are of practical interest for both computational and theoretical purposes. Particularly, the recursive computation and the limiting behaviour of cumulative reward structures for non-negative dynamic systems is concluded as a special application. Two numerical examples are included to illustrate the conditions and the results.

Using a representation in terms of a two-type branching particle system, we prove that positive solutions of the system remain bounded for suitable bounded initial conditions, provided A and B generate processes with independent increments and one of the processes is transient with a uniform power decay of its semigroup. For the case of symmetric stable processes on R1,this answers a question raised in [4].

We provide a set of verifiable sufficient conditions for proving in a number of practical examples the equivalence of the martingale and the PDE approaches to the valuation of derivatives. The key idea is to use a combination of analytic and probabilistic assumptions that covers typical models in finance falling outside the range of standard results from the literature. Applications include Heston's stochastic volatility model and the Black-Karasinski term structure model.

This paper presents bounds on convergence rates of Markov chains in terms of quantities calculable directly from chain transition operators. Bounds are constructed by creating a probability distribution that minorizes the transition kernel over some region, and by examining bounds on an expectation conditional on lying within and without this region. These are shown to be sharper in most cases than previous similar results. These bounds are applied to a Markov chain useful in frequentist conditional inference in canonical generalized linear models.

This work presents an estimate of the error on a cumulative reward function until the entrance time of a continuous-time Markov chain into a set, when the infinitesimal generator of this chain is perturbed. The derivation of an error bound constitutes the first part of the paper while the second part deals with an application where the time until saturation is considered for a circuit switched network which starts from an empty state and which is also subject to possible failures.

We consider adaptive importance sampling for a Markov chain with scoring. It is shown that convergence to the zero-variance importance sampling chain for the mean total score occurs exponentially fast under general conditions. These results extend previous work in Kollman (1993) and in Kollman et al. (1999) for finite state spaces.

Previous work on the joint asymptotic distribution of the sum and maxima of Gaussian processes is extended here. In particular, it is shown that for a stationary sequence of standard normal random variables with correlation function r, the condition r(n)ln n = o(1) as n → ∞ suffices to establish the asymptotic independence of the sum and maximum.

In this paper we give bounds on the total variation distance from convergence of a continuous time positive recurrent Markov process on an arbitrary state space, based on Foster-Lyapunov drift and minorisation conditions. Considerably improved bounds are given in the stochastically monotone case, for both discrete and continuous time models, even in the absence of a reachable minimal element. These results are applied to storage models and to diffusion processes.

For i.i.d. random variables in the domain of attraction of a max-stable distribution with discount and observation costs we determine asymptotic approximations of the optimal stopping values and asymptotically optimal stopping times. The results are based on Poisson approximation of related embedded planar point processes. The optimal stopping problem for the limiting Poisson point processes can be reduced to differential equations for the boundaries. In several cases we obtain numerical solutions of the differential equations. In some cases the analysis allows us to obtain explicit optimal stopping values. This approach thus leads to approximate solutions of the optimal stopping problem of discrete time sequences.

A (generalized) stochastic fluid system Q is defined as the one-dimensional Skorokhod reflection of a finite variation process X (with possibly discontinuous paths). We write X as the (not necessarily minimal) difference of two positive measures, A, B, and prove an alternative ‘integral representation’ for Q. This representation forms the basis for deriving a ‘Little's law’ for an appropriately constructed stationary version of Q. For the special case where B is the Lebesgue measure, a distributional version of Little's law is derived. This is done both at the arrival and departure points of the system. The latter result necessitates the consideration of a ‘dual process’ to Q. Examples of models for X, including finite variation Lévy processes with countably many jumps on finite intervals, are given in order to illustrate the ideas and point out potential applications in performance evaluation.

The maximality principle [6] is shown to be valid in some examples of discounted optimal stopping problems for the maximum process. In each of these examples explicit formulas for the value functions are derived and the optimal stopping times are displayed. In particular, in the framework of the Black-Scholes model, the fair prices of two lookback options with infinite horizon are calculated. The main aim of the paper is to show that in each considered example the optimal stopping boundary satisfies the maximality principle and that the value function can be determined explicitly.