A (generalized) stochastic fluid system Q is defined as the one-dimensionalSkorokhod reflection of a finite variation process X (with possibly discontinuous paths). We write X as the (not necessarily minimal) difference of two positive measures, A, B, and prove an alternative ‘integral representation’ for Q. This representation forms the basis for deriving a ‘Little's law’ for an appropriately constructed stationary version of Q. For the special case where B is the Lebesgue measure, a distributional version of Little's law is derived. This is done both at the arrival and departure points of the system. The latter result necessitates the consideration of a ‘dual process’ to Q. Examples of models for X, including finite variation Lévy processes with countably many jumps on finite intervals, are given in order to illustrate the ideas and point out potential applications in performance evaluation.

A duality is presented for continuous-time, real-valued, monotone, stochastic recursions driven by processes with stationary increments. A given recursion defines the time evolution of a content process (such as a dam or queue), and it is shown that the existence of the content process implies the existence of a corresponding dual risk process that satisfies a dual recursion. The one-point probabilities for the content process are then shown to be related to the one-point probabilities of the risk process. In particular, it is shown that the steady-state probabilities for the content process are equivalent to the first passage time probabilities for the risk process. A number of applications are presented that flesh out the general theory. Examples include regulated processes with one or two barriers, storage models with general release rate, and jump and diffusion processes.

In this paper we consider the optimal control of an infinite dam using policies assuming that the input process is a compound Poisson process with a non-negative drift term, and using the total discounted cost and long-run average cost criteria. The results of Lee and Ahn (1998) as well as other well-known results are shown to follow from our results.

Lifetime distributions for multicomponent systems are developed through the interplay of ageing and stress shocks to the system. The ageing process is explicitly modeled by an exponential function with rate affected by the magnitude of stresses from a compound Poisson process shock model. Applications of these life distributions and associated failure rates towards the study of multicomponent system survival are discussed. In particular, we illustrate the behavior of these survival functions in relevant subsets of the parameter space.

The authors prove that certain reliability formulas which link asymptotic availability, mean normal operation time, mean time between failures, mean number of failures over a period of time and asymptotic Vesely rate, and which are well known in the case of modelling using a Markov jump process or an alternating renewal process, are also true in the context of more general modelling.

We consider a network traffic model consisting of an infinite number of sources linked to a server. Sources initiate transmissions to the server at Poisson time points. The duration of each transmission has a heavy-tailed distribution. We show that suitable scalings of the traffic process converge to a totally skewed stable Lévy motion in Skorohod space, equipped with the Skorohod M 1 topology. This allows us to prove a heavy-traffic theorem for a single-server fluid model.

We consider a device that is subject to three types of failures: repairable, non-repairable and failures due to wear-out. This last type is also non-repairable. The times when the system is operative or being repaired follow phase type distributions. When a repairable failure occurs, the operating time of the device decreases, in that the lifetimes between failures are stochastically decreasing according to a geometric process. Following a non-repairable failure or after a previously fixed number of repairs occurs, the device is replaced by a new one. Under these conditions, the functioning of the device can be modelled by a Markov process. We consider two different models depending on whether or not the phase of the operational system at the instants of failure is remembered or not. For both models we derive the stationary distribution of the Markov process, the availability of the device, the rate of occurrence of the different types of failures, and certain quantities of interest.

We study strong asymptotic properties of two types of integral functionals of geometric stochastic processes. These integral functionals are of interest in financial modelling, yielding various option pricings, annuities, etc., by appropriate selection of the processes in their respective integrands. We show that under fairly general conditions on the latter processes the logs of the integral functionals themselves asymptotically behave like appropriate sup functionals of the processes in the exponents of their respective integrands. We illustrate the possible use and applications of these strong invariance theorems by listing and elaborating on several examples.

We define a class of anticipative flows on Poisson space and compute its Radon-Nikodym derivative. This result is applied to statistical testing in an anticipative queueing problem.

We study the following stochastic investment model: opportunities occur randomly over time, following a renewal process with mean interarrival time d, and at each of them the decision-maker can choose a distribution for an instantaneous net gain (or loss) from the set of all probability measures that have some prespecified expected value e and for which his maximum possible loss does not exceed his current capital. Between the investments he spends money at some constant rate. The objective is to avoid bankruptcy as long as possible. For the case e>d we characterize a strategy maximizing the probability that ruin never occurs. It is proved that the optimal value function is a concave function of the initial capital and uniquely determined as the solution of a fixed point equation for some intricate operator. In general, two-point distributions suffice; furthermore, we show that the cautious strategy of always taking the deterministic amount e is optimal if the interarrival times are hyperexponential, and, in the case of bounded interarrival times, is optimal ‘from some point on’, i.e. whenever the current capital exceeds a certain threshold. In the case e = 0 we consider a class of natural objective functions for which the optimal strategies are non-stationary and can be explicitly determined.

We consider a multiserver queue in the heavy-traffic regime introduced and studied by Halfin and Whitt who investigated the case of a single customer class with exponentially distributed service times. Our purpose is to extend their analysis to a system with multiple customer classes, priorities, and phase-type service distributions. We prove a weak convergence limit theorem showing that a properly defined and normalized queue length process converges to a particular K-dimensional diffusion process, where K is the number of phases in the service time distribution. We also show that a properly normalized waiting time process converges to a simple functional of the limit diffusion for the queue length.

In, Tory and Pickard show that a simple subclass of unilateral AR processes identifies with Gaussian Pickard random fields on Z 2. First, we extend this result to the whole class of unilateral AR processes, by showing that they all satisfy a Pickard-type property, under which correlation matching and maximum entropy properties are assessed. Then, it is established that the Pickard property provides the ‘missing’ equations that complement the two-dimensional Yule-Walker equations, in the sense that the conjunction defines a one-to-one mapping between the set of AR parameters and a set of correlations. It also implies Markov chain conditions that allow exact evaluation of the likelihood and an exact sampling scheme on finite lattices.

We establish new multidimensional martingales for Markov additive processes and certain modifications of such processes (e.g., such processes with reflecting barriers). These results generalize corresponding one-dimensional martingale results for Lévy processes. This martingale is then applied to various storage processes, queues and Brownian motion models.

The lifelengths of components of a system are usually dependent due to the common random production and operating environments. In this paper, we introduce a multi-variate pure jump Markov process to describe a large class of damage processes on various system components driven by common environmental shocks, and establish some dependence properties (association) for such a process and its multivariate increment process. These strong association properties describe both spatial dependence and temporal dependence of a multivariate pure jump process, and also provide a vehicle to derive some structural properties of component lifelengths of the systems operating in such an environment. Some bounds for the joint survival functions of component lifelengths are also obtained.

This paper describes the limiting asymptotic behaviour of a long cascade of linear reservoirs fed by stationary inflows into the first reservoir. We show that the storage in the nth reservoir becomes asymptotically deterministic as n → ∞, and establish a central limit theorem for the random fluctuations about the deterministic approximation. In addition, we prove a large deviations theorem that provides precise logarithmic asymptotics for the tail probabilities associated with the storage in the nth reservoir when n is large.

We study a system of interacting renewal processes which is a model for neuronal activity. We show that the system possesses an exponentially large number (with respect to the number of neurons in the network) of limiting configurations of the ‘firing neurons’. These we call patterns. Furthermore, under certain conditions of symmetry we find an algorithm to control limiting patterns by means of the connection parameters.

We show that the solution of a quasi-renewal equation with an exponential distribution of the renewals converges at infinity and we compute explicitly the limit, hence generalizing the classical renewal theorem. We apply this result to a stochastic model of DNA replication introduced by Cowan and Chiu (1994).

We consider a network with N infinite-buffer queues with service rates λ, and global task arrival rate Nν. Each task is allocated L queues among N with uniform probability and joins the least loaded one, ties being resolved uniformly. We prove Q-chaoticity on path space for chaotic initial conditions and in equilibrium: any fixed finite subnetwork behaves in the limit N goes to infinity as an i.i.d. system of queues of law Q. The law Q is characterized as the unique solution for a non-linear martingale problem; if the initial conditions are q-chaotic, then Q 0 = q, and in equilibrium Q 0 = q ρ is the globally attractive stable point of the Kolmogorov equation corresponding to the martingale problem. This result is equivalent to a law of large numbers on path space with limit Q, and implies a functional law of large numbers with limit (Q t )t≥0. The significant improvement in buffer utilization, due to the resource pooling coming from the choices, is precisely quantified at the limit.

In various stochastic models the random equation of implicit renewal theory appears where the real random variable S and the stochastic process Ψ with index space and state space R are independent. By use of stochastic approximation the distribution function of S is recursively estimated on the basis of independent or ergodic copies of Ψ. Under integrability assumptions almost sure L 1-convergence is proved. The choice of gains in the recursion is discussed. Applications are given to insurance mathematics (perpetuities) and queueing theory (stationary waiting and queueing times).

In this paper we consider an irreducible random walk in Z + defined by X(m+1) = max(0, X(m) + A(m+1)) with E{A} < 0 and for an s ≥ 0 where a + = max(0,a). Let π be the stationary distribution of X. We show that one can find probability distributions πn supported by {0,n} such that ||πn - π||1 ≤ Cn -s , where the constant C is computable in terms of the moments of A, and also that ||πn - π||1 = o(n -s ). Moreover, this upper bound reveals exact for s ≥ 1, in the sense that, for any positive ε, we can find a random walk fulfilling the above assumptions and for which the relation ||πn - π||1 = o(n -s-ε) does not hold. This result is used to derive the exact convergence rate of the time stationary distribution of an M/GI/1/n queueing system to the time stationary distribution of the corresponding M/GI/1 queueing system when n tends to infinity.