We prove that if the renewal function M(t) corresponding to a life distribution F is convex (concave) then F is NBU (NWU), and hence answer two questions posed by Shaked and Zhu (1992). Moreover, based-on the renewal function, some characterizations of the exponential distribution within certain classes of life distributions are given.

Many disordered random systems in applications can be described by N randomly coupled Ito stochastic differential equations in :

where is a sequence of independent copies of the one-dimensional Brownian motion W and ( is a sequence of independent copies of the ℝp-valued random vector ξ. We show that under suitable conditions on the functions b, σ, K and Φ the dynamical behaviour of this system in the N → (limit can be described by the non-linear stochastic differential equation

where P(t, dx dy) is the joint probability law of ξ and X(t).

We consider a problem in which a single server must serve a stream of customers whose arrivals are distributed over a finite-size convex space. Under the assumption that the server has full information on the customer location, obvious service policies are the FCFS and the greedy (serve-the-closest-customer) approaches. These algorithms are, however, either inefficient (FCFS) or ‘unfair' (greedy).

We propose and study two alternative algorithms, the gated-greedy policy and the gated-scan policy, which are more ‘fair' than the pure greedy method. We show that the stability conditions of the gated-greedy are p < 1 (where p is the expected rate at which work arrives at the system), implying that the method is at least as efficient (in terms of system stability) as any other discipline, in particular the greedy one. For the gated-scan policy we show that for any p < 1 one can design a stable gated-scan policy; however, for any fixed gated-scan policy there exists p < 1 for which the policy is unstable. We evaluate the performance of the gated-scan policy, and present bounds for the performance of the gated-greedy policy.

These results are derived for systems in which the arrivals occur on a two-dimensional space (a square) but they are not limited to this configuration; rather they hold for more complex N-dimensional spaces, in particular for serving customers in (three-dimensional) convex space and serving customers on a line.

We have two aims in this paper. First, we generalize the well-known theory of matrix-geometric methods of Neuts to more complicated Markov chains. Second, we use the theory to solve a last-come-first-served queue with a generalized preemptive resume (LCFS-GPR) discipline. The structure of the Markov chain considered in this paper is one in which one of the variables can take values in a countable set, which is arranged in the form of a tree. The other variable takes values from a finite set. Each node of the tree can branch out into d other nodes. The steady-state solution of this Markov chain has a matrix product-form, which can be expressed as a function of d matrices Rl,· ··, Rd. We then use this theory to solve a multiclass LCFS-GPR queue, in which the service times have PH-distributions and arrivals are according to the Markov modulated Poisson process. In this discipline, when a customer's service is preempted in phase j (due to a new arrival), the resumption of service at a later time could take place in a phase which depends on j. We also obtain a closed form solution for the stationary distribution of an LCFS-GPR queue when the arrivals are Poisson. This result generalizes the known result on a LCFS preemptive resume queue, which can be obtained from Kelly's symmetric queue.

The mean busy period of a Markov-modulated queue or fluid model is computed by an extension of the time-reversal argument connecting the steady-state distribution and the maximum of a related Markov additive process.

We rigorously prove that for a stochastic process, , the existence of a first regeneration time, R1, implies the existence of an infinite sequence of such times, {R1, R2, · ·· }, and hence that the definition of regenerative process need only demand the existence of a first regeneration time. Here we include very general processes up to and including processes where cycles are stationary but not necessarily independent and identically distributed.

We obtain explicit upper bounds in closed form for the queue length in a slotted time FCFS queue in which the service requirement is a sum of independent Markov processes on the state space {0, 1}, with integral service rate. The bound is of the form [queue length for any where c < 1 and y > 1 are given explicitly in terms of the parameters of the model. The model can be viewed as an approximation for the burst-level component of the queue in an ATM multiplexer. We obtain heavy traffic bounds for the mean queue length and show that for typical parameters this far exceeds the mean queue length for independent arrivals at the same load. We compare our results on the mean queue length with an analytic expression for the case of unit service rate, and compare our results on the full distribution with computer simulations.

When a mission is assigned, it often is the case that the component used to perform the task is required to work properly during the period of the mission time. In other words, the probability of the event that this component does not fail within the allowable mission time should be as large as possible. This problem is considered for the case when the lifetime of a component has a bathtub-shaped failure rate function, and it is found that burn-in procedure is beneficial. An application of this result to the problem of minimizing the mean number of failures in a given period of mission time is also considered.

We consider an absorbing semi-Markov chain for which each time absorption occurs there is a resetting of the chain according to some initial (replacement) distribution. The new process is a semi-Markov replacement chain and we study its properties in terms of those of the imbedded Markov replacement chain. A time-dependent version of the model is also defined and analysed asymptotically for two types of environmental behaviour, i.e. either convergent or cyclic. The results contribute to the control theory of semi-Markov chains and extend in a natural manner a wide variety of applied probability models. An application to the modelling of populations with semi-Markovian replacements is also presented.

In this paper we obtain some new theoretical and numerial results on estimation of small steady-state probabilities in regenerative queueing models by using the likelihood ratio (score function) method, which is based on a change of the probability measure. For simple GI/G/1 queues, this amounts to simulating the regenerative cycles by a suitable change of the interarrival and service time distribution, typically corresponding to a reference traffic intensity ρ0 which is < 1 but larger than the given one ρ. For the M/M/1 queue, the resulting gain of efficiency is calculated explicitly and shown to be considerable. Simulation results are presented indicating that similar conclusions hold for gradient estimates and in more general queueing models like queueing networks.

The Jackson network under study receives batch arrivals at i.i.d. intervals and features Markovian routing and exponentially distributed service times. The system is shown to be stable, in the sense of not being overloaded, if and only if, for each node, the total arrival rate of external and internal customers is less than the service rate. The method of proof is of more general interest.

The algorithm for the transient solution for the denumerable state Markov process with an arbitrary initial distribution is given in this paper. The transient queue length distribution for a general Markovian queueing system can be obtained by this algorithm. As examples, some numerical results are presented.

Let Φ = {Φ n} be an aperiodic, positive recurrent Markov chain on a general state space, π its invariant probability measure and f ≧ 1. We consider the rate of (uniform) convergence of Ex[g(Φ n)] to the stationary limit π (g) for |g| ≦ f: specifically, we find conditions under which

as n →∞, for suitable subgeometric rate functions r. We give sufficient conditions for this convergence to hold in terms of

(i) the existence of suitably regular sets, i.e. sets on which (f, r)-modulated hitting time moments are bounded, and

(ii) the existence of (f, r)-modulated drift conditions (Foster–Lyapunov conditions).

The results are illustrated for random walks and for more general state space models.

Exponential bounds are derived for the tail probabilities of various compound distributions, generalizing the classical Lundberg inequality of insurance risk theory. Failure rate properties of the compounding distribution including log-convexity and log-concavity are considered in some detail. Mixed Poisson compounding distributions are also considered. A ruin theoretic generalization of the Lundberg inequality is obtained in the case where the number of claims process is a mixed Poisson process. An application to the M/G/1 queue length distribution is given.

Choi and Park [2] derived an expression for the joint stationary distribution of the number of customers of k types who arrive in batches at an infinite-server system of M/M/∞ type. We propose another method of solving this problem and extend the result to the case of general service times (not necessarily independent). We also get a transient solution. Our main result states that the k- dimensional vector of the number of customers of k types in the system is a certain linear function of a (2k – 1)-dimensional vector whose coordinates are independent Poisson random variables.

In this paper a unified derivation of the upper and lower bounds (in terms of the mean) of an IFR, DFR, IFRA, DFRA, NBU or NWU reliability function is presented. The method of proof provides a simpler alternative to the various proofs known in the literature. Moreover, this method can be used to generalize the existing results in two ways, as demonstrated here. First, the bounds for the reliability function are obtained in terms of any finite moment in all these cases. Subsequently we provide a moment bound on a reliability function which ages faster or slower than a known one in some sense. The existing literature does not offer any of these generalizations, except for a few results which are available in an unnecessarily complicated form.

The theory of piecewise-deterministic Markov processes is used in order to investigate insurance risk models where borrowing, investment and inflation are present.

In this paper we obtain the Beňes equation for the evolution of the probability distribution of the excursion process associated with the level crossings of a general storage process. We then show that under stationarity and ergodicity assumptions on the process we can recover the well-known rate conservation law (RCL). Using the stationary solution we then show that the existence of an invariant solution can be studied in terms of an operator equation and we show how this characterization leads to a very simple explicit computation of the stationary distribution.

Perturbation analysis estimators for expectations of possibly discontinuous functions of the time-stationary workload were derived in [2]. The expressions obtained may, however, not be valid if the customer-stationary distribution of the workload has atoms (at points other than zero). This was pointed out by Brémaud and Lasgouttes in [1]. In this note we clearly state the additional condition required for the validity of the expressions in [2]. We furthermore show how our approximation scheme can also be used to obtain the correct expressions for the right and left derivatives given in [1].

Existence and finiteness of the sample-mean limit of sojourn times of jobs in a queueing system are investigated. The queueing system operates under rather general multiprocessor disciplines allowing job classes and priorities. The input stream of jobs consisting of job classes and interarrival and processing times is stationary and ergodic and may contain batch arrivals. Existence of the sample-mean limit is proved by means of the superadditive ergodic theorem, and its finiteness is controlled by uniform mixing of the input stream.