A problem of regrinding and recycling worn train wheels leads to a Markov population process with distinctive properties, including a product-form equilibrium distribution. A convenient framework for analyzing this process is via the notion of dynamic reversal, a natural extension of ordinary (time) reversal. The dynamically reversed process is of the same type as the original process, which allows a simple derivation of some important properties. The process seems not to belong to any class of Markov processes for which stationary distributions are known.

The stationary distribution for the population frequencies under an infinite alleles model is described as a random sequence (x1, x2, · ··) such that Σxi = 1. Likelihood ratio theory is developed for random samples drawn from such populations. As a result of the theory, it is shown that any parameter distinguishing an infinite alleles model with selection from the neutral infinite alleles model cannot be consistently estimated based on gene frequencies at a single locus. Furthermore, the likelihood ratio (neutral versus selection) converges to a non-trivial random variable under both hypotheses. This shows that if one wishes to test a completely specified infinite alleles model with selection against neutrality, the test will not obtain power 1 in the limit.

In this paper we provide further results on the general d-dimensional correlated random walk. In particular, we prove that the n-step characteristic function of any correlated random walk satisfies a recurrence formula which enables both it and the total characteristic function to be obtained. Some examples are then considered.

Lajos Takács was born in Maglód, Hungary, on 21 August 1924. It was in this small town, 16 miles from Budapest, that he attended elementary school. He showed an early fascination with numbers, and worked on personal projects such as predicting the weight of the apricot harvest from 12 trees in the garden of the family home, by counting the buds on one tree in the spring.

A model in which a foraging animal can reproduce if its energy reserves reach a critical level is presented. The animal's reserves are modelled as a finite-state Markov chain. The animal has the choice between foraging options which may have the same mean net gain but differ in their variances. In addition to starvation, animals are subject to death because of predation, bad weather, and so on. We focus on the case where the rate of mortality due to these sources is the same under all options. We investigate policies that maximise the expected lifetime reproductive success. It is found that the optimal value function is concave at low reserves (low-variance action region) and convex at high reserves (high-variance action region). The value function under the low-variance action has also the same shape and the same inflexion point. This result allows us to compute optimal policies just by looking at the low-variance value function. The result is also used to show that increasing the mortality rate increases the high-variance region under the optimal policy. The pattern of risk-sensitive behaviour predicted by this model is in contrast to that predicted by a similar model in which no reproduction occurs and the optimality criterion is to minimise the probability of death (McNamara (1990)).

We consider a model for the spread of an epidemic through a population divided into m groups, in which infectives move from group to group and infect only within their current group. For both deterministic and stochastic versions of this model, the effect on the total size of the epidemic of varying the speed with which infectives move between groups is considered. We also compare the distribution of the total size of this model with that of a suitably matched model in which infectives cannot move between groups, but are able to infect outside their own group.

In this paper, we discuss a variety of methods for computing the Wiener-Hopf factorization of a finite Markov chain associated to a fluctuating additive functional. The importance of this is that the equilibrium law of a fluid model can be expressed in terms of these Wiener–Hopf factors. The diagonalization methods considered are actually quite efficient, and provide an effective solution to the problem.

The double-stranded molecule, DNA, has the unique property of replication and, because of this, it is the central molecule of life. The mechanism of replication for each single strand is intricate, involving enzymes which move along each of the single strands building a complementary copy. At the frontier of this action, the events have a strong stochastic character due to the random location on the DNA of key ‘sites' where copying commences. A model of this process is analysed. The central problem of interest is the mean length of certain ‘islands' of newly replicated DNA developed at the randomly located ‘sites'. These islands, which have been observed experimentally, are called Okazaki fragments.

This paper considers the asymptotic distribution of the maximum number of infectives in an epidemic model by showing that, as the initial number of susceptibles converges to infinity, the process of infectives converges almost surely to a birth and death process. The model studied here is more general than usual (see e.g. Bailey (1975), Bharucha-Reid (1960), Keilson (1979)) in that it incorporates immigration and the limiting birth and death process is non-linear. The main novelty of the present paper is the martingale approach used to prove the above-mentioned convergence.

This paper introduces exchangeable bisexual models with fixed population sizes and non-overlapping generations. In each generation there are N pairs of individuals consisting of a female and a male. The N pairs of a generation produce N daughters and N sons altogether, and these 2N children form the N pairs of the next generation at random.

First the extinction of the lines of descendants of a fixed number of pairs is studied, when the population size becomes large. Under suitable conditions this structure can be approximately treated in the framework of a Galton-Watson process. In particular it is shown for the Wright-Fisher model that the discrepancy between the extinction probabilities in the model and in the approximating Galton-Watson process is of order N.

Next, the process of the number of ancestor-pairs of all pairs of a generation is analysed. Under suitable conditions this process, properly normed, has a weak limit as N becomes large. For the Wright-Fisher model this limit is an Ornstein–Uhlenbeck process (restricted to a discrete time-set). The corresponding stationary distributions of the backward processes converge to the normal distribution, as expected.

Multidimensional Markov processes in continuous time with asymptotically linear mean change per unit of time are studied as randomly perturbed linear differential equations. Conditions for exponential and polynomial growth rates with stable type distribution are given. From these conditions results on branching models of populations with stabilizing reproduction for near-supercritical and near-critical cases follow.

A three-stage real diffusion process is used as a model of the T-cell count of an HIV-positive individual who is to receive antiviral therapy such as AZT. The ‘quality of life' of such a person is identified as the sojourn time of the diffusion process above a certain critical T-cell level c. The time of introducing therapy is defined as the first-passage time of the diffusion to a prescribed level z > c. The distribution of the sojourn time of the diffusion above the level c depends on the level z at which therapy is initiated. The expected sojourn time is explicitly computed as a function of z for the particular diffusion process defining the model. There is a simple criterion for determining when to start therapy as early as possible.

In [14] a necessary and sufficient condition was obtained for there to exist uniquely a Q-process with a specified invariant measure, under the assumption that Q is a stable, conservative, single-exit matrix. The purpose of this note is to demonstrate that, for an arbitrary stable and conservative q-matrix, the same condition suffices for the existence of a suitable Q-process, but that this process might not be unique. A range of examples is considered, including pure-birth processes, a birth process with catastrophes, birth-death processes and the Markov branching process with immigration.

Through the study of a simple embedded martingale we obtain an extension of the Kesten–Stigum theorem and prove a central limit theorem for controlled Galton-Watson processes.

This paper first considers a simple deterministic epidemic in a growing population. It then examines a simple deterministic epidemic in several related growing communities, where infection is transmitted between individuals both within and across the communities. An explicit parametric solution is derived for the number of susceptibles in these communities as a function of time.

In a branching process with random environments, the probability of ultimate extinction is a function of the environment sequence, and is therefore a random variable. Explicit results about the distribution of this random variable are difficult to obtain in general. Here we assume independent and identically distributed environments and use the special properties of fractional linear generating functions to derive some explicit distributions, which may be singular or absolutely continuous, depending on the values of certain parameters. We also consider briefly tail behaviour close to 1, and provide an extension to cases where probability generating functions are not fractional linear.

We prove that the quasi-invariant measures associated to a Brownian motion with negative drift X form a one-parameter family. The minimal one is a probability measure inducing the transition density of a three-dimensional Bessel process, and it is shown that it is the density of the limit distribution limt→∞Px(X A | τ > t). It is also shown that the minimal quasi-invariant measure of infinite mass induces the density of the limit distribution ) which is the law of a Bessel process with drift.

This paper is concerned with the description of both a deterministic and stochastic branching procedure. The renewal equations for the deterministic branching population are first derived which allow for asymptotic results on the ‘number' and ‘generation' processes. A probabilistic version of these processes is then studied which presents some discrepancy with the standard Harris age-dependent branching processes.

We characterize the conditions under which an absorbing Markovian finite process (in discrete or continuous time) can be transformed into a new aggregated process conserving the Markovian property, whose states are elements of a given partition of the original state space. To obtain this characterization, a key tool is the quasi-stationary distribution associated with absorbing processes. It allows the absorbing case to be related to the irreducible one. We are able to calculate the set of all initial distributions of the starting process leading to an aggregated homogeneous Markov process by means of a finite algorithm. Finally, it is shown that the continuous-time case can always be reduced to the discrete one using the uniformization technique.