In this note, the sequence of the interarrivals of a stationary Markovian arrival process is shown to be ρ-mixing with a geometric rate of convergence when the driving process is ρ-mixing. This provides an answer to an issue raised in the recent work of Ramirez-Cobo and Carrizosa (2012) on the geometric convergence of the autocorrelation function of the stationary Markovian arrival process.

We consider a Markov-modulated Brownian motion (MMBM) with phase-dependent termination rates, i.e. while in a phase i the process terminates with a constant hazard rate r i ≥ 0. For such a process, we determine the matrix of expected local times (at zero) before termination and hence the resolvent. The results are applied to some recent questions arising in the framework of insurance risk. We further provide expressions for the resolvent and the local times at zero of an MMBM reflected at its infimum.

In this article we investigate the minimal entropy martingale measure for continuous-time Markov chains. The conditions for absence of arbitrage and existence of the minimal entropy martingale measure are discussed. Under this measure, expressions for the transition intensities are obtained. Differential equations for the arbitrage-free price are derived.

In this note we consider the two-dimensional risk model introduced in Avram, Palmowski and Pistorius (2008) with constant interest rate. We derive the integral-differential equations of the Laplace transforms, and asymptotic expressions for the finite-time ruin probabilities with respect to the joint ruin times T max(u 1,u 2) and T min(u 1,u 2) respectively.

We study recurrence and transience for Lévy processes induced by topological transformation groups acting on complete Riemannian manifolds. In particular the transience–recurrence dichotomy in terms of potential measures is established and transience is shown to be equivalent to the potential measure having finite mass on compact sets when the group acts transitively. It is known that all bi-invariant Lévy processes acting in irreducible Riemannian symmetric pairs of noncompact type are transient. We show that we also have ‘harmonic transience’, that is, local integrability of the inverse of the real part of the characteristic exponent which is associated to the process by means of Gangolli’s Lévy–Khinchine formula.

Stationary expectations corresponding to long-run averages of additive functionals on level-dependent quasi-birth-and-death processes are considered. Special cases include long-run average costs or rewards, moments and cumulants of steady-state queueing network performance measures, and many others. We provide a matrix-analytic scheme for numerically computing such stationary expectations without explicitly computing the stationary distribution of the process, which yields an algorithm that is as quick as its counterparts for stationary distributions but requires far less computer storage. Specific problems arising in the case of infinite state spaces are discussed and the application of the algorithm is demonstrated by a queueing network example.

The pricing of options in exponential Lévy models amounts to the computation of expectations of functionals of Lévy processes. In many situations, Monte Carlo methods are used. However, the simulation of a Lévy process with infinite Lévy measure generally requires either truncating or replacing the small jumps by a Brownian motion with the same variance. We will derive bounds for the errors generated by these two types of approximation.

Known results on the moments of the distribution generated by the two-locus Wright–Fisher diffusion model, and the duality between the diffusion process and the ancestral process with recombination are briefly summarized. A numerical method for computing moments using a Markov chain Monte Carlo simulation and a method to compute closed-form expressions of the moments are presented. By applying the duality argument, the properties of the ancestral recombination graph are studied in terms of the moments.

We consider a birth–death process {X(t),t≥0} on the positive integers for which the origin is an absorbing state with birth coefficients λn ,n≥0, and death coefficients μn ,n≥0. If we define A=∑n=1 ∞ 1/λn πn and S=∑n=1 ∞ (1/λn πn )∑i=n+1 ∞ πi , where {πn ,n≥1} are the potential coefficients, it is a well-known fact (see van Doorn (1991)) that if A=∞ and S<∞, then λC >0 and there is precisely one quasistationary distribution, namely, {a j (λC )}, where λC is the decay parameter of {X(t),t≥0} in C={1,2,...} and a j (x)≡μ1 -1πj xQ j (x), j=1,2,.... In this paper we prove that there is a unique quasistationary distribution that attracts all initial distributions supported in C, if and only if the birth–death process {X(t),t≥0} satisfies bothA=∞ and S<∞. That is, for any probability measure M={m i , i=1,2,...}, we have limt→∞ℙM (X(t)=j∣ T>t)= a j (λC ), j=1,2,..., where T=inf{t≥0 : X(t)=0} is the extinction time of {X(t),t≥0} if and only if the birth–death process {X(t),t≥0} satisfies both A=∞ and S<∞.

In this note we compute the Laplace transform of hitting times, to fixed levels, of integrated geometric Brownian motion. The transform is expressed in terms of the gamma and confluent hypergeometric functions. Using a simple Itô transformation and standard results on hitting times of diffusion processes, the transform is characterized as the solution to a linear second-order ordinary differential equation which, modulo a change of variables, is equivalent to Kummer's equation.

We study the Bayesian problems of detecting a change in the drift rate of an observable diffusion process with linear and exponential penalty costs for a detection delay. The optimal times of alarms are found as the first times at which the weighted likelihood ratios hit stochastic boundaries depending on the current observations. The proof is based on the reduction of the initial problems into appropriate three-dimensional optimal stopping problems and the analysis of the associated parabolic-type free-boundary problems. We provide closed-form estimates for the value functions and the boundaries, under certain nontrivial relations between the coefficients of the observable diffusion.

Given two correlated Brownian motions (X t )t≥ 0 and (Y t )t≥ 0 with constant correlation coefficient, we give the upper and lower estimations of the probability ℙ(max0 ≤s≤t X s ≥ a, max0 ≤s≤t Y s ≥ b) for any a,b,t > 0 through explicit formulae. Our strategy is to establish a new reflection principle for two correlated Brownian motions, which can be viewed as an extension of the reflection principle for one-dimensional Brownian motion. Moreover, we also consider the nonexit probability for linear boundaries, i.e. ℙ (X t ≤ a t+c,Y t ≤ b t+d, 0≤ t≤T) for any constants a, b≥0 and c,d, T > 0.

We show how to write the solution to the generalized drift Skorokhod problem in one-dimension in terms of the supremum of the solution of a tractable unrestricted integral equation (that is, an integral equation with no boundaries). As an application of our result, we equate the transient distribution of a reflected Ornstein–Uhlenbeck (OU) process to the first hitting time distribution of an OU process (that is not reflected). Then, we use this relationship to approximate the transient distribution of the GI/GI/1 + GI queue in conventional heavy traffic and the M/M/N/N queue in a many-server heavy traffic regime.

We consider a branching population where individuals have independent and identically distributed (i.i.d.) life lengths (not necessarily exponential) and constant birth rates. We let N t denote the population size at time t. We further assume that all individuals, at their birth times, are equipped with independent exponential clocks with parameter δ. We are interested in the genealogical tree stopped at the first time T when one of these clocks rings. This question has applications in epidemiology, population genetics, ecology, and queueing theory. We show that, conditional on {T<∞}, the joint law of (N t , T, X (T)), where X (T) is the jumping contour process of the tree truncated at time T, is equal to that of (M, -I M , Y′ M ) conditional on {M≠0}. Here M+1 is the number of visits of 0, before some single, independent exponential clock e with parameter δ rings, by some specified Lévy process Y without negative jumps reflected below its supremum; I M is the infimum of the path Y M , which in turn is defined as Y killed at its last visit of 0 before e ; and Y′ M is the Vervaat transform of Y M . This identity yields an explanation for the geometric distribution of N T (see Kitaev (1993) and Trapman and Bootsma (2009)) and has numerous other applications. In particular, conditional on {N T =n}, and also on {N T =n,T<a}, the ages and residual lifetimes of the n alive individuals at time T are i.i.d. and independent of n. We provide explicit formulae for this distribution and give a more general application to outbreaks of antibiotic-resistant bacteria in the hospital.

An asymptotic model for the extreme behavior of certain Markov chains is the ‘tail chain’. Generally taking the form of a multiplicative random walk, it is useful in deriving extremal characteristics, such as point process limits. We place this model in a more general context, formulated in terms of extreme value theory for transition kernels, and extend it by formalizing the distinction between extreme and nonextreme states. We make the link between the update function and transition kernel forms considered in previous work, and we show that the tail chain model leads to a multivariate regular variation property of the finite-dimensional distributions under assumptions on the marginal tails alone.

We study the two-sided exit problem of a time-homogeneous diffusion process with tax payments of loss-carry-forward type and obtain explicit formulae for the Laplace transforms associated with the two-sided exit problem. The expected present value of tax payments until default, the two-sided exit probabilities, and, hence, the nondefault probability with the default threshold equal to the lower bound are solved as immediate corollaries. A sufficient and necessary condition for the tax identity in ruin theory is discovered.

Gene conversion is a genetic mechanism by which one gene is ‘copied and pasted’ onto another gene, where the direction can be biased between the different types. In this paper, a stochastic model for biased gene conversion within a d-unlinked multigene family and its diffusion approximation are developed for a finite Moran population. A connection with a d-island model is made. A formula for the fixation probability in the absence of mutation is given. A two-timescale argument is applied in the case of the strong conversion limit. The dual process is generally shown to be a biased voter model, which generates an ancestral bias graph for a given sample. An importance sampling algorithm for computing the likelihood of the sample is deduced.

Markovian systems with multiple interacting subsystems under the influence of a control unit are considered. The state spaces of the subsystems are countably infinite, whereas that of the control unit is finite. A recent infinite level-dependent quasi-birth-and-death model for such systems is extended by facilitating the automatic representation and generation of the nonzero blocks in its underlying infinitesimal generator matrix with sums of Kronecker products. Experiments are performed on systems of stochastic chemical kinetics having two or more countably infinite state space subsystems. Results indicate that, even though more memory is consumed, there are many cases where a matrix-analytic solution coupled with Lyapunov theory yields a faster and more accurate steady-state measure compared to that obtained with simulation.

In this paper we explore the first passage times of constant-elasticity-of-variance (CEV) processes with two-sided reflecting barriers. The explicit Laplace transforms of the first passage times are derived. Our results can include analytic formulae concerning Laplace transforms of first passage times of reflected Ornstein–Uhlenbeck processes, reflected geometric Brownian motions, and reflected square-root processes.

Upper deviation results are obtained for the split time of a supercritical continuous-time Markov branching process. More precisely, we establish the existence of logarithmic limits for the likelihood that the split times of the process are greater than an identified value and determine an expression for the limiting quantity. We also give an estimation for the lower deviation probability of the split times, which shows that the scaling is completely different from the upper deviations.