Jakeman's random walk model with step number fluctuations describes the coherent amplitude scattered from a rough medium in terms of the summation of individual scatterers' contributions. If the scattering population conforms to a birth-death immigration model, the resulting amplitude is K-distributed. In this context, we derive a class of diffusion processes as an extension of the ordinary birth-death immigration model. We show how this class encompasses four different cross-section models commonly studied in the literature. We conclude by discussing the advantages of this unified description.

In this paper we present simple extensions of earlier works on the optimal time to exchange one basket of log Brownian assets for another. A superset and subset of the optimal stopping region in the case where both baskets consist of multiple assets are obtained. It is also shown that a conjecture of Hu and Øksendal (1998) is false except in the trivial case where all the assets in a basket are the same processes.

We consider a portfolio optimization problem in a defaultable market. The investor can dynamically choose a consumption rate and allocate his/her wealth among three financial securities: a defaultable perpetual bond, a default-free risky asset, and a money market account. Both the default risk premium and the default intensity of the defaultable bond are assumed to rely on some stochastic factor which is described by a diffusion process. The goal is to maximize the infinite-horizon expected discounted log utility of consumption. We apply the dynamic programming principle to deduce a Hamilton-Jacobi-Bellman equation. Then an optimal Markov control policy and the optimal value function is explicitly presented in a verification theorem. Finally, a numerical analysis is presented for illustration.

A useful result when dealing with backward stochastic differential equations is the comparison theorem of Peng (1992). When the equations are not based on Brownian motion, the comparison theorem no longer holds in general. In this paper we present a condition for a comparison theorem to hold for backward stochastic differential equations based on arbitrary martingales. This theorem applies to both vector and scalar situations. Applications to the theory of nonlinear expectations are also explored.

In this paper we study the asymptotic normality of discrete-time Markov control processes in Borel spaces, with possibly unbounded cost. Under suitable hypotheses, we show that the cost sequence is asymptotically normal. As a special case, we obtain a central limit theorem for (noncontrolled) Markov chains.

This paper investigates the linear minimum mean-square error estimation for discrete-time Markovian jump linear systems with delayed measurements. The key technique applied for treating the measurement delay is reorganization innovation analysis, by which the state estimation with delayed measurements is transformed into a standard linear mean-square filter of an associated delay-free system. The optimal filter is derived based on the innovation analysis method together with geometric arguments in an appropriate Hilbert space. The solution is given in terms of two Riccati difference equations. Finally, a simulation example is presented to illustrate the efficiency of the proposed method.

We study a stochastic differential game between two insurance companies who employ reinsurance to reduce the risk of exposure. Under the assumption that the companies have large insurance portfolios compared to any individual claim size, their surplus processes can be approximated by stochastic differential equations. We formulate competition between the two companies as a game with a single payoff function which depends on the surplus processes. One company chooses a dynamic reinsurance strategy in order to maximize this expected payoff, while the other company simultaneously chooses a dynamic reinsurance strategy so as to minimize the same quantity. We describe the Nash equilibrium of this stochastic differential game and solve it explicitly for the case of maximizing/minimizing the exit probability.

We consider variance-optimal hedging in general continuous-time affine stochastic volatility models. The optimal hedge and the associated hedging error are determined semiexplicitly in the case that the stock price follows a martingale. The integral representation of the solution opens the door to efficient numerical computation. The setup includes models with jumps in the stock price and in the activity process. It also allows for correlation between volatility and stock price movements. Concrete parametric models will be illustrated in a forthcoming paper.

This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the α-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.

In this paper we study m-discount optimality (m ≥ −1) and Blackwell optimality for a general class of controlled (Markov) diffusion processes. To this end, a key step is to express the expected discounted reward function as a Laurent series, and then search certain control policies that lexicographically maximize the mth coefficient of this series for m = −1,0,1,…. This approach naturally leads to m-discount optimality and it gives Blackwell optimality in the limit as m → ∞.

The aim of this paper is to investigate the almost sure stability with a certain rate function λ(t) for a class of stochastic evolution equations in infinite dimensional spaces under various sufficient conditions. The results obtained here include exponential and polynomial stability as special cases. Much more refined sufficient conditions than the usual ones, for example, those described in [14], are obtained under our framework by the method of Liapunov functions. Two examples are given to illustrate our theory.

We consider Monte Carlo methods for the classical nonlinear filtering problem. The first method is based on a backward pathwise filtering equation and the second method is related to a backward linear stochastic partial differential equation. We study convergence of the proposed numerical algorithms. The considered methods have such advantages as a capability in principle to solve filtering problems of large dimensionality, reliable error control, and recurrency. Their efficiency is achieved due to the numerical procedures which use effective numerical schemes and variance reduction techniques. The results obtained are supported by numerical experiments.

We consider a modified version of the classical optimal dividends problem of de Finetti in which the objective function is altered by adding in an extra term which takes account of the ruin time of the risk process, the latter being modeled by a spectrally negative Lévy process. We show that, with the exception of a small class, a barrier strategy forms an optimal strategy under the condition that the Lévy measure has a completely monotone density. As a prerequisite for the proof, we show that, under the aforementioned condition on the Lévy measure, the q-scale function of the spectrally negative Lévy process has a derivative which is strictly log-convex.

Throughout recent years, various sequential Monte Carlo methods, i.e. particle filters, have been widely applied to various applications involving the evaluation of the generally intractable stochastic discrete-time filter. Although convergence results exist for finite-time intervals, a stronger form of convergence, namely, uniform convergence, is required for bounding the error on an infinite-time interval. In this paper we prove easily verifiable conditions for the filter applications that are sufficient for the uniform convergence of certain particle filters. Essentially, the conditions require the observations to be accurate enough. No mixing or ergodicity conditions are imposed on the signal process.

A controlled heterogeneous collection of identical items is presented. According to their level of wear and tear, they are divided into a finite number of classes and the partition of the collection is allowed to change over time. A suitable exchangeability assumption is made to preserve the property that the items be identical. The role of the occupation numbers is investigated and a filtering problem is set up, where the observation is the cardinality of a particular class. A control on the dynamics of the items is introduced, and the existence of an optimal control is proved. A discrete-time approximation for the separated problem, which is a finite-dimensional one, is performed. As a consequence, an approximation for the value function is given.

Let X and Y be two simple symmetric continuous-time random walks on the vertices of the n-dimensional hypercube, Z 2 n . We consider the class of co-adapted couplings of these processes, and describe an intuitive coupling which is shown to be the fastest in this class.

We study the problem of maximizing the long-run average growth of total wealth for a logarithmic utility function under the existence of fixed and proportional transaction costs. The market model consists of one riskless asset and d risky assets. Impulsive control theory is applied to this problem. We derive a quasivariational inequality (QVI) of ‘ergodic’ type and obtain a weak solution for the inequality. Using this solution, we obtain an optimal investment strategy to achieve the optimal growth.

The aim of this paper is to provide the conditions necessary to reduce the complexity of state filtering for finite stochastic systems (FSSs). A concept of lumpability for FSSs is introduced. In this paper we assert that the unnormalised filter for a lumped FSS has linear dynamics. Two sufficient conditions for such a lumpability property to hold are discussed. We show that the first condition is also necessary for the lumped FSS to have linear dynamics. Next, we prove that the second condition allows the filter of the original FSS to be obtained directly from the filter for the lumped FSS. Finally, we generalise an earlier published result for the approximation of a general FSS by a lumpable FSS.

A multiarmed bandit problem is studied when the arms are not always available. The arms are first assumed to be intermittently available with some state/action-dependent probabilities. It is proven that no index policy can attain the maximum expected total discounted reward in every instance of that problem. The Whittle index policy is derived, and its properties are studied. Then it is assumed that the arms may break down, but repair is an option at some cost, and the new Whittle index policy is derived. Both problems are indexable. The proposed index policies cannot be dominated by any other index policy over all multiarmed bandit problems considered here. Whittle indices are evaluated for Bernoulli arms with unknown success probabilities.

In this paper we study the bias and the overtaking optimality criteria for continuous-time jump Markov decision processes in general state and action spaces. The corresponding transition rates are allowed to be unbounded, and the reward rates may have neither upper nor lower bounds. Under appropriate hypotheses, we prove the existence of solutions to the bias optimality equations, the existence of bias optimal policies, and an equivalence relation between bias and overtaking optimality.