In the classical gambler’s ruin problem, the gambler plays an adversary with initial capitals z and $a-z$, respectively, where $a>0$ and $0< z < a$ are integers. At each round, the gambler wins or loses a dollar with probabilities p and $1-p$. The game continues until one of the two players is ruined. For even a and $0<z\leq {a}/{2}$, the family of distributions of the duration (total number of rounds) of the game indexed by $p \in [0,{\frac{1}{2}}]$ is shown to have monotone (increasing) likelihood ratio, while for ${a}/{2} \leq z<a$, the family of distributions of the duration indexed by $p \in [{\frac{1}{2}}, 1]$ has monotone (decreasing) likelihood ratio. In particular, for $z={a}/{2}$, in terms of the likelihood ratio order, the distribution of the duration is maximized over $p \in [0,1]$ by $p={\frac{1}{2}}$. The case of odd a is also considered in terms of the usual stochastic order. Furthermore, as a limit, the first exit time of Brownian motion is briefly discussed.

We consider a birth–death process with killing where transitions from state i may go to either state $i-1$ or state $i+1$ or an absorbing state (killing). Stochastic ordering results on the killing time are derived. In particular, if the killing rate in state i is monotone in i, then the distribution of the killing time with initial state i is stochastically monotone in i. This result is a consequence of the following one for a non-negative tri-diagonal matrix M: if the row sums of M are monotone, so are the row sums of $M^n$ for all $n\ge 2$ .

In the subject of optimal stopping, the classical secretary problem is concerned with optimally selecting the best of n candidates when their relative ranks are observed sequentially. This problem has been extended to optimally selecting the kth best candidate for k ≥ 2. While the optimal stopping rule for k=1,2 (and all n ≥ 2) is known to be of threshold type (involving one threshold), we solve the case k=3 (and all n ≥ 3) by deriving an explicit optimal stopping rule that involves two thresholds. We also prove several inequalities for p(k, n), the maximum probability of selecting the k-th best of n candidates. It is shown that (i) p(1, n) = p(n, n) > p(k, n) for 1<k<n, (ii) p(k, n) ≥ p(k, n + 1), (iii) p(k, n) ≥ p(k + 1, n + 1) and (iv) p(k, ∞): = lim n→∞p(k, n) is decreasing in k.

Recently, Chen, Hsiau & Yang [1] proposed a new two-urn model with red and white balls and showed that the fractions of red balls in both urns converge almost surely to the same limit. We extend the results for the two-urn model to the q-urn model (q≥3) with similar dynamics of drawing and adding balls. We use matrix forms and martingale theory to show that the fractions of red balls in all urns converge almost surely to the same limit.

We propose a two-urn model of Pólya type as follows. There are two urns, urn A and urn B. At the beginning, urn A contains rA red and wA white balls and urn B contains rB red and wB white balls. We first draw m balls from urn A and note their colors, say i red and m - i white balls. The balls are returned to urn A and bi red and b(m - i) white balls are added to urn B. Next, we draw ℓ balls from urn B and note their colors, say j red and ℓ - j white balls. The balls are returned to urn B and aj red and a(ℓ - j) white balls are added to urn A. Repeat the above action n times and let Xn be the fraction of red balls in urn A and Yn the fraction of red balls in urn B. We first show that the expectations of Xn and Yn have the same limit, and then use martingale theory to show that Xn and Yn converge almost surely to the same limit.

Suppose that I1, I2,… is a sequence of independent Bernoulli random variables with E(In) = λ/(λ + n − 1), n = 1, 2,…. If λ is a positive integer k, {In}n≥1 can be interpreted as a k-record process of a sequence of independent and identically distributed random variables with a common continuous distribution. When In−1In = 1, we say that a consecutive k-record occurs at time n. It is known that the total number of consecutive k-records is Poisson distributed with mean k. In fact, for general is Poisson distributed with mean λ. In this paper, we want to find an optimal stopping time τλ which maximizes the probability of stopping at the last n such that In−1In = 1. We prove that τλ is of threshold type, i.e. there exists a tλ ∈ ℕ such that τλ = min{n | n ≥ tλ, In−1In = 1}. We show that tλ is increasing in λ and derive an explicit expression for tλ. We also compute the maximum probability Qλ of stopping at the last consecutive record and study the asymptotic behavior of Qλ as λ → ∞.

In a two-person red-and-black game, each player holds an integral amount of chips. At each stage of the game, each player can bet any integral amount in his possession, winning the chips of his opponent with a probability which is a function of the ratio of his bet to the sum of both players' bets and is called a win probability function. Both players seek to maximize the probability of winning the entire fortune of his opponent. In this paper we propose two new models. In the first model, at each stage, there is a positive probability that two players exchange their bets. In the second model, the win probability functions are stage dependent. In both models, we obtain suitable conditions on the win probability functions such that it is a Nash equilibrium for the subfair player to play boldly and for the superfair player to play timidly.

In the subfair red-and-black gambling problem, a gambler can stake any amount in his possession, winning an amount equal to the stake with probability w and losing the stake with probability 1 − w, where 0 < w < ½. The gambler seeks to maximize the probability of reaching a fixed fortune (to be normalized to unity) by gambling repeatedly with suitably chosen stakes. In their classic work, Dubins and Savage (1965), (1976) showed that it is optimal to play boldly. When there is a house limit of l (0 < l < ½), so that the gambler can stake no more than l, Wilkins (1972) showed that bold play remains optimal provided that 1 / l is an integer. On the other hand, building on an earlier surprising result of Heath, Pruitt and Sudderth (1972), Schweinsberg (2005) recently showed that, for all irrational 0 < l < ½ and all 0 < w < ½, bold play is not optimal for some initial fortune. The purpose of the present paper is to present several results supporting the conjecture that, for all rational l with 1 / l not an integer and all 0 < w < ½, bold play is not optimal for some initial fortune. While most of these results are based on Schweinsberg's method, in a special case where his method is shown to be inapplicable, we argue that the conjecture can be verified with the help of symbolic-computation software.

In this paper a two-person red-and-black game is investigated. We suppose that, at every stage of the game, player I's win probability, f, is a function of the ratio of his bet to the sum of both players' bets. Two results are given: (i) if f is convex then a bold strategy is optimal for player I when player II plays timidly; and (ii) if f satisfies f(s)f(t) ≤ f(st) then a timid strategy is optimal for player II when player I plays boldly. These two results extend two formulations of red-and-black games proposed by Pontiggia (2005), and also provide a sufficient condition to ensure that the profile (bold, timid) is the unique Nash equilibrium for players I and II. Finally, we give a counterexample to Pontiggia's conjecture about a proportional N-person red-and-black game.

We drive a car along a street towards our destination and look for an available parking place without turning around. Each parking place is associated with a loss which decreases with the distance of the parking place from our destination. Assume that the states (empty or filled) of the parking places form a Markov chain. We want to find an optimal parking strategy to minimize the expected loss. A curious example is constructed and two sufficient conditions for the existence of the threshold-type optimal parking strategy are given.

In a sequence of Markov-dependent trials, the optimal strategy which maximizes the probability of stopping on the last success is considered. Both homogeneous Markov chains and nonhomogeneous Markov chains are studied. For the homogeneous case, the analysis is divided into two parts and both parts are realized completely. For the nonhomogeneous case, we prove a result which contains the result of Bruss (2000) under an independence structure.

This paper establishes a compound Poisson limit theorem for the sum of a sequence of multi-state Markov chains. Our theorem generalizes an earlier one by Koopman for the two-state Markov chain. Moreover, a similar approach is used to derive a limit theorem for the sum of the k th-order two-state Markov chain.