In recent works on the theory of machine learning, it has been observed that heavy tail properties of stochastic gradient descent (SGD) can be studied in the probabilistic framework of stochastic recursions. In particular, Gürbüzbalaban et al. (2021) considered a setup corresponding to linear regression for which iterations of SGD can be modelled by a multivariate affine stochastic recursion $X_n=A_nX_{n-1}+B_n$ for independent and identically distributed pairs $(A_n,B_n)$, where $A_n$ is a random symmetric matrix and $B_n$ is a random vector. However, their approach is not completely correct and, in the present paper, the problem is put into the right framework by applying the theory of irreducible-proximal matrices.

This paper introduces the general ideas for parametric integral stochastic orders, with which a continuum of parametric functions are defined as a bridge between different classes of non-parametric functions. This approach allows one to identify a parametric function class over which two given random variables may violate the non-parametric stochastic order with specific patterns. The parameter used to name the parametric function class also measures the ratio of dominance violation for the corresponding non-parametric stochastic orders. Our framework, expanding the domain of stochastic orders, covers the existing studies of almost stochastic dominance. This leads to intuitive explanations and simpler proofs of existing results and their extensions.

We consider the problem of detecting whether a power-law inhomogeneous random graph contains a geometric community, and we frame this as a hypothesis-testing problem. More precisely, we assume that we are given a sample from an unknown distribution on the space of graphs on n vertices. Under the null hypothesis, the sample originates from the inhomogeneous random graph with a heavy-tailed degree sequence. Under the alternative hypothesis, $k=o(n)$ vertices are given spatial locations and connect following the geometric inhomogeneous random graph connection rule. The remaining $n-k$ vertices follow the inhomogeneous random graph connection rule. We propose a simple and efficient test based on counting normalized triangles to differentiate between the two hypotheses. We prove that our test correctly detects the presence of the community with high probability as $n\to\infty$, and identifies large-degree vertices of the community with high probability.

We consider a population consisting of two types of individuals, each of which can produce offspring on two different islands (in particular, the islands can be interpreted as active or dormant individuals). We model the evolution of the population of each type using a two-type Feller diffusion with immigration and study the frequency of one type on each island, when the total population size on each island is forced to be constant at a dense set of times. This leads to the solution of a stochastic differential equation, which we call the asymmetric two-island frequency process. We derive properties of this process and obtain a large population limit as the total size of each island tends to infinity. Additionally, we compute the fluctuations of the process around its deterministic limit. We establish conditions under which the asymmetric two-island frequency process has a moment dual. The dual is a continuous-time two-dimensional Markov chain that can be interpreted in terms of mutation, branching, pairwise branching, coalescence, and a novel mixed selection–migration term.

We study bond and site Bernoulli percolation models on $\mathbb{Z}^d$ for $d \geq 3$ with parameter p, in both the oriented and non-oriented versions. The main macroscopic quantity of interest is the probability of long-range order, and the existence of a non-trivial threshold is well established. Precise numerical results for the threshold values are available in the literature, but mathematically rigorous bounds are mostly restricted to two-dimensional lattices. Utilizing dynamical coupling techniques, we introduce a comprehensive set of new rigorous upper bounds that corroborate existing numerical values.

Any margin of the multinomial distribution is multinomially distributed. Retaining this closure property, a family of generalized multinomial distributions is proposed. This family is characterized within multiplicative probability measures, using the Bell polynomial. The retained closure property simplifies marginal properties such as moments. The family can be obtained by conditioning independent infinitely divisible distributions on the total and also by mixing the multinomial distribution with the normalized infinitely divisible distribution. The closure property justifies a stochastic process of the family by Kolmogorov’s extension theorem. Over time, Gibbs partitions of a positive integer appear as the limiting distributions of the family.

Negative dependence in tournaments has received attention in the literature. The property of negative orthant dependence (NOD) was proved for different tournament models with a special proof for each model. For general round-robin tournaments and knockout tournaments with random draws, Malinovsky and Rinott (2023) unified and simplified many existing results in the literature by proving a stronger property, negative association (NA). For a knockout tournament with a non-random draw, they presented an example to illustrate that ${\boldsymbol{S}}$ is NOD but not NA. However, their proof is not correct. In this paper, we establish the properties of negative regression dependence (NRD), negative left-tail dependence (NLTD), and negative right-tail dependence (NRTD) for a knockout tournament with a random draw and with players being of equal strength. For a knockout tournament with a non-random draw and with equal strength, we prove that ${\boldsymbol{S}}$ is NA and NRTD, while ${\boldsymbol{S}}$ is, in general, not NRD or NLTD.

Exchangeable partitions of the integers and their corresponding mass partitions on $\mathcal{P}_{\infty} = \{\mathbf{s} = (s_{1},s_{2},\ldots)\colon s_{1} \geq s_{2} \geq \cdots \geq 0$ and $\sum_{k=1}^{\infty}s_{k} = 1\}$ play a vital role in combinatorial stochastic processes and their applications. In this work, we continue our focus on the class of Gibbs partitions of the integers and the corresponding stable Poisson–Kingman-distributed mass partitions generated by the normalized jumps of a stable subordinator with an index $\alpha \in (0,1)$, subject to further mixing. This remarkable class of infinitely exchangeable random partitions is characterized by probabilities that have Gibbs (product) form. These partitions have practical applications in combinatorial stochastic processes, random tree/graph growth models, and Bayesian statistics. The most notable class consists of random partitions generated from the two-parameter Poisson–Dirichlet distribution $\mathrm{PD}(\alpha,\theta)$. While the utility of Gibbs partitions is recognized, there is limited understanding of the broader class. Here, as a continuation of our work, we address this gap by extending the dual coagulation/fragmentation results of Pitman (1999), developed for the Poisson–Dirichlet family, to all Gibbs models and their corresponding Poisson–Kingman mass partitions, creating nested families of Gibbs partitions and mass partitions. We focus primarily on fragmentation operations, identifying which classes correspond to these operations and providing significant calculations for the resulting Gibbs partitions. Furthermore, for completion, we provide definitive results for dual coagulation operations using dependent processes. We demonstrate the applicability of our results by establishing new findings for Brownian excursion partitions, Mittag-Leffler, and size-biased generalized gamma models.

We study the bilateral preference graphs $\mathit{LK}(n, k)$ of La and Kabkab, obtained as follows. Put independent and uniform [0, 1] weights on the edges of the complete graph $K_n$. Then, each edge (i, j) is included in $\mathit{LK}(n,k)$ if it is bilaterally preferred, in the sense that it is among the k edges of lowest weight incident to vertex i, and among the k edges of lowest weight incident to vertex j. We show that $k = \log(n)$ is the connectivity threshold, solving a conjecture of La and Kabkab, and obtaining finer results about the window. We also investigate the asymptotic behavior of the average degree of vertices in $\mathit{LK}(n, k)$ as $n\rightarrow\infty$.

In this paper, we provide a new property of value at risk (VaR), which is a standard risk measure that is widely used in quantitative financial risk management. We show that the subadditivity of VaR for given loss random variables holds for any confidence level if and only if those are comonotonic. This result also gives a new equivalent condition for the comonotonicity of random vectors.

We prove large and moderate deviations for the output of Gaussian fully connected neural networks. The main achievements concern deep neural networks (i.e. when the model has more than one hidden layer) and hold for bounded and continuous pre-activation functions. However, for deep neural networks fed by a single input, we have results even if the pre-activation is ReLU. When the network is shallow (i.e. there is exactly one hidden layer), the large and moderate principles hold for quite general pre-activation functions.

We study backward stochastic difference equations (BS$\Delta$Es) driven by a d-dimensional stochastic process on a lattice, whose increments take only $d+1$ possible values that generate the lattice. Interpreting the driving process as a d-dimensional asset price process, we provide applications to an optimal investment problem and to a market equilibrium analysis, where utility functionals are defined via BS$\Delta$Es.

We investigate the asymptotic behavior of nearly unstable Hawkes processes whose regression kernel has $L^1$ norm strictly greater than 1 and close to 1 as time goes to infinity. We find that the scaling size determines the scaling behavior of the processes as in Jaisson and Rosenbaum (2015). Specifically, after a suitable rescale of $({a_T-1})/{T{\textrm{e}}^{b_TTx}}$, the limit of the sequence of Hawkes processes is deterministic. Also, with another appropriate rescaling of $1/T^2$, the sequence converges in law to an integrated Cox–Ingersoll–Ross-like process. This theoretical result may apply to model the recent COVID-19 outbreak in epidemiology and phenomena in social networks.

We consider a generalization of the forest fire model on $\mathbb{Z}_+$ with ignition at zero only, studied by Volkov (2009 ALEA 6, 399–414). Unlike that model, we allow delays in the spread of the fires and the non-zero burning time of individual ‘trees’. We obtain some general properties for this model, which cover, among others, the phenomenon of an ‘infinite fire’, not present in the original model.

Hybrid stochastic differential equations (SDEs) are a useful tool for modeling continuously varying stochastic systems modulated by a random environment, which may depend on the system state itself. In this paper we establish the pathwise convergence of solutions to hybrid SDEs using space-grid discretizations. Though time-grid discretizations are a classical approach for simulation purposes, our space-grid discretization provides a link with multi-regime Markov-modulated Brownian motions. This connection allows us to explore aspects that have been largely unexplored in the hybrid SDE literature. Specifically, we exploit our convergence result to obtain efficient and computationally tractable approximations for first-passage probabilities and expected occupation times of the solutions to hybrid SDEs. Lastly, we illustrate the effectiveness of the resulting approximations through numerical examples.

We prove a scaling limit theorem for two-type Galton–Watson branching processes with interaction. The limit theorem gives rise to a class of mixed-state branching processes with interaction used to simulate evolution for cell division affected by parasites. Such processes can also be obtained by the pathwise-unique solution to a stochastic equation system. Moreover, we present sufficient conditions for extinction with probability 1 and the exponential ergodicity in the $L^1$-Wasserstein distance of such processes in some cases.

We study two continuous-time, time-inconsistent problems for an individual who purchases life annuities and invests her wealth in a risky asset under the mean-variance criterion. In the first problem, the buyer may only purchase life annuities at a bounded, continuous rate, while in the second problem, the buyer may purchase any amount of life annuity income at any time, which results in a singular control problem. We find the individual’s time-consistent equilibrium control strategies explicitly for the two life-annuity problems by solving the corresponding extended Hamilton–Jacobi–Bellman systems of equations. We also discuss the effects of parameters on the equilibrium strategies of the two life-annuity problems.

Let $\{X_{i}\}_{i\geq1}$ be a sequence of independent and identically distributed random variables and $T\in\{1,2,\ldots\}$ a stopping time associated with this sequence. In this paper, the distribution of the minimum observation, $\min\{X_{1},X_{2},\ldots,X_{T}\}$, until the stopping time T is provided by proposing a methodology based on an appropriate change of the initial probability measure of the probability space to a truncated (shifted) one on the $X_{i}$. As an application of the aforementioned general result, the random variables $X_{1},X_{2},\ldots$ are considered to be the interarrival times (spacings) between successive appearances of events in a renewal counting process $\{Y_{t},t\geq0\}$, while the stopping time T is set to be the number of summands until the sum of the $X_{i}$ exceeds t for the first time, i.e. $T=Y_{t}+1$. Under this setup, the distribution of the minimal spacing, $D_{t}=\min\{X_{1},X_{2},\ldots,X_{Y_{t}+1}\}$, that starts in the interval [0, t] is investigated and a stochastic ordering relation for $D_{t}$ is obtained. In addition, bounds for the tail probability of $D_{t}$ are provided when the interarrival times have the increasing failure rate / decreasing failure rate property. In the special case of a Poisson process, an exact formula, as well as closed-form bounds and an asymptotic result, are derived for the tail probability of $D_{t}$. Furthermore, for renewal processes with Erlang and uniformly distributed interarrival times, exact and approximation formulae for the tail probability of $D_{t}$ are also proposed. Finally, numerical examples are presented to illustrate the aforementioned exact and asymptotic results, and practical applications are briefly discussed.

Let $\pi$ be a probability distribution in $\mathbb{R}^d$ and f a test function, and consider the problem of variance reduction in estimating $\mathbb{E}_\pi(f)$. We first construct a sequence of estimators for $\mathbb{E}_\pi (f)$, say $({1}/{k})\sum_{i=0}^{k-1} g_n(X_i)$, where the $X_i$ are samples from $\pi$ generated by the Metropolized Hamiltonian Monte Carlo algorithm and $g_n$ is the approximate solution of the Poisson equation through the weak approximate scheme recently invented by Mijatović and Vogrinc (2018). Then we prove under some regularity assumptions that the estimation error variance $\sigma_\pi^2(g_n)$ can be as arbitrarily small as the approximation order parameter $n\rightarrow\infty$. To illustrate, we confirm that the assumptions are satisfied by two typical concrete models, a Bayesian linear inverse problem and a two-component mixture of Gaussian distributions.

We establish large deviations for dynamical Schrödinger problems driven by perturbed Brownian motions when the noise parameter tends to zero. Our results show that Schrödinger bridges charge exponentially small masses outside the support of the limiting law that agrees with the optimal solution to the dynamical Monge–Kantorovich optimal transport problem. Our proofs build on mixture representations of Schrödinger bridges and establishing exponential continuity of Brownian bridges with respect to the initial and terminal points.