In this paper, we consider an optimal distributed control problem for a reaction-diffusion-based SIR epidemic model with human behavioural effects. We develop a model wherein non-pharmaceutical intervention methods are implemented, but a portion of the population does not comply with them, and this non-compliance affects the spread of the disease. Drawing from social contagion theory, our model allows for the spread of non-compliance parallel to the spread of the disease. The quantities of interest for control are the reduction in infection rate among the compliant population, the rate of spread of non-compliance and the rate at which non-compliant individuals become compliant after, e.g., receiving more or better information about the underlying disease. We prove the existence of global-in-time solutions for fixed controls and study the regularity properties of the resulting control-to-state map. The existence of optimal control is then established in an abstract framework for a fairly general class of objective functions. Necessary first–order optimality conditions are obtained via a Lagrangian-based stationarity system. We conclude with a discussion regarding minimisation of the size of infected and non-compliant populations and present simulations with various parameters values to demonstrate the behaviour of the model.

Bioreactor scaffolds must be designed to facilitate adequate nutrient delivery to the growing tissue they support. For perfusion bioreactors, the dominant transport process is determined by the scale of fluid velocity relative to diffusion and the geometry of the scaffold. In this paper, models of nutrient transport in a fibrous bioreactor scaffold are developed using homogenisation via multiscale asymptotics. The scaffold is modelled as an ensemble of aligned strings surrounded by viscous, slowly flowing fluid. Multiple scales analysis is carried out for various parameter regimes which give rise to macroscale transport models that incorporate the effects of advection, reaction and diffusion. Multiple scales in both space and time are employed when macroscale advection balances macroscale diffusion. The microscale model is solved to obtain the effective diffusion coefficient and simple solutions to the macroscale problem are presented for each regime.

Adversarial training is a min-max optimization problem that is designed to construct robust classifiers against adversarial perturbations of data. We study three models of adversarial training in the multiclass agnostic-classifier setting. We prove the existence of Borel measurable robust classifiers in each model and provide a unified perspective of the adversarial training problem, expanding the connections with optimal transport initiated by the authors in their previous work [21]. In addition, we develop new connections between adversarial training in the multiclass setting and total variation regularization. As a corollary of our results, we provide an alternative proof of the existence of Borel measurable solutions to the agnostic adversarial training problem in the binary classification setting.

Minimizing an adversarial surrogate risk is a common technique for learning robust classifiers. Prior work showed that convex surrogate losses are not statistically consistent in the adversarial context – or in other words, a minimizing sequence of the adversarial surrogate risk will not necessarily minimize the adversarial classification error. We connect the consistency of adversarial surrogate losses to properties of minimizers to the adversarial classification risk, known as adversarial Bayes classifiers. Specifically, under reasonable distributional assumptions, a convex surrogate loss is statistically consistent for adversarial learning iff the adversarial Bayes classifier satisfies a certain notion of uniqueness.

We consider the chemotaxis-Navier–Stokes system with generalised fluid dissipation in $\mathbb{R}^3$:

\begin{eqnarray*} \begin{cases} \partial _t n+u\cdot \nabla n=\Delta n- \nabla \cdot (\chi (c)n \nabla c),\\[5pt] \partial _t c+u \cdot \nabla c=\Delta c-nf(c),\\[5pt] \partial _t u +u \cdot \nabla u+\nabla P=-(\!-\Delta )^\alpha u-n\nabla \phi, \\[5pt] \nabla \cdot u=0, \end{cases} \end{eqnarray*}

$\alpha \gt \frac {3}{4}$

$\tilde {\textrm {a}}$

$\alpha \gt \frac {1}{2}$

$\alpha \geq \frac {5}{4}$

$\frac {3}{4}\lt \alpha \lt \frac {5}{4}$

$L^2$

We study the long-time asymptotics for the solution of the modified Camassa–Holm (mCH) equation with step-like initial data.

\begin{align*} &m_{t}+\left (m\left (u^{2}-u_{x}^{2}\right )\right )_{x}=0, \quad m=u-u_{xx}, \\[3pt] & {u(x,0)=u_0(x)\to \left \{ \begin{array}{l@{\quad}l} 1/c_+, &\ x\to +\infty, \\[3pt] 1/c_-, &\ x\to -\infty, \end{array}\right .} \end{align*}

$c_+$

$c_-$

$(y,t)$

$(\xi, c)$

$c=c_+/c_-$

$\{ (\xi, c)\,:\, \xi \in \mathbb{R}, \ c\gt 0, \ \xi =y/t\}$

$u(y,t)$

$\mathcal{O}(t^{-2})$

$\mathcal{O}(t^{-1})$

In recent years, there has been significant interest in the effect of different types of adversarial perturbations in data classification problems. Many of these models incorporate the adversarial power, which is an important parameter with an associated trade-off between accuracy and robustness. This work considers a general framework for adversarially perturbed classification problems, in a large data or population-level limit. In such a regime, we demonstrate that as adversarial strength goes to zero that optimal classifiers converge to the Bayes classifier in the Hausdorff distance. This significantly strengthens previous results, which generally focus on $L^1$-type convergence. The main argument relies upon direct geometric comparisons and is inspired by techniques from geometric measure theory.

Deep neural networks and other modern machine learning models are often susceptible to adversarial attacks. Indeed, an adversary may often be able to change a model’s prediction through a small, directed perturbation of the model’s input – an issue in safety-critical applications. Adversarially robust machine learning is usually based on a minmax optimisation problem that minimises the machine learning loss under maximisation-based adversarial attacks. In this work, we study adversaries that determine their attack using a Bayesian statistical approach rather than maximisation. The resulting Bayesian adversarial robustness problem is a relaxation of the usual minmax problem. To solve this problem, we propose Abram – a continuous-time particle system that shall approximate the gradient flow corresponding to the underlying learning problem. We show that Abram approximates a McKean–Vlasov process and justify the use of Abram by giving assumptions under which the McKean–Vlasov process finds the minimiser of the Bayesian adversarial robustness problem. We discuss two ways to discretise Abram and show its suitability in benchmark adversarial deep learning experiments.

Asymptotic homogenisation is considered for problems with integral constraints imposed on a slowly varying microstructure; an insulator with an array of perfectly dielectric inclusions of slowly varying size serves as a paradigm. Although it is well-known how to handle each of these effects (integral constraints, slowly varying microstructure) independently within multiple scales analysis, additional care is needed when they are combined. Using the flux transport theorem, the multiple scales form of an integral constraint on a slowly varying domain is identified. The proposed form is applied to obtain a homogenised model for the electric potential in a dielectric composite, where the microstructure slowly varies and the integral constraint arises due to a statement of charge conservation. A comparison with multiple scales analysis of the problem with established approaches provides validation that the proposed form results in the correct homogenised model.

We consider local and nonlocal Cahn–Hilliard equations with constant mobility and singular potentials including, e.g., the Flory–Huggins potential, subject to no-flux (or periodic) boundary conditions. The main goal is to show that the presence of a suitable class of reaction terms allows to establish the existence of a weak solution to the corresponding initial and boundary value problem even though the initial condition is a pure state. This fact was already observed by the authors in a previous contribution devoted to a specific biological model. In this context, we examine the essential assumptions required for the reaction term to ensure the existence of a weak solution. Also, we explore the scenario involving the nonlocal Cahn–Hilliard equation and provide some illustrative examples that contextualize within our abstract framework.

This work investigates the online machine learning problem of prediction with expert advice in an adversarial setting through numerical analysis of, and experiments with, a related partial differential equation. The problem is a repeated two-person game involving decision-making at each step informed by $n$ experts in an adversarial environment. The continuum limit of this game over a large number of steps is a degenerate elliptic equation whose solution encodes the optimal strategies for both players. We develop numerical methods for approximating the solution of this equation in relatively high dimensions ($n\leq 10$) by exploiting symmetries in the equation and the solution to drastically reduce the size of the computational domain. Based on our numerical results we make a number of conjectures about the optimality of various adversarial strategies, in particular about the non-optimality of the COMB strategy.

A popular method to perform adversarial attacks on neural networks is the so-called fast gradient sign method and its iterative variant. In this paper, we interpret this method as an explicit Euler discretization of a differential inclusion, where we also show convergence of the discretization to the associated gradient flow. To do so, we consider the concept of $p$-curves of maximal slope in the case $p=\infty$. We prove existence of $\infty$-curves of maximum slope and derive an alternative characterization via differential inclusions. Furthermore, we also consider Wasserstein gradient flows for potential energies, where we show that curves in the Wasserstein space can be characterized by a representing measure on the space of curves in the underlying Banach space, which fulfil the differential inclusion. The application of our theory to the finite-dimensional setting is twofold: On the one hand, we show that a whole class of normalized gradient descent methods (in particular, signed gradient descent) converge, up to subsequences, to the flow when sending the step size to zero. On the other hand, in the distributional setting, we show that the inner optimization task of adversarial training objective can be characterized via $\infty$-curves of maximum slope on an appropriate optimal transport space.

We present a novel multiscale mathematical model of espresso brewing. The model captures liquid infiltration and flow through a packed bed of ground coffee, as well as coffee solubles transport (both in the grains and in the liquid) and solubles dissolution. During infiltration, a sharp interface separates the dry and wet regions of the bed. A matched asymptotic analysis (based on fast dissolution rates) reveals that the bed can be described by four asymptotic regions: a dry region yet to be infiltrated by the liquid, a region in which the liquid is saturated with solubles and very little dissolution occurs, a slender region in which solubles are rapidly extracted from the smallest grains, and region in which slower extraction occurs from larger grains. The position and extent of each of these regions move with time (one being an intrinsic moving internal boundary layer) making the asymptotic analysis intriguing in its own right. The analysis yields a reduced model that elucidates the rate-limiting physical processes. Numerical solutions of the reduced model are compared to those to the full model, demonstrating that the reduced model is both accurate and significantly cheaper to solve.

Machine learning has exhibited substantial success in the field of natural language processing (NLP). For example, large language models have empirically proven to be capable of producing text of high complexity and cohesion. However, at the same time, they are prone to inaccuracies and hallucinations. As these systems are increasingly integrated into real-world applications, ensuring their safety and reliability becomes a primary concern. There are safety critical contexts where such models must be robust to variability or attack and give guarantees over their output. Computer vision had pioneered the use of formal verification of neural networks for such scenarios and developed common verification standards and pipelines, leveraging precise formal reasoning about geometric properties of data manifolds. In contrast, NLP verification methods have only recently appeared in the literature. While presenting sophisticated algorithms in their own right, these papers have not yet crystallised into a common methodology. They are often light on the pragmatical issues of NLP verification, and the area remains fragmented. In this paper, we attempt to distil and evaluate general components of an NLP verification pipeline that emerges from the progress in the field to date. Our contributions are twofold. First, we propose a general methodology to analyse the effect of the embedding gap – a problem that refers to the discrepancy between verification of geometric subspaces, and the semantic meaning of sentences which the geometric subspaces are supposed to represent. We propose a number of practical NLP methods that can help to quantify the effects of the embedding gap. Second, we give a general method for training and verification of neural networks that leverages a more precise geometric estimation of semantic similarity of sentences in the embedding space and helps to overcome the effects of the embedding gap in practice.

In the second part of this series of papers, we address the same evolution problem that was considered in part 1 (see [16]), namely the nonlocal Fisher-KPP equation in one spatial dimension,

\begin{equation*} u_t = D u_{xx} + u(1-\phi *u), \end{equation*}

$\phi *u$

$\phi (y) \equiv H\left (\frac {1}{4}-y^2\right )$

$[0,a]$

In deep learning (DL), the instability phenomenon is widespread and well documented, and the most commonly used measure of stability is the Lipschitz constant. While a small Lipchitz constant is traditionally viewed as guarantying stability, it does not capture the instability phenomenon in DL for classification well. The reason is that a classification function – which is the target function to be approximated – is necessarily discontinuous, thus having an ‘infinite’ Lipchitz constant. As a result, the classical approach will deem every classification function unstable, yet basic classification functions a la ‘is there a cat in the image?’ will typically be locally very ‘flat’ – and thus locally stable – except at the decision boundary. The lack of an appropriate measure of stability hinders a rigorous theory for stability in DL, and consequently, there are no proper approximation theoretic results that can guarantee the existence of stable networks for classification functions. In this paper, we introduce a novel stability measure $\mathcal{S}(f)$, for any classification function $f$, appropriate to study the stability of classification functions and their approximations. We further prove two approximation theorems: First, for any $\epsilon \gt 0$ and any classification function $f$ on a compact set, there is a neural network (NN) $\psi$, such that $\psi - f \neq 0$ only on a set of measure $\lt \epsilon$; moreover, $\mathcal{S}(\psi ) \geq \mathcal{S}(f) - \epsilon$ (as accurate and stable as $f$ up to $\epsilon$). Second, for any classification function $f$ and $\epsilon \gt 0$, there exists a NN $\psi$ such that $\psi = f$ on the set of points that are at least $\epsilon$ away from the decision boundary.

The unprecedented success of deep learning (DL) makes it unchallenged when it comes to classification problems. However, it is well established that the current DL methodology produces universally unstable neural networks (NNs). The instability problem has caused a substantial research effort – with a vast literature on so-called adversarial attacks – yet there has been no solution to the problem. Our paper addresses why there has been no solution to the problem, as we prove the following: any training procedure based on training rectified linear unit (ReLU) neural networks for classification problems with a fixed architecture will yield neural networks that are either inaccurate or unstable (if accurate) – despite the provable existence of both accurate and stable neural networks for the same classification problems. The key is that the stable and accurate neural networks must have variable dimensions depending on the input, in particular, variable dimensions is a necessary condition for stability. Our result points towards the paradox that accurate and stable neural networks exist; however, modern algorithms do not compute them. This yields the question: if the existence of neural networks with desirable properties can be proven, can one also find algorithms that compute them? There are cases in mathematics where provable existence implies computability, but will this be the case for neural networks? The contrary is true, as we demonstrate how neural networks can provably exist as approximate minimisers to standard optimisation problems with standard cost functions; however, no randomised algorithm can compute them with probability better than $1/2$.

In deep learning, interval neural networks are used to quantify the uncertainty of a pre-trained neural network. Suppose we are given a computational problem $P$ and a pre-trained neural network $\Phi _P$ that aims to solve $P$. An interval neural network is then a pair of neural networks $(\underline {\phi }, \overline {\phi })$, with the property that $\underline {\phi }(y) \leq \Phi _P(y) \leq \overline {\phi }(y)$ for all inputs $y$, where the inequalities are meant componentwise. $(\underline {\phi }, \overline {\phi })$ are specifically trained to quantify the uncertainty of $\Phi _P$, in the sense that the size of the interval $[\underline {\phi }(y),\overline {\phi }(y)]$ quantifies the uncertainty of the prediction $\Phi _P(y)$. In this paper, we investigate the phenomenon when algorithms cannot compute interval neural networks in the setting of inverse problems. We show that in the typical setting of a linear inverse problem, the problem of constructing an optimal pair of interval neural networks is non-computable, even with the assumption that the pre-trained neural network $\Phi _P$ is an optimal solution. In other words, there exist classes of training sets $\Omega$, such that there is no algorithm, even randomised (with probability $p \geq 1/2$), that computes an optimal pair of interval neural networks for each training set ${\mathcal{T}} \in \Omega$. This phenomenon happens even when we are given a pre-trained neural network $\Phi _{{\mathcal{T}}}$ that is optimal for $\mathcal{T}$. This phenomenon is intimately linked to instability in deep learning.