To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
This book offers a comprehensive introduction to Markov decision process and reinforcement learning fundamentals using common mathematical notation and language. Its goal is to provide a solid foundation that enables readers to engage meaningfully with these rapidly evolving fields. Topics covered include finite and infinite horizon models, partially observable models, value function approximation, simulation-based methods, Monte Carlo methods, and Q-learning. Rigorous mathematical concepts and algorithmic developments are supported by numerous worked examples. As an up-to-date successor to Martin L. Puterman's influential 1994 textbook, this volume assumes familiarity with probability, mathematical notation, and proof techniques. It is ideally suited for students, researchers, and professionals in operations research, computer science, engineering, and economics.
Providing comprehensive yet accessible coverage, this is the first graduate-level textbook dedicated to the mathematical theory of risk measures. It explains how economic and financial principles result in a profound mathematical theory that allows us to quantify risk in monetary terms, giving rise to risk measures. Each chapter is designed to match the length of one or two lectures, covering the core theory in a self-contained manner, with exercises included in every chapter. Additional material sections then provide further background and insights for those looking to delve deeper. This two-layer modular design makes the book suitable as the basis for diverse lecture courses of varying length and level, and a valuable resource for researchers.
While Value-at-Risk (V@R) often fails to capture the benefits of diversification, coherent and convex risk measures are developed to align with the financial intuition that diversification reduces risk.
On atomless probability spaces, all law-determined convex risk measures on Lp spaces can be represented as a supremum of integrals of Average-Value-at-Risk (AV@R) measures, demonstrating AV@R’s role as a fundamental building block.
This chapter explores various constructions of risk measures, including spectral risk measures, distortion risk measures, and moment-based risk measures, as well as risk measures generated by expected losses.
This chapter demonstrates that coherent and comonotonic additive risk measures are characterized by Choquet integrals with respect to two-alternating (submodular or concave) non-additive measures.
This chapter demonstrates that finite convex risk measures on Lp spaces (for p ∈ [1, ∞) are inherently lower semicontinuous, ensuring the validity of their dual representations, while for L∞ spaces, the Fatou property is required.
This chapter introduces financial risk as a random variable representing uncertain future gains or losses. A risk measure quantifies this uncertainty by mapping random variables to real numbers. The prominent example of Value-at-Risk (V@R) is discussed.
The Average-Value-at-Risk (AV@R) has emerged as a superior, coherent risk measure that accounts for the magnitude of potential losses beyond a given quantile and consistently favors diversification.
This chapter presents the main ideas behind measuring the risks of random vectors. The main point is that it may be possible to transfer assets between components of a vector, and so the risk measure becomes a convex set in Euclidean space.
This chapter introduces fundamental concepts of monetary risk measures and their associated acceptance sets in the context of financial risk assessment.
Law-determined risk measures assign the same risk to identically distributed random variables. On atomless probability spaces, they are characterized by their minimal penalty functions being law-determined.