Skip to content
Register Sign in Wishlist

High-Dimensional Statistics
A Non-Asymptotic Viewpoint

Part of Cambridge Series in Statistical and Probabilistic Mathematics

  • Date Published: February 2019
  • availability: Available
  • format: Hardback
  • isbn: 9781108498029


Add to wishlist

Other available formats:

Looking for an inspection copy?

Please email to enquire about an inspection copy of this book

Product filter button
About the Authors
  • Recent years have witnessed an explosion in the volume and variety of data collected in all scientific disciplines and industrial settings. Such massive data sets present a number of challenges to researchers in statistics and machine learning. This book provides a self-contained introduction to the area of high-dimensional statistics, aimed at the first-year graduate level. It includes chapters that are focused on core methodology and theory - including tail bounds, concentration inequalities, uniform laws and empirical process, and random matrices - as well as chapters devoted to in-depth exploration of particular model classes - including sparse linear models, matrix models with rank constraints, graphical models, and various types of non-parametric models. With hundreds of worked examples and exercises, this text is intended both for courses and for self-study by graduate students and researchers in statistics, machine learning, and related fields who must understand, apply, and adapt modern statistical methods suited to large-scale data.

    • Almost 200 worked examples support the reader in building practical intuition and understanding the motivation for the theory
    • Contains over 250 exercises - ranging in difficulty from easy to challenging - which strengthen learning, with solutions available to instructors
    • The book is organized for teaching and learning, allowing instructors to choose one of several identified paths depending on course length
    Read more

    Reviews & endorsements

    'Non-asymptotic, high-dimensional theory is critical for modern statistics and machine learning. This book is unique in providing a crystal clear, complete and unified treatment of the area. With topics ranging from concentration of measure to graphical models, the author weaves together probability theory and its applications to statistics. Ideal for graduate students and researchers. This will surely be the standard reference on the topic for many years.' Larry Wasserman, Carnegie Mellon University, Pennsylvania

    'Martin J. Wainwright brings his large box of analytical power tools to bear on the problems of the day - the analysis of models for wide data. A broad knowledge of this new area combines with his powerful analytical skills to deliver this impressive and intimidating work - bound to be an essential reference for all the brave souls that try their hand.' Trevor Hastie, Stanford University, California

    'This book provides an excellent treatment of perhaps the fastest growing area within high-dimensional theoretical statistics - non-asymptotic theory that seeks to provide probabilistic bounds on estimators as a function of sample size and dimension. It offers the most thorough, clear, and engaging coverage of this area to date, and is thus poised to become the definitive reference and textbook on this topic.' Genevera Allen, William Marsh Rice University, Texas

    'Statistical theory and practice have undergone a renaissance in the past two decades, with intensive study of high-dimensional data analysis. No researcher has deepened our understanding of high-dimensional statistics more than Martin Wainwright. This book brings the signature clarity and incisiveness of his published research into book form. It will be a fantastic resource for both beginning students and seasoned researchers, as the field continues to make exciting breakthroughs.' John Lafferty, Yale University, Connecticut

    'This is an outstanding book on high-dimensional statistics, written by a creative and celebrated researcher in the field. It gives comprehensive treatments on many important topics in statistical machine learning and, furthermore, is self-contained, from introductory materials to most updated results on various research frontiers. This book is a must-read for those who wish to learn and to develop modern statistical machine theory, methods and algorithms.' Jianqing Fan, Princeton University, New Jersey

    'This book provides an in-depth mathematical treatment and methodological intuition of high-dimensional statistics. The main technical tools from probability theory are carefully developed and the construction and analysis of statistical methods and algorithms for high-dimensional problems is presented in an outstandingly clear way. Martin J. Wainwright has written a truly exceptional, inspiring and beautiful masterpiece!' Peter Bühlmann, Eidgenössische Technische Hochschule Zürich

    'This new book by Martin J. Wainwright covers modern topics in high-dimensional statistical inference, and focuses primarily on explicit non-asymptotic results related to sparsity and non-parametric estimation. This is a must-read for all graduate students in mathematical statistics and theoretical machine learning, both for the breadth of recent advances it covers and the depth of results which are presented. The exposition is outstandingly clear, starting from the first introductory chapters on the necessary probabilistic tools. Then, the book covers state-of-the-art advances in high-dimensional statistics, with always a clever choice of results which have the perfect mix of significance and mathematical depth.' Francis Bach, INRIA Paris

    'Wainwright's book on those parts of probability theory and mathematical statistics critical to understanding of the new phenomena encountered in high dimensions is marked by the clarity of its presentation and the depth to which it travels. In every chapter he starts with intuitive examples and simulations which are systematically developed either into powerful mathematical tools or complete answers to fundamental questions of inference. It is not easy, but elegant and rewarding whether read systematically or dipped into as a reference.' Peter Bickel, University of California, Berkeley

    '… this is a very valuable book, covering a variety of important topics, self-contained and nicely written.' Fabio Mainardi, MAA Reviews

    'This is an excellent book. It provides a lucid, accessible and in-depth treatment of nonasymptotic high-dimensional statistical theory, which is critical as the underpinning of modern statistics and machine learning. It succeeds brilliantly in providing a self-contained overview of high-dimensional statistics, suitable for use in formal courses or for self-study by graduate-level students or researchers. The treatment is outstandingly clear and engaging, and the production is first-rate. It will quickly become essential reading and the key reference text in the field.' G. Alastair Young, International Statistical Review

    'Martin Wainwright takes great care to polish every sentence of each part of the book. He introduces state-of-the-art theory in every chapter, as should probably be expected from an acknowledged specialist of the field. But it is certainly an enormous amount of work to organize all these results in a complete, coherent, rigorous yet easy-to-follow theory. I am simply amazed by the quality of the writing. The explanations on the motivations (Chapter 1) and on the core of the theory are extremely pedagogical. The proofs of the main results are rigorous and complete, but most of them are also built in a way that makes them seem easier to the reader than they actually are. This is the kind of magic only a few authors are capable of.' Pierre Alquier, MatSciNet

    '... provides a masterful exposition of various mathematical tools that are becoming increasingly common in the analysis of contemporary statistical problems. In addition to providing a rigorous and comprehensive overview of these tools, the author delves into the details of many illustrative examples to provide a convincing case for the general usefulness of the methods that are introduced.' Po-Ling Lo, Bulletin of the American Mathematical Society

    'An excellent statistical masterpiece is in the hands of the reader, which is a must read book for all graduate students in both mathematical statistics and mathematical machine learning.' Rózsa Horváth-Bokor, ZB Math Reviews

    See more reviews

    Customer reviews

    Not yet reviewed

    Be the first to review

    Review was not posted due to profanity


    , create a review

    (If you're not , sign out)

    Please enter the right captcha value
    Please enter a star rating.
    Your review must be a minimum of 12 words.

    How do you rate this item?


    Product details

    • Date Published: February 2019
    • format: Hardback
    • isbn: 9781108498029
    • length: 568 pages
    • dimensions: 260 x 183 x 35 mm
    • weight: 1.2kg
    • contains: 49 b/w illus. 1 table 211 exercises
    • availability: Available
  • Table of Contents

    1. Introduction
    2. Basic tail and concentration bounds
    3. Concentration of measure
    4. Uniform laws of large numbers
    5. Metric entropy and its uses
    6. Random matrices and covariance estimation
    7. Sparse linear models in high dimensions
    8. Principal component analysis in high dimensions
    9. Decomposability and restricted strong convexity
    10. Matrix estimation with rank constraints
    11. Graphical models for high-dimensional data
    12. Reproducing kernel Hilbert spaces
    13. Nonparametric least squares
    14. Localization and uniform laws
    15. Minimax lower bounds
    Author index
    Subject index.

  • Author

    Martin J. Wainwright, University of California, Berkeley
    Martin J. Wainwright is a Chancellor's Professor at the University of California, Berkeley, with a joint appointment between the Department of Statistics and the Department of Electrical Engineering and Computer Sciences. His research lies at the nexus of statistics, machine learning, optimization, and information theory, and he has published widely in all of these disciplines. He has written two other books, one on graphical models together with Michael I. Jordan, and one on sparse learning together with Trevor Hastie and Robert Tibshirani. Among other awards, he has received the COPSS Presdients' Award, has been a Medallion Lecturer and Blackwell Lecturer for the Institute of Mathematical Statistics, and has received Best Paper Awards from the Neural Information Processing Systems (NIPS), the International Conference on Machine Learning (ICML), and the Uncertainty in Artificial Intelligence (UAI) conferences, as well as from the Institute of Electrical and Electronics Engineers (IEEE) Information Theory Society.

Related Books

Sorry, this resource is locked

Please register or sign in to request access. If you are having problems accessing these resources please email

Register Sign in
Please note that this file is password protected. You will be asked to input your password on the next screen.

» Proceed

You are now leaving the Cambridge University Press website. Your eBook purchase and download will be completed by our partner Please see the permission section of the catalogue page for details of the print & copy limits on our eBooks.

Continue ×

Continue ×

Continue ×
warning icon

Turn stock notifications on?

You must be signed in to your Cambridge account to turn product stock notifications on or off.

Sign in Create a Cambridge account arrow icon

Find content that relates to you

Join us online

This site uses cookies to improve your experience. Read more Close

Are you sure you want to delete your account?

This cannot be undone.


Thank you for your feedback which will help us improve our service.

If you requested a response, we will make sure to get back to you shortly.

Please fill in the required fields in your feedback submission.