Accelerating Deep Neural Networks
Deep learning models are powerful, but are often large, slow, and expensive to run. This book is a practical guide to accelerating and compressing neural networks using proven techniques such as quantization, pruning, distillation, and fast architectures. It explains how and why these methods work, fostering a comprehensive understanding. Written for engineers, researchers, and advanced students, the book combines clear theoretical insights with hands-on PyTorch implementations and numerical results. Readers will learn how to reduce inference time and memory usage, lower deployment costs, and select the right acceleration strategy for their task. Whether you're working with large language models, vision systems, or edge devices, this book gives you the tools and intuition needed to build faster, leaner AI systems, without sacrificing performance. It is perfect for anyone who wants to go beyond intuition and take a principled approach to optimizing AI systems
- Bridges the gap between research and practice by synthesizing information on acceleration techniques into a systematic and practical resource
- Allows readers to go beyond theory and immediately apply the techniques to their own models with ready-to-use implementation code
- Shows the trade-offs between different methods through numerical comparisons of speed, accuracy, and memory usage, helping readers more easily choose the best approach for their specific task
Reviews & endorsements
‘This book is a practical guide to DNN and LLM acceleration, bridging the gap between theory and practice. Moving beyond ‘black-box’ tricks, it pairs the latest techniques-like FlashAttention-with runnable code and empirical data. Readers will gain both the technical tools and the fundamental understanding to optimize models effectively.’ Masashi Sugiyama, RIKEN and University of Tokyo
‘This book effectively bridges theory and practice in accelerating deep learning. It offers clear insights into modern architectures such as Mamba, while also elucidating fundamental concepts and practical techniques for efficient deep learning. It will be a valuable resource for researchers and graduate students seeking a deep understanding of modern deep learning.’ Makoto Yamada, Okinawa Institute of Science and Technology
Product details
- Published: June 2026
- Format: Hardback
- ISBN: 9781009687089
- Length: 310 pages
- Dimensions: 229 × 152 × 19 mm
- Weight: 0.614kg
- Availability: Available
Table of Contents
- 1. Introduction
- 2. Overview of acceleration methods
- 3. Quantization and low precision
- 4. Pruning
- 5. Distillation
- 6. Low-rank approximation
- 7. Fast architectures
- 8. Tools for tuning
- 9. Efficient training
- Conclusion
- References
- Index.
- Show more