Normalization Techniques in Deep Learning (Synthesis Lectures on Computer Vision) （2. Aufl.）

Huang, Lei

Springer, Berlin; Springer（2026/04発売）

• 製本 Hardcover:ハードカバー版
• 商品コード 9783032199904

Full Description

This book surveys normalization techniques with a deep analysis in training deep neural networks. Normalization methods can improve the training stability, optimization efficiency, and generalization ability of deep neural networks (DNNs) and have become basic components in most state-of-the-art DNN architectures. The author provides guidelines for elaborating, understanding, and applying normalization methods. This book is ideal for readers working on the development of novel deep learning algorithms and/or their applications to solve practical problems in computer vision and machine learning. The book also serves as a resource researchers, engineers, and students who are new to the field and need to understand and train DNNs. This Second Edition builds upon the original material with the addition of more recent proposed methods and expanded technical details for new normalization methods and network architectures tailored to specific tasks.

Contents

Introduction.- Motivation and Overview of Normalization in DNNs.- A General View of Normalizing Activations.- A Framework for Normalizing Activations as Functions.- Multi-Mode and Combinational Normalization.- BN for More Robust Estimation.- Normalizing Weights.- Normalizing Gradients.- Analysis of Normalization.- Normalization in Task-specific Applications.- Summary and Discussion.