Structured Representation Learning (eBook)

From Homomorphisms and Disentanglement to Equivariance and Topography

Yue Song, Thomas Anderson Keller, Nicu Sebe, Max Welling (Autoren)

eBook Download: PDF

2025 | 1. Auflage
XXVII, 140 Seiten
Springer-Verlag
978-3-031-88111-4 (ISBN)

Infos

This book introduces approaches to generalize the benefits of equivariant deep learning to a broader set of learned structures through learned homomorphisms.  In the field of machine learning, the idea of incorporating knowledge of data symmetries into artificial neural networks is known as equivariant deep learning and has led to the development of cutting edge architectures for image and physical data processing. The power of these models originates from data-specific structures ingrained in them through careful engineering.  To-date however, the ability for practitioners to build such a structure into models is limited to situations where the data must exactly obey specific mathematical symmetries.  The authors discuss naturally inspired inductive biases, specifically those which may provide types of efficiency and generalization benefits through what are known as homomorphic representations, a new general type of structured representation inspired from techniques in physics and neuroscience.  A review of some of the first attempts at building models with learned homomorphic representations are introduced.  The authors demonstrate that these inductive biases improve the ability of models to represent natural transformations and ultimately pave the way to the future of efficient and effective artificial neural networks. 

Produkt-Details

• Erscheint lt. Verlag: 18.5.2025
• Reihe/Serie: Synthesis Lectures on Computer Vision
• Zusatzinfo: XXVII, 140 p. 56 illus., 49 illus. in color.
• Sprache: englisch
• Themenwelt: Mathematik / Informatik ► Informatik ► Grafik / Design
• Themenwelt: Informatik ► Theorie / Studium ► Künstliche Intelligenz / Robotik
• Themenwelt: Mathematik / Informatik ► Mathematik ► Statistik
• Schlagworte: Disentangled Representation Learning • Equivariant Neural Networks • generative models • Learned Homomorphisms • Structured Representation Learning • variational autoencoders
• ISBN-10: 3-031-88111-7 / 3031881117
• ISBN-13: 978-3-031-88111-4 / 9783031881114