Advancements in Knowledge Distillation: Towards New Horizons of Intelligent Systems
Springer International Publishing (Verlag)
9783031320972 (ISBN)
The book provides a timely coverage of the paradigm of knowledge distillation-an efficient way of model compression. Knowledge distillation is positioned in a general setting of transfer learning, which effectively learns a lightweight student model from a large teacher model. The book covers a variety of training schemes, teacher-student architectures, and distillation algorithms. The book covers a wealth of topics including recent developments in vision and language learning, relational architectures, multi-task learning, and representative applications to image processing, computer vision, edge intelligence, and autonomous systems. The book is of relevance to a broad audience including researchers and practitioners active in the area of machine learning and pursuing fundamental and applied research in the area of advanced learning paradigms.
Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation.- A Geometric Perspective on Feature-Based Distillation.- Knowledge Distillation Across Vision and Language.- Knowledge Distillation in Granular Fuzzy Models by Solving Fuzzy Relation Equations.- Ensemble Knowledge Distillation for Edge Intelligence in Medical Applications.- Self-Distillation with the New Paradigm in Multi-Task Learning.- Knowledge Distillation for Autonomous Intelligent Unmanned System.
| Erscheinungsdatum | 17.06.2024 |
|---|---|
| Reihe/Serie | Studies in Computational Intelligence |
| Zusatzinfo | VIII, 232 p. 70 illus., 51 illus. in color. |
| Verlagsort | Cham |
| Sprache | englisch |
| Maße | 155 x 235 mm |
| Themenwelt | Informatik ► Theorie / Studium ► Künstliche Intelligenz / Robotik |
| Technik | |
| Schlagworte | Artificial Intelligence • Computational Intelligence • Distillation Learning • Intelligent Systems • knowledge distillation |
| ISBN-13 | 9783031320972 / 9783031320972 |
| Zustand | Neuware |
| Informationen gemäß Produktsicherheitsverordnung (GPSR) | |
| Haben Sie eine Frage zum Produkt? |
aus dem Bereich