Analogue imprecision in MLP training /
Hardware inaccuracy and imprecision are important considerations when implementing neural algorithms. This book presents a study of synaptic weight noise as a typical fault model for analogue VLSI realisations of MLP neural networks and examines the implications for learning and network performance....
Saved in:
Main Authors: | |
---|---|
Corporate Authors: | |
Group Author: | |
Published: |
World Scientific Pub. Co.,
|
Publisher Address: | Singapore : |
Publication Dates: | 1996. |
Literature type: | eBook |
Language: | English |
Series: |
Progress in neural processing ;
4 |
Subjects: | |
Online Access: |
http://www.worldscientific.com/worldscibooks/10.1142/3170#t=toc |
Summary: |
Hardware inaccuracy and imprecision are important considerations when implementing neural algorithms. This book presents a study of synaptic weight noise as a typical fault model for analogue VLSI realisations of MLP neural networks and examines the implications for learning and network performance. The aim of the book is to present a study of how including an imprecision model into a learning scheme as a "fault tolerance hint" can aid understanding of accuracy and precision requirements for a particular implementation. In addition the study shows how such a scheme can give rise to significant performance enhancement. |
Carrier Form: | 1 online resource (xi,178pages) : illustrations. |
Bibliography: | Includes bibliographical references (pages 165-172) and index. |
ISBN: | 9789812830012 |
CLC: | TP183 |
Contents: | 1. Introduction. 1.1. Multi-layer perceptrons. 1.2. Stochastic systems. 1.3. Chapter summary -- 2. Neural network performance metrics. 2.1. Introduction. 2.2. Fault tolerance. 2.3. Generalisation. 2.4. Learning trajectory and speed. 2.5. Chapter summary -- 3. Noise in neural implementations. 3.1. Introduction. 3.2. Implementation errors. 3.3. An implementation error model. 3.4. The mathematical model. 3.5. Chapter summary -- 4. Simulation requirements and environment. 4.1. Introduction. 4.2. Simulation requirements. 4.3. Simulation environment. 4.4. Chapter summary -- 5. Fault tolerance. 5.1. Introduction. 5.2. Test environment. 5.3. Results. 5.4. Chapter summary -- 6. Generalisation ability. 6.1. Introduction. 6.2. Test environment. 6.3. Results. 6.4. Chapter summary -- 7. Learning trajectory and speed. 7.1. Introduction. 7.2. Test aims and method. 7.3. Results. 7.4. Chapter summary -- 8. Penalty terms for fault tolerance. 8.1. Introduction. 8.2. Definition of the penalty terms. 8.3. Learning algorithms. 8.4. Practical issues. 8.5. Chapter summary -- 9. Conclusions. 9.1. Introduction. 9.2. Implications for analogue hardware. 9.3. Synaptic noise as an enhancement scheme. 9.4. Learning hints. 9.5. General conclusions. |