Screen LibraryCognitive plausibility in natural language processing /
This book explores the cognitive plausibility of computational language models and why it's an important factor in their development and evaluation. The authors present the idea that more can be learned about cognitive plausibility of computational language models by linking signals of cognitiv...
Saved in:
| Main Authors: | |
|---|---|
| Group Author: | |
| Published: |
Springer,
|
| Publisher Address: | Cham, Switzerland : |
| Publication Dates: | [2024] |
| Literature type: | Book |
| Language: | English |
| Series: |
Synthesis lectures on human language technologies,
|
| Subjects: | |
| Summary: |
This book explores the cognitive plausibility of computational language models and why it's an important factor in their development and evaluation. The authors present the idea that more can be learned about cognitive plausibility of computational language models by linking signals of cognitive processing load in humans to interpretability methods that allow for exploration of the hidden mechanisms of neural models. The book identifies limitations when applying the existing methodology for representational analyses to contextualized settings and critiques the current emphasis on form over more grounded approaches to modeling language. The authors discuss how novel techniques for transfer and curriculum learning could lead to cognitively more plausible generalization capabilities in models. The book also highlights the importance of instance-level evaluation and includes thorough discussion of the ethical considerations that may arise throughout the various stages of cognitive plausibility research. |
| Carrier Form: | xi, 158 pages : illustrations (chiefly color) ; 25 cm. |
| Bibliography: | Includes bibliographical references. |
| ISBN: |
9783031432590 3031432592 |
| Index Number: | QA76 |
| CLC: | TP391 |
| Call Number: | TP391/B422 |
| Contents: | Acknowledgments -- Chapter 1 Introduction -- Chapter 2 Foundations of Language Modeling -- Chapter 3 Cognitive Signals of Language Processing -- Chapter 4 Behavioral Patterns -- Chapter 5 Representational Structure -- Chapter 6 Procedural Strategies -- Chapter 7 Towards Cognitively More Plausible Models -- Bibliography. |