Full Description
The success of predictive large language models (PLLMs) like GPT3 and ChatGPT has created both enthusiasts and skeptics of their widespread practical applications, but this book argues that the larger significance of such models is contained in what they suggest about human cognition. To explore this potential, the book develops a thought experiment called the Prediction Room, a reference to John Searle's influential Chinese Room argument, in which a human agent processes language by following a set of opaque written rules without possessing an inherent understanding of the language. The book proposes a new Room model—the Prediction Room with its resident Prediction Agent—generalizing the working of large language models. Working through a wide range of topics in cognitive science, the book challenges the conclusion of Searle's thought experiment, that discredited contemporary artificial intelligences (AI), through the suggestion that the Prediction Room offers a means of exploring how new ideas in AI can provide productive alternatives to traditional understandings of human cognition. In considering the implications of this, the book reviews an array of topics and issues in cognitive science to uncover new ideas and reinforce older ideas about the mental mechanisms involved in both sides. The discussion of these topics in the book serves two purposes. First, it aims to stimulate new thinking about familiar topics like language acquisition or the nature and acquisition of concepts. Second, by contrasting human psychology with the form of artificial psychology these models exhibit, it uncovers how new directions in the development of these systems can be better explored.
Contents
Introduction.- The Prediction Room: A Rough Outline of a Model of Cognition.- Part I: Problem Solving and Reasoning.- Einstellung.- Analogical Reasoning.- More Reasoning: Inference and Prediction.- Transfer Skills, Production Rules, and Prediction.- Qualitative Physics.- Situated Cognition.- Part II: Memory.- Recall from Long Term Memory.- Interference with Real World Knowledge.- Speed-Accuracy Tradeoffs.- Is Knowledge Represented in Propositions?.- Associationism.- Procedural and Declarative Knowledge.- Part III: Language.- Language.- Inner Speech.- Babies and Other Primates.- Gestures.- Part IV: Action.- Action and Identity.- Predictive Modeling and Active Inference.- Part V: Being Human and Being Artificial.- Embodiment and Grounding.- Concepts?.- Emotions.- Intuition.- Belief-Desire Psychology.- Part VI: Mechanisms and Interpretation.- In the Engine Room: Transformer Models.- In the Engine Room--The Brain.- Virtuality, Reading in, and Emergence.- Coda.
