Across the levels of analysis: Explaining predictive processing in humans requires more than machine-estimated probabilities

Abstract

Under the lens of Marr’s (levels of analysis, we critique and extend the authors’ two points about language models (LMs) and language processing: first, predicting upcoming linguistic information based on context is key to language processing, and second, that many advances in psycholinguistics would be impossible without LLMs. We also outline directions combining LLMs’ strengths with psycholinguistic models.