Can LLMs tell us about human language?

Large language models predict the next token with high accuracy, passing many surface tests of linguistic competence. Whether their internal representations align with human linguistic structure — phrases, syntax, semantics — is an empirical question.

Recent probing studies find both alignment and divergence. Whether LLMs constrain theories of human language, or merely serve as exotic comparison points, is unsettled.