I think the best way to understand this is that when you type something into a prompt, you’re not actually asking it to answer a question at all. Rather, you’re asking it “what sort of answers would people be likely to produce to questions that look like this?” You’re asking it to match a pattern.1
Footnotes
-
https://www.ben-evans.com/benedictevans/2023/7/2/working-with-ai “AI and the automation of work” ↩