What Is ChatGPT Doing … and Why Does It Work?

I’m sure you’ve heard the argument that all artificial intelligence is really doing at this point is «guessing what the next word in a series of words will be». In a way, it’s hard to argue against, because that is literally what GPT is doing, and yet that process generates astonishing results. How come? For an answer, look no further than this excellent in depth explainer by Stephen Wolfram, one of the key early figures in artificial intelligence. It’s a good 1.5 hour read, but if you’re into language and technology, it’s so worth it. His answer, in a nutshell: «Language is at a fundamental level somehow simpler than it seems»