Differences you will actually feel
Some gaps between these tools are real and show up in an afternoon of use.
Language coverage. This is the biggest under-advertised difference. Models are trained on wildly different mixtures of text, and quality in Marathi, Yoruba, Vietnamese or Quechua varies far more between models than quality in English does. Nobody puts this on a comparison page. Test it yourself in the language you actually work in.
What the product can reach. Can it read your Google Drive? Run code and show you the output? Live inside your editor and see the whole project? Browse the web and cite what it found? These are product decisions, and they differ enormously. For most jobs this matters more than model quality.
Long documents. Advertised context windows range from tens of thousands of tokens to a million or more. But a stated window is a ceiling, not a promise of quality. Some models hold detail from page 200 well and some lose the middle. Test it: paste a long document, then ask about something buried two-thirds of the way in.
House manners. Models are trained with different preferences and it shows. One hedges heavily and asks clarifying questions. Another commits to an answer and is wrong with confidence. One refuses a medical question, another answers with caveats. This is real, persistent, and a matter of taste — but it decides whether a tool fits your work.
Availability and payment. In some countries an account is hard to create, a card is hard to charge, or the service is not offered. This ends the debate quickly.
Price per unit of work. Invisible when you are chatting. Decisive when you are processing 50,000 support tickets, where a tenfold cost difference between a small model and a frontier one is the whole budget.
Differences that are mostly marketing
Leaderboard positions two or three points apart. Public benchmarks are useful for tracking the field over years, and close to useless for choosing between today's top few. The tests get saturated, questions leak into training data, and scores are reported under favourable settings. A three-point gap on a reasoning benchmark will not be visible in your work.
"Reasoning" as a brand word. Most serious models now have a mode where they spend longer thinking before answering, and it genuinely helps on maths, logic and multi-step planning. It is not a separate species of intelligence that one company owns. Where they differ is how much compute they spend and whether you can control it.
Parameter counts. "Trillions of parameters" is unverifiable for closed models and does not map cleanly to usefulness. A well-trained 30-billion-parameter model beats a badly-trained 200-billion one.
Launch demos. Every one of them is a best case, rehearsed, recorded, and sometimes edited. Treat them as advertising, because they are.
Build your own benchmark in twenty minutes
Here is the method that beats every review you will read.
Open a plain text file. Write down five tasks you genuinely do, with real material:
- A real email you need to reply to, with the context you would give a colleague.
- A document from your work, plus the question you would actually ask about it.
- A task in your own language, not English.
- Something you already know the correct answer to. This is the one that catches confident nonsense.
- The thing you were doing when you last got frustrated with a tool.
Run all five through each candidate. Judge them yourself. It takes less than an hour and it is worth more than every comparison table on the internet, because it measures fit to your work rather than fit to a test.
Keep the file. You will use it again in lesson eight, when everything has changed and you need to decide all over again.
Before you move on