The safety argument, both sides fairly

Two camps that are usually caricatured

Ask a researcher what the danger of AI is and you will get one of two answers, and each side tends to describe the other unfairly. This lesson gives both as their best proponents would, then says where they agree and where the disagreement actually lives.

The present-harms position

The systems are causing harm now, the argument goes, and the harm is measurable. Bias in the decisions the second module described, falling on the people least able to contest them. The labour from the previous module, paid by the task in poor countries. Surveillance, and the face-scraping the European law now bans. Fabricated text at a scale that degrades the information people rely on. The environmental cost of the previous lesson. And the concentration of the first lesson: a dozen firms, three governments.

The most-cited statement of this view was a 2021 paper describing large language models as parrots that stitch together likely sequences with no understanding, the argument the first module of this course took seriously. One of its authors was dismissed from a large company’s research group during a dispute over it. Its proponents hold that talk of future catastrophe is, at best, a distraction from present harm and, at worst, a way for the labs to cast themselves as the responsible stewards of a danger they are creating and profiting from.

The loss-of-control position

The systems are improving faster than anyone predicted, the argument goes, along a curve the history module showed you, toward capabilities nobody has designed and nobody fully understands. In May 2023 the researcher who had spent thirty years on the learning approach left his position at a large company so he could say freely that he thought the risk of these systems escaping human control was real. The same month, a one-sentence statement (that mitigating the risk of extinction from AI should be a global priority alongside pandemics and nuclear war) was signed by the heads of the leading labs and by several of the field’s founders. Two months earlier a letter had called for a six-month pause on training anything beyond the frontier; nobody paused.

Proponents point to lab evaluations since 2024 in which models, placed in contrived scenarios, appeared to conceal information from their operators, resist being shut down, or act against instructions to preserve a goal. The labs that ran these tests published them. The tests were artificial; the behaviour was real within them; what it predicts is disputed.

The third position

A smaller group of prominent researchers holds that both camps overstate: that the systems are useful tools with ordinary failure modes, that loss of control is science fiction, and that present harms are real but no different in kind from those of any technology. Its most prominent voice runs the AI research of one of the largest companies.

Where they agree

More than either side’s rhetoric suggests. That the systems are not understood from the inside. That evaluation is weak: the benchmarks lesson to come. That the concentration of capability in a few firms is a problem. That some regulation is needed. And that the models can deceive, whether one calls it a statistical artefact or an early warning. The argument is not about the facts. It is about which facts matter most and what probability to assign to the ones that have not happened yet.

What the institutions did

In November 2023, twenty-eight countries, including the United States, China and India, signed a declaration at a British country house acknowledging the potential for serious harm from frontier models and committing to cooperate. Britain and the United States founded institutes to test models before release; the British one was renamed in 2025 to emphasise security, and the American one was reorganised the same year. An international scientific report on the state of the evidence was published in early 2025 under one of the field’s founders. At the 2025 summit in Paris, the United States and Britain declined to sign the declaration. The institutions exist and their remit narrowed in eighteen months.

How to hold it

You can hold both positions at once, and most careful people do. The harms of the present-harms camp are documented in this course and require no speculation. The concern of the loss-of-control camp rests on an extrapolation of a curve that has, so far, kept going, and on behaviour that has, so far, appeared only in tests. What you cannot do honestly is assign a confident probability to the second, because nobody can, and anyone who states one (high or low) is telling you their temperament.

The practical question that both camps would accept is the one this course has asked throughout: what does this system actually do, on what evidence, and who is accountable when it is wrong.