Your photographs are partly predicted

The photograph you did not quite take

Point a modern phone at a dim room and you get a bright, sharp, low-noise image that the sensor physically could not have captured. This is not a trick of the lens. Between the sensor and the picture sits a stack of trained models, and the file you keep is as much a prediction as a recording.

The pipeline, roughly, in the moment you press the button:

• The phone has already been capturing frames continuously. It grabs a burst: Google’s HDR+ typically merges around ten to fifteen; night modes take several seconds’ worth.
• It aligns those frames, compensating for your hand shake and for things moving in the scene.
• It merges them, which cancels the random noise, because noise differs frame to frame while the real scene does not.
• Learned models then handle demosaicing, tone mapping, white balance, sharpening and often face and sky treatment.
• Portrait mode adds a segmentation model that separates subject from background and blurs the background artificially.
• Zoom beyond the optical limit invokes super-resolution, which produces detail that was never resolved by the lens.

Each step is a model trained on paired examples: this sensor input, that desirable output.

Where it stops being a recording

The interesting question is where enhancement becomes invention, and there is a concrete case that made this unavoidable.

In 2023 a user demonstrated that a popular phone photographing a deliberately blurred image of the moon produced a crisp, detailed lunar surface: detail that could not have come from the blurred source. The manufacturer explained it as a scene-recognition and detail-enhancement feature. Whatever you call it, the craters in that photograph were supplied by the system, not by the light.

That is the extreme, and most processing is far more modest. But the principle it exposes is general: a model trained to produce plausible photographs will fill in plausible detail, and plausible detail is not evidence.

Why two phones disagree about the same scene

Stand two people side by side photographing the same street and the pictures will differ in a consistent, brand-specific way: one warmer, one contrastier, one with visibly brighter shadows and smoother skin.

That is not sensor variation. Each manufacturer trains its pipeline towards a preferred look, decided by its own imaging team, and that look is baked into the models. It is closer to a house style (the way two newspapers crop and grade the same press photograph differently) than to a measurement.

So “which phone has the best camera” is partly a question about hardware and largely a question about whose taste you share. It also means the same scene will look different when you upgrade, which is why old and new photographs in one album often refuse to sit together.

Why this matters beyond photography

Two consequences you can act on.

For documentation. If you are photographing a damaged part, a rash, a document, a meter reading or an accident, heavy processing is working against you. Shoot in good light, get close, and where possible use the RAW or Pro mode, which bypasses much of the pipeline and gives you the sensor’s own data. The image will look worse and mean more.

For trust. A phone photograph has not been a straightforward record for about eight years now, and this predates any of the generative image tools. Face smoothing that cannot be fully switched off, skies replaced wholesale, and scene-specific enhancements are all in ordinary consumer phones. When somebody says a picture “looks unnatural”, the honest response is that all of them are processed, and the line is a matter of degree.

Doing it yourself, free

The paid standard for photo work is Adobe Lightroom and Photoshop, and job adverts name them. The free tools that do the same jobs are capable:

• darktable and RawTherapee develop RAW files with full manual control, which is exactly the control the phone takes from you.
• GIMP covers retouching and compositing.
• Krita is for painting and illustration.

All four run on modest hardware, including older laptops, and none of them require a subscription. Learning to develop a RAW yourself is also the fastest way to understand what your phone was doing on your behalf, because you have to make each of those decisions by hand.

The habit

When an image matters (as proof, as a record, as something you will rely on later) ask what the camera added. Then decide whether you want the pretty version or the true one. Most of the time the pretty one is fine. The point is that it is now a choice, and most people do not know they are making it.