{"course":{"slug":"ai-images","title":"Image Generation, in Practice","url":"https://addaly.com/learn/ai-images","level":"beginner","track":"create"},"lesson":{"slug":"prompt-from-an-image","title":"Interrogating a picture for vocabulary","url":"https://addaly.com/learn/ai-images/prompt-from-an-image","position":30,"of":69,"minutes":7,"answer":"An interrogator recovers usable vocabulary from a reference image but never recovers the image, because it is describing appearance rather than inverting the generation process.","keyIdea":"An interrogator recovers usable vocabulary from a reference image but never recovers the image, because it is describing appearance rather than inverting the generation process."},"body":{"format":"markdown","text":"## What the tools do\n\nPoint a CLIP interrogator or a tagger at a photograph and it returns text: a caption, or a list of tags. The free options are the CLIP Interrogator, the WD tagger family, and any general vision model you can run locally or through a free tier.\n\nWhat comes back looks like this:\n\n```text\na woman in a green sari sorting chillies, sitting on the floor,\nwhitewashed wall, harsh sunlight, shadows, documentary photography,\n35mm, film grain, warm tones, india, natural light\n```\n\nUseful. And it will not regenerate the photograph.\n\n## Why it cannot give you the image back\n\nAn interrogator is a *description* model, not an inversion. It answers \"what words fit this picture\" by comparing the image against text embeddings and returning close matches. That is a different operation from recovering the specific noise, seed, model and prompt that produced a particular image, which, for a photograph, never existed anyway.\n\nSo the description is lossy in exactly the way descriptions always are. It captures category and salient attributes and loses arrangement, proportion, the precise light, the specific gesture. Feed the output back into a generator and you get *an* image of a woman sorting chillies in sunlight. Not that one.\n\nPeople discover this and conclude the tool is broken. It is doing what it does; the expectation was wrong.\n\n## What it is good for\n\n**Recovering vocabulary you lack.** You have a reference whose look you cannot name. The interrogator says `chiaroscuro`, `rim lighting`, `tenebrism`; and now you have three terms to use deliberately. This is the main value and it is a real one, especially early on.\n\n**Checking your assumptions.** You think the reference is softly lit. The tagger says hard light. Look again; it is usually right, and your eye is being fooled by a bright background.\n\n**Building a caption style for LoRA training.** When you caption a training set, consistency matters more than accuracy, and a tagger applied to every image gives you consistency for free. The consistency block returns to this.\n\n**Bulk sorting.** Tag two hundred images and you can group them by style, which is how you build a reference library rather than a folder.\n\n## How to use the output properly\n\nNever paste it in whole. It arrives full of redundancy and noise: `best quality`, `1girl`, duplicated concepts, and terms that came from the tagger's training vocabulary rather than from the image.\n\nRead it, take the two or three words you did not have, and put them in the appropriate slot of your own structured prompt. The interrogator is a thesaurus, not a source.\n\n## The thing to be careful about\n\nIf the reference is somebody's copyrighted work, an interrogated prompt fed straight back is an attempt to reproduce it. Whether that is lawful depends on jurisdiction, on how close the result is, and on questions that are unresolved and being argued in several courts right now. This course does not pretend to know the answer.\n\nWhat can be said is narrower and more useful: taking vocabulary from a reference (`hard side light`, `muted palette`, `35mm`) is ordinary practice, the same as any art director describing a look. Attempting to regenerate a specific existing picture is a different act with different exposure, and the difference is obvious to you when you are doing it.\n\nA final practical note. The interrogator's output tells you what the *tagger* sees, which reflects its own training data and biases. It will describe people in its own vocabulary, which is sometimes crude and sometimes worse, particularly about ethnicity and body type. Read the output before you use it rather than pasting it forward unseen, because whatever it hands you becomes your prompt and then becomes your picture.\n\n## A better use: interrogate your own output\n\nTurn the tool around. Run it on an image *you* generated and compare what it says against what you asked for.\n\nIf your prompt said `hard side light` and the interrogator says `soft studio lighting`, one of two things is true: the model ignored that part of the prompt, or your eye is wrong about what came out. Either is worth knowing, and both are invisible without the comparison.\n\nThis is a surprisingly good calibration exercise in the first month. Generate ten images, interrogate all ten, and read the captions against your prompts. The slots that consistently fail to appear in the description are the ones the model is not acting on, and they are where your prompt-writing time should go.\n\n## The free options, concretely\n\n- **CLIP Interrogator**: runs on Hugging Face Spaces without installing anything, or locally on a modest GPU.\n- **WD taggers**: tag-style output, fast, well suited to bulk captioning for training sets.\n- **A small local vision-language model**: the most flexible option, because you can ask a specific question rather than accepting a generic caption. \"Describe only the lighting in this image\" is far more useful than a full caption when lighting is what you are after.\n\nThat last approach is the one worth learning. A general caption answers a question you did not ask; a targeted question answers the one you did."},"check":{"question":"Why does feeding an interrogator's caption back into a generator not reproduce the source image?","options":[{"text":"Because interrogators are trained on generated images rather than photographs, so their captions transfer poorly to real-world source material.","correct":false,"tempting":"They are trained on image-text pairs from the web, largely photographic; the loss is inherent to description rather than a domain mismatch."},{"text":"Because the caption omits the seed and model parameters, which are what actually determine the specific output of a generation.","correct":false,"tempting":"True for a generated source and irrelevant for a photograph, which never had a seed; the caption would still not reproduce it."},{"text":"Because interrogators return tags rather than full sentences, and the loss of grammar removes the relationships between the elements described.","correct":false,"tempting":"Sentence-style interrogators exist and fail in the same way, so grammar is not what is missing."},{"text":"Because a caption describes appearance rather than inverting the generation, so arrangement, proportion and exact light are never captured.","correct":true}]},"prev":{"slug":"when-the-model-will-not-do-it","title":"Recognising the twenty minutes that will never converge","url":"https://addaly.com/learn/ai-images/when-the-model-will-not-do-it"},"next":{"slug":"the-keeper-checklist","title":"What \"good enough to take forward\" actually means","url":"https://addaly.com/learn/ai-images/the-keeper-checklist"},"authorship":"Founder and series editor: Dr Mustafa Mun. Written by AI models to a written standard. Exam keys checked blind by a second model: 3,665 of 3,666 agreed. Academic review invited.","review":{"status":"Draft, open for academic review"},"cite":"Addaly (2026) 'Interrogating a picture for vocabulary', in Image Generation, in Practice. Edited by M. Mun. Addaly. Available at: https://addaly.com/learn/ai-images/prompt-from-an-image (Accessed: 13 October 2026).","licence":{"name":"CC BY-NC-SA 4.0","url":"https://creativecommons.org/licenses/by-nc-sa/4.0/"},"reader":{"schema":1,"title":"Interrogating a picture for vocabulary","courseTitle":"Image Generation, in Practice","module":{"index":3,"slug":"first-frames","title":"Getting to a frame worth keeping"},"answer":null,"keyIdea":"An interrogator recovers usable vocabulary from a reference image but never recovers the image, because it is describing appearance rather than inverting the generation process.","hero":{"kind":"plate","image":null,"alt":null,"caption":null},"blocks":[{"t":"h2","id":"what-the-tools-do","runs":[{"text":"What the tools do"}]},{"t":"p","runs":[{"text":"Point a CLIP interrogator or a tagger at a photograph and it returns text: a caption, or a list of tags. The free options are the CLIP Interrogator, the WD tagger family, and any general vision model you can run locally or through a free tier."}]},{"t":"p","runs":[{"text":"What comes back looks like this:"}]},{"t":"code","lang":"text","label":"Text","text":"a woman in a green sari sorting chillies, sitting on the floor,\nwhitewashed wall, harsh sunlight, shadows, documentary photography,\n35mm, film grain, warm tones, india, natural light"},{"t":"p","runs":[{"text":"Useful. And it will not regenerate the photograph."}]},{"t":"h2","id":"why-it-cannot-give-you-the-image-back","runs":[{"text":"Why it cannot give you the image back"}]},{"t":"p","runs":[{"text":"An interrogator is a "},{"text":"description","i":true},{"text":" model, not an inversion. It answers “what words fit this picture” by comparing the image against text embeddings and returning close matches. That is a different operation from recovering the specific noise, seed, model and prompt that produced a particular image, which, for a photograph, never existed anyway."}]},{"t":"p","runs":[{"text":"So the description is lossy in exactly the way descriptions always are. It captures category and salient attributes and loses arrangement, proportion, the precise light, the specific gesture. Feed the output back into a generator and you get "},{"text":"an","i":true},{"text":" image of a woman sorting chillies in sunlight. Not that one."}]},{"t":"p","runs":[{"text":"People discover this and conclude the tool is broken. It is doing what it does; the expectation was wrong."}]},{"t":"h2","id":"what-it-is-good-for","runs":[{"text":"What it is good for"}]},{"t":"p","runs":[{"text":"Recovering vocabulary you lack.","b":true},{"text":" You have a reference whose look you cannot name. The interrogator says "},{"text":"chiaroscuro","code":true},{"text":", "},{"text":"rim lighting","code":true},{"text":", "},{"text":"tenebrism","code":true},{"text":"; and now you have three terms to use deliberately. This is the main value and it is a real one, especially early on."}]},{"t":"p","runs":[{"text":"Checking your assumptions.","b":true},{"text":" You think the reference is softly lit. The tagger says hard light. Look again; it is usually right, and your eye is being fooled by a bright background."}]},{"t":"p","runs":[{"text":"Building a caption style for LoRA training.","b":true},{"text":" When you caption a training set, consistency matters more than accuracy, and a tagger applied to every image gives you consistency for free. The consistency block returns to this."}]},{"t":"p","runs":[{"text":"Bulk sorting.","b":true},{"text":" Tag two hundred images and you can group them by style, which is how you build a reference library rather than a folder."}]},{"t":"h2","id":"how-to-use-the-output-properly","runs":[{"text":"How to use the output properly"}]},{"t":"p","runs":[{"text":"Never paste it in whole. It arrives full of redundancy and noise: "},{"text":"best quality","code":true},{"text":", "},{"text":"1girl","code":true},{"text":", duplicated concepts, and terms that came from the tagger’s training vocabulary rather than from the image."}]},{"t":"p","runs":[{"text":"Read it, take the two or three words you did not have, and put them in the appropriate slot of your own structured prompt. The interrogator is a thesaurus, not a source."}]},{"t":"h2","id":"the-thing-to-be-careful-about","runs":[{"text":"The thing to be careful about"}]},{"t":"p","runs":[{"text":"If the reference is somebody’s copyrighted work, an interrogated prompt fed straight back is an attempt to reproduce it. Whether that is lawful depends on jurisdiction, on how close the result is, and on questions that are unresolved and being argued in several courts right now. This course does not pretend to know the answer."}]},{"t":"p","runs":[{"text":"What can be said is narrower and more useful: taking vocabulary from a reference ("},{"text":"hard side light","code":true},{"text":", "},{"text":"muted palette","code":true},{"text":", "},{"text":"35mm","code":true},{"text":") is ordinary practice, the same as any art director describing a look. Attempting to regenerate a specific existing picture is a different act with different exposure, and the difference is obvious to you when you are doing it."}]},{"t":"p","runs":[{"text":"A final practical note. The interrogator’s output tells you what the "},{"text":"tagger","i":true},{"text":" sees, which reflects its own training data and biases. It will describe people in its own vocabulary, which is sometimes crude and sometimes worse, particularly about ethnicity and body type. Read the output before you use it rather than pasting it forward unseen, because whatever it hands you becomes your prompt and then becomes your picture."}]},{"t":"h2","id":"a-better-use-interrogate-your-own-output","runs":[{"text":"A better use: interrogate your own output"}]},{"t":"p","runs":[{"text":"Turn the tool around. Run it on an image "},{"text":"you","i":true},{"text":" generated and compare what it says against what you asked for."}]},{"t":"p","runs":[{"text":"If your prompt said "},{"text":"hard side light","code":true},{"text":" and the interrogator says "},{"text":"soft studio lighting","code":true},{"text":", one of two things is true: the model ignored that part of the prompt, or your eye is wrong about what came out. Either is worth knowing, and both are invisible without the comparison."}]},{"t":"p","runs":[{"text":"This is a surprisingly good calibration exercise in the first month. Generate ten images, interrogate all ten, and read the captions against your prompts. The slots that consistently fail to appear in the description are the ones the model is not acting on, and they are where your prompt-writing time should go."}]},{"t":"h2","id":"the-free-options-concretely","runs":[{"text":"The free options, concretely"}]},{"t":"ul","items":[[{"text":"CLIP Interrogator","b":true},{"text":": runs on Hugging Face Spaces without installing anything, or locally on a modest GPU."}],[{"text":"WD taggers","b":true},{"text":": tag-style output, fast, well suited to bulk captioning for training sets."}],[{"text":"A small local vision-language model","b":true},{"text":": the most flexible option, because you can ask a specific question rather than accepting a generic caption. “Describe only the lighting in this image” is far more useful than a full caption when lighting is what you are after."}]]},{"t":"p","runs":[{"text":"That last approach is the one worth learning. A general caption answers a question you did not ask; a targeted question answers the one you did."}]}],"check":{"question":[{"text":"Why does feeding an interrogator’s caption back into a generator not reproduce the source image?"}],"options":[{"text":[{"text":"Because interrogators are trained on generated images rather than photographs, so their captions transfer poorly to real-world source material."}],"correct":false,"tempting":[{"text":"They are trained on image-text pairs from the web, largely photographic; the loss is inherent to description rather than a domain mismatch."}]},{"text":[{"text":"Because the caption omits the seed and model parameters, which are what actually determine the specific output of a generation."}],"correct":false,"tempting":[{"text":"True for a generated source and irrelevant for a photograph, which never had a seed; the caption would still not reproduce it."}]},{"text":[{"text":"Because interrogators return tags rather than full sentences, and the loss of grammar removes the relationships between the elements described."}],"correct":false,"tempting":[{"text":"Sentence-style interrogators exist and fail in the same way, so grammar is not what is missing."}]},{"text":[{"text":"Because a caption describes appearance rather than inverting the generation, so arrangement, proportion and exact light are never captured."}],"correct":true,"tempting":null}],"order":[0,2,3,1],"why":null},"prev":{"slug":"when-the-model-will-not-do-it","title":"Recognising the twenty minutes that will never converge","minutes":7},"next":{"slug":"the-keeper-checklist","title":"What “good enough to take forward” actually means","minutes":7}}}