The controls, in order of how often they should move
Most interfaces expose four things: steps, guidance, sampler, and shift. In practice you should touch them in almost the reverse of the order people usually do.
- Steps. Set once per model from your own step-count test. Then leave it.
- Guidance. The one worth understanding and occasionally adjusting.
- Sampler. Pick the documented default. Differences are small on video.
- Shift. Leave alone unless the model’s own guide tells you otherwise.
Everything else (prompt, still, motion strength, duration) matters more than all four combined.
What guidance actually does
At each step the model makes two predictions: one conditioned on your prompt, one unconditioned. Classifier-free guidance takes the difference and extrapolates along it:
prediction = uncond + scale * (cond - uncond)At scale 1 you get the conditioned prediction unchanged. Above 1 you are pushing past it: deliberately overshooting in the direction the prompt pulls.
That overshoot is why guidance works and why it breaks. Push harder and the prompt is obeyed more literally. Push too hard and you leave the region where the model’s predictions are valid. The symptoms are specific and recognisable:
- Contrast and saturation climb until highlights clip to white.
- Edges get a hard, posterised outline.
- Motion freezes. This one is particular to video and catches people out. High guidance drives every frame toward the strongest interpretation of the prompt, and the strongest interpretation does not change over time, so the clip stiffens into a near-still.
If your motion looks locked and your colours look cooked, lower the guidance before you touch anything else.
The usable ranges
Video models generally want lower guidance than image models. Typical bands, which you should verify on your own model rather than trust here:
- Full (non-distilled) video models: roughly 3 to 7, with 5 a common default.
- Distilled or turbo variants: near 1. These were trained to need no guidance, and feeding them 7 produces exactly the burnt, frozen output described above.
- Some models expose separate guidance for the image condition and the text condition. Raising image guidance tightens adherence to your first frame at the cost of motion; lowering it lets the model drift from your still.
The diagnostic: generate the same shot at guidance 2, 5 and 9 with a fixed seed. You will see the motion die and the colour cook, and you will know your model’s ceiling for the rest of your career with it.
Samplers, briefly and honestly
On image models sampler choice was a genuine subject. On flow-matching video models it is mostly not. The differences between Euler, DPM variants and the rest are small compared with the differences between prompts, stills and guidance values.
Use whatever the model card recommends. If you want to test it, test it once, with a fixed seed, and then stop thinking about it. Time spent on samplers is time not spent on the shot list, and the shot list is where the quality is.
Shift, and why it exists for video
Flow-matching models spend their steps along a path from noise to data. Shift biases where along that path the effort goes. Higher shift concentrates steps early, where large-scale structure and motion are decided; lower shift concentrates them late, where fine detail resolves.
Video wants more early effort than images do, because getting the motion trajectory right matters more than getting a texture crisp. That is why video models ship with a higher default shift, and why raising resolution sometimes calls for raising shift too: a bigger latent has more structure to settle.
It is a real control and a rarely useful one. If motion is consistently mushy at good guidance and adequate steps, try raising it. Otherwise leave it.
What people reach for instead, and should not
Three habits that waste money:
- Raising steps to fix a bad shot. Steps resolve detail. They do not change what the model decided to depict. A shot that is wrong at 20 steps is the same shot, sharper, at 50.
- Raising guidance to force an ignored instruction. If the model ignored “she turns left”, guidance 9 gives you a stiffer clip in which she still does not turn left. The fix is the still or the phrasing.
- Changing four things at once and keeping the result. You now have a setting you cannot explain and cannot repeat.
The free path
All of this is testable for nothing on a Hugging Face Space or a Colab notebook, because none of it needs scale: it needs one still, one seed, and patience with a queue. Build a small grid: three guidance values across two step counts, six generations, one page of notes. That page is worth more than any settings guide, including this one, because it is about your model.
Today: generate one shot at guidance 2, 5 and 9 with the seed fixed, and watch the motion disappear as the colour cooks.
Every lesson here is open. Your progress is recorded once you pass the Editing Video exam.
Check your understanding
A shot generated at guidance 9 comes back with clipped highlights and almost no movement, although the prompt asked for a walking figure. What is happening mechanically?
Pick the one you would defend. Your answer stays private.
Stuck on something?Ask Chiamaka, your AI tutor