Taking motion out of language

Why these controls exist

Every interface in this category has, at some point, added a control that is not a text box. That is not product decoration. It is an admission that a sentence cannot specify how fast, how far, and in what curve.

The three you will meet:

1. Motion strength, a single slider.
2. Motion brush, where you paint the part of the frame that should move.
3. Trajectory or drag control, where you draw a path an object should follow.

Motion strength, and why the good default is low

A single number controlling how much the clip moves overall. Names vary: motion, dynamism, motion bucket, amount.

The relationship with quality is direct and mechanical. More motion means more change per frame, and every frame of change is another opportunity for drift, morphing limbs, background churn and identity slip. High motion does not just look busier; it is more likely to break.

The professional default is lower than feels exciting. A near-still frame with a slow drift, a small parallax and real ambient sound reads as footage. A high-motion clip with a morphing hand reads as generated, immediately, to everybody.

That is not timidity. It is choosing the version that survives being watched twice, which is the only test that matters for anything a client pays for.

A useful calibration: find the motion value at which your model starts producing visible artefacts on your kind of content, then work one or two steps below it. That number is yours and it is worth twenty minutes of a free allowance to find.

Motion brush

Paint a mask over the region that should move, leave the rest alone. Runway popularised it and similar tools exist elsewhere.

What it is good for is specific and valuable: motion that is local. Steam rising from a cup while the room stays still. Hair moving while the face does not. Water in the bottom third. A flag. A single figure in a crowd.

What it does not do is make the unpainted region truly static. It biases rather than freezes, so expect some residual drift outside the mask, and check for it rather than assuming.

The technique that gets the most from it: paint less than you think. A small moving region against a still frame is more convincing than a large one, because the stillness is what makes the motion read as real. This is the same principle as a subtle grade: the restraint is where the credibility lives.

Trajectory and drag controls

Draw an arrow, or drag a point from where a thing is to where it should go. The tool converts that into a motion-conditioning signal.

This is the most direct control available and it is also the most brittle. Three honest limits:

• It controls position, not pose. Dragging a person across frame moves them; it does not make them walk convincingly while doing so. You often get a sliding figure.
• It fights physics. A drawn path that no real object would take produces exactly the impossible-looking result you asked for.
• It competes with the prompt. If the text says one thing and the arrow says another, you get an averaged mess. Make them agree, or leave the motion out of the text entirely when you are drawing it.

Use it for objects rather than people, and for simple translations rather than complex actions.

Camera controls as a separate axis

Some tools separate camera motion from subject motion: sliders or gizmos for pan, tilt, zoom, roll and orbit. Where this exists, use it in preference to describing the move in words, for the obvious reason: a number is unambiguous and a sentence is not.

It also lets you do the thing language cannot, which is ask for a camera move of a specific magnitude. “Slow push in” is a genre. “Dolly in 15%” is an instruction.

Choosing between the three

A decision rule:

• Whole-frame ambient motion: slider, set low.
• One region moves, the rest holds: brush.
• A specific object travels a specific path: trajectory, and expect to fix the result in the edit.
• The camera moves: camera controls if they exist, otherwise language.

The free path

Motion strength exists everywhere, including free tiers. Brushes and trajectories are mostly features of paid hosted tools, but the open-weights equivalent is real: ComfyUI workflows expose motion masks and trajectory conditioning as nodes, free, if you can run them. On a phone with only a free hosted allowance, the slider is your whole toolkit, which is fine, because turning it down is the highest-value thing on this page.

Today: generate the same still twice, once at your tool’s default motion and once at roughly half of it. Judge which one you would show a client.