What is VFX software?
VFX software changes or creates what the camera recorded. It takes footage, a 3D scene or both, and isolates, builds, simulates or generates the elements of a shot. The output is a finished shot, ready for the edit.
- Traditional VFX software. Compositors, 3D suites and real-time engines in which an artist builds the shot by hand: Nuke, Fusion in DaVinci Resolve, After Effects, Blender, Houdini and Unreal Engine.
- AI VFX software. Tools that edit or generate a shot from a written instruction and reference images. Morphic is the one on this list.
Both end in a finished shot. In one the artist does the work step by step, and in the other a model renders it from a description.
AI VFX software vs traditional VFX software
Traditional VFX software works on the parts of a shot. An artist tracks the camera, cuts the mattes, keys the screen, builds or simulates the new element, lights and renders it, and layers the result over the plate. Every step can be opened again and adjusted. Nuke fits shot-by-shot compositing for film and episodic work. Fusion fits compositing in the same app as the edit and the grade. Houdini fits simulation. Blender fits 3D work with no licence cost. Unreal Engine fits real-time scenes. After Effects fits motion design alongside compositing.
AI VFX software works on the whole shot. You upload a clip, describe the change and add reference images, and a model renders a new version of the clip. A revision is a new instruction and a new render. Morphic fits effects on footage you already shot, with the edit in the same place.
An AI edit suits the pitch version, previz and shots where a described change is enough. Shots that need control over every pixel stay with a compositor.
How VFX software works
Four jobs make up most VFX shots:
- Isolating. Keying a green screen or rotoscoping a subject makes a matte that separates one element from the rest of the frame.
- Tracking. Following the camera or an object keeps a new element locked to the plate.
- Creating. The new element is modelled, simulated, painted or generated.
- Compositing. The elements are layered, matched in colour and rendered as one shot.
Nuke lists deep compositing and a 3D environment for projections. Fusion lists keyers, rotoscoping tools and 3D particle systems inside DaVinci Resolve. After Effects lists Content-Aware Fill for removing an object across frames. Houdini lists fluids, destruction and Pyro smoke and fire. Blender ships two renderers and a node compositor. Unreal Engine renders final frames in real time.
On Morphic a clip is edited by instruction with reference images, masks and chroma key sit in Compose, and the cut is finished on the same timeline.