Chevron right icon

Novel view synthesis

What is novel view synthesis?

Novel view synthesis is the task of generating new, photorealistic views of a scene from camera angles that were never actually photographed. Given a set of input images, an algorithm reconstructs the underlying 3D structure and appearance so it can render the scene from any viewpoint.

Novel view synthesis at a glance

It is the core capability behind neural radiance fields and Gaussian splatting, which both learn a continuous scene representation from photos and then render unseen angles — producing free, interactive camera movement around a captured real-world subject.

See also

Neural radiance fields (NeRFs) — A neural approach to novel view synthesis.

Gaussian splatting — A fast, point-based method for novel view synthesis.

Photogrammetry — An earlier, geometry-based way to reconstruct scenes from photos.