Flying with Photons: Rendering Novel Views of Propagating Light
Summary
ECCV 2024 paper 'Flying with Photons' presents an imaging and neural rendering framework to synthesize videos of propagating light from novel viewpoints using an ultrafast, picosecond-resolution dataset. It introduces the transient field, a neural representation that maps 3D points and directions to time-varying radiance, and demonstrates rendering effects such as scattering, refraction, and diffraction, along with direct/global separation and time-warped unwarping to account for light-speed delays.