Foveated Thermal Computational Imaging in the Wild Using All-Silicon Meta-Optics

by   Vishwanath Saragadam, et al.

Foveated imaging provides a better tradeoff between situational awareness (field of view) and resolution and is critical in long-wavelength infrared regimes because of the size, weight, power, and cost of thermal sensors. We demonstrate computational foveated imaging by exploiting the ability of a meta-optical frontend to discriminate between different polarization states and a computational backend to reconstruct the captured image/video. The frontend is a three-element optic: the first element which we call the "foveal" element is a metalens that focuses s-polarized light at a distance of f_1 without affecting the p-polarized light; the second element which we call the "perifoveal" element is another metalens that focuses p-polarized light at a distance of f_2 without affecting the s-polarized light. The third element is a freely rotating polarizer that dynamically changes the mixing ratios between the two polarization states. Both the foveal element (focal length = 150mm; diameter = 75mm), and the perifoveal element (focal length = 25mm; diameter = 25mm) were fabricated as polarization-sensitive, all-silicon, meta surfaces resulting in a large-aperture, 1:6 foveal expansion, thermal imaging capability. A computational backend then utilizes a deep image prior to separate the resultant multiplexed image or video into a foveated image consisting of a high-resolution center and a lower-resolution large field of view context. We build a first-of-its-kind prototype system and demonstrate 12 frames per second real-time, thermal, foveated image, and video capture in the wild.


page 6

page 7

page 8

page 15

page 18

page 19

page 21

page 23


CoReFusion: Contrastive Regularized Fusion for Guided Thermal Super-Resolution

Thermal imaging has numerous advantages over regular visible-range imagi...

Physiological and Affective Computing through Thermal Imaging: A Survey

Thermal imaging-based physiological and affective computing is an emergi...

Learning Light Field Reconstruction from a Single Coded Image

Light field imaging is a rich way of representing the 3D world around us...

A Novel Registration Colorization Technique for Thermal to Cross Domain Colorized Images

Thermal images can be obtained as either grayscale images or pseudo colo...

Pyramidal Edge-maps based Guided Thermal Super-resolution

Thermal imaging is a robust sensing technique but its consumer applicabi...

Seeing Far in the Dark with Patterned Flash

Flash illumination is widely used in imaging under low-light environment...

Please sign up or login with your details

Forgot password? Click here to reset