Seeing Around Street Corners: Non-Line-of-Sight Detection and Tracking In-the-Wild Using Doppler Radar

by   Nicolas Scheiner, et al.

Conventional sensor systems record information about directly visible objects, whereas occluded scene components are considered lost in the measurement process. Nonline-of-sight (NLOS) methods try to recover such hidden objects from their indirect reflections - faint signal components, traditionally treated as measurement noise. Existing NLOS approaches struggle to record these low-signal components outside the lab, and do not scale to large-scale outdoor scenes and high-speed motion, typical in automotive scenarios. Especially optical NLOS is fundamentally limited by the quartic intensity falloff of diffuse indirect reflections. In this work, we depart from visible-wavelength approaches and demonstrate detection, classification, and tracking of hidden objects in large-scale dynamic scenes using a Doppler radar which can be foreseen as a low-cost serial product in the near future. To untangle noisy indirect and direct reflections, we learn from temporal sequences of Doppler velocity and position measurements, which we fuse in a joint NLOS detection and tracking network over time. We validate the approach on in-the-wild automotive scenes, including sequences of parked cars or house facades as indirect reflectors, and demonstrate low-cost, real-time NLOS in dynamic automotive environments.


page 1

page 5

page 6

page 7

page 8


Steady-state Non-Line-of-Sight Imaging

Conventional intensity cameras recover objects in the direct line-of-sig...

Keyhole Imaging: Non-Line-of-Sight Imaging and Tracking of Moving Objects Along a Single Optical Path at Long Standoff Distances

Non-line-of-sight (NLOS) imaging and tracking is an emerging paradigm th...

Embedded Line Scan Image Sensors: The Low Cost Alternative for High Speed Imaging

In this paper we propose a low-cost high-speed imaging line scan system....

AutoPlace: Robust Place Recognition with Low-cost Single-chip Automotive Radar

This paper presents a novel place recognition approach to autonomous veh...

Automated Ground Truth Estimation For Automotive Radar Tracking Applications With Portable GNSS And IMU Devices

Baseline generation for tracking applications is a difficult task when w...

Live Reconstruction of Large-Scale Dynamic Outdoor Worlds

Standard 3D reconstruction pipelines assume stationary world, therefore ...

Optically lightweight tracking of objects around a corner

The observation of objects located in inaccessible regions is a recurrin...

Please sign up or login with your details

Forgot password? Click here to reset