Back to personal page

Automatic Spatial Calibration of Near-Field MIMO Radar With Respect to Optical Depth Sensors

Vanessa Wirth1, Johanna Bräunig1, Danti Khouri1, Florian Gutsche1, Martin Vossiek1, Tim Weyrich1,2, Marc Stamminger1
1Friedrich-Alexander-Universität Erlangen-Nürnberg, 2University College London

IROS 2024

We developed a novel spatial calibration method, specifically targeted to near-field high-resolution imaging radars, to be calibrated with an optical depth camera, such that we can spatially fuse optical and radio-frequency data with millimeter precision.

Abstract

Despite an emerging interest in MIMO radar, the utilization of its complementary strengths in combination with optical depth sensors has so far been limited to far-field applications, due to the challenges that arise from mutual sensor calibration in the near field. In fact, most related approaches in the autonomous industry propose target-based calibration methods using corner reflectors that have proven to be unsuitable for the near field.

In contrast, we propose a novel, joint calibration approach for optical RGB-D sensors and MIMO radars that is designed to operate in the radar's near-field range, within decimeters from the sensors. Our pipeline consists of a bespoke calibration target, allowing for automatic target detection and localization, followed by the spatial calibration of the two sensor coordinate systems through target registration.

We validate our approach using two different depth sensing technologies from the optical domain. The experiments show the efficiency and accuracy of our calibration for various target displacements, as well as its robustness of our localization in terms of signal ambiguities.

Presentation

Calibration Target

Traditional far-field calibration target
Our near-field calibration target

Target Localization

Localization in RGB-D Data
Localization in Radar Data

Paper

Supplementary Video

BibTeX

@InProceedings{wirth2024nfcalib,
    title={Automatic Spatial Calibration of Near-Field MIMO Radar With Respect to Optical Depth Sensors}, 
    author={Vanessa Wirth and Johanna Bräunig and Danti Khouri and Florian Gutsche and Martin Vossiek and Tim Weyrich and Marc Stamminger},
    year={2024},
    eprint={2403.10981},
    archivePrefix={arXiv},
    primaryClass={cs.RO},
    url={https://arxiv.org/abs/2403.10981}, 
}

Acknowledgements

This work was funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) – SFB 1483 – Project-ID 442419336, EmpkinS.

The authors would like to thank the Rohde & Schwarz GmbH & Co. KG (Munich, Germany) for providing the radar imaging devices.

The authors gratefully acknowledge the scientific support and HPC resources provided by the Erlangen National High Performance Computing Center of the Friedrich-Alexander-Universität Erlangen-Nürnberg.