4D Imaging Radar and Stereo Camera: Cost-effective Solution for Autonomous Vehicles
DOI:
https://doi.org/10.31305/rrijm2026.v06.n03.003Keywords:
LiDAR, 4D Imaging radar, stereo camera, AIAbstract
In autonomous driving, 3D object detection plays a critical role by enabling vehicles to perceive their surroundings. However, Light detection and ranging (LiDAR) suffers from severe point cloud degradation in adverse weather with high cost-benefit ratio. LiDAR may potentially be replaced with a combination of 4D Imaging radar, stereo camera and AI. It leads to high quality 4D cloud and object tracking. To address the challenges of prevalent systems, we propose this new technology by fusing 4D Imaging radar, stereo camera and AI. 4D Imaging radar measures the surrounding in 3D and also track the object motion. Stereo camera helps in depth measurement. AI is used for fusing the sensors.
References
Zhang Y, Carballo A, Yang H, Takeda K. Perception and sensing for autonomous vehicles under adverse weather conditions: A survey. ISPRS Journal of Photogrammetry and Remote Sensing. 2023;196:146–177. doi: 10.1016/j.isprsjprs.2022.12.021. DOI: https://doi.org/10.1016/j.isprsjprs.2022.12.021
Bijelic M, Gruber T, Mannan F, Kraus F, Ritter W, Dietmayer K, et al. Seeing through fog without seeing fog: Deep multimodal sensor fusion in unseen adverse weather. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020:11682–11692. DOI: https://doi.org/10.1109/CVPR42600.2020.01170
Zhou Y, Liu L, Zhao H, López-Benítez M, Yu L, Yue Y. Towards deep radar perception for autonomous driving: Datasets, methods, and challenges. Sensors. 2022;22(11):4208. doi: 10.3390/s22114208. DOI: https://doi.org/10.3390/s22114208
Zhao Y, Jiang J, Dong T, et al. A novel 4D radar and image fusion for 3D object detection in autonomous driving. In: 2024 IEEE 27th International Conference on Intelligent Transportation Systems (ITSC). doi: 10.1109/ITSC58415.2024.10919966. DOI: https://doi.org/10.1109/ITSC58415.2024.10919966
Szeliski R. Computer Vision: Algorithms and Applications. 2nd ed. Springer; 2022. doi: 10.1007/978-3-030-34372-9. DOI: https://doi.org/10.1007/978-3-030-34372-9
Liu H, Liu J, Jiang G, Jin X. MSSF: A 4D radar and camera fusion framework with multi-stage sampling for 3D object detection in autonomous driving. arXiv. 2024. https://arxiv.org/abs/2411.15016. DOI: https://doi.org/10.1109/TITS.2025.3554313
