【论文阅读】RadarNet: Exploiting Radar for Robust Perception of Dynamic Objects

RadarNet是一种新的神经网络架构,它结合了LiDAR和雷达传感器的数据,以实现对场景中动态对象的精确检测和速度估计。通过早期融合利用雷达的长感知范围和几何信息,晚期融合利用雷达的动态信息(如径向速度)进行更精确的目标关联和速度聚合。实验表明,这种方法在检测远距离物体和理解动态物体运动方面提高了感知能力。

RadarNet: Exploiting Radar for Robust Perception of Dynamic Objects

Abstract

Radar provides complementary information in the form of Doppler velocity.

propose a new solution that exploits both LiDAR and Radar sensors for perception.

1 Introduction

cameras capture rich appearance features, LiDAR provides direct and accurate 3D measurements.
Challenges:

  • sparsity of LiDAR measurements (e.g., at long range)
  • sensor’s sensitivity to weather (e.g., fog, rain and snow)
  • estimating their velocities is also of vital importance.
  • cameras and Lidar provides static information only.

Radar’s limitations:

  • data is very sparse (typically much more so than LiDAR)
  • the measurements are ambiguous in terms of position and velocity
  • the readings lack tangential information and often contain false positives

What this paper do:

  1. design a novel neural network architecture, dubbed RadarNet, which can exploit both LiDAR and Radar to provide accurate detections and velocity estimates for the actors in the scene.
  2. propose a multi-level fusion scheme that can fully exploit both geomet- ric and dynamic information of Radar data.

Steps:

  1. first fuse Radar data with LiDAR point clouds via a novel voxel-based early fusion approach to leverage the Radar’s long sensing range.
  2. Furthermore, after we get object detections, we fuse Radar data again via an attention-based late fusion approach to leverage the Radar’s velocity readings.

attention module transforming the 1D radial velocities from Radar to accurate 2D object velocity estimates.

2 Related Work

3 Review of LiDAR and Radar Sensors

LiDAR (light detection and ranging) sensors can be divided into three main types: spinning LiDAR(旋转激光雷达), solid state LiDAR(固态激光雷达), and flash LiDAR(闪光激光雷达).
In this paper w

评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值