A Lightweight LiDAR-Camera Sensing Method of Obstacles Detection and Classification for Autonomous Rail Rapid Transit

Release time:2022-08-09

Impact Factor:9.55

DOI number:10.1109/TITS.2022.3194553

Journal:IEEE Transactions on Intelligent Transportation Systems

Key Words:LiDAR and RGB camera, data fusion, autonomous rail rapid transit, point cloud classification

Abstract:Detecting obstacles accurately is a vital part of realizing autonomous driving. But utilizing single sensors, for example, RGB camera or LiDAR itself, is difficult to meet the needs of autonomous driving under the condition of sparse environmental sensing data. In contrast, equipments that can collect data in large quantities are expensive and difficult to be utilized in practical applications. Hence, under the premise of ensuring low application costs, the difficult task is to obtain high-precision three-dimensional information of obstacles in real-time from sparse data. To overcome this problem, a real-time detection technique that combines LiDAR data and image information for obstacles detection is proposed in this article. It can detect vehicles close to the ART in sparse data in real-time. The sparse point cloud is de-noised initially and the ground is separated from the initial cloud data. The remained cloud, which includes surrounding vehicles, are processed by the clustering algorithm according to the structural relationship and scanning mechanism of the LiDAR. Then the processed LiDAR data is fused with the classification information generated from images based on a neural network to locate suspicious obstacles. The ratio values between the central values of vehicles and image width are obtained in the image coordinate system. Then the category information and ratio values are mapped on the processed LiDAR clusters during ART operation. The method is tested and verified in the real field. The evaluation results show that the proposed method can achieve an average accuracy of 85.5% for obstacle classification with a cost-effective sensing suit.

Note:IEEE Transactions on Intelligent Transportation Systems是智能交通系统领域top期刊，中科院大类分区一区，CCF B类期刊，最新的IF为9.55。属于交通领域顶刊。

Co-author:Chao Li, Tian Yuwen, Zhengliang Wan

First Author:Scarlett Liu

Indexed by:Journal paper

Correspondence Author:Yiping Luo

Volume:23

Issue:12

Page Number:23043-23058

Translation or Not:no

Included Journals:SCI