A Residual Neural Network with Voting for 3D Object Detection in Point Clouds

Yang Ji-sheng; Zhang Yun; Li Dong

doi:10.12052/gdutxb.200176

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

A Residual Neural Network with Voting for 3D Object Detection in Point Clouds

更新时间：2026-05-27

- A Residual Neural Network with Voting for 3D Object Detection in Point Clouds
- Vol. 39, Issue 1, Pages: 56-62(2022)
- 作者机构：
  
  广东工业大学自动化学院,广东,广州,510006
- 作者简介：
- 基金信息：
- DOI：10.12052/gdutxb.200176
  CLC： TP391.4;TP181
- Published：2022
- 稿件说明：
移动端阅览
杨积升, 章云, 李东. 点云目标检测残差投票网络[J]. 广东工业大学学报, 2022, 39(1): 56-62.

Yang Ji-sheng, Zhang Yun, Li Dong. A Residual Neural Network with Voting for 3D Object Detection in Point Clouds[J]. 2022, 39(1): 56-62.
杨积升, 章云, 李东. 点云目标检测残差投票网络[J]. 广东工业大学学报, 2022, 39(1): 56-62. DOI： 10.12052/gdutxb.200176.

Yang Ji-sheng, Zhang Yun, Li Dong. A Residual Neural Network with Voting for 3D Object Detection in Point Clouds[J]. 2022, 39(1): 56-62. DOI： 10.12052/gdutxb.200176.

摘要

高精度的三维目标检测是实现物体感知的关键技术

对自动驾驶、机器人控制等应用的落地具有重要意义。为提高三维目标检测的精度

对算法VoteNet改进

提出了一种基于残差网络的端到端的高精度三维点云目标检测网络ResVoteNet。具体来说

设计了适用于点云数据的残差网络骨架

提出了残差特征提取模块以及残差上采样模块

并集成进VoteNet框架。残差网络结构的引入增强了网络对点云数据的特征提取和学习能力

并且提高了模型的鲁棒性。该算法在公开的大规模点云数据集SCANNET和SUN-RGBD上进行实验

平均检测精度mAP分别达到61.1%和59.9%

超越了当前最先进水平的其他算法。

Abstract

High-precision 3D object detection is a key technology to realize object perception

which is of great significance to the implementation of applications such as automatic driving and robot control. In order to improve the accuracy of 3D object detection

the algorithm VoteNet is improved

and an end-to-end high-precision 3D point cloud target detection network based on residual network

ResVoteNet is proposed. Specifically

a residual network skeleton suitable for point cloud data is designed

and a residual feature extraction module and a residual up-sampling module are proposed and integrated into the VoteNet framework. The introduction of the residual network structure enhances the network's feature extraction and learning capabilities for point cloud data

and improves the robustness of the model. The algorithm is tested on the publicly available large-scale point cloud data sets SCANNET and SUN-RGBD

and the average detection accuracy mAP has reached 61.1% and 59.9%

respectively

surpassing other current state-of-the-art algorithms.

关键词

Keywords

references

王玺. 谷歌公布无人驾驶车事故细节未来交通尚仍是梦[J]. 华东科技, 2016, 4(1): 10-15.

YAN Y, MAO Y, LI B. Second: Sparsely embedded convolutional detection [J]. Sensors, 2018, 18(10): 3337.

LANG A H, VORA S, CAESAR H, et al. Pointpillars: fast encoders for object detection from point clouds[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Long Beach: IEEE, 2019: 12697-12705.

YANG Z X, PENG L C, LIU D N, et al . Development of point cloud processing system based on PCL and Qt [J ] . Journal of Guangdong University of Technology, 2017, 34(6): 61-67.

ZHOU Y, TUZEL O. Voxelnet: end-to-end learning for point cloud based 3D object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018: 4490-4499.

REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: unified, real-time object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 779-788.

QI C R, LIU W, WU C, et al. Frustum pointnets for 3D object detection from RGB-D data[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018: 918-927.

QI C R, SU H, MO K, et al. Pointnet: deep learning on point sets for 3D classification and segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI: IEEE, 2017: 652-660.

QI C R, LITANY O, HE K, et al. Deep hough voting for 3D object detection in point clouds[C]//Proceedings of the IEEE International Conference on Computer Vision. Long Beach: IEEE, 2019: 9277-9286.

SHI S, GUO C, JIANG L, et al. PV-RCNN: point-voxel feature set abstraction for 3D object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2020: 10529-10538.

LIU Z, ZHAO X, HUANG T, et al. TANet: robust 3D object detection from point clouds with triple attention[C]//Proceedings of the AAAI Conference on Artificial Intelligence. New York: AAAI, 2020: 11677-11684.

HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 770-778.

LONG J, SHELHAMER E, DARRELL T. Fully convolutional networks for semantic segmentation[C]//Proceedings of the Conference on Computer Vision and Pattern Recognition. Boston: IEEE, 2015: 3431-3440.

DAI A, CHANG A X, SAVVA M, et al. Scannet: richly-annotated 3D reconstructions of indoor scenes[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE, 2017: 5828-5839.

SONG S, LICHTENBERG S P, XIAO J. Sun RGB-D: a RGB-D scene understanding benchmark suite[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Boston: IEEE, 2015: 567-576.

SONG S, XIAO J. Deep sliding shapes for a modal 3D object detection in RGB-D images[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 808-816.

HOU J, DAI A, NIEBNER M. 3D-SIS: 3D semantic instance segmentation of RGB-D scans[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Long Beach: IEEE, 2019: 4421-4430.

LAHOUD J, GHANEM B. 2D-driven 3D object detection in RGB-D images[C]//Proceedings of the IEEE International Conference on Computer Vision. Honolulu: IEEE, 2017: 4622-4630.

REN Z, SUDDERTH E B. Three-dimensional object detection and layout prediction using clouds of oriented gradients[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 1525-1533.

HE K, GKIOXARI G, DOLLÁR P, et al. Mask R-CNN[C]//Proceedings of the IEEE International Conference on Computer Vision. Honolulu: IEEE, 2017: 2961-2969.

YI L, ZHAO W, WANG H, et al. GSPN: generative shape proposal network for 3D instance segmentation in point cloud[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Long Beach: IEEE, 2019: 3947-3956.

QI C R, YI L, SU H, et al . Pointnet++: deep hierarchical feature learning on point sets in a metric space [J ] . Advances in Neural Information Processing Systems, 2017, 30: 5099-5108.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

A Channel-splited Based Dual-branch Block for 3D Point Cloud Processing

Dynamic Adaptive Enhancement for Power Scene Images DA-IOD Algorithm for Quantitative Target Detection

SCA-YOLO: Real-time Target Detection Based on Deformable Convolution and Context-aware Attention

SR-Det:Towards Robust Detection of Slender and Rotated Objects in Industrial Scene

An Insulator Burst Defect Detection Method Based on YOLOv4-MP

Related Author

Zhong Geng-jun

Xu Fangyuan

Chen Hailin

Yuan Haoliang

Chen Jianhua

Sha Wendan

Deng Liguo

Ye Song-hang

Related Institution

School of Advanced Manufacturing, Guangdong University of Technology

School of Computer Science and Technology, Guangdong University of Technology

Yunnan Electric Power Research Institute, Yunnan Power Grid Co., Ltd

School of Applied Mathematics, Guangdong University of Technology

AI问答

⁰