提出选择性采样策略以提高网络训练效率和缓解网络正负样本不平衡问题。本方法在DOTA遥感数据集旋转目标检测任务上的平均精度(mean Average Precision
mAP)达到74.9%
超过了现有单阶段甚至部分双阶段的方法。定性与定量的对比实验表明
基于姿态表示的旋转目标检测网络具有设计简单、检测性能更高的优势。
Abstract
Horizontal bounding box representation in traditional object detection is not appropriate for ubiquitous oriented objects in aerial images because of the variant perspective
the crowded
cluttered and oriented objects. Therefore
a one-stage pose-based oriented object detection network is proposed
which represents oriented object as different pose and detect the oriented objects by locating the center and regressing four offsets between center and four vertices. Meanwhile
an adaptive feature pyramid network with learnable weights is utilized to automatically select more discriminative features. Moreover
according to the high resolution of aerial images
selective sampling strategy is proposed to improve the efficiency of network training and alleviate the imbalance problem of positive and negative samples. The proposed method achieves 74.85 mAP on oriented detection task of DOTA dataset
which outperforms the existing one-stage or even two-stage methods. The qualitative and quantitative comparative experiments show that the proposed pose-based oriented object detection network is simple and has competitive detection performance.
关键词
Keywords
references
XIA G S, BAI X, DING J, et al. DOTA: a large-scale dataset for object detection in aerial images[C]// IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018: 3974-3983.
UIJLINGS J R R, VAN DE SANDE K E A, GEVERS T, et al . Selective search for object recognition [J ] . International Journal of Computer Vision, 2013, 104(2): 154-171.
REN S, HE K, GIRSHICK R, et al . Fasterr-cnn: towards real-time object detection with region proposal networks [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 39(6): 1137-1149.
HE K, GKIOXARI G, DOLLAR P, et al. Mask r-cnn[C]//IEEE International Conference on Computer Vision. Venice: IEEE, 2017: 2961-2969.
REDMON J, FARHADI A. YOLOv3: an incremental improvement[J]. arXiv preprint arXiv: 1804.02767, 2018.
ZHONG Y C, SUN S Y, LYU S, et al . Recognition of bird’s nest on transmission tower in aerial images of high-voltage power line by YOLOv3 algorithm [J ] . Journal of Guangdong University of Technology, 2020, 37(3): 42-48.
LIN T Y, GOYAL P, GIRSHICK R, et al. Focal loss for dense object detection[C]//IEEE International Conference on Computer Vision. Venice: IEEE, 2017: 2980-2988.
ZHOU X, WANG D, KRAHENBUHL P. Objects as points[J]. arXiv preprint arXiv: 1904.07850, 2019.
DING J, XUE N, LONG Y, et al. Learning roi transformer for detecting oriented objects in aerial images[J]. arXiv preprint arXiv: 1812.00155, 2018.
YANG X, YANG J, YAN J, et al. Scrdet: towards more robust detection for small, cluttered and rotated objects[C]//IEEE International Conference on Computer Vision. Seoul: IEEE, 2019: 8232-8241.
XU Y, FU M, WANG Q, et al . Gliding vertex on the horizontal bounding box for multi-oriented object detection [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020(99): 1.
QIAN W, YANG X, PENG S, et al. Learning modulated loss for rotated object detection[J]. arXiv preprint arXiv: 1911.08299, 2019.
YANG X, LIU Q, YAN J, et al. R3det: refined single-stage detector with feature refinement for rotating object[J]. arXiv preprint arXiv: 1908.05612, 2019.
PAN X, REN Y, SHENG K, et al. Dynamic refinement network for oriented and densely packed object detection[C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2020: 11207-11216.
SUN K, XIAO B, LIU D, et al. Deep high-resolution representation learning for human pose estimation[C] //IEEE Conference on Computer Vision and Pattern Recognition. Long Beach: IEEE, 2019: 5693-5703.
LIN T Y, DOLLAR P, GIRSHICK R, et al. Feature pyramid networks for object detection[C]//IEEE Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE, 2017: 2117-2125.
ZHU P, WEN L, BIAN X, et al. Vision meets drones: a challenge[J]. arXiv preprint arXiv: 1804.07437, 2018.
EVERINGHAM M, ESLAMI S, WILLIAMS C , et al . The pascal visual object classes (voc) challenge [J ] . International Journal of Computer Vision, 2010, 88(2): 303-338.
LIN T Y, MAIRE M, BELONGIE S, et al. Microsoft coco: common objects in context[C]//European Conference on Computer Vision. Zurich: Springer, 2014: 740-755.
AZIMI S M, VIG E, BAHMANYAR R, et al. Towards multi-class object detection in unconstrained remote sensing imagery[C]//Asian Conference on Computer Vision. Perth : Springer, 2018: 150-165.
LIN Y, FENG P, GUAN J. Ienet: interacting embranchment one stage anchor free detector for orientation aerial object detection[J]. arXiv preprint arXiv: 1912.00969, 2019.
WEI H, ZHANG Y, CHANG Z, et al . Oriented objects as pairs of middle lines [J ] . ISPRS Journal of Photogrammetry and Remote Sensing, 2020, 169: 268-279.
ZHANG X, LZQUIERDO E, CHANDRAMOULI K. Dense and small object detection in uav vision based on cascade network[C]//IEEE International Conference on Computer Vision Workshops. Seoul: IEEE, 2019.
ZHANG J, HUANG J, CHEN X, et al. How to fully exploit the abilities of aerial image detectors[C]//IEEE International Conference on Computer Vision Workshops. Seoul: IEEE, 2019.
YANG F, FAN H, CHU P, et al. Clustered object detection in aerial images[C]//IEEE International Conference on Computer Vision. Seoul: IEEE, 2019: 8311-8320.
WANG H, WANG Z, JIA M, et al. Spatial attention for multi-Scale feature refinement for object detection[C]//IEEE International Conference on Computer Vision Workshops. Seoul: IEEE, 2019.
ZHANG P, ZHONG Y, LI X. SlimYOLOv3: Narrower, faster and better for real-time UAV applications[C]//IEEE International Conference on Computer Vision Workshops. Seoul: IEEE, 2019.