嵌入拓扑特征的自然场景文本检测方法

郑侠聪; 程良伦; 黄国恒; 王敬超

doi:10.12052/gdutxb.230011

欢迎来到能源电力期刊网！

English Version 期刊登录

您当前的位置：

首页 >

文章列表页 >

嵌入拓扑特征的自然场景文本检测方法

计算机科学与技术 | 更新时间：2026-05-27

- 嵌入拓扑特征的自然场景文本检测方法
- Text Detection in Natural Scenes Embedded Topological Feature
- 广东工业大学学报 2024年41卷第3期页码：102-109
- 作者机构：
  
  广东工业大学计算机学院,广东,广州,510006
- 作者简介：
  
  郑侠聪(1996–)，男，硕士研究生，主要研究方向为计算机视觉、人工智能，E-mail：413169248@qq.com
  黄国恒(1985–)，男，副教授，博士，主要研究方向为计算机视觉、机器学习和模式识别等，E-mail：kevinwong@gdut.edu.cn
- 基金信息：
  
  国家自然科学基金资助项目(U20A6003);国家自然科学基金广东联合基金资助项目(U1801263, U1701262, U2001201);广东省信息物理融合系统重点实验室项目(2020B1212060069);佛山市重点领域科技攻关项目(2020001006832)
- DOI：10.12052/gdutxb.230011
  中图分类号： TP391
- 纸质出版：2024
- 稿件说明：
移动端阅览
郑侠聪, 程良伦, 黄国恒, 王敬超. 嵌入拓扑特征的自然场景文本检测方法[J]. 广东工业大学学报, 2024, 41(3): 102-109.

Zheng Xia-cong, Cheng Liang-lun, Huang Guo-heng, et al. Text Detection in Natural Scenes Embedded Topological Feature[J]. 2024, 41(3): 102-109.
郑侠聪, 程良伦, 黄国恒, 王敬超. 嵌入拓扑特征的自然场景文本检测方法[J]. 广东工业大学学报, 2024, 41(3): 102-109. DOI： 10.12052/gdutxb.230011.

Zheng Xia-cong, Cheng Liang-lun, Huang Guo-heng, et al. Text Detection in Natural Scenes Embedded Topological Feature[J]. 2024, 41(3): 102-109. DOI： 10.12052/gdutxb.230011.

摘要

传统的基于锚点框(anchor box)实现的自然场景文本检测方法中，锚点框容易受到其他文本实例的干扰产生误判或精度降低，且文本实例包含强烈的拓扑特征但并未得到重视，导致在弯曲环形文本检测任务中表现不佳。针对这个问题提出了一种新颖的神经网络结构，引入图卷积神经网络的概念，充分考虑邻近锚点框之间的联系，并融入锚点框的拓扑特征辅助图神经网络的学习，提高整体网络的有效性。在两个公开的自然场景文本检测数据集上进行了消融实验，在公开数据集CTW1500中，本文提出的方法使模型在召回率、精确率、

分数这3个指标上分别提高了3.0%、1.9%以及2.5%，在公开数据集Totel-Text中这3个指标分别是2.2%、1.8%以及2.0%。此外，本文方法还与近年提出的其他文本检测算法进行了比较，实验结果证明本文提出的方法在复杂自然场景下文本检测效果优秀，所提出的模块有利于文本检测性能的提高。

Abstract

In traditional anchor box-based text detection methods for natural scenes

anchor boxes are prone to interference from other text instances

resulting in erroneous judgments or affecting accuracy. Moreover

text instances contain strong topological features

which are usually be ignored

resulting in poor performance in curved circular text detection tasks. To solve this problem

a novel neural network structure is proposed

which introduces the concept of graph convolutional networks by fully considering the relationship between adjacent anchor frames

and incorporating the topological characteristics of anchor frames to assist the learning of graph neural networks

improving the effectiveness of the overall network. The ablation experiments were conducted on two publicly available natural scene text detection datasets. In the CTW1500 dataset

the proposed method improved the model by approximately 3.0%

1.9%

and 2.5% in terms of recall

accuracy

and F-score

respectively

and in the Totel-Text dataset

the three values were improved by approximately 2.2%

1.8%

and 2.0%

respectively. In addition

the proposed method has also been compared with other text detection algorithms proposed in recent years. Experimental results show that the proposed method performs well for text detection in complex natural scenes

demonstrating the promising effectiveness of the proposed module for improving the performance of text detection.

关键词

Keywords

references

ROSS B, GIRSHICK, JEFF D, TREVOR D, et al . Rich feature hierarchies for accurate object detection and semantic segmentation [C ] //Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2014: 580-587.

LIU W, ANGUELOV D, ERHAN D, et al . SSD: single shot multi box detector[C ] //Proc of the 2016 European Conference on Computer Vision. Amsterdam: Springer, 2016: 21-37.

ZHI T, HUANG W, TONG H, et al . Detecting text in natural image with connectionist text proposal network[C ] //Proc of the 2016 European Conference on Computer Vision. Amsterdam: Springer, 2016: 56-72.

LIAO M, SHI B, BAI X, et al . TextBoxes: a fast text detector with a single deep neural network [C ] //Proc of the AAAI Conference on Artificial Intelligence. San Francisco: AAAI, 2017: 186-196.

LIAO M, SHI B G, BAI X. TextBoxes++: a single-shot oriented scene text detector [J]. IEEE Trans on Image Processing:a Publication of the IEEE Signal Processing Society, 2018, 27(8): 3676-3690.

LONG S B, RUAN J Q, ZHANG W J, et al . Textsnake: a flexible representation for detecting text of arbitrary shapes[C ] //Proc of the European conference on computer vision. Munich: Springer, 2018: 20-36.

WEI F, HE W H, YIN F, et al. Textdragon: an end-to-end framework for arbitrary shaped text spotting[C]//Proc of the IEEE/CVF International Conference on Computer Vision, Long Beach: IEEE, 2019: 9076-9085.

DAN D, LIU H F, LI X L, et al. Pixellink: detecting scene text via instance segmentation[C ] //Proc of the AAAI Conference on Artificial Intelligence. New Orleans: AAAI, 2018: 296-308

LIN T Y, DOLLAR P, GIRSHICK R, et al . Feature pyramid networks for object detection[C ] //Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Hawaii: IEEE, 2017: 2117-2125.

DEFFERRARD M, BR ESSON X, VANDERGHEYNST P, et al. Convolutional neural networks on graphs with fast localized spectral filtering[C ] //Advances in Neural Information Processing Systems. Barcelona: MIT, 2016: 29.

ZHU Y Q, CHEN J Y, LIANG L Y, et al . Fourier contour embedding for arbitrary-shaped text detection[C ] //Proc of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Nashville: IEEE, 2021: 3123-3131.

KOHLI H, AGARWAL J, KUMAR M. An improved method for text detection using Adam optimization algorithm [J]. Global Transitions Proceedings, 2022, 3(1): 230-234.

LIU Z, FANG Y, HUANG C, et al. GraphXSS: an efficient XSS payload detection approach based on graph convolutional network[J].Computers Security, 2022, 114: 102597.

MA J Q, SHAO W Y, YE H, et al . Arbitrary-oriented scene text detection via rotation proposals [J ] . IEEE Trans on Multimedia, 2018, 20(11): 3111-3222.

ASHISH V, NOAM S, NIKI P, et al . Attention is all you need [J ] . Advances in Neural Information Processing Systems, 2017, 30(10): 6000-6010.

GAO H, XIANG Y, SUI Y, et al. Topological graph convolutional network based on complex network characteristics[J]. IEEE Access, 2022, 10: 64465-64472

JIANG W. Graph-based deep learning for communication networks: a survey[J]. Computer Communications, 2022, 185: 40-54

WANG Z, ZHENG L, LI Y , et al . Linkage based face clustering via graph convolution network[C ] //Proc of the IEEE/CVF International CONference on Computer Vision. Long Beach: IEEE, 2019: 1117-2225.

CHENG C K, CHAN C S, LIU C L. Total-text: toward orientation robustness in scene text detection [J]. International Journal on Document Analysis and Recognition(IJDAR) , 2020, 23(1): 31-52.

YUAN T L, ZHU Z, XU K, et al . A large chinese text dataset in the wild [J ] . Journal of Computer Science and Technology, 2019, 34(3): 509-521.

GUPTA A , VEDALDI A , ZISSERMAN A, et al . Synthetic data for text localisation in natural images[C ] //Proc of the IEEE CONFERence on Computer Vision and Pattern Recognition. Las Vegas : IEEE, 2016: 2315-2324.

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

具守恒量波动方程的循环双子网物理信息神经网络

双模态迭代交叉注意力融合集成框架

SCA-YOLO: 基于可变形卷积与上下文感知注意力的实时目标检测

融合沟道倾斜角的3D NAND存储单元建模及编程策略优化

基于AAGV-YOLOX模型的输电线路异物检测研究