
1. 广东工业大学 计算机学院,广东,广州,510006
2. 广州番禺职业技术学院 信息工程学院,广东,广州,511483
Published:2025
移动端阅览
滕少华, 吴泽锋, 滕璐瑶, 等. 置信样本选择与差异性特征增强的域适应[J]. 广东工业大学学报, 2025, 42(3): 12–26.
Teng Shaohua, Wu Zefeng, Teng Luyao, et al. Confidence Sample Selection and Specific Feature Enhancement for Domain Adaptation[J]. 2025, 42(3): 12-26.
滕少华, 吴泽锋, 滕璐瑶, 等. 置信样本选择与差异性特征增强的域适应[J]. 广东工业大学学报, 2025, 42(3): 12–26. DOI: 10.12052/gdutxb.230188
Teng Shaohua, Wu Zefeng, Teng Luyao, et al. Confidence Sample Selection and Specific Feature Enhancement for Domain Adaptation[J]. 2025, 42(3): 12-26. DOI: 10.12052/gdutxb.230188.
域适应学习因其有效减少域差异实现标签传播被广泛应用。目前,大多数域适应学习仅通过线性判别分析增强线性数据的判别性而忽略了现实世界存在非线性数据;同时,这些方法未考虑目标域的低置信样本对训练过程的负影响。因此,本文提出一种新颖的置信样本选择与差异性特征增强的域适应框架(Confidence Sample Selection and Specific Feature Enhancement
CSS-SFE)。首先,该框架通过最小最大原则选择高置信的目标样本来辅助训练,减少不正确伪标签影响;其次,权衡类散点矩阵和邻居散点矩阵的贡献来增强线性和非线性数据集的特征,提高数据集的判别性;接着,分别为源域和目标域的样本学习不同投影矩阵来保持各自的差异性特征,防止源域和目标域的样本区分性降低;再次,进一步应用边缘分布对齐和条件分布对齐减少域分布差异;最后,在多个基准数据集上进行的广泛实验证明该方法优于目前的方法。
For domain shifts
domain adaptation (DA) promotes label propagation by reducing distributional differences. In recent work
DA only enhances the discriminability of linear data by linear discriminant analysis
which ignores real-world nonlinear data. Meanwhile
these methods fail to consider the negative impact of the target low-confidence samples on the training process. Therefore
confidence sample selection and specific feature enhancement for domain adaptation (CSS-SFE) is proposed. Firstly
the framework selects target high-confidence samples through the min-max principle to reduce the impact of incorrect pseudo-label during training; Secondly
the class scatter matrix and neighbor scatter matrix are balanced to enhance the features of linear and nonlinear datasets so that the discriminability of the samples is improved; Thirdly
the framework maintains source and target specific features by learning different projection matrices
which prevents the discriminability of the samples decreasing; Fourthly
the marginal and conditional distribution alignment is further applied to reduce the domain distribution discrepancy; Finally
extensive experiments on several benchmark datasets demonstrate the superiority of CSS- SFE over state-of-the-art methods.
PAN S J, TSANG F W, KWOK J T, et al . Domain adaptation via transfer component analysis [J ] . Journal of IEEE Transactions on Neural Networks and Learning Systems, 2011, 22: 199-210.
LONG M S, WANG J M, DING G G, et al . Transfer feature learning with joint distribution adaptation[C ] //2013 International Conference on Computer Vision. Sydney: IEEE, 2013: 2200-2207.
GHIFARY M, BALDUZZI D, KLEIJN W B, et al . Scatter component analysis: a unified framework for domain adaptation and domain generalization [J ] . Journal of IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39: 1414-1430.
LI S, SONG S J, HUANG G, et al . Domain invariant and class discriminative feature learning for visual domain adaptation [J ] . Journal of IEEE Transactions on Image Processing, 2018, 27: 4260-4273.
ZHANG W, WU D R. Discriminative joint probability maximum mean discrepancy (DJP-MMD) for domain adaptation[C]//2020 International Joint Conference on Neural Networks. Glasgow, United Kingdom: IEEE, 2020, 1-8.
TENG S H, ZHENG Z F, WU N Q, et al . Domain adaptation via incremental confidence samples into classification [J ] . Journal of International Journal of Intelligent Systems, 2022, 37: 365-385.
MENG M, LAN M C, YU J, et al . Dual-level adaptive and discriminative knowledge transfer for cross-domain recognition [J ] . Journal of IEEE Transactions on Multimedia, 2023, 25: 2266-2279.
ZHU F, GAO J B, YANG J, et al . Neighborhood linear discriminant analysis [J ] . Journal of Pattern Recognition, 2022, 123: 108422.
WANG J D, CHEN Y Q, HAO S J, et al . Balanced distribution adaptation for transfer learning[C ] // 2017 International Conference on Data Mining. New Orleans: IEEE, 2017: 1129-1134.
WANG J D, CHEN Y Q, YU H, et al . Easy transfer learning by exploiting intra-domain structures[C ] //2019 International Conference on Multimedia and Expo. Shanghai: IEEE, 2019: 1210-1215.
PENG Z H, ZHANG W, HAN N, et al . Active transfer learning [J ] . Journal of IEEE Transactions on Circuits and Systems for Video Technology, 2020, 30: 1022-1036.
TIAN L, TANG Y Q, HU Y Q, et al . Domain adaptation by class centroid matching and local manifold self-learning [J ] . Journal of IEEE Transactions on Image Processing, 2020, 29: 9703-9718.
XIAO N, ZHANG L, XU X, et al . Label disentangled analysis for unsupervised visual domain adaptation [J ] . Journal of Knowledge-Based Systems, 2021, 229: 107309.
LI Y, LI D S, LU Y W, et al . Progressive distribution alignment based on label correction for unsupervised domain adaptation[C ] //2021 International Conference on Multimedia and Expo. Shenzhen: IEEE, 2021: 1-6.
LU Y W, LI D S, WANG W J, et al . Discriminative invariant alignment for unsupervised domain adaptation [J ] . Journal of IEEE Transactions on Multimedia, 2022, 24: 1871-1882 .
ZHAO J C, LI L S, DENG F, et al . Discriminant geometrical and statistical alignment with density peaks for domain adaptation [J ] . Journal of IEEE Transactions on Cybernetics, 2022, 52: 1193-1206.
WANG J D, FENG W J, CHEN Y Q, et al . Visual domain adaptation with manifold embedded distribution alignment[C ] // 2018 Multimedia Conference on Multimedia Conference. Seoul: ACM, 2018: 402-410.
ZHANG W, LI C, TENG S H. Joint discriminative distribution adaptation and manifold regularization for unsupervised domain adaptation[C]// 24th International Conference on Computer Supported Cooperative Work in Design. Dalian: IEEE, 2021: 226-231.
YANG H W, HE H, ZHANG W Z, et al . Lie group manifold analysis: an unsupervised domain adaptation approach for image classification [J ] . Journal of Applied Intelligence, 2022, 52: 4074-4088.
SUN J, WANG Z H, WANG W, et al . Joint adaptive dual graph and feature selection for domain adaptation [J ] . Journal of IEEE Transactions on Circuits and Systems for Video Technology, 2022, 32: 1453-1466.
WANG Q, BRECKON. Unsupervised domain adaptation via structured prediction based selective pseudo-labeling[C]// 2020 Applications of Artificial Intelligence Conference. New York: AAAI, 2020: 6243-6250.
ZHANG J, LI W Q, OGUNBONA P. Joint geometrical and statistical alignment for visual domain adaptation[C]//2017 Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE, 2017: 5150-5158.
SARAY S N, TAHMORESNEZHAD J. Joint distinct subspace learning and unsupervised transfer classification for visual domain adaptation [J]. Journal of Signal Image Video Process, 2021, 15: 279-287.
GONG B Q, SHI Y, SHA F, et al . Geodesic flow kernel for unsupervised domain adaptation[C ] // 2012 Conference on Computer Vision and Pattern Recognition. Providence: IEEE, 2012: 2066-2073.
SAENKO K, KULIS B, FRITZ M et al . Adapting visual category models to new domains[C ] // 11th European Conference on Computer Vision, Heraklion. Greece: Springer, 2010: 213-226.
WANG Q, BRECKON T P. Unsupervised domain adaptation via structured prediction based selective pseudo-labeling[C]//The Thirty-Fourth Conference on Artificial Intelligence. New York: AAAI, 2020: 6243-6250.
NENE S A, NAYAR S K, MURASE H. Columbia object image library (COIL-100) [R]. New York: Columbia University, 1996.
VENKATESWARA H, EUSEBIO J, CHAKRABORTY S, et al . Deep hashing network for unsupervised domain adaptation[C ] // 2017 Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE, 2017: 5018-5027.
LIU H, LONG M S, WANG J M, et al . Transferable adversarial training: a general approach to adapting deep classifiers[C ] //2019 Proceedings of the 36th International Conference on Machine Learning. California: PMLR, 2019: 4013-4022.
ZHU Y C, ZHUANG F Z, WANG J D, et al . Deep subdomain adaptation network for image classification [J ] . Journal of IEEE Transactions on Neural Networks and Learning Systems, 2020, 32: 1713-1722.
LI J J, CHEN E, DING Z M, et al . Maximum density divergence for domain adaptation [J ] . Journal of IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, 43: 3918-3930.
0
Views
0
下载量
0
CSCD
Publicity Resources
Related Articles
Related Author
Related Institution
京公网安备11010802024621