Multi-label Feature Selection Algorithm Based on ReliefF and Mutual Information

Chen Ping-hua; Huang Hui; Mai Miao; Zhou Hong-hong

doi:10.12052/gdutxb.180023

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

Multi-label Feature Selection Algorithm Based on ReliefF and Mutual Information

更新时间：2026-05-27

- Multi-label Feature Selection Algorithm Based on ReliefF and Mutual Information
- Vol. 35, Issue 5, Pages: 20-25, 50(2018)
- 作者机构：
  
  1. 广东工业大学　计算机学院,广东,广州,510006
  2. 广东南方报业传媒集团有限公司,广东,广州,510601
  3. 广东省科技创新监测研究中心,广东,广州,510033
- 作者简介：
- 基金信息：
- DOI：10.12052/gdutxb.180023
  CLC： TP181
- Online First：10 July 2018，
  
  Published：2018
- 稿件说明：
移动端阅览
陈平华, 黄辉, 麦淼, 周宏虹. 结合ReliefF和互信息的多标签特征选择算法[J]. 广东工业大学学报, 2018, 35(5): 20-25, 50.

Chen Ping-hua, Huang Hui, Mai Miao, et al. Multi-label Feature Selection Algorithm Based on ReliefF and Mutual Information[J]. 2018, 35(5): 20-25, 50.
陈平华, 黄辉, 麦淼, 周宏虹. 结合ReliefF和互信息的多标签特征选择算法[J]. 广东工业大学学报, 2018, 35(5): 20-25, 50. DOI： 10.12052/gdutxb.180023.

Chen Ping-hua, Huang Hui, Mai Miao, et al. Multi-label Feature Selection Algorithm Based on ReliefF and Mutual Information[J]. 2018, 35(5): 20-25, 50. DOI： 10.12052/gdutxb.180023.

摘要

针对传统单标签特征选择算法不能直接应用于多标签数据的问题

提出一种多标签特征选择算法——MML-RF算法. 在ReliefF的基础上

MML-RF算法提出新的类内最近邻样本查找方式

并结合多标签的贡献值改进特征权值的计算方法

能很好地适应多标签数据的特点; 同时为了减少特征冗余

MML-RF算法以互信息作为特征冗余度量方式

提出一种去冗余方法

能够得到更小的特征子集. 实验表明

MML-RF多标签特征选择算法得到的特征子集规模较小

且在多标签数据集上具有很好的分类效果

能够提升多标签学习和数据挖掘工作的效率.

Abstract

In view of the problem that the traditional feature selection algorithm can not be applied to the multi-label learning context

a MML-RF algorithm is presented. The MML-RF improves the way of defining and searching nearest neighbor on the basis of the ReliefF

and introduces a new parameter to consider the contribution values of different labels. The improved weighting formula enables MML-RF to be used to the multi-label dataset. MML-RF algorithm makes use of mutual information as the measure of feature redundancy

and puts forward a solution to redundancy

which can get smaller subset of features. Experiments show that the feature subset of MML-RF is smaller

and has good classification effect on multi-label dataset

which can further enhance the efficiency of subsequent multi-label learning and data mining.

关键词

Keywords

references

CHANDRASHEKAR G, SAHIN F. A survey on feature selection methods [J]. Computers Electrical Engineering, 2014, 40(1): 16-28.

YAO X, WANG X D, ZHANG Y X, et al . Summary of feature selection algorithms [J ] . Control and Decision, 2012, 27(2): 161-166.

XU J L, ZHOU Y M, CHEN L, et al . An unsupervised feature selection approach based on mutual information [J ] . Journal of Computer Research and Development, 2012, 49(2): 372-382.

ROBNIK-ŠIKONJA M, KONONENKO I. Theoretical and empirical analysis of ReliefF and RReliefF [J]. Machine Learning, 2003, 53(1-2): 23-69.

XIE Y, LI D, ZHANG D, et al. An improved multi-label Relief feature selection algorithm for unbalanced datasets[C]//Advances in Intelligent Systems and Interactive Applications.[S.l.]: Springer, 2017: 141-151.

FU Z, LU G, TING K M, et al . A survey of audio-based music classification and annotation [J ] . IEEE Transactions on Multimedia, 2011 , 13(2): 303-319.

TANG J, ALELYANI S, LIU H. Feature selection for classification: a review [J]. Documentación Administrativa, 2014: 313-334.

ZHANG M L, ZHOU Z H. A review on multi-label learning algorithms [J]. IEEE Transactions on Knowledge and Data Engineering, 2014, 26(8): 1819-1837.

KANJ S, ABDALLAH F, DENOEUX T, et al . Editing training data for multi-label classification with the k-nearest neighbor rule [J ] . Pattern Analysis and Applications, 2016, 19(1): 145-161.

HE K D, ZHU Z T, CHENG Y. A research on text classification method based on improved TF-IDF algorithm [J]. Journal of Guangdong University of Technology, 2016, 33(5): 49-53.

ZHAO K, CHU W S, DE L T F, et al. Joint patch and multi-label learning for facial action unit detection[C]//Computer Vision and Pattern Recognition. [S.l.]: IEEE, 2015: 2207-2216.

WU B, ZHONG E, HORNER A, et al. Music emotions recognition by multi-label multi-layer multi-instance multi-view learning[C]//ACM International Conference on Multimedia.[S.l.]: ACM, 2014: 117-126.

CHEN G, YE D, XING Z, et al. Ensemble application of convolutional and recurrent neural networks for multi-label text categorization[C]//International Joint Conference on Neural Networks. [S.l.]: IEEE, 2017: 2377-2383.

CHEN P H, ZHOU P. A recognition algorithm of noise applied to environments with intensive noise-data distribution [J]. Journal of Guangdong University of Technology, 2014, 31(3): 39-43.

HUANG L L, TANG J, SUN D D, et al . Feature selection algorithm based on multi-label ReliefF [J ] . Journal of Computer Applications, 2012, 32(10): 2888-2890.

VERGARA J R, ESTÉVEZ P A. A review of feature selection methods based on mutual information [J]. Neural Computing and Applications, 2014, 24(1): 175-186.

HU X G, XU Y, LI P P, et al . A fillter multi-label feature selection algorithm [J ] . Journal of Nanjing University (Natural Sciences), 2015, 51(4): 723-730.

TSOUMAKAS G, SPYROMITROS-XIOUFIS E, VILCEK J, et al . MULAN: a Java library for multi-label learning [J ] . Journal of Machine Learning Research, 2011, 12(7): 2411-2414.

CHERMAN E A, VALVERDE-REBAZA J, MONARD M C. Lazy multi-label learning algorithms based on mutuality strategies [J]. Journal of Intelligent Robotic Systems, 2015, 80(1): 261-276.

REYES O, MORELL C, Ventura S. Scalable extensions of the ReliefF algorithm for weighting and selecting features on the multi-label learning context [J]. Neurocomputing, 2015(161): 168-182.

LEE J, KIM D W. Mutual information-based multi-label feature selection using interaction information [J]. Expert Systems with Applications, 2015, 42(4): 2013-2025.

RODRIGUES D, PEREIRA L A M, NAKAMURA R Y M, et al . A wrapper approach for feature selection based on bat algorithm and optimum-path forest [J ] . Expert Systems with Applications, 2014, 41(5): 2250-2258.

ZHANG H R, CHEN P H, XIONG J B. Task scheduling algorithm based on simulated annealing ant colony algorithm in cloud computing environment [J]. Journal of Guangdong University of Technology, 2014, 31(3): 77-82.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Extension Classification Method for Label Variability

Joint Graph Embedding and Feature Weighting for Unsupervised Feature Selection

Combined Weighting Method for Short Text Features

Joint Low-Rank Representation and Graph Embedding for Unsupervised Feature Selection

A Research on Text Classification Method Based on Improved TF-IDF Algorithm

Related Author

Tian Yingjie

Liu Dalian

Li Xingsen

Zhang Wei

Zhang Zhen-bin

Tan You-xin

Teng Shao-hua

Related Institution

Research Center on Fictitious Economy and Data Science, Chinese Academy of Sciences

Institute of Mathematics and Physics, Beijing Union University

Institute of Fundamental and Interdisciplinary Sciences, Beijing Union University

Research Institute of Extenics and Innovation Methods, Guangdong University of Technology

School of Computers, Guangdong University of Technology

AI问答

⁰