模糊c-harmonic均值算法在不平衡数据上改进

doi:10.13229/j.cnki.jdxbgxb20190963

Abstract

Abstract:

A new fuzzy c-harmonic means clustering algorithm, which is based on cluster volumes constraint, is proposed in this paper to solve the problem of imperfect clustering performance of traditional algorithm for imbalanced data set. Firstly, a quantity is defined by the membership matrix to measure the volume of each cluster, which is then used to construct a new objective function by combining with that of traditional algorithm. Secondly, new membership matrix and cluster center formulas are obtained by minimizing this new objective function. The proposed algorithm was tested on the UCI data sets, simulated imbalanced data sets and actual machine vibration detection imbalanced data sets. Experimental results show that, compared with several peer algorithms, the proposed algorithm achieved good clustering performance for imbalanced data sets while maintaining the global optimal performance of the traditional one.

Key words: artificial intelligence, clustering, fuzzy c-harmonic mean algorithm, global optimality, unbalanced data

CLC Number:

TP391

Fu LIU,Yi-xin LIANG,Tao HOU,Yang SONG,Bing KANG,Yun LIU. Improvement of fuzzy c-harmonic mean algorithm on unbalanced data[J].Journal of Jilin University(Engineering and Technology Edition), 2021, 51(4): 1447-1453.

Figures/Tables 8

Fig.1

Table 1

Table 2

Table 3

Fig.2

Fig.3

Fig.4

Table 4

References 23

1	Henao-Restrepo A M, Camacho A, Longini I M, et al. Efficacy and effectiveness of an rVSV-vectored vaccine in preventing Ebola virus disease: final results from the guinea ring vaccination open-label cluster-randomised trial[J]. Lancet, 2017, 389(10068): 505-518.
2	Huzurbazar S, Kuang D Y, Lee L. Landmark-based algorithms for group average and pattern recognition[J]. Pattern Recognition, 2019, 86: 172-187.
3	刘云, 刘富, 侯涛,等. 优化核参数的模糊C均值聚类算法[J]. 吉林大学学报:工学版, 2016, 46(1):246-251.
	Liu Yun, Liu Fu, Hou Tao, et al. Kernel-based fuzzy C-means clustering method based on parameter optimization[J]. Journal of Jilin University(Engineering and Technology Edition), 2016, 46(1): 246-251.
4	Gao Z M, Wang L, Zhou L P. A probabilistic approach to cross-region matching-based image retrival[J]. IEEE Transactions on Image Processing, 2019, 28(3): 1191-1204.
5	Zhang B. Generalized k-harmonic Means-Boosting in unsupervised Learning[M]. Palo Alto: Hewlett, 2000.
6	Zhang B, Hsu M, Dayal U. K-harmonic means-a spatial clustering algorithm with boosting[C]∥International Workshop on Temporal, Spatial, and Spatio-Temporal Data Mining, Lyon, France, 2000, 12: 31-45.
7	Wu X H, Wu B, Sun J, et al. A hybrid fuzzy K-harmonic means clustering algorithm[J]. Applied Mathematical Modelling, 2015, 39(12): 3398-3409.
8	Jiang H, Yi S, Li J, et al. Ant clustering algorithm with K -harmonic means clustering[J]. Expert Systems with Applications, 2010, 37(12): 8679-8684.
9	汪中, 刘贵全, 陈恩红. 基于模糊K-harmonic means的谱聚类算法[J]. 智能系统学报, 2009,4(2): 95-99.
	Wang Zhong, Liu Gui-quan, Chen En-hong, et al. A spectral clustering algorithm based on fuzzy K-harmonic means[J]. CAAI Tranctions on Intelligent Systems, 2009, 4(2): 95-99.
10	Yang F, Sun T, Zhang C. An efficient hybrid data clustering method based on K-harmonic means and particle swarm optimization[J]. Expert Systems with Applications, 2009, 36(6): 9847-9852.
11	赵恒, 杨万海, 张高煜. 模糊K-Harmonic Means聚类算法[J]. 西安电子科技大学学报:自然科学版, 2005,32(4):603-606, 638.
	Zhao Heng, Yang Wan-hai, Zhang Gao-yu, et al. Fuzzy K-Harmonic Means clustering algorithm[J]. Journal of Xidian University(Natural Science), 2005, 32(4): 603-606, 638.
12	Bensaid A M, Hall L O, Bezdek J C. Partially supervised clustering for image segmentation[J]. Pattern Recognition, 1996, 29(5): 859-871.
13	Noordam J C, van den Broek W H A M, Buydens L M C. Multivariate image segmentation with cluster size insensitive fuzzy C-means[J]. Chemometrics and Intelligent Laboratory Systems, 2002, 64(1): 65-78.
14	Liang J Y, Bai L, Dang C Y, et al. The K-Means-Type algorithms versus imbalanced data distributions[J]. IEEE Transactions on Fuzzy Systems, 2012, 20(4): 728-745.
15	Likas A, Vlassis N, Verbeek J J. The global k-means clustering algorithm[J]. Pattern Recognition, 2002, 36(2): 451-461.
16	Bagirov A M. Modified global k-means algorithm for minimum sum-of-squares clustering problems[J]. Pattern Recognition, 2008, 41(10): 3192-3199.
17	Zhang Bin, Hsu M, Dayal U, et al. K-Harmonic means—a data clustering algorithm[J]. Hewlett Packard Research Laboratory Technical Report, 1999.
18	Kim D W, Lee K H, Lee D. On cluster validity index for estimation of the optimal number of fuzzy clusters[J]. Pattern Recognition, 2004, 37(10): 2009-2025.
19	Capitaine H L, Frelicot C. A cluster-validity index combining an overlap measure and a separation measure based on fuzzy-aggregation operators[J]. IEEE Transactions on Fuzzy Systems, 2011, 19(3): 580–588.
20	Zahid N, Limouri M, Essaid A. A new cluster-validity for fuzzy clustering[J]. Pattern Recognition, 1999, 32(7): 1089-1097.
21	Wu K L, Yang M S. A cluster validity index for fuzzy clustering[J]. Pattern Recognition Letters, 2005, 26(9): 1275-1291.
22	Han H, Wang W Y, Mao B H. Borderline-SMOTE: a new over-sampling method in imbalanced data sets learning[J]. International Conference on Intelligent Computing, 2005, 3644(5): 878-887.
23	Su C T, Chen L S, Yih Y. Knowledge acquisition through information granulation for imbalanced data[J]. Expert Systems with Applications, 2006, 31(3): 531-541.

Related Articles 15

[1]	Ya-hui ZHAO,Fei-yang YANG,Zhen-guo ZHANG,Rong-yi CUI. Korean text structure discovery based on reinforcement learning and attention mechanism [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(4): 1387-1395.
[2]	Yan-hua DONG,Jing-wei LIU,Jing-hua ZHAO,Liang LI,Fang-xi XIE. Real-time torque tracking control based on BPNN online learning prediction model [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(4): 1405-1413.
[3]	Fu-hua SHANG,Mao-jun CAO,Cai-zhi WANG. Local outlier data mining based on artificial intelligence technology [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(2): 692-696.
[4]	Hai-ying ZHAO,Wei ZHOU,Xiao-gang HOU,Xiao-li ZHANG. Double-layer annotation of traditional costume images based on multi-task learning [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(1): 293-302.
[5]	Dan-tong OUYANG,Cong MA,Jing-pei LEI,Sha-sha FENG. Knowledge graph embedding with adaptive sampling [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(2): 685-691.
[6]	Yi-bin LI,Jia-min GUO,Qin ZHANG. Methods and technologies of human gait recognition [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(1): 1-18.
[7]	Qiao-bin LIU,Wen-ku SHI,Zhi-yong CHEN,Lian-meng LUO,Zhi-yong SU,Kai-jun HUANG. Parameter estimation of mixed reliability model based on kernel density optimal grouping and gravity search algorithm [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 1818-1825.
[8]	Jun-jun LI,Jian-nong CAO,Bei-bei CHENG,Juan LIAO,Ying-ying ZHU. High spatial resolution remote sensing imagery segmentation based on combination of pixels and multi⁃scaleobjects using spectral clustering [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 2098-2108.
[9]	Bin LI,Xu ZHOU,Fang MEI,Shuai-ning PAN. Location recommendation algorithm based on K-means and matrix factorization [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(5): 1653-1660.
[10]	Qian XU,Ying LI,Gang WANG. Pedestrian-vehicle detection based on deep learning [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(5): 1661-1667.
[11]	Yu-mei LIU,Ning-guo QIAO,Jiao-jiao ZHUANG,Peng-cheng LIU,Ting HU,Li-jun CHEN. Anomaly detection of rail vehicle gearbox based on multi⁃sensor data fusion [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(5): 1465-1470.
[12]	Wan-fu GAO,Ping ZHANG,Liang HU. Nonlinear feature selection method based on dynamic change of selected features [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(4): 1293-1300.
[13]	Dan⁃tong OUYANG,Jun XIAO,Yu⁃xin YE. Distant supervision for relation extraction with weakconstraints of entity pairs [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 912-919.
[14]	LIU Zhong-min,WANG Yang,LI Zhan-ming,HU Wen-jin. Image segmentation algorithm based on SLIC and fast nearest neighbor region merging [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1931-1937.
[15]	GU Hai-jun, TIAN Ya-qian, CUI Ying. Intelligent interactive agent for home service [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1578-1585.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 0

No Suggested Reading articles found!

数据集	样本数量	特征数量	类的个数	样本组成
Iris	150	4	2或3	50，50
Iris	150	4	2或3	50，50，50
Ionosphere	351	34	2	126，225
Pima Indians Diabetes	768	8	2	538，230
Breast Cancer1	683	10	2	458，225
Glass	214	9	2	163，51
Breast Cancer2	569	30	2	212，357
振动数据集	215	48 312	2	159，56

数据集	c	J_opt	本文算法
数据集	c	J_opt	J	E	N	t
Iris	2	152.35	152.37	0.01	16	0.03
			152.37	0.01	14	0.01
			152.37	0.01	18	0.01
			152.37	0.01	14	0.01
			152.37	0.01	15	0.01
	3	78.85	79.12	0.33	39	0.05
			79.12	0.33	30	0.02
			79.12	0.33	25	0.02
			79.12	0.33	37	0.03
			79.12	0.33	30	0.02
Ionosphere	2	2419.4	2420.01	0.03	33	0.09
			2420.01	0.03	44	0.12
			2420.01	0.03	36	0.11
			2420.01	0.03	30	0.06
			2420.01	0.03	53	0.14
Pima Indians Diabetes	2	5.14e6	5.18e6	0.68	43	0.19
			5.18e6	0.68	34	0.12
			5.18e6	0.68	43	0.15
			5.18e6	0.68	36	0.14
			5.18e6	0.68	35	0.13
Breast Cancer1	2	1.93e5	1.93e5	0.00	13	0.05
			1.93e5	0.00	15	0.06
			1.93e5	0.00	18	0.06
			1.93e5	0.00	19	0.06
			1.93e5	0.00	16	0.05

数据集	c	J_opt	GKM			MGKM			本文算法
数据集	c	J_opt	E	N	t	E	N	t	E	N	t
Iris	2	152.35	0.00	1.26e4	0.00	0.00	3.55e4	0.00	0.01	13	0.01
Iris	3	78.85	0.01	1.78e4	0.00	0.00	6.34e4	0.00	0.33	22	0.02
Ionosphere	2	2.42e3	0.00	6.63e4	0.03	0.00	1.90e5	0.05	0.03	16	0.03
Pima Indians Diabetes	2	5.14e6	0.00	3.18e5	0.06	0.00	9.09e5	0.09	0.68	35	0.12
Breast Cancer1	2	1.93e5	0.00	2.42e5	0.05	0.00	7.09e5	0.06	0.00	12	0.04

模拟数据集	FCHM		siibFCM		本文算法
模拟数据集	F- value	G-mean	F- value	G-mean	F- value	G-mean
a	0.8621	0.9839	0.9615	0.9960	0.9950	0.9950
b	0.9639	0.9925	0.6700	0.8961	0.9975	0.9975
c	0.9709	0.9910	0.8772	0.9571	0.9967	0.9967
d	0.9913	0.9965	0.9467	0.9772	0.9937	0.9967
e	0.9930	0.9965	0.9718	0.9854	0.9940	0.9970
f	0.9893	0.9932	0.9748	0.9844	0.9933	0.9943
Glass	0.7961	0.8658	0.7805	0.8659	0.8667	0.8745
Breast Cancer2	0.7112	0.7429	0.8779	0.9030	0.9055	0.9161
Ionosphere	0.6383	0.7099	0.6286	0.7025	0.7749	0.8278

Improvement of fuzzy c-harmonic mean algorithm on unbalanced data

RICH HTML

PDF (PC)