Unsupervised Variable Selection Using a Genetic Algorithm: An Application to Textual Data - Archive ouverte HAL Access content directly
Conference Papers Year :

Unsupervised Variable Selection Using a Genetic Algorithm: An Application to Textual Data

(1) , (2, 3, 4, 5) , (6) , (3, 4, 5, 2)
1
2
3
4
5
6

Abstract

Microelectronics production failure analysis is an important step in improving product quality and development. Indeed, the understanding of the failure mechanisms and therefore the implementation of corrective actions on the cause of the failure depend on the results of these analysis. These analysis are saved under textual features format. Then such data need first to be pre-processed and vectorized (converted to numeric). Second, to overcome the curse of dimensionality caused by the vectorisation process, a dimension reduction is applied. We are first interested in studying the potential of using an unsupervised variable selection technique to identify the variables that best demonstrate discrimination in the separation and compactness of groups of textual data. Variable selection has been approached by several variable or feature selection methods. Some of them have not been adapted for use in large data sets or are difficult to tune, and others require additional information. This work investigates the potential of using a genetic algorithm to find, in an unsupervised way, the variables allowing the best discrimination of the classes, to select variables correlated to particular textual groups. The proosed genetic algorithm uses a combination of the K-means clustering and validity indices as a fitness function for optimization. Such a function improves both compactness and class separation. Experiments on textual datasets demonstrate the effectiveness of the proposed method of variable selection which allows better discrimination of textual classes compared to the use of K-means clustering on all data variables.
Not file

Dates and versions

emse-03923877 , version 1 (05-01-2023)

Identifiers

Cite

Abbas Rammal, Kenneth Ezukwoke, Anis Hoayek, Mireille Batton-Hubert. Unsupervised Variable Selection Using a Genetic Algorithm: An Application to Textual Data. 2022 International Conference on Smart Systems and Power Management (IC2SPM), Nov 2022, Beyrouth, Lebanon. pp.11-19, ⟨10.1109/IC2SPM56638.2022.9989008⟩. ⟨emse-03923877⟩
0 View
0 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More