Feature Selection Using Multi Objective Genetic Algorithm with Support Vector Machine

Abstract

Different approaches have been proposed for feature selection to obtain suitable features subset among all features. These methods search feature space for feature subsets which satisfies some criteria or optimizes several objective functions. The objective functions are divided into two main groups: filter and wrapper methods. In filter methods, features subsets are selected due to some measures like inter-class distance, features statistical independence or information theoretic measures. Even though, wrapper methods use a classifier to evaluate features subsets by their predictive accuracy (on test data) by statistical resampling or cross-validation. Filter methods usually use only one measure for feature selection that does not necessarily produce the best result. In this paper, we proposed to use the classification error measures besides to filter measures where our classifier is support vector machine (SVM). To this end, we use multi objective genetic algorithm. In this way, one of our feature selection measure is SVM classification error. Another measure is selected between mutual information and Laplacian criteria which indicates informative content and structure preserving property of features, respectively. The evaluation results on the UCI datasets show the efficiency of this method.