A novel probabilistic feature selection method for text classification


Uysal A. K. , Gunal S.

KNOWLEDGE-BASED SYSTEMS, vol.36, pp.226-235, 2012 (Journal Indexed in SCI) identifier identifier

  • Publication Type: Article / Article
  • Volume: 36
  • Publication Date: 2012
  • Doi Number: 10.1016/j.knosys.2012.06.005
  • Title of Journal : KNOWLEDGE-BASED SYSTEMS
  • Page Numbers: pp.226-235

Abstract

High dimensionality of the feature space is one of the most important concerns in text classification problems due to processing time and accuracy considerations. Selection of distinctive features is therefore essential for text classification. This study proposes a novel filter based probabilistic feature selection method, namely distinguishing feature selector (DFS), for text classification. The proposed method is compared with well-known filter approaches including chi square, information gain, Gini index and deviation from Poisson distribution. The comparison is carried out for different datasets, classification algorithms, and success measures. Experimental results explicitly indicate that DFS offers a competitive performance with respect to the abovementioned approaches in terms of classification accuracy, dimension reduction rate and processing time. (C) 2012 Elsevier B.V. All rights reserved.