GovdeTurk: A Novel Turkish Natural Language Processing Tool for Stemming, Morphological Labelling and Verb Negation


Yucebas S. C., Tintin R.

INTERNATIONAL ARAB JOURNAL OF INFORMATION TECHNOLOGY, cilt.18, sa.2, ss.148-157, 2021 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 18 Sayı: 2
  • Basım Tarihi: 2021
  • Doi Numarası: 10.34028/iajit/18/2/3
  • Dergi Adı: INTERNATIONAL ARAB JOURNAL OF INFORMATION TECHNOLOGY
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Applied Science & Technology Source, Arab World Research Source, Computer & Applied Sciences
  • Sayfa Sayıları: ss.148-157
  • Anahtar Kelimeler: Natural language processing, stemming, morphological analysis, Turkish language
  • Çanakkale Onsekiz Mart Üniversitesi Adresli: Evet

Özet

GovdeTurk is a tool for stemming, morphological labeling and verb negation for Turkish language. We designed comprehensive finite automata to represent Turkish grammar rules. Based on these automata, GovdeTurk finds the stem of the word by removing the inflectional suffixes in a longest match strategy. Levenshtein Distance is used to correct spelling errors that may occur during suffix removal. Morphological labeling identifies the functionality of a given token. Nine different dictionaries are constructed for each specific word type. These dictionaries are used in the stemming and morphological labeling. Verb negation module is developed for lexicon based sentiment analysis. GovdeTurk is tested on a dataset of one million words. The results are compared with Zemberek and Turkish Snowball Algorithm. While the closest competitor, Zemberek, in the stemming step has an accuracy of 80%, GovdeTurk gives 97.3% of accuracy. Morphological labeling accuracy of GovdeTurk is 93.6%. With outperforming results, our model becomes foremost among its competitors.