Analysis of Diplomatic Texts with LLMs: A Hybrid Approach in Computational Social Sciences B y k Dil Modelleriyle Diplomatik Metin Analizi: Hesaplamali Sosyal Bilimlerde Hibrit Bir Yaklasim


KURNAZ A., Unver A.

33rd IEEE Conference on Signal Processing and Communications Applications, SIU 2025, İstanbul, Türkiye, 25 - 28 Haziran 2025, (Tam Metin Bildiri) identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Doi Numarası: 10.1109/siu66497.2025.11112347
  • Basıldığı Şehir: İstanbul
  • Basıldığı Ülke: Türkiye
  • Anahtar Kelimeler: LLMs, natural language processing, topic modelling
  • Çanakkale Onsekiz Mart Üniversitesi Adresli: Evet

Özet

This paper presents the practical application of big language models in text mining and topic modeling processes using texts shared online by the Ministry of Foreign Affairs of the Republic of Türkiye. The research describes an iterative and hybrid algorithm in which domain experts and large language models work together. The findings indicate that well-defined themes play a critical role in model success. It is emphasized that in social sciences, topic modeling processes should be handled with a "tailor-made"approach that includes the contextual interpretations of the researcher in the data evaluation processes, rather than being evaluated only through numerical outputs. In conclusion, the proposed algorithm offers a comprehensive and flexible analysis opportunity in social scientific research by generating topic labels suitable for qualitative or quantitative analysis of texts.