33rd IEEE Conference on Signal Processing and Communications Applications, SIU 2025, İstanbul, Türkiye, 25 - 28 Haziran 2025, (Tam Metin Bildiri)
This paper presents the practical application of big language models in text mining and topic modeling processes using texts shared online by the Ministry of Foreign Affairs of the Republic of Türkiye. The research describes an iterative and hybrid algorithm in which domain experts and large language models work together. The findings indicate that well-defined themes play a critical role in model success. It is emphasized that in social sciences, topic modeling processes should be handled with a "tailor-made"approach that includes the contextual interpretations of the researcher in the data evaluation processes, rather than being evaluated only through numerical outputs. In conclusion, the proposed algorithm offers a comprehensive and flexible analysis opportunity in social scientific research by generating topic labels suitable for qualitative or quantitative analysis of texts.