Faculté des Sciences appliquées
Faculté des Sciences appliquées

Master thesis : Generating Topic Models from Corpora Across Languages

Thielen, Benoit ULiège
Promotor(s) : Ittoo, Ashwin ULiège
Date of defense : 28-Jan-2022 • Permalink :
Title : Master thesis : Generating Topic Models from Corpora Across Languages
Author : Thielen, Benoit ULiège
Date of defense  : 28-Jan-2022
Advisor(s) : Ittoo, Ashwin ULiège
Committee's member(s) : Geurts, Pierre ULiège
Louppe, Gilles ULiège
Language : English
Keywords : [en] LDA
[en] HDP
[en] nHDP
[en] Poincaré
[en] embeddings
[en] topic
[en] modeling
[en] Dirichlet
Discipline(s) : Engineering, computing & technology > Computer science
Target public : Researchers
Institution(s) : Université de Liège, Liège, Belgique
Degree: Master en sciences informatiques, à finalité spécialisée en "intelligent systems"
Faculty: Master thesis of the Faculté des Sciences appliquées


[en] Topic modeling is a learning process aiming to analyze texts to discover their topic composition by associating groups of correlated words. Historically, topic modeling has used unsupervised learning techniques. Bayesian generative models, such as Latent Dirichlet Allocation (LDA), have quickly proven their performance for representing with probabilities the distributions of words across topics and of topics across documents. Recently, new topic models based on LDA have emerged, like the Hierarchical Dirichlet Process (HDP) which self-determines the number of topics in the text and the nested Hierarchical Dirichlet Process (nHDP) which enables a hierarchical representation of the topics.

The performances in topic identification and hierarchical modeling of HDP and nHDP were evaluated in this work, on English and French corpora built from Wikipedia articles. A large number of very coherent and interesting topics were detected in both languages, despite the presence of some less coherent ones. Correlations have been highlighted between the statistics of the corpus and evaluation metrics such as coherence and model perplexity.

Additionally, a more recent approach of learning word embeddings in hyperbolic space, specifically in the Poincaré ball space, has been studied to determine if it could constitute a promising approach to hierarchical topic modeling. Poincaré embeddings of 10 dimensions were trained on hypernymy relations of our English corpus. Our analysis revealed clusters of words which can be linked to topics, unfortunately the 2D representation method we applied did not allow to show hierarchical relations between those clusters.

In conclusion, both HDP and nHDP models have shown good and similar learning performances when trained on French and English corpora, nHDP being also efficient in providing hierarchical representation of the topics. The Poincaré embeddings were successful in learning and representing the hypernymy relations in the Poincaré ball, however suffered from the constraints imposed by the data acquisition methods and required filtering processes.



Access Master_thesis_final.pdf
Size: 5.23 MB
Format: Adobe PDF
Access summary_thesis.pdf
Size: 244.36 kB
Format: Adobe PDF


  • Thielen, Benoit ULiège Université de Liège > Master sc. informatiques, à fin.


Committee's member(s)

  • Geurts, Pierre ULiège Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Algorith. des syst. en interaction avec le monde physique
    ORBi View his publications on ORBi
  • Louppe, Gilles ULiège Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Big Data
    ORBi View his publications on ORBi
  • Total number of views 48
  • Total number of downloads 340

All documents available on MatheO are protected by copyright and subject to the usual rules for fair use.
The University of Liège does not guarantee the scientific quality of these students' works or the accuracy of all the information they contain.