Position models and language modeling - Université Jean-Monnet-Saint-Étienne Accéder directement au contenu
Communication Dans Un Congrès Année : 2008

Position models and language modeling

Franck Thollard
  • Fonction : Auteur
  • PersonId : 841732

Résumé

In statistical language modelling the classic model used is $n$-gram. This model is not able however to capture long term dependencies, \emph{i.e.} dependencies larger than $n$. An alternative to this model is the probabilistic automaton. Unfortunately, it appears that preliminary experiments on the use of this model in language modelling is not yet competitive, partly because it tries to model too long term dependencies. We propose here to improve the use of this model by restricting the dependency to a more reasonable value. Experiments shows an improvement of 45\% reduction in the perplexity obtained on the Wall Street Journal language modeling task.
Fichier principal
Vignette du fichier
zdiziobeck_thollard_sspr.pdf (312.88 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

ujm-00322820 , version 1 (09-03-2009)

Identifiants

  • HAL Id : ujm-00322820 , version 1

Citer

Arnaud Zdziobeck, Franck Thollard. Position models and language modeling. Structural and Syntactic Pattern Recognition and Statistical Techniques in Pattern Recognition, Dec 2008, Orlando, United States. pp.76-85. ⟨ujm-00322820⟩
58 Consultations
125 Téléchargements

Partager

Gmail Facebook X LinkedIn More