The Albayzin 2008 Language Recognition Evaluation

SESSION 7: Speaker and Language recognition - Evaluations and performance testing

Added: 14. 7. 2010 11:08, Author: Luis Javier Rodriguez-Fuentes, Mikel Penagarikano, German Bordel, Amparo Varona (University of the Basque Country), Length: 0:29:29

The Albayzin 2008 Language Recognition Evaluation was held from May to October 2008, and their results presented and discussed among the participating teams at the 5th Biennial Workshop on Speech Technology, organized by the Spanish Network on Speech Technologies in November 2008. In this paper, we present (for the first time) a full description of the Albayzin 2008 LRE and analyze and discuss recognition results. The evaluation was designed according to the test procedures, protocols and performance measures used in the NIST 2007 LRE. The KALAKA database, consisting of 16 kHz audio signals recorded from TV broadcasts, was created ad-hoc and used for the evaluation. The four official languages spoken in Spain (Basque, Catalan, Galician and Spanish) were taken as target languages, other (unknown) languages being also recorded to allow open-set verification tests. The best system, employing state-of-the-art technology, yielded Cavg=0,0552 (around 5% EER) in closed-set verification tests on a set of 30-second segments. This reveals the difficulty of the task, despite using 16 kHz speech signals and having only four target languages. We plan to include also Portuguese and English as target languages for the next Albayzin 2010 LRE.

  Speech Transcript



Please sign in to post your comment!

  Lecture Information

Number of views: 337
Video resolution: 720x576 px
Audio track: MP3 [10.12 MB], 0:29:29