The 2003 NIST Language Recognition evaluation (LRE-03) is part of an ongoing series of evaluations of language recognition technology. The protocols and procedures of this year's evaluation is given in the evaluation plan (LRE03EvalPlan-v1.pdf, updated January 13, 2003).

Those who are interested in participating in the evaluation must fill out a registration form and return to NIST before the registration deadline of February 19, 2003.

Sites must put in a request to NIST to get the training and/or development data. Non-LDC members must sign the LDC license agreement before NIST can send them the data.

The LRE-03 answer key is now available online.

Important Updates:

• Nov 29, 2005: Post LRE-03 answer key to the to website.


• July 29, 2003: Language recognition resources made publicly available. MIT-Lincoln Labs is making available their speech detection (using talkative) marks for both the development and evaluation data used for the 2003 NIST Language Recognition evaluation. View the readme file for details.


• January 21, 2003: Note to system developers. An overlap exists between the published LDC CallFriend corpus and the data used for the 1996 NIST Language Recognition evaluation. If using the 1996 NIST development and evaluation data for system development, sites should view the conversation lists used for each. This is to avoid testing on training data during system development.
  • 1996 NIST Development data (r31-1.3) conversation list
  • 1996 NIST Evaluation data (r32-1.2) conversation list


• January 13, 2003: The dates of the evaluation workshop have changed and are now reflected in the evaluation plan and schedule.
  

[ LRE Home ]