IberSPEECH'2020 will hold two evaluation challenges, the traditional ALBAYZÍN evaluation organized by the Spanish Thematic Network on Speech Technologies and the ALLIES evaluation organized by the ALLIES European project: LNE (Laboratoire national de métrologie et d?essais, France), LIUM (Le Mans Université, France), IDIAP (Switzerland) and UPC (Spain).

ALLIES evaluation focuses on speaker segmentation on a new corpus of audio-visual documents (news, debates, talk-shows...) from the French channel LCP.
More information about ALLIES evaluation can be found in  https://lium.univ-lemans.fr/allies-evaluation/

ALBAYZÍN evaluation challenges focus on evaluating different audio-visual technologies over TV and radio broadcast, and Basque Parliament content.

Five evaluations are proposed:

• Speech to Text Challenge (S2TC), organized by RTVE (Spanish public radio and television) and Universidad de Zaragoza, consists of automatically transcribe different types of TV shows.
• Speaker Diarization and Identity Asignement (SDIAC), organized by RTVE(Spanish public radio and television) and Universidad de Zaragoza, consists of segmenting broadcast audio documents according to different speakers, linking those segments which originate from the same speaker and identify a closed set of speakers. 
• Multimodal Diarization and Scene Description Challenge (MDSDC), organized by RTVE (Spanish public radio and television) and Universidad de Zaragoza, consists of segmenting broadcast audio-visual documents according to a closed set of speakers, faces and scene descriptors and linking those segments which originate from the same speaker, face and scene descriptor. 
• Search on Speech Challenge (SoSC), organized by Universidad San Pablo-CEU and AuDIaS from Universidad Autónoma de Madrid, consists of searching in audio content a list of terms/queries. 
• Text-to-Speech Alignment Evaluation (S2TAC), organized by University of the Basque Country (UPV/EHU), consists of aligning text and audio extracted from a plenary session of the Basque Parliament (bilingual audio).

More information about the different challenges, databases and online registration can be found in
http://catedrartve.unizar.es/albayzin2020.html

More information about IberSpeech 2020 in
https://iberspeech2020.eca-simm.uva.es/

The calendar for the Albayzín S2TC, SDIAC, MDSDC and SoSC evaluations is:

• March 23th, 2020: Registration opens
• March 23th, 2020: Release of the training and development data
• June 1st, 2020: Registration deadline. Release of the evaluation data
• June 30th, 2020: Submission deadline
• July 15th, 2020: Results distribution to the participants
• September 13th, 2020: Paper submission deadline
• November 18-20, 2020: Iberspeech 2020 conference in Valladolid (Spain)
  

The calendar for the Albayzín S2TAC evaluation is:

• May 4th, 2020 Evaluation plan released. Registration open.
• May 18th, 2020 Development data released. Scoring website enabled for dev data.
• July 13th, 2020 Test data released. Registration closed.
• July 24th, 2020 Deadline for submitting results.
• July 27th, 2020 Scoring website enabled for test data.
• September 13th, 2020: Paper submission deadline
• November 18-20, 2020: Iberspeech 2020 conference in Valladolid (Spain)
  

For any additional information, please contact the organizers of the calls.

Thanks in advance for your time an interest in IBERSPEECH 2020 Conference and ALBAYZÍN evaluations.

Best regards,
The ALBAYZÍN 2020 Evaluations Organizing Committee

Alfonso Ortega Giménez, ortega@unizar.es
Universidad de Zaragoza, Spain
Eduardo Lleida Solano, lleida@unizar.es
Universidad de Zaragoza, Spain
Luis Javier Rodríguez Fuentes, luisjavier.rodriguez@ehu.es
Universidad del País Vasco, Spain