EVALITA 2011 - First Call for Participation May 2011

The registration to EVALITA 2011, the third evaluation campaign of Natural Language Processing and Speech tools for Italian, is open. We invite participation, both from academic institutions and industrial organizations, in eight tasks, all for Italian.

The results of the evaluation will be disseminated at the final workshop which will be organized in conjunction with in the next AISV Conference in Rome, on January 24-25 2012.

Final reports describing the participating systems will appear in the workshop electronic working notes. After the workshop, the proceedings will be published by Springer in the LNCS subseries of the Lecture Notes in Artificial Intelligence (LNAI).

In order to register for one or more of the EVALITA 2011 tasks, fill the online form at: http://www.evalita.it/2011/registration

For updated information please refer to the EVALITA 2011 website: http://www.evalita.it/2011

Timeline

- 4th April 2011: on-line registration opens (postponed to June 1st for the Voice Applications on Mobile - Student Contest)

- 20th May 2011: development data available to participants

- 4th October 2011: test data available, registration closes

- 14th October 2011: system results due to organizers

- 28th October 2011: assessment returned to participants

- 24th November 2011: technical reports due to organizers

- 24th-25th January 2012: final workshop in Rome

Coordination

- Scientific coordination: Bernardo Magnini (FBK-irst, Trento) and Emanuele Pianta (CELCT, Trento)

- Scientific coordination for Speech Technology Evaluation: Francesco Cutugno (Uni. Napoli "Federico II") and Mauro Falcone (Fondazione Ugo Bordoni, Roma)

- Organization and Contact : Manuela Speranza – manspera[AT]fbk.eu (FBK-irst, Trento)

- Web site and Proceedings: Valentina Bartalesi Lenzi (CELCT, Trento) and Rachele Sprugnoli (CELCT, Trento)

Task Organization:

- Parsing: Cristina Bosco (Uni.Torino), Alessandro Mazzei (Uni.Torino)

- Domain Adaptation: Felice dell'Orletta (ILC-CNR, Pisa), Simonetta Montemagni (ILC-CNR, Pisa), Giulia Venturi (ILC-CNR, Pisa) Tommaso Agnoloni (ITTIG-CNR, Firenze), and Enrico Francesconi (ITTIG-CNR, Firenze)

- Named Entity Recognition on Transcribed Broadcast News: Manuela Speranza (FBK-irst, Trento), Valentina Bartalesi Lenzi (CELCT, Trento) and Rachele Sprugnoli (CELCT, Trento)

- Cross-document Coreference Resolution of Named Person Entities (NePS): Luisa Bentivogli (FBK-irst, Trento), Alessandro Marchetti (CELCT, Trento)

- Anaphora Resolution: Massimo Poesio and Olga Uryupina (Uni. Trento)

- Super Sense Tagging : Stefano Dei Rossi, Giulia Di Pietro and Maria Simi (Uni. Pisa)

- Frame Labeling over Italian Texts: Roberto Basili (Uni.Roma Tor Vergata) and Alessandro Lenci (Uni. Pisa)

- Lemmatisation: Fabio Tamburini (Uni. Bologna)

- Automatic Speech Recognition - Large Vocabulary Transcription: Fabio Brugnara, Roberto Gretter and Marco Matassoni (FBK-irst, Trento)

- Spoken Dialogue Systems Evaluation: Silvia Quarteroni (Politecnico di Milano), Giuseppe Riccardi (Uni. Trento) and Pierluigi Roberti (Interactive Media)

- Forced Alignment on Spontaneous Speech: Francesco Cutugno (Uni. Napoli), Dino Seppi (Uni. Leuven), Antonio Origlia (Uni. Napoli)

- Voice Applications on Mobile - Student Contest: Francesco Cutugno (Uni. Napoli), Roberto Pieraccini (SpeechCycle, New York, USA), Paolo Coppo (Loquendo)