Findings of the VarDial Evaluation Campaign 2025: The NorSID Shared Task on Norwegian Slot, Intent and Dialect Identification
- Yves Scherrer,
- ,
- Petter Mæhlum
- University of Oslo,
- ,
- ,
Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-reviewOpen access
Publication Information
Output type
Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-reviewOriginal language
EnglishPages from-to (Number of pages)
Pages 1-8 (8 pages)Publication milestones
- Published - 01/01/2025
Publication status
Published - 01/01/2025
Place of publication
Abu Dhabi, UAEPublisher
Association for Computational Linguistics, United StatesPublication IDs
- Scopus: 105001918856
Host publication title
Proceedings of the 12th Workshop on NLP for Similar Languages, Varieties and DialectsHost publication editors
- Yves Scherrer
- Tommi Jauhiainen
- Nikola Ljubešić
- Preslav Nakov
- Jorg Tiedemann
- Marcos Zampieri
Abstract
The VarDial Evaluation Campaign 2025 was organized as part of the twelfth workshop on Natural Language Processing for Similar Languages, Varieties and Dialects (VarDial), colocated with COLING 2025. It consisted of one shared task with three subtasks: intent detection, slot filling and dialect identification for Norwegian dialects. This report presents the results of this shared task. Four participating teams have submitted systems with very high performance (> 97% accuracy) for intent detection, whereas slot detection and dialect identification showed to be much more challenging, with respectively span-F1 scores up to 89%, and weighted dialect F1 scores of 84%.
Publication metrics
PlumX
Captures
8
Access to documents
Final published version
License:CC BY, opens in new tab
Final published version
License:CC BY, opens in new tab
Related Event
Title
Workshop on NLP for Similar Languages, Varieties and Dialects
Event type
WorkshopDegree of recognition
International eventDate
19/01/2025 - 19/01/2025Location
Abu DhabiUnited Arab Emirates
