Skip to search boxSkip to navigationSkip to main content

Findings of the VarDial Evaluation Campaign 2025: The NorSID Shared Task on Norwegian Slot, Intent and Dialect Identification

Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-review

Open access

Publication Information

Output type

Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-review

Original language

English

Pages from-to (Number of pages)

Pages 1-8 (8 pages)

Publication milestones

  • Published - 01/01/2025

Publication status

Published - 01/01/2025

Place of publication

Abu Dhabi, UAE

Publisher

Association for Computational Linguistics, United States

Publication IDs

  • Scopus: 105001918856

Host publication title

Proceedings of the 12th Workshop on NLP for Similar Languages, Varieties and Dialects

Host publication editors

  • Yves Scherrer
  • Tommi Jauhiainen
  • Nikola Ljubešić
  • Preslav Nakov
  • Jorg Tiedemann
  • Marcos Zampieri

Abstract

The VarDial Evaluation Campaign 2025 was organized as part of the twelfth workshop on Natural Language Processing for Similar Languages, Varieties and Dialects (VarDial), colocated with COLING 2025. It consisted of one shared task with three subtasks: intent detection, slot filling and dialect identification for Norwegian dialects. This report presents the results of this shared task. Four participating teams have submitted systems with very high performance (> 97% accuracy) for intent detection, whereas slot detection and dialect identification showed to be much more challenging, with respectively span-F1 scores up to 89%, and weighted dialect F1 scores of 84%.

Publication metrics

PlumX

Captures
8

Related Event

Title

Workshop on NLP for Similar Languages, Varieties and Dialects

Event type

Workshop

Degree of recognition

International event

Date

19/01/2025 - 19/01/2025

Location

Abu DhabiUnited Arab Emirates