NLP North at WNUT-2020 Task 2: Pre-training versus Ensembling for Detection of Informative COVID-19 English Tweets
- Anders Giovanni Møller,
- ,
Publikation:
Konference artikel i Proceeding eller bog/rapport kapitel
Konferencebidrag i proceedings
Forskning
Peer-reviewOpen Access
Resume
With the COVID-19 pandemic raging world-wide since the beginning of the 2020 decade,the need for monitoring systems to track relevant information on social media is vitally important. This paper describes our submission to the WNUT-2020 Task 2: Identification of informative COVID-19 English Tweets. We investigate the effectiveness for a variety of classification models, and found that domain-specific pre-trained BERT models lead to the best performance. On top of this, we attempt a variety of ensembling strategies, but these at-tempts did not lead to further improvements.Our final best model, the standalone CT-BERT model, proved to be highly competitive, leading to a shared first place in the shared task.Our results emphasize the importance of do-main and task-related pre-training.
Publikation information
Produktionstype
Publikation:
Konference artikel i Proceeding eller bog/rapport kapitel
Konferencebidrag i proceedings
Forskning
Peer-reviewOriginalsprog
EngelskSider fra-til (Antal sider)
Sider 331-336Publikationsmilepæle
- Udgivet - 11/2020
Publikationsstatus
Udgivet - 11/2020
Forlag
Association for Computational Linguistics, USATitel på værtspublikation
Proceedings of the Sixth Workshop on Noisy User-generated Text (W-NUT 2020)Adgang til dokumenter
Accepteret manuskript, 162.84 KB
Accepteret manuskript
Relateret event
Titel
The Sixth Workshop on Noisy User-generated Text
Begivenhedstype
KonferenceDato
19/11/2020 - 19/11/2020Lokation
Online
