Hyperparameter Power Impact in Transformer Language Model Training

Lucas Høyberg Puvis de Chavannes
,
Mads Guldborg Kjeldgaard Kongsbak
,
Timmie Rantzau
,
Leon Derczynski

NLPnorth
,
Machine Learning

Research Output:

Conference Article in Proceeding or Book/Report chapter

Article in proceedings

Peer-review

Open access

Publication Information

Output type

Research Output:

Conference Article in Proceeding or Book/Report chapter

Article in proceedings

Peer-review

Original language

English

Publication milestones

Published - 01/11/2021

Publication status

Published - 01/11/2021

Publisher

Association for Computational Linguistics, United States

Host publication title

Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing

Access to documents

https://aclanthology.org/2021.sustainlp-1.12.pdf

Final published version

License:CC BY

Related Event

Title

Workshop on Simple and Efficient Natural Language Processing

Event type

Workshop

Date

10/11/2021

Location

VIRTUAL