Get on the Train or be Left on the Station: Using LLMs for Software Engineering Research.
- Bianca Trinkenreich,
- Fabio Calefato,
- Geir Hanssen,
- Kelly Blincoe,
- Marcos Kalinowski,
- Mauro Pezzè
- Colorado State University,
- The Interaction, Visualization, Usability & UX group at Dip. di Informatica, Bari University,
- SINTEF Digital,
- The University of Auckland,
- Pontifical Catholic University of Rio de Janerio,
- Università della Svizzera italiana
Publikation:
Artikel i tidsskrift og konference artikel i tidsskrift
Tidsskriftartikel
Forskning
Peer-reviewOpen Access
Resume
The adoption of Large Language Models (LLMs) is not only transforming software engineering (SE) practice but is also poised to
fundamentally disrupt how research is conducted in the field. While
perspectives on this transformation range from viewing LLMs as
mere productivity tools to considering them revolutionary forces,
we argue that the SE research community must proactively engage
with and shape the integration of LLMs into research practices, emphasizing human agency in this transformation. As LLMs rapidly
become integral to SE research—both as tools that support investigations and as subjects of study—a human-centric perspective is
essential. Ensuring human oversight and interpretability is necessary for upholding scientific rigor, fostering ethical responsibility,
and driving advancements in the field. Drawing from discussions
at the 2nd Copenhagen Symposium on Human-Centered AI in SE,
this position paper employs McLuhan’s Tetrad of Media Laws to
analyze the impact of LLMs on SE research. Through this theoretical lens, we examine how LLMs enhance research capabilities
through accelerated ideation and automated processes, make some
traditional research practices obsolete, retrieve valuable aspects of
historical research approaches, and risk reversal effects when taken
to extremes. Our analysis reveals opportunities for innovation and
potential pitfalls that require careful consideration. We conclude
with a call to action for the SE research community to proactively
harness the benefits of LLMs while developing frameworks and
guidelines to mitigate their risks, to ensure continued rigor and
impact of research in an AI-augmented future.
fundamentally disrupt how research is conducted in the field. While
perspectives on this transformation range from viewing LLMs as
mere productivity tools to considering them revolutionary forces,
we argue that the SE research community must proactively engage
with and shape the integration of LLMs into research practices, emphasizing human agency in this transformation. As LLMs rapidly
become integral to SE research—both as tools that support investigations and as subjects of study—a human-centric perspective is
essential. Ensuring human oversight and interpretability is necessary for upholding scientific rigor, fostering ethical responsibility,
and driving advancements in the field. Drawing from discussions
at the 2nd Copenhagen Symposium on Human-Centered AI in SE,
this position paper employs McLuhan’s Tetrad of Media Laws to
analyze the impact of LLMs on SE research. Through this theoretical lens, we examine how LLMs enhance research capabilities
through accelerated ideation and automated processes, make some
traditional research practices obsolete, retrieve valuable aspects of
historical research approaches, and risk reversal effects when taken
to extremes. Our analysis reveals opportunities for innovation and
potential pitfalls that require careful consideration. We conclude
with a call to action for the SE research community to proactively
harness the benefits of LLMs while developing frameworks and
guidelines to mitigate their risks, to ensure continued rigor and
impact of research in an AI-augmented future.
Publikation information
Produktionstype
Publikation:
Artikel i tidsskrift og konference artikel i tidsskrift
Tidsskriftartikel
Forskning
Peer-reviewOriginalsprog
EngelskSider fra-til (Antal sider)
Sider 1503-1507 (4 sider)Tidsskrift (Bind, Nummer)
CoRRPublikationsmilepæle
- Udgivet - 2025
Publikationsstatus
Udgivet - 2025
ISSN
0000-0000Publikations IDer
- Scopus: 105013964607
Metrikker
PlumX, åbner i en ny fane
Hentninger
24
Antal citationer
7
