Research Stay (ETH Zürich)
- Bertram Højer(PI),
- Stefan Heinrich(Collaborator),
- Anna Rogers(Collaborator)
Project:
Research
Project status
Finished
Description
At ETH Zürich I will be working on understanding the fundamental
mathematical structures in language that allow for matrix models (such as
transformers on which ChatGPT is based) to be as succesful in modeling
language as they are. We use category theory to study embedding spaces and specifically a notion of logical implication. Standard approaches to embeddings have succeeded in unveiling some structure in language, but viewing language through the lens of category theory could unveil others.
mathematical structures in language that allow for matrix models (such as
transformers on which ChatGPT is based) to be as succesful in modeling
language as they are. We use category theory to study embedding spaces and specifically a notion of logical implication. Standard approaches to embeddings have succeeded in unveiling some structure in language, but viewing language through the lens of category theory could unveil others.
Project Information
Project Type
Research
Project Collaborators
- Swiss Federal Institute of Technology Zürich
Time Period
01/09/2025 – 31/12/2025Status
FinishedFunding Details
PhD Research Stay (ETH Zürich)Award
FundersAmounts
Stibo-Fonden
50000 DKK