Welcome!
I am a researcher, a lecturer and a PI in NLP at the University of Aberdeen, and a lecturer at Heidelberg University. Previously, I was a postdoctoral researcher at Heidelberg Institute for Theoretical Studies (HITS) and Heidelberg University, working on the Geometry and Representation Learning. In December 2022, I earned my Ph.D. in NLP from the AIPHES Training Group at TU Darmstadt. My research interests include evaluation of NLP systems, cross-temporal research in NLP, and more recently, NLP for science. I am an Area Chair at ARR, COLING, CoNLL 2025, and a grant application reviewer for Leverhulme Trust and ISPF.
Recent News
03/2025: Recipient of Sponsorship Funding from Artificial Intelligence Journal
02/2025: Recipient of Research Catalyst Funding from the University of Aberdeen
01/2025: A paper about evaluation of LLMs accepted at NAACL
01/2025: Recipient of Computing Credits from OpenAI
12/2024: A paper nominated by ARR Area Chair for Best Paper Award
12/2024: Two papers about LLMs for human annotation accepted at the CoMeDi Workshop, co-located with COLING
08/2024: Recipient of Research Collaboration Grant from the Royal Society of Edinburgh
07/2024: A paper about LLMs for lexicography accepted at the LLM-LEX Workshop, co-located with EURALEX
07/2024: Recipient of Computing Credits from Google
06/2024: Three papers about cross-temporal research accepted at the LChange Workshop, co-located with ACL
04/2024: A paper about graph embedding accepted at TMLR
02/2024: A paper about evaluation of LLMs accepted at JMLR
01/2024: A paper about cross-temporal research accepted at EACL
Invited Talks
05/2025: Leipzig University, Germany
04/2025: Aalborg University (Copenhagen campus), Denmark
09/2024: Oxford University Press, UK
09/2024: IR Group, University of Glasgow, UK
06/2024: Stuttgart University, Germany
06/2024: Mannheim University, Germany
06/2024: Université Grenoble Alpes, France
Selected Publications
How Good Are LLMs for Literary Translation, Really? Literary Translation Evaluation with Humans and LLMs - Ran Zhang, Wei Zhao, Steffen Eger, NAACL 2025, Nomination for Best Paper Award (2.5% of paper submissions)
Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation - Steffen Eger, Yong Cao, Jennifer D'Souza, Andreas Geiger, Christian Greisinger, Stephanie Gross, Yufang Hou, Brigitte Krenn, Anne Lauscher, Yizhi Li, Chenghua Lin, Nafise Sadat Moosavi, Wei Zhao, Tristan Miller, preprint, 02/2025
Research Group (current students)
Qianchen Luo (MSC): LLMs | Cross-Temporal Bias | Evaluation
Gagan Bhatia (MSC): LLMs | Cross-Temporal Bias | Interpretability
Niklas Lough (BSC): LLMs | Cross-Temporal Bias | Forecasting
Roshani Nitin Pawar (MSC): LLMs | Cross-Temporal Bias | Datasets Analysis
Ahmad Isa (MSC): LLMs | Cross-Temporal Bias | Multilingual NLP
Ran Zhang (PhD, co-supervised w/ Steffen Eger): LLMs | Translation | Evaluation
Shu Fan Sun (BSC): LLMs | Translation | Media Study
Francisco De La Torre Silva (BSC): LLMs | Translation | Sign2Spoken
Ying Xuan Loke (BSC): LLMs | Lexical Semantics | Annotation
Lydia Körber (MSC): LLMs | Lexical Semantics | Lexicography
Melis Çelikkol (MSC): LLMs | Lexical Semantics | Sign Language
Teaching
CS4051: Natural Language Processing (2024-2025) at Aberdeen
CS5063: Evaluation of AI Systems (2024-2025) at Aberdeen
CS551N: Introduction to Programming (2024-2025) at Aberdeen
CS551P: Advanced Programming (2024-2025) at Aberdeen
PS/HS: Diachronic Language Models (2023-2025) at Heidelberg
Open Positions
Deadline: 10/04/2025 MSC thesis project on Evaluation of AI Misuse in Scientific Publications
Deadline: 10/04/2025 MSC thesis project on Generation and Evaluation for Multimodal Scientific Content
Deadline: 15/04/2025 Annotators for Multimodal Scientific Content