PhD on Developing a User-centric AI evaluation framework for LLMs
Eindhoven University of Technology
Job descriptionDo you want to develop methods to better evaluate, understand and improve human-AI interaction in the context of value-aligned Large Language models? Do you want to conduct impactful user research in close collaboration with scientists and engineers in a EU-funded doctoral network, helping to promote fair and transparent generative AI?We are seeking a highly motivated doctoral candidate to join our research team as part of a prestigious Marie Skłodowska-Curie Actions (MSCA) doctoral network: AlignAI. The AlignAI doctoral network aims to train doctoral candidates to develop, evaluate, and engage with Large Language Models (LLMs). It focuses on aligning these models with human values to ensure their development and deployment are ethically sound and socially beneficial. By integrating expertise from social sciences, humanities, and technical disciplines, the project will address critical issues such as explainability and fairness, thereby ensuring LLMs contribute positively to education, mental health, and news consumption.The doctoral candidate in this position will develop and test a user-centric AI evaluation framework that triangulates subjective metrics such as perceived transparency, understandability, fairness and cognitive explainability (mental models), with objective measures of explanation and model quality. Quantitative and qualitative user studies will be developed iteratively throughout the project within the three use cases of the AlignAI consortium: Education, positive health and online news consumption. The candidate will support the validation of AI tools developed by other candidates within alignAI consortium and final validation step with user groups towards the end of the project.The doctoral candidate will be supervised by associate Professor and embedded within the Human-Technology Interaction group, Department of Industrial Engineering and Innovation Sciences, Eindhoven University of Technology (TU/e). Additional supervision will be provided within the AlignAI doctoral network by Assistant Professor Sneha Das (Computer Science, DTU) and Professor Daniel Gatica- Perez (Digital Humanities,EPFL). The candidate will be affiliated with the (EAISI), and will be expected to contribute actively and positively to Human-AI interaction research communities in Eindhoven, as well as to attend workshops, summer schools, and research visits (secondments) at AlignAI partner institutions as part of the MSCA doctoral network.Key Responsibilities
This position is one of four PhD positions being offered at TU/e through the AlignAI doctoral network, the others being in Philosophy & Ethics (Carlos Zednik) and Industrial Design (Jesse Benjamin & Stephan Wensween).Job requirements
Selection Process
Conditions of employmentA meaningful job in a dynamic and ambitious university, in an interdisciplinary setting and within an international network. You will work on a beautiful, green campus within walking distance of the central train station. In addition, we offer you:
. * An excellent technical infrastructure, on-campus children’s day care and sports facilities.
and a tax compensation scheme (the 30% facility) for international candidatesInformation and applicationAbout usEindhoven University of Technology is an internationally top-ranking university in the Netherlands that combines scientific curiosity with a hands-on attitude. Our spirit of collaboration translates into an open culture and a top-five position in collaborating with advanced industries. Fundamental knowledge enables us to design solutions for the highly complex problems of today and tomorrow.InformationDo you recognize yourself in this profile and would you like to know more?
Please contact the hiring manager Martijn Willemsen,Visit our website for more information about the or the You can also contact or +31 40 247 5152.Are you inspired and would like to know more about working at TU/e? Please visit .ApplicationWe invite you to submit a complete application by using the apply button. The application should include a:
We look forward to receiving your application and will screen it as soon as possible. The vacancy will remain open until the position is filled.
€2872 – 3670 per month
Eindhoven, Noord-Brabant
Thu, 31 Oct 2024 23:07:18 GMT
To help us track our recruitment effort, please indicate in your email/cover letter where (vacanciesineu.com) you saw this job posting.
vacanciesineu.com Die Stelle Wir suchen engagierte neue Lehrlinge, die im September 2025 ihre 3,5-jährige Elektrotechnik-…
vacanciesineu.com Wir suchen Sie am Standort Wallern, als Disponent Rollfuhr Landverkehr (m/w/d) Oberösterreich in unserem…
vacanciesineu.com Date Posted: 2024-10-31 Country: Austria Location: Lustenauerstrasse 64, 6850 Dornbirn, Austria SIE STELLEN SICH…
vacanciesineu.com Kompetent. Dynamisch. International ausgerichtet & regional verwurzelt.Kompetent. Dynamisch. International ausgerichtet & regional verwurzelt.Wir, die…
vacanciesineu.com Wir verwirklichen, worauf es ankommt. Mit unseren MitarbeiterInnen elektrifizieren, automatisieren und digitalisieren wir Österreich.…
vacanciesineu.com Die Stelle Wir suchen engagierte neue Lehrlinge, die im September 2025 ihre 3,5-jährige Pharmatechnologie-Ausbildung…