30 June 2025 to 4 July 2025
Leiden University, Gorlaeus building
Europe/Amsterdam timezone
We are happy to announce that the timetable is now available. You can see it is a very busy schedule so there is little or no wiggle room.

Development and Validation of a Performance-Based AI Literacy Assessment Test for High-School Students Enabling Predictions of their Performance in Tasks Involving AI Tools

2 Jul 2025, 09:00
20m
Leiden University, Gorlaeus building

Leiden University, Gorlaeus building

Einsteinweg 55 2333 CC Leiden https://www.universiteitleiden.nl/en/locations/gorlaeus-building#tab-1
Oral presentation Artificial Intelligence (AI) Parallel oral presentations

Speaker

Tobias Patrick Treczoks (Ludwig Maximilians Universitat (DE))

Description

AI literacy is pivotal for students navigating AI-driven environments. This research introduces a novel performance-based AI literacy assessment test targeting high-school students (16–19). Built on foundational AI literacy conceptualisations, the tool aims to predict students’ proficiency in using AI tools effectively. Validation employs Classical Test Theory and Item Response Theories, eventually linking test outcomes with performance in AI interactions. Initial findings from trials conducted at CERN Science Gateway will be presented. Ultimately, the results will inform AI-themed physics education interventions, enhancing students’ critical thinking, input creation, and reflective abilities within AI contexts.

Education level Age 15-18 (Secondary education)
Physics topic Interdisciplinary topics
Research focus Evaluation & Assessment
Research method Mixed method (qualitative & quantitative)
Organizing preference criteria Track

Author

Tobias Patrick Treczoks (Ludwig Maximilians Universitat (DE))

Co-authors

Jochen Kuhn (University of Munich) Dr Sascha Schmeling (CERN) Dr Stefan Küchemann (Ludwig-Maximilians-Universität München)

Presentation materials