26–30 Aug 2024
Auditorium Maximum UJ
Europe/Warsaw timezone

Physics Assessment in the age of AI

30 Aug 2024, 12:30
20m
Small Hall

Small Hall

Oral presentations Multimedia, AR, VR and AI in Physics Education Oral presentations

Speaker

Will Yeadon (Durham University)

Description

This contribution explores the profound effects of generative AI, particularly ChatGPT models, on physics education. By melding performance analyses of GPT-3.5 and GPT-4 across diverse assessments - including 593 physics exam questions, 300 coding submissions, and 300 essay submissions - we unveil nuanced insights into AI's effect on assessment. Our findings reveal that AI rivals human performance in essay writing and approaches it in coding tasks, yet falls short in physics written exams. This comprehensive evaluation not only highlights AI's potential and limitations in academic contexts but also sets the stage for discussing its pedagogical implications and future integration.

How would you like to present your contribution? Live in Kraków (time slot to be allotted based on the programme)
Target education level University
Category Formal Education

Primary author

Will Yeadon (Durham University)

Presentation materials