Help us make Indico better by taking this survey! Aidez-nous à améliorer Indico en répondant à ce sondage !

3–7 Jul 2023
Faculty of Science, UPJS, Košice, Slovakia
Europe/Bratislava timezone

Context dependence of machine-learning models for the analysis of argumentation in undergraduate lab reports

3 Jul 2023, 17:00
20m
Room 4 (Platón)

Room 4

Platón

Faculty of Science, UPJS, Moyzesova 9, Košice
Oral presentation Digital technologies in physics education Digital technologies

Speaker

Michael Fox (Imperial College London)

Description

Lab reports form an important part of learning experimental physics in undergraduate courses. Advances in natural language processing give us new tools that allow for the large-scale qualitative analysis of lab reports to understand how students demonstrate their skills and knowledge. Hence, we compare natural language processing techniques to understand whether it is possible to reliably extract information about student argumentation from lab reports on two different spectroscopy experiments. We find that the transformer model BERT results in the highest accuracy of $84\pm5\%$ and is the only model to show improved accuracy when analysing both experiments simultaneously.

How would you like to present your contribution? Live in Košice (time slot to be allotted based on the programme)
Target education level (primary) University education

Primary author

Michael Fox (Imperial College London)

Co-authors

Efia Amankwa (Imperial College London) Jiayang Zhang (Imperial College London)

Presentation materials