login - create an account - help
|
Performance of freely available vision-capable chatbots on the test for understanding graphs in kinematics
In this paper, we evaluate the performance of three freely available vision-capable chatbots – Copilot, Gemini, and Claude 3 Sonnet – on the Test of Understanding Graphs in Kinematics (TUG-K). Our analysis highlights a performance gap between these freely available chatbots and the state-of-the-art, subscription-based ChatGPT-4. We also report largely unclear patterns of performance of the tested chatbots on different types of tasks. We discuss the implications of our findings for using chatbots in educational contexts, point out potential challenges for educational equity, and provide some ideas for future research that could help us better understand the patterns in the chatbots' performance on tasks that involve the interpretation of graphical input.
Physics Education Research Conference 2024
Part of the PER Conference series Boston, MA: July 10-11, 2024 Pages 336-341
ComPADRE is beta testing Citation Styles!
Record Link
<a href="https://www.compadre.org/portal/items/detail.cfm?ID=16919">Polverini, Giulia, and Bor Gregorcic. "Performance of freely available vision-capable chatbots on the test for understanding graphs in kinematics." Paper presented at the Physics Education Research Conference 2024, Boston, MA, July 10-11, 2024.</a>
AIP Format
G. Polverini and B. Gregorcic, , presented at the Physics Education Research Conference 2024, Boston, MA, 2024, WWW Document, (https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16919&DocID=5986).
AJP/PRST-PER
G. Polverini and B. Gregorcic, Performance of freely available vision-capable chatbots on the test for understanding graphs in kinematics, presented at the Physics Education Research Conference 2024, Boston, MA, 2024, <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16919&DocID=5986>.
APA Format
Polverini, G., & Gregorcic, B. (2024, July 10-11). Performance of freely available vision-capable chatbots on the test for understanding graphs in kinematics. Paper presented at Physics Education Research Conference 2024, Boston, MA. Retrieved July 18, 2025, from https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16919&DocID=5986
Chicago Format
Polverini, Giulia, and Bor Gregorcic. "Performance of freely available vision-capable chatbots on the test for understanding graphs in kinematics." Paper presented at the Physics Education Research Conference 2024, Boston, MA, July 10-11, 2024. https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16919&DocID=5986 (accessed 18 July 2025).
MLA Format
Polverini, Giulia, and Bor Gregorcic. "Performance of freely available vision-capable chatbots on the test for understanding graphs in kinematics." Physics Education Research Conference 2024. Boston, MA: 2024. 336-341 of PER Conference. 18 July 2025 <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16919&DocID=5986>.
BibTeX Export Format
@inproceedings{
Author = "Giulia Polverini and Bor Gregorcic",
Title = {Performance of freely available vision-capable chatbots on the test for understanding graphs in kinematics},
BookTitle = {Physics Education Research Conference 2024},
Pages = {336-341},
Address = {Boston, MA},
Series = {PER Conference},
Month = {July 10-11},
Year = {2024}
}
Refer Export Format
%A Giulia Polverini %A Bor Gregorcic %T Performance of freely available vision-capable chatbots on the test for understanding graphs in kinematics %S PER Conference %D July 10-11 2024 %P 336-341 %C Boston, MA %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16919&DocID=5986 %O Physics Education Research Conference 2024 %O July 10-11 %O application/pdf
EndNote Export Format
%0 Conference Proceedings %A Polverini, Giulia %A Gregorcic, Bor %D July 10-11 2024 %T Performance of freely available vision-capable chatbots on the test for understanding graphs in kinematics %B Physics Education Research Conference 2024 %C Boston, MA %P 336-341 %S PER Conference %8 July 10-11 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16919&DocID=5986 Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.
Citation Source Information
The AIP Style presented is based on information from the AIP Style Manual. The APA Style presented is based on information from APA Style.org: Electronic References. The Chicago Style presented is based on information from Examples of Chicago-Style Documentation. The MLA Style presented is based on information from the MLA FAQ. Performance of freely available vision-capable chatbots on the test for understanding graphs in kinematics:Know of another related resource? Login to relate this resource to it. |
ContributeRelated MaterialsSimilar Materials |
Save to my folders