Kids who use ChatGPT as a study assistant do worse on tests ...
A recent study conducted by researchers at the University of Pennsylvania highlighted the impact of using ChatGPT as a study assistant on the academic performance of high school students. The study compared the math progress of nearly 1,000 high school students and analyzed the effects of integrating AI technology like ChatGPT into their learning process.
Experiment Details
The study involved three groups of students: one group had access to ChatGPT for assistance with math practice problems, another group used a revised version of ChatGPT that functioned more like a tutor, providing hints instead of direct answers, and the third group did their practice work without any high-tech aids. The results were quite revealing.
Findings
Students who had access to ChatGPT solved more practice problems correctly, but surprisingly, they scored 17% lower on the math test compared to students who did not use AI assistance. The group that used the AI tutor version of ChatGPT performed exceptionally well on practice problems, but their performance on the test did not reflect this improvement.
The researchers concluded that using ChatGPT as a crutch hindered the students' learning process, as they tended to rely on the AI for answers rather than developing problem-solving skills independently.
Challenges with ChatGPT
One of the major challenges observed was the error rate of ChatGPT, with incorrect arithmetic computations and misleading step-by-step problem-solving approaches. Even the revised tutor version, which was fed with correct solutions, did not significantly improve students' test scores.
Implications and Future Studies
The study, titled "Generative AI Can Harm Learning," emphasizes the need for caution when incorporating AI technologies in educational settings. It also raises questions about overreliance on AI tools, which may lead to reduced learning outcomes and overconfidence among students.
full article on The Hechinger Report website.
