Kids who use ChatGPT as a study assistant do worse on tests ...
A recent study conducted by researchers at the University of Pennsylvania has raised concerns about the use of AI technology, specifically ChatGPT, as a study aid for high school students. The study compared the performance of almost 1,000 high school students in Turkey who used ChatGPT for math practice with those who did not have access to the AI tool.
Impact on Learning
The results of the study revealed that while students who used ChatGPT were able to solve 48% more practice problems correctly, they ultimately scored 17% worse on the math test compared to their peers who did not use the AI tool. A third group of students who had access to a modified version of ChatGPT, designed to provide hints instead of direct answers, performed significantly better on practice problems but showed no improvement on the test.
Limitations of ChatGPT
The researchers highlighted that students tended to use ChatGPT as a "crutch," often asking for answers without fully engaging with the problem-solving process. Additionally, the AI tool's margin of error, especially in providing step-by-step solutions, was a contributing factor to the students' lower test scores.
Overconfidence and Autopilot Effect
Interestingly, students who used ChatGPT expressed overconfidence in their learning outcomes, despite the evidence of poorer test performance. This overreliance on AI technology was likened to the autopilot feature in aviation, where pilots are advised to minimize its use to maintain essential skills.
ChatGPT is not the first technology to present such a tradeoff in education, with previous tools like calculators and computers also impacting learning outcomes. While AI tools may help in solving specific problems, they may not necessarily contribute to overall learning and skill development.
This study serves as a cautionary tale for educators and parents, highlighting the importance of balancing the use of AI technology in education to ensure that students develop essential skills and knowledge effectively.
This story was produced by The Hechinger Report, a nonprofit news organization focused on education, and reviewed and distributed by Stacker Media.
