Kids who use ChatGPT as a study assistant do worse on tests ...
A recent study conducted by The Hechinger Report compared the math progress of nearly 1,000 high school students to assess the impact of utilizing ChatGPT in learning environments. The results revealed some concerning outcomes that raise questions about the efficacy of AI in educational settings.
Effects of ChatGPT on Learning
The study, carried out by researchers at the University of Pennsylvania, focused on Turkish high school students who were provided access to ChatGPT while working on practice math problems. Surprisingly, the students who had access to ChatGPT solved 48% more practice problems correctly. However, when tested on the same topics, these students scored 17% lower compared to their peers who did not use ChatGPT.

Another group of students had access to a modified version of ChatGPT, designed to function more like a tutor by providing hints instead of direct answers. These students excelled in solving practice problems, outperforming their peers by 127%. Yet, when it came to the test, there was no significant improvement in their scores.
ChatGPT as a Learning Tool
The researchers titled their paper "Generative AI Can Harm Learning," emphasizing that the current AI chatbots, including ChatGPT, could potentially hinder academic progress. Students were found to rely on the chatbot as a crutch, often seeking answers directly without developing problem-solving skills.
The inaccuracies in ChatGPT's solutions also played a role in diminishing learning outcomes. The chatbot's error rate in arithmetic computations and problem-solving approaches raised concerns about its effectiveness as an educational tool.
Future Implications and Considerations
While this study offers valuable insights, it is essential to acknowledge that it represents just one experiment in a specific context. Further research is necessary to validate these findings and explore the broader implications of using AI in education.
ChatGPT's tendency to foster overconfidence among students further complicates its role as a learning assistant. Despite evidence suggesting decreased learning outcomes, students often perceived their performance inaccurately, highlighting the challenge of self-assessment in educational settings.

Conclusion
Similar to other technological advancements in education, such as calculators and computers, ChatGPT presents a tradeoff between accuracy and learning retention. While AI tools may offer immediate solutions, they may not necessarily enhance long-term learning and problem-solving skills.
It is crucial for educators and policymakers to carefully evaluate the role of AI in educational practices and ensure that these technologies complement, rather than replace, traditional learning methods.
This story was produced by The Hechinger Report, a nonprofit, independent news organization focused on inequality and innovation in education.
Originally published on hechingerreport.org, part of the BLOX Digital Content Exchange.
Your browser is out of date and potentially vulnerable to security risks.
We recommend switching to one of the following browsers:




















