I was intrigued by this paper: "Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Tasks". The article is here: https://arxiv.org/abs/2506.08872.
Conclusion
What they found was when people used ChatGPT, their understanding of the material was very weak.
"This trade-off highlights an important educational concern: AI tools, while valuable for supporting performance, may unintentionally hinder deep cognitive processing, retention, and authentic engagement with written material. If users rely heavily on AI tools, they may achieve superficial fluency but fail to internalize the knowledge or feel a sense of ownership over it"
Even if they "cleaned" up the AI-generated output, it made no impression on their ability to recall the key points. This dovetails nicely with our learning of late in our PIDP instructional course, as fact and concept recall is poor unless tested in a reasonably delayed fashion. Having AI generate a response that is immediately "zhushed" to look more personal gives the person doing it very little "stickiness" for the facts and key points.
This underscores some key facts I have been writing about of late: Kahnemann and Tversky's System 2 deep thinking (and lazy) brain needs to "feel the pain" to retain it - I gather rewiring or enforcing information in the brain takes "horsepower" and the brain tries to avoid it (like practicing an instrument).
The research sample size was quite small - however the detail was very high,
Some other interesting bits I found about a "dreary" academic paper...
Clear Title
First off: the title is unusually descriptive, hinting at a conclusion immediately:
Term: Cognitive Debt
Second, I was intrigued by the term cognitive debt. As an IT person and a coder, I am always aware of, and avoid at all costs, technical debt. Technical debt is where you use or buy technology that seems to make your life easier, but as you add each piece, it creates more and more complicated dependencies so that in the end you're afraid to make any changes. Of you are enslaved by this old technology, unable to move forward because "that's what we all use and don't want to change".
For a related article on "The Conversation" web site (https://tinyurl.com/3rjr5rhs): "The authors claim this demonstrates how prolonged use of AI led to participants accumulating “cognitive debt”. When they finally had the opportunity to use their brains, they were unable to replicate the engagement or perform as well as the other two groups. Cautiously, the authors note that only 18 participants (six per condition) completed the fourth, final session. Therefore, the findings are preliminary and require further testing."
This is the one thing I try to avoid in classes where I encourage AI use. As was stressed to me in some of the articles I read for this course - allowing me to track 3 key concepts:
- Retrieval practice—recalling knowledge through testing, writing, or speaking leads to stronger, longer-lasting learning than passive review. Especially delayed retrieval (no cramming!)
- Repeated testing is better than one
- Testing with feedback is better
Instructions
And third, it is rare for a paper to do you the courtesy of giving you guideposts as to where you might want to go, instead of floundering around:
Comments
Post a Comment