Grades dropped from 96 to 48 percent when a Brown professor made students take the exam without AI
Brown University professor Roberto Serrano observed a drastic grade drop from 96% on a take-home exam to 48.6% on a proctored final, attributing the initial high scores to widespread AI cheating. Two independent studies corroborate this trend: a Chinese study of 26,000 students showed homework scores rising while exam scores fell after AI adoption, and a UC Berkeley analysis of 500,000 grades revealed a significant spike in A grades in unsupervised assignments post-ChatGPT launch. The data indic
Analysis
TL;DR
- Brown University professor Roberto Serrano observed a drastic grade drop from 96% on a take-home exam to 48.6% on a proctored final, attributing the initial high scores to widespread AI cheating.
- Two independent studies corroborate this trend: a Chinese study of 26,000 students showed homework scores rising while exam scores fell after AI adoption, and a UC Berkeley analysis of 500,000 grades revealed a significant spike in A grades in unsupervised assignments post-ChatGPT launch.
- The data indicates that reliance on AI tools creates a false sense of mastery, leading to inflated homework performance but a collapse in actual knowledge retention and application during supervised assessments.
Why It Matters
This phenomenon highlights a critical validity crisis in current educational assessment models, particularly those relying heavily on unsupervised, take-home assignments. For educators and institutions, it underscores the urgent need to redesign evaluation methods to distinguish between genuine student capability and AI-generated output, ensuring that grades accurately reflect learning outcomes.
Technical Details
- Brown University Case Study: Professor Serrano identified AI usage by comparing student solutions to ChatGPT outputs, noting that many students utilized complex, non-intuitive mathematical proofs generated by the AI rather than standard direct approaches.
- Central China Longitudinal Study: Tracked 26,000 students (grades 7-12) over 30 months; found that six months after AI introduction, homework completion time dropped from 64 to 45 minutes, homework scores rose by 18%, but exam scores fell by 20%.
- UC Berkeley Grade Analysis: Analyzed over 500,000 grades at a major Texas research university; found that courses with heavy writing/programming components saw a 13 percentage point jump in A grades after ChatGPT’s launch, with the effect being 16 percentage points higher in unsupervised homework compared to proctored exams.
- Performance Disparity: In the Chinese study, approximately 81% of long-term AI users exhibited the pattern of fast/high homework but poor exams, with top-performing students suffering the largest relative declines (24%).
Industry Insight
Educational institutions must pivot toward supervised, in-person, or strictly monitored assessment formats for high-stakes evaluations to maintain academic integrity. Curriculum designers should consider reducing the weight of unsupervised take-home assignments in favor of process-oriented grading or oral defenses that verify individual understanding and prevent AI dependency from masking skill deficits.
Disclaimer: The above content is generated by AI and is for reference only.