Two-year university study finds banning AI from classrooms leaves students worse off
A two-year classroom experiment at Vrije Universiteit Amsterdam found that banning AI entirely produced the worst student outcomes, contradicting the researcher's initial assumptions. Students with structured prompt engineering training outperformed all other groups in 2024, but the advantage nearly disappeared in 2025 as AI familiarity became widespread. Uncritically accepting AI suggestions led to errors persisting in drafts, though students demonstrated ability to self-correct on later exams
Analysis
TL;DR
- A two-year classroom experiment at Vrije Universiteit Amsterdam found that banning AI entirely produced the worst student outcomes, contradicting the researcher's initial assumptions.
- Students with structured prompt engineering training outperformed all other groups in 2024, but the advantage nearly disappeared in 2025 as AI familiarity became widespread.
- Uncritically accepting AI suggestions led to errors persisting in drafts, though students demonstrated ability to self-correct on later exams without formal instruction.
- The no-AI group experienced "idea exhaustion" within 10–15 minutes, producing mostly minor wording changes rather than substantive legal improvements.
- Blanket AI bans in education are counterproductive; universities should invest in AI skills training for both faculty and students rather than restricting tool access.
Why It Matters
This study directly challenges the growing wave of institutional AI bans in higher education, providing empirical evidence that exclusion from AI tools harms learning outcomes more than unguided use does. For AI practitioners and educators, it underscores that the critical variable is not whether students use AI, but how they are trained to use it effectively and critically.
Technical Details
- Three-group randomized controlled trial across two academic years: Group 1 (no AI, n=66 in 2024 / n=164 in 2025), Group 2 (unguided ChatGPT access with embedded suggestions), Group 3 (hands-on legal prompt engineering and accuracy-checking training).
- Task: Small teams of 4–5 students revised a provision of the EU AI Act within 20 minutes; grading rubric covered substance, clarity, proportionality, and innovation.
- Assessment included both in-class performance and a take-home exam requiring revision of a separate AI Act provision, plus a multiple-choice test.
- Sample was limited to students enrolled in an AI law course, introducing potential self-selection bias toward tech-savvy participants.
- No mechanism existed to verify actual AI usage during the unsupervised take-home exam, a acknowledged methodological limitation.
Industry Insight
- Educational institutions should shift from prohibition-based AI policies to investment in structured AI literacy programs, as the research demonstrates that training—not restriction—is the primary driver of positive outcomes.
- The diminishing returns of formal AI training by year two signal that as tool familiarity becomes commoditized, curricula must evolve continuously rather than treating AI instruction as a one-time intervention.
- The contrast between boosted homework grades and depressed exam performance in related studies suggests that AI integration strategies must distinguish between formative and summative assessment contexts to avoid superficial learning gains.
Disclaimer: The above content is generated by AI and is for reference only.