AI could make scientists do more work less well, not less work better, study argues
A theoretical economics paper argues that LLMs may worsen research quality because time savings increase the opportunity cost of each hour, pushing researchers to do more work less thoroughly Using an optimal foraging model adapted from behavioral ecology, researchers simulate how scientists allocate effort across projects when AI shortens different phases of the research lifecycle In two out of three scenarios, AI application leads to shallower research: when used for early idea evaluation or f
Analysis
TL;DR
- A theoretical economics paper argues that LLMs may worsen research quality because time savings increase the opportunity cost of each hour, pushing researchers to do more work less thoroughly
- Using an optimal foraging model adapted from behavioral ecology, researchers simulate how scientists allocate effort across projects when AI shortens different phases of the research lifecycle
- In two out of three scenarios, AI application leads to shallower research: when used for early idea evaluation or for publishing tasks, thoroughness declines as researchers chase quantity over depth
- Only when AI accelerates the voluntary deep-dive phase (extra experiments, deeper analysis, polishing) does research quality actually improve
- Real-world evidence already mirrors these predictions: OpenAI case studies show bottleneck shifting rather than elimination, METR found AI-assisted developers took 19% longer despite feeling 24% faster, and Arxiv is imposing penalties for AI-generated citation errors
Why It Matters
This research challenges a foundational assumption in AI adoption across academia—that time saved by automation will naturally be reinvested into deeper, more rigorous work. For AI practitioners and researchers, it highlights that the impact of AI on output quality depends critically on which phase of a workflow is automated, not just how much time is saved. The findings carry urgent implications for how institutions design incentives, peer review systems, and AI integration policies.
Technical Details
- The paper employs a mathematical model based on optimal foraging theory from behavioral ecology, adapted to model how researchers distribute labor across competing projects under time constraints
- Each research project is modeled in two phases: an idea viability check (abandon or proceed) and a execution phase split into mandatory tasks (figures, formatting, submission) and voluntary deep-dive tasks (extra experiments, deeper analysis, prose polishing)
- Three scenarios are analyzed based on where AI intervention occurs: (1) early idea evaluation, (2) publishing/writing acceleration, and (3) voluntary deep-dive acceleration—each producing qualitatively different outcomes for research quality
- The model deliberately idealizes LLMs as error-free, negligible-cost time savers to isolate the pure effect of opportunity cost changes from other technological weaknesses
- Supporting empirical evidence includes OpenAI's field report (up to 60x speedups with bottleneck migration), METR's study (19% longer actual completion despite 24% perceived speedup), and institutional responses from Arxiv and ICLR workshops
Industry Insight
- AI tool designers and adopters should target the voluntary deep-dive phase of research workflows rather than routine or publishing tasks if the goal is to improve output quality—automation of shallow tasks risks a quantity-over-quality trap
- Institutions and journals need discipline-specific AI policies rather than one-size-fits-all guidelines, since the effect of AI on research quality varies dramatically depending on which workflow phase is accelerated
- The "tragedy of the commons" dynamic identified in software development—where individual productivity gains impose costs on reviewers and maintainers—likely extends to academic publishing, suggesting that incentive structures around AI-assisted output need reform to prevent systemic quality degradation
Disclaimer: The above content is generated by AI and is for reference only.