LAI #142: My AI Setup in 2026
The author shares a portable AI workflow using Claude Code for planning/coordination and Codex for bounded execution, with knowledge stored in an open-source Obsidian vault accessible across devices "AI Engineering for Production" (launching October 20) addresses engineering challenges that better models alone cannot solve: context management, retrieval, agents, evaluation, recovery, and deployment Document parsing quality is a critical but underestimated bottleneck—extraction can break structur
Analysis
TL;DR
- The author shares a portable AI workflow using Claude Code for planning/coordination and Codex for bounded execution, with knowledge stored in an open-source Obsidian vault accessible across devices
- "AI Engineering for Production" (launching October 20) addresses engineering challenges that better models alone cannot solve: context management, retrieval, agents, evaluation, recovery, and deployment
- Document parsing quality is a critical but underestimated bottleneck—extraction can break structural relationships that retrieval and prompting cannot recover
- Agent frameworks leave four operational gaps unaddressed: context selection, observability, scalability, and governance, requiring infrastructure beneath interfaces like MCP
- Shared-memory multi-agent systems introduce classic database concurrency problems (lost updates, write skew, dirty reads) that consistency mechanisms alone cannot fully resolve
Why It Matters
This article synthesizes practical workflow insights with deeper engineering principles relevant to anyone building production AI systems. The emphasis on portable knowledge, operational gaps in agent frameworks, and concurrency challenges in shared-memory agents directly addresses the gap between demo-quality systems and reliable production deployments.
Technical Details
- Portable Agent Workflow: Claude Code handles planning and coordination; Codex handles bounded execution and scheduled tasks. Knowledge and skills are maintained in an Obsidian vault, making them device-agnostic and model-agnostic.
- Document Parsing Pitfalls: PDF extraction can lose structural relationships—table values detached from column headings, footnotes displaced from qualifying sentences. The recommended debugging test is to attempt answering an incorrect system response using only the extracted text.
- Continuous Batching: Replaces static batching by removing completed sequences and admitting new requests at every generation step, improving GPU utilization. Performance should be judged across utilization, throughput, latency, and queueing behavior rather than a single speedup metric.
- Agent Framework Operational Gaps: Four areas remain unaddressed by frameworks: context selection, observability, scalability, and governance. Durable state, retrieval, recovery, permissions, and monitoring require infrastructure beneath interfaces like Store and Checkpointer.
- Shared-State Concurrency in Multi-Agent Systems: Lost updates, write skew, dirty reads, phantom reads, and stale-context writes arise when agents concurrently modify shared memory. Solutions include partitioning, single-writer designs, reducers, event logs, optimistic concurrency control, and CRDTs—but semantic reconciliation and idempotency remain application-layer concerns.
- Sandbox Egress Policies: Network access should be phase-dependent rather than fixed for the sandbox lifetime. Tensorlake Sandboxes demonstrate dynamic egress policy replacement, restricting access after dependency installation completes.
- Contextual Off-Policy Evaluation: New policies that perform better on average may harm specific subpopulations. Cross-fitted doubly robust estimates with confidence bounds can gate deployment to contexts where evidence supports improvement.
Industry Insight
- The shift from model-centric to engineering-centric thinking is accelerating—books, frameworks, and community discourse now focus on reliability, deployment, and operational concerns rather than raw model capability.
- Multi-agent systems will increasingly require database-grade concurrency controls and sandbox isolation patterns borrowed from distributed systems engineering.
- Token usage should be evaluated through outcome quality rather than raw cost, as agents capable of end-to-end task execution (research, implement, test, iterate) can justify higher consumption when aligned with productive work.
Disclaimer: The above content is generated by AI and is for reference only.