New release of LLM adds support for reasoning traces, OpenAI Responses, server-side tools, and smarter logging
LLM 0.32 introduces visible reasoning traces streamed to stderr, allowing users to inspect model "thinking" without polluting stdout pipelines Server-side tools are now supported, including OpenAI's CodeInterpreter and WebSearch, plus Anthropic's WebSearch, WebFetch, CodeExecution, and AnthropicMCP The Python API gains a `model.prompt(messages=[])` parameter for direct message-sequence passing and a `stream_events()` method for structured event handling (reasoning, text, tool calls, images) A ne
Analysis
TL;DR
- LLM 0.32 introduces visible reasoning traces streamed to stderr, allowing users to inspect model "thinking" without polluting stdout pipelines
- Server-side tools are now supported, including OpenAI's CodeInterpreter and WebSearch, plus Anthropic's WebSearch, WebFetch, CodeExecution, and AnthropicMCP
- The Python API gains a
model.prompt(messages=[])parameter for direct message-sequence passing and astream_events()method for structured event handling (reasoning, text, tool calls, images) - A new content-addressable SQLite logging system, modeled after Git, deduplicates message history across turns to reduce redundant JSON storage
- LLM now offers an
llm-chat-completions-serverplugin implementing the OpenAI chat completions API, enabling interoperability with any OpenAI-compatible client
Why It Matters
This release marks LLM's evolution from a simple CLI wrapper into a full-featured agent framework, driven by real-world needs of tools like Datasette Agent. The introduction of reasoning traces, server-side tools, and structured streaming events addresses critical gaps in observability and composability that AI practitioners face when building production LLM systems. The content-addressable logging design also offers an elegant solution to a common problem in conversational AI: avoiding redundant storage of growing message histories.
Technical Details
- Reasoning traces: Models supporting reasoning (e.g., o-series, Claude 5) now output thinking tokens to stderr via a new streaming event type, with a
--hide-reasoningflag to suppress them - Server-side tools: OpenAI's CodeInterpreter and WebSearch tools are available natively; Anthropic plugin (v0.26) adds WebSearch, WebFetch, CodeExecution, and AnthropicMCP for executing MCP calls within a single request
- Python API overhaul:
model.prompt(messages=[...])accepts a full message list (system, user, assistant), bypassing the previous conversation abstraction;stream_events()yields typed events for reasoning chunks, text chunks, tool calls, and image attachments - Content-addressable logs: SQLite backend redesigned using a Git-inspired model where messages are stored by content hash, eliminating duplication across conversation turns;
llm logsandllm logs --jsoncommands render the deduplicated store into readable output - OpenAI compatibility: The
llm-chat-completions-serverplugin serves the OpenAI chat completions endpoint on a configurable port, enabling tools likellm openai endpointto route prompts through any OpenAI-compatible API (e.g., local LM Studio instances) - New default model: GPT-5.6 Luna is now the default for
llm "prompt", replacing the previous default with a more cost-effective option
Industry Insight
- The shift toward agent-like capabilities (tool loops, human-in-the-loop approval, message history resumption) signals that even lightweight CLI tools are being pulled into the agent ecosystem; developers should expect their favorite LLM utilities to adopt agent patterns as the standard
- Content-addressable logging is a design pattern worth adopting in other AI tooling—it solves a real scalability problem as conversation histories grow, and the Git analogy makes it intuitive for engineers to understand and extend
- The
llm-chat-completions-serverplugin demonstrates the growing importance of OpenAI API compatibility as a de facto standard; any tool that can interoperate with this protocol gains immediate access to a broad ecosystem of clients and integrations
Disclaimer: The above content is generated by AI and is for reference only.