OpenAI's Computer History turns your clicks and keystrokes into a searchable ChatGPT memory timeline
OpenAI's Computer History replaces the screenshot-based "Chronicle" preview with an event-tracking system that records clicks, keystrokes, shortcuts, and app switches via macOS accessibility APIs Captured interaction events are converted into plaintext Markdown memory files stored locally, which ChatGPT and Codex can use as contextual memory The feature detects recurring workflows and suggests reusable "Skills" that Codex can turn into automation templates Memory files are unencrypted plaintext
Analysis
TL;DR
- OpenAI's Computer History replaces the screenshot-based "Chronicle" preview with an event-tracking system that records clicks, keystrokes, shortcuts, and app switches via macOS accessibility APIs
- Captured interaction events are converted into plaintext Markdown memory files stored locally, which ChatGPT and Codex can use as contextual memory
- The feature detects recurring workflows and suggests reusable "Skills" that Codex can turn into automation templates
- Memory files are unencrypted plaintext stored locally; temporary event files are deleted after 48 hours and processed server-side without retention
- OpenAI warns of heightened prompt injection risks and advises against using the feature with sensitive communication or health/financial apps without explicit consent
Why It Matters
Computer History represents a significant shift toward persistent, behavior-aware AI assistants that can recall and act on a user's actual workflow patterns rather than relying on one-off prompts. The move from screenshots to structured event tracking raises important questions about privacy, data security, and the trust model between users and AI platforms. For AI practitioners, it signals the growing industry trend of embedding AI deeper into desktop workflows through local-first memory systems.
Technical Details
- Event capture mechanism: Uses macOS accessibility APIs to record interaction events (clicks, keystrokes, keyboard shortcuts, app switches) rather than visual content like screenshots or screen recordings; excludes private browsing mode entirely
- Memory pipeline: Raw event files are stored temporarily in the ChatGPT app group and deleted after 48 hours; they are then processed server-side to generate plaintext Markdown memory summaries, which are written locally and retained until manually deleted by the user
- Skill detection and automation: ChatGPT analyzes the timeline for recurring workflow patterns and surfaces them as suggested "Skills"; users can then prompt Codex to generate reusable automation templates from those recorded patterns
- Data handling: Memory files are unencrypted plaintext on the local filesystem, readable by any process running under the same macOS user account; OpenAI states the files are not used for AI training, though chat content containing memories may become training data depending on user data control settings
- Permission architecture: Multi-layered opt-in system requiring both workspace admin approval (Business/Enterprise) and individual user consent; users maintain granular control via include/exclude lists for apps and websites, with pause/resume capability from the menu bar
Industry Insight
- The shift from screenshot-based to event-based tracking reflects a broader industry pivot toward privacy-preserving AI memory systems; competitors will likely follow suit, making structured interaction logging a standard pattern for desktop AI assistants
- The unencrypted local storage and prompt injection warnings highlight an emerging class of security risks for AI-augmented productivity tools—developers building similar features should prioritize encryption, sandboxing, and injection-resistant context pipelines from day one
- The multi-layered consent model (admin + user + per-app controls) sets a precedent for enterprise AI deployments, suggesting that organizational governance will become a critical differentiator as AI memory features proliferate across the workplace
Disclaimer: The above content is generated by AI and is for reference only.