memex

memex is a personal capture agent that runs entirely on Google Cloud and scales down its resource usage when idle. It accepts input from multiple surfaces: speaking a thought at a phone, screenshotting a page, or dumping open tabs. Each capture becomes a searchable note with a summary, tags, and any to-dos it contained. A scheduled agent reviews the backlog and proposes cleanups that can be accepted with one click, and a chat sidebar lets users ask questions against their data. Research can be initiated via Gemini Deep Research Agent, with the report added to the Memex feed.

Enrichment uses one structured Gemini call to turn a capture into a note, including transcript or image description, summary, tags, and extracted tasks. The model's full trace is stored on the note. Text and link captures enrich synchronously, while audio and image captures return 202 immediately and are enriched through Eventarc, taking about ten seconds. Cloud Scheduler fires two agent sessions a day: a task review at 09:00 and a digest at 03:00. Routines cannot touch tasks; they can only queue an approval that the user accepts or rejects.

A sidebar chat runs over the same corpus with a larger toolset and streams over Server-Sent Events, showing each model turn, tool call, and tool result. Chat mutates directly instead of queuing approvals. Deep Research runs on Vertex AI and is tracked as a durable operation in Firestore, polled by a self-rescheduling Cloud Tasks job every 30 seconds.