MemoPop Connector API, Phase 4: Materials
Decks, datarooms, notes, and links reach the server three ways, become text the steps can read, and never block the memo.
- Path
- plans/MemoPop-Connector-API-Phase-4-Materials.md
- Authors
- Michael Staton
- Augmented with
- Claude Code on Claude Opus 5.5 (1M context)
- Tags
- Plan · MemoPop · Claude-Connector · TDD
MemoPop Connector API, Phase 4: Materials
Read the spec (context-v/specs/MemoPop-Connector-API.md, §The tools →
add_materials, §Storage, §Tests → Materials) and the loop doc first. Phase 1
is merged into development; build on its registry, workspace, bucket, and
error catalogue. Runs in parallel with phases 5 and 6: stay inside your files.
Your files
src/connector/tools/add_materials.py, src/connector/materials/ (fetch,
extract, upload page), the materials.extract server step and the
materials.brief instruction file, tests/connector/test_materials*.py, and
small fixtures (a two-page synthetic PDF; generate it, don’t copy a real deck).
Touch shared registry files only to register your items.
Steps
- Failing tests for the seven owned IDs; ledger shows them RED.
add_materialsper the spec: inline text (100,000-character cap →material_too_large), links, and filename-only items that get a one-time upload URL. Returns at once; extraction runs in a background task.- Link fetching with
httpx, timeouts, and a size cap. An unreachable or unreadable link records a skip (material_unreadable) on the deal; it never blocks. Google Drive and Dropbox share links: rewrite to their direct download form. DocSend is out of scope for v1; record it as unreadable with a message saying so. - The upload page:
GET /upload/{token}serves a minimal HTML form;POSTaccepts the file. Tokens are random, single-use, and expire after an hour. No auth beyond the token. - Extraction: reuse what exists rather than rewrite it. PDF text through
the orchestrator’s PyMuPDF path (
src/agents/dataroom/document_text.pyhas the OCR fallback);.docx,.xlsx,.csv,.md,.txtas plain text. Originals go to the firm’s bucket undermaterials/; extracted text todeals/<deal>/materials/<id>.md. materials.brief: a Claude step offered after materials are ready and before research; instruction adapted fromsrc/agents/deck_analyst.py’s prompt, with model calls removed.- Docs for
add_materialscomplete, with examples that execute.
Rules and done
As in Phase 1: never edit a test to pass, no model calls, uv add only, no
io/. Done when scripts/check.sh passes, the owned IDs are GREEN, the
existing and Phase 1 tests still pass, a changelog entry is written, and the
branch is pushed. Report the ledger output and suite counts.