Camera-Plus-VLM Tactile Whiteboard Digitizer That Mirrors Sticky Notes and Tokens to a Live Miro Board

desktop app venture scale • early

An Ask HN thread about developer tools wished for in 2026 produced a multi-comment exchange where users described the same gap: people who think with their hands (sticky notes, sketches, tokens) want the artifact to also exist as an editable digital board, without buying a $4,000 'smart' whiteboard. The OP and a reply co-described the actual MVP — point a webcam at a normal whiteboard or wall of stickies, run an on-device VLM, sync state to a Miro/FigJam-style canvas in near-real-time. Rocketbook is referenced as the closest commercial attempt and dismissed as clunky. Demand is small in raw upvotes but unusually concrete (multiple users describing the exact same workflow) and the technical pieces (cheap webcams, on-device VLMs, multiplayer canvas libraries) are all 2026-ready.

builder note

The hard part isn't the OCR or the canvas, it's the diff. You need a representation of the whiteboard state that survives a hand passing in front of the camera, a sticky note being moved 3 inches, and someone wiping a section. Treat the local VLM as an event detector that emits 'token X moved from A to B' deltas, not a full re-OCR of the entire frame. Wedge customer: post-its-and-string designers and ops/incident-response teams who already use physical war rooms but need the artifact to live somewhere after the meeting.

landscape (5 existing solutions)

Hardware-first attempts (Logitech, Webex Board) are expensive and built for one-way capture. Software-first tools (Miro, FigJam) live entirely in the digital domain. The unmet wedge is the cheap-camera + on-device VLM + multiplayer canvas combination, which became feasible only in the last 12 months as VLMs got small enough to run locally on a M-series Mac mini or a Jetson. Nobody has shipped it because the team needs both ML competence and a real opinion about how tokens, sticky notes, and freehand strokes get represented in the digital twin.

Rocketbook Reusable notebook plus phone app for OCR. One-shot capture, no continuous sync, no token tracking. The original commenter explicitly mentioned trying it and finding it clunky.

Microsoft Whiteboard / Apple Freeform Pure digital. Nothing physical. Defeats the entire point of the request, which is the tactile half.

Logitech Scribe / Owl Camera $1,200+ AI-enhanced whiteboard cameras built for conference rooms. They share the captured image with remote viewers but don't reconstruct an editable digital canvas.

Miro / FigJam The destination canvas the commenters want their physical board to mirror to. Has APIs but no first-party physical capture path.

remarkable / reMarkable Excellent digital paper, but it's a tablet — no tokens, no shared wall, no group session.

sources (3)

hackernews https://news.ycombinator.com/item?id=46354666 "A physical board that translates digitally. Imagine a whiteboard that has sticky notes, writing, little tokens and trinkets and the board also becomes a digital version that you can iterate on. I really like to plan with my hands and in MY memory, but still love the utility of planning digitally of course." 2025-12-22

hackernews https://news.ycombinator.com/item?id=46366727 "My immediate thought for a build: just a camera with on-device VLMs and LLMs. You could point it at a normal whiteboard (or a wall of sticky notes), and the model could interpret the handwriting, track the tokens, and sync the state digitally in real-time without needing any special 'smart' hardware." 2025-12-23

hackernews https://news.ycombinator.com/item?id=46354630 "But if I plan too much digitally, it's stored in digital memory, not my memory. I'm really struggling to find something to mitigate this. I wish I had a tactile miro board that also created the miro board online." 2025-12-22

aivlmwhiteboardproductivitycomputer-visioncollaboration