William Collins-Broza

Talks

Data Con LA 2026

Connecting your Agents to Spatial Data

Lightning Talks

Agents have deep access to text systems — code, documents, calendars — and almost none to physical space. This talk covers why that gap persists, and how one tool closes it. XR Capture is largely solved, but what capture produces is geometry, and a mesh is not something an agent can reason over. Agents need a typed, semantic description of a space — objects with positions, labels, confidence, and stable identity — small enough to fit in a prompt. Companion Scan is an OSS tool that pairs on-device scene understanding with vision models running locally, projecting what the models detect onto geometry the device already holds. Each detection becomes a labelled point with a durable coordinate, anchored so it survives across sessions. That stability is what enables change detection — comparing two scans weeks apart and asking what moved. The session covers the schema decisions that make a space queryable, the failure modes, and letting agents write corrections back.