Room RAG
Ask a 3D scan of a room a question in plain language
Case study. This system is private — its architecture is described here, but it is not linked and no real data or media from it appears.
"How much clearance is above the bathroom door?" — answered from a scan rather than a tape measure.
Two capture sources feed one pipeline. Photogrammetry meshes arrive unsolved, so the floor has to be found by RANSAC and the units guessed; phone LiDAR arrives already gravity-aligned and metric and can be trusted. Everything downstream — plane extraction, door and window heuristics, the spatial database, the tools exposed for LLM tool-calling — works the same either way.
The scan used to build it is of a home, so no geometry, no room dimensions, and no derived floorplans appear here.
Stack
- Python
- RANSAC plane fitting
- LiDAR / photogrammetry ingest
- LLM tool-calling