← index
private · prototype

Room RAG

Ask a 3D scan of a room a question in plain language

Case study. This system is private — its architecture is described here, but it is not linked and no real data or media from it appears.

"How much clearance is above the bathroom door?" — answered from a scan rather than a tape measure.

Two capture sources feed one pipeline. Photogrammetry meshes arrive unsolved, so the floor has to be found by RANSAC and the units guessed; phone LiDAR arrives already gravity-aligned and metric and can be trusted. Everything downstream — plane extraction, door and window heuristics, the spatial database, the tools exposed for LLM tool-calling — works the same either way.

The scan used to build it is of a home, so no geometry, no room dimensions, and no derived floorplans appear here.

Stack

  • Python
  • RANSAC plane fitting
  • LiDAR / photogrammetry ingest
  • LLM tool-calling