RECORDED RUN / 24 S LOOP
A robot's run, rebuilt by drones.
A recorded run from the Zonta Labs research simulator. A small robot car drives a track in a lab while simulated drones watch it and rebuild the room and the car in 3D.
The run plays back in your browser from a recording. It is research in simulation, not a shipped product.
Controls
- DRAG
- Orbit the camera
- RIGHT-DRAG
- Pan
- W A S D
- Fly forward, back and sideways
- Q / E
- Fly down and up
- SHIFT
- Fly faster
Click the view first so it takes the keys. On a touch screen the run plays without controls.
What you are seeing
The drones
52 simulated drones. Eight fly with the car and aim their cameras at a marker on its roof. The other 44 sweep the room.
The map
The room and the car appear only where a drone camera has seen them. Anything no camera has reached stays blank, so the map fills in as the run goes on.
The car
The car has no sensors of its own. A filter fuses the drones' noisy measurements into one estimate of where it is, and its driving policy steers from that estimate. The car is drawn at the estimate, never at its true position.
Where it fits
This is the first stage of the loop we are building: watch a run and rebuild it in 3D. Handing that reconstruction to AI agents, so they can explain a failure and improve the next run, is the part still in development.
Limits
The simulation is simple on purpose. The car has no tire slip, the camera measurements come from a hand-written sensing model rather than rendered images, and none of it has been tested on hardware yet.
Research recordings
Simulation / chase view A policy learns to drive.
A small car runs a driving policy trained with reinforcement learning, recorded in simulation from a chase camera.
Simulation / overhead view The same run, from above.
An overhead view of the track shows each turn and correction the policy makes.
Lab / 3D reconstruction A lab, rebuilt in 3D.
A lab workspace reconstructed in 3D from recorded observations. This is the kind of scene an agent needs to reason about a run.