Autonomous Drone Racing with Monocular Vision
This project challenged each team to build a fully autonomous drone capable of completing a race through an unknown obstacle course using only a single RGB camera and noisy IMU data; no depth sensing, no prior map, and no reliable visual texture. The course consisted of three rectangular racing frames followed by an irregularly shaped gap in a textured wall. Critically, the back faces of the frames and the wall were completely textureless, making conventional on device image segmentation unreliable. After passing through all obstacles (stage 1 and 2), the drone was required to rotate 360 degrees and return through the same course (stage 3).
To solve this, our team implemented a perception and navigation stack based entirely on motion cues. We combined optical flow (RAFT) with Temporally Stacked Spatial Parallax (TS2P) to infer relative depth from monocular video in real time. Rather than relying on appearance or color, the system exploited motion parallax to distinguish foreground structures from background surfaces, allowing it to detect both regular window frames and arbitrary gaps regardless of texture or background.
From the resulting flow field, we segmented navigable free space, estimated the centroid of each opening, and fed this information into a visual servoing controller. The drone aligned itself to each target and traversed it using a minimum-snap trajectory planner. This approach enabled robust navigation through textureless geometry and eliminated any dependence on explicit depth sensors or pre-mapped environments.
Our system completed the full out-and-back course in approximately 260 seconds, the third fastest time in the class, demonstrating that reliable autonomous flight through unknown, visually ambiguous environments is possible using only a single camera and motion-based perception.