Design and Development of a Mixed Reality-Based Simulator for Drone Pilot Training
Contributors
Suhas G K
Shashi Kant Gupta
Keywords
Proceeding
Track
General Track
License
Copyright (c) 2026 Sustainable Global Societies Initiative

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Abstract
The growing use of unmanned aerial vehicles (UAVs) in surveying, agriculture, photography, emergency response and other fields has increased the need for practical and safe pilot training. Conventional flight practice can involve equipment costs, restricted access to suitable flying areas and the risk of damage or injury while beginners learn basic control. This paper presents a mixed reality (MR) drone-training simulator that combines a physical radio controller and cockpit mock-up with a virtual flight environment. The system uses ArduPilot Software-in-the-Loop (SITL) through Mission Planner for flight-control computation, Unity for the three-dimensional environment and physics interface, and a Meta Quest Pro headset for mixed-reality presentation and cockpit passthrough. Motor pulse-width modulation (PWM) values are exchanged with Unity, while simulated position, velocity, acceleration and attitude information are returned to the flight-control process. Real-time telemetry is displayed to support learning and situational awareness. Training is organised as five progressively challenging hoop-navigation courses and evaluated using missed hoops, collisions and completion time. The project report describes trials involving five novice and five experienced pilots. The individual novice improvement figures average approximately 24.47%; however, the report contains inconsistencies between its summary averages and participant-level tables. These discrepancies are identified rather than treated as settled findings. The work demonstrates the feasibility of integrating a real flight-control stack with an MR training interface and provides a basis for more rigorous evaluation of simulation fidelity, usability and transfer of skills to physical UAV operation.