Design and Development of a Mixed Reality-Based Simulator for Drone Pilot Training


Date Published : 16 November 2026

Contributors

Suhas G K

Author

Shashi Kant Gupta

Lincoln University College
Author

Keywords

Mixed reality drone pilot training ArduPilot Software-in-the-Loop Unity Meta Quest Pro telemetry UAV simulation

Proceeding

Track

General Track

License

Copyright (c) 2026 Sustainable Global Societies Initiative

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Abstract

The growing use of unmanned aerial vehicles (UAVs) in surveying, agriculture, photography, emergency response and other fields has increased the need for practical and safe pilot training. Conventional flight practice can involve equipment costs, restricted access to suitable flying areas and the risk of damage or injury while beginners learn basic control. This paper presents a mixed reality (MR) drone-training simulator that combines a physical radio controller and cockpit mock-up with a virtual flight environment. The system uses ArduPilot Software-in-the-Loop (SITL) through Mission Planner for flight-control computation, Unity for the three-dimensional environment and physics interface, and a Meta Quest Pro headset for mixed-reality presentation and cockpit passthrough. Motor pulse-width modulation (PWM) values are exchanged with Unity, while simulated position, velocity, acceleration and attitude information are returned to the flight-control process. Real-time telemetry is displayed to support learning and situational awareness. Training is organised as five progressively challenging hoop-navigation courses and evaluated using missed hoops, collisions and completion time. The project report describes trials involving five novice and five experienced pilots. The individual novice improvement figures average approximately 24.47%; however, the report contains inconsistencies between its summary averages and participant-level tables. These discrepancies are identified rather than treated as settled findings. The work demonstrates the feasibility of integrating a real flight-control stack with an MR training interface and provides a basis for more rigorous evaluation of simulation fidelity, usability and transfer of skills to physical UAV operation.

References

No References

Downloads

How to Cite

Suhas G K, S. G. K., & Shashi Kant Gupta, S. K. G. (2026). Design and Development of a Mixed Reality-Based Simulator for Drone Pilot Training. Sustainable Global Societies Initiative, 1(14). https://vectmag.com/sgsi/paper/view/1599