Autonomous Navigation for UAVs in Complex Environments: Towards an Improved DQN Approach

2026-99-2549

11/20/2026

Authors
Abstract
Content
In real-world operations, tasks such as urban inspection and forest search place extremely high demands on UAV autonomous obstacle avoidance and navigation. However, the classic DQN falls short in practical deployment due to its limitations in single-sensor input, insufficient exploration, and slow convergence. This paper introduces three key improvements to DQN: First, a dual-stream network is built to fuse visual and LiDAR information. Second, prioritized experience replay (PER) and NoisyNet are introduced to enhance sample efficiency and exploration quality, respectively. Third, a three-stage curriculum learning strategy is designed to gradually reduce the training difficulty. Experiments are conducted using TensorFlow 2.x and Gazebo, and the results show that our improved algorithm significantly outperforms DQN, DDQN, Dueling DQN, and PPO in terms of the success rate, path length, and adaptability to dynamic obstacle avoidance.
Meta TagsDetails
DOI
https://doi.org/10.4271/2026-99-2549
Citation
Lin, S., Wen, Z., Lin, X., and Xia, X., "Autonomous Navigation for UAVs in Complex Environments: Towards an Improved DQN Approach," 2026 5th International Conference on Aerospace, Aerodynamics and Mechatronics Engineering (AAME2026), Nanchang, China, April 17, 2026, https://doi.org/10.4271/2026-99-2549.
Additional Details
Publisher
Published
Yesterday
Product Code
2026-99-2549
Content Type
Technical Paper
Language
English