Research on UAV Anti-UAV Strategies Based on Deep Reinforcement Learning

This paper constructs a reinforcement learning framework based on the PPO algorithm for drone air combat to solve 1v1 pursuit-evasion in 2D beyond-visual-range air combat. Firstly, the mission scenario is modeled, defining key roles of ATA and AA. Then, state transition models of pursuer and evader are built based on flight kinematics. To handle reward sparsity in policy network training, a dense reward function combining distance and angle rewards is designed to guide the agent in learning tail-chasing and interception strategies. Using the Actor-Critic architecture, deep neural networks implement the decision-making and evaluation modules. The PPO algorithm trains the pursuing drone in a simulation. Results show that after ~5 million steps, the agent learns a stable strategy, completing tasks promptly and generalizing well in unseen scenarios. This research offers ideas for drone combat and guidance, and supports autonomous decision-making in complex air battles.