On-orbit Computing Framework for LEO Satellites Based on MADDPG and Lyapunov Optimization

This paper solves the problem of resource and energy constraints on orbit computing for LEO satellites. By combining MADDPG reinforcement learning and Lyapunov optimization, the paper proposes a computing framework and implements an adaptive task offloading model for space flight using a multi-agent deep actor critic algorithm, MADDPG. The joint optimization mechanism is implemented by multi-agent dynamic task offloading. Through the transformation from the state with long-term constraints into optimization of the status of queue stability, the load scheduling under threshold energy in accordance with the characteristics of energy constraints was realized by introducing Lyapunov virtual queues into the process of policy evaluation of deep reinforcement learning. The experimental results show that the proposed framework enables a lightweight preliminary calculation, balanced energy consumption to reduce resource allocation, and realizes the stable queues through adaptability of tasks under energy balance conditions, which can provide high-efficiency computing assistance and support for space orbit tasks such as monitoring remote sensing of Earth.