基于深度强化学习的四旋翼无人机双向推力控制

Bidirectional Thrust Control of a Quadrotor with Deep Reinforcement Learning

  • 摘要: 目前四旋翼无人机控制技术主要采用电机正向推力的思路,限制了双向转动电机的应用潜力。为了提高四旋翼无人机的机动性,扩展其动作空间,实现机动飞行和快速控制,提出一种基于深度强化学习的四旋翼无人机双向推力控制方法。该方法首次将深度强化学习与四旋翼无人机双向推力控制相结合,在双向推力的旋翼无人机动力学模型的基础上,设计基于深度强化学习的神经网络控制器,控制无人机底层的4个电机的期望推力,实现了无人机在剧烈运动状态下的快速悬停。同时,开展了大姿态角、大速度、大角速度等剧烈运动状态下四旋翼无人机稳定悬停控制仿真实验,实验结果表明,与现有使用正向推力的控制器相比,本文提出的双向推力控制器执行动作更平滑、无人机状态波动更小、控制时间更短、鲁棒性更强,能够有效提升无人机的控制效果。

     

    Abstract: Current control technologies for quadrotors mainly adopt the approach of utilizing positive thrust from the motor, limiting the application potential of bidirectional motors. To improve the maneuverability of quadrotors, expand their action space, and achieve agile flight and rapid control, a bidirectional thrust control method for quadrotors based on deep reinforcement learning is proposed. This method combines deep reinforcement learning with bidirectional thrust control for quadrotors for the first time. Based on the dynamic model of quadrotors with bidirectional thrust, a neural network controller based on deep reinforcement learning is designed to control the expected low-level thrust of 4 motors, realizing rapid hovering under extreme conditions. In addition, simulations of quadrotor stable hovering control under extreme conditions, such as large attitudes, high speeds, and high angular speeds, are conducted. The experimental results show that, compared to existing controllers using positive thrust, the proposed bidirectional thrust controller performs smoother actions, with smaller state fluctuations, shorter control times, and stronger robustness, effectively improving the control performance of the quadrotor.

     

/

返回文章
返回