融合注意力机制和速度障碍法的多移动机器人端到端自主导航方法

End-to-end Autonomous Navigation Approach for Multiple Mobile Robots Integrating Attention Mechanism and Velocity Obstacle Method

  • 摘要: 针对现有基于深度强化学习(DRL)的多移动机器人端到端自主导航算法存在的收敛速度慢、稳定性差及可解释性弱等问题,提出了一种基于注意力—速度障碍—柔性动作评价(Attention-VO-SAC)的多移动机器人端到端自主导航策略。首先,在DRL算法的网络结构中引入注意力模块,根据不同的任务场景动态调整状态特征的权重,使其聚焦于与任务相关的关键特征;其次,设计了一种新的奖励函数,该奖励函数融合了速度障碍法,能够约束移动机器人的速度方向,引导机器人规避不安全动作;再次,通过可视化注意力权重系数分析了不同时刻状态特征对算法决策的影响,提升了算法的透明度和可解释性;最后,与主流DRL算法以及传统导航算法进行了仿真与实机对比实验,仿真实验表明所提的Attention-VO-SAC算法具有最快的收敛速度,在所有测试场景中均取得了超过80% 的成功率,表现出了更好的稳定性;此外真实环境中的实验结果表明本文算法能够完成多移动机器人的自主导航任务。

     

    Abstract: For the problems of slow convergence speed, poor stability, and weak interpretability in existing end-to-end autonomous navigation algorithms for multiple mobile robots based on deep reinforcement learning (DRL), an end-to-end autonomous navigation strategy for multiple mobile robots utilizing attention-velocity obstacle-soft actor critic algorithm (Attention-VO-SAC) is proposed. Firstly, an attention module is integrated into the network structure of the DRL algorithm, which dynamically adjust state feature weights to focus on key task-related features. Secondly, a new reward function is designed to guide robots to avoid unsafe actions with integration of velocity obstacle method, through constraining the velocity direction of the mobile robot. Thirdly, the influence of state features at different decision-making moments on the algorithm decisions is analyzed through the visualization of attention weight coefficients, enhancing the transparency and interpretability of the proposed algorithm. Finally, comparative simulation and experiments are performed to validate the performances of the proposed algorithm. Simulation results indicate that the proposed Attention-VO-SAC algorithm can achieve fastest convergence with over 80% success rate in all scenarios, demonstrating better stability. Experimental results in real scenes show that the proposed algorithm can complete autonomous navigation tasks for multiple mobile robots.

     

/

返回文章
返回