基于推抓技能协同的家庭复杂场景下的物品抓取方法

An Object Grasping Method in Complex Household Scenes Based on Pushing and Grasping Skills Collaboration

  • 摘要: 针对家庭复杂场景下物品的抓取任务,提出了一种基于推抓技能协同的抓取方法。首先,将复杂环境下的抓取任务建模为马尔可夫决策过程,给出状态、动作等变量的定义,并设计推抓技能置信度评估网络(PGCE-Net),对当前场景需采取的抓取和推动动作以及推动距离进行置信度评估,实现推抓技能协同。其次,受人类完成混乱物品抓取任务的启发,设计混乱度评估网络(CE-Net)推断当前场景的混乱度等级,并对机器人的动作进行优化调整,从而有效提高抓取成功率。最后,根据推动和抓取动作的特点设计了合理的奖励函数,实现了推抓技能的增强。通过仿真和真实环境下的机器人抓取实验,验证了所提方法的可行性和有效性。

     

    Abstract: For the object grasping task in complex household scenes, a grasping method with pushing and grasping skills collaboration is proposed. Firstly, the grasping task in complex environments is formulated as a Markov decision process,with explicit definitions for variables such as state and action. Then, the pushing-grasping skill confidence evaluation network(PGCE-Net) is designed to evaluate the confidence of the grasping and pushing actions and the pushing distance in the current scene, achieving the collaboration of pushing and grasping skills. Inspired by human strategies for grasping objects in clutter environments, a clutter level evaluation network(CE-Net) is designed to infer the level of clutter in the current scene to optimize and adjust the robot actions, which effectively improves the grasping success rate. Finally, a suitable reward function is designed based on the characteristics of pushing and grasping actions, which enhances the pushing and grasping skills. The feasibility and effectiveness of the proposed method are validated through robotic grasping experiments in simulation and real environment.

     

/

返回文章
返回