基于开放词汇目标检测的零样本目标导航方法

Zero-shot Object Navigation Method Based on Open-vocabulary Object Detection

  • 摘要: 针对现有零样本导航方法中大语言模型计算复杂度较高、难以满足实时性要求,以及基于物体关系的建模方法易受环境变化影响、泛化性差的问题,提出一种基于开放词汇目标检测的零样本目标导航方法。针对开放世界的导航场景对实时性与目标识别精度的双重要求,构建一种面向导航任务的目标检测优化策略,在开放词汇目标检测模型的基础上引入空间约束与置信度融合机制,实现低延迟条件下的可靠目标检测。为增强智能体对目标语义与环境空间的感知能力,设计了一种带有反馈机制的目标导向语义提取网络,通过交叉注意力机制提取目标语义与环境特征之间的关联信息,同时使智能体主动感知当前状态并进行及时调整,从而避免无效探索。实验结果表明,与TDANet法相比,本文方法在18/4与14/8两组类别设定中寻找未知物体的准确率分别提升19.5% 和22.0%,寻找已知物体的准确率分别提升6.6% 和6.3%。此外,真实环境中的实验验证进一步证明了本文方法在不同环境下的适应性及面对未知目标时的泛化能力。

     

    Abstract: To address the issues in existing zero-shot object navigation methods, where large language models suffer from high computational complexity and fail to meet real-time requirements, and object-relation-based modeling methods are susceptible to environmental changes and exhibit poor generalization ability, a zero-shot object navigation method based on open-vocabulary object detection is proposed. To meet the dual demands of real-time performance and target recognition accuracy in open-world navigation scenarios, an object detection optimization strategy oriented to navigation tasks is constructed, where a spatial constraint and confidence fusion mechanism is introduced into the open-vocabulary object detection model to achieve reliable object detection under low latency. To enhance the agent perception for target semantics and environmental space, a target-oriented semantic extraction network with a feedback mechanism is designed. By using a cross-attention mechanism to extract the association information between target semantics and environmental features, the agent is enabled to actively perceive the current state and make timely adjustments, thereby avoiding ineffective exploration. Experimental results show that, compared with TDANet, the proposed method improves the accuracy of unknown object search by 19.5% and 22.0% under the 18/4 and 14/8 category splits, respectively, and improves the accuracy of known object search by 6.6% and 6.3%, respectively. In addition, experimental validation in real-world environments further demonstrates the adaptability of the proposed method to different environments and its generalization ability when facing unknown targets.

     

/

返回文章
返回