受限环境下基于视觉伺服的假肢手目标对准方法

Vision-servo-based Target Alignment for Prosthetic Hands in Constrained Conditions

  • 摘要: 为解决带腕关节的假肢手因主动自由度多、仅依赖肌电控制易致穿戴者疲劳并影响肌电解码与意图识别准确性的问题,提出利用视觉伺服技术替代肌电信号控制假肢手的腕关节。在用户穿戴假肢手执行操控任务时,先以视觉伺服法控制手腕关节实现特征对准,再融合肌电信号控制手指精准操控。针对有限算力和空间条件,设计融合视觉伺服的假肢手操控对准方法。其中图像处理模块对图像进行预处理和边缘检测,进而识别目标轮廓,并通过特征点匹配确定关键特征位置;特征对准模块基于处理结果运用伺服算法调整关节姿态实现精确对准,突破视觉与肌电信号跨模态融合技术瓶颈。最终,将视觉伺服算法零样本部署至假肢手开展综合实验。结果表明,该方法平均调整时间不超过1.81 s、操控成功率达70% 以上、识别准确率不低于90%,能一定程度替代肌电信号实现腕关节控制,减轻穿戴者负担,降低疲劳影响,有效解决仅依赖肌电控制的问题,具有良好应用前景。

     

    Abstract: The prosthetic hands with wrist joints have multiple active degrees of freedom (DOFs) and rely solely on electromyographic (EMG) control, which may cause wearer fatigue and affect the accuracy of EMG decoding and intention recognition. To address the problem, the visual servo technology is used to replace EMG signals for controlling the wrist joints of prosthetic hands. When users wear the prosthetic hand to perform manipulation tasks, the wrist joint is firstly controlled by the visual servo method to achieve feature alignment, followed by integrating EMG signals to enable precise finger manipulation. Given the limited computing power and space, a manipulation and alignment method for prosthetic hands integrating visual servo is designed. In the method, the image-processing module identifies the target contour via pre-processing and edge detection, and determines key feature positions through feature-point matching. The feature-alignment module adjusts the joint posture by a servo algorithm based on the processing results to achieve precise alignment, breaking through the technical bottleneck of cross-modal fusion of visual and EMG signals. Finally, the visual servo algorithm is zero-shot deployed on the prosthetic hand for comprehensive experiments. Results indicate that this method has an average adjustment time of no more than 1.81 s, a manipulation success rate of over 70%, and a recognition accuracy of no less than 90%. To some extent, it can replace EMG signals for wrist-joint control, relieve the wearer's burden, reduce fatigue effects, effectively solve the issues of relying solely on EMG control, and has promising application prospects.

     

/

返回文章
返回