基于知识蒸馏的NeRF SLAM模型轻量化研究

Research on Lightweight NeRF SLAM Models through Knowledge Distillation

  • 摘要: 神经辐射场(NeRF)在高质量3维场景重建方面具有巨大潜力,但其高计算复杂度、数据需求和存储限制使其在实际应用中面临诸多挑战。为了解决这一问题,提出了一种结合知识蒸馏的改进NeRF SLAM系统。通过引入知识蒸馏技术,以实现快速且高效的训练。实验结果表明,与原始NeRF模型相比,本文的系统在重建精度上使点云准确性提升18.21%、重建点云完整度提升14.86%,完成率提升14.09%,在重建效率上使得总FLOP(浮点运算次数)值下降了35.52%,在保持重建精度的同时,显著减少了训练时间和计算资源消耗。本研究不仅为NeRF SLAM系统的优化提供了新的思路,也为知识蒸馏在3维视觉领域的应用探索了新的途径。

     

    Abstract: NeRF(neural radiance field) has great potential in high-quality 3D scene reconstruction. However, its high computational complexity, data requirements, and storage limitations pose numerous challenges in practical applications. To tackle this issue, an improved NeRF-based SLAM(simultaneous localization and mapping) system incorporating knowledge distillation is proposed to achieve rapid and efficient training. The experimental results show that the proposed system improves the point cloud accuracy by 18.21%, the point cloud completeness by 14.86%, and the completion rate by 14.09%in terms of reconstruction accuracy, compared with the original NeRF model. In terms of reconstruction efficiency, it reduces the total FLOPs(floating point operations) by 35.52%. While maintaining the reconstruction accuracy, it significantly reduces the training time and computational resource consumption. This research not only offers new insights for optimizing NeRF SLAM systems, but also opens new paths for the application of knowledge distillation to the 3D vision domain.

     

/

返回文章
返回