机器人透明物体深度感知技术研究现状与发展趋势

Research Status and Development Trends of Depth Perception Technologies for Transparent Objects in Robotic Applications

  • 摘要: 准确的环境感知是机器人执行操作任务的基础。当前, 机器人通常利用视觉传感器(如红外相机、激光雷达或双目相机等)获取环境的深度信息。然而, 透明物体具有非朗伯体特性, 上述相机的结构光在其表面容易发生镜面反射或折射, 导致部分光线无法返回或返回错误信号(对应非真实表面), 从而造成深度感知信息的缺失与误差, 最终导致机器人操作失败。为了解决上述难题, 从透明物体深度感知硬件、数据集、方法、评估指标4个方面综述机器人透明物体深度感知技术研究现状与发展趋势。分析可知, 基于机器人传感器获取的多模态信息能够准确预测透明物体深度, 提升机器人感知与操作精度, 对于医院、工厂、化学实验室等复杂场景中的机器人可靠部署意义重大, 有助于推动具身智能机器人的发展与应用。

     

    Abstract: Accurate environmental perception is the foundation for robots to perform operational tasks. Currently, robots typically utilize depth cameras (such as infrared cameras, lidars or binocular vision systems) to obtain depth information about the environment. However, transparent objects possess non-lambertian properties. The structured light of depth cameras is prone to specular reflection and refraction on their surfaces, resulting in some light being unable to return or returning incorrect signals (corresponding to non-real surfaces), thereby causing the loss and error of depth perception and ultimately leading to the failure of robot operation. To address the aforementioned challenges, this paper reviews the current research status and development trends of robot depth perception technology for transparent objects from four aspects:hardware, datasets, methods, and evaluation indicators. Research shows that the multimodal information obtained by robot sensors can accurately predict the depth of transparent areas, improve the perception and operation accuracy of robots, which is of great significance for the reliable deployment of robots in complex scenarios such as hospitals, factories, and chemical laboratories, and is conducive to promoting the development and application of intelligent robots with bodies.

     

/

返回文章
返回