基于多模态融合的工业安全智能感知系统构建与应用
Construction and Application of Industrial Safety Intelligent Perception System Based on Multi-modal Fusion
-
摘要: 工业安全监测作为智能制造的核心环节,其技术水平直接关系到生产安全与效率。传统单一模态感知系统存在可靠性低、误报率高等问题,难以满足复杂工业环境下的精准监测需求。基于此,提出一种基于多模态融合的工业安全智能感知系统,通过融合视觉、声学、热力学和振动4类模态数据,结合深度学习算法,构建具备高鲁棒性的工业安全监测体系。该系统采用多模态数据融合架构,实现数据级、特征级与决策级融合,并引入时空注意力图卷积网络(Attention Spatio-temporal Graph Convolutional Network,AST-GCN)实现异常诊断与故障预警。实验结果表明,该系统在复杂工业环境中的异常检测准确率达98.7%,系统响应时间在200ms以内,能够显著提升工业安全监测的可靠性与实时性,为智能制造提供关键技术支撑。Abstract: Industrial safety monitoring, as a core link in intelligent manufacturing, its technical level is directly related to production safety and efficiency. The traditional single-modal perception system has problems such as low reliability and high false alarm rate, making it difficult to meet the precise monitoring requirements in complex industrial environments. Based on this, an industrial safety intelligent perception system based on multi-modal fusion is proposed. By integrating four types of modal data: visual, acoustic, thermodynamic and vibration, and combining them with deep learning algorithms, an industrial safety monitoring system with high robustness is constructed. The system adopts a multi-model data fusion strategy to achieve the fusion of data level, feature level and decision level, and introduces the attention spatio-temporal graph convolutional network ( AST-GCN) realizes abnormal diagnosis and fault early warning. The experimental results show that the anomaly detection accuracy rate of the system in complex industrial environments reaches 98.7% , and the system response time is within 200ms. It can significantly improve the reliability and real-time performance of industrial safety monitoring and provide key technical support for intelligent manufacturing.
下载: