面向小样本立体包装的分布式视觉感知与知识驱动决策融合检测方法

Distributed Visual Perception and Knowledge-driven Decision Fusion Decision Method for Small-sample 3D Packaging

  • 摘要: 为解决工业产线场景下包装外观缺陷样本极度稀缺及单一视角检测盲区难题,提出一种面向小样本立体包装的分布式视觉感知与知识驱动决策融合检测方法。首先,为解决小样本数据集训练过拟合问题,提出一种基于物理约束的动态在线数据增强策略,通过几何扰动、光照扰动等方式,在不增加标注成本的前提下大幅提升模型泛化能力;其次,针对多机位数据采集异步导致的特征对齐困难问题,设计一种分布式视觉感知-知识驱动决策协同架构,利用独立部署的轻量级YOLOv8n模型提取局部特征,并结合工艺先验知识构建缺陷-视角可见性图谱,实现多视角信息的逻辑互补;最后,以某典型软盒包装产品为研究对象开展实验验证。结果表明,该方法在仅有少量原始样本的条件下,能够有效克服侧边翘起、折叠歪斜等隐蔽缺陷漏检问题,mAP50达94.9%,具有低成本、易部署的工程应用价值。

     

    Abstract: To address the severe scarcity of appearance defect samples in industrial high-speed packaging lines and the blind spots in single-view detection of three-dimensional packaging, a distributed visual perception and knowledge-driven decision fusion detection method for small-sample 3D packaging is proposed. Firstly, to solve the overfitting problem in training with small sample datasets, a dynamic online data augmentation strategy based on physical constraints is proposed. Through geometric perturbation and illumination perturbation, the generalization ability of the model is significantly improved without increasing the annotation cost. Secondly, to address the difficulty in feature alignment caused by asynchronous data collection from multiple positions, a distributed visual perception and knowledge-driven decision-making collaborative architecture is designed. Independent lightweight YOLOv8n detection models are used to extract local features, and a defect-view visibility map constructed based on process prior knowledge is combined with the knowledge-driven multi-view decision fusion strategy to achieve logical complementation of multi-view information. Finally, experiments are conducted using a typical soft box packaging product as the research object. The results show that the method effectively overcomes the problem of missed detection of concealed defects such as side warping and folding skewing with only a small number of original samples. The mAP50 reaches 94.9%, and it has the engineering application value of low cost and easy deployment.

     

/

返回文章
返回