CN115855953A - A three-dimensional defect detection method and device for an engine cylinder head - Google Patents

A three-dimensional defect detection method and device for an engine cylinder head Download PDF

Info

Publication number
CN115855953A
CN115855953A CN202211509429.4A CN202211509429A CN115855953A CN 115855953 A CN115855953 A CN 115855953A CN 202211509429 A CN202211509429 A CN 202211509429A CN 115855953 A CN115855953 A CN 115855953A
Authority
CN
China
Prior art keywords
engine cylinder
dimensional
industrial robot
cylinder cover
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211509429.4A
Other languages
Chinese (zh)
Inventor
姜振海
王超
孙勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Qiuchen Photoelectric Technology Co ltd
Original Assignee
Nanjing Qiuchen Photoelectric Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Qiuchen Photoelectric Technology Co ltd filed Critical Nanjing Qiuchen Photoelectric Technology Co ltd
Priority to CN202211509429.4A priority Critical patent/CN115855953A/en
Publication of CN115855953A publication Critical patent/CN115855953A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention provides a three-dimensional defect detection method and a three-dimensional defect detection device for an engine cylinder cover, which can automatically detect surface defects and an internal three-dimensional structure of the engine cylinder cover and quickly and efficiently switch six surfaces of the engine cylinder cover. The method comprises the following steps: the method comprises the following steps: grabbing an engine cylinder cover to be detected by a first industrial robot and sending the engine cylinder cover to a specified detection area; step two: the method comprises the following steps that a first industrial robot is matched with a second industrial robot, and a three-dimensional camera on the second industrial robot is used for obtaining three-dimensional images of six surfaces 1,2, 3, 4, A and B on an engine cylinder to be detected; step three: carrying out point cloud registration on the obtained three-dimensional image of the engine cylinder cover; step four: carrying out three-dimensional modeling on the detected point cloud registration data and comparing the point cloud registration data with a three-dimensional model of a standard engine cylinder cover in shape difference; step five: and comparing the compared shape difference value with a set numerical value.

Description

一种发动机缸盖的三维缺陷检测方法及其装置A three-dimensional defect detection method and device for an engine cylinder head

技术领域technical field

本发明涉及发动机缸盖检测技术领域,特别是涉及一种发动机缸盖的三维缺陷检测方法及其装置。The invention relates to the technical field of engine cylinder head detection, in particular to a three-dimensional defect detection method and device for an engine cylinder head.

背景技术Background technique

发动机缸体缸盖的铸件是发动机生产中难度最大,而且最重要的一环,其质量队发动机的功率、油耗等性能起到决定性的作用。可以说,缸体缸盖的铸造技术体现了发动机的制造能力,汽车缸体缸盖铸件铸造成套装备及其制造水平是影响发动机性能的重要因素之一。目前行业内的检测方法主要以人工目视检测为主,检测主要依赖于人眼的识别能力、经验、责任心和细心程度,检测可靠性与人息息相关。在实际生产过程中,由于生产线速度较快人易疲劳,且需要对整个铸件的各个面进行检测,常常有漏检情况的发生。The casting of engine block and cylinder head is the most difficult and most important part in engine production, and its quality plays a decisive role in the performance of engine power and fuel consumption. It can be said that the casting technology of the cylinder block and cylinder head reflects the manufacturing capacity of the engine, and the complete set of casting equipment for the cylinder block and cylinder head of the automobile and its manufacturing level are one of the important factors affecting the performance of the engine. At present, the detection method in the industry is mainly based on manual visual detection. The detection mainly depends on the recognition ability, experience, responsibility and carefulness of the human eye. The detection reliability is closely related to people. In the actual production process, due to the high speed of the production line, people are prone to fatigue, and it is necessary to inspect all sides of the entire casting, so missed inspections often occur.

在现有的专利数据库中有一种公开号为:CN216433934U的一种发动机缸盖视觉检测设备,此种设备利用三自由度运动平台、仿形力矩夹手以及传动平台构成了传动送检系统,使发动机缸盖可以多角度展现在光学镜头的拍照范围内;传动送检系统与光学检测系统相配合,使发动机缸盖的检测效率大幅度提升,光学相机代替肉眼检查,进一步确保了检测的精确度;该设备可控性强、经济成本大幅度降低,实现了自动化智能检测的目的。但是此类型的缺陷检测设备与方法只能采取到二维平面的发动机缸盖图像,无法做到对发动机缸盖的内部三维结构检测,而且现有的发动机缸盖缺陷检测装置主要是采用传送带进行运送,无法快速的切换不同的面进行检测,效率低。In the existing patent database, there is a kind of engine cylinder head visual detection equipment whose publication number is CN216433934U. This kind of equipment utilizes a three-degree-of-freedom motion platform, a profiling torque gripper and a transmission platform to form a transmission inspection system. The engine cylinder head can be displayed in the range of the optical lens from multiple angles; the transmission inspection system cooperates with the optical detection system to greatly improve the detection efficiency of the engine cylinder head, and the optical camera replaces the naked eye inspection to further ensure the accuracy of detection ; The device has strong controllability, greatly reduces the economic cost, and realizes the purpose of automatic intelligent detection. However, this type of defect detection equipment and method can only take a two-dimensional plane image of the engine cylinder head, and cannot detect the internal three-dimensional structure of the engine cylinder head, and the existing engine cylinder head defect detection device mainly uses a conveyor belt. Transportation, it is impossible to quickly switch between different surfaces for detection, and the efficiency is low.

发明内容Contents of the invention

对此,本发明旨在于提供一种发动机缸盖的三维缺陷检测方法及其装置,能够自动检测发动机缸盖的表面缺陷与内部三维结构,并且快速高效率切换发动机缸盖的六个面。In this regard, the present invention aims to provide a three-dimensional defect detection method and device for an engine cylinder head, which can automatically detect surface defects and internal three-dimensional structures of the engine cylinder head, and quickly and efficiently switch six faces of the engine cylinder head.

为实现上述目的,本发明提供如下技术方案:To achieve the above object, the present invention provides the following technical solutions:

一种发动机缸盖的三维缺陷检测方法,包括以下步骤:A three-dimensional defect detection method of an engine cylinder head, comprising the following steps:

步骤一:通过一号工业机器人抓取待检测发动机缸盖送到指定检测区域;Step 1: Use No. 1 industrial robot to grab the cylinder head of the engine to be inspected and send it to the designated inspection area;

步骤二:通过一号工业机器人与二号工业机器人配合,使用二号工业机器人上的三维相机获取待检测发动机缸上1、2、3、4、A、B六个面的三维图像;Step 2: Cooperate with the No. 1 industrial robot and the No. 2 industrial robot, and use the 3D camera on the No. 2 industrial robot to obtain three-dimensional images of six surfaces 1, 2, 3, 4, A, and B on the engine cylinder to be detected;

步骤三:将获取到的发动机缸盖的三维图像进行点云配准;Step 3: Perform point cloud registration on the obtained 3D image of the engine cylinder head;

步骤四:将检测到的点云配准数据进行三维建模并与标准发动机缸盖的三维模型进行形状差值的比对;Step 4: Perform 3D modeling of the detected point cloud registration data and compare the shape difference with the 3D model of the standard engine cylinder head;

步骤五:将对比出来的形状差值与设定的数值进行对比,如果大于设定数值范围或小于设定数值范围则判定为缺陷位置。Step 5: Compare the compared shape difference with the set value, if it is greater than the set value range or less than the set value range, it will be judged as the defect position.

与现有技术相比,本发明的有益效果是:Compared with prior art, the beneficial effect of the present invention is:

通过上述检测方法,实现了仅通过每个面单次拍照数据即可同时检测出发动机缸盖的表面二维图像缺陷与其三维内部结构的难题,并且实现自动化,准确性高,极大的极高了检测效率,节省了人工。Through the above detection method, the problem of the two-dimensional image defect on the surface of the engine cylinder head and its three-dimensional internal structure can be detected at the same time only by a single photo data of each surface, and it is automated, with high accuracy and extremely high Improve detection efficiency and save labor.

为实现上述目的,本发明还提供如下技术方案:To achieve the above object, the present invention also provides the following technical solutions:

一种发动机缸盖的三维缺陷检测的装置,包括光源、一号工业机器人、二号工业机器人、识别摄像头、三维相机和主控模块,光源固定在检测区域的顶部,识别摄像头安装在一号机器人上,二号工业机器人上固定有三维相机,所述光源、一号工业机器人、二号工业机器人、识别摄像头、三维相机分别与主控模块电控连接。A device for three-dimensional defect detection of an engine cylinder head, including a light source, No. 1 industrial robot, No. 2 industrial robot, a recognition camera, a 3D camera and a main control module. The light source is fixed on the top of the detection area, and the recognition camera is installed on the No. 1 robot Above, the No. 2 industrial robot is fixed with a 3D camera, and the light source, No. 1 industrial robot, No. 2 industrial robot, identification camera, and 3D camera are electrically connected to the main control module respectively.

优选的,在步骤一前先通过一号工业机器人上的识别摄像头对待检测发动机缸盖的B面进行抓取点进行识别。Preferably, before step 1, the identification camera on the No. 1 industrial robot is used to identify the grasping point of the B-side of the cylinder head of the engine to be detected.

与现有技术相比,本发明的有益效果是:Compared with prior art, the beneficial effect of the present invention is:

通过一号工业机器人和二号工业机器人在位置上的不断切换,使各功能部件有机结合,从而实现对发动机缸盖的抓取和检测时六个面多角度切换,识别摄像头能够对发动机缸盖对抓取点高精度识别,也能够解决在光源光照角度不同的环境下对抓取点识别低的问题,精度高,而通过三维相机获取到的三维图像则存入到主控模块内进行储存和处理,最终通过计算检测到的点云配准数据进行三维建模并与标准发动机缸盖的三维模型进行形状差值的比对,从而检测和定位发动机缸盖的缺陷位置。Through the continuous switching of the positions of the No. 1 industrial robot and the No. 2 industrial robot, the organic combination of various functional components is realized, so as to realize the six-sided multi-angle switching when grasping and detecting the engine cylinder head, and the recognition camera can detect the engine cylinder head. The high-precision recognition of the grabbing point can also solve the problem of low recognition of the grabbing point in an environment with different light source angles, with high precision, and the 3D image obtained by the 3D camera is stored in the main control module for storage And processing, finally by calculating the detected point cloud registration data for 3D modeling and comparing the shape difference with the 3D model of the standard engine cylinder head, so as to detect and locate the defect position of the engine cylinder head.

附图说明Description of drawings

图1为本发明一种发动机缸盖的三维缺陷检测方法及其装置中发动机缸盖的抓取点的定位流程图。Fig. 1 is a flow chart of the positioning of the grabbing point of the engine cylinder head in a three-dimensional defect detection method of the engine cylinder head and its device according to the present invention.

图2为本发明中对发动机缸盖六个面进行三维图像获取的流程图。。Fig. 2 is a flow chart of acquiring three-dimensional images of six faces of an engine cylinder head in the present invention. .

图3为本发明中三维数据进行缺陷检测时的流程图。Fig. 3 is a flow chart of defect detection of three-dimensional data in the present invention.

图4为以K-means得到的质心为初始圆心沿半径方向进行径向扫描得到沿着半径方向的投影图。Fig. 4 is a projection diagram along the radial direction obtained by radially scanning along the radial direction with the centroid obtained by K-means as the initial center.

具体实施方式Detailed ways

下面对本发明作进一步详细的说明:The present invention is described in further detail below:

具体参看图1至图4:Refer to Figure 1 to Figure 4 for details:

一种发动机缸盖的三维缺陷检测方法,包括以下步骤:A three-dimensional defect detection method of an engine cylinder head, comprising the following steps:

步骤一:通过一号工业机器人抓取待检测发动机缸盖送到指定检测区域;Step 1: Use No. 1 industrial robot to grab the cylinder head of the engine to be inspected and send it to the designated inspection area;

步骤二:通过一号工业机器人与二号工业机器人配合,使用二号工业机器人上的三维相机获取待检测发动机缸上1、2、3、4、A、B六个面的三维图像;Step 2: Cooperate with the No. 1 industrial robot and the No. 2 industrial robot, and use the 3D camera on the No. 2 industrial robot to obtain three-dimensional images of six surfaces 1, 2, 3, 4, A, and B on the engine cylinder to be detected;

步骤三:将获取到的发动机缸盖的三维图像进行点云配准;Step 3: Perform point cloud registration on the obtained 3D image of the engine cylinder head;

步骤四:将检测到的点云配准数据进行三维建模并与标准发动机缸盖的三维模型进行形状差值的比对;Step 4: Perform 3D modeling of the detected point cloud registration data and compare the shape difference with the 3D model of the standard engine cylinder head;

步骤五:将对比出来的形状差值与设定的数值进行对比,如果大于设定数值范围或小于设定数值范围则判定为缺陷位置。通过上述检测方法,实现了仅通过每个面单次拍照数据即可同时检测出发动机缸盖的表面二维图像缺陷与其三维内部结构的难题,并且实现自动化,准确性高,极大的极高了检测效率,节省了人工。Step 5: Compare the compared shape difference with the set value, if it is greater than the set value range or less than the set value range, it will be judged as the defect position. Through the above detection method, the problem of the two-dimensional image defect on the surface of the engine cylinder head and its three-dimensional internal structure can be detected at the same time only by a single photo data of each surface, and it is automated, with high accuracy and extremely high Improve detection efficiency and save labor.

本实施例中,发动机缸盖的四个侧面分别为1、2、3、4,正面为A面,背面为B面。In this embodiment, the four sides of the engine cylinder head are respectively 1, 2, 3, and 4, the front side is A side, and the back side is B side.

本实施例中,在步骤一前先通过一号工业机器人上的识别摄像头对待检测发动机缸盖的B面进行抓取点进行识别,这样,能够保证每个待检测发动机缸盖抓取位置的一致性,从而保证检测精度。In this embodiment, before step 1, the identification camera on the No. 1 industrial robot is used to identify the grasping point on the B side of the cylinder head of the engine to be detected, so that the consistency of the grasping position of each cylinder head of the engine to be detected can be guaranteed. , so as to ensure the detection accuracy.

在步骤一前,通过识别摄像头对待检测发动机缸盖的B面进行抓取点识别,使用卷积神经网络与K-means算法结合的方式来精确定位安装抓取点,首先使用卷积神经网络对安装抓取点的圆心区域粗略定位,因为精度不够,需要在粗定位区域中精准抓取圆孔位置;第一步采用K-means聚类的方法得到安装抓取点孔圆的轮廓,和其质心,用于初始化圆心的大概位置。初始中心点选择为卷积神经网络输出的安装抓取点孔圆边界框圆形区域ROI(Intersection over Union)的中心点,K-means算法步骤如下所示:Before step 1, identify the grabbing point on the B side of the engine cylinder head to be detected by the recognition camera, and use the combination of convolutional neural network and K-means algorithm to accurately locate the grabbing point for installation. First, use the convolutional neural network to The center area of the installation grab point is roughly positioned, because the accuracy is not enough, it is necessary to accurately grab the position of the round hole in the rough positioning area; the first step is to use the K-means clustering method to obtain the contour of the hole circle of the installation grab point, and other Centroid, used to initialize the approximate location of the center of the circle. The initial center point is selected as the center point of the ROI (Intersection over Union) of the installation capture point hole circle bounding box output by the convolutional neural network. The steps of the K-means algorithm are as follows:

c(i)=argmin||x(i)j||c (i) = argmin||x (i) - μ j ||

Figure SMS_1
Figure SMS_1

1)选择初始化的2个样本作为初始聚类中心为1,2,…,。1) Select the initialized 2 samples as the initial cluster centers as 1, 2,...,.

2)针对数据集中每个样本计算它到2个聚类中心的距离并将其分到距离最小的聚类中心所对应的类中;2) For each sample in the data set, calculate its distance to two cluster centers and classify it into the class corresponding to the cluster center with the smallest distance;

3)针对每个类别,重新计算它的聚类中心即属于该类的所有样本的质心);3) For each category, recalculate its cluster center (that is, the centroid of all samples belonging to this category);

4)重复上面23两步操作,直到达到某个中止条件(迭代次数、最小误差变化等)。4) Repeat the above two steps of 23 until a certain termination condition (number of iterations, minimum error change, etc.) is reached.

第二步本申请设计了一种通过扫描寻找边缘点的方法。以K-means得到的质心为初始圆心,沿半径方向进行径向扫描得到沿着半径方向的投影图,可以看到明显的边界点如图4所示:The second step This application designs a method for finding edge points by scanning. Take the center of mass obtained by K-means as the initial center of the circle, and scan radially along the radial direction to obtain a projection map along the radial direction. You can see the obvious boundary points as shown in Figure 4:

为了提高定位精度,对投影图求梯度:In order to improve the positioning accuracy, the gradient of the projection map is calculated:

Figure SMS_2
Figure SMS_2

Figure SMS_3
Figure SMS_3

计算得出Y方向的梯度;对于二维离散的Y方向导数,可由下列的卷积核与圆图像卷积得到。最后选取梯度最大的点为边界点。Calculate the gradient in the Y direction; for the two-dimensional discrete Y direction derivative, it can be obtained by convolving the following convolution kernel with the circle image. Finally, the point with the largest gradient is selected as the boundary point.

Figure SMS_4
Figure SMS_4

在得到一系列的边缘点的基础上使用最小二乘法进行精准的圆检测,一号机器人根据安装抓取点的精确位置进行发动机缸盖的抓取。On the basis of obtaining a series of edge points, the least square method is used for precise circle detection, and the No. 1 robot grabs the engine cylinder head according to the precise position of the installation grab point.

为实现上述目的,本发明还提供如种发动机缸盖的三维缺陷检测的装置,包括光源、一号工业机器人、二号工业机器人、识别摄像头、三维相机和主控模块,光源固定在检测区域的顶部,识别摄像头安装在一号机器人上,二号工业机器人上固定有三维相机,所述光源、一号工业机器人、二号工业机器人、识别摄像头、三维相机分别与主控模块电控连接。通过一号工业机器人和二号工业机器人在位置上的不断切换,使各功能部件有机结合,从而实现对发动机缸盖的抓取和检测时六个面多角度切换,识别摄像头能够对发动机缸盖对抓取点高精度识别,也能够解决在光源光照角度不同的环境下对抓取点识别低的问题,精度高,而通过三维相机获取到的三维图像则存入到主控模块内进行储存和处理,最终通过计算检测到的点云配准数据进行三维建模并与标准发动机缸盖的三维模型进行形状差值的比对,从而检测和定位发动机缸盖的缺陷位置。In order to achieve the above object, the present invention also provides a device for detecting three-dimensional defects of an engine cylinder head, including a light source, a No. 1 industrial robot, a No. 2 industrial robot, a recognition camera, a three-dimensional camera and a main control module. The light source is fixed on the detection area. On the top, the identification camera is installed on the No. 1 robot, and the No. 2 industrial robot is fixed with a 3D camera. The light source, No. 1 industrial robot, No. 2 industrial robot, identification camera, and 3D camera are electrically connected to the main control module respectively. Through the continuous switching of the positions of the No. 1 industrial robot and the No. 2 industrial robot, the organic combination of various functional components is realized, so as to realize the six-sided multi-angle switching when grasping and detecting the engine cylinder head, and the recognition camera can detect the engine cylinder head. The high-precision recognition of the grabbing point can also solve the problem of low recognition of the grabbing point in an environment with different light source angles, with high precision, and the 3D image obtained by the 3D camera is stored in the main control module for storage And processing, finally by calculating the detected point cloud registration data for 3D modeling and comparing the shape difference with the 3D model of the standard engine cylinder head, so as to detect and locate the defect position of the engine cylinder head.

本装置的具体操作流程如下:The specific operation process of this device is as follows:

一号机器人抓取发动机缸盖B面后,将待检测的发动机缸盖运送到指定检测区域,转动机器人TCP(Tool Center Point)与关节轴的角度,使得发动机缸盖的1面与水平平行,设定好的光源能够完全照射至缸盖的1面,二号机器人携带三维相机到达适当高度,三维相机运行轨迹也与水平面平行,三维相机的LED光源的中轴线与1面垂直且三维相机的视野可以完全覆盖发动机缸盖的1面,对三维图像进行获取并转存到主控模块;在获取到1面全部三维图像后,一号机器人转动TCP角度90°,使发动机缸盖的2面与水平平行。设定好的光源能够完全照射至缸盖的2面。二号机器人携带三维相机到达适当高度,相机运行轨迹也与水平面平行三维相机的LED光源的中轴线与2面垂直且三维相机的视野可以完全覆盖发动机缸盖的2面,对三维图像进行获取并转存到主控模块;在获取到2面全部三维图像后,一号机器人转动TCP角度90°,使发动机缸盖的3面与水平平行。设定好的光源能够完全照射至缸盖的3面。二号机器人携带三维相机到达适当高度,相机运行轨迹也与水平面平行三维相机的LED光源的中轴线与3面垂直且三维相机的视野可以完全覆盖发动机缸盖的3面,对三维图像进行获取并转存到主控模块;在获取到3面全部三维图像后,一号机器人转动TCP角度90°,使发动机缸盖的4面与水平平行。设定好的光源能够完全照射至缸盖的4面。二号机器人携带三维相机到达适当高度,相机运行轨迹也与水平面平行三维相机的LED光源的中轴线与4面垂直且三维相机的视野可以完全覆盖发动机缸盖的4面,对三维图像进行获取并转存到主控模块;此时已经采集完发动机缸盖的四个全部侧面;二号机器人转动TCP以及关节轴使三维传感器的运行轨迹与A面平行,三维传感器LED光源的中轴线与A面垂直,且三维相机的视野可以完全覆盖发动机缸盖的A面对三维图像进行获取并转存到主控模块;一号机器人将发动机缸盖放置指定区域中,且发动机缸盖B面朝基座坐标系Z轴正方向,设定好的光源能够完全照射至缸盖的B面。二号机器人携带三维相机到达适当高度,三维相机运行轨迹也与水平面平行,三维相机的LED光源的中轴线与B面垂直且三维相机的视野可以完全覆盖发动机缸盖的B面,对三维图像进行获取并转存到主控模块。After the No. 1 robot grabs the B side of the engine cylinder head, it transports the engine cylinder head to be inspected to the designated inspection area, and rotates the angle between the TCP (Tool Center Point) of the robot and the joint axis so that the first surface of the engine cylinder head is parallel to the horizontal. The set light source can fully illuminate the first surface of the cylinder head. The No. 2 robot carries the 3D camera to an appropriate height, and the running track of the 3D camera is also parallel to the horizontal plane. The field of view can completely cover one side of the engine cylinder head, and the 3D image is acquired and transferred to the main control module; after acquiring all the 3D images of one side, the No. parallel to the level. The set light source can fully illuminate the two sides of the cylinder head. The No. 2 robot carries the 3D camera to an appropriate height, and the running track of the camera is also parallel to the horizontal plane. Transfer to the main control module; after obtaining all the 3D images of the two sides, the No. 1 robot rotates the TCP angle by 90°, so that the three sides of the engine cylinder head are parallel to the horizontal. The set light source can fully illuminate the 3 sides of the cylinder head. The No. 2 robot carries the 3D camera to an appropriate height, and the running track of the camera is also parallel to the horizontal plane. Transfer to the main control module; after obtaining all three-dimensional images of the three sides, the No. 1 robot rotates the TCP angle by 90°, so that the four sides of the engine cylinder head are parallel to the horizontal. The set light source can fully illuminate the 4 sides of the cylinder head. The No. 2 robot carries the 3D camera to an appropriate height, and the running track of the camera is also parallel to the horizontal plane. Transfer to the main control module; at this time, all four sides of the engine cylinder head have been collected; the No. 2 robot rotates the TCP and the joint axis so that the running track of the 3D sensor is parallel to the A surface, and the central axis of the LED light source of the 3D sensor is parallel to the A surface. Vertical, and the field of view of the 3D camera can completely cover the A surface of the engine cylinder head to acquire the 3D image and transfer it to the main control module; the No. 1 robot places the engine cylinder head in the designated area, and the engine cylinder head B faces the base In the positive direction of the Z axis of the coordinate system, the set light source can fully illuminate the B surface of the cylinder head. The No. 2 robot carries the 3D camera to an appropriate height, and the running track of the 3D camera is also parallel to the horizontal plane. The central axis of the LED light source of the 3D camera is perpendicular to the B surface, and the field of view of the 3D camera can completely cover the B surface of the engine cylinder head. Get and dump to the main control module.

主控模块接收到三维传感器发送的点云X、Y、Z坐标的数据,通过C#环境下的软件将接收到的三维数组转化成图像,最终输出对应的亮度图与高度图,首先对生成的亮度图进行图像的拼接,本申请采用SURF算法进行拼接,对获取的亮度图进行特征点的提取与匹配,在得到两幅待拼接图的匹配点集后进行图像的配准,即将两张图像转换为同一坐标下,使用单映性矩阵函数来求得变换矩阵,实现图像的配准;此时在图像的拼接处并不自然,因为光照色泽的不统一两图的交界处过渡需要进行加权融合,即将图像的重叠区域的像素按一定的权值相加合成新的图像。重复此步骤可以将发动机缸盖的每一整面凭借成完整的图片,通过训练好的神经网络对发动机缸盖的亮度图进行缺陷检测。The main control module receives the X, Y, and Z coordinate data of the point cloud sent by the 3D sensor, converts the received 3D array into an image through the software in the C# environment, and finally outputs the corresponding brightness map and height map. The luminance images are stitched together. This application adopts the SURF algorithm for stitching, extracts and matches the feature points of the acquired luminance images, and performs image registration after obtaining the matching point sets of the two images to be stitched, that is, the two images Convert to the same coordinates, use the homography matrix function to obtain the transformation matrix, and realize the registration of the image; at this time, the splicing of the image is not natural, because the transition between the two images needs to be weighted due to the inconsistency of the illumination color Fusion is to add the pixels in the overlapping area of the image according to a certain weight to synthesize a new image. Repeating this step can make each entire surface of the engine cylinder head into a complete picture, and perform defect detection on the brightness map of the engine cylinder head through the trained neural network.

发动机缸盖的三维结构缺陷检测需要进行点云的配准;通过三维相机的软件模拟器将数据类型文件转换成二进制文本文件,将二进制文本文件通过开源软件转换成ASSIC码的点云文件。因为点云数据量比较大,影响到了点云数据的处理效率,同时受外部环境的干扰,会采集到大量的噪声点,因此需要对点云数据进行滤波处理。本申请中采用VoxelGrid滤波器对点云进行下采样,通过输入的点云数据创建一个三维体素栅格,容纳后每个体素内用体素中所有点的重心来近似显示体素中其他点,这样该体素内所有点都用一个重心点最终表示;The three-dimensional structural defect detection of the engine cylinder head requires point cloud registration; the data type file is converted into a binary text file through the software simulator of the three-dimensional camera, and the binary text file is converted into an ASSIC code point cloud file through open source software. Because the amount of point cloud data is relatively large, it affects the processing efficiency of point cloud data, and at the same time, due to the interference of the external environment, a large number of noise points will be collected, so the point cloud data needs to be filtered. In this application, the VoxelGrid filter is used to down-sample the point cloud, and a three-dimensional voxel grid is created through the input point cloud data, and the center of gravity of all points in each voxel is used to approximate other points in the voxel after being accommodated. , so that all points in the voxel are finally represented by a barycenter point;

并且在进行配准之前首先使用标准的发动机缸盖通过三维传感器扫描后建立起标准3D模型;在获取发动机缸盖的三维数据时一定会存在位置的误差,其测量坐标系会随着位置的变化而每次有细微的变化。本申请首先使用迭代最近点(iterative closetpoint,ICP)算法进行点云精配准,每次选择两点间的距离最小值作为对应点,根据每次得到的对应关系计算出旋转变换矩阵得到新的点云位置,以此迭代直到点云间的距离误差达到最小。将生产的或需要修复的发动机缸盖与标准的三维模型配准后进行比较,计算模具零件与标准三维模型的形状差值,从而来检测和定位模具的缺陷位置。And before the registration, first use the standard engine cylinder head to scan through the three-dimensional sensor to establish a standard 3D model; when obtaining the three-dimensional data of the engine cylinder head, there must be a position error, and its measurement coordinate system will change with the position And every time there are subtle changes. This application firstly uses the iterative closest point (ICP) algorithm for point cloud fine registration, selects the minimum distance between two points as the corresponding point each time, and calculates the rotation transformation matrix according to the corresponding relationship obtained each time to obtain a new The position of the point cloud is iterated until the distance error between the point clouds reaches the minimum. Compare the produced or repaired engine cylinder head with the standard 3D model after registration, and calculate the shape difference between the mold parts and the standard 3D model, so as to detect and locate the defect position of the mold.

本实施例中,本方法及装置可以推广到复杂结构的有多面检测需求的刚性物体检测中,不仅限于发动机缸盖。In this embodiment, the method and device can be extended to the detection of rigid objects with complex structures and multi-faceted detection requirements, not limited to engine cylinder heads.

本实施例中,机器人可选用同等功能的多轴机械手代替。In this embodiment, the robot can be replaced by a multi-axis manipulator with the same function.

尽管已经示出和描述了本发明的实施例,对于本领域的普通技术人员而言,可以理解在不脱离本发明的原理和精神的情况下可以对这些实施例进行多种变化、修改、替换和变型,本发明的范围由所附权利要求及其等同物限定。Although the embodiments of the present invention have been shown and described, those skilled in the art can understand that various changes, modifications and substitutions can be made to these embodiments without departing from the principle and spirit of the present invention. and modifications, the scope of the invention is defined by the appended claims and their equivalents.

Claims (3)

1. A three-dimensional defect detection method of an engine cylinder cover is characterized by comprising the following steps:
the method comprises the following steps: grabbing an engine cylinder cover to be detected by a first industrial robot and sending the engine cylinder cover to an appointed detection area;
step two: the method comprises the following steps that a first industrial robot is matched with a second industrial robot, and a three-dimensional camera on the second industrial robot is used for obtaining three-dimensional images of six surfaces 1,2, 3, 4, A and B on an engine cylinder to be detected;
step three: carrying out point cloud registration on the obtained three-dimensional image of the engine cylinder cover;
step four: carrying out three-dimensional modeling on the detected point cloud registration data and comparing the point cloud registration data with a three-dimensional model of a standard engine cylinder cover in shape difference;
step five: and comparing the compared shape difference value with a set value, and judging as the defect position if the shape difference value is larger than the set value range or smaller than the set value range.
2. The method for detecting the three-dimensional defects of the engine cylinder cover according to the claim 1, characterized in that before the step one, a recognition camera on a first industrial robot is used for recognizing a grabbing point of the B surface of the engine cylinder cover to be detected.
3. The utility model provides a device that three-dimensional defect of engine cylinder lid detected, its characterized in that, includes light source, industrial robot, no. two industrial robot, discernment camera, three-dimensional camera and host system, and the light source is fixed at the top of detection area, and the discernment camera is installed on the robot, is fixed with the three-dimensional camera on No. two industrial robot, light source, industrial robot, no. two industrial robot, discernment camera, three-dimensional camera are connected with host system is automatically controlled respectively.
CN202211509429.4A 2022-11-29 2022-11-29 A three-dimensional defect detection method and device for an engine cylinder head Pending CN115855953A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211509429.4A CN115855953A (en) 2022-11-29 2022-11-29 A three-dimensional defect detection method and device for an engine cylinder head

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211509429.4A CN115855953A (en) 2022-11-29 2022-11-29 A three-dimensional defect detection method and device for an engine cylinder head

Publications (1)

Publication Number Publication Date
CN115855953A true CN115855953A (en) 2023-03-28

Family

ID=85667620

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211509429.4A Pending CN115855953A (en) 2022-11-29 2022-11-29 A three-dimensional defect detection method and device for an engine cylinder head

Country Status (1)

Country Link
CN (1) CN115855953A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118777307A (en) * 2024-07-03 2024-10-15 广西大学 An intelligent detection system for production defects of automobile engine cylinder heads

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1987000629A1 (en) * 1985-07-15 1987-01-29 Sira Limited Inspection apparatus
CN102308201A (en) * 2008-12-24 2012-01-04 斯奈克玛 Method for the non-destructive inspection of a mechanical part
CN102448679A (en) * 2009-05-27 2012-05-09 莱卡地球系统公开股份有限公司 Method and system for positioning at least one object with high precision in a final position in space
KR101446914B1 (en) * 2013-03-29 2014-10-07 아진산업(주) Robot arm for vision test
CN108496124A (en) * 2015-11-09 2018-09-04 艾天诚工程技术系统股份有限公司 The automatic detection and robot assisted processing of surface defect
DE102017221649A1 (en) * 2017-12-01 2019-06-06 Volkswagen Aktiengesellschaft Test method for detecting surface defects on matt and shiny surfaces and associated device and test arrangement between the device and component
WO2019197981A1 (en) * 2018-04-10 2019-10-17 Scuola Superiore Di Studi Universitari E Di Perfezionamento Sant'anna System for the detection of defects on a surface of at least a portion of a body and method thereof
CN110980276A (en) * 2019-12-30 2020-04-10 南京埃克里得视觉技术有限公司 Method for implementing automatic casting blanking by three-dimensional vision in cooperation with robot
CN113267452A (en) * 2021-06-11 2021-08-17 菲特(天津)检测技术有限公司 Engine cylinder surface defect detection method and system based on machine vision
CN113424055A (en) * 2019-10-09 2021-09-21 山东大学 Multi-scale tunnel structure disease detection and intelligent diagnosis system and method

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1987000629A1 (en) * 1985-07-15 1987-01-29 Sira Limited Inspection apparatus
CN102308201A (en) * 2008-12-24 2012-01-04 斯奈克玛 Method for the non-destructive inspection of a mechanical part
CN102448679A (en) * 2009-05-27 2012-05-09 莱卡地球系统公开股份有限公司 Method and system for positioning at least one object with high precision in a final position in space
KR101446914B1 (en) * 2013-03-29 2014-10-07 아진산업(주) Robot arm for vision test
CN108496124A (en) * 2015-11-09 2018-09-04 艾天诚工程技术系统股份有限公司 The automatic detection and robot assisted processing of surface defect
DE102017221649A1 (en) * 2017-12-01 2019-06-06 Volkswagen Aktiengesellschaft Test method for detecting surface defects on matt and shiny surfaces and associated device and test arrangement between the device and component
WO2019197981A1 (en) * 2018-04-10 2019-10-17 Scuola Superiore Di Studi Universitari E Di Perfezionamento Sant'anna System for the detection of defects on a surface of at least a portion of a body and method thereof
CN113424055A (en) * 2019-10-09 2021-09-21 山东大学 Multi-scale tunnel structure disease detection and intelligent diagnosis system and method
CN110980276A (en) * 2019-12-30 2020-04-10 南京埃克里得视觉技术有限公司 Method for implementing automatic casting blanking by three-dimensional vision in cooperation with robot
CN113267452A (en) * 2021-06-11 2021-08-17 菲特(天津)检测技术有限公司 Engine cylinder surface defect detection method and system based on machine vision

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118777307A (en) * 2024-07-03 2024-10-15 广西大学 An intelligent detection system for production defects of automobile engine cylinder heads

Similar Documents

Publication Publication Date Title
US12008796B2 (en) Systems and methods for pose detection and measurement
CN108555908B (en) A method for gesture recognition and picking of stacked workpieces based on RGBD cameras
CN112476434B (en) Visual 3D pick-and-place method and system based on cooperative robot
US12067080B2 (en) Method and system for generating training data
CN109840900B (en) A fault online detection system and detection method applied to intelligent manufacturing workshops
CN101630418B (en) Integrated method for measurement and reconstruction of three-dimensional model and system thereof
JP7387117B2 (en) Computing systems, methods and non-transitory computer-readable media
CN103196370B (en) Measuring method and measuring device of conduit connector space pose parameters
CN115482195A (en) Train part deformation detection method based on three-dimensional point cloud
CN113267452A (en) Engine cylinder surface defect detection method and system based on machine vision
CN115330734A (en) Automatic robot repair welding system based on three-dimensional target detection and point cloud defect completion
CN117291918B (en) A method for defect detection of automotive stamping parts based on three-dimensional point cloud
CN106504262A (en) A kind of small tiles intelligent locating method of multiple features fusion
CN114387262A (en) Nut positioning detection method, device and system based on machine vision
CN113970560A (en) A three-dimensional defect detection method based on multi-sensor fusion
CN118691551A (en) New energy ship parts detection method and system based on deep learning
CN115855953A (en) A three-dimensional defect detection method and device for an engine cylinder head
CN119693841B (en) Endoscope pipeline inner wall crack automatic identification system based on video deep learning
CN118858293A (en) Graphite Sheet Component Appearance Defect Detection Method Based on Photometric Stereo Algorithm
CN116091559B (en) An Assembly State Recognition Method Based on Optimization Perspective
CN117705720A (en) A synchronous and rapid detection system for appearance dimensions and defects of double-block sleepers
Sun et al. Precision work-piece detection and measurement combining top-down and bottom-up saliency
Liang Mechanical Parts Pose Detection System Based on ORB Key Frame Matching Algorithm.
Li et al. A Flexible Quality Inspection Robot System for Multi-type Surface Defects
JP7417882B2 (en) Computing systems, methods and non-transitory computer-readable media

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination