A method and device for detecting glue flying
Through continuous shooting of the camera and recording the glue fly shot detection method in the glue detection method, the glue length and width are determined using the image and shooting time, which solves the problems of low detection efficiency and high cost, and achieves efficient and accurate glue detection.
Patent Information
- Application Number
- CN202410889037.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-04
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2044-07-04
AI Technical Summary
The existing glue fly shot detection methods are inefficient and costly, mainly because the camera movement speed is limited by the trigger delay error, and complex image stitching is required to determine the actual length and width of the glue.
By controlling the camera to move along the direction of the glue extension, continuously capture and record the image and shooting time, use the image and shooting time to determine the actual length and width of the glue, avoid image stitching, improve detection efficiency and reduce costs.
It realizes efficient glue detection without the impact of trigger delay error, simplifies the detection process, reduces costs, and improves detection efficiency and accuracy.
Smart Images

Figure CN118443676B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of glue detection, and in particular to a method and device for detecting glue flying. Background Art
[0002] Glue flying inspection is a method for inspecting the quality of glue application based on visual sensor technology, which is particularly suitable for glue defect detection on large-size products.
[0003] The commonly used glue flying detection method is to first continuously shoot the glue trajectory with a high-speed camera to obtain multiple flying images, then stitch the multiple flying images into a complete detection image, and finally determine the glue situation based on the detection image.
[0004] However, the above-mentioned glue flying detection method has the following problems: 1. The above-mentioned glue flying detection method uses a hard trigger method to control the camera shooting, that is, the camera receives a trigger signal once and shoots an image. Considering the trigger delay error, the camera movement speed needs to be controlled below 200mm / s. The movement speed is slow, which affects the detection efficiency. 2. The above-mentioned glue flying detection method also needs to splice multiple flying images. In order to ensure the accuracy of the detection, the splicing method is usually more complicated and difficult to implement, which will increase the detection cost. Summary of the invention
[0005] The present invention provides a method and device for detecting glue flying, so as to solve the problems of low detection efficiency and high detection cost of the existing glue flying detection method.
[0006] In a first aspect, an embodiment of the present invention provides a method for detecting glue flying, the method comprising:
[0007] Control the camera to start moving along the extension direction of the glue to be detected;
[0008] After the camera moves to a first preset time, the camera is controlled to continuously take pictures of the glue to be detected, and the images taken by the camera and the shooting time corresponding to the images are collected and recorded until the camera moves to a second preset time;
[0009] The actual length of the glue to be detected is determined according to the image and the shooting time corresponding to the image.
[0010] Optionally, determining the actual length of the glue to be detected according to the image and the shooting time corresponding to the image includes:
[0011] Determine a first image and a second image according to the image and the shooting time corresponding to the image, the first image being an image in which the glue to be detected appears for the first time according to the shooting time, and the second image being an image in which the glue to be detected appears for the last time according to the shooting time;
[0012] The actual length of the glue to be detected is determined according to the first image, the shooting time of the first image, the second image, and the shooting time of the second image.
[0013] Optionally, determining the actual length of the glue to be detected according to the first image, the shooting time of the first image, the second image, and the shooting time of the second image includes:
[0014] Determine a starting position of the glue to be detected in the field of view of the first image and an ending position in the field of view of the second image;
[0015] The actual length of the glue to be detected is determined according to the shooting time of the first image, the shooting time of the second image, the movement speed of the camera, the starting position and the ending position.
[0016] Optionally, the camera moves at a uniform speed along the extension direction of the glue to be detected;
[0017] Determining the actual length of the glue to be detected according to the shooting time of the first image, the shooting time of the second image, the movement speed of the camera, the starting position and the ending position includes:
[0018] The actual length of the glue to be tested is determined using the following corresponding relationship:
[0019] L'=(t2-t1)*v+(X2-X1);
[0020] Wherein, L' represents the actual length of the glue to be detected, t1 represents the shooting time of the first image, t2 represents the shooting time of the second image, v represents the movement speed of the camera, X1 represents the distance between the starting position and the starting edge of the field of view of the first image, and X2 represents the distance between the ending position and the starting edge of the field of view of the second image.
[0021] Optionally, before controlling the camera to continuously take photos of the glue to be detected, the glue flying detection method further includes:
[0022] Determining the first preset time according to the relative position relationship between the camera and the glue to be detected, the movement speed of the camera, and the preset shooting start position of the camera;
[0023] The second preset time is determined according to the relative position relationship between the camera and the glue to be detected, the standard length of the glue to be detected, the movement speed of the camera, and the preset shooting stop position of the camera.
[0024] Optionally, after determining the actual length of the glue to be detected according to the image and the shooting time corresponding to the image, the method further includes:
[0025] It is determined whether the glue to be detected meets the coating length requirement according to the actual length of the glue to be detected and the preset length requirement.
[0026] Optionally, the glue flying detection method further includes:
[0027] Determine the actual width of the glue to be detected according to the image;
[0028] It is determined whether the glue to be detected meets the coating width requirement according to the actual width of the glue to be detected and the preset width requirement.
[0029] Optionally, determining the actual width of the glue to be detected according to the image includes:
[0030] Determine a first image, a second image, and at least one third image according to the images and the shooting times corresponding to the images; the first image is an image in which the glue to be detected appears for the first time according to the shooting time, and the second image is an image in which the glue to be detected appears for the last time according to the shooting time; the shooting time of the third image is between the shooting time of the first image and the shooting time of the second image, and the glue to be detected in the third image runs through the field of view of the third image;
[0031] The actual width of the glue to be detected is determined according to the first image, the second image and the third image.
[0032] Optionally, the camera moves at a uniform speed along the extension direction of the glue to be detected;
[0033] After determining whether the glue to be detected meets the coating width requirement according to the actual width of the glue to be detected and the preset width requirement, the glue flying detection method further includes:
[0034] The position of the to-be-detected glue whose actual width does not meet the coating width requirement is determined according to the movement speed of the camera, the shooting time of the first image, and the shooting time of the image whose actual width does not meet the coating width requirement.
[0035] In a second aspect, an embodiment of the present invention provides a glue flying detection device, the glue flying detection device comprising:
[0036] A camera motion control unit, used for controlling the camera to start moving along the extension direction of the glue to be detected;
[0037] A camera shooting control unit, used to control the camera to continuously take pictures of the glue to be detected after the camera moves to a first preset time, and collect and record the images taken by the camera and the shooting time corresponding to the images, until the camera moves to a second preset time;
[0038] The glue actual length determination unit is used to determine the actual length of the glue to be detected according to the image and the shooting time corresponding to the image.
[0039] The technical solution of the embodiment of the present invention, by controlling the camera to take continuous photos of the glue to be detected, can make the glue flying detection method in the embodiment of the present invention not be affected by the trigger delay error, which is beneficial to improve the movement speed of the camera, and further improve the detection efficiency. By collecting and recording the image captured by the camera while also collecting and recording the shooting time corresponding to the image, the glue flying detection method in the embodiment of the present invention can determine the actual length of the glue to be detected based on the image and the shooting time corresponding to the image, without the need for image stitching, which is beneficial to reducing the detection cost.
[0040] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0042] Figure 1 A flow chart of a method for detecting glue flying provided by an embodiment of the present invention;
[0043] Figure 2 A flow chart of another method for detecting glue flying provided by an embodiment of the present invention;
[0044] Figure 3 A schematic diagram of photographing glue to be detected provided by an embodiment of the present invention;
[0045] Figure 4 A flowchart of another method for detecting glue flying provided by an embodiment of the present invention;
[0046] Figure 5A flowchart of another method for detecting glue flying provided by an embodiment of the present invention;
[0047] Figure 6 A flowchart of another method for detecting glue flying provided by an embodiment of the present invention;
[0048] Figure 7 A flowchart of another method for detecting glue flying provided by an embodiment of the present invention;
[0049] Figure 8 A flowchart of another method for detecting glue flying provided by an embodiment of the present invention;
[0050] Fig. 9 A flowchart of another method for detecting glue flying provided by an embodiment of the present invention;
[0051] Fig.10 A structural schematic diagram of a glue flying detection device provided by an embodiment of the present invention;
[0052] Fig.11 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0053] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.
[0054] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices. The orientation or positional relationship indicated by the terms "upper", "lower", "left", "right", etc. is based on the orientation or positional relationship shown in the drawings, and is only used to illustrate the relative positional relationship between the components or components, and does not particularly limit the specific installation orientation of the components or components.
[0055] Embodiment 1
[0056] Figure 1 A flowchart of a method for detecting glue flying shot provided by an embodiment of the present invention. The simulation method of the embodiment of the present invention is applicable to situations where glue needs to be detected. The method for detecting glue flying shot can be performed by a device for detecting glue flying shot. The device can be implemented by software and / or hardware and is specifically configured in an electronic device. It should be noted that the flying shot in the embodiment of the present invention can be understood as shooting by a moving camera. Reference Figure 1 , the glue flying detection method in the embodiment of the present invention includes:
[0057] S110, controlling the camera to start moving along the extension direction of the glue to be detected.
[0058] Exemplarily, a slide rail parallel to the extension direction of the glue to be detected can be set, and a slider that can move relative to the slide rail along the extension direction of the glue to be detected can be placed on the slide rail. The camera can be fixed on the slider, and when the control slider starts to move along the extension direction of the glue to be detected, the camera will also start to move along the extension direction of the glue to be detected.
[0059] Exemplarily, a mechanical arm capable of moving along the extension direction of the glue to be detected may be provided, and the camera may be fixed on the mechanical arm. When the mechanical arm is controlled to start moving along the extension direction of the glue to be detected, the camera will also start moving along the extension direction of the glue to be detected.
[0060] S120, after the camera moves to the first preset time, control the camera to continuously take pictures of the glue to be inspected, and collect and record the images taken by the camera and the shooting time corresponding to the images, until the camera moves to the second preset time.
[0061] It is understandable that in order to ensure that the camera can capture the starting position of the glue to be detected, the initial movement position of the camera is usually set at a distance from the starting position of the glue to be detected. Considering that it takes a certain amount of starting time to accelerate the camera to the preset speed, the distance between the initial movement position of the camera and the starting position of the glue to be detected is set relatively long. If continuous shooting begins when the camera starts to move, there will be a situation where the glue to be detected cannot be captured many times, which will interfere with the detection and is not conducive to reducing the detection cost. Therefore, it can be set to control the camera to take continuous photos of the glue to be detected after the camera moves to the first preset time, so as to avoid the situation where the camera cannot capture the glue to be detected many times, which is conducive to reducing the interference of images without glue to be detected on the detection and the detection cost.
[0062] It is understandable that when setting the first preset time, it is also necessary to consider ensuring that the camera can capture the starting position of the glue to be detected. Therefore, the first image captured by the camera may not include the glue to be detected by setting an appropriate first preset time.
[0063] Exemplarily, after the camera moves to a first preset time, the camera is controlled to take continuous photos of the glue to be inspected, that is, the camera's multiple shots only need to be triggered once. Compared with the hard trigger method of receiving a trigger signal once and taking an image, the embodiment of the present invention does not need to consider the influence of the trigger delay error, and the camera movement can be set to more than 1000mm / s. The movement speed is increased by more than 5 times, which is conducive to improving detection efficiency.
[0064] The embodiment of the present invention uses a timestamp when capturing an image, that is, while collecting and recording the captured image, the capturing time corresponding to the image is also collected and recorded synchronously.
[0065] It is understandable that when setting the second preset time, it is necessary to consider ensuring that the camera can capture the end position of the glue to be detected. Therefore, the last image captured by the camera may not include the glue to be detected by setting an appropriate second preset time.
[0066] It should be noted that the embodiment of the present invention does not impose any specific restrictions on the first preset time and the second preset time, and those skilled in the art can set them according to actual conditions.
[0067] S130: Determine the actual length of the glue to be detected according to the image and the shooting time corresponding to the image.
[0068] For example, since the embodiment of the present invention simultaneously collects and records the shooting time corresponding to the image while collecting and recording the image captured by the camera, the actual length of the glue to be detected can be determined based on the image and the shooting time corresponding to the image. The embodiment of the present invention can determine the actual length of the glue to be detected without image stitching, which is conducive to reducing the difficulty and cost of detection.
[0069] The technical solution of the embodiment of the present invention, by controlling the camera to take continuous pictures of the glue to be detected, can make the glue flying detection method in the embodiment of the present invention not be affected by the trigger delay error, which is beneficial to improve the movement speed of the camera, and then improve the detection efficiency. By collecting and recording the image captured by the camera and the shooting time corresponding to the recorded image, the glue flying detection method in the embodiment of the present invention can determine the actual length of the glue to be detected according to the image and the shooting time corresponding to the image, without the need for image stitching, which is beneficial to reducing the detection cost.
[0070] Based on the above embodiments, Figure 2A flowchart of another method for detecting glue flying provided by an embodiment of the present invention, Figure 2 The embodiment shown in the figure describes in detail how to determine the actual length of the glue to be detected based on the image and the shooting time corresponding to the image. Figure 2 , the glue flying detection method in the embodiment of the present invention includes:
[0071] S210, controlling the camera to start moving along the extension direction of the glue to be detected.
[0072] S220, determining a first image and a second image according to the images and the shooting time corresponding to the images, the first image being the image in which the glue to be detected appears for the first time according to the shooting time, and the second image being the image in which the glue to be detected appears for the last time according to the shooting time.
[0073] For example, Figure 3 A schematic diagram of photographing glue to be detected provided by an embodiment of the present invention,
[0074] refer to Figure 3 The embodiment of the present invention can perform image detection on all the captured images in the order of the shooting time, and determine the first image 10 where the glue to be detected appears for the first time and the second image 20 where the glue to be detected appears for the last time from all the images.
[0075] S230: Determine the actual length of the glue to be detected according to the first image, the shooting time of the first image, the second image, and the shooting time of the second image.
[0076] Exemplarily, the actual length of the glue to be detected can be determined based on the first image 10, the shooting time of the first image 10, the second image 20 and the shooting time of the second image 10 determined in the above step S121. The specific calculation is similar to "a car crossing a bridge" and will be described in detail below.
[0077] S240: Determine the actual length of the glue to be detected according to the image and the shooting time corresponding to the image.
[0078] Based on the above embodiments, Figure 4 A flowchart of another method for detecting glue flying provided by an embodiment of the present invention, Figure 4 The embodiment shown in the figure describes in detail how to determine the actual length of the glue to be detected according to the first image, the shooting time of the first image, the second image and the shooting time of the second image. Figure 4 , the glue flying detection method in the embodiment of the present invention includes:
[0079] S310, controlling the camera to start moving along the extension direction of the glue to be detected.
[0080] S320, determining a first image and a second image according to the images and the shooting time corresponding to the images, the first image being the image in which the glue to be detected appears for the first time according to the shooting time, and the second image being the image in which the glue to be detected appears for the last time according to the shooting time.
[0081] S330: Determine the starting position of the glue to be detected in the field of view of the first image and the ending position in the field of view of the second image.
[0082] Exemplary, reference Figure 3 , image detection is performed on the first image 10 to determine the starting position of the glue to be detected in the field of view of the first image 10, and the starting position of the glue to be detected in the field of view of the first image 10 refers to the starting edge (the leftmost side) of the glue to be detected. Image detection is performed on the second image 20 to determine the ending position of the glue to be detected in the field of view of the second image 20, and the starting position of the glue to be detected in the field of view of the first image 10 refers to the ending edge (the rightmost side) of the glue to be detected.
[0083] S340: Determine the actual length of the glue to be detected according to the shooting time of the first image, the shooting time of the second image, the movement speed of the camera, the starting position and the ending position.
[0084] Exemplary, reference Figure 3 The movement speed of the camera may include the speed of the camera moving at a uniform speed after the camera starts shooting, or the initial speed and acceleration of the camera moving at a variable speed after the camera starts shooting, and the camera moves at a uniform speed along the extension direction of the glue to be detected. The actual length of the glue to be detected can be determined according to the shooting time of the first image 10, the shooting time of the second image 20, the movement speed of the camera, the starting position of the glue to be detected in the field of view of the first image 10, the ending position of the glue to be detected in the field of view of the second image 20, and the scale between the image and the actual.
[0085] As a feasible implementation method, refer to Figure 3 , when the camera moves at a constant speed along the extension direction of the glue to be detected, the actual length of the glue to be detected is determined according to the shooting time of the first image 10, the shooting time of the second image 20, the movement speed of the camera, the starting position and the ending position, including:
[0086] The actual length of the glue to be tested is determined using the following corresponding relationship:
[0087] L'=(t2-t1)*v+(X2-X1).
[0088] Wherein, L' represents the actual length of the glue to be detected, t1 represents the shooting time of the first image 10, t2 represents the shooting time of the second image 20, v represents the movement speed of the camera, X1 represents the distance between the starting position and the starting edge of the field of view of the first image 10, and X2 represents the distance between the ending position and the starting edge of the field of view of the second image 20.
[0089] It should be noted that the embodiment of the present invention does not limit whether the camera moves at a uniform speed along the extension direction of the glue to be detected. It is just that compared with variable speed motion, the calculation of the actual length of the glue to be detected under uniform motion will be simpler. Technical personnel in this field can set the movement mode of the camera during the shooting process according to actual needs.
[0090] S350: Determine the actual length of the glue to be detected according to the image and the shooting time corresponding to the image.
[0091] Based on the above embodiments, Figure 5 A flowchart of another method for detecting glue flying provided by an embodiment of the present invention, Figure 5 The embodiment shown enriches the process of the glue flying detection method, refer to Figure 5 , the glue flying detection method in the embodiment of the present invention includes:
[0092] S410, controlling the camera to start moving along the extension direction of the glue to be detected.
[0093] S420: Determine a first preset time according to the relative position relationship between the camera and the glue to be detected, the movement speed of the camera, and a preset shooting start position of the camera.
[0094] Exemplarily, the relative position relationship between the camera and the glue to be detected can be the initial distance between the camera and the glue to be detected before the camera starts to move, the camera movement speed can include the preset speed when the camera starts shooting, the acceleration when accelerating to the preset speed, and the preset shooting start position of the camera can be a position 5 to 10 mm away from the starting edge of the glue to be detected. A more appropriate first preset time can be determined based on the relative position relationship between the camera and the glue to be detected, the camera movement speed, and the camera's preset shooting start position.
[0095] S430: Determine a second preset time according to the relative position relationship between the camera and the glue to be detected, the standard length of the glue to be detected, the movement speed of the camera, and the preset shooting stop position of the camera.
[0096] Exemplarily, the relative position relationship between the camera and the glue to be detected can be the initial distance between the camera and the glue to be detected before the camera starts to move, the standard length of the glue to be detected can be the qualified length specified when the glue to be detected is made, the movement speed of the camera can include the speed of the camera moving at a uniform speed after starting to shoot, or the initial speed and acceleration of the camera moving at a variable speed after starting to shoot, and the preset shooting stop position of the camera can be a position 5 to 10 mm away from the end edge of the glue to be detected. A more appropriate first preset time can be determined based on the relative position relationship between the camera and the glue to be detected, the standard length of the glue to be detected, the movement speed of the camera, and the preset shooting stop position of the camera.
[0097] S440, after the camera moves to the first preset time, control the camera to continuously take pictures of the glue to be inspected, and collect and record the images taken by the camera and the shooting time corresponding to the images, until the camera moves to the second preset time.
[0098] S450: Determine the actual length of the glue to be detected according to the image and the shooting time corresponding to the image.
[0099] Based on the above embodiments, Figure 6 A flowchart of another method for detecting glue flying provided by an embodiment of the present invention, Figure 6 The embodiment shown enriches the process of the glue flying detection method, refer to Figure 6 , the glue flying detection method in the embodiment of the present invention includes:
[0100] S510, controlling the camera to start moving along the extension direction of the glue to be detected.
[0101] S520, after the camera moves to the first preset time, control the camera to continuously take pictures of the glue to be inspected, and collect and record the images taken by the camera and the shooting time corresponding to the images, until the camera moves to the second preset time.
[0102] S530: Determine the actual length of the glue to be detected according to the image and the shooting time corresponding to the image.
[0103] S540: Determine whether the glue to be tested meets the coating length requirement according to the actual length of the glue to be tested and the preset length requirement.
[0104] Exemplarily, if the difference between the actual length of the glue to be detected and the preset length of the glue to be detected does not exceed the first allowable deviation range, it is judged that the glue to be detected meets the coating length requirement. If the difference between the actual length of the glue to be detected and the preset length of the glue to be detected exceeds the first allowable deviation range, it is judged that the glue to be detected does not meet the coating length requirement. The preset length of the glue to be detected may be the standard length of the glue to be detected. The first allowable deviation range may be the length allowable deviation range ±δ1 when the glue to be detected is made, where δ1 represents the length allowable deviation.
[0105] Based on the above embodiments, Figure 7 A flowchart of another method for detecting glue flying provided by an embodiment of the present invention, Figure 7 The embodiment shown enriches the process of the glue flying detection method, refer to Figure 7 , the glue flying detection method in the embodiment of the present invention includes:
[0106] S610, controlling the camera to start moving along the extension direction of the glue to be detected.
[0107] S620: After the camera moves to the first preset time, control the camera to continuously take pictures of the glue to be inspected, and collect and record the images taken by the camera and the shooting time corresponding to the images, until the camera moves to the second preset time.
[0108] S630: Determine the actual length of the glue to be detected according to the image and the shooting time corresponding to the image.
[0109] S640: Determine whether the glue to be tested meets the coating length requirement according to the actual length of the glue to be tested and the preset length requirement.
[0110] S650: Determine the actual width of the glue to be detected according to the image.
[0111] Exemplarily, the embodiment of the present invention may perform image detection on all captured images in the order of the capturing time, so as to determine the actual width of the glue to be detected in each image containing the glue to be detected.
[0112] S660: Determine whether the glue to be tested meets the coating width requirement according to the actual width of the glue to be tested and the preset width requirement.
[0113] Exemplarily, if the difference between the actual width of the glue to be detected in all images where the glue to be detected exists and the preset width of the glue to be detected does not exceed the second allowable deviation range, it is judged that the glue to be detected meets the coating width requirement. As long as the difference between the actual width of the glue to be detected in one image where the glue to be detected exists and the preset width of the glue to be detected exceeds the second allowable deviation range, it is judged that the glue to be detected meets the coating width requirement. The second allowable deviation range can be the width allowable deviation range ±δ2 when the glue to be detected is made, where δ2 represents the length allowable deviation.
[0114] Based on the above embodiments, Figure 8 A flowchart of another method for detecting glue flying provided by an embodiment of the present invention, Figure 8 The embodiment shown in the figure describes in detail how to determine the actual width of the glue to be detected based on the image, referring to Figure 8 , the glue flying detection method in the embodiment of the present invention includes:
[0115] S710, controlling the camera to start moving along the extension direction of the glue to be detected.
[0116] S720: After the camera moves to the first preset time, control the camera to continuously take pictures of the glue to be inspected, and collect and record the images taken by the camera and the shooting time corresponding to the images, until the camera moves to the second preset time.
[0117] S730: Determine the actual length of the glue to be detected according to the image and the shooting time corresponding to the image.
[0118] S740: Determine whether the glue to be tested meets the coating length requirement according to the actual length of the glue to be tested and the preset length requirement.
[0119] S750. Determine a first image, a second image, and at least one third image based on the images and the shooting times corresponding to the images, wherein the first image is an image in which the glue to be detected appears for the first time according to the shooting time, the second image is an image in which the glue to be detected appears for the last time according to the shooting time, the shooting time of the third image is between the shooting time of the first image and the shooting time of the second image, and the glue to be detected in the third image runs through the field of view of the third image.
[0120] Exemplary, reference Figure 3 The embodiment of the present invention can perform image detection on all the captured images in the order of shooting time, and determine from all the images the first image 10 where the glue to be detected appears for the first time, the second image 20 where the glue to be detected appears for the last time, and the third image 30 where the glue to be detected passes through the field of view of the third image.
[0121] S760: Determine the actual width of the glue to be detected according to the first image, the second image, and the third image.
[0122] Exemplary, reference Figure 3 , determine the first actual width of the glue to be detected according to the first image 10, specifically, the first actual width of the glue to be detected can be determined according to the width of the glue to be detected in the field of view of the first image, and the scale between the image and the actual. Determine the second actual width of the glue to be detected according to the second image 20, specifically, the second actual width of the glue to be detected can be determined according to the width of the glue to be detected in the field of view of the second image, and the scale between the image and the actual. Determine the third actual width of the glue to be detected according to the third image 30, specifically, the third actual width of the glue to be detected can be determined according to the width of the glue to be detected in the field of view of the third image, and the scale between the image and the actual.
[0123] S770: Determine whether the glue to be tested meets the coating width requirement according to the actual width of the glue to be tested and the preset width requirement.
[0124] Based on the above embodiments, Fig. 9 A flowchart of another method for detecting glue flying provided by an embodiment of the present invention, Fig. 9 The embodiment shown enriches the process of the glue flying detection method, refer to Fig. 9 , the glue flying detection method in the embodiment of the present invention includes:
[0125] S810, controlling the camera to start moving along the extension direction of the glue to be detected.
[0126] S820: After the camera moves to the first preset time, control the camera to continuously take pictures of the glue to be inspected, and collect and record the images taken by the camera and the shooting time corresponding to the images, until the camera moves to the second preset time.
[0127] S830: Determine the actual length of the glue to be detected according to the image and the shooting time corresponding to the image.
[0128] S840: Determine whether the glue to be tested meets the coating length requirement according to the actual length of the glue to be tested and the preset length requirement.
[0129] S850: Determine the actual width of the glue to be detected according to the image.
[0130] S860: Determine whether the glue to be tested meets the coating width requirement according to the actual width of the glue to be tested and the preset width requirement.
[0131] S870, determining the position of the to-be-detected glue whose actual width does not meet the coating width requirement according to the movement speed of the camera, the shooting time of the first image, and the shooting time of the image whose actual width does not meet the coating width requirement.
[0132] Exemplary, reference Figure 3 The camera movement speed may include the speed of the camera moving at a uniform speed after the camera starts shooting, or the initial speed and acceleration of the camera moving at a variable speed after the camera starts shooting, and the camera moves at a uniform speed along the extension direction of the glue to be detected. The position of the glue to be detected whose actual width does not meet the coating width requirement can be determined based on the camera movement speed, the shooting time of the first image 10, and the shooting time of the image whose actual width does not meet the coating width requirement.
[0133] As a feasible implementation method, refer to Figure 3 , when the camera moves at a constant speed along the extension direction of the glue to be detected, the position of the glue to be detected whose actual width does not meet the coating width requirement is determined according to the movement speed of the camera, the shooting time of the first image 10, and the shooting time of the image whose actual width does not meet the coating width requirement, including:
[0134] The following corresponding relationship is used to determine the position of the glue to be tested whose actual width does not meet the coating width requirement:
[0135] D=(tm-t1)*v-X1.
[0136] Wherein, D represents the actual distance between the glue to be detected whose actual width does not meet the coating width requirement and the glue to be detected, t1 represents the shooting time of the first image 10, tm represents the shooting time of the image whose actual width does not meet the coating width requirement, v represents the movement speed of the camera, and X1 represents the distance between the starting position and the starting edge of the field of view of the first image 10.
[0137] Embodiment 2
[0138] The embodiment of the present invention provides a glue flying detection device, Fig.10 A schematic diagram of a glue flying detection device provided by an embodiment of the present invention, referring to Fig.10 , the glue flying detection device comprises:
[0139] The camera motion control unit 910 is used to control the camera to start moving along the extension direction of the glue to be detected.
[0140] The camera shooting control unit 920 is used to control the camera to continuously shoot the glue to be inspected after the camera moves to the first preset time, and collect and record the images shot by the camera and the shooting time corresponding to the images until the camera moves to the second preset time.
[0141] The glue actual length determination unit 930 is used to determine the actual length of the glue to be detected according to the image and the shooting time corresponding to the image.
[0142] Optionally, the glue flying detection device in the embodiment of the present invention may also include a glue length judgment unit, a glue actual width determination unit and a glue width judgment unit. Specifically, the glue length judgment unit is used to judge whether the glue to be detected meets the coating length requirement according to the actual length of the glue to be detected and the preset length requirement. The glue actual width determination unit is used to determine the actual width of the glue to be detected according to the image. The glue width judgment unit is used to judge whether the glue to be detected meets the coating width requirement according to the actual width of the glue to be detected and the preset width requirement.
[0143] The glue flying detection device provided in the embodiment of the present invention can execute the glue flying detection method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.
[0144] Embodiment 3
[0145] Fig.11 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention, Fig.11 A schematic diagram of the structure of an electronic device 1000 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.
[0146] like Fig.11As shown, the electronic device 1000 includes at least one processor 1010, and a memory connected to the at least one processor 1010 in communication, such as a read-only memory (ROM) 1020, a random access memory (RAM) 1030, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 1010 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 1020 or the computer program loaded from the storage unit 1080 to the random access memory (RAM) 1030. In the RAM 1030, various programs and data required for the operation of the electronic device 1000 can also be stored. The processor 1010, the ROM 1020, and the RAM 1030 are connected to each other through a bus 1040. An input / output (I / O) interface 1050 is also connected to the bus 1040.
[0147] Multiple components in the electronic device 1000 are connected to the I / O interface 1050, including: an input unit 1060, such as a keyboard, a mouse, etc.; an output unit 1070, such as various types of displays, speakers, etc.; a storage unit 1080, such as a disk, an optical disk, etc.; and a communication unit 1090, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1090 allows the electronic device 1000 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.
[0148] The processor 1010 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 1010 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 1010 performs the various methods and processes described above, such as the glue flying detection method.
[0149] In some embodiments, the glue flying detection method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 1080. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 1000 via the ROM 1020 and / or the communication unit 1090. When the computer program is loaded into the RAM 1030 and executed by the processor 1010, one or more steps of the glue flying detection method described above may be performed. Alternatively, in other embodiments, the processor 1010 may be configured to perform the glue flying detection method in any other appropriate manner (e.g., by means of firmware).
[0150] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0151] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
[0152] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, device, or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0153] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).
[0154] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.
[0155] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.
[0156] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.
[0157] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims
1. A method for detecting glue flying, It is characterized in that include: Control the camera to start moving along the extension direction of the glue to be detected; After the camera moves to a first preset time, the camera is controlled to continuously take pictures of the glue to be detected, and the images taken by the camera and the shooting time corresponding to the images are collected and recorded until the camera moves to a second preset time; Determine the actual length of the glue to be detected according to the image and the shooting time corresponding to the image; Determining the actual length of the glue to be detected according to the image and the shooting time corresponding to the image includes: Determine a first image and a second image according to the image and the shooting time corresponding to the image, the first image being an image in which the glue to be detected appears for the first time according to the shooting time, and the second image being an image in which the glue to be detected appears for the last time according to the shooting time; determining an actual length of the glue to be detected according to the first image, the shooting time of the first image, the second image, and the shooting time of the second image; Determining the actual length of the glue to be detected according to the first image, the shooting time of the first image, the second image, and the shooting time of the second image includes: Determine a starting position of the glue to be detected in the field of view of the first image and an ending position in the field of view of the second image; Determining the actual length of the glue to be detected according to the shooting time of the first image, the shooting time of the second image, the movement speed of the camera, the starting position and the ending position; The camera moves at a uniform speed along the extension direction of the glue to be detected; Determining the actual length of the glue to be detected according to the shooting time of the first image, the shooting time of the second image, the movement speed of the camera, the starting position and the ending position includes: The actual length of the glue to be tested is determined using the following corresponding relationship: L'=(t2-t1)*v+(X2-X1); Wherein, L' represents the actual length of the glue to be detected, t1 represents the shooting time of the first image, t2 represents the shooting time of the second image, v represents the movement speed of the camera, X1 represents the distance between the starting position and the starting edge of the field of view of the first image, and X2 represents the distance between the ending position and the starting edge of the field of view of the second image.
2. The glue flying detection method according to claim 1, It is characterized in that Before controlling the camera to continuously take photos of the glue to be detected, the glue flying detection method further includes: Determining the first preset time according to the relative position relationship between the camera and the glue to be detected, the movement speed of the camera, and the preset shooting start position of the camera; The second preset time is determined according to the relative position relationship between the camera and the glue to be detected, the standard length of the glue to be detected, the movement speed of the camera, and the preset shooting stop position of the camera.
3. The glue flying detection method according to claim 1, It is characterized in that After determining the actual length of the glue to be detected according to the image and the shooting time corresponding to the image, the method further includes: It is determined whether the glue to be detected meets the coating length requirement according to the actual length of the glue to be detected and the preset length requirement.
4. The glue flying detection method according to claim 1, It is characterized in that The glue flying detection method also includes: Determine the actual width of the glue to be detected according to the image; It is determined whether the glue to be detected meets the coating width requirement according to the actual width of the glue to be detected and the preset width requirement.
5. The method for detecting glue flying according to claim 4, It is characterized in that Determining the actual width of the glue to be detected according to the image includes: Determine a first image, a second image, and at least one third image according to the images and the shooting times corresponding to the images; the first image is an image in which the glue to be detected appears for the first time according to the shooting time, and the second image is an image in which the glue to be detected appears for the last time according to the shooting time; the shooting time of the third image is between the shooting time of the first image and the shooting time of the second image, and the glue to be detected in the third image runs through the field of view of the third image; The actual width of the glue to be detected is determined according to the first image, the second image and the third image.
6. The method for detecting glue flying according to claim 5, It is characterized in that The camera moves at a uniform speed along the extension direction of the glue to be detected; After determining whether the glue to be detected meets the coating width requirement according to the actual width of the glue to be detected and the preset width requirement, the glue flying detection method further includes: The position of the to-be-detected glue whose actual width does not meet the coating width requirement is determined according to the movement speed of the camera, the shooting time of the first image, and the shooting time of the image whose actual width does not meet the coating width requirement.
7. A glue flying detection device, It is characterized in that Used to perform the glue flying detection method as described in any one of claims 1 to 6; The glue flying detection device comprises: A camera motion control unit, used for controlling the camera to start moving along the extension direction of the glue to be detected; A camera shooting control unit, used to control the camera to continuously take pictures of the glue to be detected after the camera moves to a first preset time, and collect and record the images taken by the camera and the shooting time corresponding to the images, until the camera moves to a second preset time; The glue actual length determination unit is used to determine the actual length of the glue to be detected according to the image and the shooting time corresponding to the image.
