Visual inspection device and method of inspecting thereof, system and method of inspecting thereof
By using a visual inspection device to acquire and fuse multi-angle images of the glued area under the battery pack casing, the problem of difficulty in detecting large areas of glued areas in traditional inspection methods is solved, and efficient and accurate quality control of the glued area is achieved.
Patent Information
- Application Number
- CN202380061179.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-21
- Publication Date
- 2026-03-03
- Estimated Expiration
- 2043-06-21
AI Technical Summary
Existing technologies are insufficient to effectively detect the amount of adhesive applied to the large areas of the battery pack casing. This can result in insufficient adhesive affecting structural strength or excessive adhesive leading to poor thermal conductivity. Furthermore, traditional testing methods carry the risk of missed detections.
A visual inspection device is used, including an image acquisition device, a driving device, and a controller. The controller controls the driving device to move the image acquisition device back and forth along the length of the adhesive-coated area. Combined with multiple light sources, images are acquired from different angles, and image fusion processing is performed to eliminate reflective areas, thereby achieving complete inspection of the adhesive-coated area.
It enables macroscopic inspection of the glued area of the lower housing, accurately identifying defects such as bubbles, debris, or glue breaks, improving inspection accuracy, reducing the risk of missed detections, and ensuring that the glued area meets quality standards.
Smart Images

Figure CN119816726B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of lower box inspection technology, and in particular to a visual inspection device and its inspection method, inspection system and its inspection method. Background Technology
[0002] In the manufacturing process of battery modules and battery packs, the first step is to apply adhesive to the lower casing and fix the module to the casing with adhesive. This adhesive application process is particularly important. Too much or too little adhesive will result in poor thermal conductivity. Too little adhesive will affect the structural strength of the battery pack and cause the battery inside the battery pack to move, which will cause great damage to the safety of the vehicle.
[0003] Currently, linear laser sensors are typically used to scan during adhesive application to determine the location of the adhesive and any instances of missing or broken adhesive. However, this image acquisition method can only detect small sections of adhesive strips and cannot meet the needs of detecting large areas of adhesive application. Summary of the Invention
[0004] The main purpose of this application is to provide a visual inspection device designed to meet the inspection requirements for adhesive coating on large surfaces of lower housings.
[0005] To achieve the above objectives, the visual inspection device proposed in this application includes:
[0006] Image acquisition device;
[0007] A driving device, which drives the image acquisition device to reciprocate along the length of the adhesive coating area of the lower housing, thereby acquiring a detection image of the entire adhesive coating area; and
[0008] A controller is electrically connected to the image acquisition device and the drive device to control the acquisition of images by the image acquisition device and the operation of the drive device.
[0009] The visual inspection device includes a controller, an image acquisition device, and a drive device. Under the control of the controller, the drive device can move the image acquisition device back and forth along the length of the glue-coating area. The image acquisition device can obtain an inspection image of the overall structure of the glue-coating area, thereby enabling a more macroscopic observation of the overall glue coating situation and better assisting in judging whether the glue coating is qualified.
[0010] This visual inspection device can capture the overall appearance of the glued area from a macroscopic perspective, thus making it easy to detect whether there are defects such as bubbles, debris or broken glue in the glued area, and thus better control whether the glue coating of the lower box is qualified.
[0011] In one embodiment of this application, the visual inspection device further includes a light source, which is disposed on one side of the image acquisition device and electrically connected to the controller. The light source is used to emit light toward the adhesive coating area.
[0012] Here, the light source setting can provide better light for the image acquisition device, thereby improving the image acquisition effect.
[0013] In one embodiment of this application, the image acquisition device includes a line scan camera;
[0014] And / or, the light source includes a linear light source.
[0015] Line scan cameras offer higher resolution and better imaging results, thereby further improving the effectiveness of image acquisition.
[0016] Here, the linear light source has better consistency and uniformity, which can provide better supplementary lighting for the image acquisition device.
[0017] In one embodiment of this application, the light source includes a first light source and a second light source. The first light source is disposed on one side of the image acquisition device in the direction of movement, and the second light source is disposed on the other side of the image acquisition device in the direction of movement. The first light source and the second light source have different emission angles.
[0018] Here, at least one of the first light source and the second light source can be selected for supplementary lighting, thereby providing supplementary lighting from different directions, obtaining images of reflections at different positions, and obtaining a true and effective detection image by eliminating reflections, thus improving detection accuracy.
[0019] In one embodiment of this application, the controller is further configured to turn on the first light source and control the image acquisition device to move from one side of the adhesive coating area along its length to the opposite side; turn on the second light source and control the image acquisition device to move from one side of the adhesive coating area along its length to the opposite side.
[0020] For example, the first light source is located near the left side of the adhesive coating area, and the second light source is located near the right side of the adhesive coating area. When the controller turns on the first light source, it simultaneously controls the image acquisition device to move from the left side to the right side of the adhesive coating area to acquire the first image. When the second light source is turned on, it controls the image acquisition device to move from the right side to the left side of the adhesive coating area to acquire the second image, thereby realizing the automatic acquisition of at least two images with different reflective positions and improving detection efficiency.
[0021] In one embodiment of this application, the light source is movably configured relative to the image acquisition device to adjust the emission angle of the light source relative to the horizontal plane;
[0022] And / or, the angle between the emission angle of the light source and the axis of the image acquisition device is greater than or equal to 30° and less than or equal to 60°.
[0023] Here, the emission angle of the light source relative to the horizontal plane can be adjusted, allowing it to be changed according to different types and sizes of the lower chamber, thereby obtaining more accurate detection images.
[0024] Setting the range of the angle between the light source's emission angle and the axis of the image acquisition device can further facilitate obtaining more realistic detection images.
[0025] This application also proposes a detection method for a visual inspection device, the visual inspection device including a driving device, an image acquisition device, and a controller, the detection method comprising the following steps:
[0026] Send a drive command to the drive device so that the drive device drives the image acquisition device to move back and forth along the length of the glue coating area of the lower housing, and at the same time send an image acquisition command to the image acquisition device so that the image acquisition device acquires the detection image of the glue coating area.
[0027] The detected image is acquired and sent to the server.
[0028] In this detection method, by controlling the driving device and the image acquisition device, the detection image of the overall morphology of the glue-coated area can be automatically acquired, thereby making it convenient to judge the defects of the glue-coated area from a macroscopic perspective and reducing the risk of missed detection.
[0029] In one embodiment of this application, the visual inspection device includes a first light source and a second light source. The first light source is disposed on one side of the image acquisition device in the direction of movement, and the second light source is disposed on the other side of the image acquisition device in the direction of movement. The first light source and the second light source have different emission angles. The detection method of the visual inspection device includes:
[0030] Send a command to turn on the first light source;
[0031] Send a drive command to the drive device to move the image acquisition device from the side of the adhesive application area closer to the first light source to the opposite side, and simultaneously send an acquisition command to the image acquisition device to acquire the first image;
[0032] The first image is acquired and sent to the server;
[0033] Send instructions to turn on the second light source and turn off the first light source;
[0034] A drive command is sent to the drive device to move the image acquisition device from the side of the adhesive application area closer to the second light source to the opposite side, and a acquisition command is sent to the image acquisition device to acquire the second image.
[0035] The second image is acquired and sent to the server.
[0036] By cooperating with a first light source and a driving device, a first image with a reflective area can be obtained. Similarly, by cooperating with a second light source and a driving device, a second image with a reflective area can be obtained. Because the positions and emission angles of the first and second light sources are different, the reflective areas of the first and second images are located in different positions. Therefore, combining these two images yields a more realistic and complete detection image of the coated area, preventing missed detections due to reflections or obstruction by the enclosure, and providing better image data to the server. This detection method can improve detection accuracy.
[0037] This application also proposes a detection system, comprising:
[0038] The visual inspection device is the visual inspection device as described above; and
[0039] The server, electrically connected to the controller, is used to receive and determine the compliance status of the glued area based on the detection image.
[0040] This visual inspection device can capture the overall appearance of the glued area from a macroscopic perspective. The server can then make more accurate judgments based on these images, improving the accuracy of the glue application. The images obtained by the visual inspection device facilitate the detection of defects such as bubbles, debris, or broken glue in the glued area, thereby better controlling the quality of the glue application on the lower casing.
[0041] In one embodiment of this application, the detection system further includes a base, the base including two frames disposed opposite to each other and a crossbeam slidably connected to the two frames, with the lower housing placed between the two frames;
[0042] The drive unit of the visual inspection device is installed on the frame and driven to the crossbeam. The image acquisition device is located on the crossbeam and above the glue application area of the lower housing, so as to reciprocate in the length direction of the glue application area under the drive of the drive unit.
[0043] Here, the base provides a mounting foundation for the drive unit and confines the lower housing between the two frames. The crossbeam provides a more stable moving support for the image acquisition device, allowing the moving direction of the image acquisition device to be better aligned with the length direction of the glued area of the lower housing, thereby improving acquisition accuracy.
[0044] In one embodiment of this application, the detection system further includes a first driving module and a light source. The light source is disposed on one side of the image acquisition device, and the first driving module is disposed on the crossbeam and drives the image acquisition device and the light source to reciprocate in the width direction of the adhesive coating area.
[0045] The light source provides supplementary lighting for the image acquisition device, thereby improving the acquisition effect of the detected image. Simultaneously, the first drive module allows the image acquisition device to reciprocate along the width of the adhesive coating area to match lower housings of different widths, thus enabling image acquisition of the entire adhesive coating area and improving adaptability.
[0046] In one embodiment of this application, the detection system further includes a second drive module. A slider is mounted on the crossbeam. The first drive module drives and connects to the slider. The second drive module is mounted on the slider and drives and connects to the image acquisition device and the light source, so as to drive the image acquisition device and the light source to reciprocate in the thickness direction of the adhesive coating area.
[0047] The second drive module can move the image acquisition device in the thickness direction, which can match the situation where the glue coating area is not on the same plane, thereby further improving the accuracy of detection image acquisition and improving the adaptability of the detection system.
[0048] In one embodiment of this application, the detection system further includes a lifting mechanism, which is disposed between the two frames and driven to be connected to the lower housing, so as to drive the lower housing to reciprocate in the vertical direction.
[0049] Here, the lifting mechanism can lift all the lower boxes to the same height, thereby ensuring the acquisition distance between the image acquisition device and the adhesive application area and improving the accuracy of image acquisition.
[0050] In one embodiment of this application, the lifting mechanism includes a base, a lifting assembly disposed on the base, and two clamping members disposed opposite to each other. The two clamping members can move toward or away from each other to clamp or release the lower housing. The lifting assembly drives the clamping members to move the clamping members up or down.
[0051] To improve the stability of the lower housing, clamping devices are used to secure it, making it more stable during the lifting process and preventing it from falling.
[0052] In one embodiment of this application, the server is used to send a detection command to the controller so that the image acquisition device acquires at least two detection images;
[0053] The server is also used to acquire at least two detection images, and after performing image fusion on the at least two detection images to eliminate image reflection, determine the compliance status of the glued area.
[0054] Because the images acquired by the image acquisition device with the help of a light source will have varying degrees of reflection, the server acquires at least two detection images when obtaining detection images, and eliminates reflections by fusing the two detection images to improve the authenticity and effectiveness of the detection images. Based on the detection images, the server can make more accurate judgments to improve the accuracy of detecting the adhesive application status in the adhesive application area.
[0055] In one embodiment of this application, the detection system further includes two grating gates, forming a detection channel between the two frames. The extension direction of the detection channel is consistent with the length direction of the adhesive coating area. The detection channel has an entrance and an exit arranged opposite to each other. One grating gate is located at the entrance of the detection channel, and the other grating gate is located at the exit of the detection channel.
[0056] The frame forms a detection channel with openings at both ends, which facilitates the entry and exit of the trolley transporting the lower box. By setting up light gates at the entrance and exit, the detection channel can be protected to prevent external interference and improve detection safety.
[0057] In one embodiment of this application, the detection system includes an origin sensor and a limit sensor. The origin sensor is located at the initial position of the image acquisition device and the light source, and the limit sensor is located on the moving path of the image acquisition device and the light source.
[0058] The installation of the origin sensor allows the image acquisition device and light source to be accurately reset, enabling a reset check during each inspection to calibrate the inspection system and improve accuracy. The installation of limit sensors detects whether the image acquisition device has moved to the correct position in the correct direction, thereby enhancing the self-checking performance of the inspection system.
[0059] This application further proposes a detection method for a detection system, wherein the detection system includes a visual inspection device, a server, and a light source, and the detection method of the detection system includes the following steps:
[0060] The server receives the detection request from the lower enclosure and sends the detection command to the controller;
[0061] The controller receives the detection command and sends a drive command to the drive device, while simultaneously sending an acquisition command to the image acquisition device;
[0062] The driving device drives the image acquisition device and the light source to reciprocate along the length of the glued area of the lower housing. The image acquisition device acquires and detects images and sends them to the controller.
[0063] The server receives and processes the detection images sent by the controller to determine the compliance status of the glued area of the lower housing.
[0064] This detection method can acquire images of the entire glued area of the lower casing and process and analyze the detected images to accurately determine whether there are defects such as bubbles, foreign matter or broken glue, thereby better controlling whether the glue coating of the lower casing is qualified.
[0065] In one embodiment of this application, the step of the controller receiving the detection command, sending a drive command to the drive device, and simultaneously sending an acquisition command to the image acquisition device includes:
[0066] The controller receives the detection command and sends a reset command to the drive device;
[0067] The driving device drives the image acquisition device and the light source back to the initial detection position;
[0068] The controller sends drive commands to the drive device and simultaneously sends acquisition commands to the image acquisition device.
[0069] This method, by setting a reset procedure, ensures that each detection is performed from the same location, thereby improving the accuracy and consistency of the detection.
[0070] In one embodiment of this application, the light source includes a first light source and a second light source. The first light source is disposed on one side of the image acquisition device in the direction of movement, and the second light source is disposed on the other side of the image acquisition device in the direction of movement. The first light source and the second light source have different emission angles. The detection command includes acquiring at least a first image and a second image. The detection method includes:
[0071] The controller issues a command to turn on the first light source and turn off the second light source, and sends a first drive command;
[0072] The driving device receives a first driving command and drives the image acquisition device and the light source to move from one side of the glued area of the lower housing to the opposite side along the length direction. The image acquisition device acquires a first image and sends it to the controller.
[0073] The controller issues a command to turn on the second light source and turn off the first light source, and sends a second drive command;
[0074] The driving device receives a second driving command and drives the image acquisition device and the light source to move from one side of the glued area of the lower housing to the opposite side along the length direction. The image acquisition device acquires a second image and sends it to the controller.
[0075] The server receives the first and second images sent by the controller and performs image fusion processing to eliminate image reflections and obtain the target detection image of the coated area;
[0076] The server determines the compliance status of the glued area based on the target detection image.
[0077] By cooperating with a first light source and a driving device, a first image with a reflective area can be obtained. By cooperating with a second light source and a driving device, a second image with a reflective area can be obtained. Because the positions and emission angles of the first and second light sources are different, the positions of the reflective areas in the first and second images are different. After the server fuses the two images, the reflective areas can be eliminated, resulting in a more realistic and complete detection image of the glue-coated area. This prevents missed detections due to reflections or obstruction by the enclosure. Using this target detection image as the basis for judgment, a more accurate assessment of the glue coating status can be obtained, improving detection accuracy.
[0078] In one embodiment of this application, the step of the server receiving a first image and a second image sent by the controller and performing image fusion processing to eliminate image reflection and obtain a target detection image of the coated area includes:
[0079] The server performs grayscale processing on the first image and the second image respectively to obtain a first grayscale image and a second grayscale image.
[0080] The server performs binarization processing on the first grayscale image and the second grayscale image to obtain binarized grayscale. Figure 1 and two Value-based grayscale Figure 2 ;
[0081] The server obtains the binary grayscale. Figure 1 and two Value-based grayscale Figure 2 The intersection area is used to obtain a non-reflective area;
[0082] The server uses the binarized grayscale value. Figure 1 and two Value-based grayscale Figure 2 In addition to non-reflective areas, the highlight and shadow areas of the first image and the highlight and shadow areas of the second image are calculated.
[0083] The server sets preset weights for the highlight and shadow areas of the first and second images respectively, and then superimposes the two images to obtain the target detection image.
[0084] In this detection method, the server performs fusion processing on the first image and the second image. Grayscale processing and binarization processing can determine the position of each pixel in the first image and the second image, so that when the two are superimposed, it is easier to eliminate reflective areas and obtain the target detection image.
[0085] In one embodiment of this application, the step of superimposing the target detection image by setting preset weights based on the highlight and shadow regions of the first image and the second image respectively to obtain the target detection image includes:
[0086] The server sets the weight of the shadow area at the overlapping position of the first image and the second image to be x, and the weight of the other image to be 1-x;
[0087] The server sets the highlighted area of one of the first and second images to 0, and the corresponding shadow area of the other image to 1;
[0088] The server overlays the first image and the second image to obtain the target detection image.
[0089] In this method, when overlapping portions of both images that are in shadow, the pixel ratio of the first and second images can be chosen to be arbitrary, making the overlay process easier. Conversely, the bright areas of the first image are entirely replaced by the shadow areas of the second image, and vice versa, resulting in a target detection image with reduced glare.
[0090] In one embodiment of this application, the step of determining the compliance status of the adhesive-coated area based on the target detection image includes:
[0091] The server acquires a standard detection image and compares and calculates it with the target detection image;
[0092] If the comparison values are consistent, the server determines that the glued area meets the standard.
[0093] By comparing the pixel values of each point in the target detection image with those in the standard detection image, it is possible to automatically determine whether the glued area of the lower box meets the standard, which is simple and convenient.
[0094] In one embodiment of this application, the detection system further includes a lifting structure, and after the step of driving the image acquisition device and the light source back to the initial detection position, the system includes the following steps:
[0095] The controller sends a lifting command to the lifting mechanism;
[0096] The lifting mechanism raises the lower box to a preset height so that the tray supporting the lower box is parallel to the horizontal plane.
[0097] Here, the lifting mechanism can lift all the lower boxes to the same height, thereby ensuring the acquisition distance between the image acquisition device and the adhesive application area and improving the accuracy of image acquisition.
[0098] In one embodiment of this application, after the lifting mechanism raises the lower housing to a preset height so that the tray carrying the lower housing is parallel to the horizontal plane, the method further includes:
[0099] The controller issues a detection command to detect whether the glued area of the lower housing is on a horizontal plane;
[0100] If not, the controller sends a leveling drive command to the drive unit;
[0101] The driving device drives the image acquisition device to move along the length of the adhesive coating area of the lower housing and simultaneously in the vertical direction, so that the moving path of the image acquisition device is parallel to the surface of the adhesive coating area, and acquires and detects images.
[0102] Here, the detection method ensures that the acquisition path of the image acquisition device is parallel to the surface of the adhesive-coated area, thereby improving the accuracy of image acquisition.
[0103] This application further proposes a detection method for a detection system, wherein the detection system includes a visual inspection device, a server, and a light source, and the detection method of the detection system includes the following steps:
[0104] The system receives a detection request from the lower housing and sends a detection command to the controller, so that the controller controls the drive device to drive the image acquisition device and the light source to move back and forth along the length of the glued area of the lower housing, and the image acquisition device acquires the detection image.
[0105] The detected image is received and processed for analysis to determine the compliance status of the adhesive coating area of the lower housing.
[0106] This detection method can acquire images of the entire glued area of the lower casing and process and analyze the detected images to accurately determine whether there are defects such as bubbles, foreign matter or broken glue, thereby better controlling whether the glue coating of the lower casing is qualified.
[0107] In one embodiment of this application, the detection instruction includes the steps of acquiring at least a first image and a second image, receiving the detection images, and processing and analyzing them to determine the compliance status of the adhesive coating area of the lower housing, including:
[0108] The system receives a first image and a second image sent by the controller and performs image fusion processing to eliminate image reflections and obtain a target detection image of the coated area.
[0109] Based on the target detection image, determine whether the adhesive-coated area meets the standards.
[0110] Because the positions and emission angles of the first and second light sources are different, the positions of the reflective areas in the first and second images are different. After the server performs image fusion on the two, it can eliminate the reflective areas and obtain a more realistic and complete detection image of the glue-coated area. This prevents missed detections due to reflections or obstruction by the box. Using this target detection image as the basis for judgment, a more accurate judgment of the glue coating situation can be obtained, thereby improving the detection accuracy.
[0111] In one embodiment of this application, the step of receiving a first image and a second image sent by a controller and performing image fusion processing to eliminate image reflection and obtain a target detection image of the coated area includes:
[0112] The first image and the second image are processed to obtain a first grayscale image and a second grayscale image, respectively.
[0113] The first grayscale image and the second grayscale image are binarized to obtain binarized grayscale. Figure 1 and two Value-based grayscale Figure 2 ;
[0114] Obtain the binarized grayscale Figure 1 and two Value-based grayscale Figure 2 The intersection area is used to obtain a non-reflective area;
[0115] According to the binarized grayscale Figure 1 and two Value-based grayscale Figure 2 In addition to non-reflective areas, the highlight and shadow areas of the first image and the highlight and shadow areas of the second image are calculated.
[0116] Based on the highlight and shadow areas of the first and second images respectively, preset weights are set to superimpose the two to obtain the target detection image.
[0117] In this detection method, the server performs fusion processing on the first image and the second image. Grayscale processing and binarization processing can determine the position of each pixel in the first image and the second image, so that when the two are superimposed, it is easier to eliminate reflective areas and obtain the target detection image.
[0118] In one embodiment of this application, the step of superimposing the target detection image by setting preset weights based on the highlight and shadow regions of the first image and the second image respectively to obtain the target detection image includes:
[0119] Let x be the weight of the shadowed area at the overlapping position of the first image and the second image, and let 1-x be the weight of the other image;
[0120] Set the highlighted area of one of the first and second images to 0, and the shadow area of the corresponding position of the other image to 1;
[0121] The first image and the second image are superimposed to obtain the target detection image.
[0122] In this method, when overlapping portions of both images that are in shadow, the pixel ratio of the first and second images can be chosen to be arbitrary, making the overlay process easier. Conversely, the bright areas of the first image are entirely replaced by the shadow areas of the second image, and vice versa, resulting in a target detection image with reduced glare.
[0123] In one embodiment of this application, the step of determining the compliance status of the adhesive-coated area based on the target detection image includes:
[0124] Acquire a standard detection image and compare it with the target detection image for calculation;
[0125] If the comparison values are consistent, the glued area is deemed to meet the standard.
[0126] By comparing the pixel values of each point in the target detection image with those in the standard detection image, it is possible to automatically determine whether the glued area of the lower box meets the standard, which is simple and convenient. Attached Figure Description
[0127] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on the structures shown in these drawings without creative effort.
[0128] Figure 1 This is a schematic diagram of an embodiment of the visual inspection device of this application;
[0129] Figure 2 This is a schematic diagram of the optical path of the visual inspection device in this application during the inspection process;
[0130] Figure 3 This is a flowchart of an embodiment of the detection method of the visual inspection device of this application;
[0131] Figure 4 This is a flowchart of another embodiment of the detection method of the visual inspection device of this application;
[0132] Figure 5 This is a schematic diagram of the detection system of this application;
[0133] Figure 6 for Figure 5 A schematic diagram of the detection system from another perspective;
[0134] Figure 7 for Figure 6 Exploded view of the detection system shown;
[0135] Figure 8 for Figure 7 A schematic diagram of the structure of the detection system after removing the protective cover and frame;
[0136] Figure 9 for Figure 8 Enlarged view of point A in the middle;
[0137] Figure 10 This is a flowchart of the first embodiment of the detection method of the detection system of this application;
[0138] Figure 11 This is a flowchart of the second embodiment of the detection method of the detection system of this application;
[0139] Figure 12 This is a flowchart of the third embodiment of the detection method of the detection system of this application;
[0140] Figure 13 This is a flowchart of the fourth embodiment of the detection method of the detection system of this application;
[0141] Figure 14 This is a flowchart of the fifth embodiment of the detection method of the detection system of this application;
[0142] Figure 15 This is a flowchart of the sixth embodiment of the detection method of the detection system of this application;
[0143] Figure 16 This is a flowchart of the seventh embodiment of the detection method of the detection system of this application;
[0144] Figure 17 This is a flowchart of the eighth embodiment of the detection method of the detection system of this application;
[0145] Figure 18 This is a flowchart of the ninth embodiment of the detection method of the detection system of this application;
[0146] Figure 19 This is a flowchart of the tenth embodiment of the detection method of the detection system of this application;
[0147] Figure 20This is a flowchart of the eleventh embodiment of the detection method of the detection system of this application.
[0148] Explanation of icon numbers:
[0149] label name label name 100 Detection system 222 Adjustment frame 10 Visual inspection device 30 First drive module 11 Image acquisition device 40 Second drive module 12 light source 50 Lifting mechanism 13 drive unit 51 base 20 base 52 Clamping parts 21 frame 60 Light grating gate 211 guide 70 Protective shield 22 beam 800 Glue application area 221 slider
[0150] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation
[0151] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of the embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.
[0152] It should be noted that all directional indicators (such as up, down, left, right, front, back, etc.) in the embodiments of this application are only used to explain the relative positional relationship and movement of each component in a certain specific posture (as shown in the figure). If the specific posture changes, the directional indicator will also change accordingly.
[0153] In this application, unless otherwise expressly specified and limited, the terms "connection," "fixed," etc., should be interpreted broadly. For example, "fixed" can mean a fixed connection, a detachable connection, or an integral part; it can mean a mechanical connection or an electrical connection; it can mean a direct connection or an indirect connection through an intermediate medium; it can mean the internal communication of two components or the interaction between two components, unless otherwise expressly limited. Those skilled in the art can understand the specific meaning of the above terms in this application according to the specific circumstances.
[0154] Furthermore, the use of terms such as "first" and "second" in this application is for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of those features. Additionally, the word "and / or" throughout the text means including three parallel solutions; for example, "A and / or B" includes solution A, solution B, or a solution that simultaneously satisfies A and B. Furthermore, the technical solutions of the various embodiments can be combined with each other, but this must be based on the ability of a person skilled in the art to implement them. When the combination of technical solutions is contradictory or impossible to implement, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection claimed in this application.
[0155] Batteries, as discussed in this field, can be categorized into primary batteries and rechargeable batteries based on whether they are rechargeable. Common types of rechargeable batteries include lead-acid batteries, nickel-metal hydride batteries, and lithium-ion batteries. Lithium-ion batteries are currently widely used in pure electric vehicles and hybrid vehicles. Lithium-ion batteries used in these applications have relatively lower capacity but offer higher output and charging current, as well as longer lifespans, although they are more expensive.
[0156] The batteries described in the embodiments of this application refer to rechargeable batteries. The embodiments disclosed in this application will be described below primarily using lithium-ion batteries as an example. It should be understood that the embodiments disclosed in this application are applicable to any other suitable type of rechargeable battery. The batteries mentioned in the embodiments disclosed in this application can be directly or indirectly used in suitable devices to power those devices.
[0157] The battery mentioned in the embodiments disclosed in this application refers to a single physical module comprising one or more battery cells to provide a predetermined voltage and capacity. A battery cell is the basic unit of a battery, comprising a positive electrode, a negative electrode, an electrolyte, and a separator. Lithium-ion battery cells primarily function by the movement of lithium ions between the positive and negative electrodes. Generally, they can be classified according to their packaging method as: cylindrical battery cells, cuboid battery cells, and pouch battery cells. The following discussion will primarily focus on cuboid battery cells. It should be understood that the embodiments described below are also applicable in some respects to cylindrical battery cells or pouch battery cells.
[0158] The development of battery technology must consider multiple design factors simultaneously, such as energy density, cycle life, discharge capacity, and charge / discharge rate. In the battery manufacturing process, batteries often require numerous steps and stations to complete production, measurement, and the final product. First, the positive and negative electrode sheets, electrolyte, and separator are formed into the cell shape. Then, processes such as casing, welding, and formation are performed to form a single battery cell. Multiple battery cells are then arranged side-by-side to form a battery module, which is then assembled into a casing to form a battery pack. Alternatively, multiple battery cells can be directly assembled into a battery pack structure.
[0159] To ensure a stable structure for the battery module within the casing, a layer of adhesive is typically applied to the bottom wall of the lower casing before the battery module is placed inside and securely connected to the casing via the adhesive. Excessive adhesive wastes material and results in poor thermal conductivity, while insufficient adhesive weakens the battery pack's structural strength, potentially causing the battery module to shift and posing a significant safety hazard to the vehicle. Therefore, the adhesive application process is crucial.
[0160] Currently, with technological advancements, the quality control requirements for adhesive application in lower enclosures are gradually increasing, demanding more precise monitoring of bubbles, foreign matter, and other defects on the adhesive surface. Traditional inspection methods rely on manual judgment or retrospective analysis using photographic records. Manual judgment suffers from issues of missed detections and misplacement due to human error; photographic retrospective analysis also faces problems such as missing areas due to varying angles and improper image review by human intervention, making both methods increasingly inadequate to meet market demands. While automated adhesive detection methods exist, such as using linear laser sensors to scan during adhesive application to determine application location and defects, this linear laser method is only suitable for detecting small cross-section adhesive strips and cannot meet the needs of detecting large-area adhesive applications.
[0161] Therefore, in order to solve the problems in the related technologies, this application proposes a visual inspection device, including an image acquisition device, a driving device and a controller. The controller automatically controls the operation of the driving device and drives the image acquisition device to move from one side to the opposite side along the length of the adhesive coating area, thereby obtaining the overall morphology of the adhesive coating area completely, without missing any detections, and can macroscopically observe the presence or absence of foreign objects and bubbles, thus improving the detection effect.
[0162] Please refer to Figure 1 In one embodiment of this application, the visual inspection device 10 proposed in this application includes an image acquisition device 11, a driving device 13, and a controller. The driving device 13 drives the image acquisition device 11 to move back and forth along the length of the glue coating area 800 of the lower housing, and acquires the detection image of the entire glue coating area 800. The controller is electrically connected to the image acquisition device 11 and the driving device 13 to control the acquisition of the image acquisition device 11 and the operation of the driving device 13.
[0163] The visual inspection device 10 includes a controller, an image acquisition device 11, and a drive device 13. The image acquisition device 11 can be a line scan camera or a surface camera, etc., without limitation, as long as it can acquire images of the adhesive application area 800 during movement. The drive device 13 can be a drive component that drives a transmission component to drive the image acquisition device 11 to move linearly back and forth, or it can directly drive the image acquisition device 11 to move. The drive component can be a motor or a cylinder, etc., without limitation. Under the control of the controller, the drive device 13 can drive the image acquisition device 11 to move back and forth along the length direction of the adhesive application area 800. The image acquisition device 11 can obtain an inspection image of the overall structure of the adhesive application area 800, thereby enabling a more macroscopic observation of the overall adhesive application status of the adhesive application area 800 and better assisting in judging whether the adhesive application is qualified.
[0164] The visual inspection device 10 can collect the overall appearance of the glued area 800 from a macroscopic perspective, thereby making it easy to detect whether there are defects such as bubbles, debris or broken glue in the glued area 800, and thus better control whether the glue coating of the lower box is qualified.
[0165] Please refer to Figure 1 and Figure 2 In one embodiment of this application, the visual inspection device 10 further includes a light source 12, which is disposed on one side of the image acquisition device 11 and electrically connected to the controller. The light source 12 is used to emit light toward the adhesive coating area 800.
[0166] The light source 12 can be a linear light source or a matrix point light source; no limitation is made here. The light source 12 being located on one side of the image acquisition device 11 means that the light source 12 is situated on one side of the image acquisition device 11 in the horizontal direction, at a different height. For example, the light source 12 can be located below the side of the image acquisition device 11, so that it can emit light towards the adhesive application area 800, providing supplemental lighting for the image acquisition device 11. The light source 12 can be installed independently or integrated into the mounting structure of the image acquisition device 11 as a single unit. Here, the placement of the light source 12 provides better light for the image acquisition device 11, improving the image acquisition effect.
[0167] In one embodiment of this application, the image acquisition device 11 includes a line scan camera;
[0168] And / or, the light source 12 includes a linear light source.
[0169] The line scan camera can only capture one row of pixels with a width of 1 pixel at a time. Therefore, driven by the drive device 13, it completes the acquisition of a two-dimensional image of the adhesive coating area 800 during movement. The line scan camera has higher resolution and better imaging effect, thereby further improving the image acquisition effect. It also has a certain width to match the width of the adhesive coating area 800, moving along the length of the adhesive coating area 800 to obtain a complete image of the adhesive coating area 800, avoiding missed detections.
[0170] In one example, a color line scan camera can be selected to acquire the color information of the glue-coated area 800, thereby quantifying the color information of the glue. When using a mixture of AB glue for application, the appropriate glue ratio in a certain area of the glue-coated area 800 can be determined by comparing the detection images. Of course, if the line scan camera is black and white, the presence of defects such as bubbles or foreign objects in the glue-coated area 800 can also be determined based on the brightness of the detection image.
[0171] When the image acquisition device 11 is configured as a line scan camera or not, the light source 12 is selected as a linear light source. The linear light source uses a high-power, high-brightness LED and forms a high-brightness, highly uniform light band through a special lens. The linear light source has good consistency and uniformity, and its illumination length can be designed according to the width of the adhesive coating area 800. When used in conjunction with the line scan camera, it can make the acquired detection image clearer and more complete.
[0172] In one embodiment of this application, the light source 12 includes a first light source and a second light source. The first light source is disposed on one side of the image acquisition device 11 in the moving direction, and the second light source is disposed on the other side of the image acquisition device 11 in the moving direction. The first light source and the second light source have different emission angles.
[0173] Here, both the first and second light sources can be linear light sources, located on opposite sides of the image acquisition device 11. The first light source is positioned on one side of the image acquisition device 11 in the moving direction, i.e., closer to the adhesive coating area 800 in the length direction, while the second light source is on the other side of the image acquisition device 11 in the moving direction, i.e., closer to the adhesive coating area 800 in the length direction. The first and second light sources have different emission directions. In one example, both emission axes are inclined towards the image acquisition device 11, thereby enabling illumination at different positions within the adhesive coating area 800 and improving the image acquisition effect.
[0174] At least one of the first light source and the second light source can be selected for supplementary lighting, thereby providing supplementary lighting from different directions and obtaining at least two images of reflections from different positions. This provides more effective detection images for subsequent judgment and avoids missed detections.
[0175] In one embodiment of this application, the controller is further configured to turn on the first light source and control the image acquisition device 11 to move from one side of the adhesive coating area 800 along its length to the opposite side; turn on the second light source and control the image acquisition device 11 to move from one side of the adhesive coating area 800 along its length to the opposite side.
[0176] The controller stands with one long side facing the adhesive coating area 800. For example, the first light source is near the left side of the adhesive coating area 800 along its length, and the second light source is near the right side of the adhesive coating area 800. When the first light source is turned on, the controller simultaneously moves the image acquisition device 11 from the left side to the right side of the adhesive coating area 800 to acquire the first image. When the second light source is turned on, the controller moves the image acquisition device 11 from the right side to the left side of the adhesive coating area 800 to acquire the second image. This structure enables the automatic acquisition of at least two images with different reflective positions, improving detection efficiency.
[0177] In one embodiment of this application, the light source 12 is movably disposed relative to the image acquisition device 11 to adjust the emission angle of the light source 12 relative to the horizontal plane;
[0178] And / or, the angle between the emission angle of the light source 12 and the axis of the image acquisition device 11 is greater than or equal to 30° and less than or equal to 60°.
[0179] In one example, the image acquisition device 11 is mounted on a fixed frame and positioned facing the adhesive application area 800. The light source 12 is mounted on an adjusting frame 222 and also facing the adhesive application area 800. The adjusting frame 222 is movably mounted on the fixed frame, thereby adjusting the angle of the light source 12 relative to the image acquisition device 11, that is, adjusting the emission angle of the light source 12 relative to the horizontal plane. In an optional example, multiple adjusting holes are formed at both ends of the adjusting frame 222, and the multiple adjusting holes are arranged in an arc shape. The fixed frame has fixing holes, which are threadedly connected to different adjusting holes, thereby changing the tilt angle of the adjusting frame 222 relative to the horizontal plane, that is, changing the emission angle of the light source 12. In other examples, the adjusting frame 222 and the fixed frame can also be fitted with a shaft hole, and the rotation angle can be limited by other fasteners.
[0180] Here, the emission angle of the light source 12 relative to the horizontal plane can be adjusted, so as to change according to different types and sizes of the lower box, thereby obtaining more accurate detection images.
[0181] The angle between the emission angle of the light source 12 and the axis of the image acquisition device 11 should not be too large or too small; otherwise, the light reflected into the image acquisition device 11 will be reduced or even nonexistent, failing to provide supplementary lighting. Therefore, in one example, the angle between the emission angle of the light source 12 and the axis of the image acquisition device 11 is set to a range greater than or equal to 30° and less than or equal to 60°, such as 30°, 35°, 40°, 45°, etc., which can further facilitate the image acquisition device 11 in obtaining a more realistic and clear detection image.
[0182] Please refer to Figure 3 This application also proposes a detection method for a visual inspection device, the visual inspection device including a driving device, an image acquisition device, and a controller, the detection method including the following steps:
[0183] Step S1: Send a drive command to the drive device so that the drive device drives the image acquisition device to move back and forth along the length of the glue coating area of the lower housing, and at the same time send an image acquisition command to the image acquisition device so that the image acquisition device acquires the detection image of the glue coating area.
[0184] Step S2: Acquire the detected image and send it to the server.
[0185] In this detection method, in step S1, the controller, i.e., the lower-level machine, simultaneously sends a drive command and an image acquisition command, causing the drive device to move the image acquisition device along the length of the adhesive coating area and simultaneously acquire images. The width of the image acquisition device is set to match the width of the adhesive coating area, so that a single scan of the adhesive coating area, driven by the drive device, can obtain an overall morphological image of the coating area. In step S2, the controller can send a command to obtain the detection image from the image acquisition device and send it to the server for analysis and processing. Optionally, the controller can also store the detection image on the local disk.
[0186] By controlling the drive device and the image acquisition device, the detection image of the overall shape of the glue coating area can be automatically acquired, which can facilitate the macroscopic judgment of defects in the glue coating area. For example, it can detect bubbles and foreign objects and reduce the risk of missed detection.
[0187] Please refer to Figure 4 In one embodiment of this application, the visual inspection device includes a first light source and a second light source. The first light source is disposed on one side of the image acquisition device in the direction of movement, and the second light source is disposed on the other side of the image acquisition device in the direction of movement. The first light source and the second light source have different emission angles. The detection method of the visual inspection device includes:
[0188] Step S11: Send a command to turn on the first light source;
[0189] Step S12: Send a driving command to the driving device to move the image acquisition device from the side of the adhesive application area closer to the first light source to the opposite side, and at the same time send an acquisition command to the image acquisition device to acquire the first image;
[0190] Step S13: Acquire the first image and send it to the server;
[0191] Step S14: Send a command to turn on the second light source and turn off the first light source;
[0192] Step S15: Send a driving command to the driving device to move the image acquisition device from the side of the adhesive area closer to the second light source to the opposite side, and at the same time send an acquisition command to the image acquisition device to acquire the second image;
[0193] Step S16: Obtain the second image and send it to the server.
[0194] The device stands facing one long side of the adhesive-coated area. For example, the first light source is near the left side of the adhesive-coated area along its length, and the second light source is near the right side. When the first light source is turned on, the controller simultaneously moves the image acquisition device from the left to the right side of the adhesive-coated area to acquire a first image. When the second light source is turned on, the image acquisition device moves from the right to the left side of the adhesive-coated area to acquire a second image. This detection method, through the cooperation of the first light source and the driving device, can obtain a first image with a reflective area, and through the cooperation of the second light source and the driving device, can obtain a second image with a reflective area, achieving automatic acquisition of at least two images with different reflective positions, thus improving detection efficiency. Because the positions and emission angles of the first and second light sources are different, the reflective areas of the first and second images are in different positions. Therefore, the two images can be combined to obtain a more realistic and complete detection image of the adhesive-coated area, preventing missed detections due to reflections or obstruction by the enclosure, and providing better image data for the server. This detection method can improve detection accuracy.
[0195] Please refer to Figures 5 to 7 This application also proposes a detection system 100, including a visual inspection device 10 and a server. The visual inspection device 10 is the same as described above. The server is electrically connected to the controller and is used to receive and determine the compliance status of the glued area 800 based on the detection image. Since the visual inspection device 10 of the testing system adopts all the technical solutions of all the above embodiments, it has at least all the beneficial effects brought about by the technical solutions of the above embodiments, which will not be described in detail here.
[0196] The visual inspection device 10 can capture the overall appearance of the glued area 800 from a macroscopic perspective. The server can make more accurate judgments based on the inspection images, thereby improving the accuracy of the glued area 800's glue application. The inspection images obtained by the visual inspection device 10 can easily detect whether there are defects such as bubbles, debris, or broken glue in the glued area 800, thus better controlling whether the glue application of the lower box is qualified.
[0197] Please refer to Figures 7 to 8 In one embodiment of this application, the detection system 100 further includes a base 20, the base 20 including two opposing frames 21 and a crossbeam 22 slidably connected to the two frames 21, and the lower box is placed between the two frames 21.
[0198] The driving device 13 of the visual inspection device 10 is installed on the frame 21 and driven to be connected to the crossbeam 22. The image acquisition device 11 is located on the crossbeam 22 and above the glue application area 800 of the lower box, so as to reciprocate in the length direction of the glue application area 800 under the drive of the driving device 13.
[0199] In one example, the two frames 21 are arranged in a cuboid structure, having a length direction and a width direction. Plates can be connected to the periphery and upper surface of the frames 21 to form a cabinet structure, capable of housing some electrical control components and wiring, thus making the detection system 100 more organized. Optionally, support feet are connected to the bottom of the frames 21 to facilitate height adjustment, movement, and support. The crossbeam 22 is a cuboid structure, with its length direction equal to the width direction of the frames 21; therefore, both ends of the crossbeam 22 are slidably connected to the upper surfaces of the two frames 21. The image acquisition device 11 is installed on the crossbeam 22, and can be positioned in the middle of the crossbeam 22 as needed. The lower housing is located between the two frames 21 and corresponds to the image acquisition device 11, thus facilitating the acquisition of images of the complete adhesive application area 800. One or two drive devices 13 can be installed on the frame 21 and driven by the crossbeam 22. This allows the crossbeam 22 to move along the length of the frame 21. The length of the adhesive application area 800 of the lower housing is aligned with the length of the frame 21, thus driving the image acquisition device 11 to move along the length of the adhesive application area 800, enabling image acquisition in a single pass. In other examples, the image acquisition device 11 can also be driven to move along the width of the adhesive application area 800, acquiring a portion of the image before scanning again to complete the entire image acquisition.
[0200] Here, the frame 21 provides an installation base for the drive device 13 and limits the lower housing to form a safe testing environment. The crossbeam 22 can provide a relatively stable moving support for the image acquisition device 11, so that the moving direction of the image acquisition device 11 can be better aligned with the length direction of the glued area 800 of the lower housing, thereby improving the acquisition accuracy.
[0201] In one example, the drive unit 13 may include a drive component and a transmission component. The drive component is a motor, and the transmission component may be a lead screw and a slider 221. For example, a lead screw is provided on the frame 21, and nut sliders 221 that cooperate with the lead screw are provided at both ends of the crossbeam 22, so that the lead screw is driven to rotate under the drive of the motor, causing the nut sliders 221 to move horizontally. Alternatively, a belt can be provided, and the motor drives the belt to rotate, thereby moving the image acquisition device 11. At the same time, a guide rail 211 is also provided on the upper surface of the frame 21, so that the movement of the image acquisition device 11 is more stable. A tank chain is also provided above the frame 21, which can provide traction and protection for the cables of the devices on the crossbeam 22. Optionally, a support column is also provided above the frame 21, and the transmission component and the tank chain are set on the support column, while the drive component is set on the frame 21, thereby achieving better drive.
[0202] Please refer to Figure 8 and Figure 9In one embodiment of this application, the detection system 100 further includes a first driving module 30 and a light source 12. The light source 12 is disposed on one side of the image acquisition device 11. The first driving module 30 is disposed on the crossbeam 22 and drives the image acquisition device 11 and the light source 12 to reciprocate in the width direction of the adhesive coating area 800.
[0203] Here, the type of light source 12 can refer to the type in the above embodiment. The light source 12 is located on one side of the image acquisition device 11, for example, the light source 12 is located below the side of the image acquisition device 11 and emits light to the adhesive coating area 800. The setting of the light source 12 can provide supplementary lighting for the image acquisition device 11, thereby improving the acquisition effect of the detected image. At the same time, the setting of the first driving module 30 can make the image acquisition device 11 reciprocate in the width direction of the adhesive coating area 800. For example, when the size of the lower box is non-standard and has a large width value, the image acquisition device 11 has a certain acquisition field of view. By moving the image acquisition device 11 in the length direction of the adhesive coating area 800, half of the image is acquired, and then it moves in the width direction to the other half of the adhesive coating area 800, and then moves along the length direction of the adhesive coating area 800, thereby acquiring the complete image. The setting of this structure can match the image acquisition device 11 and the light source 12 with lower boxes of different width sizes, thereby performing image acquisition of the entire adhesive coating area 800 and improving adaptability.
[0204] In one example, the first drive module 30 includes a first drive motor and a transmission component. The first drive motor is mounted on a crossbeam 22, and the transmission component consists of a first lead screw and a first nut slider 221. The image acquisition device 11 and the light source 12 are mounted on the first nut slider 221. The drive component drives the image acquisition device 11 to move horizontally relative to the crossbeam 22. Optionally, a tank chain is also provided on the crossbeam 22 to provide traction and cable protection when the device moves on the crossbeam 22.
[0205] In one embodiment of this application, the detection system 100 further includes a second drive module 40. The crossbeam 22 is equipped with a slider 221. The first drive module 30 drives and connects to the slider 221. The second drive module 40 is installed on the slider 221 and drives and connects to the image acquisition device 11 and the light source 12, so as to drive the image acquisition device 11 and the light source 12 to reciprocate in the thickness direction of the adhesive coating area 800.
[0206] The second drive module 40 includes a second drive motor, which is mounted on the first nut slider 221 and drives a fixed frame. The image acquisition device 11 is mounted on the fixed frame and moves back and forth under the drive of the second drive motor. The light source 12 is mounted on an adjustment frame 222, which is movable relative to the fixed frame to adjust the emission angle of the light source 12, thereby matching the glue application area 800 of the lower housing of different sizes.
[0207] The second drive module 40 can drive the image acquisition device 11 to move in the thickness direction, thereby matching the situation where the glue application area 800 is not on the same plane, so as to further improve the accuracy of detection image acquisition and improve the adaptability of the detection system 100.
[0208] Please refer to Figure 7 In one embodiment of this application, the detection system 100 further includes a lifting mechanism 50, which is disposed between the two frames 21 and driven to be connected to the lower box, so as to drive the lower box to reciprocate in the vertical direction.
[0209] In one example, a lifting mechanism 50 is positioned between two frames 21, capable of vertically lifting and lowering the lower housing of the incoming material. The type of lifting mechanism 50 is not limited; it can be driven vertically by a cylinder or by a motor to achieve vertical movement of the lower housing. Here, the lifting mechanism 50 is configured to lift all lower housings to the same height, thus accommodating lower housings of different heights and dimensions. This ensures that the acquisition distance between the image acquisition device 11 and the adhesive application area 800 remains consistent, thereby improving the accuracy of image acquisition.
[0210] In one embodiment of this application, the lifting mechanism 50 includes a base 51, a lifting assembly disposed on the base 51, and two clamping members 52 disposed opposite to each other. The two clamping members 52 can move toward or away from each other to clamp or release the lower housing. The lifting assembly drives the clamping members 52 to drive the clamping members 52 to rise or fall.
[0211] In one example, the lifting mechanism 50 includes a base 51, which may include support columns and feet to achieve a stable support effect and installation foundation. The lifting assembly may include a lifting drive and a lifting platform connected thereto. The lifting drive is mounted on the base 51, and a clamping member 52 is connected to the lifting platform, allowing it to move vertically under the drive of the platform. Placing the lower housing on the lifting platform and clamping it with the clamping member 52 effectively improves the stability of the lower housing. The clamping member 52 can be a clamping cylinder, i.e., a cylinder drives a clamping plate to secure the lower housing. By fixing the lower housing with the clamping member 52, it becomes more stable during the lifting process, preventing it from falling.
[0212] In another example, two lifting mechanisms 50 can be provided, which are clamped around the lower housing by clamping members 52, thereby further improving the stability of the lower housing during the lifting process.
[0213] In one embodiment of this application, the server is used to send a detection command to the controller so that the image acquisition device 11 acquires at least two detection images;
[0214] The server is also used to acquire at least two detection images, and after performing image fusion on the at least two detection images to eliminate image reflection, determine the compliance status of the adhesive coating area 800.
[0215] The server, also known as the host computer, issues different detection schemes based on the detection needs. Here, because the images acquired by the image acquisition device 11 with the assistance of the light source 12 will exhibit varying degrees of reflection, in order to improve the quality of the detection images, the server sends a command to acquire at least two detection images when issuing the detection command to the controller. The controller then acquires the images using the method described above, where the visual inspection device 10 acquires the first and second images. The server eliminates reflections by fusing the two detection images, i.e., the first and second images, to improve the authenticity and effectiveness of the detection images. Based on these detection images, the server can make more accurate judgments, thereby improving the accuracy of detecting the adhesive application status of the adhesive-coated area 800.
[0216] Please continue to refer to Figure 7 In one embodiment of this application, the detection system 100 further includes two grating gates 60, and a detection channel is formed between the two frames 21. The extension direction of the detection channel is consistent with the length direction of the adhesive coating area 800. The detection channel has an entrance and an exit that are arranged opposite to each other. One grating gate 60 is located at the entrance of the detection channel, and the other grating gate 60 is located at the exit of the detection channel.
[0217] The grating gate 60 includes two oppositely arranged transmitting and receiving ends. Infrared light transmitted by the transmitting end is received by the receiving end, allowing for the transmission of a normal signal. If the receiving end does not receive light, it indicates an obstruction, and a signal indicating an obstruction can be transmitted. The two frames 21 form an entrance and an exit in the width direction. The detection channel formed by the frames 21, with openings at both ends, facilitates the entry and exit of the trolley transporting the lower box. By installing grating gates 60 at the entrance and exit, the detection within the detection channel can be protected against external interference, improving detection safety. In one example, the receiving end of one grating gate 60 is installed at the entrance end of one frame 21, and the receiving end is installed at the opposite entrance end of the other frame 21. The receiving end of the other grating gate 60 is installed at the exit end of one frame 21, and the receiving end is installed at the opposite exit end of the other frame 21.
[0218] In one embodiment of this application, the detection system 100 includes an origin sensor and a limit sensor. The origin sensor is located at the initial position of the image acquisition device 11 and the light source 12, and the limit sensor is located on the moving path of the image acquisition device 11 and the light source 12.
[0219] The origin sensor can be located at the end of frame 21 near the entrance. At the start of each detection, the image acquisition device 11 is first controlled to return to the origin sensor. It can be a displacement sensor. The origin sensor allows the image acquisition device 11 and the light source 12 to accurately reset, enabling a reset check during each detection to calibrate the detection system 100 and improve detection accuracy. Limit sensors can be installed according to the dimensions of the lower housing. These limit sensors detect whether the image acquisition device 11 has moved to the correct position in the moving direction, thereby improving the self-testing performance of the detection system 100.
[0220] In one example, the detection system 100 also includes a protective cover 70 for covering the top of the frame 21 and covering the crossbeam 22 and the image acquisition device 11, thereby forming a better protective space, avoiding external interference, and improving detection accuracy and efficiency.
[0221] Please refer to Figure 10 This application further proposes a detection method for a detection system, the detection system including a visual inspection device, a server, and a light source, and the detection method of the detection system including the following steps:
[0222] Step S100: The server receives the detection request from the lower enclosure and sends the detection command to the controller;
[0223] Step S200: The controller receives the detection command and sends a drive command to the drive device, and at the same time sends an acquisition command to the image acquisition device;
[0224] Step S300: The driving device drives the image acquisition device and the light source to reciprocate along the length of the glue coating area of the lower housing. The image acquisition device acquires and detects the image and sends it to the controller.
[0225] Step S400: The server receives the detection image sent by the controller and processes and analyzes it to determine the compliance status of the glue coating area of the lower housing.
[0226] In step S100 of the above method, when the lower housing is about to enter the inspection channel, a request for inspection can be sent to the server. The server confirms that inspection is possible based on the inspection environment and can choose to open the light gate at the entrance, allowing the trolley to carry the lower housing into the inspection channel. In step S200, the controller controls the drive device and image acquisition device to operate according to the inspection command to acquire the inspection image. In step S300, the drive device drives the image acquisition device to acquire the image of the glue-coated area, which is a movement in the length direction. In other examples, the movement can also be in the width direction according to the size and shape of the glue-coated area. In step S400, after receiving the inspection image, the server performs a series of processing and analysis, such as quantizing its coordinates and comparing it with a standard image. If the coordinate positions of each pixel are the same, it indicates that the glue-coating position of the glue-coated area meets the standard. Otherwise, it does not meet the standard. Alternatively, the inspection image can be converted to grayscale to determine whether there are obvious dark spots or bright spots, in order to detect defects such as bubbles or debris.
[0227] This detection method can acquire images of the entire glued area of the lower casing and process and analyze the detected images to accurately determine whether there are defects such as bubbles, foreign matter or broken glue, thereby better controlling whether the glue coating of the lower casing is qualified.
[0228] Please refer to Figure 11 In one embodiment of this application, step S200, where the controller receives the detection command and sends a drive command to the drive device, and simultaneously sends an acquisition command to the image acquisition device, includes:
[0229] Step S201: The controller receives the detection command and sends a reset command to the drive device;
[0230] Step S202: The driving device drives the image acquisition device and the light source back to the initial detection position;
[0231] Step S203: The controller sends a drive command to the drive device and a data acquisition command to the image acquisition device.
[0232] In this method, when the server receives a detection request, it can send a detection command to the controller. The controller first controls the image acquisition device to reset and move to the initial detection position, i.e., the starting point for each detection, and then controls the movement to acquire images. This starting point can be set as needed, for example, at the end of the frame near the entrance. Calibration is performed by setting an origin sensor.
[0233] By setting a reset procedure, each test can be performed from the same location, improving the accuracy and consistency of the test.
[0234] Please refer to Figure 12In one embodiment of this application, the light source includes a first light source and a second light source. The first light source is disposed on one side of the image acquisition device in the direction of movement, and the second light source is disposed on the other side of the image acquisition device in the direction of movement. The first light source and the second light source have different emission angles. The detection command includes acquiring at least a first image and a second image. The detection method includes:
[0235] Step S2031: The controller issues a command to turn on the first light source and turn off the second light source, and sends a first drive command;
[0236] Step S301: The driving device receives the first driving command and drives the image acquisition device and the light source to move from one side of the glue coating area of the lower housing to the opposite side along the length direction. The image acquisition device acquires the first image and sends it to the controller.
[0237] Step S2032: The controller issues a command to turn on the second light source and turn off the first light source, and sends a second drive command;
[0238] Step S302: The driving device receives the second driving command and drives the image acquisition device and the light source to move from the other side of the glue coating area of the lower housing to the opposite side. The image acquisition device acquires the second image and sends it to the controller.
[0239] Step S401: The server receives the first image and the second image sent by the controller and performs image fusion processing to eliminate image reflection and obtain the target detection image of the coated area;
[0240] Step S402: The server determines the compliance status of the glued area based on the target detection image.
[0241] Both the first and second light sources can be linear light sources, located on opposite sides of the image acquisition device. The first light source is positioned on one side of the image acquisition device in the direction of movement, i.e., closer to the adhesive coating area along its length, while the second light source is on the other side in the same direction of movement, also closer to the adhesive coating area along its length. The first and second light sources have different emission directions. In one example, both emission axes are inclined towards the image acquisition device, thereby enabling illumination at different locations within the adhesive coating area and improving the image acquisition effect.
[0242] The device stands facing one long side of the adhesive-coated area. For example, the first light source is near the left side of the adhesive-coated area along its length, and the second light source is near the right side. When the first light source is turned on, the controller simultaneously moves the image acquisition device from the left side to the right side of the adhesive-coated area to acquire a first image. When the second light source is turned on, the controller moves the image acquisition device from the right side to the left side of the adhesive-coated area to acquire a second image. This structure enables the automatic acquisition of at least two images with different reflective positions, improving detection efficiency.
[0243] By cooperating with a first light source and a driving device, a first image with a reflective area can be obtained. By cooperating with a second light source and a driving device, a second image with a reflective area can be obtained. Because the positions and emission angles of the first and second light sources are different, the positions of the reflective areas in the first and second images are different. After the server fuses the two images, the reflective areas can be eliminated, resulting in a more realistic and complete detection image of the glue-coated area. This prevents missed detections due to reflections or obstruction by the enclosure. Using this target detection image as the basis for judgment, a more accurate assessment of the glue coating status can be obtained, improving detection accuracy.
[0244] Please refer to Figure 13 In one embodiment of this application, step S401, in which the server receives a first image and a second image sent by the controller and performs image fusion processing to eliminate image reflections and obtain a target detection image of the coated area, includes:
[0245] Step S4011: The server performs grayscale processing on the first image and the second image respectively to obtain a first grayscale image and a second grayscale image.
[0246] Step S4012: The server performs binarization processing on the first grayscale image and the second grayscale image to obtain binarized grayscale. Figure 1 and two Value-based grayscale Figure 2 ;
[0247] Step S4013: The server obtains the binarized grayscale value. Figure 1 and two Value-based grayscale Figure 2 The intersection area is used to obtain a non-reflective area;
[0248] Step S4014: The server calculates the binarized grayscale value... Figure 1 and two Value-based grayscale Figure 2 In addition to non-reflective areas, the highlight and shadow areas of the first image and the highlight and shadow areas of the second image are calculated.
[0249] Step S4015: The server sets a preset weight based on the highlight and shadow areas of the first image and the second image respectively, and superimposes the two to obtain the target detection image.
[0250] In this detection method, step S4011, grayscale processing, refers to converting the first image and the second image to grayscale using a grayscale algorithm to form their respective grayscale images. Step S4012, binarization processing, refers to binarizing the values of each pixel in the image. For example, a brightness value greater than a certain preset value is assigned a value of 1, and a brightness value less than the preset value is assigned a value of 0, thus forming their respective binarized grayscale images. Step S4013 involves obtaining the intersection region of the two images, i.e., the binarized grayscale value. Figure 1 and two Value-based grayscale Figure 2 The set of pixels with identical coordinates and values is obtained, which represents the non-reflective areas in both images. In step S4014, the non-reflective areas are mapped to the positions in the original first and second images to obtain the shadow areas; the remaining blank areas are the highlight areas. In step S401, the pixels of the marked first and second images are weighted and overlapped to obtain the final target detection image.
[0251] The server performs fusion processing on the first and second images. Grayscale processing and binarization processing can determine the position of each pixel in the first and second images, making it easier to eliminate reflective areas and obtain a target detection image when the two are superimposed.
[0252] Please refer to Figure 14 In one embodiment of this application, the step of superimposing the target detection image by setting preset weights based on the highlight and shadow regions of the first image and the second image respectively to obtain the target detection image includes:
[0253] Step S40151: The server sets the weight of the shadow area at the overlapping position of the first image and the second image to be x, and the weight of the other image to be 1-x;
[0254] Step S40152: The server sets the highlight area weight of one of the first image and the second image to 0, and the shadow area weight of the corresponding position of the other image to 1;
[0255] Step S40153: The server overlays the first image and the second image to obtain the target detection image.
[0256] In this method, when overlapping portions of both the first and second images that are shadowed areas, the ratio of pixel values can be chosen arbitrarily to facilitate overlay. For example, if the ratio of the shadowed areas in the first image is 0.5, then the ratio of the shadowed areas in the second image is also 0.5, and the superimposed shadowed areas still represent the original image. Conversely, the highlighted areas of the first image are set to 0% and entirely replaced by the shadowed areas of the second image, and vice versa, thus obtaining a target detection image with anti-reflection properties.
[0257] Please refer to Figure 15 In one embodiment of this application, the step of determining the compliance status of the adhesive-coated area based on the target detection image includes:
[0258] Step S4021: The server acquires a standard detection image and performs a comparison calculation with the target detection image;
[0259] Step S4022: If the comparison values are consistent, the server determines that the glued area meets the standard.
[0260] In this detection method, the detection image has undergone coordinate quantization and color quantization. If the pixel values at the same location in the standard detection image and the target detection image are the same, it indicates that the glue application position in the glued area meets the standard. Otherwise, it does not meet the standard. Alternatively, the detection image can be converted to grayscale to determine whether there are obvious dark spots or bright spots in the target detection image, in order to detect defects such as bubbles or foreign matter. Another method is to compare the RGB values of the target detection image with the RGB values of the standard detection image; if they are the same, it can be determined that the AB glue ratio in the glued area also meets the standard.
[0261] Thus, this detection method can automatically determine whether the glued area of the lower box meets the standard by comparing the pixel values of each point in the target detection image and the standard detection image. It can also detect bubbles, impurities, and glue ratio at the same time, which is simple and convenient.
[0262] Please refer to Figure 16 In one embodiment of this application, the detection system further includes a lifting structure, and after the step of driving the image acquisition device and the light source back to the initial detection position, the system includes the following steps:
[0263] Step S2021: The controller sends a lifting command to the lifting mechanism;
[0264] Step S2022: The lifting mechanism raises the lower box to a preset height so that the tray supporting the lower box is parallel to the horizontal plane.
[0265] Here, the lifting mechanism can lift all the lower boxes to the same height, thus matching lower boxes of different heights and sizes, ensuring that the image acquisition device maintains a consistent acquisition distance from the adhesive application area, thereby improving the accuracy of image acquisition.
[0266] Please refer to Figure 17 In one embodiment of this application, after the lifting mechanism raises the lower box to a preset height so that the tray carrying the lower box is parallel to the horizontal plane, the method further includes:
[0267] Step S2023: The controller issues a detection command to detect whether the glued area of the lower housing is on a horizontal plane;
[0268] Step S2024: If not, the controller sends a leveling drive command to the drive device;
[0269] Step S2025: The driving device drives the image acquisition device to move along the length of the adhesive coating area of the lower housing and simultaneously in the vertical direction, so that the moving path of the image acquisition device is parallel to the surface of the adhesive coating area, and acquires a detection image.
[0270] Here, the driving device drives the image acquisition device to move in the length direction, and the second driving module can drive the image acquisition device to move in the thickness direction, that is, in the vertical direction. This can match the situation where the glue coating area is not on the same plane, so that the moving path of the image acquisition device is always parallel to the surface of the glue coating area, thereby further improving the accuracy of detection image acquisition and improving the adaptability of the detection system.
[0271] Please refer to Figure 18 This application further proposes a detection method for a detection system, the detection system including a visual inspection device, a server, and a light source, and the detection method of the detection system including the following steps:
[0272] Step S1': Receive the detection request of the lower box and send the detection command to the controller, so that the controller controls the drive device to drive the image acquisition device and the light source to move back and forth in the length direction of the glue coating area of the lower box, and causes the image acquisition device to acquire the detection image;
[0273] Step S2': Receive the detected image and process and analyze it to determine the compliance status of the adhesive coating area of the lower box.
[0274] In step S1' of the above method, when the lower box is about to enter the inspection channel, a request for inspection can be sent to the server. The server confirms that inspection is possible based on the inspection environment and can choose to open the light gate at the entrance, allowing the trolley to carry the lower box into the inspection channel. The controller controls the drive unit and image acquisition unit to operate according to the inspection command to acquire the inspection image. The drive unit drives the image acquisition unit to acquire the image of the glued area, which is a movement in the length direction. In other examples, the movement can also be in the width direction according to the size and shape of the glued area. In step S2', after receiving the inspection image, the server performs a series of processing and analysis, such as quantizing its coordinates and comparing it with a standard image. If the coordinate positions of each pixel are the same, it indicates that the glued area meets the standard. Otherwise, it does not meet the standard. Alternatively, the inspection image can be converted to grayscale to determine if there are obvious dark spots or bright spots, in order to detect defects such as bubbles or debris.
[0275] This detection method can acquire images of the entire glued area of the lower casing and process and analyze the detected images to accurately determine whether there are defects such as bubbles, foreign matter or broken glue, thereby better controlling whether the glue coating of the lower casing is qualified.
[0276] Please refer to Figure 19 In one embodiment of this application, the detection instruction includes the steps of acquiring at least a first image and a second image, receiving the detection images, and processing and analyzing them to determine the compliance status of the adhesive coating area of the lower housing, including:
[0277] Step S21': Receive the first image and the second image sent by the controller and perform image fusion processing to eliminate image reflection and obtain the target detection image of the coated area;
[0278] Step S22': Determine the compliance status of the adhesive-coated area based on the target detection image.
[0279] Because the positions and emission angles of the first and second light sources are different, the positions of the reflective areas in the first and second images are different. After the server performs image fusion on the two, it can eliminate the reflective areas and obtain a more realistic and complete detection image of the glue-coated area. This prevents missed detections due to reflections or obstruction by the box. Using this target detection image as the basis for judgment, a more accurate judgment of the glue coating situation can be obtained, thereby improving the detection accuracy.
[0280] Please refer to Figure 20 In one embodiment of this application, the step of receiving a first image and a second image sent by a controller and performing image fusion processing to eliminate image reflection and obtain a target detection image of the coated area includes:
[0281] Step S211': Perform grayscale processing on the first image and the second image respectively to obtain a first grayscale image and a second grayscale image;
[0282] Step S212': Perform binarization processing on the first grayscale image and the second grayscale image to obtain binarized grayscale. Figure 1 and two Value-based grayscale Figure 2 ;
[0283] Step S213': Obtain the binarized grayscale Figure 1 and two Value-based grayscale Figure 2 The intersection area is used to obtain a non-reflective area;
[0284] Step S214': Based on the binarized grayscale Figure 1 and two Value-based grayscale Figure 2 In addition to non-reflective areas, the highlight and shadow areas of the first image and the highlight and shadow areas of the second image are calculated.
[0285] Step S215': Based on the highlight and shadow areas of the first image and the second image respectively, set preset weights and superimpose the two to obtain the target detection image.
[0286] In this detection method, step S211', grayscale processing, refers to converting the first image and the second image to grayscale using a grayscale algorithm to form their respective grayscale images. Step S212', binarization processing, refers to binarizing the values of each pixel in the image; for example, a brightness value greater than a preset value is assigned a value of 1, and a brightness value less than the preset value is assigned a value of 0, thus forming their respective binarized grayscale images. Step S213', obtaining the intersection region of the two images, i.e., the binarized grayscale value, is then performed. Figure 1 and two Value-based grayscale Figure 2 The set of pixels with identical coordinates and values is obtained, which represents the non-reflective areas in both images. In step S214', the non-reflective areas are mapped to the positions in the original first and second images to obtain the shadow areas; the remaining blank areas are the highlight areas. In step S215', the pixels of the marked first and second images are weighted and overlapped to obtain the final target detection image.
[0287] The server performs fusion processing on the first and second images. Grayscale processing and binarization processing can determine the position of each pixel in the first and second images, making it easier to eliminate reflective areas and obtain a target detection image when the two are superimposed.
[0288] In one embodiment of this application, the step of superimposing the target detection image by setting preset weights based on the highlight and shadow regions of the first image and the second image respectively to obtain the target detection image includes:
[0289] Let x be the weight of the shadowed area at the overlapping position of the first image and the second image, and let 1-x be the weight of the other image;
[0290] Set the highlighted area of one of the first and second images to 0, and the shadow area of the corresponding position of the other image to 1;
[0291] The first image and the second image are superimposed to obtain the target detection image.
[0292] In this method, when overlapping portions of both the first and second images that are shadowed areas, the ratio of pixel values can be chosen arbitrarily to facilitate overlay. For example, if the ratio of the shadowed areas in the first image is 0.5, then the ratio of the shadowed areas in the second image is also 0.5, and the superimposed shadowed areas still represent the original image. Conversely, the highlighted areas of the first image are set to 0% and entirely replaced by the shadowed areas of the second image, and vice versa, thus obtaining a target detection image with anti-reflection properties.
[0293] In one embodiment of this application, the step of determining the compliance status of the adhesive-coated area based on the target detection image includes:
[0294] Acquire a standard detection image and compare it with the target detection image for calculation;
[0295] If the comparison values are consistent, the glued area is deemed to meet the standard.
[0296] By comparing the pixel values of each point in the target detection image with those in the standard detection image, it is possible to automatically determine whether the glued area of the lower box meets the standard, which is simple and convenient. A specific embodiment:
[0298] The AGV (Automated Guided Vehicle) notifies the server to allow the vehicle to enter via network interaction. After receiving the AGV signal, the server instructs the hardware and software control devices to perform a grating shielding operation and then places the vehicle in.
[0299] After the trolley enters, the device opens the entrance light curtain, and the lifting mechanism clamps the trolley and lifts it to a fixed height.
[0300] The hardware and software control device begins to control the module, namely the XYZ axis module of the gantry device. First, it performs a reset operation to return to the zero origin. Then, the XY axis module scans according to the template path set by the server. The two light sources of the imaging system are turned on alternately according to the hardware and software control device.
[0301] After the scan is completed, the lifting mechanism performs a reset operation, that is, the clamping cylinder is released and the lifting cylinder is lowered.
[0302] After the server device analyzes and processes the images acquired by the imaging system, it outputs the results to the display and uploads the data to the MES.
[0303] The software and hardware control devices are notified to disable the exit light curtain, and a message is sent to the AGV to allow it to pass. After the AGV leaves the station, the exit light curtain is reactivated, and the next cycle begins.
[0304] The above description is merely a preferred embodiment of this application and does not limit the patent scope of this application. Any equivalent structural transformations made based on the inventive concept of this application and the contents of the specification and drawings of this application, or direct / indirect applications in other related technical fields, are included within the patent protection scope of this application.
Claims
1. A vision inspection apparatus, wherein, The visual inspection device comprises: an image acquisition device; a driving device drivingly connected to the image acquisition device to drive the image acquisition device to reciprocally move along the length direction of the glue applying area of the lower box to acquire detection images of the whole glue applying area; and a controller electrically connected to the image acquisition device and the driving device to control the acquisition of the image acquisition device and the operation of the driving device. The visual inspection device further comprises a light source arranged on one side of the image acquisition device and electrically connected to the controller, and the light source is used to emit light towards the glue applying area. The light source comprises a first light source arranged on one side of the image acquisition device in the moving direction and a second light source arranged on the other side of the image acquisition device in the moving direction, and the first light source and the second light source have different exit angles. The controller is further used to turn on the first light source, control the image acquisition device to move from one side of the length direction of the glue applying area to the other side opposite to the one side, turn on the second light source, and control the image acquisition device to move from the other side of the length direction of the glue applying area to the one side opposite to the other side. The image acquisition device comprises a line-scan camera.
2. The vision inspection apparatus of claim 1, wherein, The light source comprises a linear light source. The light source is movably arranged relative to the image acquisition device to adjust the exit angle of the light source relative to the horizontal plane.
3. The vision inspection apparatus of any of claims 1 to 2, wherein, The exit angle of the light source and the angle between the axis of the image acquisition device are greater than or equal to 30° and less than or equal to 60°. The detection method comprises the following steps:
4. A method of inspection by a vision inspection apparatus as claimed in any one of claims 1 to 3, the vision inspection apparatus comprising a drive arrangement and an image capture arrangement and a controller, wherein, sending a driving instruction to the driving device to drive the image acquisition device to reciprocally move along the length direction of the glue applying area of the lower box, and simultaneously sending an image acquisition instruction to the image acquisition device to acquire detection images of the glue applying area; acquiring the detection images and sending them to a server. The visual inspection device comprises a first light source arranged on one side of the image acquisition device in the moving direction and a second light source arranged on the other side of the image acquisition device in the moving direction, and the first light source and the second light source have different exit angles, and the detection method of the visual inspection device comprises:
5. The detection method of the visual inspection apparatus according to claim 4, wherein, sending an instruction to turn on the first light source; sending a driving instruction to the driving device to drive the image acquisition device to move from one side of the glue applying area close to the first light source to the other side opposite to the one side, and simultaneously sending an acquisition instruction to the image acquisition device to acquire a first image; acquiring the first image and sending it to a server; sending an instruction to turn on the second light source and turn off the first light source; sending a driving instruction to the driving device to drive the image acquisition device to move from one side of the glue applying area close to the second light source to the other side opposite to the one side, and simultaneously sending an acquisition instruction to the image acquisition device to acquire a second image; acquiring the second image and sending it to a server. The visual inspection device comprises:
6. A detection system, wherein, a visual inspection device as claimed in any one of claims 1 to 3; and a server. A server is electrically connected with the controller, and is configured to receive and determine whether the glue application area meets the standard according to the detection image.
7. The detection system of claim 6, wherein, The detection system further comprises a base, the base comprising two frames arranged oppositely and a crossbeam slidably connected to the two frames, and the two frames are used for placing the lower box therebetween; The driving device of the visual detection device is mounted on the frame and drivingly connected to the crossbeam, and the image acquisition device is arranged on the crossbeam and above the glue application area of the lower box, so as to reciprocate in the length direction of the glue application area under the driving of the driving device.
8. The detection system of claim 7, wherein, The detection system further comprises a first driving module and a light source, the light source is arranged on one side of the image acquisition device, and the first driving module is arranged on the crossbeam and drivingly connected to the image acquisition device and the light source, so as to drive the image acquisition device and the light source to reciprocate in the width direction of the glue application area.
9. The detection system of claim 8, wherein, The detection system further comprises a second driving module, the crossbeam is provided with a sliding block, the first driving module is drivingly connected to the sliding block, and the second driving module is mounted on the sliding block and drivingly connected to the image acquisition device and the light source, so as to drive the image acquisition device and the light source to reciprocate in the thickness direction of the glue application area.
10. The detection system of any one of claims 7 to 9, wherein, The detection system further comprises a jacking mechanism, the jacking mechanism is arranged between the two frames and drivingly connected to the lower box, so as to drive the lower box to reciprocate in the vertical direction.
11. The detection system of claim 10, wherein, The jacking mechanism comprises a base, a jacking assembly arranged on the base, and two clamping members arranged oppositely, the two clamping members can move towards or away from each other to clamp or release the lower box, and the jacking assembly is drivingly connected to the clamping members to drive the clamping members to rise or fall.
12. The detection system of any one of claims 6 to 9, wherein, The server is configured to send a detection instruction to the controller, so that the image acquisition device acquires at least two detection images; The server is further configured to acquire at least two detection images, perform image fusion on the at least two detection images to eliminate image reflection, and determine whether the glue application area meets the standard.
13. The detection system of any one of claims 7 to 9, wherein, The detection system further comprises two grating doors, a detection channel is formed between the two frames, the extension direction of the detection channel is consistent with the length direction of the glue application area, the detection channel has an entrance and an exit arranged oppositely, one grating door is arranged at the entrance of the detection channel, and the other grating door is arranged at the exit of the detection channel.
14. The detection system of any one of claims 7 to 9, wherein, The detection system comprises an origin sensor and a limit sensor, the origin sensor is arranged at the initial position of the image acquisition device and the light source, and the limit sensor is arranged on the movement path of the image acquisition device and the light source.
15. A detection method of a detection system, wherein, The detection system is the detection system according to any one of claims 6 to 14, the detection system comprises a visual detection device, a server and a light source, and the detection method of the detection system comprises the following steps: The server receives a detection request of the lower box and sends a detection instruction to the controller; The controller receives the detection instruction, sends a driving instruction to the driving device, and sends an acquisition instruction to the image acquisition device; The driving device drives the image acquisition device and the light source to reciprocate in the length direction of the glue applying area of the lower box, and the image acquisition device acquires a detection image and sends it to the controller; The server receives the detection image sent by the controller and processes and analyzes it to determine whether the glue applying area of the lower box meets the standard.
16. The detection method of the detection system according to claim 15, wherein, The step of the controller receiving the detection instruction, sending a driving instruction to the driving device, and sending an acquisition instruction to the image acquisition device comprises: The controller receives the detection instruction and sends a reset instruction to the driving device; The driving device drives the image acquisition device and the light source to return to the initial detection position; The controller sends a driving instruction to the driving device and an acquisition instruction to the image acquisition device.
17. The detection method of the detection system according to claim 15, wherein, The light source comprises a first light source and a second light source, the first light source is arranged on one side of the image acquisition device in the moving direction, the second light source is arranged on the other side of the image acquisition device in the moving direction, the first light source and the second light source have different exit angles, the detection instruction comprises at least acquiring a first image and a second image, and the detection method comprises: The controller sends an instruction to turn on the first light source and turn off the second light source, and sends a first driving instruction; The driving device receives the first driving instruction and drives the image acquisition device and the light source to move from one side to the opposite side of the length direction of the glue applying area of the lower box, the image acquisition device acquires a first image and sends it to the controller; The controller sends an instruction to turn on the second light source and turn off the first light source, and sends a second driving instruction; The driving device receives the second driving instruction and drives the image acquisition device and the light source to move from the other side to the opposite side of the length direction of the glue applying area of the lower box, the image acquisition device acquires a second image and sends it to the controller; The server receives the first image and the second image sent by the controller and performs image fusion processing to eliminate image reflection and obtain a target detection image of the glue applying area; The server determines whether the glue applying area meets the standard according to the target detection image.
18. The detection method of the detection system according to claim 17, wherein, The step of the server receiving the first image and the second image sent by the controller and performing image fusion processing to eliminate image reflection and obtain a target detection image of the glue applying area comprises: The server performs grayscale processing on the first image and the second image respectively to obtain a first grayscale image and a second grayscale image; The server performs binaryzation processing on the first grayscale image and the second grayscale image to obtain a binaryzation grayscale image one and a binaryzation grayscale image two; The server obtains an intersection area of the binaryzation grayscale image one and the binaryzation grayscale image one to obtain a non-reflection area; The server calculates the highlight area and the shadow area of the first image and the highlight area and the shadow area of the second image according to the binaryzation grayscale image one, the binaryzation grayscale image two, and the non-reflection area; The server sets a preset weight according to the highlight area and the shadow area of the first image and the highlight area and the shadow area of the second image respectively, and superimposes them to obtain the target detection image.
19. The detection method of the detection system according to claim 18, wherein, The step of setting a preset weight to superimpose the first image and the second image to obtain the target detection image according to the highlight area and the shadow area of the first image and the second image respectively, comprising: The server sets the proportion of the shadow area of one of the first image and the second image to be x when they overlap, and the proportion of the other to be 1-x; The server sets the highlight area of one of the first image and the second image to be 0, and the shadow area of the corresponding position of the other to be 1; The server superimposes the first image and the second image to obtain the target detection image.
20. The detection method of the detection system according to any one of claims 17 to 19, wherein, The step of judging the standard reaching condition of the glue applying area according to the target detection image, comprising: The server obtains a standard detection image and compares it with the target detection image; If the comparison value is consistent, the server judges that the glue applying area meets the standard.
21. The detection method of the detection system according to claim 16, wherein, The detection system further comprises a jacking structure, and after the step of driving the image acquisition device and the light source to return to the initial detection position by the driving device, comprising the steps of: The controller sends a jacking instruction to the jacking mechanism; The jacking mechanism raises the lower box to a preset height so that the tray carrying the lower box is parallel to the horizontal plane.
22. The detection method of the detection system according to claim 21, wherein, After the step of raising the lower box to a preset height so that the tray carrying the lower box is parallel to the horizontal plane, further comprising: The controller sends a detection instruction to detect whether the glue applying area of the lower box is horizontal; If not, the controller sends a leveling driving instruction to the driving device; The driving device drives the image acquisition device to move in the length direction of the glue applying area of the lower box while moving in the vertical direction so that the movement path of the image acquisition device is parallel to the surface of the glue applying area, and acquires a detection image.
23. A detection method of a detection system, wherein, The detection system as claimed in any one of claims 6 to 14, comprising a visual detection device, a server and a light source, and a detection method of the detection system comprising the steps of: Receiving a detection request of the lower box and sending a detection instruction to the controller to control the driving device to drive the image acquisition device and the light source to reciprocate in the length direction of the glue applying area of the lower box, and to make the image acquisition device acquire a detection image; Receiving the detection image and processing and analyzing it to judge the standard reaching condition of the glue applying area of the lower box.
24. The detection method of the detection system according to claim 23, wherein, The detection instruction comprises at least the steps of acquiring a first image and a second image, receiving the detection image and processing and analyzing it to judge the standard reaching condition of the glue applying area of the lower box, comprising Receiving the first image and the second image sent by the controller and performing image fusion processing to eliminate image reflection, to obtain a target detection image of the glue applying area; Judging the standard reaching condition of the glue applying area according to the target detection image.
25. The detection method of the detection system according to claim 24, wherein, The step of receiving the first image and the second image sent by the controller and performing image fusion processing to eliminate image reflection, to obtain a target detection image of the glue applying area, comprising: Performing gray scale processing on the first image and the second image respectively to obtain a first gray scale image and a second gray scale image; Performing binary processing on the first gray scale image and the second gray scale image to obtain a binary gray scale image one and a binary gray scale image two; Obtaining the intersection area of the two binary gray images to obtain a non-reflective area; According to the two binary gray images and the non-reflective area, the highlight area and the shadow area of the first image and the highlight area and the shadow area of the second image are calculated; According to the highlight area and the shadow area of the first image and the second image respectively, a preset weight is set to superimpose the two to obtain the target detection image.
26. The detection method of the detection system according to claim 25, wherein, According to the highlight area and the shadow area of the first image and the second image respectively, a preset weight is set to superimpose the two to obtain the target detection image. The step of setting a preset weight to superimpose the two to obtain the target detection image according to the highlight area and the shadow area of the first image and the second image respectively, comprises: Setting the proportion of the shadow area of one of the first image and the second image at the overlapping position to be x, and the proportion of the other to be 1-x; Setting the highlight area of one of the first image and the second image to be 0, and the shadow area of the other at the corresponding position to be 1; 27. The detection method of the detection system according to any one of claims 24 to 26, wherein, Superimposing the first image and the second image to obtain the target detection image. According to the target detection image, the step of judging the standard reaching condition of the glue applying area, comprises: Obtaining a standard detection image and comparing and calculating with the target detection image; If the comparison value is consistent, it is judged that the glue applying area meets the standard.
Citation Information
Patent Citations
Online vision inspection method for surface gluing of engine and gearbox
CN106949925A
Image processing method and device, computer system and storage medium
CN114863081A