Industrial detection method and device

Abstract

The invention discloses an industrial detection method and device, and belongs to the technical field of industrial detection. The industrial detection method comprises the following steps: processing a collected template image corresponding to an energy storage device to obtain a first image corresponding to the energy storage device; based on offset information between the energy storage device and a to-be-detected image corresponding to the energy storage device and the first image, obtaining a plurality of candidate grid lines included in the to-be-detected image; and processing each candidate grid line, and determining a plurality of target grid lines included in the to-be-detected image. According to the industrial detection method, the accuracy and accuracy of grid line positioning are improved, and the industrial detection method is suitable for matched positioning of grid lines of any geometrical shape, can adapt to battery piece grid lines of screens of any specification and is wide in application scene.

Description

Technical Field

[0001] The present application belongs to the field of industrial detection technology, and in particular, relates to an industrial detection method and device. Background Art

[0002] In the photovoltaic industry, grid line defects can be detected by locating the grid lines of the cells to reduce the scrap rate of the final product. In the related positioning technology, there are methods to determine the position of the grid lines through edge extraction or contour extraction technology. The commonly used grid line positioning method has high requirements on the imaging effect of the collected cell images. It is necessary to ensure that the foreground such as the grid lines can be completely separated from the background. In the case of missing grid lines in the cell image, it is impossible to accurately screen out the complete grid lines, and the positioning precision and accuracy are low, and the applicable scenarios are limited. Summary of the invention

[0003] The present application aims to solve at least one of the technical problems existing in the related art. To this end, the present application proposes an industrial detection method and device, which improves the precision and accuracy of grid line positioning, is suitable for matching and positioning grid lines of any geometric shape, and can adapt to grid lines of battery cells with any specifications of screens, and has a wide range of application scenarios.

[0004] In a first aspect, the present application provides an industrial detection method, the method comprising:

[0005] Processing the collected template image corresponding to the energy storage device to obtain a first image corresponding to the energy storage device; the first image is used to represent the position information of the grid line of the energy storage device in the energy storage device;

[0006] Based on the offset information between the energy storage device and the image to be tested corresponding to the energy storage device and the first image, a plurality of candidate gate lines included in the image to be tested are obtained;

[0007] Each of the candidate grid lines is processed to determine a plurality of target grid lines included in the image to be tested.

[0008] According to the industrial inspection method provided in the embodiment of the present application, by processing the template image corresponding to the energy storage device, the position information of the gate line in the energy storage device is obtained, and then the gate lines obtained by modeling are converted into the image to be tested to obtain candidate gate lines, and the candidate gate lines are processed to obtain multiple target gate lines. The imaging effect of the image to be tested is not required to be high, and the complete gate lines can be accurately screened out even if the gate lines in the image to be tested are missing, thereby improving the precision and accuracy of the gate line positioning, and is suitable for matching and positioning of gate lines of any geometric shape, and can adapt to the grid lines of battery cells with any specifications of screens, and has a wide range of applicable scenarios.

[0009] The industrial inspection method of one embodiment of the present application, wherein the processing of each candidate grid line to determine a plurality of target grid lines included in the image to be inspected includes:

[0010] Perform at least one of a rotation process and a translation process on each of the candidate gate lines to obtain a plurality of first gate lines;

[0011] The target gate line is determined from the plurality of candidate gate lines based on the grayscale values ​​corresponding to all sampling points included in each of the first gate lines.

[0012] The industrial detection method of an embodiment of the present application, wherein at least one of a rotation process and a translation process is performed on each of the candidate gate lines to obtain a plurality of first gate lines, comprises:

[0013] Taking the center point of the candidate grid line as the rotation center, rotating the candidate grid line by a first angle to obtain a second grid line;

[0014] The second gate line is moved by a first translation amount to obtain the first gate line.

[0015] An industrial detection method according to an embodiment of the present application, determining the target gate line from a plurality of candidate gate lines based on the grayscale values ​​corresponding to all sampling points included in each of the first gate lines, comprises:

[0016] Obtaining grayscale mean values ​​corresponding to all sampling points included in each first grid line at a first angle;

[0017] Based on the grayscale mean value corresponding to each first grid line at the first angle, weighted processing is performed on the first translation amount corresponding to each first grid line at the first angle to obtain a target translation amount corresponding to the first angle;

[0018] Based on the grayscale averages corresponding to the first gate lines at the first angle, obtaining a target grayscale corresponding to the first angle;

[0019] Determine a first angle corresponding to a maximum value among the plurality of target grayscales as a target angle;

[0020] The candidate grid lines are processed based on the target translation amount and the target angle to obtain the target grid lines.

[0021] An industrial detection method according to an embodiment of the present application, wherein the candidate grid lines are processed based on the target translation amount and the target angle to obtain the target grid lines, comprises:

[0022] The candidate grid lines are rotated by the target angle with the center point of the candidate grid lines as the rotation center, and the rotated candidate grid lines are moved by the target translation amount to obtain the target grid lines.

[0023] An industrial detection method according to an embodiment of the present application obtains a plurality of candidate gate lines included in the image to be tested based on the offset information between the energy storage device and the image to be tested corresponding to the energy storage device and the first image, including:

[0024] Aligning the first image to the image to be tested, and moving the aligned first image based on the offset information to obtain a fused image of the first image and the image to be tested; aligning the energy storage device in the fused image with the energy storage device in the first image;

[0025] Based on the fused image, the plurality of candidate gate lines included in the image to be tested are obtained.

[0026] In an industrial inspection method according to an embodiment of the present application, the first image after moving alignment based on the offset information to obtain a fused image of the first image and the image to be inspected includes:

[0027] Based on the origin coordinates of the energy storage device in the image to be tested in the offset information and the inclination angle between the energy storage device and the edge of the image to be tested in the offset information, the aligned first image is moved until the origin coordinates of the energy storage device in the first image match the origin coordinates of the energy storage device in the image to be tested and the edge of the energy storage device in the first image matches the edge of the energy storage device in the image to be tested, so as to obtain the fused image.

[0028] In an industrial inspection method according to an embodiment of the present application, the collected template image corresponding to the energy storage device is processed to obtain a first image corresponding to the energy storage device, including:

[0029] Processing the template image to obtain position information of the origin of the coordinate system of the energy storage device in the image coordinate system corresponding to the template image and an inclination angle between the energy storage device and the template image;

[0030] Processing the template image to obtain a grid line binary image including the plurality of grid lines;

[0031] Sampling the grid line binary image to obtain the position information corresponding to each grid line in the template image;

[0032] The first image is obtained based on the position information of the origin of the coordinate system of the energy storage device in the image coordinate system corresponding to the template image, the inclination angle between the energy storage device and the template image, and the position information corresponding to each of the grid lines in the template image.

[0033] In a second aspect, the present application provides an industrial detection device, comprising:

[0034] A first processing module, used to process the collected template image corresponding to the energy storage device to obtain a first image corresponding to the energy storage device; the first image is used to represent the position information of the grid line of the energy storage device in the energy storage device;

[0035] A second processing module, configured to obtain a plurality of candidate gate lines included in the image to be tested based on the offset information between the energy storage device and the image to be tested corresponding to the energy storage device and the first image;

[0036] The third processing module is used to process each of the candidate grid lines to determine a plurality of target grid lines included in the image to be tested.

[0037] According to the industrial inspection device provided in the embodiment of the present application, by processing the template image corresponding to the energy storage device, the position information of the gate line in the energy storage device is obtained, and then the gate lines obtained by modeling are converted into the image to be tested to obtain candidate gate lines, and the candidate gate lines are processed to obtain multiple target gate lines. The imaging effect of the image to be tested is not required to be high, and the complete gate lines can be accurately screened out even if the gate lines in the image to be tested are missing, thereby improving the precision and accuracy of gate line positioning, and is suitable for matching and positioning of gate lines of any geometric shape, and can adapt to the grid lines of battery cells with any specifications of screens, and has a wide range of applicable scenarios.

[0038] In a third aspect, the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the industrial detection method as described in the first aspect above when executing the computer program.

[0039] The above one or more technical solutions in the embodiments of the present application have at least one of the following technical effects:

[0040] By processing the template image corresponding to the energy storage device, the position information of the gate line in the energy storage device is obtained, and then the gate lines obtained by modeling are converted into the image to be tested to obtain candidate gate lines, and the candidate gate lines are processed to obtain multiple target gate lines. The imaging effect of the image to be tested is not required to be high, and the complete gate lines can be accurately screened out even if the gate lines in the image to be tested are missing, thereby improving the precision and accuracy of gate line positioning, and is suitable for gate line matching and positioning of any geometric shape, and can adapt to the grid lines of battery cells with any specifications of screens, and has a wide range of applicable scenarios.

[0041] Furthermore, by processing the grayscale information of the sampling points to precisely position the grid lines obtained by coarse positioning, the precision and accuracy of the target grid line positioning are further improved, and the positioning efficiency is improved, which is suitable for various application scenarios.

[0042] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0044] Figure 1 This is one of the flow diagrams of the industrial detection method provided in the embodiment of the present application;

[0045] Figure 2 This is one of the principle schematic diagrams of the industrial detection method provided in the embodiment of the present application;

[0046] Figure 3 This is the second principle schematic diagram of the industrial detection method provided in the embodiment of the present application;

[0047] Figure 4 This is the third principle schematic diagram of the industrial detection method provided in the embodiment of the present application;

[0048] Figure 5 This is the second flow chart of the industrial detection method provided in the embodiment of the present application;

[0049] Figure 6 This is the fourth principle schematic diagram of the industrial detection method provided in the embodiment of the present application;

[0050] Figure 7 This is the fifth principle schematic diagram of the industrial detection method provided in the embodiment of the present application;

[0051] Figure 8 This is the sixth principle schematic diagram of the industrial detection method provided in the embodiment of the present application;

[0052] Fig. 9 This is the third flow chart of the industrial detection method provided in the embodiment of the present application;

[0053] Fig.10 This is the seventh principle schematic diagram of the industrial detection method provided in the embodiment of the present application;

[0054] Fig.11 is a schematic diagram of the structure of an industrial detection device provided in an embodiment of the present application;

[0055] Fig.12 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0056] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0057] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0058] The industrial detection method, industrial detection device, electronic device and readable storage medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0059] The industrial detection method may be applied to a terminal, and may be specifically executed by hardware or software in the terminal.

[0060] The terminal includes but is not limited to portable communication devices such as mobile phones or tablet computers. It should also be understood that in some embodiments, the terminal may not be a portable communication device, but a desktop computer.

[0061] In the following various embodiments, a terminal including a display and a touch-sensitive surface is described. However, it should be understood that the terminal may include one or more other physical user interface devices such as a physical keyboard, a mouse and a joystick.

[0062] The industrial detection method provided in the embodiment of the present application may be executed by an electronic device or a functional module or functional entity in the electronic device that can implement the industrial detection method. The electronic devices mentioned in the embodiment of the present application include but are not limited to mobile phones, tablet computers, computers, cameras, and wearable devices. The industrial detection method provided in the embodiment of the present application is described below using the electronic device as an example of the execution subject.

[0063] like Figure 1 As shown, the industrial detection method includes: step 110, step 120 and step 130.

[0064] Step 110: Process the collected template image corresponding to the energy storage device to obtain a first image corresponding to the energy storage device;

[0065] In this step, the energy storage device may include a battery cell, for example, the energy storage device may include a photovoltaic cell.

[0066] The template image includes the complete grid line structure of the cell.

[0067] The template image may include multiple types of grid lines. For example, the template image may include a fine grid and a main grid, or may also include other types of grid lines.

[0068] Among them, the grid line is a metal line located on the surface of the battery, which is used to collect and transmit electrons.

[0069] The energy storage device may include a plurality of grid lines.

[0070] The template image may be segmented and extracted to obtain a first image.

[0071] The first image can be used to represent position information of the grid lines of the energy storage device in the energy storage device.

[0072] For example, the template image may be binarized, and then connected component analysis may be performed on the binarized image to obtain all connected regions, and then the regions corresponding to the grid lines in the template image may be obtained based on the grid line features.

[0073] Based on the offset information between the template image and the energy storage device, the position of the grid lines on the surface of the energy storage device can be obtained. For example, by establishing a coordinate system corresponding to the energy storage device, the specific number of grid lines on the surface of the energy storage device can be obtained.

[0074] like Figure 5 As shown, in some embodiments, step 110 may include:

[0075] Processing the template image to obtain position information of the origin of the coordinate system of the energy storage device in the image coordinate system corresponding to the template image and the inclination angle between the energy storage device and the template image;

[0076] Processing the template image to obtain a grid line binary image including a plurality of grid lines;

[0077] Sampling the binary image of the grid lines to obtain the corresponding position information of each grid line in the template image;

[0078] A first image is obtained based on the position information of the origin of the coordinate system of the energy storage device in the image coordinate system corresponding to the template image, the inclination angle between the energy storage device and the template image, and the position information corresponding to each grid line in the template image.

[0079] In this embodiment, an image coordinate system corresponding to the template image may be established first. For example, the center point or upper left corner of the template image may be used as the origin, and then the X-axis and Y-axis are established to obtain the image coordinate system corresponding to the template image.

[0080] The origin of the coordinate system of the energy storage device may be the upper left corner or the center point of the energy storage device, or may be other fixed points, which may be selected based on user needs and is not limited in this application.

[0081] For example, the upper left corner of the energy storage device can be determined as the origin of the coordinate system of the energy storage device, and then the offset (OffsetX, OffsetY) between the origin of the coordinate system of the energy storage device and the origin of the image coordinate system corresponding to the template image can be obtained, thereby determining the position information of the origin of the coordinate system of the energy storage device in the image coordinate system corresponding to the template image. For example, the sum of the origin of the image coordinate system and the offset can be determined as the coordinate information (OffsetX, OffsetY) of the origin of the coordinate system of the energy storage device in the image coordinate system.

[0082] The tilt angle between the energy storage device and the template image may be determined based on the angle between the transverse (longitudinal) edge of the energy storage device and the X-axis (Y-axis) of the image coordinate system.

[0083] like Figure 6 As shown, in the gate line binary image, the gate lines can be marked as white (or black) and the rest can be marked as black (or white).

[0084] The grid line binary image includes a plurality of grid lines.

[0085] The binary image of the grid lines can be extracted from the template image by using image processing techniques (such as threshold segmentation or edge detection).

[0086] On the grid line binary image, each grid line can be sampled to generate multiple sampling points, and the sampling points can be used to record the position and shape information of the grid line.

[0087] On the raster line binary image, sampling points may be generated for each raster line along the image X-axis and Y-axis according to a fixed step size.

[0088] Alternatively, the binary image of the grid line can be scaled, and then the contour points of the binary image of the grid line can be used as sampling points; or sampling points can be randomly selected from the binary image of the grid line, or other sampling methods can be used. The selection can be based on user needs, and this application does not limit this.

[0089] like Figure 7 As shown, when the surface of the energy storage device includes a main grid, multiple sampling points can be generated on the binary image of the main grid to obtain a first image; Figure 8As shown, when the surface of the energy storage device includes a fine grid, multiple sampling points can be generated on the binary image of the fine grid to obtain a first image.

[0090] The first image is obtained based on the modeling operation, and the first image may include a binary image of the gate line in the energy storage device and corresponding position information.

[0091] Step 120, obtaining a plurality of candidate gate lines included in the image to be tested based on the offset information between the energy storage device and the image to be tested corresponding to the energy storage device and the first image;

[0092] In this step, the image to be measured is an image for which the position of the grid lines needs to be located.

[0093] The energy storage device can be imaged based on an image sensor to obtain an image to be tested corresponding to the energy storage device.

[0094] The offset information is used to characterize the offset between the energy storage device and the image to be tested in the image to be tested. For example, the offset information may include the lateral distance or longitudinal distance between the edge of the energy storage device and the edge of the image to be tested, and the degree of inclination of the energy storage device in the image to be tested.

[0095] In the actual implementation process, an edge detection algorithm can be used to perform edge detection on the energy storage device in the image to be tested to obtain the edge contour of the energy storage device. Then, a straight line fitting algorithm can be used to obtain the outer straight line of the energy storage device, and then the offset information between the energy storage device and the image to be tested can be calculated.

[0096] The first image is aligned with the image to be tested, that is, the origin of the energy storage device coordinate system in the first image is aligned with the origin of the image coordinate system corresponding to the image to be tested, and then the candidate grid lines in the image to be tested are found according to the offset information between the energy storage device and the image to be tested.

[0097] For example, the first image may be superimposed or fused onto the image to be measured.

[0098] Based on the position information of the grid lines in the first image, candidate grid lines corresponding to the grid lines in the first image can be found in the image to be tested.

[0099] In some embodiments, step 120 may include:

[0100] Aligning the first image to the image to be tested, and moving the aligned first image based on the offset information to obtain a fused image of the first image and the image to be tested;

[0101] Based on the fused image, a plurality of candidate grid lines included in the image to be tested are obtained.

[0102] In this embodiment, the aligned first image is moved based on the offset information until the energy storage device in the first image is aligned with the energy storage device in the image to be tested, thereby obtaining a fused image.

[0103] The energy storage device in the fused image is aligned with the energy storage device in the first image.

[0104] The first image includes position information of the grid lines on the surface of the energy storage device. Based on the position information, candidate grid lines can be found in the fused image, thereby obtaining a plurality of candidate grid lines included in the image to be tested.

[0105] In some embodiments, based on the offset information, the first image after the alignment is moved to obtain a fused image of the first image and the image to be measured, including:

[0106] Based on the origin coordinates of the energy storage device in the image to be tested in the offset information and the inclination angle between the energy storage device and the edge of the image to be tested in the offset information, the aligned first image is moved until the origin coordinates of the energy storage device in the first image match the origin coordinates of the energy storage device in the image to be tested and the edge of the energy storage device in the first image matches the edge of the energy storage device in the image to be tested, so as to obtain a fused image.

[0107] In this embodiment, an image coordinate system corresponding to the first image and a coordinate system of the energy storage device may be established.

[0108] The origin coordinates of the energy storage device in the first image are position information of the origin of the coordinate system of the energy storage device in the image coordinate system corresponding to the first image.

[0109] The first image includes a binary image of the grid lines in the energy storage device and corresponding position information, and the origin of the coordinate system of the energy storage device is the origin of the image coordinate system corresponding to the first image.

[0110] An image coordinate system corresponding to the image to be measured and a coordinate system of the energy storage device can be established.

[0111] The origin coordinates of the energy storage device in the image to be tested are position information of the origin of the coordinate system of the energy storage device in the image coordinate system corresponding to the image to be tested.

[0112] Moving the aligned first image based on the offset information may include moving the origin coordinates of the energy storage device in the first image to the origin coordinates of the energy storage device in the image to be tested, and rotating the first image with the origin coordinates after alignment as the center so that the edge of the energy storage device in the first image matches the edge of the energy storage device in the image to be tested.

[0113] In the actual implementation process, Figure 2 As shown, the image coordinate system can be obtained by taking the upper left corner of the image as the origin O, establishing the X axis along the horizontal direction and the Y axis along the vertical direction.

[0114] like Figure 3 As shown, the intersection of the left line and the upper line of the energy storage device (battery cell) can be taken as the origin o, the x-axis is established along the upper line of the battery cell, and the y-axis is established along the left line of the battery cell to obtain the battery cell coordinate system.

[0115] like Figure 4 As shown, the coordinates of the cell origin o in the image to be tested are (OffsetX, OffsetY), and a point (x, y) in the cell coordinate system corresponding to the image to be tested can be expressed as:

[0116]

[0117] Wherein, θ is the first tilt angle.

[0118] Step 130: Process each candidate grid line to determine a plurality of target grid lines included in the image to be tested.

[0119] In this step, each candidate grid line is processed to determine the precise positioning result of the grid line in the image to be tested, and further determine the multiple target grid lines included in the image to be tested.

[0120] For example, the candidate grid lines may be rotated at different angles or displaced at different distances to determine the target grid lines from the displaced grid lines.

[0121] The target grid lines are grid line structures that meet the requirements in the image to be tested.

[0122] According to the industrial inspection method provided in the embodiment of the present application, by processing the template image corresponding to the energy storage device, the position information of the gate line in the energy storage device is obtained, and then the gate lines obtained by modeling are converted into the image to be tested to obtain candidate gate lines, and the candidate gate lines are processed to obtain multiple target gate lines. The imaging effect of the image to be tested is not required to be high, and the complete gate lines can be accurately screened out even if the gate lines in the image to be tested are missing, thereby improving the precision and accuracy of the gate line positioning, and is suitable for gate line matching and positioning of any geometric shape, and can adapt to the grid lines of battery cells with any specifications of screens, and has a wide range of applicable scenarios.

[0123] In some embodiments, step 130 may include:

[0124] Perform at least one of a rotation process and a translation process on each candidate grid line to obtain a plurality of first grid lines;

[0125] Based on the grayscale values ​​corresponding to all sampling points included in each first gate line, a target gate line is determined from a plurality of candidate gate lines.

[0126] In this embodiment, the candidate grid lines may be rotated around a certain point to obtain first grid lines at different angles.

[0127] like Fig.10 As shown, by rotating the candidate grid lines around the rotation center within the angle range of [-α, α], the first grid lines at multiple different angles can be obtained.

[0128] The candidate grid lines can be translated by a certain distance to obtain the first grid lines at different positions.

[0129] like Fig.10 As shown, by translating the candidate grid lines along the x-axis within the range of [-shiftx, shiftx] or along the y-axis within the range of [-shifty, shifty], a plurality of first grid lines at different positions can be obtained.

[0130] After the candidate grid lines are rotated, the candidate grid lines at each angle may be translated by different distances to obtain a plurality of first grid lines.

[0131] After performing translation processing on the candidate grid lines, the candidate grid lines at each position may be rotated by different angles to obtain multiple first grid lines.

[0132] The first grid line is a grid line obtained after rotating or translating the candidate grid line.

[0133] There may be a plurality of sampling points on the first gate line, which are used to represent the position information of the first gate line.

[0134] The grayscale value of the sampling point is used to represent the brightness or intensity information of the sampling point in the image.

[0135] The grayscale value can be a value between 0 and a maximum value (eg, 255).

[0136] In some embodiments, performing at least one of rotation and translation processing on each candidate gate line to obtain a plurality of first gate lines may include:

[0137] Taking the center point of the candidate grid line as the rotation center, rotating the candidate grid line by a first angle to obtain a second grid line;

[0138] The second grid line is moved by a first translation amount to obtain a first grid line.

[0139] In this embodiment, the center point of the candidate grid line can be determined by calculating the average position of all points on the candidate grid line or using other geometric methods.

[0140] For example, you can first fit or select two endpoints on the candidate grid line and then calculate the center point.

[0141] The coordinates of the center point of each grid line (for example, the center point may be the average position calculated based on the sampling points) in the coordinate system corresponding to the energy storage device may be calculated to rotate the candidate grid lines in the coordinate system corresponding to the energy storage device.

[0142] The first angle may be 5 degrees, 10 degrees or 15 degrees, or may be other values, and may be user-defined, and is not limited in this application.

[0143] The candidate grid lines are rotated according to a specified first angle with the center point of the candidate grid lines as the rotation center. For example, on a two-dimensional plane, the rotation can be achieved by a rotation matrix.

[0144] The second grid line is a grid line obtained by rotating the candidate grid line.

[0145] The first translation amount may be any distance along the x-axis or the y-axis.

[0146] The first grid line can be obtained by moving the second grid line obtained after the rotation according to the specified translation amount.

[0147] In the actual implementation process, Fig.10 As shown, the center point of the candidate grid line can be used as the rotation center and rotated within the angle range of [-α, α]; after rotating according to the specified dα, the grid line is translated along the x-axis within the range of [-shiftx, shiftx] and the y-axis within the range of [-shifty, shifty] to obtain multiple first grid lines.

[0148] In some embodiments, determining a target gate line from a plurality of candidate gate lines based on the grayscale values ​​corresponding to all sampling points included in each first gate line may include:

[0149] Obtaining grayscale mean values ​​corresponding to all sampling points included in each first grid line at a first angle;

[0150] Based on the grayscale mean value corresponding to each first grid line at the first angle, weighted processing is performed on the first translation amount corresponding to each first grid line at the first angle to obtain a target translation amount corresponding to the first angle;

[0151] Based on the grayscale averages corresponding to the first gate lines at the first angle, obtaining a target grayscale corresponding to the first angle;

[0152] Determine a first angle corresponding to a maximum value among a plurality of target grayscales as a target angle;

[0153] The candidate grid lines are processed based on the target translation amount and the target angle to obtain the target grid lines.

[0154] In this embodiment, the candidate gate line is rotated according to a first angle to obtain the first gate line.

[0155] The first gate line includes a plurality of sampling points, and the grayscale value of each sampling point can be obtained. Then, the average grayscale value of all the sampling points is obtained, and the grayscale mean value corresponding to the first gate line can be obtained.

[0156] A plurality of different first translation amounts may be set, and then based on the plurality of first translation amounts, the grid lines at the first angle are translated multiple times to obtain a first grid line set at the first angle.

[0157] The angles of the first grid lines in the first grid line set are all first angles, and the translation amounts of the first grid lines are all different.

[0158] The grayscale mean corresponding to each first gate line in the first gate line set may be used as the weight of the first translation amount corresponding to the first gate line, and weighted processing may be performed on the first translation amount corresponding to the first gate lines in the first gate line set.

[0159] For example, the first gate line set includes two first gate lines, and the grayscale means of the two first gate lines are GrayMean1 and GrayMean2 respectively, and the displacements of the two first gate lines are (dx1, dy1) and (dx2, dy2) respectively. Then, the two displacements can be weighted averaged to obtain the target translation corresponding to the first angle.

[0160] The target translation amount is the optimal displacement corresponding to the grid line at the first angle.

[0161] In some embodiments, when the grayscale mean corresponding to the first gate line is greater than the grayscale threshold, the first translation amount corresponding to the grayscale mean can be determined as a candidate displacement, and then multiple candidate displacements are weighted to obtain a target translation amount corresponding to the first angle.

[0162] The target grayscale is an average of grayscale means of all first gate lines in the first gate line set.

[0163] A target grayscale can be calculated from each first angle, and then a maximum target grayscale can be determined from multiple target grayscales, and the first angle corresponding to the maximum target grayscale is determined as the target angle.

[0164] The target angle is the optimal rotation angle of the grid line. The candidate grid lines are moved based on the target translation amount and the target angle, and the target grid line can be located.

[0165] In some embodiments, a first translation amount corresponding to a maximum value among grayscale means of a plurality of first gate lines corresponding to the first angle may be determined as a target translation amount corresponding to the first angle.

[0166] In some embodiments, processing the candidate grid lines based on the target translation amount and the target angle to obtain the target grid lines may include:

[0167] The candidate grid lines are rotated by a target angle with the center point of the candidate grid lines as the rotation center, and the rotated candidate grid lines are moved by a target translation amount to obtain the target grid lines.

[0168] In this embodiment, the target angle and the target translation are used to characterize the position difference between the candidate grid line and the target grid line.

[0169] The candidate lines are rotated by the target angle and the rotated candidate lines are moved by the target translation amount, so that the target lines can be accurately located.

[0170] In some embodiments, the candidate lines may be moved by a target translation amount, and the moved candidate lines may be rotated by a target angle with the center point as the rotation center to obtain the target lines.

[0171] For each candidate grid line, a target grid line can be located, and the matching and positioning of all grid lines can be completed.

[0172] like Fig. 9 As shown, in some embodiments, based on the target translation amount and the target angle, the raster line binary image obtained by modeling can be converted to the image to be tested to obtain the raster line binary image corresponding to the image to be tested.

[0173] According to the industrial detection method provided in the embodiment of the present application, the grayscale information of the sampling points is processed to finely position the grid lines obtained by coarse positioning, thereby further improving the precision and accuracy of target grid line positioning and improving the positioning efficiency, and is suitable for a variety of application scenarios.

[0174] The industrial detection device provided in the present application is described below. The industrial detection device described below and the industrial detection method described above can be referenced to each other.

[0175] The industrial detection method provided in the embodiment of the present application can be executed by an industrial detection device. The industrial detection device provided in the embodiment of the present application is described by taking an industrial detection device executing the industrial detection method as an example.

[0176] The embodiment of the present application also provides an industrial detection device.

[0177] like Fig.11 As shown, the industrial detection device includes: a first processing module 1010 , a second processing module 1020 and a third processing module 1030 .

[0178] A first processing module 1010 is used to process the collected template image corresponding to the energy storage device to obtain a first image corresponding to the energy storage device; the first image is used to represent the position information of the grid line of the energy storage device in the energy storage device;

[0179] A second processing module 1020, configured to obtain a plurality of candidate gate lines included in the image to be tested based on the offset information between the energy storage device and the image to be tested corresponding to the energy storage device and the first image;

[0180] The third processing module 1030 is used to process each candidate grid line to determine a plurality of target grid lines included in the image to be tested.

[0181] According to the industrial inspection device provided in the embodiment of the present application, by processing the template image corresponding to the energy storage device, the position information of the gate line in the energy storage device is obtained, and then the gate lines obtained by modeling are converted into the image to be tested to obtain candidate gate lines, and the candidate gate lines are processed to obtain multiple target gate lines. The imaging effect of the image to be tested is not required to be high, and the complete gate lines can be accurately screened out even if the gate lines in the image to be tested are missing, thereby improving the precision and accuracy of gate line positioning, and is suitable for matching and positioning of gate lines of any geometric shape, and can adapt to the grid lines of battery cells with any specifications of screens, and has a wide range of applicable scenarios.

[0182] In some embodiments, the third processing module 1030 may also be used to:

[0183] Perform at least one of a rotation process and a translation process on each candidate grid line to obtain a plurality of first grid lines;

[0184] Based on the grayscale values ​​corresponding to all sampling points included in each first gate line, a target gate line is determined from a plurality of candidate first gate lines.

[0185] In some embodiments, the third processing module 1030 may also be used to:

[0186] Taking the center point of the candidate grid line as the rotation center, rotating the candidate grid line by a first angle to obtain a second grid line;

[0187] The second grid line is moved by a first translation amount to obtain a first grid line.

[0188] In some embodiments, the third processing module 1030 may also be used to:

[0189] Obtaining grayscale mean values ​​corresponding to all sampling points included in each first grid line at a first angle;

[0190] Based on the grayscale mean value corresponding to each first grid line at the first angle, weighted processing is performed on the first translation amount corresponding to each first grid line at the first angle to obtain a target translation amount corresponding to the first angle;

[0191] Based on the grayscale averages corresponding to the first gate lines at the first angle, obtaining a target grayscale corresponding to the first angle;

[0192] Determine a first angle corresponding to a maximum value among a plurality of target grayscales as a target angle;

[0193] The candidate grid lines are processed based on the target translation amount and the target angle to obtain the target grid lines.

[0194] In some embodiments, the third processing module 1030 may also be used to:

[0195] The candidate grid lines are rotated by a target angle with the center point of the candidate grid lines as the rotation center, and the rotated candidate grid lines are moved by a target translation amount to obtain the target grid lines.

[0196] In some embodiments, the second processing module 1020 may also be used to:

[0197] Aligning the first image to the image to be tested, and moving the aligned first image based on the offset information to obtain a fused image of the first image and the image to be tested; aligning the energy storage device in the fused image with the energy storage device in the first image;

[0198] Based on the fused image, a plurality of candidate grid lines included in the image to be tested are obtained.

[0199] In some embodiments, the second processing module 1020 may also be used to:

[0200] Based on the origin coordinates of the energy storage device in the image to be tested in the offset information and the inclination angle between the energy storage device and the edge of the image to be tested in the offset information, the aligned first image is moved until the origin coordinates of the energy storage device in the first image match the origin coordinates of the energy storage device in the image to be tested and the edge of the energy storage device in the first image matches the edge of the energy storage device in the image to be tested, so as to obtain a fused image.

[0201] In some embodiments, the first processing module 1010 may also be used to:

[0202] Processing the template image to obtain position information of the origin of the coordinate system of the energy storage device in the image coordinate system corresponding to the template image and the inclination angle between the energy storage device and the template image;

[0203] Processing the template image to obtain a grid line binary image including a plurality of grid lines;

[0204] Sampling the binary image of the grid lines to obtain the corresponding position information of each grid line in the template image;

[0205] A first image is obtained based on the position information of the origin of the coordinate system of the energy storage device in the image coordinate system corresponding to the template image, the inclination angle between the energy storage device and the template image, and the position information corresponding to each grid line in the template image.

[0206] The industrial detection device in the embodiment of the present application can be an electronic device, or a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtualreality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personalcomputer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application is not specifically limited.

[0207] The industrial detection device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0208] The industrial detection device provided in the embodiment of the present application can achieve Figures 1 to 10 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0209] In some embodiments, Fig.12 As shown, an embodiment of the present application also provides an electronic device 1100, including a processor 1101, a memory 1102, and a computer program stored in the memory 1102 and executable on the processor 1101. When the program is executed by the processor 1101, each process of the above-mentioned industrial detection method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0210] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0211] On the other hand, an embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned industrial detection method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0212] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0213] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0214] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware. Based on this understanding, the above technical solution can be essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiment.

[0215] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. An industrial detection method, characterized in that: include: Processing the collected template image corresponding to the energy storage device to obtain a first image corresponding to the energy storage device; The first image is used to represent position information of the gate line of the energy storage device in the energy storage device; Based on the offset information between the energy storage device and the image to be tested corresponding to the energy storage device and the first image, a plurality of candidate gate lines included in the image to be tested are obtained; Each of the candidate grid lines is processed to determine a plurality of target grid lines included in the image to be tested.

2. The industrial detection method according to claim 1, characterized in that: The step of processing each of the candidate grid lines to determine a plurality of target grid lines included in the image to be tested comprises: Perform at least one of a rotation process and a translation process on each of the candidate gate lines to obtain a plurality of first gate lines; The target gate line is determined from the plurality of candidate gate lines based on the grayscale values ​​corresponding to all sampling points included in each of the first gate lines.

3. The industrial detection method according to claim 2, characterized in that: The performing at least one of a rotation process and a translation process on each of the candidate gate lines to obtain a plurality of first gate lines comprises: Taking the center point of the candidate grid line as the rotation center, rotating the candidate grid line by a first angle to obtain a second grid line; The second gate line is moved by a first translation amount to obtain the first gate line.

4. The industrial detection method according to claim 2, characterized in that: The step of determining the target gate line from a plurality of candidate gate lines based on the grayscale values ​​corresponding to all sampling points included in each of the first gate lines comprises: Obtaining grayscale mean values ​​corresponding to all sampling points included in each first grid line at a first angle; Based on the grayscale mean value corresponding to each first grid line at the first angle, weighted processing is performed on the first translation amount corresponding to each first grid line at the first angle to obtain a target translation amount corresponding to the first angle; Based on the grayscale averages corresponding to the first gate lines at the first angle, obtaining a target grayscale corresponding to the first angle; Determine a first angle corresponding to a maximum value among the plurality of target grayscales as a target angle; The candidate grid lines are processed based on the target translation amount and the target angle to obtain the target grid lines.

5. The industrial detection method according to claim 4, characterized in that: The step of processing the candidate grid lines based on the target translation amount and the target angle to obtain the target grid lines includes: The candidate grid lines are rotated by the target angle with the center point of the candidate grid lines as the rotation center, and the rotated candidate grid lines are moved by the target translation amount to obtain the target grid lines.

6. The industrial detection method according to any one of claims 1 to 5, characterized in that: The step of obtaining a plurality of candidate gate lines included in the image to be tested based on the offset information between the energy storage device and the image to be tested corresponding to the energy storage device and the first image comprises: Aligning the first image to the image to be tested, and moving the aligned first image based on the offset information to obtain a fused image of the first image and the image to be tested; aligning the energy storage device in the fused image with the energy storage device in the first image; Based on the fused image, the plurality of candidate gate lines included in the image to be tested are obtained.

7. The industrial detection method according to claim 6, characterized in that: The step of moving the aligned first image based on the offset information to obtain a fused image of the first image and the image to be measured includes: Based on the origin coordinates of the energy storage device in the image to be tested in the offset information and the inclination angle between the energy storage device and the edge of the image to be tested in the offset information, the aligned first image is moved until the origin coordinates of the energy storage device in the first image match the origin coordinates of the energy storage device in the image to be tested and the edge of the energy storage device in the first image matches the edge of the energy storage device in the image to be tested, so as to obtain the fused image.

8. The industrial detection method according to any one of claims 1 to 5, characterized in that: The processing of the collected template image corresponding to the energy storage device to obtain the first image corresponding to the energy storage device includes: Processing the template image to obtain position information of the origin of the coordinate system of the energy storage device in the image coordinate system corresponding to the template image and an inclination angle between the energy storage device and the template image; Processing the template image to obtain a grid line binary image including the plurality of grid lines; Sampling the grid line binary image to obtain the position information corresponding to each grid line in the template image; The first image is obtained based on the position information of the origin of the coordinate system of the energy storage device in the image coordinate system corresponding to the template image, the inclination angle between the energy storage device and the template image, and the position information corresponding to each of the grid lines in the template image.

9. An industrial detection device, characterized in that: include: A first processing module, used to process the collected template image corresponding to the energy storage device to obtain a first image corresponding to the energy storage device; The first image is used to represent position information of the gate line of the energy storage device in the energy storage device; A second processing module, configured to obtain a plurality of candidate gate lines included in the image to be tested based on the offset information between the energy storage device and the image to be tested corresponding to the energy storage device and the first image; The third processing module is used to process each of the candidate grid lines to determine a plurality of target grid lines included in the image to be tested.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the industrial detection method according to any one of claims 1 to 8 is implemented.

Images