Photovoltaic module image splicing method and device, electronic equipment, storage medium and program product

By determining the initial stitching line from the image to be stitched in the photovoltaic module image stitching technology and adjusting according to the target object, the image distortion problem caused by inaccurate stitching lines in the photovoltaic module image stitching is solved, and the authenticity of the image is improved.

CN120070174AActive Publication Date: 2025-05-30SHANGHAI HONGPU INFORMATION TECH CO LTD

Patent Information

Application Number
CN202510542135.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-04-28
Publication Date
2025-05-30
Estimated Expiration
2045-04-28

AI Technical Summary

Technical Problem

During the production process of photovoltaic modules, image stitching technology causes inaccurate stitching lines due to image quality and other reasons, resulting in distortion of the photovoltaic module image.

Method used

By determining the initial stitching line from the image to be stitched and adjusting the initial stitching line according to the target object (such as battery cells, gap areas, bus bar areas and segmentation information), the adjusted stitching line is obtained, and the stitching image is stitched according to the adjusted stitching line.

Benefits of technology

The image distortion problem of photovoltaic modules caused by image quality and other reasons has been improved, and the image authenticity after stitching is improved, making the stitched image closer to the real photovoltaic module.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120070174A_ABST
    Figure CN120070174A_ABST
Patent Text Reader

Abstract

The invention provides a photovoltaic module image stitching method and device, electronic equipment, a storage medium and a program product, and the method comprises the steps: determining an initial stitching line from a to-be-stitched image, the to-be-stitched image being a local image of a photovoltaic module, and the initial stitching line representing a boundary, close to a stitching position, of a battery piece in the to-be-stitched image; adjusting the position of the initial splicing line according to the target object to obtain an adjusted splicing line; and splicing the to-be-spliced image according to the adjusted splicing line to obtain a spliced image. In the implementation process of the scheme, the capability of position adjustment is provided through the initial splicing line determined from the to-be-spliced image, and the to-be-spliced image is spliced according to the adjusted splicing line, so that the problem of image distortion of the photovoltaic module caused by image quality and the like is solved, and the image quality of the photovoltaic module is improved. The position adjustment capability of the splicing line enables the spliced image to be closer to a real photovoltaic module, thereby improving the authenticity of the spliced image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of computer vision and image processing. Specifically, it relates to a method, device, electronic device, storage medium, and program product for splicing photovoltaic module images. Background Art

[0002] Currently, in the production process of photovoltaic modules, image acquisition and processing are key links in the quality inspection of photovoltaic modules. Due to the large size of photovoltaic modules, multiple industrial cameras (such as line scan cameras) are usually used to segmentally acquire local images of photovoltaic modules, and then image stitching technology is used to generate a complete module image. In related image stitching technologies, the stitching line determined based on global image features is usually relied on for stitching. However, in the practical process, it is found that due to reasons such as image quality, the stitching line determined based on global image features is not accurate, so the stitched photovoltaic module image is distorted. Summary of the Invention

[0003] The purpose of the embodiments of the present application is to provide a method, device, electronic device, storage medium, and program product for splicing photovoltaic module images to improve the problem of distortion of the stitched photovoltaic module image.

[0004] The embodiments of the present application provide a method for splicing photovoltaic module images, including: determining an initial stitching line from the images to be stitched, where the images to be stitched are local images of photovoltaic modules, and the initial stitching line represents the boundary of the solar cells in the images to be stitched close to the stitching position; adjusting the position of the initial stitching line according to target objects, where the target objects include: solar cells, gap regions, bus bar regions, and / or segmentation information, and the segmentation information represents the relative positional relationship of the images to be stitched; stitching the images to be stitched according to the adjusted stitching line to obtain the stitched image. In the implementation process of the above solution, the initial stitching line determined from the images to be stitched provides the ability to perform position adjustment, and the images to be stitched are stitched according to the adjusted stitching line, improving the problem of distortion of the photovoltaic module image due to reasons such as image quality. This ability to adjust the position of the stitching line can obtain better image stitching processing results, making the stitched image closer to the real photovoltaic module, thereby improving the authenticity of the stitched image.

[0005] Optionally, in the embodiments of the present application, the target object includes segmentation information; determining an initial stitching line from the to-be-stitched images includes: determining the initial stitching line from the to-be-stitched images according to the segmentation information of the to-be-stitched images; adjusting the position of the initial stitching line according to the target object includes: determining the moving direction and the number of pixels of the initial stitching line according to the segmentation information; moving the position of the initial stitching line according to the moving direction and the number of pixels of the initial stitching line. In the implementation process of the above solution, by combining the image segmentation information to determine and adjust the initial stitching line, the adjusted stitching line can be made to be compatible with the stitching requirements of the images collected by the line-scan camera and the area array camera, effectively improving the applicable scenarios and flexibility of the solution.

[0006] Optionally, in the embodiments of the present application, the target object includes: unpowered battery cells in the to-be-stitched images; adjusting the position of the initial stitching line according to the target object includes: moving the position of the stitching line on the side close to the unpowered battery cell in the initial stitching line by a preset number of spacing pixels towards the side of the unpowered battery cell to obtain the moved stitching line, and the preset number of spacing pixels is an empirical value set according to the gap width between the battery cells. In the implementation process of the above solution, by moving the position of the stitching line on the side close to the unpowered battery cell in the initial stitching line towards the side of the unpowered battery cell, the function of dynamically adjusting the height of the gaps between the battery cells in the to-be-stitched images is realized, the actual gap width between the battery cells is restored more accurately, and the gap distortion at the stitching seam caused by the lack of information in the unpowered area is avoided, making the stitched image closer to the real photovoltaic module, thereby improving the authenticity of the stitched image.

[0007] Optionally, in the embodiments of the present application, the target object includes a gap area; adjusting the position of the initial stitching line according to the target object includes: moving the initial stitching line inward towards the battery cell by a first preset distance to retain the gap area between adjacent battery cells, and the first preset distance is less than the size of the battery cell in the moving direction; or moving the initial stitching line outward towards the outside of the battery cell by a second preset distance to exceed the gap area between adjacent battery cells, and the second preset distance is greater than the gap width between the battery cells and less than the sum of the size of the adjacent battery cells and the gap width in the moving direction. In the implementation process of the above solution, by moving the initial stitching line to retain the gap area between adjacent battery cells, the gap area between adjacent battery cells in the stitched image after moving the stitching line is made more clearly visible, so that the re-inspection personnel or quality inspection personnel can accurately detect the gap defects in the stitched image. The gap defects in the photovoltaic module include, for example, foreign objects, string spacing, cell spacing, etc.

[0008] Optionally, in the embodiments of the present application, the target object includes: the bus bar region in the image to be spliced; adjusting the position of the initial splicing line includes: moving the splicing line position on the side of the initial splicing line close to the bus bar region towards the side of the bus bar region to obtain the moved splicing line. In the implementation process of the above solution, by moving the splicing line position on the side of the initial splicing line close to the bus bar region towards the side of the bus bar region, the finally spliced image presents the bus bar region, making the whole image more comprehensive and capable of presenting the complete structural information of the component.

[0009] Optionally, in the embodiments of the present application, moving the splicing line position on the side of the initial splicing line close to the bus bar region towards the side of the bus bar region includes: moving the splicing line position on the side of the initial splicing line close to the bus bar region towards the side of the bus bar region by the number of pixels of the region width; wherein, the number of pixels of the region width is an empirical value set according to the width of the bus bar region in the image, or the number of pixels of the region width is determined by the bus bar region detected from the image to be spliced by the target detection neural network model, or the number of pixels of the region width is determined by the bus bar region segmented from the image to be spliced by the image segmentation model. In the traditional method, the splicing line is usually fixed at the boundary of the battery cell, which may cut or ignore the bus bar region, resulting in the missing of the bus bar information in the spliced image. Such an image missing the bus bar region cannot comprehensively reflect the structural information of the component and affects the accuracy of quality detection. In the implementation process of the above solution, by moving the initial splicing line towards the side of the bus bar region, it is ensured that the bus bar region is completely included in the spliced image, so that the whole image is more comprehensive and can completely reflect the structural information of the component, improving the problem of information loss caused by the fixed splicing line and enhancing the authenticity of the image and the accuracy of quality detection. Further, according to the actual width of the bus bar region (determined by, for example, an empirical value, a target detection neural network model or an image segmentation model), the position of the splicing line is accurately adjusted to adapt to the bus bar layouts of different photovoltaic modules (such as single-sided bus bars and double-sided bus bars), avoiding cutting the bus bar region due to different bus bar layouts of photovoltaic modules, and effectively increasing the flexibility and applicability of the solution.

[0010] Optionally, in the embodiments of the present application, splicing the image to be spliced according to the adjusted splicing line includes: aligning the image to be spliced according to the adjusted splicing line to obtain the aligned image; performing weighted fusion on the aligned image to obtain the spliced image. In the implementation process of the above solution, the aligned image is weighted and fused through the adjusted splicing line. This smooth processing method of weighted fusion effectively eliminates the edge traces and inconsistent illumination in the splicing region, thus achieving the effect of smooth image transition.

[0011] Optionally, in the embodiments of the present application, performing weighted fusion on the aligned images includes: obtaining a weight matrix, where the weight matrix is generated according to a Gaussian weight template or a cosine weight template of a preset fusion width; using the weight matrix to perform weighted fusion on the aligned images. In the implementation process of the above solution, the aligned images are weighted and fused by using the weight matrix generated according to the weight template of the preset fusion width. Since the values of the weight matrix gradually transition from one side of the image to the other side, this smoothing processing method using the weight matrix effectively eliminates phenomena such as edge traces and inconsistent illumination in the splicing area. The design of this weight template ensures that the pixel values in the seam area change gradually, quickly achieving the effect of smooth image transition and improving the efficiency of weighted fusion. In addition, by generating the weight matrix according to the Gaussian weight template or the cosine weight template of the preset fusion width, the weight template can be selected according to the fusion requirements of different photovoltaic module images, effectively improving the applicable scenarios and flexibility of this solution.

[0012] The embodiments of the present application also provide a photovoltaic module image splicing device, including: a splicing line determination module, configured to determine an initial splicing line from the images to be spliced, where the images to be spliced are partial images of photovoltaic modules, and the initial splicing line represents the boundary of the solar cell in the images to be spliced close to the splicing position; a splicing line adjustment module, configured to adjust the position of the initial splicing line according to a target object to obtain an adjusted splicing line, where the target object includes: a solar cell, a gap area, a bus bar area, and / or segmentation information, and the segmentation information represents the relative position relationship of the images to be spliced; an image splicing module, configured to splice the images to be spliced according to the adjusted splicing line to obtain a spliced image.

[0013] Optionally, in the embodiments of the present application, the target object includes segmentation information; the splicing line determination module includes: an initial splicing line determination sub-module, configured to determine an initial splicing line from the images to be spliced according to the segmentation information of the images to be spliced; the splicing line adjustment module includes: a direction pixel determination sub-module, configured to determine the moving direction and the number of pixels of the initial splicing line according to the segmentation information; an initial splicing line moving sub-module, configured to move the position of the initial splicing line according to the moving direction and the number of pixels of the initial splicing line.

[0014] Optionally, in the embodiments of the present application, the target object includes an unpowered solar cell in the images to be spliced; the splicing line adjustment module includes: a first splicing line moving sub-module, configured to move the position of the splicing line on the side of the initial splicing line close to the unpowered solar cell to the side of the unpowered solar cell by a preset spacing number of pixels to obtain a moved splicing line, and the preset spacing number of pixels is an empirical value set according to the gap width between the solar cells.

[0015] Optionally, in the embodiments of the present application, the target object includes a gap region; the splicing line adjustment module includes: a first splicing line moving sub-module, configured to move the initial splicing line inward of the solar cell by a first preset distance to reserve the gap region between adjacent solar cells, where the first preset distance is less than the size of the solar cell in the moving direction; or, a second splicing line moving sub-module, configured to move the initial splicing line outward of the solar cell by a second preset distance to reserve the gap region between adjacent solar cells, where the second preset distance is greater than the gap width between the solar cells and less than the sum of the size of the adjacent solar cells and the gap width in the moving direction.

[0016] Optionally, in the embodiments of the present application, the target object includes: the bus bar region in the image to be spliced; the splicing line adjustment module includes: a third splicing line moving sub-module, configured to move the position of the splicing line on the side close to the bus bar region in the initial splicing line to one side of the bus bar region to obtain the moved splicing line.

[0017] Optionally, in the embodiments of the present application, the third splicing line moving sub-module includes: a third splicing line moving unit, configured to move the position of the splicing line on the side close to the bus bar region in the initial splicing line to one side of the bus bar region by the number of pixels of the region width; where the number of pixels of the region width is an empirical value set according to the width of the bus bar region in the image, or the number of pixels of the region width is determined by the bus bar region detected from the image to be spliced by a target detection neural network model, or the number of pixels of the region width is determined by the bus bar region segmented from the image to be spliced by an image segmentation model.

[0018] Optionally, in the embodiments of the present application, the image splicing module includes: an image alignment sub-module, configured to align the image to be spliced according to the adjusted splicing line to obtain the aligned image; a weighted fusion sub-module, configured to perform weighted fusion on the aligned image to obtain the spliced image.

[0019] Optionally, in the embodiments of the present application, the weighted fusion sub-module includes: a weight matrix obtaining unit, configured to obtain a weight matrix, where the weight matrix is generated according to a Gaussian weight template or a cosine weight template of a preset fusion width; an image weighted fusion unit, configured to perform weighted fusion on the aligned image using the weight matrix.

[0020] The embodiments of the present application further provide an electronic device, including: a processor and a memory, where the memory stores machine-readable instructions executable by the processor, and when the machine-readable instructions are run by the processor, the methods described above are executed.

[0021] The embodiments of the present application further provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is run by a processor, the methods described above are executed.

[0022] The embodiment of the present application also provides a computer program product, including: a computer program or computer instructions, and when the computer program or computer instructions are run by a processor, the methods described above are executed. Description of the Drawings

[0023] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings required to be used in the embodiments of the present application. It should be understood that the following drawings only show some embodiments of the embodiments of the present application, and therefore should not be regarded as a limitation of the scope. For those of ordinary skill in the art, without creative efforts, other related drawings can also be obtained based on these drawings.

[0024] Figure 1 Schematic diagram showing a partial image of the photovoltaic module provided by the comparative example; Figure 2 Schematic diagram showing the inability to reflect the actual gap of the photovoltaic module provided by the comparative example; Figure 3 Schematic flow diagram showing the method for splicing images of photovoltaic modules provided by the embodiment of the present application; Figure 4 Schematic diagram showing the corner positions of all the solar cells powered on provided by the embodiment of the present application; Figure 5 Schematic diagram showing the initial splicing line of all the solar cells powered on provided by the embodiment of the present application; Figure 6 Schematic diagram showing the adjustment of the initial splicing line when all the solar cells are powered on provided by the embodiment of the present application; Figure 7 Schematic diagram showing the image to be spliced of some of the solar cells powered on provided by the embodiment of the present application; Figure 8 Schematic diagram showing the initial splicing line of some of the solar cells powered on provided by the embodiment of the present application; Figure 9 Schematic diagram showing the adjustment of the initial splicing line when some of the solar cells are powered on provided by the embodiment of the present application; Figure 10 Schematic diagram showing the offset of the splicing line towards the inner side of the solar cell provided by the embodiment of the present application; Figure 11 Schematic diagram showing the offset of the splicing line towards the outer side of the solar cell provided by the embodiment of the present application; Figure 12 Schematic diagram showing the appearance image of the bus bar area in the image to be spliced provided by the embodiment of the present application; Figure 13Schematic diagram of the spliced appearance image provided by the embodiment of the present application; Figure 14 Schematic structural diagram of the photovoltaic module image splicing device provided by the embodiment of the present application.

[0025] Icons: 100 - Photovoltaic module; 101 - Cell array; 102 - Main grid line; 103 - Cell; 104 - Cell gap; 105 - Frame; 106 - Bus bar area; 200 - Photovoltaic module image splicing device; 210 - Splicing line determination module; 220 - Splicing line adjustment module; 230 - Image splicing module. Detailed implementation manners

[0026] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application usually described and illustrated in the accompanying drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application claimed, but only represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative efforts belong to the scope of protection of the present application. It should be noted that similar reference numerals and letters indicate similar items in the following drawings. Therefore, once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of the present application, the terms "first", "second", etc. are only used for distinguishing descriptions and cannot be understood as indicating or implying relative importance. It should be noted that, without conflict, the embodiments or technical features in the embodiments of the present application can be combined.

[0027] Please refer to Figure 1 Schematic diagram of a partial image of a photovoltaic module provided by a comparative embodiment; A photovoltaic module 100 (Photovoltaic Module) is a device that converts solar energy into electrical energy. The photovoltaic module 100 includes: a frame 105 and a cell array 101 embedded in the frame 105. The cell array 101 can be formed by splicing a plurality of cells 103. There are a plurality of main grid lines 102 extending in the horizontal direction in each cell 103. It can be understood that there is a cell gap 104 (also simply referred to as a gap) between two adjacent cells 103 in the cell array 101. In addition, there is also a cell gap 104 between the cell 103 and the frame 105. In addition, the photovoltaic module may also include components such as an EVA film, a backsheet, a glass cover plate, and / or a junction box.

[0028] To ensure image quality requirements, it is usually necessary to use an industrial camera (such as a line scan camera) to take pictures of a cell array 101 in a photovoltaic module 100 to obtain an image to be stitched. The number of cells 103 included in the cell array 101 can be determined according to specific scenario requirements such as camera performance parameters and image quality, for example, 6, 10, 12, 16, or 18 cells 103, etc. During the image acquisition process, the industrial camera for acquiring the image to be stitched can use multiple area array cameras or multiple line scan cameras. Among them, the area array camera can specifically use an industrial camera with a near-infrared monochrome charge-coupled device (CCD) to acquire an electroluminescence (EL) image, or a color industrial camera to acquire the appearance image of the photovoltaic module. Among them, the number of industrial cameras can be 2, 4, or 6, and the specific number of cameras can be determined according to specific scenario requirements such as camera performance parameters and image quality.

[0029] For ease of understanding, the following takes the example of using four area array cameras to photograph a photovoltaic module. Assume that it takes three steps to photograph a complete photovoltaic module using four area array cameras. The image to be stitched in the figure is the image taken by the first area array camera when using four area array cameras and three steps of photographing. That is to say, each step requires these four area array cameras to respectively photograph and image the area within the field of view of the camera lens. Then each area array camera approximately acquires 1 / 12 of the image of the photovoltaic module each time. To obtain a complete image of the entire photovoltaic module 100, it is usually necessary to use image stitching technology to stitch multiple images to be stitched taken.

[0030] Please refer to Figure 2 The schematic diagram of the comparative example shown cannot reflect the actual gap of the photovoltaic module; in some related technologies of image stitching, it is usually stitched without moving the stitching line, and finally the stitched photovoltaic module image is distorted. There are many reasons for image distortion. For example, when using multiple cameras for segmented shooting, the photovoltaic module is usually driven by a stepping motor to move, and there is a positioning error (such as a micron-level error) in the mechanical system of the stepping motor. In addition to the positioning error, other error sources can also be camera lens distortion, uneven illumination, image noise, etc. These may all cause the physical positions at the cell arrays of adjacent segmented information to be not completely aligned. If the stitching line is fixed, this positioning error will form misalignment or overlap at the gap, resulting in image distortion. For example, in the stitched photovoltaic module image, the gap area in the row direction or column direction cannot reflect the actual gap of the photovoltaic module.

[0031] The defects existing in the solutions in the above related technologies are all the results obtained by the inventor through practice and careful research. Therefore, the process of discovering the above problems and the solutions proposed by the embodiments of the present invention below for the above problems should both be the contributions made by the inventor to the present invention during the process of the present invention.

[0032] To improve the above problems, the following is a method, device, electronic device, storage medium and program product for splicing photovoltaic module images provided by an embodiment of the present application. By determining an initial splicing line from the images to be spliced, the ability to perform position adjustment is provided, and the images to be spliced are spliced according to the adjusted splicing line, which improves the problem of distortion of photovoltaic module images due to reasons such as image quality. This ability to adjust the position of the splicing line can obtain better image splicing processing results, making the spliced image closer to the real photovoltaic module, and enabling the spliced photovoltaic module image to truly reflect the actual gap of the photovoltaic module in the row direction or column direction.

[0033] In some application scenarios, the above method for splicing photovoltaic module images can be applied to terminal devices. The above terminal devices can include, for example, a PC, a tablet computer, a mobile phone, etc.; in other application scenarios, the above method for splicing photovoltaic module images can also be applied to server devices. The above server devices can include, for example, a server, a server cluster or a cloud platform, etc. In addition, the above terminal device can be a physical device or a virtual device, such as a virtual machine. In the following description of the embodiments of the present application, the application to a server is taken as an example for elaboration.

[0034] Please refer to Figure 3 the schematic flowchart of the method for splicing photovoltaic module images provided by the embodiments of the present application shown; the implementation manner of the method for splicing photovoltaic module images can include: Step S110: Determine an initial splicing line from the images to be spliced. The images to be spliced are partial images of a photovoltaic module, and the initial splicing line represents the boundary of the solar cells in the images to be spliced near the splicing position.

[0035] It can be understood that the above images to be spliced can be partial images currently captured by an industrial camera for a photovoltaic module, or historical images captured by an industrial camera, which is not limited here. The above server can obtain at least two images to be spliced from the industrial camera, or obtain at least two images to be spliced from a preset historical image storage location. The above images to be spliced can be, for example, an image of a solar cell array composed of a preset number of solar cells. At this time, the object to be spliced in the images to be spliced is the solar cell array. Of course, the above images to be spliced can also be an image of a single solar cell. At this time, the object to be spliced in the images to be spliced is the solar cell itself.

[0036] Please refer to Figure 4 A schematic diagram showing the corner positions of all the battery cells powered on in the embodiment of the present application; the figure shows all the corner positions in the partial image of the photovoltaic module. However, in fact, during the fitting process of the corner positions, only some of the corner positions can be fitted because the initial splicing line is a straight line, and theoretically, only two or more corner positions are required to fit this straight line. For example, only any two of the points EFHG in the figure can be used to fit the EF splicing line, FH splicing line, HG splicing line, and / or GE splicing line as the initial splicing line. Of course, in some implementation scenarios, all the corner positions can also be fitted as needed. For example, when fitting the EF splicing line, not only the E corner position and the F corner position are used, but also the other five corner positions between E and F are required to fit an EF splicing line as the initial splicing line. The process of determining the initial splicing line from the image to be spliced can include: first, determining the corner positions according to the image to be spliced, and then, using the least squares algorithm to fit the corner positions to obtain the initial splicing line. Among them, the corner positions can be directly marked in the image to be spliced, or detected from the image to be spliced through a corner detection algorithm. Corner detection algorithms that can be used include, for example, Harris corner detection, SIFT, SURF, etc. Optionally, before fitting the corner positions, the corner positions can be screened first. For example, the corner positions of points EFGH are screened out from all the corner positions in the image to be spliced as the corner positions to be fitted.

[0037] Please refer to Figure 5 A schematic diagram showing the initial splicing line of all the battery cells powered on in the embodiment of the present application; the initial splicing line refers to the battery cell boundary line near the splicing position in the image to be spliced, which is a reference line in the splicing process and is used to preliminarily determine the position of the battery cell gap. After screening out the corner positions of points EFGH from all the corner positions in the image to be spliced, a straight line fitting can be performed on the corner positions of any two of EF, FH, HG, and / or GE among the corner positions of points EFGH to obtain the initial splicing line as shown in the figure.

[0038] Step S120: Adjust the position of the initial splicing line according to the target object to obtain the adjusted splicing line. The target object includes: battery cells, gap regions, bus bar regions, and / or segmentation information, and the segmentation information represents the relative position relationship of the image to be spliced.

[0039] It can be understood that there are many purposes for adjusting the position of the initial splicing line, including expanding or shrinking the height of the battery cell gap to be spliced for the image, offsetting the battery cell gap, or adding a bus bar region, etc. The adjustment method also varies according to different targets. Therefore, the adjustment method here will be described in detail below.

[0040] Step S130: Stitch the images to be stitched according to the adjusted stitching line to obtain the stitched image.

[0041] In the implementation process of the above solution, the initial stitching line determined from the images to be stitched provides the ability to perform position adjustment, and the images to be stitched are stitched according to the adjusted stitching line, improving the problem of image distortion of photovoltaic module images caused by reasons such as image quality. This position adjustment ability of the stitching line can obtain better image stitching processing results, making the stitched image closer to the real photovoltaic module, thereby improving the authenticity of the stitched image.

[0042] Please refer to Figure 6 the schematic diagram of adjusting the initial stitching line when all the battery cells are powered on provided by the embodiment of the present application shown; when all the battery cells are powered on, after determining the initial stitching line from the images to be stitched, the position of the initial stitching line can be adjusted. For example, for the initial stitching line fitted according to the corner positions F and H in the figure, the stitching line can be moved a preset pixel width (such as half of the gap width) in the direction of the gap on the right side, or the stitching line can be directly moved until it reaches the perpendicular bisector between the corner positions F and I, or the stitching line can be directly moved until it reaches the perpendicular bisector between the corner positions H and K, so as to obtain the adjusted stitching line. The adjusted stitching line refers to the stitching line obtained by adjusting the position of the initial stitching line, and the purpose of the adjustment is to make the images at the stitching seam align more accurately and reduce distortion.

[0043] Optionally, when all the battery cells are powered on, the stitching line required in step S130 can also be obtained by not moving the initial stitching line. Specifically, for example: after detecting the corner positions F and H from the first row of battery cell arrays EFGH, since the right side of the first row of battery cell arrays EFGH is also the powered-on battery cell array IJKL (please refer to Figure 6 the right side of), therefore, the corner positions I and K of the right-side powered-on battery cell array can be detected. Then, the first perpendicular bisector between the corner position F and the corner position I can be calculated and determined as the stitching line for stitching the images to be stitched, or the second perpendicular bisector between the corner position H and the corner position K can be calculated and determined as the stitching line for stitching the images to be stitched. The above describes the stitching process of the first row, and the stitching processes of other rows are similar. Moreover, since all are powered on, the corner positions in the column direction can be detected, and the stitching process in the column direction is similar, which will not be elaborated here.

[0044] As an alternative implementation manner of the above step S110, the above target object includes the segmentation information of the images to be stitched; the above implementation manner of determining the initial stitching line from the images to be stitched may include: Step S111: Determine an initial stitching line from the images to be stitched according to the segmentation information of the images to be stitched, where the segmentation information characterizes the relative positional relationship of the images to be stitched.

[0045] The segmentation information refers to data characterizing the relative positional relationship of the images to be stitched in the complete photovoltaic module. Such segmentation information data can be the data information recorded when the images to be stitched are captured. The above-mentioned segmentation information may include camera parameter information, the order of each local image (such as the order of the first cell array, the second cell array, etc.), the position (such as the first row and the first column in the first cell array), and / or the relationship between this segmented image and other segmented images (such as adjacent or non-adjacent), etc.

[0046] Please refer to Figure 7 the schematic diagram of the images to be stitched with some cells in the photovoltaic module powered on provided by the embodiment of the present application shown; in some scenarios where only some cells in the photovoltaic module are powered on, such as the case of powering on a certain row or column of cell arrays in the photovoltaic module. For the sake of easy understanding and explanation, the following takes the case of only powering on the first row of cell arrays as an example for illustration. It can be known from the segmentation information of the images to be stitched that the figure shows the first cell array of the first row segmented image. The process of determining the initial stitching line from the images to be stitched of this cell array is similar to the above step S110, that is, first determine the corner point positions according to the images to be stitched, and then fit the corner point positions to obtain the initial stitching line, so it will not be elaborated here.

[0047] As an alternative implementation manner of the above step S120, the above implementation manner of adjusting the position of the initial stitching line according to the target object may include: Step S121: Determine the moving direction and the number of pixels of the initial stitching line according to the segmentation information.

[0048] Please refer to Figure 8 the schematic diagram of the initial stitching line with some cells in the photovoltaic module powered on provided by the embodiment of the present application shown; The implementation manner of the above step S121 is as follows: The segmentation information of different models of photovoltaic modules may be different, and the moving direction and the number of pixels of the initial stitching line determined by different segmentation information may also be different. It can be that the moving direction and the number of pixels of the initial stitching line are calculated manually through the segmentation information and the model of the photovoltaic module, or the specific values of the segmentation information corresponding to the moving direction and the number of pixels of the initial stitching line are obtained from the configuration file or the database, so that the moving direction and the number of pixels of the initial stitching line can be adjusted dynamically. The moving direction and the number of pixels in the above configuration file or database can be calculated and set in advance by personnel. Specifically, for the cell arrays of the segmented images such as the first row, the second row, and the third row, the pixel value of the spacing in the row direction is assumed to be , the positive or negative value represents the moving direction of the initial splicing line (for example, a positive value indicates moving downward, and a negative value indicates moving upward), and the numerical value represents the number of pixels by which the initial splicing line moves. Similarly, for the cell arrays of segmented diagrams such as the first column, the second column, and the third column, the spacing pixel value in the column direction is assumed to be represented as , the positive or negative value represents the moving direction of the initial splicing line (for example, a positive value indicates moving to the right, and a negative value indicates moving to the left), and the numerical value represents the number of pixels by which the initial splicing line moves.

[0049] Step S122: Move the position of the initial splicing line according to the moving direction and the number of pixels of the initial splicing line.

[0050] Please refer to Figure 9 the schematic diagram of adjusting the initial splicing line when some cells are powered on provided by the embodiment of the present application shown; in some scenarios where only some cells in the photovoltaic module are powered on, some corner positions cannot be detected. For example, when a row or column of cell arrays in the photovoltaic module is powered on, the initial splicing line can be adjusted in the column direction or the row direction to obtain the spliced line after moving and adjusting. For the initial splicing line below the cell array of the first row segmented diagram, the following formula can be used for moving:

[0051] where represents the spliced line after being moved below the cell array of the first row segmented diagram, represents the initial splicing line below the cell array of the first row segmented diagram, represents the spacing pixel value in the row direction, and respectively represent the th row and the th column.

[0052] As another alternative implementation of the above step S120, the above target object may include: the unpowered cells in the image to be spliced; the implementation of adjusting the position of the initial splicing line according to the target object may include: Step S123: Move the position of the splicing line on the side of the initial splicing line close to the unpowered cell towards the side of the unpowered cell by a preset number of spacing pixels to obtain the spliced line after moving, and the preset number of spacing pixels is an empirical value set according to the gap width between the cells.

[0053] The above unpowered cells refer to the cells that are not powered on during the acquisition of the electroluminescence (EL) image. Since these cells are not powered on, they appear as dark areas in the image (please refer to Figure 7 orFigure 8 The dark areas therein indicate the unpowered cells, while the bright areas indicate the powered cells), lacking obvious feature points. Therefore, it is difficult to find the corner positions of the unpowered cells through algorithms, or even if the corner positions found through algorithms are inaccurate.

[0054] Among them, the above-mentioned preset spacing pixel number refers to the number of pixels determined according to the actual gap width between the cells. The above-mentioned preset spacing pixel number can be an empirical value set according to the gap width between the cells, and this preset spacing pixel number is used to adjust the position of the splicing line to make it closer to the actual gap position.

[0055] For example, the implementation manner of the above step S123: For a photovoltaic module with segmented information of three rows and four columns, the following formula can be used to move the initial splicing line below the cell array of the first row segmented diagram:

[0056] For the cell array of the second row segmented diagram, the following formula is used to move the initial splicing lines above and below the cell array:

[0057] For the cell array of the third row segmented diagram, the following formula is used to move the initial splicing line above the cell array:

[0058] For the cell array of the first column segmented diagram, the following formula is used to move the initial splicing line on the right side of the cell array:

[0059] For the cell array of the second column segmented diagram, the following formula is used to move the initial splicing line on the left side of the cell array:

[0060] For the cell array of the third column segmented diagram, the following formula is used to move the initial splicing line on the right side of the cell array:

[0061] For the cell array of the fourth column segmented diagram, the following formula is used to move the initial splicing line on the left side of the cell array:

[0062] Among them, in the row direction, respectively represent the moved splicing lines below the cell arrays of the first row and the second row segmented diagrams, respectively represent the spliced lines after being moved above the cell arrays of the second and third row segmented diagrams, and represent the initial spliced lines below the cell arrays of the first and second row segmented diagrams, and represent the initial spliced lines above the cell arrays of the first and second row segmented diagrams, represents the pitch pixel value of the first movement in the row direction, and respectively represent the row and the column; For the column direction, represents the spliced lines after being moved to the left of the cell arrays of the first, second, third, and fourth column segmented diagrams, represents the spliced lines after being moved to the right of the cell arrays of the first, second, third, and fourth column segmented diagrams, represents the initial spliced lines to the left of the cell arrays of the first, second, third, and fourth column segmented diagrams, represents the initial spliced lines to the right of the cell arrays of the first, second, third, and fourth column segmented diagrams, represents the pitch pixel value of the first movement in the column direction.

[0063] As another alternative implementation manner of the above step S120, it can be understood that the above implementation manner of adjusting the position of the initial spliced line can be applied to the appearance image of the photovoltaic module, and can also be applied to the electroluminescence (EL) image of the photovoltaic module. The above target object may include a gap area, and the implementation manner of adjusting the spliced line for this gap area may include: Step S124a: Move the initial spliced line inward in the direction of the cell by a first preset distance to reserve the gap area between adjacent cells, and the first preset distance is less than the size of the cell in the moving direction.

[0064] Please refer to Figure 10Schematic diagram showing the splicing line of the embodiment of the present application shifted towards the inner side of the cell; in the specific practice process, the splicing line in the appearance image of the photovoltaic module can be shifted towards the inner side of the cell (the left side direction in the figure), or the splicing line in the electroluminescence (EL) image of the photovoltaic module can be shifted towards the inner side of the cell (the left side direction in the figure). In order to present a more realistic image of the gap area in the spliced image (such as the appearance image or the electroluminescence image of the photovoltaic module), the initial splicing line of the first cell (for example, the splicing line near the right boundary) can be moved a first preset distance towards the inner side of the first cell (for example, the center point direction of the first cell is the left side direction), so as to be able to retain the real gap area between adjacent cells in the spliced image after the splicing process is completed, rather than the gap spliced by the two side images. Among them, the first preset distance can be preset and less than the size of the cell in the moving direction (the width of the first cell on the horizontal axis in the figure), so that the moved splicing line falls within the first cell, so as to be able to retain the real gap between adjacent cells in the spliced image after the splicing process is completed according to the moved splicing line. In the subsequent defect detection process of the photovoltaic module, it is necessary to perform defect detection according to the real gap between the cells, such as whether the gap width meets the preset width standard, etc.

[0065] Alternatively, the above-described embodiment of adjusting the position of the initial splicing line may include: Step S124b: Move the initial splicing line a second preset distance towards the outer side of the cell to retain the gap area between adjacent cells, where the second preset distance is greater than the gap width between the cells and less than the sum of the sizes of the adjacent cells and the gap width in the moving direction.

[0066] Please refer to Figure 11Schematic diagram showing the splicing line of the embodiment of the present application offset in the outer direction of the cell; in the specific practice process, the splicing line in the appearance image of the photovoltaic module can be offset in the outer direction of the cell (the right side direction in the figure), or the splicing line in the electroluminescence (EL) image of the photovoltaic module can be offset in the outer direction of the cell (the right side direction in the figure). In order to present a more realistic image of the gap area in the spliced image (such as the appearance image or electroluminescence image of the photovoltaic module), the initial splicing line of the first cell (for example, the splicing line near the right boundary) can be moved a second preset distance in the outer direction of the first cell (the direction away from the center point of the first cell is called the outer direction) to retain the gap area between adjacent cells. Wherein, the second preset distance can be a pre-set distance, and the second preset distance is a distance greater than the gap width between cells and less than the sum of the sizes of adjacent cells and the gap width in the moving direction. Let the moved splicing line fall inside the second cell, so that after the splicing process is completed according to the moved splicing line, the real gap area between adjacent cells can be retained in the spliced image, rather than the gap spliced by the two side images. In the subsequent defect detection process of the photovoltaic module, defect detection needs to be carried out according to the real gap between cells, such as whether the gap width meets the preset width standard, etc.

[0067] Taking a photovoltaic module with segmented information of three rows and four columns as an example to illustrate the specific process of moving all the moved splicing lines in a preset direction. First, the following formula can be used to move the initial splicing line below the cell array of the first row segmented diagram:

[0068] For the cell array of the second row segmented diagram, the following formula is used to move the initial splicing lines above and below the cell array:

[0069] For the cell array of the third row segmented diagram, the following formula is used to move the initial splicing line above the cell array:

[0070] For the cell array of the first column segmented diagram, the following formula is used to move the initial splicing line on the right side of the cell array:

[0071] For the cell array of the second column segmented diagram, the following formula is used to move the initial splicing line on the left side of the cell array:

[0072] For the cell array of the third column segmented diagram, use the following formula to move the initial splicing line on the right side of the cell array:

[0073] For the cell array of the fourth column segmented diagram, use the following formula to move the initial splicing line on the left side of the cell array:

[0074] Wherein, in the row direction, respectively represent the spliced lines after being moved below the cell arrays of the first-row and second-row segmented diagrams, respectively represent the spliced lines after being moved above the cell arrays of the second-row and third-row segmented diagrams, and represent the initial spliced lines below the cell arrays of the first-row and second-row segmented diagrams, and represent the initial spliced lines above the cell arrays of the first-row and second-row segmented diagrams, represents the preset pitch pixel number for the re-movement in the row direction, and the positive or negative value of this value represents the re-movement direction of the spliced line, and respectively represent the row and the column; In the column direction, represents the spliced lines after being moved to the left of the cell arrays of the first-column, second-column, third-column, and fourth-column segmented diagrams, represents the spliced lines after being moved to the right of the cell arrays of the first-column, second-column, third-column, and fourth-column segmented diagrams, represents the initial spliced lines to the left of the cell arrays of the first-column, second-column, third-column, and fourth-column segmented diagrams, represents the initial spliced lines to the right of the cell arrays of the first-column, second-column, third-column, and fourth-column segmented diagrams, represents the preset pitch pixel number for the re-movement in the column direction, and the positive or negative value of this value represents the re-movement direction of the spliced line.

[0075] As another alternative implementation manner of the above step S120, the above target object may include: the bus bar area in the image to be spliced; the implementation manner of adjusting the position of the initial spliced line may include: Step S125: Move the position of the spliced line on the side close to the bus bar area in the initial spliced line to the side of the bus bar area to obtain the moved spliced line.

[0076] One implementation manner of the above step S125 is, for example: Please refer toFigure 12 Schematic diagram of the appearance image of the bus bar area in the image to be spliced provided by the embodiment of the present application; the bus bar area refers to the metal bar area in the photovoltaic module for collecting and transmitting current, and the bus bar in the image usually appears as a bright strip. Therefore, the initial splicing line fitted at the right corner points F and H of the second column of cell arrays can be moved to the right, so that the finally spliced image presents the bus bar area. The determination process of the number of pixels in the width of the area to be moved will be described in detail below. The process of moving the initial splicing line to the right can be expressed by the following formula:

[0077] Wherein, represents the spliced line after the right side of the cell array in the second column of sectional views is moved, represents the initial spliced line on the right side of the cell array in the second column of sectional views, represents the number of pixels in the width of the area to be moved.

[0078] Optionally, another implementation manner of the above step S125 is, for example: the initial spliced line fitted at the left corner points I and K of the cell array in the third column of sectional views can also be moved to the left, so that the finally spliced image presents the bus bar area. The determination process of the number of pixels in the width of the area to be moved will be described in detail below. The process of moving the initial spliced line to the left can be expressed by the following formula:

[0079] Wherein, represents the spliced line after the left side of the cell array in the second column of sectional views is moved, represents the initial spliced line on the left side of the cell array in the second column of sectional views, represents the number of pixels in the width of the area to be moved.

[0080] As an alternative implementation manner of the above step S125, the implementation manner of moving the position of the spliced line on the side close to the bus bar area in the initial spliced line to the side of the bus bar area may include: Step S125a: Move the position of the spliced line on the side close to the bus bar area in the initial spliced line to the side of the bus bar area by the number of pixels in the width of the area.

[0081] Among them, the number of pixels of the region width refers to the width of the bus bar region in the image, in pixels. The above-mentioned number of pixels of the region width can be an empirical value set according to the width of the bus bar region in the image, or the above-mentioned number of pixels of the region width can be determined from the bus bar region detected from the image to be stitched by a target detection neural network model, or the above-mentioned number of pixels of the region width can also be determined from the bus bar region segmented from the image to be stitched by an image segmentation model. The target detection neural network model is a computer vision model based on deep learning, which is used to detect specific targets (such as bus bar regions) from images and output their position and size information. The above-mentioned target detection neural network model can adopt models such as SSD model, RetinaNet model, EfficinetDet model, CenterNet model, Mask-RCNN model, DETR model, YOLO model or Faster-RCNN model, etc. The above-mentioned image segmentation model can adopt models such as U-Net model, DeepLabv3 model, PSPNet model or SegFormer model, etc. Here, taking the cell array of the second column segmented diagram as an example, the following formula is used to calculate the target box of the bus bar region detected from the image to be stitched by the target detection neural network model, and the above-mentioned number of pixels of the region width can be obtained. Among them, represents the number of pixels of the region width that needs to be moved, represents the abscissa of the lower right corner of the target box of the bus bar region, represents the abscissa of the lower left corner of the target box of the bus bar region.

[0082] In the implementation process of the above solution, by moving the position of the stitching line on the side close to the bus bar region in the initial stitching line towards the side of the bus bar region, the finally stitched image presents the bus bar region, making the whole image more comprehensive and capable of presenting the complete structural information of the component.

[0083] As an optional implementation manner of the above step S130, the above implementation manner of stitching the image to be stitched according to the adjusted stitching line may include: Step S131: Align the image to be stitched according to the adjusted stitching line to obtain the aligned image.

[0084] The implementation manner of the above step S131 is, for example: align the image to be stitched according to the adjusted stitching line to obtain the aligned image. The purpose of alignment here is to make the geometric shapes at the stitching seams of adjacent images match. Optionally, after obtaining the aligned image, geometric perspective transformation (such as translation, rotation) can also be performed on the aligned image.

[0085] Step S132: Perform weighted fusion on the aligned images to obtain the stitched image.

[0086] Please refer to Figure 13 the schematic diagram of the stitched appearance image provided by the embodiment of the present application shown in; the implementation manner of the above step S132 is, for example, by performing weighted fusion on the aligned images to obtain the stitched image, which can effectively eliminate the lateral instability or longitudinal instability of the photovoltaic module during the step-by-step shooting with a area array camera, effectively reduce the deviation or misalignment generated at the mapping position, and enable the stitched image to more truly reflect the actual defect situation of the photovoltaic module.

[0087] As an optional implementation manner of the above step S132, the implementation manner of performing weighted fusion on the aligned images may include: Step S132a: Obtain a weight matrix, which is generated according to a Gaussian weight template or a cosine weight template with a preset fusion width.

[0088] The weight matrix refers to the matrix for performing weighted fusion at the stitching line of the images to be stitched, and its element values represent the weights of each pixel in the overlapping area, which is mainly used for pixel-by-pixel adjustment at the stitching line and the edge area of the images to be stitched to ensure smooth transition of the stitching area.

[0089] The preset fusion width is a parameter in the image stitching process, which determines the smoothness of the transition of the stitching area. This fusion width determines the transition range of the stitching area. The larger the width, the wider the transition area and the smoother the change in brightness or texture at the stitching line. Therefore, by setting an appropriate width (for example, for high-resolution images, the width can be set to 10-20 pixels; for low-resolution images, the width can be set to 5-10 pixels), the edge traces (such as brightness jumps or geometric misalignments) at the stitching line can be effectively eliminated.

[0090] The factors considered in the above-mentioned preset fusion width may include: image resolution, lighting conditions, characteristics of the seam area, requirements for splicing accuracy, and computational efficiency, etc. From the perspective of image resolution, high-resolution images require a larger width to achieve smooth transition, while low-resolution images can use a smaller width. From the perspective of lighting conditions, if there is a large difference in lighting between the two side images, a larger width needs to be set to balance the brightness difference. From the perspective of the characteristics of the seam area, if the seam area contains complex textures or details, a larger width needs to be set to avoid unnatural transitions. From the perspective of requirements for splicing accuracy, for high-precision splicing (such as quality inspection of photovoltaic modules), a smaller width needs to be set to retain more details. From the perspective of computational efficiency, the larger the width, the higher the computational complexity. Therefore, on the premise of ensuring the splicing effect, a smaller width should be selected as much as possible to improve computational efficiency.

[0091] Step S132b: Use the weight matrix to perform weighted fusion on the aligned images.

[0092] An implementation manner of the above step S132b is, for example: perform weighted fusion on the aligned images using the weight matrix. For example, for each edge region of the image (such as the right side, left side, top, bottom), multiply the weight value in the weight matrix according to the relative position of the pixels in this edge region respectively, so as to adjust the pixel values in the splicing area. Here, weighted fusion refers to performing weighted averaging on the pixel values in the overlapping area of the aligned images according to the preset weight matrix to achieve the process of smooth transition of the images. Another example: for different splicing regions (such as the right side, left side, top, and bottom) of each image, multiply the pre-computed weight matrix element by element with the image data, so as to update the pixel values of the images to be spliced element by element, and finally complete the fusion of the images.

[0093] As an alternative implementation manner of the above step S132a, the implementation manner of obtaining the weight matrix may include: for the splicing direction of each image to be spliced (up, down, left, right, and according to different segmentation information of the segmented images, its splicing direction is different), use the preset fusion width to generate a weight template, where the weight template may be a linear template, a Gaussian weight template, or a cosine weight template. Then, use the linear template, Gaussian weight template, or cosine weight template to generate the weight matrix. The above-mentioned linear template may include a set of weight values calculated to gradually change from 0 to 1 according to the preset fusion width. Among them, the Gaussian weight template is a weight matrix generated based on the Gaussian function, and its characteristic is that the weight in the center is high and the weight at the edge is low, which can achieve smooth transition. The cosine weight template is a weight matrix generated based on the cosine function or exponential function, and its characteristic is that the weight smoothly decreases from the center to the edge, and is suitable for scenarios that require natural transition.

[0094] Optionally, at the position of the splicing line on the side of the initial splicing line close to the bus bar area, move it towards the side of the bus bar area, so that after the finally spliced image shows the bus bar area, it is also possible to perform bus bar recognition on the spliced image to identify whether the bus bars in the bus bar area are offset or missing, etc., thereby effectively improving the quality inspection efficiency of photovoltaic modules.

[0095] Please refer to Figure 14 the structural schematic diagram of the photovoltaic module image splicing device provided by the embodiment of the present application shown in; the embodiment of the present application provides a photovoltaic module image splicing device 200, including: A splicing line determination module 210, configured to determine an initial splicing line from the images to be spliced. The images to be spliced are partial images of a photovoltaic module, and the initial splicing line represents the boundary of the solar cells in the images to be spliced close to the splicing position.

[0096] A splicing line adjustment module 220, configured to adjust the position of the initial splicing line according to the target object to obtain an adjusted splicing line. The target object includes: solar cells, gap regions, bus bar regions, and / or segmentation information, and the segmentation information represents the relative positional relationship of the images to be spliced.

[0097] An image splicing module 230, configured to splice the images to be spliced according to the adjusted splicing line to obtain a spliced image.

[0098] As an optional implementation manner of the above device, the target object includes segmentation information; the splicing line determination module includes: An initial splicing line determination sub-module, configured to determine an initial splicing line from the images to be spliced according to the segmentation information of the images to be spliced.

[0099] The splicing line adjustment module includes: A direction pixel determination sub-module, configured to determine the moving direction and the number of pixels of the initial splicing line according to the segmentation information.

[0100] An initial splicing line moving sub-module, configured to move the position of the initial splicing line according to the moving direction and the number of pixels of the initial splicing line.

[0101] As an optional implementation manner of the above device, the target object includes: the unpowered solar cells in the images to be spliced; the above-mentioned splicing line adjustment module includes: A first splicing line moving sub-module, configured to move the position of the splicing line on the side of the initial splicing line close to the unpowered solar cells towards the side of the unpowered solar cells by a preset spacing number of pixels to obtain a moved splicing line. The preset spacing number of pixels is an empirical value set according to the gap width between the solar cells.

[0102] As an alternative implementation of the above device, the target object includes a gap area; the stitching line adjustment module includes: The second stitching line moving sub-module is configured to move the initial stitching line inward of the solar cell by a first preset distance to reserve the gap area between adjacent solar cells, where the first preset distance is less than the size of the solar cell in the moving direction; or, move the initial stitching line outward of the solar cell by a second preset distance to reserve the gap area between adjacent solar cells, where the second preset distance is greater than the gap width between the solar cells and less than the sum of the size of the adjacent solar cells and the gap width in the moving direction.

[0103] As an alternative implementation of the above device, the target object includes the bus bar area in the image to be stitched; the above stitching line adjustment module includes: The third stitching line moving sub-module is configured to move the position of the stitching line on the side of the initial stitching line close to the bus bar area toward the side of the bus bar area to obtain the moved stitching line.

[0104] As an alternative implementation of the above device, the third stitching line moving sub-module includes: The third stitching line moving unit is configured to move the position of the stitching line on the side of the initial stitching line close to the bus bar area toward the side of the bus bar area by the number of pixels of the area width; where the number of pixels of the area width is an empirical value set according to the width of the bus bar area in the image, or the number of pixels of the area width is determined by the bus bar area detected from the image to be stitched by a target detection neural network model, or the number of pixels of the area width is determined by the bus bar area segmented from the image to be stitched by an image segmentation model.

[0105] As an alternative implementation of the above device, the image stitching module includes: The image alignment sub-module is configured to align the image to be stitched according to the adjusted stitching line to obtain the aligned image.

[0106] The weighted fusion sub-module is configured to perform weighted fusion on the aligned images to obtain the stitched image.

[0107] As an alternative implementation of the above device, the weighted fusion sub-module includes: The weight matrix acquisition unit is configured to acquire a weight matrix, where the weight matrix is generated according to a Gaussian weight template or a cosine weight template of a preset fusion width; The graphic weighted fusion unit is configured to perform weighted fusion on the aligned images using the weight matrix.

[0108] It should be understood that the device corresponds to the above-mentioned photovoltaic module image stitching method embodiment, and can execute the various steps involved in the above-mentioned method embodiment. The specific functions of the device can be referred to in the above description, and the detailed description is appropriately omitted here. The device includes at least one software function module that can be stored in a memory in the form of software or firmware or fixed in the operating system (OS) of the device.

[0109] An electronic device provided in an embodiment of the present application includes: a processor and a memory, the memory storing machine-readable instructions executable by the processor, and the above method is performed when the machine-readable instructions are executed by the processor.

[0110] The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and the computer program is executed by a processor to execute the above method. The computer-readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, disk or optical disk.

[0111] The embodiment of the present application also provides a computer program product, including: a computer program or a computer instruction, and the computer program or the computer instruction executes the method described above when executed by a processor.

[0112] It should be noted that each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the embodiments can be referred to each other. For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0113] In several embodiments provided by the embodiments of the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architectures, functions, and operations of devices, methods, and computer program products according to multiple embodiments of the embodiments of the present application. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code, and the module, program segment, or part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may also occur in a different order from that marked in the accompanying drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, mainly depending on the functions involved.

[0114] In addition, the various functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist alone, or two or more modules may be integrated to form an independent part. Furthermore, in the description of this specification, the descriptions referring to terms such as "one embodiment", "some embodiments", "example", "specific example", "some examples", etc. mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the embodiments of the present application. In this specification, the schematic expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. In addition, without contradiction, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples.

[0115] The above description is only an alternative implementation manner of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited thereto. Any person skilled in the art within the technical scope disclosed by the embodiments of the present application can easily think of changes or substitutions, which should all be covered within the protection scope of the embodiments of the present application.

Claims

1. A photovoltaic module image stitching method, characterized in that: include: Determining an initial stitching line from the image to be stitched, wherein the image to be stitched is a partial image of a photovoltaic module, and the initial stitching line represents a boundary of a cell in the image to be stitched close to a stitching position; Adjusting the position of the initial stitching line according to a target object to obtain an adjusted stitching line, wherein the target object includes: a battery cell, a gap area, a bus bar area and / or segmentation information, wherein the segmentation information represents a relative position relationship of the images to be stitched; The images to be stitched are stitched according to the adjusted stitching line to obtain a stitched image.

2. The method according to claim 1, characterized in that The target object includes segmentation information; and determining an initial stitching line from the images to be stitched includes: Determining an initial stitching line from the images to be stitched according to segmentation information of the images to be stitched; The adjusting the position of the initial stitching line according to the target object includes: Determining the moving direction and the number of pixels of the initial stitching line according to the segmentation information; The position of the initial stitching line is moved according to the moving direction and the number of pixels of the initial stitching line.

3. The method according to claim 1, characterized in that The target object includes: an unpowered battery cell in the image to be spliced; and adjusting the position of the initial splicing line according to the target object includes: The stitching line position close to the unpowered battery cell in the initial stitching line is moved toward the unpowered battery cell by a preset number of pixels to obtain a moved stitching line, wherein the preset number of pixels is an empirical value set according to the gap width between the battery cells.

4. The method according to claim 1, characterized in that: The target object includes a gap area; and adjusting the position of the initial stitching line according to the target object includes: Moving the initial splicing line toward the inner side of the battery sheet by a first preset distance to reserve the gap area between adjacent battery sheets, wherein the first preset distance is smaller than the size of the battery sheet in the moving direction; Alternatively, the initial splicing line is moved toward the outside of the battery cell by a second preset distance to retain the gap area between adjacent battery cells, and the second preset distance is greater than the gap width between the battery cells and less than the sum of the size of the adjacent battery cells in the moving direction and the gap width.

5. The method according to claim 1, characterized in that The target object includes: a bus bar area in the image to be stitched; and the adjusting the position of the initial stitching line includes: The position of the splicing line in the initial splicing line close to one side of the bus bar area is moved toward one side of the bus bar area to obtain a moved splicing line.

6. The method according to claim 5, characterized in that The step of moving the position of the initial splicing line close to one side of the bus bar area toward one side of the bus bar area comprises: The stitching line position close to the bus bar area in the initial stitching line is moved toward the side of the bus bar area by the number of area width pixels; wherein the number of area width pixels is an empirical value set according to the width of the bus bar area in the image, or the number of area width pixels is determined by the bus bar area detected from the image to be stitched by a target detection neural network model, or the number of area width pixels is determined by the bus bar area segmented from the image to be stitched by an image segmentation model.

7. The method according to claim 1, characterized in that The step of stitching the images to be stitched according to the adjusted stitching line comprises: Aligning the images to be stitched according to the adjusted stitching line to obtain an aligned image; The aligned images are weightedly fused to obtain the spliced ​​image.

8. The method according to claim 7, characterized in that Performing weighted fusion on the aligned images, including: Obtain a weight matrix, where the weight matrix is ​​generated according to a Gaussian weight template or a cosine weight template with a preset fusion width; The weight matrix is ​​used to perform weighted fusion on the aligned images.

9. A photovoltaic module image splicing device, characterized in that: include: A stitching line determination module, used to determine an initial stitching line from an image to be stitched, wherein the image to be stitched is a partial image of a photovoltaic module, and the initial stitching line represents a boundary of a cell in the image to be stitched close to a stitching position; A stitching line adjustment module, used to adjust the position of the initial stitching line according to a target object to obtain an adjusted stitching line, wherein the target object includes: a battery cell, a gap area, a bus bar area and / or segmentation information, wherein the segmentation information represents the relative position relationship of the images to be stitched; The image stitching module is used to stitch the images to be stitched according to the adjusted stitching line to obtain a stitched image.

10. An electronic device, characterized in that: include: A processor and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the machine-readable instructions are executed by the processor to perform any method according to claims 1 to 8.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 8 is executed.

12. A computer program product, characterized in that include: A computer program or a computer instruction, wherein when the computer program or the computer instruction is executed by a processor, the method according to any one of claims 1 to 8 is executed.

Citation Information

Patent Citations

  • Rapid splicing method and system for photovoltaic module images

    CN111311487A

  • Image splicing method and device of photovoltaic module, electronic device and storage medium

    CN113393378A

  • Image splicing method and device, storage medium and unmanned aerial vehicle

    CN116523748A

  • Image splicing method and device, equipment and storage medium

    CN116823601A

  • Elastic correction and splicing method and system for line scanning photovoltaic module picture

    CN116862767A

Cited By

  • PCB jointed board automatic optical detection method and device based on edge detection, and medium

    CN121582140A

  • Line scanning solar module image self-adaptive splicing method based on battery piece grid structure

    CN121767179A