Judgment Method, Device, Storage Medium and Electronic Device for Photovoltaic Module Detachment

Abstract

The present application discloses a method, device, storage medium and electronic device for judging the detachment of a photovoltaic module. Among them, the method includes: obtaining a first ground elevation model corresponding to a target area within a target time period, where the first ground elevation model is at least used to indicate the elevation information of each photovoltaic module in the target area within the target time period; obtaining first position information of each sub-area corresponding to each photovoltaic module from a second ground elevation model corresponding to the target area within a historical time period; extracting target elevation information corresponding to each sub-area from the first ground elevation model according to the first position information; and determining whether there is a detachment phenomenon for each photovoltaic module according to the target elevation information. The present application solves the technical problems in the related art that when identifying the detachment phenomenon of photovoltaic modules based on algorithms such as machine learning, there are problems such as a large amount of data processing, long time consumption, and inaccurate identification results.

Description

Technical Field

[0001] The present application relates to the field of photovoltaic applications, and in particular, to a method, device, storage medium, and electronic device for judging the detachment of photovoltaic modules. Background Art

[0002] Domestic photovoltaic power stations are generally built on large hillsides, deserts, plains, swamps, waters, rooftops of factories, rooftops of residents, etc. There are significant differences in the scale, form, distribution, etc. of different photovoltaic power stations, resulting in many inconveniences in the later operation and maintenance inspections. Especially for larger-scale photovoltaic power generation projects, the complexity of the power station inspection work is stronger. When inspecting such types of power station projects, on the one hand, the conventional manual inspection method not only requires a large amount of labor and time costs, resulting in untimely inspection of power station equipment and affecting the economic benefits of the power plant; on the other hand, the work of inspection personnel also has certain risks.

[0003] Currently, a camera device carried by a drone can be used to inspect photovoltaic modules. Based on the method of image analysis and detection, machine learning and other related algorithms are used to implement the detection task of faulty modules. Component faults generally include hot spots, weed shading, component detachment, etc. However, identifying the faults of photovoltaic modules through algorithms such as machine learning requires obtaining a large amount of sample data for model training. The data processing process is relatively complex, time-consuming, and there are often technical problems such as a large deviation between the recognition result and the actual situation and poor accuracy of the recognition result due to the small amount of sample data.

[0004] In response to the above problems, no effective solution has been proposed yet. Summary of the Invention

[0005] Embodiments of the present application provide a method, device, storage medium, and electronic device for judging the detachment of photovoltaic modules, so as to at least solve the technical problems in the related art that the recognition of the detachment phenomenon of photovoltaic modules based on algorithms such as machine learning has a large amount of data processing, is time-consuming, and the recognition result is inaccurate.

[0006] According to one aspect of the embodiments of the present application, a method for judging the detachment of photovoltaic modules is provided, including: obtaining a first digital elevation model corresponding to a target area within a target time period, where the first digital elevation model is at least used to indicate the elevation information of each photovoltaic module in the target area within the target time period; obtaining first position information of each sub-region corresponding to each photovoltaic module based on a second digital elevation model corresponding to the target area within a historical time period, where no photovoltaic module in the target area has detached during the historical time period; extracting target elevation information of each sub-region corresponding to each photovoltaic module from the first digital elevation model according to the first position information; and determining whether each photovoltaic module has detached according to the target elevation information.

[0007] Optionally, determining whether each photovoltaic module has fallen off according to the target elevation information includes: determining the average elevation of each sub-region according to the target elevation information; comparing the average elevation with the first preset threshold corresponding to each sub-region to obtain a first comparison result, and determining whether each photovoltaic module has fallen off according to the first comparison result.

[0008] Optionally, determining whether each photovoltaic module has fallen off according to the first comparison result includes: when the first comparison result indicates that the average elevation is less than the first preset threshold, determining the sub-region where the average elevation is less than the first preset threshold as the target sub-region; determining the photovoltaic module corresponding to the target sub-region as the target photovoltaic module with the falling-off phenomenon.

[0009] Optionally, determining whether each photovoltaic module has fallen off according to the target elevation information includes: determining the first elevation value and the second elevation value corresponding to each sub-region according to the target elevation information, where the first elevation value is the elevation value at the highest point position in the sub-region, and the second elevation value is the elevation value at the lowest point position in the sub-region; determining the difference between the first elevation value and the second elevation value; comparing the difference with the second preset threshold to obtain a second comparison result, and determining whether each photovoltaic module has fallen off according to the second comparison result.

[0010] Optionally, determining whether each photovoltaic module has fallen off according to the second comparison result includes: when the second comparison result indicates that the difference is greater than the second preset threshold, determining the sub-region where the difference is greater than the second preset threshold as the target sub-region; determining the photovoltaic module corresponding to the target sub-region as the target photovoltaic module with the falling-off phenomenon.

[0011] Optionally, obtaining the first position information of each sub-region corresponding to each photovoltaic module based on the second ground elevation model of the target region in the historical period includes: obtaining the second ground elevation model and the electronic map corresponding to the predetermined region, where the second ground elevation model is used to indicate the elevation information of each object on the ground surface in the predetermined region in the historical period, and the electronic map is used to indicate the map information of the predetermined region; obtaining the second position information of the target region where the photovoltaic module is located in the predetermined region according to the second ground elevation model; obtaining the map image corresponding to the predetermined region according to the electronic map; obtaining the target image corresponding to the target region from the map image according to the second position information, and determining the first position information according to the target image.

[0012] Optionally, determining the first position information according to the target image includes: converting the target image into a grayscale image, and invoking an edge detection algorithm to obtain an edge image corresponding to the grayscale image, where the edge image at least includes: edge lines; invoking a Hough transform algorithm to search for all straight lines in the edge image; obtaining four grid boundary lines corresponding to each photovoltaic module according to the spacing between the straight lines; obtaining each sub-region according to the four grid boundary lines; and determining the intersection coordinates of the four grid boundary lines as the first position information.

[0013] According to an embodiment of the present application, there is also provided a device for judging the detachment of a photovoltaic module, including: a first acquisition module, configured to acquire a first digital elevation model corresponding to a target area within a target time period, where the first digital elevation model is at least used to indicate the elevation information of each photovoltaic module in the target area within the target time period; a second acquisition module, configured to acquire the first position information of each sub-region corresponding to each photovoltaic module based on a second digital elevation model corresponding to the target area within a historical time period, where no detachment phenomenon occurs for each photovoltaic module in the target area within the historical time period; an extraction module, configured to extract the target elevation information corresponding to each sub-region from the first digital elevation model according to the first position information; and a determination module, configured to determine whether there is a detachment phenomenon for each photovoltaic module according to the target elevation information.

[0014] According to an embodiment of the present application, there is also provided a non-volatile storage medium, where the storage medium includes a stored program, and when the program runs, it controls the device where the storage medium is located to execute any method for judging the detachment of a photovoltaic module.

[0015] According to an embodiment of the present application, there is also provided an electronic device, including: a processor; and a memory for storing processor-executable instructions; where the processor is configured to execute the instructions to implement any method for judging the detachment of a photovoltaic module.

[0016] In the embodiment of the present application, a method of determining whether each photovoltaic module has detached based on the elevation information of the photovoltaic module is adopted. By acquiring the first digital elevation model of the target area within the target time period, and then acquiring the second digital elevation model of the target area within the historical time period, obtaining the first position information of each sub-region corresponding to each photovoltaic module from the second digital elevation model, and extracting the target elevation information corresponding to each sub-region from the first digital elevation model according to the first position information, the purpose of determining whether the photovoltaic module has detached based on the target elevation information is achieved, thereby realizing the technical effect of quickly and accurately identifying the detached module, and further solving the technical problems in the related art that the recognition of the detachment phenomenon of the photovoltaic module based on algorithms such as machine learning has a large amount of data processing, a long time consumption, and inaccurate recognition results. Description of the Drawings

[0017] The accompanying drawings described herein are used to provide a further understanding of the present application and form a part of the present application. The schematic embodiments and descriptions thereof of the present application are used to explain the present application and do not constitute an improper limitation of the present application. In the drawings:

[0018] Figure 1 is a schematic flowchart of an optional method for judging the detachment of a photovoltaic module according to an embodiment of the present application;

[0019] Figure 2 is a schematic flowchart of an optional method for judging the detachment of a photovoltaic module of the present application;

[0020] Figure 3 is a schematic diagram of the panoramic electronic map A of the power station in an exemplary embodiment of the present application;

[0021] Figure 4 is a schematic diagram of the digital surface model DSM-A of the ground in an exemplary embodiment of the present application;

[0022] Figure 5 is a schematic diagram of the predetermined area where the photovoltaic module is located obtained by segmentation using an elevation threshold in an exemplary embodiment of the present application;

[0023] Figure 6 is a schematic diagram of the target area where the photovoltaic module is located obtained by connected component filtering in an exemplary embodiment of the present application;

[0024] Figure 7 is a visible light image of the component area cropped from the panoramic electronic map A of the power station in an exemplary embodiment of the present application;

[0025] Figure 8 is a schematic diagram of the segmentation effect of the visible light image of the component area in an exemplary embodiment of the present application;

[0026] Figure 9 is a schematic diagram of the digital surface model of the ground during the operation and maintenance of the power station in an exemplary embodiment of the present application;

[0027] Figure 10 The left half is the visible light image of the component in the panoramic electronic map A of the power station, and the right half is the target elevation information of the component in the digital surface model DSM-B of the ground;

[0028] Figure 11 is a schematic diagram of the detachment of the component in an exemplary embodiment of the present application;

[0029] Figure 12 is a schematic structural diagram of a device for judging the detachment of a photovoltaic module according to an embodiment of the present application;

[0030] Figure 13 shows a schematic block diagram of an exemplary electronic device 800 that can be used to implement the embodiments of the present application. Detailed implementation manners

[0031] To enable those skilled in the art to better understand the solution of this application, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of this application.

[0032] It should be noted that the terms "first", "second", etc. in the specification, claims and above-mentioned drawings of this application are used to distinguish similar objects, and do not necessarily need to be used to describe a specific order or sequence. It should be understood that such used data can be interchanged under appropriate circumstances so that the embodiments of this application described here can be implemented in an order other than those illustrated or described here. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0033] To facilitate better understanding by those skilled in the art of related embodiments of this application, the technical terms or some nouns that this application may involve are now explained:

[0034] Digital Surface Model (abbreviated as DSM) refers to a ground elevation model that includes the heights of surface buildings, bridges, trees, etc.

[0035] Connected Component refers to an image area in an image that is adjacent and has the same pixel value. Connected Component Analysis (Connected Component Labeling) refers to finding and labeling each connected component in the image.

[0036] Grayscale image: In the RGB model, if R = G = B, the color represents a grayscale color, where the value of R = G = B is called the grayscale value. Therefore, each pixel of a grayscale image only needs one byte to store the grayscale value (also called intensity value, brightness value), and the grayscale range is 0 - 255.

[0037] Elevation refers to the height of a certain point relative to a reference plane. Currently, there are 4 common elevation systems: orthometric height, normal height, dynamic height, and geodetic height, and different countries have different definitions of elevation benchmarks.

[0038] For a photovoltaic module, a single solar cell cannot be directly used as a power source. To be used as a power source, a number of single cells must be connected in series and parallel and tightly encapsulated into a module. A solar cell module (also called a solar panel) is the core part of a solar power generation system and also the most important part. Its function is to convert solar energy into electrical energy, which can either be sent to a storage battery for storage or used to drive a load.

[0039] The Canny edge detection operator is a multi-level detection algorithm. It was proposed by John F. Canny in 1986, and at the same time, three major criteria for edge detection were proposed: 1. Edge detection with a low error rate: The detection algorithm should accurately find as many edges as possible in the image and minimize missed detections and false detections. 2. Optimal localization: The detected edge points should be accurately located at the center of the edge. 3. Any edge in the image should be marked only once, and at the same time, image noise should not generate false edges. To meet these requirements, Canny used the calculus of variations. The optimal function in the Canny detector is described by the sum of four exponential terms, which can be approximated by the first derivative of the Gaussian function. Among the commonly used edge detection methods currently, the Canny edge detection algorithm is one of the methods with strict definitions and can provide good and reliable detections. Due to its advantages of meeting the three criteria for edge detection and having a simple implementation process, it has become one of the most popular algorithms for edge detection.

[0040] According to an embodiment of the present application, an embodiment of a method for judging the detachment of a photovoltaic module is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.

[0041] Figure 1 A method for judging the detachment of a photovoltaic module according to an embodiment of the present application is as Figure 1 shown, and the method includes the following steps:

[0042] S102, obtain a first digital elevation model corresponding to a target area within a target period, where the first digital elevation model is at least used to indicate the elevation information of each photovoltaic module in the target area within the target period;

[0043] In the technical solution of step S102 of the present application, by obtaining the first digital elevation model corresponding to the target area within the target period, the elevation information of each photovoltaic module within the target period can be determined in real time.

[0044] Optionally, the above target period may be during the power station operation and maintenance. By obtaining the digital elevation model during the power station operation and maintenance, the elevation information of each photovoltaic module during the power station operation and maintenance can be determined.

[0045] S104. Obtain the first position information of each sub-region corresponding to each photovoltaic module based on the second digital elevation model corresponding to the target region during the historical period, and no photovoltaic module in the target region has fallen off during the historical period;

[0046] Through the technical solution of step S104 of the present application, the first position information of each sub-region corresponding to each photovoltaic module can be obtained based on the second digital elevation model corresponding to the above target region during the historical period. It can be understood that the end time of the historical period is earlier than the start time of the target period.

[0047] Optionally, the second digital elevation model corresponding to the target region during the above historical period may be the digital elevation model when the power station is completed. It can be understood that through steps S102 to S104, the digital elevation models of two different stages, that is, the stage when the power station is completed and the digital elevation model at any time during the power station operation and maintenance, can be obtained.

[0048] S106. Extract the target elevation information corresponding to each sub-region from the first digital elevation model according to the first position information;

[0049] Through the technical solution of step S106 of the present application, the target elevation information of each sub-region can be extracted from the first digital elevation model corresponding to the target period based on the first position information determined by the second digital elevation model corresponding to the historical period.

[0050] It can be understood that after the power station is completed, due to human or natural factors, the position, shape, etc. of the photovoltaic modules in the power station may change. Therefore, by combining the digital elevation models of the two stages, it is convenient to quickly determine the photovoltaic modules whose positions, shapes, etc. have changed.

[0051] S108. Determine whether there is any falling-off phenomenon for each photovoltaic module according to the target elevation information.

[0052] It should be noted that if some components of a certain photovoltaic module have fallen off, then the elevation information of this photovoltaic module will change compared with the elevation information when it has not fallen off originally. Therefore, the photovoltaic modules that have fallen off can be determined through the target elevation information corresponding to each photovoltaic module.

[0053] In the technical solutions of steps S102 to S108 of this application, a method of determining whether each photovoltaic module has fallen off based on the elevation information of the photovoltaic modules is adopted. By obtaining the first ground elevation model of the target area within the target time period, and then obtaining the second ground elevation model of the target area within the historical time period, the first position information of each sub-region corresponding to each photovoltaic module is obtained from the second ground elevation model, and the target elevation information corresponding to each sub-region is extracted from the first ground elevation model according to the first position information, achieving the purpose of determining whether the photovoltaic module has fallen off based on the target elevation information, thus realizing the technical effect of quickly and accurately identifying the fallen-off module, and further solving the technical problems in the related art that the identification of the fallen-off phenomenon of photovoltaic modules based on algorithms such as machine learning has a large amount of data processing, takes a long time, and the identification result is inaccurate.

[0054] As an optional implementation manner, determining whether each photovoltaic module has fallen off according to the target elevation information includes: determining the average elevation of each sub-region according to the target elevation information; comparing the size of the average elevation with the first preset threshold corresponding to each sub-region to obtain a first comparison result, and determining whether each photovoltaic module has fallen off according to the first comparison result.

[0055] It can be understood that if a component in a certain photovoltaic module falls off, the average elevation of the photovoltaic module will decrease. Therefore, it is possible to determine whether the photovoltaic module has fallen off by comparing the size relationship between the average elevation and the first preset threshold.

[0056] It should be noted that the above first preset threshold can be the average elevation of each sub-region of each photovoltaic module within the historical time period determined according to the second ground elevation model in the historical time period. For example, the first preset threshold can be the average elevation of all photovoltaic modules when the power station is completed. It should be noted that in the relevant embodiments of this application, the first preset threshold can also be the product of the average elevation and a preset coefficient. This application does not limit the value of the first preset threshold.

[0057] Specifically, determining whether each photovoltaic module has fallen off according to the first comparison result includes: when the first comparison result indicates that the average elevation is less than the first preset threshold, determining the sub-region where the average elevation is less than the first preset threshold as the target sub-region; determining the photovoltaic module corresponding to the target sub-region as the target photovoltaic module with the fallen-off phenomenon.

[0058] It is easy to notice that if a component in a certain photovoltaic module falls off, the relative distance between the highest position and the lowest position in the photovoltaic module will become larger. For example, when a component in a certain photovoltaic module falls off and drops to the ground, the relative distance between the highest position and the lowest position of the photovoltaic module will become larger. Therefore, as another alternative implementation manner, to determine whether there is a phenomenon of component falling off in each photovoltaic module according to the target elevation information, it can be achieved through the following method:

[0059] Determine the first elevation value and the second elevation value corresponding to each sub-region according to the target elevation information, where the first elevation value is the elevation value at the highest point position in the sub-region, and the second elevation value is the elevation value at the lowest point position in the sub-region; determine the difference between the first elevation value and the second elevation value; compare the size of the difference with the second preset threshold to obtain a second comparison result, and determine whether there is a phenomenon of component falling off in each photovoltaic module according to the second comparison result.

[0060] Specifically, determining whether there is a phenomenon of component falling off in each photovoltaic module according to the second comparison result includes: when the second comparison result indicates that the difference is greater than the second preset threshold, determine the sub-region where the difference is greater than the second preset threshold as the target sub-region; determine the photovoltaic module corresponding to the target sub-region as the target photovoltaic module with the phenomenon of component falling off. It can be understood that if a photovoltaic module has a component falling off, the difference between the elevation value (i.e., the first elevation value) at the highest point position of the photovoltaic module and the elevation value (the second elevation value) at the lowest point position of the photovoltaic module will become larger. Therefore, it can be determined whether the photovoltaic module has a component falling off through the difference between the two. It should be noted that the above second preset threshold can be flexibly set according to the structural characteristics of the photovoltaic module itself.

[0061] In some embodiments of the present application, obtaining the first position information of each sub-region corresponding to each photovoltaic module from the second ground elevation model corresponding to the target region in the historical period can be achieved through the following method: obtain the second ground elevation model and the electronic map corresponding to the predetermined region, where the second ground elevation model is used to indicate the elevation information of each object on the ground surface in the predetermined region in the historical period, and the electronic map is used to indicate the map information of the predetermined region; obtain the second position information corresponding to the target region where the photovoltaic module is located in the predetermined region according to the second ground elevation model; obtain the map image corresponding to the predetermined region according to the electronic map; obtain the target image corresponding to the target region from the map image according to the second position information, and determine the first position information according to the target image.

[0062] Specifically, the determination of the first position information based on the target image can be achieved through the following steps: converting the target image into a grayscale image, calling an edge detection algorithm to obtain an edge image corresponding to the grayscale image, where the edge image at least includes: edge lines; calling a Hough transform algorithm to search for all straight lines in the edge image; obtaining four grid boundary lines corresponding to each photovoltaic module according to the spacing between the straight lines; obtaining each sub-region according to the four grid boundary lines; and determining the intersection coordinates of the four grid boundary lines as the first position information.

[0063] The above technical solutions of this embodiment will be further introduced below.

[0064] Figure 2 It is a schematic flowchart of an optional method for judging the shedding of photovoltaic modules in this application. As Figure 2 shown, this method can establish a panoramic electronic map A of the power station and a digital surface model DSM-A on the ground in the first stage. The area where the modules are located is segmented through the digital surface model DSM-A on the ground to eliminate the false detection targets that appear in the area outside the modules. According to the GPS coordinates of the area where the modules are located, each module area in the panoramic electronic map A of the power station is segmented through relevant algorithms such as image processing. In the second stage, after the power station is inspected by an unmanned aerial vehicle, a digital surface model DSM-B on the ground is established. According to the GPS coordinates of the rectangular frames of the modules segmented from the panoramic electronic map A of the power station, the elevation information within the rectangular area is extracted from the digital surface model DSM-B for judging the shedding of the modules, so as to realize the judgment of the shedding of the modules in the photovoltaic power station. Specifically:

[0065] 1) The first stage: After the construction of the power station is completed, the panoramic electronic map A of the power station (i.e., the electronic map) and the digital surface model DSM-A on the ground (i.e., the second digital surface model in the historical period) can be generated by using software such as pix4dMapper based on the collected visible light pictures of the modules.

[0066] (2) The area where the modules are located is segmented through the digital surface model DSM-A on the ground to eliminate the false detection targets that appear in the area outside the modules, and the GPS coordinates (i.e., the second position information) of the target areas where all photovoltaic modules are located are obtained. That is, by obtaining the second digital surface model on the ground corresponding to the predetermined area and the electronic map, the second position information corresponding to the target area where the photovoltaic modules are located within the predetermined area is obtained according to the second digital surface model on the ground. It should be noted that the above second position information includes but is not limited to: the above GPS coordinates, and may also be rectangular frame coordinates, etc.

[0067] (3) Based on the GPS coordinates of the area where the components are located, each component area in the panoramic electronic map A of the power station is segmented through relevant algorithms such as image processing to obtain the GPS coordinates of the rectangular frames corresponding to each photovoltaic component (i.e., the first position information). Thus, the map image corresponding to the predetermined area can be obtained from the electronic map. The target image corresponding to the target area is obtained from the map image according to the second position information, and the first position information is determined based on the target image.

[0068] (4) The second stage: During the operation and maintenance of the power station, after the drone inspects the power station, a digital surface model DSM-B (i.e., the first digital surface model of the target period) is established.

[0069] (5) Based on the GPS coordinates of the rectangular frames corresponding to each photovoltaic component segmented from the panoramic electronic map A of the power station (i.e., the first position information), the elevation information within the rectangular area is extracted from the digital surface model DSM-B for component detachment discrimination. Thus, the target elevation information corresponding to each sub-area can be extracted from the first digital surface model according to the first position information, and then it is determined whether there is a detachment phenomenon for each photovoltaic component based on the target elevation information.

[0070] The above steps will be described in detail below in combination with an application scenario.

[0071] 1. The drone collects visible light images. The drone conducts inspections on photovoltaic components according to the planned path, collects visible light images, and records the GPS geographical coordinates of the location where the collection point is located, corresponding to the GPS coordinates at the center point of the visible light image.

[0072] 2. The first stage: After the construction of the power station is completed, based on the collected visible light images of the components, relevant software such as pix4dMapper can be used to generate the panoramic electronic map A (electronic map) of the power station and the digital surface model DSM-A (the second digital surface model), as shown in the figure, Figure 3 is a schematic diagram of the panoramic electronic map A of the power station, Figure 4 is a schematic diagram of the digital surface model DSM-A.

[0073] 3. The area where the components are located is segmented through the digital surface model DSM-A, and the false detection targets in the area outside the components are eliminated to obtain the GPS coordinates (the second position information) of the areas where all photovoltaic components (i.e., photovoltaic arrays) are located.

[0074] (1) Based on the elevation information in the digital surface model DSM-A, an elevation threshold is set, and the area where the photovoltaic array is located in the DSM-A map is segmented according to this elevation threshold. Figure 5 is a schematic diagram of the approximate areas (i.e., the predetermined areas) where all photovoltaic components (i.e., photovoltaic arrays) are located segmented through the elevation threshold.

[0075] (2) Segment the area where the components are located by combining image processing.

[0076] According to all the continuous areas segmented, analyze the characteristics of each continuous area, retain the areas that conform to the rectangular characteristics, and delete the irregular areas around that do not conform to the rectangular characteristics, to obtain the target area where the photovoltaic components are located in the power station. Figure 6 It is a schematic diagram of the target area where the photovoltaic components are located obtained after connected component filtering. In addition, the average height High of all components inside the area where the components are located can be calculated.

[0077] 4. According to the GPS coordinates (the second position information) of the target area where the photovoltaic array is located, segment each component area in the panoramic electronic map A of the power station through an image processing algorithm to obtain the GPS coordinates (the first position information) of the rectangular frames corresponding to each photovoltaic component, that is, the second position information corresponding to the target area where the photovoltaic components are located in the predetermined area can be obtained according to the second digital elevation model, and the map image corresponding to the predetermined area can be obtained according to the electronic map, then the target image corresponding to the target area can be obtained from the map image according to the second position information, and the first position information can be determined according to the target image.

[0078] (1) According to the GPS coordinates of the target area where the photovoltaic array is located, the visible light picture of this component area can be cropped from the panoramic electronic map A of the power station, as Figure 7 shown.

[0079] (2) Use the image processing algorithm to segment each component inside the visible light picture of the component area. The specific steps are as follows:

[0080] (a) Perform grayscale processing on the visible light picture of the component area, and then perform Canny edge detection to obtain the edge image.

[0081] (b) Search for all possible straight lines in the edge image through the HoughLines Hough line transform.

[0082] (c) After finding all possible straight lines, determine the grid boundary lines of each component in the visible light picture of the component area.

[0083] (d) Determine the four grid boundary lines of each component according to the distance between the straight lines.

[0084] (e) Calculate the coordinates of the four intersection points where the four grid boundary lines of each component intersect, so as to achieve the segmentation of all components in the visible light picture of the component area. Figure 8 It is a schematic diagram of the segmentation effect of the visible light picture of the component area, where the thick straight lines represent the segmentation lines, as Figure 8 shown. Through the coordinates of the four intersection points where the four grid boundary lines of each component intersect, the segmentation of all components in the visible light picture of the component area is achieved.

[0085] 5. Second stage: During the power station operation and maintenance period, after the UAV inspects the power station, based on the collected visible light images of the components, use software such as pix4dMapper to generate a digital surface model DSM-B (i.e., the first digital surface model at the target time period). Figure 9 It is the digital surface model DSM-B during the power station operation and maintenance period, as Figure 9 shown, the parts marked by the circles indicate that component detachment has occurred.

[0086] 6. According to the GPS coordinates of the rectangular frames corresponding to each photovoltaic component (abbreviated as component rectangular frame GPS coordinates) segmented from the panoramic electronic map A of the power station, extract the elevation information within this rectangular area from the digital surface model DSM-B for component detachment discrimination.

[0087] (1) The GPS coordinates of the component rectangular frames segmented from the panoramic electronic map A of the power station can be taken out in sequence.

[0088] (2) According to the GPS coordinates of the component rectangular frame, extract the elevation within this rectangular area from the digital surface model DSM-B, and the elevation map of this component can be obtained. Figure 10 The left half is the visible light image of the component in the panoramic electronic map A of the power station, and the right half is the elevation map of the component in the digital surface model DSM-B.

[0089] (3) According to this component elevation map, calculate the sum of the elevations at the positions of the predetermined coordinate points in the elevation map, and then find the average value.

[0090]

[0091] Among them, Avg represents the average elevation in the component elevation map, M and N represent the height and width of the component elevation map, and H[[ID=2??]] i，j represents the elevation at the position of the (i, j) coordinate point in the component elevation map.

[0092] (4) According to the average elevation Avg in this component elevation map and the average height High of all components within the area where the component is located, perform component detachment discrimination. Suppose the first preset threshold is 0.7×High. If Avg < 0.7×High, it means that this component has detached. Figure 11 It is a schematic diagram of component detachment in this embodiment, as Figure 11 shown, the parts marked within the circles indicate that component detachment has occurred.

[0093] ((5) Obviously, by repeating the above steps, based on the GPS coordinates of the component rectangular frames segmented from the panoramic electronic map A of the power station and the elevation information extracted from the digital surface model DSM-B within this rectangular area, the detachment discrimination of all photovoltaic components in the target area can be realized.

[0094] It is easy to notice that through the above method, the panoramic electronic map A of the power station and the digital surface model DSM-A of the ground elevation can be established in the first stage. Then, the area where the components are located can be segmented through the digital surface model DSM-A of the ground elevation, the false detection targets in the area outside the components are eliminated, and each component area in the panoramic electronic map A of the power station can be segmented according to the GPS coordinates of the area where the components are located through relevant image processing methods. After the power station is inspected by the UAV in the second stage, the digital surface model DSM-B of the ground elevation is established. According to the GPS coordinates of the component rectangular frames segmented from the panoramic electronic map A of the power station, the elevation information within the rectangular area is extracted from the digital surface model DSM-B of the ground elevation for component shedding discrimination, so as to realize the discrimination of component shedding in the photovoltaic power station. It can be understood that segmenting the area where the components are located according to the digital surface model DSM of the ground elevation can completely avoid misdetecting some targets outside the area where the components are located as components, thus improving the accuracy of component segmentation.

[0095] It should be noted that the above image processing algorithms include but are not limited to: YOLOv4 object detection algorithm, YOLOv5 object detection algorithm, Faster RCNN object detection algorithm, SSD object detection algorithm, etc.

[0096] Figure 12 A device for judging the shedding of photovoltaic components according to an embodiment of the present application, as Figure 12 shown, the device includes:

[0097] A first acquisition module 40, configured to acquire a first digital surface model of the ground elevation corresponding to a target area within a target time period, where the first digital surface model of the ground elevation is at least used to indicate the elevation information of each photovoltaic component in the target area within the target time period;

[0098] A second acquisition module 42, configured to acquire first position information of each sub-area corresponding to each photovoltaic component from a second digital surface model of the ground elevation corresponding to the target area within a historical time period, where no photovoltaic component in the target area has shed during the historical time period;

[0099] An extraction module 44, configured to extract target elevation information corresponding to each sub-area from the first digital surface model of the ground elevation according to the first position information;

[0100] A determination module 46, configured to determine whether each photovoltaic component has shed according to the target elevation information.

[0101] In the photovoltaic module detachment determination device, a first acquisition module is configured to acquire a first ground elevation model corresponding to a target area during a target period, where the first ground elevation model is at least used to indicate the elevation information of each photovoltaic module in the target area during the target period; a second acquisition module is configured to acquire first position information of each sub-area corresponding to each photovoltaic module from a second ground elevation model corresponding to the target area during a historical period, where no detachment phenomenon occurs for each photovoltaic module in the target area during the historical period; an extraction module is configured to extract target elevation information of each sub-area corresponding to each photovoltaic module from the first ground elevation model according to the first position information; a determination module is configured to determine whether each photovoltaic module has a detachment phenomenon according to the target elevation information, achieving the purpose of determining whether a photovoltaic module has a detachment based on the target elevation information, thus realizing the technical effect of quickly and accurately identifying the detached module, and further solving the technical problems in the related art that there are large data processing amounts, long time consumption, and inaccurate identification results when identifying the detachment phenomenon of photovoltaic modules based on algorithms such as machine learning.

[0102] According to an embodiment of the present application, there is also provided a non-volatile storage medium. The storage medium includes a stored program, where when the program runs, it controls the device where the storage medium is located to execute any method for determining the detachment of a photovoltaic module.

[0103] Specifically, the above storage medium is used to store program instructions with the following functions to implement the following functions:

[0104] Acquire a first ground elevation model corresponding to a target area during a target period, where the first ground elevation model is at least used to indicate the elevation information of each photovoltaic module in the target area during the target period; acquire first position information of each sub-area corresponding to each photovoltaic module based on a second ground elevation model corresponding to the target area during a historical period, where no detachment phenomenon occurs for each photovoltaic module in the target area during the historical period; extract target elevation information of each sub-area corresponding to each photovoltaic module from the first ground elevation model according to the first position information; determine whether each photovoltaic module has a detachment phenomenon according to the target elevation information.

[0105] Optionally, in this embodiment, the above storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or equipment, or any suitable combination of the above. More specific examples of the above storage medium will include electrical connections based on one or more wires, portable computer disks, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), optical fibers, portable compact disk read-only memories (CD-ROMs), optical storage devices, magnetic storage devices, or any suitable combination of the above.

[0106] In an exemplary embodiment of the present application, a computer program product is further provided, including a computer program, which when executed by a processor, implements the method for judging the detachment of a photovoltaic module according to any one of the above.

[0107] Optionally, when the computer program is executed by a processor, the following steps may be implemented:

[0108] Obtain a first digital elevation model corresponding to a target area within a target time period, where the first digital elevation model is at least used to indicate the elevation information of each photovoltaic module in the target area within the target time period; obtain the first position information of each sub-area corresponding to each photovoltaic module based on the second digital elevation model corresponding to the target area within a historical time period, where no detachment phenomenon occurs for each photovoltaic module in the target area within the historical time period; extract the target elevation information of each sub-area corresponding to each photovoltaic module from the first digital elevation model according to the first position information; and determine whether there is a detachment phenomenon for each photovoltaic module according to the target elevation information.

[0109] According to an embodiment of the present application, an electronic device is provided. The electronic device includes: at least one processor; and a memory communicatively connected to the at least one processor; where the memory stores instructions executable by the at least one processor, and when the instructions are executed by the at least one processor, the at least one processor can execute the method for judging the detachment of a photovoltaic module according to any one of the above.

[0110] Optionally, the above electronic device may further include a transmission device and an input / output device, where the transmission device is connected to the above processor, and the input device and the output device are connected to the above processor.

[0111] Figure 13 FIG. shows a schematic block diagram of an exemplary electronic device 800 that can be used to implement the embodiments of the present application. The electronic device is intended to represent various forms of digital computers, such as, a laptop computer, a desktop computer, a workbench, a personal digital assistant, a server, a blade server, a mainframe computer, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as, a personal digital processor, a cellular phone, a smart phone, a wearable device, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described herein and / or claimed.

[0112] As Figure 13As shown, device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to computer programs stored in a read-only memory (ROM) 802 or computer programs loaded from a storage unit 808 into a random access memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the device 800 can also be stored. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0113] Multiple components in the device 800 are connected to the I / O interface 805, including: an input unit 806, such as a keyboard, a mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a magnetic disk, an optical disc, etc.; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 809 allows the device 800 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0114] The computing unit 801 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The computing unit 801 executes the various methods and processes described above, such as the method for judging the detachment of photovoltaic components. For example, in some embodiments, the method for judging the detachment of photovoltaic components can be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as the storage unit 808. In some embodiments, part or all of the computer program can be loaded and / or installed onto the device 800 via the ROM 802 and / or the communication unit 809. When the computer program is loaded into the RAM 803 and executed by the computing unit 801, one or more steps of the method for judging the detachment of photovoltaic components described above can be executed. Alternatively, in other embodiments, the computing unit 801 can be configured to execute the method for judging the detachment of photovoltaic components in any other appropriate manner (e.g., by means of firmware).

[0115] The various embodiments of the systems and techniques described above in this specification can be implemented in digital electronic circuitry, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: being implemented in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be a special-purpose or general-purpose programmable processor that receives data and instructions from, and transmits data and instructions to, a storage system, at least one input device, and at least one output device.

[0116] The program code for implementing the methods of this application can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing device, such that the program codes, when executed by the processor or controller, cause the functions / operations specified in the flowchart and / or block diagram to be implemented. The program code can be executed entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine, or entirely on the remote machine or server.

[0117] In the context of this application, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0118] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and a pointing device (e.g., a mouse or a trackball) through which the user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, speech input, or tactile input).

[0119] The systems and techniques described herein can be implemented in a computing system including backend components (e.g., as a data server), or a computing system including middleware components (e.g., an application server), or a computing system including frontend components (e.g., a user computer having a graphical user interface or a web browser through which the user can interact with an implementation of the systems and techniques described herein), or a computing system including any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected by digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include: local area network (LAN), wide area network (WAN), and the Internet.

[0120] A computer system can include a client and a server. The client and the server are generally far from each other and usually interact through a communication network. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, or a server of a distributed system, or a server combined with a blockchain.

[0121] In the relevant embodiments of the present application, a method for determining whether each photovoltaic module has fallen off based on the elevation information of the photovoltaic modules is adopted. By obtaining the first ground elevation model of the target area during the target period, and then obtaining the second ground elevation model of the target area during the historical period, the first position information of each sub-area corresponding to each photovoltaic module is obtained from the second ground elevation model, and the target elevation information corresponding to each sub-area is extracted from the first ground elevation model according to the first position information, so as to achieve the purpose of determining whether the photovoltaic module has fallen off based on the target elevation information, thereby realizing the technical effect of quickly and accurately identifying the fallen-off modules, and further solving the technical problems in the related art that the identification of the fallen-off phenomenon of photovoltaic modules based on algorithms such as machine learning has a large amount of data processing, takes a long time, and the identification result is inaccurate.

[0122] The serial numbers of the embodiments of the present application above are only for description and do not represent the superiority or inferiority of the embodiments.

[0123] In the above embodiments of the present application, the descriptions of the various embodiments have their own emphases. For the parts not detailed in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

[0124] In the several embodiments provided by the present application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only illustrative. For example, the division of the units can be a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection to each other can be through some interfaces. The indirect coupling or communication connection of the units or modules can be in an electrical or other form.

[0125] The units described as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they can be located in one place or distributed to multiple units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0126] In addition, the functional units in the various embodiments of the present application can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above integrated units can be implemented in the form of hardware or in the form of software functional units.

[0127] If the above integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. And the aforementioned storage medium includes: USB flash drives, read-only memories (ROMs), random access memories (RAMs), mobile hard disks, magnetic disks or optical disks and other various media that can store program codes.

[0128] The above are only the preferred embodiments of the present application. It should be noted that for those of ordinary skill in the art, without departing from the principle of the present application, several improvements and refinements can be made, and these improvements and refinements should also be regarded as the protection scope of the present application.

Claims

1. A method for judging the detachment of a photovoltaic module, characterized in that, Including: Obtaining a first ground elevation model corresponding to a target area within a target time period, where the first ground elevation model is at least used to indicate the elevation information of each photovoltaic module in the target area during the target time period; Obtaining first position information of each sub-region corresponding to each photovoltaic module based on a second ground elevation model corresponding to the target area during a historical time period, where no photovoltaic module in the target area has fallen off during the historical time period; Extracting target elevation information corresponding to each sub-region from the first ground elevation model according to the first position information; Determining whether there is a phenomenon of falling off for each photovoltaic module according to the target elevation information; Among them, determining whether there is a phenomenon of falling off for each photovoltaic module according to the target elevation information includes: Determining a first elevation value and a second elevation value corresponding to each sub-region according to the target elevation information, where the first elevation value is the elevation value at the highest point position within the sub-region, and the second elevation value is the elevation value at the lowest point position within the sub-region; Determining the difference between the first elevation value and the second elevation value; Comparing the size of the difference with a second preset threshold to obtain a second comparison result, and determining whether there is a phenomenon of falling off for each photovoltaic module according to the second comparison result.

2. The method according to claim 1, characterized in that, Determining whether there is a phenomenon of falling off for each photovoltaic module according to the target elevation information includes: Determining the average elevation of each sub-region according to the target elevation information; Comparing the size of the average elevation with a first preset threshold corresponding to each sub-region to obtain a first comparison result, and determining whether there is a phenomenon of falling off for each photovoltaic module according to the first comparison result.

3. The method according to claim 2, wherein Determining whether there is a phenomenon of falling off for each photovoltaic module according to the first comparison result includes: When the first comparison result indicates that the average elevation is less than the first preset threshold, determining the sub-region where the average elevation is less than the first preset threshold as the target sub-region; Determining the photovoltaic module corresponding to the target sub-region as the target photovoltaic module with a falling-off phenomenon.

4. The method according to claim 1, characterized in that, Determining whether there is a phenomenon of falling off for each photovoltaic module according to the second comparison result includes: When the second comparison result indicates that the difference is greater than the second preset threshold, determining the sub-region where the difference is greater than the second preset threshold as the target sub-region; Determining the photovoltaic module corresponding to the target sub-region as the target photovoltaic module with a falling-off phenomenon.

5. The method according to claim 1, characterized in that Obtaining first position information of each sub-region corresponding to each photovoltaic module based on a second ground elevation model corresponding to the target area during a historical time period includes: Obtaining a second ground elevation model and an electronic map corresponding to a predetermined area, where the second ground elevation model is used to indicate the elevation information of each object on the ground surface within the predetermined area during the historical time period, and the electronic map is used to indicate the map information of the predetermined area; Obtaining second position information corresponding to the target area where the photovoltaic modules are located within the predetermined area according to the second ground elevation model; Obtaining a map image corresponding to the predetermined area according to the electronic map; Obtain the target image corresponding to the target area from the map image according to the second position information, and determine the first position information according to the target image.

6. The method according to claim 5, characterized in that Determining the first position information according to the target image includes: Convert the target image into a grayscale image, and call an edge detection algorithm to obtain an edge image corresponding to the grayscale image, where the edge image at least includes: edge lines; Call the Hough transform algorithm to search for all straight lines in the edge image; Obtain four grid boundary lines corresponding to each photovoltaic module according to the spacing between the straight lines; Obtain each sub-region according to the four grid boundary lines; determine the intersection coordinates of the four grid boundary lines as the first position information.

7. A judging device for the detachment of a photovoltaic module, characterized in that, Includes: A first acquisition module for acquiring a first digital elevation model corresponding to a target area during a target time period, where the first digital elevation model is at least used to indicate the elevation information of each photovoltaic module in the target area during the target time period; A second acquisition module for obtaining the first position information of each sub-region corresponding to each photovoltaic module based on a second digital elevation model corresponding to the target area during a historical time period, where no photovoltaic module in the target area has fallen off during the historical time period; An extraction module for extracting the target elevation information corresponding to each sub-region from the first digital elevation model according to the first position information; A determination module for determining whether there is a falling-off phenomenon of each photovoltaic module according to the target elevation information; Wherein, the determination module is further configured to determine a first elevation value and a second elevation value corresponding to each sub-region according to the target elevation information, where the first elevation value is the elevation value at the highest point position in the sub-region, and the second elevation value is the elevation value at the lowest point position in the sub-region; determine the difference between the first elevation value and the second elevation value; compare the size of the difference with a second preset threshold to obtain a second comparison result, and determine whether there is a falling-off phenomenon of each photovoltaic module according to the second comparison result.

8. A non-volatile storage medium, characterized in that, The storage medium includes a stored program, wherein when the program runs, it controls the device where the storage medium is located to execute the method for judging the falling-off of a photovoltaic module according to any one of claims 1 to 6.

9. An electronic device, characterized in that, Includes: A processor; A memory for storing instructions executable by the processor; Wherein, the processor is configured to execute the instructions to implement the method for judging the falling-off of a photovoltaic module according to any one of claims 1 to 6.

Images