Photovoltaic device labeling method, electronic device, and computer-readable storage medium
By performing image segmentation and automatic matching of layout map numbers on panoramic images of photovoltaic power plants, the problems of low efficiency and error in labeling photovoltaic equipment have been solved, realizing automated labeling of photovoltaic equipment and improving labeling efficiency and accuracy.
Patent Information
- Application Number
- CN202211643856.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-20
- Publication Date
- 2025-12-12
- Estimated Expiration
- 2042-12-20
AI Technical Summary
In existing technologies, the labeling of photovoltaic equipment is inefficient and prone to errors. It is usually done manually, which leads to low efficiency and high error rate.
By segmenting the panoramic image of the photovoltaic power station, the image areas of the photovoltaic equipment are identified and numbered. Combined with the numbering of the layout map, the layout map number is automatically labeled to the panoramic image. Automatic labeling is achieved by using image recognition technology and image segmentation algorithm.
It enables automatic labeling of photovoltaic equipment, improves labeling efficiency, avoids the inefficiency and errors of manual labeling, and enhances the accuracy and efficiency of labeling.
Smart Images

Figure CN116071738B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of labeling technology for photovoltaic equipment, and in particular to labeling methods, electronic devices and computer-readable storage media for photovoltaic equipment. Background Technology
[0002] Photovoltaic equipment in a photovoltaic (PV) power plant includes, but is not limited to, PV strings and PV modules. After obtaining a panoramic view of the PV power plant, it is usually necessary to assign a corresponding number to each PV device. For example, the layout number corresponding to each PV device in the layout diagram can be added to the panoramic view.
[0003] In related technologies, the layout diagram number corresponding to each photovoltaic device is typically added to the panoramic image manually. Since the layout diagram number consists of a string of numbers and / or letters, manual annotation is inefficient and prone to errors. Summary of the Invention
[0004] To address the aforementioned issues, this application provides a labeling method, electronic device, and computer-readable storage medium for photovoltaic equipment, avoiding the problems of low efficiency and error-prone manual labeling, thereby improving labeling efficiency.
[0005] To solve the above-mentioned technical problems, one technical solution adopted in this application is: to provide a method for labeling photovoltaic equipment, the method comprising: acquiring a panoramic view and a layout view of a photovoltaic power station; determining image regions of several photovoltaic equipment from the panoramic view; numbering all image regions to obtain an image number corresponding to each photovoltaic equipment; determining a layout view number for each photovoltaic equipment from the layout view; and labeling the corresponding photovoltaic equipment in the panoramic view using the image number and the layout view number.
[0006] The process of identifying image regions for several photovoltaic devices from the panoramic image includes: performing image segmentation on the panoramic image to segment out image regions for several photovoltaic devices.
[0007] The process involves numbering all image regions to obtain the image number corresponding to each photovoltaic device. This includes: obtaining the centroid of each image region to obtain the corresponding centroid set; sorting the centroids in the centroid set to obtain the number of each centroid; and using the number of each centroid as the image number corresponding to each photovoltaic device.
[0008] The process of sorting the centroids in the centroid set to obtain the number of each centroid includes: sorting the centroids in the centroid set according to the vertical coordinate to obtain the sorted centroid set; and sorting the centroids in the sorted centroid set using the reference coordinate to obtain the number of each centroid.
[0009] The process involves sorting the centroids in the sorted centroid set using a reference coordinate system to obtain the number of each centroid. This includes: identifying several centroids from the centroid set whose ordinates are less than the reference coordinates; sorting these centroids according to their abscissas; adjusting the ordinates of the reference coordinate system; and re-sorting the remaining unsorted centroids until all centroids are sorted.
[0010] The process of determining the layout diagram number of each photovoltaic device from the layout diagram includes: performing image segmentation on the layout diagram to segment out several layout diagram number images corresponding to photovoltaic devices; and sorting the layout diagram number images to obtain the initial number of the layout diagram number images.
[0011] The process of labeling the corresponding photovoltaic devices in the panoramic image using image numbers and layout map numbers includes: establishing an association between image numbers and layout map number images based on the same image number and the initial number; and labeling the corresponding photovoltaic devices in the panoramic image using image numbers and layout map number images with the same association.
[0012] The process of obtaining a panoramic view of a photovoltaic power station includes: acquiring multiple images of the photovoltaic power station; and stitching the multiple images together to obtain a panoramic view.
[0013] To solve the above-mentioned technical problems, another technical solution adopted in this application is to provide an electronic device, which includes a processor and a memory coupled to the processor. The memory stores a computer program, and the processor executes the computer program to implement the method provided by the above-mentioned technical solution.
[0014] To solve the above-mentioned technical problems, another technical solution adopted in this application is to provide a computer-readable storage medium that stores a computer program, which, when executed by a processor, implements the method provided by the above-mentioned technical solution.
[0015] The beneficial effects of the embodiments of this application are as follows: Unlike the prior art, the photovoltaic equipment labeling method provided in this application obtains the image area of the corresponding photovoltaic equipment by performing image recognition on the panoramic image of the photovoltaic power station, and numbers the image area. It also processes the layout map of the photovoltaic power station to obtain the corresponding layout map number. Then, by using the correlation between the panoramic image and the layout map, the corresponding photovoltaic equipment in the panoramic image is automatically labeled using the image number and the layout map number. That is, the layout map number can be automatically labeled on the corresponding panoramic image, avoiding the problems of low efficiency and easy error of manual labeling, and improving labeling efficiency. Attached Figure Description
[0016] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. Wherein:
[0017] Figure 1 This is a flowchart illustrating the first embodiment of the labeling method for photovoltaic equipment provided in this application;
[0018] Figure 2 This is a flowchart illustrating the second embodiment of the labeling method for photovoltaic equipment provided in this application;
[0019] Figure 3 This is a flowchart illustrating an embodiment of step 24 provided in this application;
[0020] Figure 4 This is a flowchart illustrating an embodiment of step 242 provided in this application;
[0021] Figure 5 This is a flowchart illustrating an embodiment of step 28 provided in this application;
[0022] Figures 6-11 This is a schematic diagram illustrating an application scenario of the labeling method for photovoltaic equipment provided in this application;
[0023] Figure 12 This is a schematic diagram of the structure of an embodiment of the electronic device provided in this application;
[0024] Figure 13 This is a schematic diagram of an embodiment of the computer-readable storage medium provided in this application. Detailed Implementation
[0025] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. It is understood that the specific embodiments described herein are only for explaining this application and not for limiting it. Furthermore, it should be noted that, for ease of description, only the parts related to this application are shown in the accompanying drawings, not all structures. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.
[0026] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.
[0027] See Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of the labeling method for photovoltaic equipment provided in this application. The method includes:
[0028] Step 11: Obtain a panoramic view and layout diagram of the photovoltaic power station.
[0029] In some embodiments, photovoltaic power plants have corresponding layout diagrams during construction. These layout diagrams can be in formats such as CAD, JPG, or PDF. Therefore, the corresponding layout diagrams can be directly obtained from the relevant database. That is, the photovoltaic power plant in the panoramic view is set up according to the layout diagram.
[0030] In some embodiments, a panoramic view of a photovoltaic power station is obtained by acquiring multiple images of the power station and then stitching them together. For example, a drone equipped with a data acquisition device can be used to take aerial photos of the power station to obtain multiple images. Due to limitations in the resolution and pixel count of the data acquisition device, the multiple images may only represent a partial view of the power station; therefore, the panoramic view can be obtained by stitching the multiple images together.
[0031] Step 12: Identify the image areas of several photovoltaic devices from the panoramic image.
[0032] In some embodiments, image segmentation algorithms can be used to segment the panoramic image to obtain corresponding image region masks. These image region masks can then be used to determine the image regions of several photovoltaic devices from the panoramic image. That is, each image region mask corresponds to one photovoltaic device.
[0033] Step 13: Number all image regions to obtain the image number corresponding to each photovoltaic device.
[0034] In some embodiments, the image regions can be numbered according to their position in the panoramic image. For example, the image regions in the panoramic image can be numbered from left to right and then from top to bottom to obtain the image number corresponding to each photovoltaic device.
[0035] For example, the image regions in the panoramic image are numbered from right to left and then from top to bottom to obtain the image number corresponding to each photovoltaic device.
[0036] Step 14: Determine the layout diagram number for each photovoltaic device from the layout diagram.
[0037] The layout diagram includes a layout diagram number for each photovoltaic (PV) device. This layout diagram number can be the PV string number corresponding to the PV device.
[0038] Specifically, the layout diagram number can be extracted as a whole using an image thresholding algorithm to obtain the corresponding layout diagram number image. Since this layout diagram number image only contains the layout diagram number, it can be directly used as the layout diagram number for the corresponding photovoltaic equipment, thereby reducing the need for operations such as text recognition in the image.
[0039] Step 15: Label the corresponding photovoltaic devices in the panoramic image using the image number and layout map number.
[0040] When obtaining the layout diagram number, these layout diagram numbers can be assigned in the same way that all image regions are numbered.
[0041] Then, image regions with consistent numbers are associated with layout map numbers, and the corresponding photovoltaic devices in the panoramic image are labeled using the image numbers and layout map numbers.
[0042] In this embodiment, by performing image recognition on the panoramic image of the photovoltaic power station, the image regions of the corresponding photovoltaic equipment are obtained and numbered. The layout map of the photovoltaic power station is also processed to obtain the corresponding layout map number. Then, by using the correlation between the panoramic image and the layout map, the corresponding photovoltaic equipment in the panoramic image is automatically labeled using the image number and the layout map number. That is, the layout map number can be automatically labeled on the corresponding panoramic image, avoiding the problems of low efficiency and easy error of manual labeling, and improving labeling efficiency.
[0043] See Figure 2 , Figure 2 This is a flowchart illustrating the first embodiment of the labeling method for photovoltaic equipment provided in this application. The method includes:
[0044] Step 21: Obtain a panoramic view and layout diagram of the photovoltaic power station.
[0045] Step 21 has the same or similar technical solution as any of the above embodiments, and will not be described in detail here.
[0046] Step 22: Perform image segmentation on the panoramic image to segment out image regions of several photovoltaic devices.
[0047] In some embodiments, image segmentation can be performed using edge segmentation. That is, the region enclosed by the coordinate points segmented from the edges can form the image region of the photovoltaic device. In other words, the image region is formed by the segmented edge coordinate points.
[0048] Step 23: Obtain the centroid of each image region to get the corresponding centroid set.
[0049] Therefore, the centroid of each image region can be determined using the edge coordinates corresponding to each image region. For example, the planar projection of a photovoltaic installation is usually rectangular or oriented in a positive direction, meaning the image region is rectangular or oriented in a positive direction, so the centroid can be the center point of the image region.
[0050] Therefore, the centroids of multiple image regions can form a corresponding set of centroids. The centroid can represent the center point of the photovoltaic device in the panoramic image.
[0051] Step 24: Sort the centroids in the centroid set to obtain the number of each centroid.
[0052] The centroids in the centroid set also have corresponding coordinates, so the coordinates of the centroids can be used to sort them and obtain the number of each centroid.
[0053] For example, sort the centroids in the centroid set according to their horizontal coordinates to obtain a sorted centroid set. Then, sort the centroids in the sorted centroid set using the reference coordinates to obtain the number of each centroid.
[0054] In some embodiments, see Figure 3 Step 24 can be the following process:
[0055] Step 241: Sort the centroids in the centroid set according to their y-coordinates to obtain the sorted centroid set.
[0056] Since these centroids are essentially unordered during the segmentation and centroid determination processes, they need to be sorted according to a standard. For example, they can be sorted by the ordinate of the centroid coordinates or by the abscissa of the centroid coordinates to obtain an ordered set of centroids.
[0057] Step 242: Sort the centroids in the sorted centroid set using the reference coordinates to obtain the number of each centroid.
[0058] After sorting, the centroids in the centroid set have a relatively regular order. At this point, the reference coordinates can be used to sort the centroids in the sorted centroid set to obtain the number of each centroid.
[0059] The reference coordinates can be adjusted according to a set step size to complete the sorting of all centroids.
[0060] In some embodiments, see Figure 4 Step 242 can be the following process:
[0061] Step 41: Identify several centroids from the centroid set whose ordinates are less than the reference coordinates in the centroid coordinate system.
[0062] The ordinate of the reference coordinate system is adjusted according to a preset step size. When sorting using the current reference coordinate system, several centroids with ordinates less than the current reference coordinate system are identified from the centroid set. Other centroids with ordinates greater than or equal to the current reference coordinate system are temporarily disregarded.
[0063] Step 42: Sort the centroids according to their x-coordinates.
[0064] For centroids whose ordinates are less than the reference ordinate, sort them according to their x-coordinates. This can be done from left to right or from right to left.
[0065] Step 43: Adjust the vertical coordinate of the reference coordinate and sort the remaining unsorted centroids again until all centroids are sorted.
[0066] After the current centroids are sorted, the ordinate of the reference coordinate is adjusted according to a preset step size. That is, the ordinate of the reference coordinate increases after adjustment, and the reference coordinate shifts downward. Then, the remaining unsorted centroids are sorted according to the adjusted reference coordinate.
[0067] For example, from the remaining unsorted centroids, determine several centroids whose ordinates are less than the baseline. Then, sort these centroids according to their x-coordinates. The sorted sequence number must immediately follow the previous sort. For example, if the last sequence number in the previous sort was 3, then the first sequence number in this sort would be 4.
[0068] By adjusting the ordinate of the baseline coordinates as described above, the remaining unsorted centroids are sorted until all centroids are sorted.
[0069] Step 25: Use the number of each centroid as the image number corresponding to each photovoltaic device.
[0070] Since the centroid actually corresponds to the image area, and the image area corresponds to the photovoltaic device, the number corresponding to the centroid can be used as the image number of the corresponding photovoltaic device.
[0071] In other embodiments, the panoramic image is segmented to divide it into image regions for several photovoltaic devices. Target sorting points are determined for each image region in the same manner, resulting in a set of target sorting points. For example, the lower right corner of an image region can be used as a target sorting point, as can the lower left corner, the upper right corner, the upper left corner, or the centroid of each image region. Only target sorting points determined in the same way can be used for subsequent sorting.
[0072] Then, the target sorting points in the target sorting point set are sorted to obtain the number of each target sorting point. The specific sorting method can be referred to the centroid sorting method, which will not be elaborated here.
[0073] Then, the number of each target sorting point is used as the image number corresponding to each photovoltaic device.
[0074] Step 26: Perform image segmentation on the layout diagram to extract the layout diagram number images corresponding to several photovoltaic devices.
[0075] The layout diagram is segmented to separate the layout diagram images corresponding to each set of photovoltaic devices.
[0076] Specifically, image morphology operations are used to connect numbers and symbols that are close in distance together, and the areas corresponding to these connected numbers and symbols are used as layout map numbering images.
[0077] Among them, the circumscribed rectangles corresponding to the areas of these numbers and symbols can be found, and the areas corresponding to the circumscribed rectangles on the layout diagram are used as the layout diagram number image.
[0078] Step 27: Sort the layout diagram numbered images to obtain the initial number of the layout diagram numbered images.
[0079] The sorting method for the layout diagram numbered images can be the same as the sorting method for the image regions of photovoltaic equipment described above.
[0080] For example, obtain the centroid of each layout image number to get the corresponding centroid set. Sort the centroids in the centroid set to get the number of each centroid. Specifically, sort the centroids in the centroid set according to their vertical coordinates to get the sorted centroid set. And sort the centroids in the sorted centroid set using the reference coordinates to get the number of each centroid.
[0081] Specifically, from the centroid set, several centroids whose ordinates are less than the reference coordinates are identified. These centroids are then sorted according to their x-coordinates. After sorting, the ordinates of the reference coordinates are adjusted, and the remaining unsorted centroids are sorted again until all centroids are sorted. The corresponding centroid numbers are then used as the initial numbers for the layout diagram's numbered image.
[0082] In other embodiments, the circumscribed rectangles can be directly sorted. For example, the centroid of each circumscribed rectangle can be obtained to get a corresponding centroid set. The centroids in the centroid set can be sorted to obtain the number of each centroid. Specifically, the centroids in the centroid set can be sorted according to their vertical coordinates to obtain a sorted centroid set. And the centroids in the sorted centroid set can be sorted using a reference coordinate to obtain the number of each centroid.
[0083] Specifically, from the centroid set, several centroids whose ordinates are less than the reference coordinates are identified. These centroids are then sorted according to their x-coordinates. After sorting, the ordinates of the reference coordinates are adjusted, and the remaining unsorted centroids are sorted again until all centroids are sorted. The corresponding centroid numbers are then used as the initial numbers for the circumscribed rectangle. Since the circumscribed rectangles correspond to the numbered images in the layout diagram, the initial numbers also correspond to the initial numbers in the numbered images of the layout diagram.
[0084] Step 28: Use the layout map image corresponding to the image number and the initial number to label the corresponding photovoltaic equipment in the panoramic image.
[0085] In some embodiments, see Figure 5 Step 28 can be the following process:
[0086] Step 51: Establish the association between the image number and the layout diagram number image based on the same image number and initial number.
[0087] Since the image numbers and initial numbers are obtained using the same sorting method, and the layout diagram and panoramic image have a corresponding relationship, the same image number and initial number actually correspond to the same photovoltaic device and the corresponding layout diagram number. In other words, the layout diagram images with the same image number and initial number actually correspond to the same photovoltaic device.
[0088] Therefore, the image number and the layout diagram number can also form a corresponding relationship.
[0089] Step 52: Use the image number and layout map number image with the same association to label the corresponding photovoltaic equipment in the panoramic image.
[0090] Since the image number and layout diagram number are associated, the corresponding photovoltaic devices can be labeled on the panoramic image so that each photovoltaic device in the panoramic image has a corresponding image number and layout diagram number. For example, using the same associated image number and layout diagram number, the image number can be labeled on the image of the photovoltaic device, and the layout diagram number can be labeled on one side of the image of the photovoltaic device, such as the top, bottom, left, or right side.
[0091] In this embodiment, by performing image recognition on the panoramic image of the photovoltaic power station, the image regions of the corresponding photovoltaic equipment are obtained and numbered. The layout map of the photovoltaic power station is also processed to obtain the corresponding layout map number. Then, by using the correlation between the panoramic image and the layout map, the corresponding photovoltaic equipment in the panoramic image is automatically labeled using the image number and the layout map number. That is, the layout map number can be automatically labeled on the corresponding panoramic image, avoiding the problems of low efficiency and easy error of manual labeling, and improving labeling efficiency.
[0092] Furthermore, by using reference coordinates to sort the disordered centroids, the sorting of numerous image regions can be achieved, while also ensuring the accuracy of the sorting.
[0093] In one application scenario, combined Figures 6-11 Explanation:
[0094] Drones equipped with data acquisition devices collect images of specific areas of the photovoltaic power station. Then, panoramic image stitching software, such as Photoscan (a 3D modeling software) and Pix4D, is used to stitch together images of all the selected areas, creating a panoramic image of the entire photovoltaic power station. Figure 6 As shown.
[0095] Panoramic images are processed using image segmentation algorithms, such as traditional thresholding, deep learning semantic segmentation, and instance segmentation, to obtain corresponding binary image masks, such as... Figure 7 As shown. Figure 7 The white area in the middle corresponds to the photovoltaic equipment in the photovoltaic power station.
[0096] right Figure 7 Image processing algorithms are applied to the white region to obtain the image coordinates of the contour points (i.e., edge points) of the white region. The set of contour points corresponding to each white contour is denoted as I0 = {(x0, y0), ..., (x...y0)}. n y n )}、...、I n ={(x0, y0), ..., (x n y n If all the white outlines are set, then all the white outlines can form the outline set I = {I0, ..., I}. nBy performing operations on each element in set I, the centroid of each white outline in the panoramic image can be obtained. Let the centroids of all white outlines be C0(x, y), ..., C0(x, y). n (x, y), then the centroids of all white outlines can form a centroid set, denoted as the centroid set C = {C0, ..., C...} n Since the centroid set C of the obtained white outline is an unordered set, it needs to be sorted. Here, it is sorted according to the sorting rules from top to bottom and from left to right.
[0097] Specifically, in combination Figure 8 To illustrate, using the image coordinate system as the reference coordinate system, given that the image width is W (horizontal coordinate) and the height is H (vertical coordinate), the coordinates of the top-left corner are O(0, 0) and the coordinates of the bottom-right corner are R(w, h). The centroid set C is sorted in ascending order based on the y-values of the y-axis (vertical coordinate). The sorted set is denoted as P = {P0, ..., P...} n}
[0098] Starting from the y-coordinate P0(y) in set P, with a fixed step size of s0, visit until element P in the set is reached. n (y). Let l be the left endpoint of line l0. 00 (0, P0(y)), right endpoint l 01 (w, P0(y)); the left endpoint l of line l1 10 (0, P0(y)+s0), right endpoint l 11 (w, P0(y)+s0); Line l n The left endpoint l n0 (0, Pn(y)+n*s0), right endpoint l n1 (w, P) n (y)+n*s0)(where P n Let (y) + n*s0 be less than H), and denote the set of all lines L = {l0, ..., l0}. n}
[0099] Compare each line in set P with each line in set L to obtain the relationship between the centroid of the contour and the line, and sort them until all points in set P are sorted. Compare the points in set C with the y-coordinates of line l0 in set L. If a point is above or on line l0, it is a target point to be sorted. If a point is below line l0, it is not a target point to be sorted. When points need to be sorted, if there is only one point, it is directly recorded as N0; if there are n points, the x-coordinates are sorted a second time, and finally recorded as N0, ..., N. nIf the points are already sorted, the next round of sorting is not performed until all points in set P are sorted. The sorted set is denoted as N = {N0, ..., N...} n}.by Figure 8 Let's take an example to illustrate, assuming Figure 8 The white solid line corresponds to l0 in set L. Figure 8 Three of the contours have centroids above l0. These are included in the numbering sequence. Since there are multiple points, the points included in the numbering sequence need to be sorted in ascending order on the x-axis. Finally, the white contours are numbered, and so on, until all the white contours in the diagram are sorted and numbered. The result after all contours are sorted and numbered is shown below. Figure 8 As shown.
[0100] By performing operations on each element in set I, the four vertices of the bounding rectangle of each white outline of the photovoltaic power station mask can be obtained. The four vertices of the bounding rectangles of all white outlines are denoted as r0 = {(x0, y0), (x1, y1), (x2, y2), (x3, y3)}, ..., r n If the set is {(x0, y0), (x1, y1), (x2, y2), (x3, y3)}, then the four vertices of the bounding rectangles of all white outlines can form a set R = {r0, ..., r...}. n Since there is a corresponding relationship between the photovoltaic equipment mask in the panoramic image and the photovoltaic equipment in the panoramic image of the photovoltaic power station, and by combining the set N of the centroids of the sorted contours, the set R can be sorted. Finally, the photovoltaic equipment on the panoramic image of the photovoltaic power station can be automatically labeled and numbered using set R. The effect is as follows. Figure 9 As shown.
[0101] Photovoltaic power plant construction will have corresponding layout diagrams, such as layout diagrams in CAD, JPG, PDF and other formats. The string of letters and numbers above the photovoltaic equipment is the layout diagram number (i.e. photovoltaic string number) corresponding to the photovoltaic equipment.
[0102] The photovoltaic string numbers are extracted from the CAD drawings of the layout plan using professional processing software (such as AutoCAD, ZWCAD, etc.), and finally processed into a panoramic view of the photovoltaic power station and the distribution shape of the photovoltaic equipment. AutoCAD is an automated computer-aided design software used for 2D drawing, detailed drawing, design documentation, and basic 3D design.
[0103] The layout image numbers are extracted as a whole using an image thresholding segmentation algorithm, generating corresponding layout image mask images. Similar operations are then performed on these layout image mask images. The bounding rectangles and centroids of these mask images are extracted. Let M = {m0, ..., m} be the set of bounding rectangles for each layout image number. n}, where m0={(x0,y0),(x1,y1),(x2,y2),(x3,y3)},...,m n = {(x0,y0), (x1,y1), (x2,y2), (x3,y3)}, where each set contains the four vertices of the bounding rectangle of the layout diagram number. The layout diagram numbers are sorted and labeled according to the bounding rectangle set M, resulting in the following... Figure 10 The image shown.
[0104] Since there is a one-to-one mapping between the layout map numbers and the photovoltaic equipment in the panoramic view of the photovoltaic power station, the layout map numbers of the photovoltaic power station can be mapped to the photovoltaic equipment in the panoramic view. The coordinates in set R can be used to extract... Figure 10 The image for each layout map number is extracted and then, based on the coordinates of set M, merged into the specified location of the photovoltaic device corresponding to the panoramic image, as shown in the image. Figure 11 As shown in the image, the image numbers and layout diagram numbers of the photovoltaic devices are labeled in the panoramic view.
[0105] See Figure 12 , Figure 12 This is a schematic diagram of an embodiment of the electronic device provided in this application. The electronic device 60 includes a processor 61 and a memory 62 coupled to the processor 61. The memory 62 stores a computer program, and the processor 61 executes the computer program to implement the following method:
[0106] Obtain a panoramic view and layout diagram of the photovoltaic power station; identify image areas for several photovoltaic devices from the panoramic view; number all image areas to obtain the image number corresponding to each photovoltaic device; and determine the layout diagram number for each photovoltaic device from the layout diagram; and label the corresponding photovoltaic devices in the panoramic view using the image number and layout diagram number.
[0107] It is understood that the processor 61 is also used to execute computer programs to implement the methods of any of the above embodiments. For details, please refer to any of the above technical solutions, which will not be repeated here.
[0108] See Figure 13 , Figure 13 This is a schematic diagram of an embodiment of the computer-readable storage medium provided in this application. The computer-readable storage medium 70 stores a computer program 71, which, when executed by a processor, implements the following method:
[0109] Obtain a panoramic view and layout diagram of the photovoltaic power station; identify image areas for several photovoltaic devices from the panoramic view; number all image areas to obtain the image number corresponding to each photovoltaic device; and determine the layout diagram number for each photovoltaic device from the layout diagram; and label the corresponding photovoltaic devices in the panoramic view using the image number and layout diagram number.
[0110] It is understood that when the computer program 71 is executed by the processor, it is also used to implement the method of any of the above embodiments. For details, please refer to any of the above technical solutions, which will not be repeated here.
[0111] In the several embodiments provided in this application, it should be understood that the disclosed methods and devices can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed.
[0112] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment, depending on actual needs.
[0113] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0114] The above description is merely an embodiment of this application and does not limit the patent scope of this application. Any equivalent structural or procedural changes made based on the description and drawings of this application, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.
Claims
1. A labeling method for photovoltaic equipment, characterized in that, The method includes: Obtain panoramic and layout diagrams of the photovoltaic power station; Image regions of several photovoltaic devices are determined from the panoramic image; Obtain the centroid of each image region to obtain the corresponding centroid set; Sort the centroids in the centroid set to obtain the number of each centroid; The number of each centroid is used as the image number corresponding to each photovoltaic device; The layout diagram is segmented to extract several layout diagram numbered images corresponding to photovoltaic devices; The layout diagram numbered images are sorted to obtain the initial numbers of the layout diagram numbered images; wherein, the sorting method of the layout diagram numbered images is the same as the sorting method of the image regions; Based on the same image number and the same initial number, establish the association between the image number and the layout diagram numbered image; The corresponding photovoltaic devices in the panoramic image are labeled using the image number and the layout map number image with the same association.
2. The method according to claim 1, characterized in that, The step of determining the image regions of several photovoltaic devices from the panoramic image includes: The panoramic image is segmented to extract image regions for several photovoltaic devices.
3. The method according to claim 1, characterized in that, The process of sorting the centroids in the centroid set to obtain the number of each centroid includes: Sort the centroids in the centroid set according to their ordinates to obtain the sorted centroid set. The centroids in the sorted centroid set are sorted using the reference coordinates to obtain the number of each centroid.
4. The method according to claim 3, characterized in that, The process of sorting the centroids in the sorted centroid set using reference coordinates to obtain the number of each centroid includes: From the set of centroids, identify several centroids whose ordinates are less than the reference coordinates in the centroid coordinate system. Sort several centroids according to their x-coordinates; Adjust the ordinate of the reference coordinates and re-sort the remaining unsorted centroids until all centroids are sorted.
5. The method according to claim 1, characterized in that, The acquisition of the panoramic view of the photovoltaic power station includes: Acquire multiple images of the photovoltaic power station; The panoramic image is obtained by stitching together multiple captured images.
6. An electronic device, characterized in that, The electronic device includes a processor and a memory coupled to the processor, the memory storing a computer program, and the processor executing the computer program to implement the method as described in any one of claims 1-5.
7. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the method as described in any one of claims 1-5.
Citation Information
Patent Citations
Inspection target positioning method and device for photovoltaic scene and readable storage medium
CN111062991A