Distributed fishing light complementary photovoltaic module monitoring method and system based on remote sensing image

Through the deep learning method based on remote sensing images, the target area of ​​the photovoltaic module is extracted and segmented, and the accuracy and dynamicity of the monitoring of the dispersed fishing complementary photovoltaic module is solved, and high-precision monitoring and real-time output of photovoltaic module change information is achieved. .

CN119006766AActive Publication Date: 2024-11-22HUANENG JIANGYIN GAS TURBINE THERMAL POWER CO LTD

Patent Information

Application Number
CN202411093490.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-09
Publication Date
2024-11-22
Estimated Expiration
2044-08-09

AI Technical Summary

Technical Problem

The prior art cannot effectively monitor and dynamically calculate the change information of the dispersed fishing complementary photovoltaic module, especially when the water surface is affected by the water surface and photovoltaic panels, which leads to increased monitoring difficulty and cannot meet the requirements of high accuracy and dynamic monitoring.

Method used

Using a remote sensing image-based method, hyperspectral images are collected through satellite images, and the initial target area of ​​the photovoltaic module is extracted using deep learning object detection and segmentation algorithms, and fine area segmentation is performed through overlapping adhesion area determination and decision-making strategies, combining the photovoltaic module's Quadrilateral shape prior knowledge, correct the detection results, and finally obtain photovoltaic module change information through hyperspectral image inversion.

Benefits of technology

It realizes high-precision real-time monitoring of dispersed fishing complementary photovoltaic modules, can accurately extract the change information of photovoltaic modules, meet the needs of dynamic monitoring, and improves the accuracy of monitoring and visual display capabilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119006766A_ABST
    Figure CN119006766A_ABST
Patent Text Reader

Abstract

The invention provides a distributed fishing-light complementary photovoltaic module monitoring method based on a remote sensing image, and belongs to the technical field of image recognition and intelligent monitoring, and the method comprises the steps: obtaining a hyperspectral image, and extracting a preliminary target region of a photovoltaic module based on a deep learning target detection and segmentation algorithm; for the situation that adhesion and overlapping possibly occur at water surface extension and exposed land in a photovoltaic module boundary extraction result, an overlapped adhesion region is judged, and fine region segmentation is performed through a strategy of fusing decision rules according to a plot preliminary target region position result, so that a photovoltaic module boundary extraction result is obtained. And finally, the change information of the photovoltaic module is obtained according to remote sensing image inversion, and high-precision real-time monitoring of the distributed fishing-light complementary photovoltaic module is realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of image recognition and intelligent monitoring, and in particular to a remote sensing image-based decentralized fish-light complementary photovoltaic assembly monitoring method and system. Background Art

[0002] The objects of photovoltaic monitoring for new energy power generation include photovoltaic arrays and distributed photovoltaics. Photovoltaic arrays, also known as photovoltaic arrays, are DC power generation units composed of several photovoltaic modules mechanically and electrically assembled in a certain way and with a fixed support structure. They are mainly built in Gobi, grassland, cultivated land, water surface and other locations. Distributed photovoltaic power stations usually refer to power generation systems that use distributed resources, have a small installed capacity and are arranged near users. With the continuous changes in installed capacity, how to dynamically calculate the change information of all distributed fish-light complementary photovoltaic modules within the monitoring range has become an urgent problem to be solved.

[0003] In the prior art, CN113298303A discloses a photovoltaic power prediction method for the dynamic attention domain of meteorological satellite cloud images, and a photovoltaic power station connected to real-time satellite remote sensing to meet the needs of power station monitoring and operation and real-time scheduling of photovoltaic grid-connected systems. CN117685929A discloses a method and terminal device for monitoring the spatial distribution information of photovoltaic panels. According to the location information, the high spatial resolution remote sensing image corresponding to the photovoltaic panel is determined for inspection and confirmation, and the user is instructed to perform a fine interpretation of the photovoltaic panel boundary to extract accurate spatial distribution location information. However, with the construction of fish-light complementarity, remote sensing image monitoring on the water surface will be affected by the water surface and photovoltaic panels on the one hand, and on the other hand, due to the decentralized characteristics of fish-light complementarity photovoltaic components, statistics and monitoring are more difficult. No targeted monitoring method has been proposed in the prior art for decentralized fish-light complementarity photovoltaic components, and the existing methods cannot meet the requirements of high accuracy and dynamic monitoring. Summary of the invention

[0004] The purpose of the present invention is to solve the above-mentioned problems existing in the prior art. In the first aspect, a method for monitoring a distributed fishery-photovoltaic hybrid photovoltaic assembly based on remote sensing images is provided. The method specifically includes the following technical contents:

[0005] Acquire the remote sensing image to be analyzed, specifically acquire the high-resolution hyperspectral image of the distributed fish-light complementary photovoltaic component target from the satellite through the satellite image acquisition unit; the hyperspectral image includes spectral features and texture features.

[0006] A deep learning-based target detection and segmentation algorithm is applied to the hyperspectral images to extract the preliminary target area of ​​the photovoltaic modules;

[0007] Furthermore, in order to measure the difference between the predicted result and the true label, the present invention defines the loss function in the target detection and segmentation algorithm as follows:

[0008] loss=-(y·log(y′)+(1-y)·log(1-y′));

[0009] Where y is the true label. If the sample is a positive sample, the value is 1, otherwise it is 0; y′ is the probability that the predicted sample is a positive example.

[0010] Furthermore, the extracted preliminary target area of ​​the photovoltaic module is finely segmented, including

[0011] In order to solve the overlapping connection problem in the boundary extraction results of photovoltaic modules, such as adhesion and overlap with the water surface and exposed land, fine regional segmentation is performed through the strategy of integrating decision rules based on the preliminary target area location results.

[0012] Fine region segmentation specifically includes:

[0013] Overlapping and sticking area determination, determine whether the preliminary target area results of the photovoltaic module have overlapping and sticking areas. Specifically: calculate the area of ​​the connected sub-area court(i) and the area of ​​the preliminary target area court_s in each preliminary target area, and make the following judgment based on the percentage A_per of the two. The calculation formula is as follows:

[0014] A_per(i)=court(i) / court_s

[0015] Where court(i) is represented by the number of pixels in the connected sub-region, and court_s is represented by the number of pixels in the preliminary target region, from which the percentage of each connected sub-region in the preliminary target region can be calculated. If there are multiple connected sub-regions and the sub-region area is greater than 30%, it is judged that the preliminary target region of the photovoltaic module may have overlapping adhesion areas.

[0016] For situations where there may be overlapping adhesion areas, the following decision steps are performed:

[0017] (1) If one of the connected sub-regions is dominant, such as if the sub-region occupies more than 80% of the area of ​​the preliminary target region, this indicates that there may be mixed pixels or noise spots in the preliminary detection results, resulting in a small deviation in the detection results. In this case, the connected sub-regions are merged and the non-quadrilateral target regions are removed based on the prior knowledge of the quadrilateral shape of the photovoltaic module through shape constraints, and the target region is output as the photovoltaic module extraction result;

[0018] ② If there are two or more connected sub-regions that dominate, first use the dominant region as the inner boundary to perform mean filling on the connected sub-region, and retain the initial target region boundary as the outer boundary;

[0019] For each filled connected subregion, generate candidate points by randomly sampling N points (N>20) from a uniform distribution;

[0020] Select β (β∈[1,N]) most uncertain points from N candidate points. Determine the probability of each pixel belonging to the photovoltaic module classification. The above probability refers to the rough predicted probability of the true value. Count the number of β points with probability values ​​greater than 0.5, expand and merge the connected sub-regions whose ratio to the number of the most uncertain points is greater than a certain threshold, until all connected sub-regions are expanded and merged, and then remove the expanded and merged regions based on the prior knowledge of the quadrilateral shape of the photovoltaic module;

[0021] The above decision step (2) is iterated until all possible overlapping adhesion areas have been decided, and finally the finely segmented PV module target area is output.

[0022] Determine the change information of photovoltaic modules according to the target area of ​​photovoltaic modules after fine segmentation, and obtain the changed area information of photovoltaic panels through hyperspectral image inversion, including new area or reduced area, by comparing the monitoring results of the current monitoring time point with the monitoring results of the previous monitoring time point;

[0023] Calculate the change information of all distributed photovoltaic modules for fishery-photovoltaic hybrids within the monitoring range, and output the module change information as the monitoring information of photovoltaic modules for fishery-photovoltaic hybrids in the area;

[0024] Optionally, the output monitoring information is displayed through a terminal display interface, preferably visually displayed on a photovoltaic power generation monitoring interface through a web page.

[0025] A distributed fish-light complementary photovoltaic assembly monitoring system based on remote sensing images is further provided, comprising:

[0026] The image acquisition module acquires the remote sensing image to be analyzed, and specifically acquires a high-resolution hyperspectral image of the target of the distributed fish-light complementary photovoltaic assembly from the satellite through a satellite image acquisition unit; the hyperspectral image includes spectral features and texture features.

[0027] A preliminary target area segmentation module performs a deep learning-based target detection and segmentation algorithm on the hyperspectral image to extract the preliminary target area of ​​the photovoltaic module;

[0028] Furthermore, in order to measure the difference between the predicted result and the true label, the present invention defines the loss function in the target detection and segmentation algorithm as follows:

[0029] loss=-(y·log(y′)+(1-y)·log(1-y′));

[0030] Where y is the true label. If the sample is a positive sample, the value is 1, otherwise it is 0; y′ is the probability that the predicted sample is a positive example.

[0031] The fine area segmentation module performs fine area segmentation on the initial target area of ​​the extracted photovoltaic module, which specifically includes:

[0032] In order to solve the overlapping connection problem in the boundary extraction results of photovoltaic modules, such as adhesion and overlap with the water surface and exposed land, fine regional segmentation is performed through the strategy of integrating decision rules based on the preliminary target area location results.

[0033] Fine region segmentation specifically includes:

[0034] Overlapping and sticking area determination, determine whether the preliminary target area results of the photovoltaic module have overlapping and sticking areas. Specifically: calculate the area of ​​the connected sub-area court(i) and the area of ​​the preliminary target area court_s in each preliminary target area, and make the following judgment based on the percentage A_per of the two. The calculation formula is as follows:

[0035] A_per(i)=court(i) / court_s

[0036] Where court(i) is represented by the number of pixels in the connected sub-region, and court_s is represented by the number of pixels in the preliminary target region, from which the percentage of each connected sub-region in the preliminary target region can be calculated. If there are multiple connected sub-regions and the sub-region area is greater than 30%, it is judged that the preliminary target region of the photovoltaic module may have overlapping adhesion areas.

[0037] For situations where there may be overlapping adhesion areas, the following decision steps are performed:

[0038] (1) If one of the connected sub-regions is dominant, such as if the sub-region occupies more than 80% of the area of ​​the preliminary target region, this indicates that there may be mixed pixels or noise spots in the preliminary detection results, resulting in a small deviation in the detection results. In this case, the connected sub-regions are merged and the non-quadrilateral target regions are removed based on the prior knowledge of the quadrilateral shape of the photovoltaic module through shape constraints, and the target region is output as the photovoltaic module extraction result;

[0039] ② If there are two or more connected sub-regions that dominate, first use the dominant region as the inner boundary to perform mean filling on the connected sub-region, and retain the initial target region boundary as the outer boundary;

[0040] For each filled connected subregion, generate candidate points by randomly sampling N points (N>20) from a uniform distribution;

[0041] Select β (β∈[1,N]) most uncertain points from N candidate points. Determine the probability of each pixel belonging to the photovoltaic module classification. The above probability refers to the rough predicted probability of the true value. Count the number of β points with probability values ​​greater than 0.5, expand and merge the connected sub-regions whose ratio to the number of the most uncertain points is greater than a certain threshold, until all connected sub-regions are expanded and merged, and then remove the expanded and merged regions based on the prior knowledge of the quadrilateral shape of the photovoltaic module;

[0042] The above decision step (2) is iterated until all possible overlapping adhesion areas have been decided, and finally the finely segmented PV module target area is output.

[0043] The calculation module for the change information of the photovoltaic components of the fishery-photovoltaic complementary system determines the change information of the photovoltaic components according to the target area of ​​the photovoltaic components after fine segmentation. Specifically, it compares the monitoring results of the current monitoring time point with the monitoring results of the previous monitoring time point, and obtains the changed photovoltaic panel area information through the inversion of the hyperspectral image, including the newly built area or the reduced area.

[0044] Calculate the change information of all distributed photovoltaic modules for fishery-photovoltaic hybrids within the monitoring range, and output the module change information as the monitoring information of photovoltaic modules for fishery-photovoltaic hybrids in the area;

[0045] Optionally, it further includes an output display module, which displays the output monitoring information through a terminal display interface, preferably visually displays it on a photovoltaic power generation monitoring interface through a web page.

[0046] Compared with the prior art, the beneficial effects of the present invention are: providing a new decentralized fish-photovoltaic complementary photovoltaic module monitoring method based on remote sensing images, extracting the preliminary target area of ​​the photovoltaic module based on the acquired hyperspectral image and the target detection and segmentation algorithm of deep learning, and the photovoltaic module boundary extraction results may have adhesion and overlap with the water surface and exposed land, by determining the overlapping adhesion area, and according to the preliminary target area position results of the plot, fine area segmentation is performed through the strategy of fusion decision rules, and finally the change information of the photovoltaic module is obtained according to the inversion of the remote sensing image, so as to realize high-precision real-time monitoring of decentralized fish-photovoltaic complementary photovoltaic modules. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 This is a flow chart of the decentralized fishery-photovoltaic component monitoring method based on remote sensing images in this application;

[0048] Figure 2 This is the architecture diagram of the target detection and segmentation algorithm based on deep learning for this application;

[0049] Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0050] The present invention is further described in detail below in conjunction with the accompanying drawings:

[0051] Example 1, see attached Figure 1 , provides a distributed fishery-photovoltaic component monitoring method based on remote sensing images, which specifically includes the following technical contents:

[0052] Acquire the remote sensing image to be analyzed, specifically acquire the high-resolution hyperspectral image of the distributed fish-light complementary photovoltaic component target from the satellite through the satellite image acquisition unit; the hyperspectral image includes spectral features and texture features.

[0053] A deep learning-based target detection and segmentation algorithm is applied to the hyperspectral images to extract the preliminary target area of ​​the photovoltaic modules;

[0054] Furthermore, the extracted preliminary target area of ​​the photovoltaic module is finely segmented, including

[0055] In order to solve the overlapping connection problem in the boundary extraction results of photovoltaic modules, such as adhesion and overlap with the water surface and exposed land, fine regional segmentation is performed through the strategy of integrating decision rules based on the preliminary target area location results.

[0056] Fine region segmentation specifically includes:

[0057] Overlapping and sticking area determination, determine whether the preliminary target area results of the photovoltaic module have overlapping and sticking areas. Specifically: calculate the area of ​​the connected sub-area court(i) and the area of ​​the preliminary target area court_s in each preliminary target area, and make the following judgment based on the percentage A_per of the two. The calculation formula is as follows:

[0058] A_per(i)=court(i) / court_s

[0059] Where court(i) is represented by the number of pixels in the connected sub-region, and court_s is represented by the number of pixels in the preliminary target region, from which the percentage of each connected sub-region in the preliminary target region can be calculated. If there are multiple connected sub-regions and the sub-region area is greater than 30%, it is judged that the preliminary target region of the photovoltaic module may have overlapping adhesion areas.

[0060] For situations where there may be overlapping adhesion areas, the following decision steps are performed:

[0061] (1) If one of the connected sub-regions is dominant, such as if the sub-region occupies more than 80% of the area of ​​the preliminary target region, this indicates that there may be mixed pixels or noise spots in the preliminary detection results, resulting in a small deviation in the detection results. In this case, the connected sub-regions are merged and the non-quadrilateral target regions are removed based on the prior knowledge of the quadrilateral shape of the photovoltaic module through shape constraints, and the target region is output as the photovoltaic module extraction result;

[0062] ② If there are two or more connected sub-regions that dominate, first use the dominant region as the inner boundary to perform mean filling on the connected sub-region, and retain the initial target region boundary as the outer boundary;

[0063] For each filled connected subregion, generate candidate points by randomly sampling N points (N>20) from a uniform distribution;

[0064] Select β (β∈[1,N]) most uncertain points from N candidate points. Determine the probability of each pixel belonging to the photovoltaic module classification. The above probability refers to the rough predicted probability of the true value. Count the number of β points with probability values ​​greater than 0.5, expand and merge the connected sub-regions whose ratio to the number of the most uncertain points is greater than a certain threshold, until all connected sub-regions are expanded and merged, and then remove the expanded and merged regions based on the prior knowledge of the quadrilateral shape of the photovoltaic module;

[0065] The above decision step (2) is iterated until all possible overlapping adhesion areas have been decided, and finally the finely segmented PV module target area is output.

[0066] Determine the change information of photovoltaic modules according to the target area of ​​photovoltaic modules after fine segmentation, and obtain the changed area information of photovoltaic panels through hyperspectral image inversion, including new area or reduced area, by comparing the monitoring results of the current monitoring time point with the monitoring results of the previous monitoring time point;

[0067] Calculate the change information of all distributed photovoltaic modules for fishery-photovoltaic hybrids within the monitoring range, and output the module change information as the monitoring information of photovoltaic modules for fishery-photovoltaic hybrids in the area;

[0068] Optionally, the output monitoring information is displayed through a terminal display interface, preferably visually displayed on a photovoltaic power generation monitoring interface through a web page.

[0069] Furthermore, in Example 2, a target detection and segmentation algorithm based on deep learning in the present invention is disclosed in detail. Based on this algorithm, a preliminary target area of ​​a photovoltaic module is extracted, which specifically includes the following technical contents:

[0070] The remote sensing image to be analyzed is used as the input image. The encoder extracts the input image features through a deep convolutional neural network and obtains multiple effective feature layers. One of the effective feature layers is subjected to dilated convolution with different dilation rates to extract features. After passing through a 1×1 convolution and image pooling layer, the features are stacked and merged. The merged results are then compressed through a 1×1 convolution. The decoder input consists of two parts, one is the output of the deep convolutional neural network, and the other is the result of the parallel dilated convolution of the above deep convolutional neural network output. These two results are connected to the encoder output results for feature fusion, and then gradually restored to the same resolution as the original image through 3×3 convolution and upsampling to capture finer target boundaries of photovoltaic modules. The predicted segmentation result map is output to obtain the preliminary target area of ​​the photovoltaic module.

[0071] The decoder part adopts a structure composed of several upsampling modules and feature map fusion modules, which is used to restore the low-resolution semantic feature map output by the encoder to the high-resolution semantic segmentation result of the original input image size. The function of the upsampling module is to upsample the input low-resolution feature map and restore it to a high-resolution feature map. The function of the feature map fusion module is to fuse the feature maps of different scales in the encoder, and use the complementary information between the feature maps of different scales to improve the accuracy of the segmentation result. The feature map fusion module adopts a pooling pyramid module, which can extract features with different receptive fields from feature maps of different scales, and then splice these features and fuse them through a convolution layer.

[0072] Furthermore, in order to measure the difference between the predicted result and the true label, the present invention defines the loss function in the target detection and segmentation algorithm as follows:

[0073] loss=-(y·log(y′)+(1-y)·log(1-y′));

[0074] Where y is the true label. If the sample is a positive sample, the value is 1, otherwise it is 0; y′ is the probability that the predicted sample is a positive example.

[0075] The sample collection and positive and negative sample pre-processing in the present invention are commonly used technical means in the art. Training of target detection and segmentation models based on training samples is also well known in the art and will not be elaborated here.

[0076] In this embodiment, see the attached Figure 3 The electronic device shown further includes a bus 103 and a communication interface 104 , and the processor 101 , the communication interface 104 and the memory 102 are connected via the bus 103 .

[0077] The memory 102 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as at least one disk storage. The bus 103 may be an ISA bus, a PCI bus, or an EISA bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0078] The communication interface 104 is used to connect to at least one user terminal and other network units through a network interface, and send the encapsulated IPv4 message or IPv4 message to the user terminal through the network interface.

[0079] The processor 101 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 101. The above processor 101 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The disclosed methods, steps and logic block diagrams in the embodiments of the present disclosure can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present disclosure can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution. The software module may be located in a storage medium mature in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 102, and the processor 101 reads the information in the memory 102 and completes the steps of the method of the above embodiment in combination with its hardware.

[0080] An embodiment of the present invention further provides a storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the decentralized fish-light complementary photovoltaic assembly monitoring method based on remote sensing images in the aforementioned embodiment are executed.

[0081] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0082] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0083] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0084] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present invention can essentially or in other words, the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0085] Finally, it should be noted that the above-described embodiments are only specific implementations of the present invention, which are used to illustrate the technical solutions of the present invention, rather than to limit them. The protection scope of the present invention is not limited thereto. Although the present invention is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed by the present invention, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

[0086] The above are only embodiments of the present application and are not intended to limit the scope of protection of the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application. It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in the subsequent drawings.

[0087] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0088] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0089] In the description of the present invention, unless otherwise specified, the terms "upper", "lower", "left", "right", "inside", "outside", etc. indicate directions or positional relationships based on the directions or positional relationships shown in the accompanying drawings. They are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific direction, be constructed and operated in a specific direction. Therefore, they cannot be understood as limitations on the present invention.

[0090] Finally, it should be explained that the above technical solution is only one implementation method of the present invention. For those skilled in the art, it is easy to make various types of improvements or modifications based on the application methods and principles disclosed in the present invention, and it is not limited to the method described in the above specific implementation method of the present invention. Therefore, the method described above is only preferred and does not have a restrictive meaning.

Claims

1. A distributed fishery-photovoltaic hybrid module monitoring method based on remote sensing images, characterized in that Include: Acquire the remote sensing image to be analyzed, specifically acquire the high-resolution hyperspectral image of the distributed fishery-photovoltaic complementary photovoltaic assembly target from the satellite through the satellite image acquisition unit; A deep learning-based target detection and segmentation algorithm is applied to the hyperspectral images to extract the preliminary target area of ​​the photovoltaic modules; Furthermore, the extracted preliminary target area of ​​the photovoltaic module is finely segmented, which specifically includes: In view of the overlapping connection problem in the boundary extraction results of photovoltaic modules, fine area segmentation is performed through the strategy of integrating decision rules according to the preliminary target area location results; fine area segmentation specifically includes: Overlapping and sticking area determination, determining whether the preliminary target area results of the photovoltaic module have overlapping and sticking areas; For situations where there may be overlapping adhesion areas, the following decision steps are performed: (1) If one of the connected sub-regions is dominant, such as if the sub-region occupies more than 80% of the area of ​​the preliminary target region, the connected sub-regions are merged and the output target region is used as the PV module extraction result through shape constraints; ② If there are two or more connected sub-regions that dominate, first use the dominant region as the inner boundary to perform mean filling on the connected sub-region, and retain the initial target region boundary as the outer boundary; For each filled connected subregion, generate candidate points by randomly sampling N points from a uniform distribution; Select β most uncertain points from N candidate points, where β∈[1,N], and judge the probability of each pixel belonging to the PV module classification. The above probability refers to the rough predicted probability of the true value. Count the number of β points with probability values ​​greater than 0.5, expand and merge the connected sub-regions whose ratio to the number of the most uncertain points is greater than a certain threshold, until all connected sub-regions are expanded and merged, and then remove the expanded and merged regions based on the prior knowledge of the quadrilateral shape of the PV module; Iterate the above decision step (2) until all possible overlapping adhesion areas have completed the decision, and finally output the finely segmented photovoltaic module target area; The photovoltaic module change information is determined according to the photovoltaic module target area after fine segmentation; the change information of all decentralized fishery-photovoltaic complementary photovoltaic modules within the monitoring range is calculated, and the module change information is output as the monitoring information of the fishery-photovoltaic complementary photovoltaic modules in the area.

2. The method according to claim 1, characterized in that: The loss function in the target detection and segmentation algorithm is defined as follows: loss=-(y·log(y′)+(1-y)·log(1-y′)); Where y is the true label. If the sample is a positive sample, the value is 1, otherwise it is 0; y′ is the probability that the predicted sample is a positive example.

3. The method according to claim 2, characterized in that: Specifically: Calculate the area of ​​the connected sub-region court(i) and the area of ​​the preliminary target region court_s in each preliminary target region, and make the following judgments based on the percentage A_per of the two. The calculation formula is as follows: A_per(i)=court(i) / court_s Where court(i) is represented by the number of pixels in the connected sub-region, and court_s is represented by the number of pixels in the preliminary target area. From this, the percentage of each connected sub-region in the preliminary target area can be calculated. If there are multiple connected sub-regions and the sub-region area is greater than 30%, it is judged that the preliminary target area of ​​the photovoltaic module may have overlapping adhesion areas.

4. The method according to claim 3, characterized in that: Specifically, based on the comparison of the monitoring results at the current monitoring point and the previous monitoring point, the information on the changed photovoltaic panel area, including newly built area or reduced area, is obtained through hyperspectral image inversion.

5. The method according to claim 1, characterized in that Also includes: The output monitoring information is displayed through the terminal display interface and visualized on the photovoltaic power generation monitoring interface through the web page.

6. The method according to claim 5, characterized in that: The initial target area of ​​PV panels extracted by deep learning-based target detection and segmentation algorithms includes the following technical contents: The remote sensing image to be analyzed is used as the input image. The encoder extracts the input image features through a deep convolutional neural network and obtains multiple effective feature layers. One of the effective feature layers is extracted through dilated convolutions with different dilation rates. After passing through 1×1 convolution and image pooling layers, the features are stacked and merged. The merged results are then compressed through 1×1 convolution. The decoder input consists of two parts, one is the output of the deep convolutional neural network, and the other is the result of the above deep convolutional neural network output after parallel hole convolution. These two results are connected to the above encoder output results for feature fusion, and then gradually restored to the same resolution as the original image through 3×3 convolution and upsampling to capture finer target boundaries of photovoltaic modules, output the predicted segmentation result map, and obtain the preliminary target area of ​​​​the photovoltaic module; The decoder part adopts a structure composed of several upsampling modules and feature map fusion modules, which is used to restore the low-resolution semantic feature map output by the encoder to a high-resolution semantic segmentation result of the original input image size; the upsampling module is used to upsample the input low-resolution feature map and restore it to a high-resolution feature map; the feature map fusion module is used to fuse feature maps of different scales in the encoder, and use the complementary information between feature maps of different scales to improve the accuracy of the segmentation result; the feature map fusion module adopts a pooling pyramid module, which can extract features with different receptive fields from feature maps of different scales, and then splice these features and fuse them through a convolutional layer.

7. The method according to claim 6, characterized in that: The change information of photovoltaic modules is determined based on the target area of ​​photovoltaic modules after fine segmentation. Specifically, the monitoring results of the current monitoring point are compared with the previous monitoring point, and the changed area information of photovoltaic panels, including new area or reduced area, is obtained through hyperspectral image inversion.

8. A distributed fishery-photovoltaic hybrid module monitoring system based on remote sensing images, characterized in that Include: An image acquisition module acquires the remote sensing image to be analyzed, and acquires a high-resolution hyperspectral image of the distributed fish-light complementary photovoltaic assembly target from a satellite through a satellite image acquisition unit; A preliminary target area segmentation module performs a deep learning-based target detection and segmentation algorithm on the hyperspectral image to extract the preliminary target area of ​​the photovoltaic module; The fine area segmentation module further performs fine area segmentation on the initial target area of ​​the extracted photovoltaic module, specifically including: In view of the overlapping connection problem in the boundary extraction results of photovoltaic modules, fine area segmentation is performed through the strategy of integrating decision rules according to the preliminary target area location results; fine area segmentation specifically includes: Overlapping and sticking area determination, determining whether the preliminary target area results of the photovoltaic module have overlapping and sticking areas; For situations where there may be overlapping adhesion areas, the following decision steps are performed: (1) If one of the connected sub-regions is dominant, such as if the sub-region occupies more than 80% of the area of ​​the preliminary target region, the connected sub-regions are merged and the output target region is used as the PV module extraction result through shape constraints; ② If there are two or more connected sub-regions that dominate, first use the dominant region as the inner boundary to perform mean filling on the connected sub-region, and retain the initial target region boundary as the outer boundary; For each filled connected subregion, generate candidate points by randomly sampling N points from a uniform distribution; Select β most uncertain points from N candidate points, where β∈[1,N], and judge the probability of each pixel belonging to the PV module classification. The above probability refers to the rough predicted probability of the true value. Count the number of β points with probability values ​​greater than 0.5, expand and merge the connected sub-regions whose ratio to the number of the most uncertain points is greater than a certain threshold, until all connected sub-regions are expanded and merged, and then remove the expanded and merged regions based on the prior knowledge of the quadrilateral shape of the PV module; Iterate the above decision step (2) until all possible overlapping adhesion areas have completed the decision, and finally output the finely segmented photovoltaic module target area; The fishery-photovoltaic complementary photovoltaic component change information calculation module determines the photovoltaic component change information based on the finely segmented photovoltaic component target area; calculates the change information of all decentralized fishery-photovoltaic complementary photovoltaic components within the monitoring range, and outputs the component change information as the fishery-photovoltaic complementary photovoltaic component monitoring information in the area.

9. An electronic device, characterized in that: The invention comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor can implement the method described in any one of claims 1 to 7 when executing the program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the program, when executed by a processor, can implement the method described in any one of claims 1 to 7.

Citation Information

Patent Citations

  • Map area merging method and device, electronic equipment and storage medium

    CN114581477A

  • Tongue picture image segmentation method in natural light environment

    CN115601358A

  • Metallographic microscopic image analysis method and device for eliminating precipitated phase interference

    CN116630248A

  • Vehicle driving image enhancement processing method in black light environment and auxiliary driving system

    CN118379203A

  • Nodule boundary detection

    US20050259855A1

Cited By

  • Fishing-light complementary photovoltaic module monitoring system based on power generation analysis

    CN119906006A

  • Road occupation construction identification method and device based on deep learning, electronic equipment and program product

    CN120318766A