Photovoltaic power station operation and maintenance method and system based on multi-modal data fusion, and medium

Through multimodal data fusion processing, text, images, audio and video data of photovoltaic power stations are collected and processed, and the problems of single detection methods and cumbersome data processing in photovoltaic power station operation and maintenance are solved, and the rapid and comprehensive photovoltaic power station components are achieved. , accurate operation and maintenance.

CN118965278AActive Publication Date: 2024-11-15CHANGDIAN NEW ENERGY CO LTD +1
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411427580.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-14
Publication Date
2024-11-15
Estimated Expiration
2044-10-14

AI Technical Summary

Technical Problem

The existing photovoltaic power station operation and maintenance methods have a single detection method, which is difficult to fully reflect the actual operation of photovoltaic modules, convergence modules and inverter modules. The differences in communication protocols and data formats of different devices lead to cumbersome data processing.

Method used

Using a multimodal data fusion method, the detection components collect text, image, audio and video data, and perform format conversion and fusion processing to achieve comprehensive and accurate operation and maintenance of photovoltaic components, convergence components and inverter components in photovoltaic power stations. .

Benefits of technology

Through multimodal data fusion, the rapid, comprehensive and accurate operation and maintenance of photovoltaic power station components can be achieved, avoiding the complicated processing of data between different formats, and improving the accuracy and efficiency of operation and maintenance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118965278A_ABST
    Figure CN118965278A_ABST
Patent Text Reader

Abstract

The invention discloses a photovoltaic power station operation and maintenance method and system based on multi-modal data fusion and a medium, a photovoltaic power station comprises a photovoltaic assembly, a confluence assembly, an inversion assembly and a detection assembly, and the method comprises the following steps: obtaining multi-modal data corresponding to the photovoltaic power station and collected based on the detection assembly in a current operation and maintenance period, the multi-modal data comprises text data, image data, audio data and video data which are subjected to format conversion; and carrying out operation and maintenance of a current operation and maintenance period on a photovoltaic module, a confluence module and an inversion module in the photovoltaic power station according to fusion processing of the multi-modal data. According to the method, the at least two items in the multi-modal data are fused, and the multi-modal data is converted into the unified data format through the format, so that the fusion processing of each item of data is more convenient, and rapid, comprehensive and accurate operation and maintenance of a photovoltaic module, a confluence module and an inverter module in a photovoltaic power station are realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of photovoltaic power generation technology, and in particular to a photovoltaic power station operation and maintenance method, system and medium based on multimodal data fusion. Background Art

[0002] With the decline of traditional fuel energy and its environmental damage, renewable clean energy is gaining increasing attention. Photovoltaic power generation is an important development direction of renewable clean energy. It is a technology that uses the photovoltaic effect at the semiconductor interface to directly convert light energy into electrical energy.

[0003] Typically, a photovoltaic power station consists primarily of PV modules, busbars, and inverters. Malfunctions in these components can significantly impact the plant's production efficiency, leading to reduced power generation efficiency, increased safety risks, shortened equipment lifespan, equipment damage, and data anomalies. Therefore, regular inspections and maintenance of PV modules, busbars, and inverters are crucial to promptly detect operational faults and ensure proper equipment operation.

[0004] Currently, the operation and maintenance of photovoltaic power plants largely relies on on-site personnel supplemented by testing equipment. However, these testing devices typically employ relatively limited methods, making it difficult to fully reflect the actual operating conditions of the photovoltaic modules, busbars, and inverter components within the power plant, resulting in incomplete and inaccurate O&M. Furthermore, different testing equipment utilizes varying communication protocols and data formats, making data processing complex. Therefore, how to quickly, comprehensively, and accurately maintain the operation and maintenance of the photovoltaic modules, busbars, and inverter components within a photovoltaic power plant is a pressing technical challenge. Summary of the Invention

[0005] The main purpose of the present invention is to provide a photovoltaic power station operation and maintenance method, system and medium based on multimodal data fusion, aiming to solve the technical problem of how to quickly, comprehensively and accurately operate and maintain photovoltaic components, bus components and inverter components in a photovoltaic power station.

[0006] To achieve the above objectives, the present invention provides a photovoltaic power station operation and maintenance method based on multimodal data fusion. The photovoltaic power station includes photovoltaic modules, bus modules, inverter modules, and detection modules. The photovoltaic power station operation and maintenance method includes: Acquire multimodal data corresponding to the photovoltaic power station collected by the detection component during the current operation and maintenance cycle, wherein the multimodal data includes text data, image data, audio data, and video data that have been formatted; wherein, The text data includes: photovoltaic power generation data and photovoltaic temperature difference data of the photovoltaic component, confluence data of the confluence component, inversion data, heat dissipation data and oil level data of the inversion component; The image data includes: a photovoltaic image of the photovoltaic component, a bus image of the bus component, and an inverter image of the inverter component; The audio data is vibration data of the inverter component, and the video data is a voltage transformation environment video of the inverter component; Performing operation and maintenance on photovoltaic components in the photovoltaic power station during a current operation and maintenance cycle based on the photovoltaic power generation data, the photovoltaic temperature difference data, and the fusion processing of the photovoltaic images; Performing operation and maintenance of the confluence components in the photovoltaic power station in a current operation and maintenance cycle according to the fusion processing of the confluence data and the confluence image; The inverter components in the photovoltaic power station are operated and maintained in the current operation and maintenance cycle based on the fusion processing of the inverter data, heat dissipation data, oil level data, the inverter image, the vibration data, and the transformer environment video.

[0007] Furthermore, to achieve the above-mentioned object, the present invention also provides a photovoltaic power station operation and maintenance system based on multimodal data fusion, wherein the photovoltaic power station operation and maintenance system based on multimodal data fusion comprises: a memory, a processor, a communication bus, and a control program stored in the memory: The communication bus is used to realize the connection and communication between the processor and the memory; The processor is used to execute the control program to implement the steps of the photovoltaic power station operation and maintenance method based on multimodal data fusion as described above.

[0008] Furthermore, to achieve the above-mentioned purpose, the present invention also provides a medium, which is a readable storage medium, and a control program is stored on the readable storage medium. When the control program is executed by the processor, the steps of the photovoltaic power station operation and maintenance method based on multimodal data fusion as described above are implemented.

[0009] The present invention is based on a photovoltaic power station operation and maintenance method, system and medium based on multimodal data fusion. The photovoltaic power station includes photovoltaic components, convergence components, inverter components and detection components. An operation and maintenance cycle for regular operation and maintenance is pre-set, and multimodal data corresponding to the photovoltaic power station collected by the detection component during the current operation and maintenance cycle is received. The multimodal data includes format-converted text data, image data, audio data and video data; specifically, the text data includes photovoltaic power generation data and photovoltaic temperature difference data of the photovoltaic components, convergence data of the convergence component, and inversion data, heat dissipation data and oil level data of the inverter component; the image data includes photovoltaic images of the photovoltaic components. , the converging image of the converging component, and the inverter image of the inverter component; the audio data is the vibration data of the inverter component, and the video data is the transformer environment video of the inverter component; then, based on the fusion processing of photovoltaic power generation data, photovoltaic temperature difference data, and photovoltaic images, the photovoltaic components in the photovoltaic power station within the current operation and maintenance cycle are operated and maintained; and based on the fusion processing of converging data and converging images, the converging components in the photovoltaic power station within the current operation and maintenance cycle are operated and maintained; and based on the fusion processing of inverter data, heat dissipation data, oil level data, inverter images, vibration data, and transformer environment video, the inverter components in the photovoltaic power station within the current operation and maintenance cycle are operated and maintained. In this way, by collecting multimodal data reflecting the operating status of the photovoltaic power station, including text data, image data, audio data, and video data, and fusing at least two of the multimodal data, comprehensive and accurate operation and maintenance of the photovoltaic components, converging components, and inverter components in the photovoltaic power station are achieved. At the same time, because multimodal data is converted into a unified data format, the tedious processing of data in different formats can be avoided, making the fusion processing of various data more convenient, which is conducive to fast, comprehensive and accurate operation and maintenance. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 This is a flow chart of a first embodiment of a photovoltaic power station operation and maintenance method based on multimodal data fusion according to the present invention; Figure 2 1 is a flow chart of a second embodiment of a photovoltaic power station operation and maintenance method based on multimodal data fusion according to the present invention; Figure 3 1 is a flow chart of a third embodiment of a photovoltaic power station operation and maintenance method based on multimodal data fusion according to the present invention; Figure 4 The figure is a schematic structural diagram of the hardware operating environment involved in an embodiment of a photovoltaic power station operation and maintenance system based on multimodal data fusion according to the present invention.

[0011] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings and in conjunction with the embodiments. DETAILED DESCRIPTION

[0012] It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0013] The present invention provides a photovoltaic power station operation and maintenance method based on multimodal data fusion, please refer to Figure 1 , Figure 1 This is a flow chart of a first embodiment of a photovoltaic power station operation and maintenance method based on multimodal data fusion according to the present invention.

[0014] The present invention provides an embodiment of a photovoltaic power station operation and maintenance method based on multimodal data fusion. It should be noted that although the flowchart shows a logical order, in some cases, the steps shown or described may be performed in a different order. Specifically, the photovoltaic power station in this embodiment includes photovoltaic modules, a bus module, an inverter module, and a detection module. The photovoltaic power station operation and maintenance method includes: Step S10: acquiring multimodal data corresponding to the photovoltaic power station collected by the detection component during the current operation and maintenance cycle, wherein the multimodal data includes text data, image data, audio data, and video data.

[0015] The photovoltaic power station operation and maintenance method based on multimodal data fusion of this embodiment is applied to the server of the photovoltaic power station. The photovoltaic power station includes a photovoltaic assembly composed of multiple photovoltaic panels, a bus assembly composed of a bus cabinet, a DC distribution cabinet, etc., an inverter assembly composed of an inverter, an AC distribution cabinet, a transformer, etc., and a detection assembly for detecting the photovoltaic assembly, the bus assembly, and the inverter assembly. The detection assembly includes at least temperature sensors, ammeters, voltmeters, infrared, drones, power robots, and other equipment, so as to collect the appearance and operating performance parameters of the photovoltaic assembly, the bus assembly, and the inverter assembly in the form of multimodal data such as images, audio, video, and text through such equipment. The server of the photovoltaic power station supports communication connection with the detection assembly in the photovoltaic power station, so as to monitor the operating status of the photovoltaic power station by fusing the multimodal data detected by the detection assembly, thereby realizing the operation and maintenance of the photovoltaic power station.

[0016] Specifically, an operation and maintenance cycle is pre-set, such as one week, half a month, one month, one quarter, half a year, one year, etc. Whenever the end of the operation and maintenance cycle is reached, the server acquires the multimodal data of the photovoltaic power station collected by the detection component during the current operation and maintenance cycle. The acquisition method can be that the server sends a transmission request to each device in the detection component, and each device sends the multimodal data collected during the current operation and maintenance cycle to the server after receiving the transmission request. It can also be that each device in the detection component transmits the collected multimodal data to the storage unit of the server in real time, and the server retrieves the storage unit to achieve acquisition. The acquired multimodal data includes at least text data, image data, audio data and video data. Moreover, corresponding to the photovoltaic components, bus components and inverter components in the photovoltaic power station, the acquired text data at least includes the photovoltaic power generation data and photovoltaic temperature difference data of the photovoltaic components, the bus data of the bus components, the inversion data, heat dissipation data and oil level data of the inverter components, etc., which are used to reflect the operating status of the photovoltaic components, bus components and inverter components; the acquired image data at least includes the photovoltaic image of the photovoltaic components, the bus image of the bus components, the inversion image of the inverter components, etc., which are used to reflect the appearance status data of the photovoltaic components, bus components and inverter components; the acquired audio data and video data mainly include vibration data reflecting the operating vibration and operating environment of the inverter components and the transformer environment video.

[0017] Step S20 , performing operation and maintenance on the photovoltaic components in the photovoltaic power station in the current operation and maintenance cycle according to the photovoltaic power generation data and the photovoltaic temperature difference data, and the fusion processing of the photovoltaic image.

[0018] It is understandable that for photovoltaic modules, the multimodal data collected includes photovoltaic power generation data, photovoltaic temperature difference data, and photovoltaic images. Therefore, in order to fully and accurately reflect its operating status, the photovoltaic power generation data, photovoltaic temperature difference data, and photovoltaic images related to the photovoltaic modules can be fused and processed, and based on the results of the fusion processing, the photovoltaic modules in the photovoltaic power station are operated and maintained in the current operation and maintenance cycle. Specifically, the steps of operating and maintaining the photovoltaic modules in the photovoltaic power station in the current operation and maintenance cycle based on the fusion processing of the photovoltaic power generation data, photovoltaic temperature difference data, and the photovoltaic images include: Step S21, performing grayscale processing on the photovoltaic image and forming a grayscale mean corresponding to each photovoltaic panel in the photovoltaic assembly; Step S22, forming matrix rows based on the monitoring period of the current operation and maintenance cycle, and forming matrix columns based on each of the photovoltaic panels; Step S23, forming the photovoltaic power generation data, the photovoltaic temperature difference data and the grayscale mean into a power generation characteristic matrix, a temperature difference characteristic matrix and a grayscale characteristic matrix respectively based on the matrix rows and the matrix columns; Step S24, performing a fusion calculation on the power generation characteristic matrix, the temperature difference characteristic matrix, and the grayscale characteristic matrix to obtain panel characteristic parameters of each photovoltaic panel in each monitoring period within the current operation and maintenance cycle; Step S25 , performing operation and maintenance of the current operation and maintenance cycle on each photovoltaic panel in the photovoltaic assembly according to the characteristic parameters of each panel.

[0019] Furthermore, to accurately reflect the operating status of each component in a photovoltaic power station during its operation and maintenance cycle, the operation and maintenance cycle can be divided into multiple monitoring periods. During each monitoring period, the detection component collects operating data from other components in the photovoltaic power station. Furthermore, the operating data collected during consecutive monitoring periods can be used to reflect changes in the operating status of the components. This embodiment uses multimodal data from each photovoltaic panel during each monitoring period of the operation and maintenance cycle to reflect changes in the operating status of each photovoltaic panel in a photovoltaic assembly, thereby achieving accurate operation and maintenance of each photovoltaic panel in the photovoltaic assembly.

[0020] Specifically, the collected photovoltaic power generation data is the power generation data of each photovoltaic panel in each monitoring period, the photovoltaic temperature difference data is the temperature difference data of at least two points selected for each photovoltaic panel in each monitoring period, and the photovoltaic image is the image taken of each photovoltaic panel that constitutes the photovoltaic assembly in each monitoring period.

[0021] Furthermore, grayscale processing is performed on the photovoltaic images of each photovoltaic panel to obtain a photovoltaic grayscale image of each photovoltaic panel during each monitoring period. Mean processing is then performed on the pixels in each grayscale image to obtain the grayscale mean of each photovoltaic panel during each monitoring period. Furthermore, the monitoring period of the current operation and maintenance cycle is formed into matrix rows, and each photovoltaic panel is formed into matrix columns. The photovoltaic power generation data of each photovoltaic panel during each monitoring period is then populated based on the matrix rows and matrix columns to form a power generation characteristic matrix. The photovoltaic temperature difference data of each photovoltaic panel during each monitoring period is then populated based on the matrix rows and matrix columns to form a temperature difference characteristic matrix. Furthermore, the grayscale mean of each photovoltaic panel during each monitoring period is populated based on the matrix rows and matrix columns to form a grayscale characteristic matrix.

[0022] In a specific embodiment, the number of photovoltaic panels of the photovoltaic assembly is 50, and the monitoring period of the operation and maintenance cycle is intervals of time A, which contains a total of 50 intervals. Then, the power generation characteristic matrix is ​​formed as follows: ; in, Indicates the photovoltaic power generation data of the first photovoltaic panel in monitoring period A, 2A, 3A...50A in the current operation and maintenance cycle; represents the photovoltaic power generation data for panels 1, 2, 3, ..., 5 during monitoring period A of the current operation and maintenance cycle. The temperature difference feature matrix and the grayscale feature matrix are also generated in this way and will not be described in detail here.

[0023] Furthermore, in order to reflect the changes in the operating status of photovoltaic panels during the operation and maintenance cycle, a formula is pre-set for calculating the panel characteristic parameters of photovoltaic panels in each monitoring period of the current operation and maintenance cycle. This calculation formula is used to fuse the power generation characteristic matrix, the temperature difference characteristic matrix, and the grayscale characteristic matrix to obtain the panel characteristic parameters of each photovoltaic panel in each monitoring period of the current operation and maintenance cycle. The calculation formula is specifically shown in the following formula (1): ; (1) Among them, P(i, t) represents the panel characteristic parameters of the i-th photovoltaic panel in the monitoring period t, Mit represents the matrix value of the i-th column and t-th row in the power generation characteristic matrix, Nit represents the matrix value of the i-th column and t-th row in the temperature difference characteristic matrix, Sit represents the matrix value of the i-th column and t-th row in the power generation characteristic matrix, f1(t±1) is the comparison function based on the monitoring period, and f2(i±1) is the comparison function based on the photovoltaic panel.

[0024] Furthermore, the "|" in formula (1) is a comparison symbol. After multiplying the data in the same matrix row and the same matrix column in the power generation characteristic matrix, the temperature difference characteristic matrix, and the grayscale characteristic matrix to obtain the power generation characteristic, temperature difference characteristic, and grayscale characteristic of the photovoltaic panel represented by the matrix row during the monitoring period represented by the matrix column, the f1(t±1) function and the f2(t±1) function are activated by this comparison symbol. The f1(t±1) function compares the above characteristics of the photovoltaic panel with its own characteristics in the previous monitoring period and the next monitoring period to obtain a first parameter representing the change of the above characteristics of the photovoltaic panel in the continuous period. The f2(i±1) function compares the above characteristics of the photovoltaic panel with the characteristics of the adjacent previous photovoltaic panel and the next photovoltaic panel in the same monitoring period to obtain a second parameter representing the change of the above characteristics of the photovoltaic panel relative to the adjacent photovoltaic panels. The first parameter and the second parameter form the panel characteristic parameters of the photovoltaic panel in a certain monitoring period within the current operation and maintenance cycle.

[0025] It is understandable that for each photovoltaic panel in a photovoltaic assembly, the operating performance in the same monitoring period should not differ much; and for the same photovoltaic panel, the operating performance in the previous and subsequent consecutive monitoring periods should also not differ much. Therefore, after obtaining the panel characteristic parameters of each photovoltaic panel in each monitoring period within the current operation and maintenance cycle, the first parameters of each photovoltaic panel in each monitoring period are compared with each other to find out whether there are first parameters with large differences; or first generate each first parameter as a mean, and then compare each first parameter with the mean to determine whether there are first parameters with large differences. If there are first parameters with large differences, then the first parameter indicates that the photovoltaic panel has experienced an operating abnormality in its corresponding monitoring period. Similarly, the second parameters of each photovoltaic panel in each monitoring period within the current operation and maintenance cycle are compared with each other to find out whether there are second parameters with large differences; or first generate each second parameter as a mean, and then compare each second parameter with the mean to determine whether there are second parameters with large differences. If there are second parameters with large differences, then it indicates that the photovoltaic panel corresponding to the second parameter has experienced an operating abnormality in the comparison monitoring period. Then, the operation and maintenance information of the abnormal photovoltaic panels is output for operation and maintenance, and the operation and maintenance of the current operation and maintenance cycle of each photovoltaic panel that constitutes the photovoltaic assembly is achieved through the acquired panel characteristic parameters.

[0026] Step S30 : performing operation and maintenance of the confluence components in the photovoltaic power station in the current operation and maintenance cycle according to the fusion processing of the confluence data and the confluence image.

[0027] Furthermore, for the convergence component, since it includes a convergence cabinet and a DC distribution cabinet, the multimodal data collected, including convergence data and convergence images, can be divided into convergence data and convergence images corresponding to the convergence cabinet, and convergence data and convergence images corresponding to the DC distribution cabinet. In order to reflect the operating status of the convergence cabinet and the DC distribution cabinet in the convergence component, the convergence data and convergence image related to the convergence cabinet can be fused, and the return data and convergence image related to the DC distribution cabinet can be fused. Then, based on the results of the respective fusion processes, the convergence cabinet and the DC distribution cabinet included in the convergence component in the photovoltaic power station are operated and maintained in the current operation and maintenance cycle. Specifically, for the convergence cabinet in the convergence component, the steps of operating and maintaining the convergence component in the photovoltaic power station in the current operation and maintenance cycle based on the fusion process of the convergence data and the convergence image include: Step S31, generating a confluence parameter of each confluence node in the confluence component according to the photovoltaic power generation data and the confluence data; Step S32, performing image feature calculation on each of the confluence images based on a preset image processing model to obtain a spatial region matrix of each of the confluence images; Step S33, generating element matrices corresponding to the confluence nodes based on the similarities between the spatial region matrices; Step S34, searching for a reference element matrix corresponding to each confluence node, and fusing each confluence parameter, each element matrix, and each reference element matrix to obtain confluence characteristic parameters of each confluence node; Step S35: performing operation and maintenance of the current operation and maintenance cycle on each confluence node in the confluence component according to each of the confluence characteristic parameters.

[0028] It can be understood that the busbar in the busbar assembly is used to converge the power generation of the photovoltaic panels in the photovoltaic assembly, and one photovoltaic panel corresponds to a busbar node in the busbar assembly. The convergence volume of each busbar node should not be much different from the power generation of its corresponding photovoltaic panel. Therefore, it is possible to determine whether each busbar node in the busbar assembly can converge normally based on the power generation of each photovoltaic panel reflected in the photovoltaic power generation data and the convergence volume of each busbar node in the convergence data. Specifically, for each busbar node, the corresponding convergence volume is found from the collected convergence data, and the photovoltaic panel corresponding to the busbar node is found, and then the power generation corresponding to the photovoltaic panel is found from the photovoltaic power generation data, and the found convergence volume and power generation are formed into the power difference.

[0029] Furthermore, mapping relationships between multiple difference intervals and parameters are pre-set, and the generated power difference is compared with each difference interval to determine the difference interval in which the power difference lies. The corresponding parameter for the difference interval is then searched based on the mapping relationship. This parameter is then used as the converging parameter for the converging node in the converging assembly, reflecting the converging performance of the converging node. In one embodiment, the smaller the numerical range of the difference interval, the smaller the mapped parameter value, indicating that the difference between the generated power and the returned power is small, and the converging node has good converging performance.

[0030] Furthermore, a pre-set image processing model is used to calculate the image features of each collected confluence image, thereby obtaining a spatial region matrix for each confluence image. This spatial region matrix reflects the spatial position of objects in the confluence image and the features of the objects at each spatial position. The specific calculation formula is shown in the following formula (2).

[0031] ; (2) Among them, Rj represents the spatial area matrix of the j-th confluence image, Hj represents the length of the j-th confluence image, Wj represents the width of the j-th confluence image, G2 represents the coordinate conversion function, G1 represents the feature extraction function, K1 represents the number of convolution kernels of the preset image processing model, k2 represents the number of steps of the preset image processing model, k3 represents the number of channels of the preset image processing model, and T* represents the formation of the converted coordinates and extracted features into a matrix.

[0032] In one specific embodiment, "||" is used to indicate the value settings for k1, k2, and k3, for example, k1 = 3*3 convolution kernels, k2 = 1 stride, and k3 = 3 channels. A confluent image is processed by a preset image processing model. The G2 coordinate conversion function converts the object pixels therein into pixel coordinates in a representation coordinate system, respectively {(x1, y1), (x2, y2), (x3, y3) ... (xn, yn)}. The features corresponding to each pixel, generated in advance by the G2 feature extraction function, are {(r1, g1, b1), (r2, g2, b2), (r3, g3, b3) ... (rn, gn, bn)}. The extracted pixel coordinates and features are then formed into a matrix based on the corresponding relationship. For example, corresponding coordinates and features are formed into the same matrix row, that is, x1, y1, r1, g1, b1 are formed into the first row of the matrix, x2, y2, r2, g2, b2 are formed into the second row of the matrix, and so on, until all pixel coordinates and features are formed into corresponding matrix rows. Of course, the matrix can also be formed in a column-by-column manner, that is, corresponding coordinates and features are formed into the same matrix column, until all pixel coordinates and features are formed into corresponding matrix columns.

[0033] Understandably, multiple converged images may represent the same object within each collected converging image. This means that multiple converged images of a particular object are obtained by capturing images at different angles. The pixel coordinates and pixel features of these converged images are similar, and the resulting spatial region matrices are similar because they represent the spatial location of the same object and the features of the object at each spatial location. Therefore, a similarity calculation can be performed on each spatial region matrix to identify a target spatial region matrix with high similarity. This target spatial region matrix represents the same object element at the converging node and can be used as the element matrix of the converging node.

[0034] Furthermore, for items at the confluence nodes, reference images representing their normal state are pre-set, such as images of confluence terminals showing a clean, tidy appearance, free of rust, and damage. These images are pre-generated into reference element matrices. After obtaining the element matrix for each confluence node, the reference element matrix corresponding to each confluence node is searched and fused with the found reference element matrix, the confluence parameters, and the element matrix to obtain the confluence characteristic parameters for each confluence node. The fusion process can include calculating a similarity between the reference element matrix and the element matrix for each confluence node to obtain a similarity value, and then correcting the calculated similarity value based on the confluence parameters to obtain the confluence characteristic parameters. For example, if the calculated similarity value is high, it indicates that the actual state of the confluence node is not much different from the theoretical reference state. In this case, the confluence performance of the confluence node is likely good. Therefore, the similarity value can be corrected using the confluence performance reflected by the confluence parameters to obtain the confluence characteristic parameters that ultimately reflect the confluence performance of the confluence node. For example, if the similarity value is high, and the confluence performance reflected by the confluence parameters is indeed good, the similarity value can be corrected to a higher value to obtain a confluence characteristic parameter reflecting good confluence performance. Conversely, if the confluence performance reflected by the confluence parameters is poor, the similarity value can be corrected to a lower value to obtain a confluence characteristic parameter reflecting poor confluence performance.

[0035] Furthermore, after obtaining the convergence characteristic parameters of each convergence node in the convergence component, each convergence node can be operated and maintained based on each convergence characteristic parameter. Specifically, a parameter indicating normal convergence performance can be set, and each convergence characteristic parameter can be compared with the parameter; or each convergence characteristic parameter can be averaged to obtain a mean operation result, and each convergence characteristic parameter can be compared with the mean operation result. Among them, for convergence characteristic parameters that are less than the parameter or less than the mean operation result, the convergence performance of the corresponding convergence node is poor and requires operation and maintenance. Therefore, the corresponding operation and maintenance information can be output for this type of convergence node to perform operation and maintenance on each convergence node in the convergence component during the current operation and maintenance cycle.

[0036] Step S40 , performing operation and maintenance on the inverter components in the photovoltaic power station in the current operation and maintenance cycle based on the fusion processing of the inverter data, heat dissipation data, oil level data, the inverter image, the vibration data, and the transformer environment video.

[0037] It can be understood that for the inverter components in the photovoltaic power station, the collected multimodal data include text-type inverter data, heat dissipation data, oil level data, image-type inverter images, audio-type vibration data, and video-type transformer environment videos. Therefore, in order to fully and accurately reflect its operating status, the inverter data, heat dissipation data, oil level data, inverter images, vibration data, and transformer environment videos related to the inverter components can be fused and processed, and based on the results of their respective fusion processing, the inverter components in the photovoltaic power station can be operated and maintained in the current operation and maintenance cycle.

[0038] The photovoltaic power station operation and maintenance method based on multimodal data fusion implemented in this invention comprises photovoltaic modules, confluence modules, inverter modules and detection modules. An operation and maintenance cycle for regular operation and maintenance is pre-set, and multimodal data corresponding to the photovoltaic power station collected by the detection module during the current operation and maintenance cycle is received. The multimodal data comprises text data, image data, audio data and video data that have been converted into a format. Specifically, the text data comprises photovoltaic power generation data and photovoltaic temperature difference data of the photovoltaic modules, confluence data of the confluence modules, and inversion data, heat dissipation data and oil level data of the inverter modules. The image data comprises photovoltaic images of the photovoltaic modules, and the confluence data of the inverter modules. The system collects the convergence image of the flow component and the inverter image of the inverter component; the audio data is the vibration data of the inverter component, and the video data is the voltage transformation environment video of the inverter component. Furthermore, based on the fusion processing of photovoltaic power generation data, photovoltaic temperature difference data, and photovoltaic images, the photovoltaic components in the photovoltaic power station within the current operation and maintenance cycle are operated and maintained. Furthermore, based on the fusion processing of convergence data and convergence images, the convergence components in the photovoltaic power station within the current operation and maintenance cycle are operated and maintained. Furthermore, based on the fusion processing of inverter data, heat dissipation data, oil level data, inverter images, vibration data, and voltage transformation environment video, the inverter components in the photovoltaic power station within the current operation and maintenance cycle are operated and maintained. In this way, by collecting multimodal data reflecting the operating status of the photovoltaic power station, including text data, image data, audio data, and video data, and fusing at least two of the multimodal data, comprehensive and accurate operation and maintenance of the photovoltaic components, convergence components, and inverter components in the photovoltaic power station can be achieved. At the same time, because multimodal data is converted into a unified data format, the tedious processing of data in different formats can be avoided, making the fusion processing of various data more convenient, which is conducive to fast, comprehensive and accurate operation and maintenance.

[0039] For further information, please refer to Figure 2 Based on the first embodiment of the photovoltaic power station operation and maintenance method based on multimodal data fusion of the present invention, a second embodiment of the photovoltaic power station operation and maintenance method based on multimodal data fusion of the present invention is proposed.

[0040] The second embodiment of the photovoltaic power station operation and maintenance method based on multimodal data fusion differs from the first embodiment of the photovoltaic power station operation and maintenance method based on multimodal data fusion in that the inverter assembly includes an inverter, a power distribution cabinet, and a transformer; The step of performing operation and maintenance on the inverter components in the photovoltaic power station in the current operation and maintenance cycle based on the fusion processing of the inverter data, heat dissipation data, oil level data, the inverter image, the vibration data, and the transformer environment video includes: Step S41, performing operation and maintenance on the inverter in the current operation and maintenance cycle according to the inverter box data in the inverter data, the inverter heat dissipation data in the heat dissipation data, the inverter box image in the inverter image, and the vibration data; Step S42, performing operation and maintenance on the power distribution cabinet in the current operation and maintenance cycle according to the fusion processing of the power distribution data in the inverter data, the power distribution and heat dissipation data in the heat dissipation data, and the power distribution cabinet image in the inverter image; Step S43 , performing operation and maintenance on the transformer in the current operation and maintenance cycle based on the fusion processing of the transformer data in the inverter data, the oil level data, the transformer image in the inverter image, and the transformer environment video.

[0041] It can be understood that the photovoltaic power station includes an inverter box for converting direct current into alternating current, a distribution cabinet for distributing electrical energy, and a transformer for realizing voltage conversion. In this embodiment, the inverter, distribution cabinet and transformer are collectively regarded as an inverter component, and the inverter, distribution cabinet and transformer in the inverter component are operated and maintained separately.

[0042] Specifically, the collected inverter data includes inverter box data reflecting the inverter box's DC power conversion performance, the heat dissipation data includes inverter heat dissipation data reflecting the inverter box's heat dissipation, and the inverter image includes an image of the inverter box, indicating whether the inverter box's appearance is intact. Furthermore, the collected vibration data reflects the magnitude of the inverter box's vibration during operation. By integrating this data, heat dissipation data, inverter box image, and vibration data, the inverter can be maintained for the current maintenance cycle.

[0043] Furthermore, the collected inverter data also includes power distribution data reflecting whether the power distribution cabinet operates normally during each monitoring period in the current operation and maintenance cycle, the heat dissipation data includes power distribution heat dissipation data reflecting the heat dissipation of the power distribution cabinet, and the inverter image includes a power distribution cabinet image reflecting whether the appearance of the power distribution cabinet is intact. Thus, based on the fusion processing of such power distribution data, power distribution heat dissipation data, and power distribution cabinet images, the operation and maintenance of the power distribution cabinet during the current operation and maintenance cycle can be achieved. Specifically, based on the power distribution data in each monitoring period, it is determined whether the power distribution cabinet operates normally during each monitoring period, and then the power distribution parameters corresponding to each monitoring period are generated; and based on the similarity between the collected power distribution cabinet image and the preset power distribution cabinet reference image, it is determined whether the appearance of the power distribution cabinet is intact, and then the corresponding image parameters are generated; and based on the comparison between the collected power distribution heat dissipation data and the reference heat dissipation parameters corresponding to each monitoring period, the heat dissipation parameters for each monitoring period are generated. Afterwards, according to each monitoring period, the power distribution parameters, image parameters and heat dissipation parameters are integrated and processed to generate parameters indicating whether there are any abnormalities in the power distribution, appearance and heat dissipation of the distribution cabinet in each monitoring period. Then, based on the parameters, the power distribution cabinet is operated and maintained in terms of power distribution, appearance and heat dissipation in the current operation and maintenance cycle.

[0044] Furthermore, the collected inverter data also includes transformer data reflecting the transformer's voltage conversion performance, and the inverter image includes a transformer image reflecting the transformer's appearance. Furthermore, the collected oil level data represents the oil level measured by the transformer's oil level gauge, while the transformer environment video reflects the transformer's surroundings. This fusion of transformer data, transformer images, oil level data, and transformer environment video allows for the current maintenance cycle of the transformer.

[0045] The step of performing operation and maintenance on the inverter in the current operation and maintenance cycle according to the inverter box data in the inverter data, the inverter heat dissipation data in the heat dissipation data, the inverter box image in the inverter image, and the fusion processing of the vibration data includes: Step S411, generating the inverter box data into inverter efficiency parameters for each monitoring period in the current operation and maintenance cycle; Step S412: obtaining weather data in the current operation and maintenance cycle, and generating heat dissipation parameters of the inverter box in each monitoring period in the current operation and maintenance cycle based on the weather data and the inverter heat dissipation data; Step S413, comparing the inverter box image with a preset inverter reference image to generate inverter image parameters of the inverter box; Step S414: Processing the vibration data based on a preset vibration algorithm to generate vibration amplitude parameters of the inverter box in the current operation and maintenance cycle; Step S415, the inverter efficiency parameters, heat dissipation parameters, inverter image parameters and vibration amplitude parameters are integrated based on each monitoring period to obtain inverter characteristic parameters, and the inverter is operated and maintained in the current operation and maintenance cycle according to each inverter characteristic parameter.

[0046] Furthermore, corresponding to each monitoring period in the current operation and maintenance cycle, the inverter box data includes input power data and output power data of each monitoring period. Such output power data and input power data are ratio-operated to generate the inverter efficiency parameters of each monitoring period in the current operation and maintenance cycle.

[0047] It is understandable that the heat dissipation performance of the inverter is not only related to the performance of the heat dissipation device equipped with the inverter, but also to the weather in the environment in which the inverter is located. Therefore, weather data for the inverter during the current operation and maintenance cycle is obtained. The obtained weather data may include temperature, humidity, wind speed, etc. The heat dissipation performance of the heat dissipation device varies under different weather conditions. A heat dissipation parameter pair for the heat dissipation device under each weather condition is pre-set. This heat dissipation parameter pair includes at least one weather parameter and one representation parameter, which reflects the heat dissipation performance of the heat dissipation device under these weather parameters. After obtaining the weather data for each monitoring period in the current operation and maintenance cycle, the heat dissipation parameter pair corresponding to each weather data is searched, as well as the representation parameters in each heat dissipation parameter pair. The heat dissipation data for each monitoring period contained in the inverter heat dissipation data is then compared with the representation parameters to generate the heat dissipation parameters of the inverter box for each monitoring period in the current operation and maintenance cycle. This heat dissipation parameter reflects the abnormality of the heat dissipation data for a given period. If the difference between the heat dissipation parameter for a given period and the representative parameter is large, it indicates that the heat dissipation parameter for that period is abnormal, and a heat dissipation parameter indicating an abnormality is generated. Otherwise, a heat dissipation parameter indicating an abnormality is generated. Furthermore, the magnitude of the abnormality can be indicated by the magnitude of the heat dissipation parameter; for example, a larger heat dissipation parameter value can be set to indicate a greater abnormality.

[0048] Furthermore, in order to monitor whether the inverter box's exterior is damaged, an image indicating that the inverter box is intact is pre-set as a preset inverter reference image, and the captured inverter box image is compared with the preset reference image to generate image similarity between the two. Furthermore, a preset similarity value representing the magnitude of similarity is pre-set, and the generated image similarity is compared with the preset similarity value to determine whether the image similarity is greater than or equal to the preset similarity value. If it is, it indicates that the similarity between the two is high, and the inverter box's exterior can be determined to be intact, generating inverter image parameters indicating that it is intact. Conversely, if the image similarity value is determined to be less than the preset similarity value after comparison, it indicates that the similarity between the two is low, and the inverter box's exterior can be determined to be damaged, and corresponding inverter image parameters are generated based on the degree of damage to the inverter box's exterior. The degree of damage to the inverter box's exterior can be reflected by the degree to which the image similarity value is less than the preset similarity value.

[0049] Furthermore, a preset vibration algorithm is pre-set for the vibration data reflecting the magnitude of vibration generated during the inverter box's operation. This preset vibration algorithm processes the vibration data to generate vibration amplitude parameters that reflect the magnitude of the inverter box's vibration during each monitoring period of the current operation and maintenance cycle. The calculation formula for the preset vibration algorithm is shown in Equation (3) below.

[0050] ; (3) Where H(A, t) represents the vibration amplitude parameter A within the monitoring period t, k represents the kth vibration data of the kth monitoring period, represents the extraction coefficient of the kth vibration data, Represents the amplitude extraction function. Extraction coefficient It is related to the ground vibration condition in the kth monitoring period of the kth vibration data, indicating the impact of ground vibration on the operating vibration of the inverter box.

[0051] Furthermore, the generated inverter efficiency parameters, heat dissipation parameters, inverter image parameters, and vibration amplitude parameters are fused according to the monitoring periods in which they are located. Specifically, each inverter efficiency parameter, heat dissipation parameter, inverter image parameter, and vibration amplitude parameter carries a time period tag representing the corresponding monitoring period. Based on the time period tags they carry, the inverter efficiency parameters, heat dissipation parameters, inverter image parameters, and vibration amplitude parameters from the same monitoring period are fused into a data group, and then the inverter characteristic parameters are generated based on the overall abnormal conditions of the inverter reflected by each data in the data group. Among them, weight values ​​can be pre-set based on the degree of influence of inverter efficiency, heat dissipation, inverter appearance, and vibration on inverter conversion, and the inverter efficiency parameters, heat dissipation parameters, inverter image parameters, and vibration amplitude parameters in the data group are weightedly fused according to the weight values ​​to obtain the inverter characteristic parameters.

[0052] Furthermore, based on the inverter characteristic parameters of each monitoring period, the inverter is operated and maintained for the current operation and maintenance cycle. Specifically, it is determined whether the change state of each inverter characteristic parameter is stable. If it is stable, it means that the inverter is operating normally. If it is not stable, the inverter characteristic parameter that has begun to fluctuate is determined, and the inverter efficiency parameter, heat dissipation parameter, image parameter, and vibration amplitude parameter that generate the fluctuating inverter characteristic parameter are found. Thereafter, based on the inverter performance reflected by the inverter efficiency parameter, heat dissipation parameter, image parameter, and vibration amplitude parameter, it is determined whether one or more of the following abnormalities exist: conversion abnormality, heat dissipation abnormality, appearance abnormality, and vibration abnormality. Then, based on the operation and maintenance information corresponding to the abnormal output, targeted and comprehensive operation and maintenance of the inverter is achieved during the current operation and maintenance cycle.

[0053] Furthermore, the step of performing operation and maintenance on the transformer in the current operation and maintenance cycle based on the fusion processing of the transformer data in the inverter data, the oil level data, the transformer image in the inverter image, and the transformer environment video includes: Step S431, generating the voltage transformation data and the oil level data into voltage transformation efficiency parameters and oil level change parameters for each monitoring period in the current operation and maintenance cycle respectively; Step S432, comparing the transformer image with a preset transformer reference image to generate transformer image parameters of the transformer; Step S433, extracting the to-be-identified images corresponding to each of the monitoring periods from the transformer environment video, and extracting the environmental characteristic parameters corresponding to the transformer from the to-be-identified images based on a preset extraction model; Step S434, the transformer efficiency parameter, oil level change parameter, transformer image parameter and environmental characteristic parameter are integrated based on each monitoring period to obtain transformer characteristic parameters, and the transformer is operated and maintained in the current operation and maintenance cycle according to each transformer characteristic parameter.

[0054] Furthermore, the transformer data for each monitoring period within the current operation and maintenance cycle includes input power data and output power data for each monitoring period. This output power data is then ratioed to the input power data to generate the transformer efficiency parameter for each monitoring period within the current operation and maintenance cycle. Furthermore, the oil level data also includes the start and end oil level data for each monitoring period. The oil level change data for each monitoring period within the current operation and maintenance cycle is obtained by calculating the difference between the start and end oil level data.

[0055] Furthermore, similar to the inverter box, in order to monitor whether the transformer's appearance is damaged, an image representing an intact transformer is pre-set as a preset transformer reference image. The captured transformer image is compared with the preset transformer reference image to generate an image similarity between the two. This image similarity is then compared with a pre-set similarity value to determine whether the image similarity is greater than or equal to the preset similarity value. If so, it indicates that the similarity between the two is high, and the transformer's appearance can be determined to be intact. Transformer image parameters indicating intactness are generated. Conversely, if the image similarity is determined to be less than the preset similarity value, it indicates that the similarity between the two is low, and the transformer's appearance can be determined to be damaged. Corresponding transformer image parameters are generated based on the degree of damage to the transformer's appearance. The degree of damage to the transformer's appearance can be reflected by the degree to which the image similarity is less than the preset similarity value.

[0056] Furthermore, the transformer environment video reflecting the transformer's surroundings is first subjected to frame extraction based on each monitoring period. Specifically, the transformer environment video is first divided into video segments corresponding to each monitoring period based on the time of its generation. Furthermore, a pre-set frame extraction interval is used for each video segment, resulting in multiple image frames as the images to be identified corresponding to the monitoring period.

[0057] Furthermore, a preset extraction model is pre-set, and a feature extraction operation is performed on the image to be identified using the extraction formula in the preset extraction model, thereby extracting environmental feature parameters corresponding to the transformer from the image to be identified. The extraction formula in the preset extraction model is shown in the following formula (4).

[0058] ; (4) Among them, px is the environmental feature parameter corresponding to the xth image to be identified, is the activation function of the preset extraction model, m is the connection index between the xth image to be recognized and the zth layer neuron of the preset extraction model, is the weight parameter of the z-th layer neuron of the preset extraction model, is the RGB feature value of each pixel in the x-th image to be identified, and bz is the bias value of the z-th layer neuron of the preset extraction model.

[0059] Furthermore, the generated transformer efficiency parameters, oil level change parameters, transformer image parameters, and environmental characteristic parameters are fused based on their respective monitoring periods. Specifically, each transformer efficiency parameter, oil level change parameter, transformer image parameter, and environmental characteristic parameter carries a time period tag representing the corresponding monitoring period. Based on the time period tags they carry, the transformer efficiency parameters, oil level change parameters, change image parameters, and environmental characteristic parameters from the same monitoring period are fused into a data set, and then the transformer characteristic parameters are generated based on the overall abnormality of the transformer as reflected by each data in the data set. Weight values ​​can be pre-set based on the degree of influence of transformer efficiency, oil level, transformer appearance, and environment on transformer transformation. Based on the weight values, the transformer efficiency parameters, oil level change parameters, transformer image parameters, and environmental characteristic parameters in the data set are weightedly fused to obtain the transformer characteristic parameters.

[0060] Furthermore, based on the transformer characteristic parameters of each monitoring period, the transformer is operated and maintained for the current operation and maintenance cycle. Specifically, it is determined whether the change state of each transformer characteristic parameter is stable. If it is stable, it means that the transformer is operating normally. If it is not stable, the transformer characteristic parameter that has begun to fluctuate is determined, and the transformer efficiency parameter, oil level change parameter, transformer image parameter, and environmental characteristic parameter that generate the fluctuating transformer characteristic parameter are searched. Thereafter, based on the transformer performance reflected by the transformer efficiency parameter, oil level change parameter, transformer image parameter, and environmental characteristic parameter, it is determined whether one or more of the following abnormalities exist: transformer abnormality, heat dissipation abnormality, appearance abnormality, and vibration abnormality. Then, based on the operation and maintenance information corresponding to the determined abnormality, targeted and comprehensive operation and maintenance of the transformer is achieved within the current operation and maintenance cycle.

[0061] This embodiment performs operation and maintenance on the inverter, distribution cabinet, and transformer in the inverter assembly separately. For the inverter, operation and maintenance are performed based on the fusion processing of the inverter box data, heat dissipation data, inverter box image, and vibration data that reflect its inversion performance; for the distribution cabinet, operation and maintenance are performed based on the fusion processing of the distribution data, heat dissipation data, and inverter box image that reflect its distribution performance; for the transformer, operation and maintenance are performed based on the fusion processing of the transformer data, oil level data, transformer image, and transformer environment video that reflect its transformer performance. In this way, the operation and maintenance of the inverter, distribution cabinet, and transformer comprehensively considers the multi-dimensional factors related to their respective operations, thereby improving the accuracy of the operation and maintenance of the inverter, distribution cabinet, and transformer.

[0062] For further information, please refer to Figure 3 Based on the first and second embodiments of the photovoltaic power station operation and maintenance method based on multimodal data fusion of the present invention, a third embodiment of the photovoltaic power station operation and maintenance method based on multimodal data fusion of the present invention is proposed.

[0063] The third embodiment of the photovoltaic power station operation and maintenance method based on multimodal data fusion differs from the first and second embodiments of the photovoltaic power station operation and maintenance method based on multimodal data fusion in that the step of obtaining multimodal data corresponding to the photovoltaic power station collected by the detection component during the current operation and maintenance cycle includes: Step S11, receiving text data, image data, audio data, and video data corresponding to the photovoltaic power station collected by the detection component during the current operation and maintenance cycle, and determining whether the text data, image data, audio data, and video data all have complete data packet numbers; Step S12: If all of the data packets have complete data packet numbers, format conversion is performed on the text data, image data, audio data, and video data to form the multimodal data; Step S13: If there is data to be transmitted that does not have a complete data packet number among the text data, image data, audio data and video data, a transmission request is sent to the detection component based on the data packet number that is missing from the data to be transmitted to obtain a complete data packet to form the multimodal data.

[0064] It is understandable that the graphic data and audio and video data collected by the detection component may be at risk of leakage. To this end, this embodiment provides a partial data encryption transmission mechanism between the detection component and the data transmission of the server, so as to ensure the security of the transmitted data while avoiding the complex encryption and decryption problems caused by encrypting all data. Specifically, before the detection component transmits text data, image data, audio data and video data to the server, it transmits the number of data packets for transmission formed by each type of data as one of the data to be transmitted. After receiving the text data, image data, audio data and video data transmitted by the detection component, the server detects each type of data according to the number of data packets carried in each type of data, and determines whether it has a complete data packet number. Among them, the data packet number is a sequential number based on the number of data packets. If the number of data packets is 10, the data packet number is numbered from 1 to 10 in sequence.

[0065] Furthermore, if it is determined that the packet numbers of the text data, image data, audio data, and video data are complete relative to the number of packets, this indicates that the detection component has sent all text data, image data, audio data, and video data collected during the current operation and maintenance cycle to the server. At this point, the server can directly perform operations and maintenance for the current operation and maintenance cycle based on this data. However, it should be noted that this text data, image data, audio data, and video data are collected by different devices that make up the detection component. These different devices use different communication protocols, resulting in different formats for the transmitted data. To facilitate unified fusion processing, the server pre-configures a format conversion mechanism that sets a unified data format and a conversion algorithm between this unified data format and other data formats. For the received text data, image data, audio data, and video data, it first determines whether the format of this data is consistent with the unified data format. If so, no conversion is required and the data can be directly fused as multimodal data. If not, the data is converted according to the conversion algorithm between the format and the unified data format to obtain multimodal data with a unified format for fusion processing.

[0066] Furthermore, if it is determined that the data packet number of any of the text data, image data, audio data, and video data is incomplete, it indicates that the detection component has not transmitted all the data collected during the current operation and maintenance cycle to the server. The missing data must be obtained through encryption and decryption to ensure the security of the transmitted data. The received data without a complete data packet is treated as the data to be transmitted, and the missing data packet number in the data to be transmitted is searched. The found data packet number is then used to form a transmission request to the detection component, so that the detection component can transmit the missing data with the data packet number to the server, so that the server can obtain the complete data packet to form multimodal data.

[0067] Furthermore, to ensure the security of the transmitted data, the transmission request includes a pre-set encryption algorithm, so that the detection component encrypts the missing data packet according to the encryption algorithm before transmitting it to the server. The server must first decrypt the encrypted data packet after receiving it. Specifically, after the step of sending a transmission request to the detection component based on the number of the missing data packet of the data to be transmitted to obtain a complete data packet to form the multimodal data, the following steps are included: Step S14: receiving the encrypted data packet sent by the detection component based on the transmission request, and calculating the missing data packet numbers based on a preset decryption algorithm to obtain a decryption key; Step S15: decrypting the encrypted data packet based on the decryption key to obtain a decrypted data packet, and merging the decrypted data packet with the data to be transmitted according to the missing data packet numbers to form a complete data packet; Step S16: performing format conversion on the complete data packet to form the multimodal data.

[0068] Furthermore, in addition to the encryption algorithm, the server also pre-sets a decryption algorithm. The encryption algorithm and decryption algorithm are inverse operations of each other and are both generated based on the missing data packet number. This allows different encryption keys and decryption keys to be generated by the encryption and decryption algorithm for encryption and decryption each time data is transmitted, due to the different missing data packet numbers. This further ensures the security of the transmitted data. After receiving the encrypted data packet generated by the detection component based on the transmission request, the server calculates the missing data packet code using the preset decryption algorithm to obtain the decryption key. The preset decryption algorithm is shown in the following formula (5).

[0069] ; (5) Where S represents the decryption key, represents the data size of the nth packet, An represents the data size of a complete packet, x1 and x2 are the missing packet numbers, and y1 and y2 are the adjacent packet number pairs corresponding to the missing packet numbers. When there are multiple missing packet numbers, y1 and y2 also represent multiple pairs. For example, if x1 is 5 and x2 is 8, indicating that the fifth and eighth packets are missing, the adjacent packet number pairs y1 and y2 corresponding to x1 are 4 and 6, respectively, and the adjacent packet number pairs y1 and y2 corresponding to x2 are 7 and 9, respectively.

[0070] Furthermore, after calculating and obtaining the decryption key, the received encrypted data packet can be interpolated with the decryption key to obtain a decrypted data packet. This decrypted data packet is the missing data packet in the data to be transmitted. Furthermore, since the missing data packet's position in the data to be transmitted is indicated by the missing data packet number, the decrypted data packet can be added to the position in the data to be transmitted indicated by the missing data packet number, thereby merging the decrypted data packet with the data to be transmitted to form a complete data packet.

[0071] Similarly, because the format of the complete data packet may differ from the unified data format, the complete data needs to be converted. Specifically, the complete data packet format is first determined to be identical to the unified data format. If so, no conversion is required and the data can be directly processed as multimodal data for fusion. If not, the complete data packet format is converted to the unified data format using a conversion algorithm between the two formats, and the converted data is then processed as multimodal data for fusion.

[0072] This embodiment provides encryption for data with transmission security requirements. Encryption does not encrypt the entire data, but rather selects portions of the data packets for encryption. This reduces the amount of data required for the encryption and decryption algorithms while ensuring data transmission security. Furthermore, the encryption and decryption algorithms are calculated based on the encoding of the missing data packets, further ensuring data transmission security. Furthermore, a format conversion mechanism is used to convert data in different formats transmitted based on different communication protocols into a unified data format, forming multimodal data with the same data format, facilitating the fusion processing of multimodal data.

[0073] In addition, an embodiment of the present invention also provides a photovoltaic power station operation and maintenance system based on multimodal data fusion. The photovoltaic power station includes photovoltaic components, confluence components, inverter components, and detection components. Figure 4 , Figure 4 This is a structural diagram of the equipment hardware operating environment involved in the embodiment of the photovoltaic power station operation and maintenance system based on multimodal data fusion of the present invention.

[0074] like Figure 4 As shown, the photovoltaic power plant operation and maintenance system based on multimodal data fusion may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display and an input unit such as a keyboard. Optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory, such as a disk drive. Optionally, the memory 1005 may be a storage device independent of the processor 1001.

[0075] Those skilled in the art will understand that Figure 4 The hardware structure of the photovoltaic power station operation and maintenance system based on multimodal data fusion shown in the figure does not constitute a limitation on the photovoltaic power station operation and maintenance system based on multimodal data fusion, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0076] like Figure 4As shown, memory 1005, a readable storage medium, may include an operating system, a network communication module, a user interface module, and a control program. The operating system is a program that manages and controls the photovoltaic power plant operation and maintenance system and software resources based on multimodal data fusion, and supports the operation of the network communication module, the user interface module, the control program, and other programs or software. The network communication module is used to manage and control the network interface 1004; the user interface module is used to manage and control the user interface 1003.

[0077] exist Figure 4 In the illustrated hardware structure of the photovoltaic power station operation and maintenance system based on multimodal data fusion, the network interface 1004 is primarily used to connect to a backend server and communicate data with the backend server; the user interface 1003 is primarily used to connect to a client (user end) and communicate data with the client; the processor 1001 can call the control program stored in the memory 1005 and perform the following operations: Acquire multimodal data corresponding to the photovoltaic power station collected by the detection component during the current operation and maintenance cycle, wherein the multimodal data includes text data, image data, audio data, and video data that have been formatted; wherein, The text data includes: photovoltaic power generation data and photovoltaic temperature difference data of the photovoltaic component, confluence data of the confluence component, inversion data, heat dissipation data and oil level data of the inversion component; The image data includes: a photovoltaic image of the photovoltaic component, a bus image of the bus component, and an inverter image of the inverter component; The audio data is vibration data of the inverter component, and the video data is a voltage transformation environment video of the inverter component; Performing operation and maintenance on photovoltaic components in the photovoltaic power station during a current operation and maintenance cycle based on the photovoltaic power generation data, the photovoltaic temperature difference data, and the fusion processing of the photovoltaic images; Performing operation and maintenance of the confluence components in the photovoltaic power station in a current operation and maintenance cycle according to the fusion processing of the confluence data and the confluence image; The inverter components in the photovoltaic power station are operated and maintained in the current operation and maintenance cycle based on the fusion processing of the inverter data, heat dissipation data, oil level data, the inverter image, the vibration data, and the transformer environment video.

[0078] Furthermore, the step of performing operation and maintenance on the photovoltaic components in the photovoltaic power station in the current operation and maintenance cycle based on the photovoltaic power generation data and the photovoltaic temperature difference data, and the fusion processing of the photovoltaic image includes: Performing grayscale processing on the photovoltaic image and forming a grayscale mean corresponding to each photovoltaic panel in the photovoltaic assembly; Forming matrix rows based on the monitoring period of the current operation and maintenance cycle, and forming matrix columns based on each of the photovoltaic panels; Based on the matrix rows and the matrix columns, the photovoltaic power generation data, the photovoltaic temperature difference data and the grayscale mean are respectively formed into a power generation characteristic matrix, a temperature difference characteristic matrix and a grayscale characteristic matrix; The power generation characteristic matrix, the temperature difference characteristic matrix and the grayscale characteristic matrix are fused and calculated to obtain the panel characteristic parameters of each photovoltaic panel in each monitoring period during the current operation and maintenance cycle, wherein the calculation formula is: ; Performing operation and maintenance on each photovoltaic panel in the photovoltaic assembly during a current operation and maintenance cycle according to the characteristic parameters of each panel; Among them, P(i, t) represents the panel characteristic parameters of the i-th photovoltaic panel in the monitoring period t, Mit represents the matrix value of the i-th column and t-th row in the power generation characteristic matrix, Nit represents the matrix value of the i-th column and t-th row in the temperature difference characteristic matrix, Sit represents the matrix value of the i-th column and t-th row in the power generation characteristic matrix, f1(t±1) is the comparison function based on the monitoring period, and f2(i±1) is the comparison function based on the photovoltaic panel. Furthermore, the step of performing operation and maintenance on the confluence components in the photovoltaic power station in the current operation and maintenance cycle based on the fusion processing of the confluence data and the confluence image includes: generating a confluence parameter of each confluence node in the confluence component according to the photovoltaic power generation data and the confluence data; Based on the preset image processing model, image features of each confluence image are calculated to obtain the spatial region matrix of each confluence image. The calculation formula is: ; Wherein, Rj represents the spatial region matrix of the j-th confluence image, Hj represents the length of the j-th confluence image, Wj represents the width of the j-th confluence image, G2 represents the coordinate conversion function, G1 represents the feature extraction function, K1 represents the number of convolution kernels of the preset image processing model, k2 represents the number of steps of the preset image processing model, k3 represents the number of channels of the preset image processing model, and T* represents the formation of the converted coordinates and the extracted features into a matrix; generating element matrices corresponding to the confluence nodes based on the similarities between the spatial region matrices; Searching for a reference element matrix corresponding to each confluence node, and fusing each confluence parameter, each element matrix, and each reference element matrix to obtain a confluence characteristic parameter of each confluence node; According to each of the confluence characteristic parameters, each confluence node in the confluence component is operated and maintained in the current operation and maintenance cycle. Furthermore, the inverter assembly includes an inverter, a power distribution cabinet and a transformer; The step of performing operation and maintenance on the inverter components in the photovoltaic power station in the current operation and maintenance cycle based on the fusion processing of the inverter data, heat dissipation data, oil level data, the inverter image, the vibration data, and the transformer environment video includes: Performing operation and maintenance on the inverter in a current operation and maintenance cycle according to the inverter box data in the inverter data, the inverter heat dissipation data in the heat dissipation data, the inverter box image in the inverter image, and the fusion processing of the vibration data; Performing operation and maintenance on the power distribution cabinet in the current operation and maintenance cycle according to the power distribution data in the inverter data, the power distribution and heat dissipation data in the heat dissipation data, and the power distribution cabinet image in the inverter image; The transformer is operated and maintained in the current operation and maintenance cycle according to the transformer data in the inverter data, the oil level data, the transformer image in the inverter image, and the fusion processing of the transformer environment video. Furthermore, the step of performing operation and maintenance on the inverter in the current operation and maintenance cycle according to the inverter box data in the inverter data, the inverter heat dissipation data in the heat dissipation data, the inverter box image in the inverter image, and the fusion processing of the vibration data includes: Generating the inverter box data into inverter efficiency parameters for each monitoring period in the current operation and maintenance cycle; Acquire weather data within the current operation and maintenance cycle, and generate heat dissipation parameters of the inverter box for each monitoring period within the current operation and maintenance cycle based on the weather data and the inverter heat dissipation data; Comparing the inverter box image with a preset inverter reference image to generate inverter image parameters of the inverter box; Based on a preset vibration algorithm, the vibration data is processed to generate the vibration amplitude parameter of the inverter box in the current operation and maintenance cycle. The calculation formula of the preset vibration algorithm is: ; Where H(A, t) represents the vibration amplitude parameter A within the monitoring period t, k represents the kth vibration data, represents the extraction coefficient of the kth vibration data, represents the amplitude extraction function; The inverter efficiency parameter, heat dissipation parameter, inverter image parameter and vibration amplitude parameter are integrated based on each monitoring period to obtain inverter characteristic parameters, and the inverter is operated and maintained in the current operation and maintenance cycle according to each inverter characteristic parameter. Furthermore, the step of performing operation and maintenance on the transformer in the current operation and maintenance cycle based on the fusion processing of the transformer data in the inverter data, the oil level data, the transformer image in the inverter image, and the transformer environment video includes: Generating the voltage transformation data and the oil level data into voltage transformation efficiency parameters and oil level change parameters for each monitoring period in the current operation and maintenance cycle respectively; Comparing the transformer image with a preset transformer reference image to generate transformer image parameters of the transformer; Extract the image to be identified corresponding to each monitoring period from the transformer environment video, and extract the environmental characteristic parameters corresponding to the transformer from the image to be identified based on a preset extraction model. The extraction formula of the preset extraction model is: ; Among them, px is the environmental feature parameter corresponding to the xth image to be identified, is the activation function of the preset extraction model, m is the connection index between the xth image to be recognized and the zth layer neuron of the preset extraction model, is the weight parameter of the z-th layer neuron of the preset extraction model, is the RGB feature value of each pixel in the x-th image to be identified, and bz is the bias value of the z-th layer neuron of the preset extraction model; The transformer efficiency parameters, oil level change parameters, transformer image parameters and environmental characteristic parameters are integrated based on each monitoring period to obtain transformer characteristic parameters, and the transformer is operated and maintained in the current operation and maintenance cycle according to each transformer characteristic parameter. Furthermore, the step of obtaining multimodal data corresponding to the photovoltaic power station collected by the detection component during the current operation and maintenance cycle includes: receiving text data, image data, audio data, and video data corresponding to the photovoltaic power station collected by the detection component during the current operation and maintenance cycle, and determining whether the text data, image data, audio data, and video data all have complete data packet numbers; If all of them have complete data packet numbers, performing format conversion processing on the text data, image data, audio data, and video data to form the multimodal data; If there is data to be transmitted that does not have a complete data packet number in the text data, image data, audio data and video data, a transmission request is sent to the detection component based on the missing data packet number of the data to be transmitted to obtain a complete data packet to form the multimodal data. Further, after the step of sending a transmission request to the detection component based on the data packet number missing from the data to be transmitted to obtain a complete data packet to form the multimodal data; the processor 1001 may call the control program stored in the memory 1005 and perform the following operations: Receive the encrypted data packet sent by the detection component based on the transmission request, and calculate the missing data packet number based on a preset decryption algorithm to obtain a decryption key, where the preset decryption algorithm is: ; Where S represents the decryption key, represents the data volume of the nth data packet, An represents the data volume of the complete data packet, x1 and x2 are the missing data packet numbers, and y1 and y2 are the adjacent data packet number pairs corresponding to the missing data packet numbers; Decrypting the encrypted data packet based on the decryption key to obtain a decrypted data packet, and fusing the decrypted data packet with the data to be transmitted according to the missing data packet number to form a complete data packet; The complete data packet is format-converted to form the multimodal data.

[0079] The specific implementation of the photovoltaic power station operation and maintenance system based on multimodal data fusion of the present invention is basically the same as the various embodiments of the photovoltaic power station operation and maintenance method based on multimodal data fusion described above, and will not be repeated here.

[0080] An embodiment of the present invention further provides a medium, which is a readable storage medium having a control program stored thereon, and which, when executed by a processor, implements the steps of the photovoltaic power station operation and maintenance method based on multimodal data fusion.

[0081] The readable storage medium of the present invention may be a computer-readable storage medium, and its specific implementation is substantially the same as that of the above-mentioned embodiments of the photovoltaic power station operation and maintenance method based on multimodal data fusion, and will not be described in detail here.

[0082] The embodiments of the present invention are described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present invention, ordinary technicians in this field can also make many forms without departing from the scope of protection of the purpose of the present invention and the claims. Any equivalent structure or equivalent process transformation made using the contents of the description and drawings of the present invention, or directly or indirectly used in other related technical fields, all fall within the protection of the present invention.

Claims

1. A photovoltaic power station operation and maintenance method based on multimodal data fusion, characterized in that: The photovoltaic power station includes a photovoltaic component, a busbar component, an inverter component, and a detection component. The photovoltaic power station operation and maintenance method includes: Acquire multimodal data corresponding to the photovoltaic power station collected by the detection component during the current operation and maintenance cycle, wherein the multimodal data includes text data, image data, audio data, and video data that have been converted into a format; wherein: The text data includes: photovoltaic power generation data and photovoltaic temperature difference data of the photovoltaic component, confluence data of the confluence component, inversion data, heat dissipation data and oil level data of the inversion component; The image data includes: a photovoltaic image of the photovoltaic component, a bus image of the bus component, and an inverter image of the inverter component; The audio data is vibration data of the inverter component, and the video data is a voltage transformation environment video of the inverter component; According to the photovoltaic power generation data and the photovoltaic temperature difference data, and the fusion processing of the photovoltaic image, the photovoltaic components in the photovoltaic power station are operated and maintained in the current operation and maintenance cycle; According to the fusion processing of the confluence data and the confluence image, the confluence components in the photovoltaic power station are operated and maintained in the current operation and maintenance cycle; The inverter components in the photovoltaic power station are operated and maintained in the current operation and maintenance cycle according to the fusion processing of the inverter data, heat dissipation data, oil level data, the inverter image, the vibration data, and the transformer environment video.

2. The photovoltaic power station operation and maintenance method according to claim 1, characterized in that: The step of operating and maintaining the photovoltaic components in the photovoltaic power station in the current operation and maintenance cycle according to the photovoltaic power generation data and the photovoltaic temperature difference data, and the fusion processing of the photovoltaic image includes: Performing grayscale processing on the photovoltaic image and forming a grayscale mean corresponding to each photovoltaic panel in the photovoltaic assembly; Forming matrix rows based on the monitoring period of the current operation and maintenance cycle, and forming matrix columns based on each of the photovoltaic panels; Based on the matrix rows and the matrix columns, the photovoltaic power generation data, the photovoltaic temperature difference data and the grayscale mean are respectively formed into a power generation characteristic matrix, a temperature difference characteristic matrix and a grayscale characteristic matrix; The power generation characteristic matrix, the temperature difference characteristic matrix and the grayscale characteristic matrix are fused and calculated to obtain the panel characteristic parameters of each photovoltaic panel in each monitoring period in the current operation and maintenance cycle, wherein the calculation formula is: ; According to the characteristic parameters of each panel, each photovoltaic panel in the photovoltaic assembly is operated and maintained in the current operation and maintenance cycle; Among them, P (i, t) represents the panel characteristic parameters of the i-th photovoltaic panel in the monitoring period t, Mit represents the matrix value of the i-th column and the t-th row in the power generation characteristic matrix, Nit represents the matrix value of the i-th column and the t-th row in the temperature difference characteristic matrix, Sit represents the matrix value of the i-th column and the t-th row in the power generation characteristic matrix, f1 (t ± 1) is the comparison function based on the monitoring period, and f2 (i ± 1) is the comparison function based on the photovoltaic panel.

3. The photovoltaic power station operation and maintenance method according to claim 1, characterized in that: The step of performing operation and maintenance of the confluence components in the photovoltaic power station in the current operation and maintenance cycle according to the fusion processing of the confluence data and the confluence image comprises: Generate a confluence parameter of each confluence node in the confluence component according to the photovoltaic power generation data and the confluence data; Based on the preset image processing model, image features of each confluence image are calculated to obtain the spatial region matrix of each confluence image. The calculation formula is: ; Wherein, Rj represents the spatial region matrix of the j-th confluence image, Hj represents the length of the j-th confluence image, Wj represents the width of the j-th confluence image, G2 represents the coordinate conversion function, G1 represents the feature extraction function, K1 represents the number of convolution kernels of the preset image processing model, k2 represents the number of steps of the preset image processing model, k3 represents the number of channels of the preset image processing model, and T* represents the formation of the converted coordinates and the extracted features into a matrix; Based on the similarity between the spatial region matrices, generating element matrices corresponding to the confluence nodes respectively; Finding the reference element matrix corresponding to each confluence node, and fusing each confluence parameter, each element matrix and each reference element matrix to obtain the confluence characteristic parameter of each confluence node; According to each of the confluence characteristic parameters, each confluence node in the confluence component is operated and maintained in the current operation and maintenance cycle.

4. The photovoltaic power station operation and maintenance method according to claim 1, characterized in that: The inverter assembly includes an inverter, a power distribution cabinet and a transformer; The step of operating and maintaining the inverter components in the photovoltaic power station in the current operation and maintenance cycle according to the fusion processing of the inverter data, the heat dissipation data, the oil level data, the inverter image, the vibration data, and the transformer environment video includes: Performing operation and maintenance of the inverter in a current operation and maintenance cycle according to the inverter box data in the inverter data, the inverter heat dissipation data in the heat dissipation data, the inverter box image in the inverter image, and the fusion processing of the vibration data; According to the power distribution data in the inverter data, the power distribution and heat dissipation data in the heat dissipation data, and the fusion processing of the power distribution cabinet image in the inverter image, the power distribution cabinet is operated and maintained in the current operation and maintenance cycle; The transformer is operated and maintained in the current operation and maintenance cycle according to the transformer data in the inverter data, the oil level data, the transformer image in the inverter image, and the fusion processing of the transformer environment video.

5. The photovoltaic power station operation and maintenance method according to claim 4, characterized in that: The step of performing operation and maintenance of the inverter in the current operation and maintenance cycle according to the inverter box data in the inverter data, the inverter heat dissipation data in the heat dissipation data, the inverter box image in the inverter image, and the fusion processing of the vibration data includes: The inverter box data is generated as the inverter efficiency parameters of each monitoring period in the current operation and maintenance cycle; Acquire weather data in the current operation and maintenance cycle, and generate heat dissipation parameters of the inverter box in each monitoring period in the current operation and maintenance cycle according to the weather data and the inverter heat dissipation data; Comparing the inverter box image with a preset inverter reference image to generate inverter image parameters of the inverter box; Based on a preset vibration algorithm, the vibration data is processed to generate the vibration amplitude parameter of the inverter box in the current operation and maintenance cycle. The calculation formula of the preset vibration algorithm is: ; Where H(A, t) represents the vibration amplitude parameter A within the monitoring period t, k represents the kth vibration data, represents the extraction coefficient of the kth vibration data, represents the amplitude extraction function; The inverter efficiency parameter, heat dissipation parameter, inverter image parameter and vibration amplitude parameter are integrated based on each monitoring period to obtain the inverter characteristic parameter, and the inverter is operated and maintained in the current operation and maintenance cycle according to each inverter characteristic parameter.

6. The photovoltaic power station operation and maintenance method according to claim 4, characterized in that: The step of performing operation and maintenance on the transformer in the current operation and maintenance cycle according to the transformer data in the inverter data, the oil level data, the transformer image in the inverter image, and the fusion processing of the transformer environment video includes: The voltage transformation data and the oil level data are respectively generated as voltage transformation efficiency parameters and oil level change parameters for each monitoring period in the current operation and maintenance cycle; Comparing the transformer image with a preset transformer reference image to generate transformer image parameters of the transformer; Extract the to-be-recognized images corresponding to each monitoring period from the transformer environment video, and extract the environmental characteristic parameters corresponding to the transformer from the to-be-recognized images based on a preset extraction model. The extraction formula of the preset extraction model is: ; Among them, px is the environmental feature parameter corresponding to the xth image to be identified. is the activation function of the preset extraction model, m is the connection index between the xth image to be recognized and the zth layer neuron of the preset extraction model, is the weight parameter of the neurons in the zth layer of the preset extraction model, is the RGB feature value of each pixel in the xth image to be identified, and bz is the bias value of the zth layer neuron of the preset extraction model; The transformer efficiency parameter, oil level change parameter, transformer image parameter and environmental characteristic parameter are integrated based on each monitoring period to obtain transformer characteristic parameters, and the transformer is operated and maintained in the current operation and maintenance cycle according to each transformer characteristic parameter.

7. The photovoltaic power station operation and maintenance method according to any one of claims 1 to 6, characterized in that: The step of acquiring multimodal data corresponding to the photovoltaic power station collected by the detection component during the current operation and maintenance cycle includes: Receiving text data, image data, audio data and video data corresponding to the photovoltaic power station collected by the detection component during the current operation and maintenance cycle, and determining whether the text data, image data, audio data and video data all have complete data packet numbers; If they all have complete data packet numbers, format conversion is performed on the text data, image data, audio data and video data to form the multimodal data; If there is data to be transmitted that does not have a complete data packet number among the text data, image data, audio data and video data, a transmission request is sent to the detection component based on the missing data packet number of the data to be transmitted to obtain a complete data packet to form the multimodal data.

8. The photovoltaic power station operation and maintenance method according to claim 7, characterized in that: The step of sending a transmission request to the detection component based on the missing data packet number of the data to be transmitted to obtain a complete data packet to form the multimodal data includes: Receive the encrypted data packet sent by the detection component based on the transmission request, and calculate the missing data packet number based on a preset decryption algorithm to obtain a decryption key, wherein the preset decryption algorithm is: ; Where S represents the decryption key, represents the data volume of the nth data packet, An represents the data volume of the complete data packet, x1 and x2 are the missing data packet numbers, and y1 and y2 are the adjacent data packet number pairs corresponding to the missing data packet numbers; Decrypting the encrypted data packet based on the decryption key to obtain a decrypted data packet, and merging the decrypted data packet with the data to be transmitted according to the missing data packet number to form a complete data packet; The complete data packet is format converted to form the multimodal data.

9. A photovoltaic power station operation and maintenance system based on multimodal data fusion, characterized in that: The photovoltaic power station operation and maintenance system based on multimodal data fusion includes: a memory, a processor, a communication bus, and a control program stored in the memory: The communication bus is used to realize the connection and communication between the processor and the memory; The processor is used to execute the control program to implement the steps of the photovoltaic power station operation and maintenance method based on multimodal data fusion as described in any one of claims 1-8.

10. A medium, characterized in that The medium is a readable storage medium, and a control program is stored on the readable storage medium. When the control program is executed by the processor, the steps of the photovoltaic power station operation and maintenance method based on multimodal data fusion as described in any one of claims 1 to 8 are implemented.

Citation Information

Patent Citations

  • Distributed photovoltaic power station remote online intelligent monitoring platform

    CN114915029A

  • Island photovoltaic operation and maintenance fault reason analysis method and system based on multi-modal data

    CN117520924A

  • Photovoltaic station operation and maintenance safety comprehensive management and control method and system

    CN118763801A

  • Multi-modal deep learning power generation device anomaly integrated identification method and device

    WO2023087525A1