Photovoltaic module tightness detection method and device

Abstract

The application provides a photovoltaic module fastening detection method and device, and relates to the technical field of image processing. The method comprises the following steps: knocking a photovoltaic module string based on a preset impact signal, obtaining initial video data of the photovoltaic module string under the impact signal, and the photovoltaic module string comprising a plurality of photovoltaic modules; correcting the initial video data to obtain target video data; performing modal analysis on the target video data to obtain a vibration signal of any photovoltaic module; and obtaining a fastening level of any photovoltaic module according to the vibration signal of any photovoltaic module. The embodiment of the application can improve the efficiency of photovoltaic module fastening detection, reduce detection cost, avoid waste of human resources caused by manual detection, reduce waste of hardware resources caused by installation of a large number of vibration data acquisition devices, collect video data at a fixed time point in an active manner for analysis and processing, reduce the amount of data processing, and improve the data processing efficiency.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of image processing, in particular to a photovoltaic module fastening detection method and device. BACKGROUND

[0002] The fastening of photovoltaic modules in a photovoltaic power station is very important for monitoring the safety of the photovoltaic power station. Since the fastening methods of photovoltaic module bolts are different, and the torque is not enough during construction or long-term vibration, the photovoltaic modules may be loose, which brings safety hazards to the photovoltaic power station. In related technologies, photovoltaic module fastening detection is mainly manual detection, which has low detection efficiency and high cost. Adding a vibration data acquisition instrument to each photovoltaic module also increases the data acquisition cost. Therefore, how to improve the efficiency of photovoltaic module fastening detection and reduce the detection cost has become one of the important research directions.

[0003] At the same time, big data computing is a high-energy-consuming operation, and reducing the energy consumption of component intelligent detection is also an important topic of intelligent photovoltaic research.

[0004] Method content

[0005] The present application aims to at least solve one of the technical problems in the related art. To this end, one object of the present application is to provide a photovoltaic module fastening detection method.

[0006] A second object of the present application is to provide a photovoltaic module fastening detection device.

[0007] A third object of the present application is to provide an electronic device.

[0008] A fourth object of the present application is to provide a non-transitory computer-readable storage medium.

[0009] A fifth object of the present application is to provide a computer program product.

[0010] To achieve the above objects, an embodiment of the first aspect of the present application provides a photovoltaic module fastening detection method, comprising:

[0011] Knocking the photovoltaic module string based on a preset impact signal to obtain initial video data of the photovoltaic module string under the impact signal, the photovoltaic module string comprising a plurality of photovoltaic modules;

[0012] Correcting the initial video data to obtain target video data;

[0013] Performing modal analysis on the target video data to obtain a vibration signal of any photovoltaic module;

[0014] According to the vibration signal of any photovoltaic module, the fastening level of any photovoltaic module is obtained.

[0015] In some implementations, the knocking on the photovoltaic string based on the preset impact signal comprises:

[0016] Obtaining the terrain information of the area where the photovoltaic string is located and the first position information of the photovoltaic string;

[0017] Sending the terrain information and the first position information to the ultrasonic vibration robot, calling the ultrasonic vibration robot to travel to the target position corresponding to the photovoltaic string based on the terrain information and the first position information, and knocking on the photovoltaic string based on the preset impact signal.

[0018] In some implementations, the initial video data of the photovoltaic string under the impact signal is obtained, comprising:

[0019] Obtaining the second position information of the ultrasonic vibration robot and the angle information of the photovoltaic string and the ground plane;

[0020] Obtaining the video data collection angle and the number of objectives based on the terrain information and the angle information;

[0021] Determining the video data collection position based on the second position information;

[0022] Based on the video data collection position, the video data collection angle and the number of objectives, the initial video data of the photovoltaic string under the impact signal is obtained at a preset time point.

[0023] In some implementations, the modal analysis is performed on the target video data to obtain the oscillation signal of any photovoltaic component, comprising:

[0024] Performing multi-layer decomposition and texture analysis on any frame of the to-be-processed image in the target video data to obtain the oscillation signal of each pixel point in any frame of the to-be-processed image;

[0025] Obtaining the oscillation signal of any photovoltaic component according to the oscillation signal of each pixel point in any frame of the to-be-processed image.

[0026] In some implementations, the oscillation signal of the i-th photovoltaic component in the to-be-processed image is obtained according to the oscillation signal of each pixel point in any frame of the to-be-processed image, comprising:

[0027] Identifying each pixel point to obtain the confidence of each pixel point belonging to the i-th photovoltaic component in the target video data;

[0028] According to the confidence of each pixel point belonging to the i-th photovoltaic component in the target video data, the oscillation signal of each pixel point is weighted to obtain the oscillation signal of any photovoltaic component.

[0029] In some implementations, after obtaining the oscillation signal of each pixel point in any frame of the to-be-processed image, further comprising:

[0030] Filter the oscillation signal of each pixel point in any frame of the to-be-processed image, to obtain the filtered oscillation signal of each pixel point in any frame of the to-be-processed image.

[0031] In some implementations, the fastening level of any photovoltaic module is obtained according to the oscillation signal of the photovoltaic module, including:

[0032] The target amplitude and the target vibration frequency of any photovoltaic module are obtained according to the oscillation signal of the photovoltaic module.

[0033] The fastening level of any photovoltaic module is obtained according to the target amplitude and the target vibration frequency.

[0034] In some implementations, after the fastening level of any photovoltaic module is obtained according to the oscillation signal of the photovoltaic module, the method further includes:

[0035] The position information of the target photovoltaic module at the preset fastening level is obtained according to the image positioning tracking algorithm.

[0036] The target photovoltaic module corresponding to the identification and the position information is alarmed and prompted.

[0037] In some implementations, the initial video data is corrected to obtain target video data, including:

[0038] The wind speed information of the target area where the photovoltaic string is located is obtained.

[0039] The initial video data is corrected according to the wind speed information to obtain the target video data.

[0040] In some implementations, the initial video data is collected by a multi-view multi-angle camera, and the method further includes:

[0041] The topographic information of the target area is obtained.

[0042] The number of views and the angle of view of the multi-view multi-angle camera are confirmed according to the topographic information.

[0043] The embodiments of the present application can improve the efficiency of photovoltaic module fastening detection, reduce the detection cost, avoid the waste of human resources caused by manual detection, and also reduce the waste of hardware resources caused by the installation of a large number of vibration data collection devices.

[0044] To achieve the above purpose, a second aspect of the present application provides a photovoltaic module fastening detection device, including:

[0045] The collection module is configured to knock the photovoltaic string based on a preset impact signal, and obtain initial video data of the photovoltaic string under the impact signal, the photovoltaic string including a plurality of photovoltaic modules.

[0046] The correction module is configured to correct the initial video data to obtain target video data.

[0047] The analysis module is configured to perform modal analysis on the target video data to obtain the oscillation signal of any photovoltaic module.

[0048] The acquisition module is configured to obtain the fastening level of any photovoltaic module according to the oscillation signal of any photovoltaic module.

[0049] In some implementations, the acquisition module is further configured to obtain terrain information of an area where the photovoltaic string is located and first position information of the photovoltaic string.

[0050] The terrain information and the first position information are sent to the ultrasonic vibration robot, and the ultrasonic vibration robot is called to travel to a target position corresponding to the photovoltaic string based on the terrain information and the first position information, and the photovoltaic string is tapped based on the preset impact signal.

[0051] In some implementations, the acquisition module is further configured to obtain second position information of the ultrasonic vibration robot and angle information of the photovoltaic string and the ground.

[0052] The video data acquisition angle and the number of objectives are obtained based on the terrain information and the angle information.

[0053] The video data acquisition position is determined based on the second position information.

[0054] The initial video data of the photovoltaic string under the impact signal is obtained at a preset time point based on the video data acquisition position, the video data acquisition angle, and the number of objectives.

[0055] In some implementations, the analysis module is further configured to:

[0056] The oscillation signal of each pixel point in any frame of the to-be-processed image in the target video data is obtained through multi-layer decomposition and texture analysis.

[0057] The oscillation signal of any photovoltaic module is obtained according to the oscillation signal of each pixel point in any frame of the to-be-processed image.

[0058] In some implementations, the analysis module is further configured to:

[0059] Each pixel point is identified to obtain a confidence degree of each pixel point belonging to the i-th photovoltaic module in the target video data.

[0060] The oscillation signal of each pixel point is weighted according to the confidence degree of each pixel point belonging to the i-th photovoltaic module in the target video data to obtain the oscillation signal of any photovoltaic module.

[0061] In some implementations, the analysis module is further configured to:

[0062] Filter the oscillation signal of each pixel point in any frame of the image to be processed to obtain the filtered oscillation signal of each pixel point in any frame of the image to be processed.

[0063] In some implementations, the obtaining module is further configured to:

[0064] According to the oscillation signal of any photovoltaic module, a target amplitude and a target vibration frequency of the photovoltaic module are obtained.

[0065] According to the target amplitude and the target vibration frequency, a fastening level of the photovoltaic module is obtained.

[0066] In some implementations, the photovoltaic module fastening detection device further includes an alarm module configured to:

[0067] According to an image positioning tracking algorithm, position information of the target photovoltaic module at the preset fastening level is obtained.

[0068] According to the identification and the position information corresponding to the target photovoltaic module, an alarm prompt is performed.

[0069] In some implementations, the correction module is further configured to:

[0070] Obtain wind speed information of a target area where the photovoltaic string is located.

[0071] According to the wind speed information, the initial video data is corrected to obtain target video data.

[0072] In some implementations, the initial video data is collected by a multi-view multi-angle camera, and the collecting module is further configured to:

[0073] Obtain terrain information of the target area.

[0074] According to the terrain information, the number of views and the viewing angles of the multi-view multi-angle camera are determined.

[0075] To achieve the above purpose, a third aspect of the present application provides an electronic device, comprising:

[0076] at least one processor; and

[0077] a memory in communication with the at least one processor; wherein

[0078] The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the photovoltaic module fastening detection method provided in the first aspect of the present application.

[0079] To achieve the above object, the fourth aspect of the present application provides a computer readable storage medium, which stores computer instructions, wherein the computer instructions are used to make a computer execute the photovoltaic module fastening detection method provided in the first aspect of the present application.

[0080] To achieve the above object, the fifth aspect of the present application provides a computer program product, which comprises a computer program, and the computer program is used to implement the photovoltaic module fastening detection method provided in the first aspect of the present application when executed by a processor. BRIEF DESCRIPTION OF DRAWINGS

[0081] Figure 1 is a flow chart of the photovoltaic module fastening detection method of one embodiment of the present application;

[0082] Figure 2 is a schematic diagram of the photovoltaic module fastening detection method of one embodiment of the present application;

[0083] Figure 3 is a schematic diagram of the oscillation signal of a pixel point of one embodiment of the present application;

[0084] Figure 4 is a flow chart of the photovoltaic module fastening detection method of one embodiment of the present application;

[0085] Figure 5 is a flow chart of the photovoltaic module fastening detection method of one embodiment of the present application;

[0086] Figure 6 is a flow chart of the photovoltaic module fastening detection method of one embodiment of the present application;

[0087] Figure 7 is a structural block diagram of the photovoltaic module fastening detection device of one embodiment of the present application;

[0088] Figure 8 is a structural schematic diagram of the electronic device of one embodiment of the present application. DETAILED DESCRIPTION

[0089] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the drawings, wherein the same or similar notations represent the same or similar elements or elements with the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary and are intended to explain the present application, and cannot be understood as a limitation of the present application.

[0090] The robot driving method and device of the embodiments of the present application are described below in combination with the drawings.

[0091] Figure 1 is a flow chart of the photovoltaic module fastening detection method of one embodiment of the present application,Figure 1 As shown, the method comprises the following steps:

[0092] S101, knocking the photovoltaic string based on a preset impact signal to obtain initial video data of the photovoltaic string under the impact signal, the photovoltaic string comprising a plurality of photovoltaic components.

[0093] In some implementations, the photovoltaic string is knocked in a manner of knocking based on the knocking point position on the photovoltaic string and the preset impact signal, that is, the knocking point position of the photovoltaic string is knocked with force based on the preset impact signal. If the fastening of the photovoltaic component is good, the photovoltaic component under the impact signal will not vibrate or have a small vibration amplitude. If the fastening of the photovoltaic component does not meet the standard, the photovoltaic component under the impact signal will vibrate and have a large vibration amplitude.

[0094] In some implementations, the initial video data of the photovoltaic string under the impact signal is collected by a video collection device arranged at the photovoltaic power station, as shown in Figure 2 As shown, for example, the video collection device comprises a support and a multi-view camera, and the photovoltaic string of the photovoltaic power station comprises a plurality of preset photovoltaic components. In the embodiment of the application, the photovoltaic component is a photovoltaic cell panel, that is, the video data of the photovoltaic string under the impact signal can be collected by the multi-view camera in sequence as the initial video data.

[0095] In some implementations, in order to improve efficiency, an ultrasonic robot can also be called to collect the initial video data of the photovoltaic string under the impact signal.

[0096] S102, correcting the initial video data to obtain target video data.

[0097] In some implementations, the video collection device will vibrate, for example, under the influence of wind force. Such vibration will affect the accuracy of the initial video data. Such vibration is periodic. Since the initial video data is composed of multiple images, the initial video data can be corrected based on the periodic vibration of the video data to obtain the target video data.

[0098] S103, performing modal analysis on the target video data to obtain a vibration signal of any photovoltaic component.

[0099] Modal analysis is a method for studying the dynamic characteristics of a structure and is generally applied in the field of engineering vibration. A mode refers to the inherent vibration characteristics of a mechanical structure, and each mode has a specific natural frequency and amplitude. The process of analyzing these modal parameters is called modal analysis.

[0100] In the embodiment of the application, the photovoltaic component will vibrate at a fixed frequency after loosening. The vibration signal can reflect the frequency and amplitude of the vibration of the photovoltaic component over time.

[0101] In the embodiment of the present application, the target video data includes multiple frames of to-be-processed images. The modal analysis on the target video data can obtain the coordinates of each pixel point in the photovoltaic module in the to-be-processed images, and then the oscillation signal of each pixel point in the photovoltaic module is obtained through the coordinates of each pixel point in the multiple frames of to-be-processed images, as shown in the formula (1). Figure 3 The oscillation signal of each pixel point in the photovoltaic module is used to obtain the oscillation signal of the photovoltaic module, which is convenient for obtaining the inherent vibration characteristics of the photovoltaic panel according to the oscillation signal of the photovoltaic module and judging the fastening of the photovoltaic module.

[0102] In S104, the fastening level of any photovoltaic module is obtained according to the oscillation signal of any photovoltaic module.

[0103] In the embodiment of the present application, the oscillation signal can reflect the frequency and amplitude of the vibration of the photovoltaic module over time, and then the fastening level of any photovoltaic module is obtained according to the frequency and amplitude of the vibration of the photovoltaic module over time.

[0104] In the embodiment of the present application, the fastening of the photovoltaic module is mainly reflected in the amplitude of the photovoltaic module, that is, the amplitude of the photovoltaic module is the primary factor affecting the fastening. The greater the amplitude, the worse the fastening of the photovoltaic module, so the fastening level of the photovoltaic module can be confirmed according to the amplitude of the photovoltaic module, thereby reflecting the fastening of the photovoltaic module.

[0105] In some implementations, the vibration frequency of the photovoltaic module is a secondary factor affecting the fastening. The vibration frequency of the photovoltaic module also affects the fastening of the photovoltaic module. The greater the vibration frequency, the worse the fastening of the photovoltaic module, thereby causing a safety hazard. Therefore, the amplitude and vibration frequency of any photovoltaic module can be obtained according to the oscillation signal of any photovoltaic module, and then the fastening level of any photovoltaic module is obtained through the preset weight of the amplitude and vibration frequency.

[0106] In the embodiment of the present application, the photovoltaic string is tapped based on a preset impact signal to obtain initial video data of the photovoltaic string under the impact signal, the photovoltaic string includes multiple photovoltaic modules; the initial video data is corrected to obtain target video data; the modal analysis is performed on the target video data to obtain the oscillation signal of any photovoltaic module; and the fastening level of any photovoltaic module is obtained according to the oscillation signal of any photovoltaic module. The embodiment of the present application can improve the efficiency of photovoltaic module fastening detection, reduce detection cost, avoid waste of human resources caused by manual detection, reduce waste of hardware resources caused by installation of a large number of vibration data acquisition devices, and reduce energy consumption of intelligent detection.

[0107] In some implementations, wind speed information of a target area where the photovoltaic string is located is acquired, and the initial video data is corrected according to the wind speed information to obtain target video data. That is, the periodic vibration information of the initial video data can be predicted through the wind speed information, and since the initial video data is composed of multiple images, the compensation amount of each image is further predicted based on the periodic vibration information of the video data, the initial video data is corrected according to the compensation amount, and the target video data is obtained.

[0108] Figure 4 FIG. 1 is a flowchart of a photovoltaic module fastening detection method according to an embodiment of the present application, as shown in the figure, the method comprises the following steps: Figure 1

[0109] S401, terrain information of an area where a photovoltaic string is located and first position information of the photovoltaic string are acquired.

[0110] In some implementations, the initial video data is acquired by a multi-view camera, terrain information of a target area where the photovoltaic string is located can be acquired, and the number of views and the angle of view of the multi-view camera are determined according to the terrain information. Alternatively, the terrain information can include the slope of the target area and the distance between the target area and the multi-view camera, and the number of views and the angle of view of the multi-view camera suitable for the initial video data are determined according to the slope and the distance between the target area and the multi-view camera and the height of the support, so as to increase the clarity of the initial video data.

[0111] S402, the terrain information and the first position information are sent to the ultrasonic vibration robot, and the ultrasonic vibration robot is called to drive to a target position corresponding to the photovoltaic string based on the terrain information and the first position information, and the photovoltaic string is tapped based on a preset impact signal.

[0112] In the embodiment of the present application, the terrain information of the photovoltaic string in the photovoltaic power station and the first position information of the photovoltaic string are input to the ultrasonic vibration robot, and the ultrasonic vibration robot drives to a target position corresponding to the photovoltaic string based on the first position information and the terrain information, and taps the photovoltaic string.

[0113] Alternatively, for each photovoltaic string, the ultrasonic vibration robot taps the photovoltaic string within a preset time threshold based on a preset impact signal. Alternatively, the preset time threshold is in the range of 5-30s.

[0114] S403, initial video data of the photovoltaic string under the impact signal is acquired.

[0115] ​In some implementations, the unmanned aerial vehicle can be equipped with a multi-view multi-angle camera to obtain initial video data of the photovoltaic string under the impact signal. First, the second position information of the ultrasonic vibration robot is obtained, that is, the position of the unmanned aerial vehicle and the ultrasonic vibration robot is shared, and the video data acquisition position of the unmanned aerial vehicle is determined based on the second position information. Further, the angle information of the photovoltaic string and the ground plane is obtained, and the video data acquisition angle and the number of views are obtained based on the terrain information and the angle information. It should be noted that the video data acquisition angle depends not only on the multi-view multi-angle camera deployed on the unmanned aerial vehicle, but also on the flight angle of the unmanned aerial vehicle. The unmanned aerial vehicle hovers in the air based on the video data acquisition position, the video data acquisition angle and the number of views, and obtains the initial video data of the photovoltaic string under the impact signal at a preset time point, thereby increasing the flexibility of data acquisition, and positioning the photovoltaic string position while collecting data, reducing the data processing amount.

[0116] In the embodiments of the present application, the position of the unmanned aerial vehicle and the ultrasonic vibration robot is shared, and single component positioning and calculation are performed for each photovoltaic string. In this way, the data processing amount is greatly reduced, and the accuracy of data processing is increased.

[0117] S404, correcting the initial video data to obtain target video data.

[0118] For the introduction of step S404, please refer to the related content in the above embodiments, which will not be repeated here.

[0119] S405, performing multi-layer decomposition and texture analysis on any frame of the target video data to obtain the vibration signal of each pixel point in any frame of the target video data.

[0120] Optionally, a plurality of frames of the target video data can be obtained, and the plurality of frames of the target video data can be respectively subjected to multi-layer decomposition to obtain the coordinates of each pixel point in the plurality of frames of the target video data. Then, the plurality of frames of the target video data can be respectively subjected to texture analysis to extract texture feature parameters, and then the change of each pixel point in the plurality of frames of the target video data can be located through the texture feature parameters, so as to obtain the vibration signal of each pixel point in any frame of the target video data.

[0121] In the embodiments of the present application, after the photovoltaic module is loosened, there will be a fixed frequency of vibration, and the vibration signal can reflect the frequency and amplitude of the vibration of the photovoltaic module over time.

[0122] In some views, in order to improve the accuracy of the fastening detection, the vibration signal of each pixel point in any frame of the target video data can be filtered to obtain the vibration signal of each pixel point in any frame of the target video data after filtering.

[0123] S406, obtain the oscillation signal of any photovoltaic module according to the oscillation signal of each pixel point in any frame of to-be-processed image.

[0124] In the embodiment of the application, the i th photovoltaic module in the to-be-processed image is taken as an example for description, each pixel point is identified, and the confidence of each pixel point belonging to the i th photovoltaic module in the target video data is obtained. The oscillation signal of each pixel point is weighted according to the confidence of each pixel point belonging to the i th photovoltaic module in the target video data, and the oscillation signal of any photovoltaic module is obtained. Alternatively, each pixel point can be identified by a neural network to obtain the confidence of each pixel point belonging to the i th photovoltaic module in the target video data, for example, a convolutional neural network or the like. In some implementations, the pixel points belonging to the i th photovoltaic module can also be obtained by semantic segmentation or edge detection, and then the oscillation signals of the pixel points belonging to the i th photovoltaic module are averaged to obtain the oscillation signal of any photovoltaic module.

[0125] S407, obtain the fastening level of any photovoltaic module according to the oscillation signal of any photovoltaic module.

[0126] For the description of step S407, reference can be made to the related content in the above embodiments, which will not be described here again.

[0127] In the embodiment of the application, any frame of to-be-processed image in the target video data is subjected to multi-layer decomposition and texture analysis, the oscillation signal of each pixel point in any frame of to-be-processed image is obtained, the oscillation signal of any photovoltaic module is obtained according to the oscillation signal of each pixel point in any frame of to-be-processed image, and the fastening level of any photovoltaic module is obtained according to the oscillation signal of any photovoltaic module. The embodiment of the application can improve the efficiency and accuracy of photovoltaic module fastening detection, avoid the waste of human resources caused by manual detection, and reduce the waste of human resources and hardware resources. In an active manner, video data is collected at a fixed time point for analysis and processing, the data processing amount is reduced, and the data processing efficiency is improved.

[0128] Figure 5 is a flowchart of a photovoltaic module fastening detection method according to an embodiment of the application, as shown in Figure 5 The method comprises the following steps:

[0129] S501, knock the photovoltaic module string based on a preset impact signal, obtain the initial video data of the photovoltaic module string under the impact signal, and the photovoltaic module string comprises a plurality of photovoltaic modules.

[0130] S502, correct the initial video data to obtain target video data.

[0131] S503, perform modal analysis on the target video data to obtain the oscillation signal of any photovoltaic module.

[0132] The description of steps S501-S503 can refer to the related content in the above embodiments, which will not be repeated here.

[0133] S504, obtaining the target amplitude and the target vibration frequency of any photovoltaic module according to the oscillation signal of the photovoltaic module.

[0134] The amplitude and the vibration frequency of the oscillation signal are obtained by signal processing the oscillation signal of any photovoltaic module as the target amplitude and the target vibration frequency of any photovoltaic module.

[0135] S505, obtaining the fastening level of any photovoltaic module according to the target amplitude and the target vibration frequency.

[0136] In the embodiments of the present application, the amplitude of the photovoltaic module is the primary factor affecting the fastening, and the vibration frequency of the photovoltaic module is the secondary factor affecting the fastening. The mapping relationship between the fastening of the photovoltaic module and the amplitude and the vibration frequency of the photovoltaic module can be preset, and then the target amplitude and the target vibration frequency of any photovoltaic module are obtained through the mapping relationship to correspond to the fastening level.

[0137] In the embodiments of the present application, the target amplitude and the target vibration frequency of any photovoltaic module are obtained according to the oscillation signal of the photovoltaic module, and the fastening level of any photovoltaic module is obtained according to the target amplitude and the target vibration frequency. The embodiments of the present application can improve the efficiency of photovoltaic module fastening detection, reduce the detection cost, avoid the waste of human resources caused by manual detection, and also reduce the waste of hardware resources caused by the installation of a large number of vibration data acquisition devices. In an active way, video data is collected at a fixed time point for analysis and processing, which reduces the data processing amount, improves the data processing efficiency, and also reduces the energy consumption of intelligent detection.

[0138] Figure 6 is a flowchart of a photovoltaic module fastening detection method according to an embodiment of the present application, as shown in the figure, the method comprises the following steps: Figure 6

[0139] S601, knocking the photovoltaic module string based on a preset impact signal, obtaining the initial video data of the photovoltaic module string under the impact signal, and the photovoltaic module string comprises a plurality of photovoltaic modules.

[0140] S602, correcting the initial video data to obtain target video data.

[0141] S603, performing modal analysis on the target video data to obtain the oscillation signal of any photovoltaic module.

[0142] S604, obtaining the fastening level of any photovoltaic module according to the oscillation signal of the photovoltaic module. ​

[0143] The steps S601-S604 can refer to the related content in the above embodiments, and details are not described herein.

[0144] S605, acquiring position information of the target photovoltaic module at the preset fastening level according to an image positioning tracking algorithm.

[0145] In the embodiments of the present application, the position of each photovoltaic module can be acquired by using the Beidou satellite navigation system, and then the target photovoltaic module at the preset fastening level is acquired, and the position information of the target photovoltaic module is located by using the image positioning tracking algorithm.

[0146] Optionally, in the embodiments of the present application, the image positioning tracking algorithm can be a target tracking algorithm (Accurate Scale Estimation for Robust Visual Tracking, DSST) or a tracking algorithm (Kernelized Correlation Filters, KCF), or a combination of the two.

[0147] S606, alarming and prompting according to the identification and position information corresponding to the target photovoltaic module.

[0148] In order to eliminate safety hazards, after detecting the target photovoltaic module at the preset fastening level, light alarm prompting or voice alarm prompting can be performed based on the identification and / or position information corresponding to the target photovoltaic module, so as to reduce the safety hazards of the photovoltaic power station.

[0149] In the embodiments of the present application, the position information of the target photovoltaic module at the preset fastening level is acquired according to the image positioning tracking algorithm, and the identification and position information corresponding to the target photovoltaic module are used for alarming and prompting. The embodiments of the present application can improve the efficiency of photovoltaic module fastening detection, reduce the detection cost, avoid the waste of human resources caused by manual detection, and also reduce the waste of hardware resources caused by the installation of a large number of vibration data acquisition devices, improve the safety of the photovoltaic power station, and improve the data processing efficiency.

[0150] As shown in FIG. 7, based on the same application concept, the embodiments of the present application also provide a photovoltaic module fastening detection device 700, which comprises: Figure 7 The acquisition module 710 is configured to knock the photovoltaic module string based on a preset impact signal, and acquire initial video data of the photovoltaic module string under the impact signal, wherein the photovoltaic module string comprises a plurality of photovoltaic modules.

[0151] The correction module 720 is configured to correct the initial video data to acquire target video data.

[0152]

[0153] ​The analysis module 730 is configured to perform modal analysis on the target video data to obtain the vibration signal of any photovoltaic module.

[0154] The acquisition module 740 is configured to obtain the fastening level of any photovoltaic module according to the vibration signal of the photovoltaic module.

[0155] In some implementations, the collection module is further configured to: obtain terrain information of an area where the photovoltaic string is located and first position information of the photovoltaic string.

[0156] The terrain information and the first position information are sent to the ultrasonic vibration robot, and the ultrasonic vibration robot is called to travel to a target position corresponding to the photovoltaic string based on the terrain information and the first position information, and the photovoltaic string is tapped based on a preset impact signal.

[0157] In some implementations, the collection module is further configured to: obtain second position information of the ultrasonic vibration robot and angle information of the photovoltaic string and a ground plane.

[0158] The video data collection angle and the number of objectives are obtained based on the terrain information and the angle information.

[0159] The video data collection position is determined based on the second position information.

[0160] The initial video data of the photovoltaic string under the impact signal is obtained at a preset time point based on the video data collection position, the video data collection angle, and the number of objectives.

[0161] In some implementations, the analysis module 730 is further configured to:

[0162] Any frame of to-be-processed image in the target video data is subjected to multi-layer decomposition and texture analysis to obtain the vibration signal of each pixel point in any frame of to-be-processed image.

[0163] The vibration signal of any photovoltaic module is obtained according to the vibration signal of each pixel point in any frame of to-be-processed image.

[0164] In some implementations, the analysis module 730 is further configured to:

[0165] Each pixel point is identified to obtain a confidence degree of each pixel point belonging to the i th photovoltaic module in the target video data.

[0166] The vibration signal of each pixel point is weighted according to the confidence degree of each pixel point belonging to the i th photovoltaic module in the target video data to obtain the vibration signal of any photovoltaic module.

[0167] In some implementations, the analysis module 730 is further configured to:

[0168] Filter the oscillation signal of each pixel point in any frame of the to-be-processed image, to obtain the filtered oscillation signal of each pixel point in any frame of the to-be-processed image.

[0169] In some implementations, the obtaining module 740 is further configured to:

[0170] According to the oscillation signal of any photovoltaic module, obtain a target amplitude and a target vibration frequency of the photovoltaic module.

[0171] According to the target amplitude and the target vibration frequency, obtain a fastening level of the photovoltaic module.

[0172] In some implementations, the photovoltaic module fastening detection apparatus 700 further includes an alarm module 750 configured to:

[0173] According to an image positioning tracking algorithm, obtain position information of a target photovoltaic module at a preset fastening level.

[0174] According to the identification and the position information corresponding to the target photovoltaic module, perform alarm prompting.

[0175] In some implementations, the correcting module 720 is further configured to:

[0176] Obtain wind speed information of a target area where the photovoltaic module string is located.

[0177] According to the wind speed information, correct the initial video data to obtain target video data.

[0178] In some implementations, the initial video data is collected by the multi-view multi-angle camera, and the collecting module 710 is further configured to:

[0179] Obtain terrain information of the target area.

[0180] According to the terrain information, determine the number of views and the angle of view of the multi-view multi-angle camera.

[0181] The embodiments of the present application can improve the efficiency of photovoltaic module fastening detection, reduce detection cost, avoid waste of human resources caused by manual detection, also reduce waste of hardware resources caused by installation of a large number of vibration data collection devices, improve data processing efficiency, and also reduce energy consumption of intelligent detection.

[0182] Based on the same application concept, the embodiments of the present application also provide an electronic device.

[0183] Figure 8 The structural schematic diagram of the electronic device provided by the embodiments of the present application is shown in FIG. 8. Figure 8As shown, the electronic device 800 includes a memory 810, a processor 820, and a computer program product stored in the memory 810 and executable on the processor 820, and the processor implements the photovoltaic module fastening detection method described above when executing the computer program.

[0184] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROMs, optical storage, etc.) containing computer-usable program code.

[0185] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of flows and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing apparatus to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing apparatus generate a means for implementing the functions specified in the flowcharts and / or block diagrams. Figure 1 one or more flows and / or blocks Figure 1 means for carrying out the functions specified in the flowcharts and / or block diagrams.

[0186] These computer program instructions can also be stored in a computer-readable memory that can direct the computer or other programmable data processing apparatus to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including instruction means, which implements the functions specified in the flowcharts and / or block diagrams. Figure 1 one or more flows and / or blocks Figure 1 means for carrying out the functions specified in the flowcharts and / or block diagrams.

[0187] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus, so that a series of operation steps are performed on the computer or other programmable data processing apparatus to produce a computer-implemented process, so that the instructions executed on the computer or other programmable data processing apparatus provide a process for implementing the functions specified in the flowcharts and / or block diagrams. Figure 1 one or more flows and / or blocks Figure 1 Figure 1 means for carrying out the functions specified in the flowcharts and / or block diagrams.

[0188] Based on the same application concept, the embodiment of the present application also provides a computer readable storage medium, which stores computer instructions, wherein the computer instructions are used to make a computer execute the photovoltaic module fastening detection method in the above embodiment.

[0189] Based on the same application concept, the embodiment of the present application also provides a computer program product, which comprises a computer program, and the computer program is used to execute the photovoltaic module fastening detection method in the above embodiment when executed by a processor.

[0190] It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word 'comprising' does not exclude the presence of elements or steps not listed in the claim. The word 'a' or 'an' preceding an element does not exclude the presence of a plurality of such elements. The application can be implemented by means of both hardware and software, and any combination thereof. In the claims, the word 'comprising' does not exclude the presence of other elements or steps than those listed in the claim. The word 'first','second', 'third', etc. does not imply any order. The use of the terms 'first','second', 'third', etc. does not limit the quantity and / or the order of the specific features thereof. These terms are used as labels in this patent application for the purpose of clarifying this application and aiding this expert skilled in the art to understand the application.

[0191] Moreover, the terms "first", "second", etc. are used herein only to describe various tings and do not imply any order or importance of the associated objects. It is to be understood that a tng designated by the "first" or "second" tng can comprise one or more of the tngs. In the description of the application, the meaning of "a plurality" is two or more, unless expressly specified otherwise.

[0192] Although the preferred embodiments of the application have been described, those skilled in the art will be able to make additional changes and modifications thereto without departing from the spirit and scope of the application. Therefore, it is intended that the appended claims be construed to include all such changes and modifications as fall within the scope of the application.

[0193] Obviously, those skilled in the art can make various modifications and variations to the present application without departing from the spirit and scope of the method. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application also intends to include these modifications and variations.

Claims

1. A method for testing the tightness of photovoltaic modules, characterized in that, include: A photovoltaic string is struck based on a preset impact signal to obtain initial video data of the photovoltaic string under the impact signal. The photovoltaic string includes multiple photovoltaic modules. The initial video data is corrected to obtain the target video data; Modal analysis is performed on the target video data to obtain the oscillation signal of the i-th photovoltaic module; The fastening level of the i-th photovoltaic module is obtained based on the oscillation signal of the i-th photovoltaic module; The modal analysis of the target video data to obtain the oscillation signal of the i-th photovoltaic module includes: Perform multi-layer decomposition and texture analysis on any frame of the target video data to obtain the oscillation signal of each pixel in any frame of the target video data; Each pixel is identified to obtain the confidence level that each pixel belongs to the i-th photovoltaic module in the target video data; The oscillation signal of each pixel is weighted according to the confidence level of each pixel belonging to the i-th photovoltaic module in the target video data to obtain the oscillation signal of the i-th photovoltaic module.

2. The method according to claim 1, characterized in that, The step of striking the photovoltaic string based on a preset impact signal includes: Obtain the terrain information of the area where the photovoltaic string is located and the first location information of the photovoltaic string; The terrain information and the first location information are sent to the ultrasonic vibration robot, which then travels to the target location corresponding to the photovoltaic string based on the terrain information and the first location information, and strikes the photovoltaic string based on a preset impact signal.

3. The method according to claim 2, characterized in that, The acquisition of initial video data of the photovoltaic string under the impact signal includes: Obtain the second position information of the ultrasonic vibration robot and the angle information between the photovoltaic string and the ground plane; Based on the terrain information and the angle information, the video data acquisition perspective and number of images are obtained; The video data collection location is determined based on the second location information; Based on the video data acquisition location, the video data acquisition angle, and the number of views, the initial video data of the photovoltaic string under the impact signal is acquired at the preset time point.

4. The method according to claim 1, characterized in that, After obtaining the oscillation signal of each pixel in any frame of the image to be processed, the method further includes: The oscillation signal of each pixel in any frame of the image to be processed is filtered to obtain the filtered oscillation signal of each pixel in any frame of the image to be processed.

5. The method according to claim 1, characterized in that, The step of obtaining the fastening level of the i-th photovoltaic module based on the oscillation signal of the i-th photovoltaic module includes: The target amplitude and target vibration frequency of the i-th photovoltaic module are obtained based on the oscillation signal of the i-th photovoltaic module. The fastening level of the i-th photovoltaic module is obtained based on the target amplitude and the target vibration frequency.

6. The method according to any one of claims 1, 4-5, characterized in that, After obtaining the fastening level of the i-th photovoltaic module based on the oscillation signal of the i-th photovoltaic module, the method further includes: The location information of the target photovoltaic module at the preset fastening level is obtained based on the image positioning and tracking algorithm; An alarm will be triggered based on the identifier corresponding to the target photovoltaic module and the location information.

7. The method according to claim 1, characterized in that, The step of correcting the initial video data to obtain the target video data includes: Obtain wind speed information for the target area where the photovoltaic string is located; The initial video data is corrected based on the wind speed information to obtain the target video data.

8. A device for testing the tightness of photovoltaic modules, characterized in that, include: The acquisition module strikes the photovoltaic string based on a preset impact signal to acquire the initial video data of the photovoltaic string under the impact signal. The photovoltaic string includes multiple photovoltaic modules. The correction module is used to correct the initial video data to obtain the target video data; The analysis module is used to perform modal analysis on the target video data to obtain the oscillation signal of the i-th photovoltaic module; The acquisition module is used to acquire the fastening level of the i-th photovoltaic module based on the oscillation signal of the i-th photovoltaic module; The modal analysis of the target video data to obtain the oscillation signal of the i-th photovoltaic module includes: Perform multi-layer decomposition and texture analysis on any frame of the target video data to obtain the oscillation signal of each pixel in any frame of the target video data; Each pixel is identified to obtain the confidence level that each pixel belongs to the i-th photovoltaic module in the target video data; The oscillation signal of each pixel is weighted according to the confidence level of each pixel belonging to the i-th photovoltaic module in the target video data to obtain the oscillation signal of the i-th photovoltaic module.

Images