Photovoltaic hidden crack detection method, device, equipment and storage medium

Abstract

The present application discloses a method, device, equipment, and storage medium for detecting photovoltaic hidden cracks. The method includes: obtaining the movement direction and movement speed of a hanging rail motion module used to carry a plurality of light sources and a plurality of cameras, generating a stroboscopic control signal and an image acquisition control signal based on the movement direction and movement speed, wherein the stroboscopic control signal includes an illumination start time point and an illumination end time point; controlling each light source to illuminate based on the illumination start time point and the illumination end time point, and controlling each camera to acquire images based on the image acquisition control signal when the light source illuminates the photovoltaic panel to obtain a plurality of photovoltaic images; performing image recognition on each photovoltaic image to obtain a photovoltaic image recognition result, and determining the location of the photovoltaic hidden crack based on the photovoltaic image recognition result. This solution has the characteristics of high detection accuracy, strong adaptability, and high detection efficiency through efficient image acquisition and hidden crack recognition of the photovoltaic panel during the movement of the hanging rail.

Description

Technical Field

[0001] The present application relates to the field of equipment detection technology, and in particular to a photovoltaic hidden crack detection method, device, equipment and storage medium. Background Art

[0002] With the widespread adoption of photovoltaic power generation technology, quality inspection of photovoltaic modules is becoming increasingly important in production and maintenance. PV subcracks, a common but subtle defect, may have little impact on module output performance in the early stages. However, over long-term operation, they can cause power degradation, hotspot effects, and even electrical failures, reducing the overall power generation efficiency and service life of the photovoltaic system. Therefore, efficiently and accurately identifying subcracks in photovoltaic modules has become a technical challenge of concern to the industry.

[0003] Existing photovoltaic crack detection technologies mostly rely on manual visual inspection, infrared thermal imaging, or static electroluminescence imaging. Manual inspection is highly subjective and inefficient, making it difficult to meet the quality control requirements of large-scale production lines. Infrared thermal imaging suffers from issues such as resolution and temperature rise response lag, limiting its applicability. While static electroluminescence imaging offers high detection accuracy, it has strict requirements for light source control, image acquisition synchronization, and the detection environment, and is not suitable for rapid detection of moving components. Summary of the Invention

[0004] The present application provides a method, device, equipment and storage medium for detecting photovoltaic hidden cracks. It can obtain the real-time motion direction and motion speed information of the hanging rail motion module used to carry several light sources and several cameras, and generate a stroboscopic control signal and an image acquisition control signal that match it based on the dynamic parameters, wherein the stroboscopic control signal includes the lighting start time point and the lighting end time point, which is used to accurately control the lighting rhythm of the light source to avoid motion blur and light interference. Driven by the stroboscopic control signal, each light source synchronously illuminates the surface of the photovoltaic component within a specified time period; at the same time, according to the image acquisition control signal, multiple cameras are driven to perform high-frame rate image acquisition to obtain several photovoltaic images covering the target area. After the acquisition is completed, the image recognition algorithm is executed on the image data one by one to extract the surface features of the component and perform defect judgment, thereby realizing the accurate identification and location of photovoltaic hidden cracks. This method significantly improves the image acquisition quality and recognition accuracy through the deep integration of motion control, synchronous lighting and visual recognition. This application integrates multiple strategies such as mechanical motion parameter perception, light source control accuracy improvement, image information integrity assurance and intelligent recognition algorithm collaboration, significantly improving the reliability and efficiency of online detection of photovoltaic modules. It is particularly suitable for automatic screening of hidden cracks and quality traceability in high-speed production line environments, and provides high-precision, high-robustness and engineered technical solutions for scenarios such as intelligent manufacturing, production line quality control and module reliability assessment.

[0005] In a first aspect, the present application provides a photovoltaic hidden crack detection method, comprising:

[0006] Obtaining a movement direction and a movement speed of a rail motion module for carrying a plurality of light sources and a plurality of cameras, and generating a stroboscopic control signal and an image acquisition control signal based on the movement direction and the movement speed, wherein the stroboscopic control signal includes an illumination start time point and an illumination end time point;

[0007] Controlling each of the light sources to perform illumination based on the illumination start time point and the illumination end time point, and controlling each of the cameras to perform image acquisition based on the image acquisition control signal to obtain a plurality of photovoltaic images when the light sources illuminate the photovoltaic panels;

[0008] Perform image recognition on each of the photovoltaic images to obtain photovoltaic image recognition results, and determine the location of the photovoltaic hidden crack based on the photovoltaic image recognition results.

[0009] In a second aspect, the present application provides a photovoltaic hidden crack detection device, comprising:

[0010] a control signal module, configured to obtain a motion direction and a motion speed of a rail motion module for carrying a plurality of light sources and a plurality of cameras, and generate a stroboscopic control signal and an image acquisition control signal based on the motion direction and the motion speed, wherein the stroboscopic control signal includes an illumination start time point and an illumination end time point;

[0011] a photovoltaic image acquisition module, configured to control each of the light sources to perform illumination based on the illumination start time point and the illumination end time point, and to control each of the cameras to perform image acquisition based on the image acquisition control signal to obtain a plurality of photovoltaic images when the light sources illuminate the photovoltaic panels;

[0012] The hidden crack detection module is used to perform image recognition on each of the photovoltaic images to obtain photovoltaic image recognition results, and determine the location of the photovoltaic hidden crack based on the photovoltaic image recognition results.

[0013] In a third aspect, the present application provides a photovoltaic hidden crack detection device, comprising:

[0014] one or more processors;

[0015] The memory stores one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the photovoltaic crack detection method as described in the first aspect.

[0016] In a fourth aspect, the present application provides a storage medium comprising computer-executable instructions, which, when executed by a computer processor, are used to perform the photovoltaic crack detection method as described in the first aspect.

[0017] In this application, a high-precision, high-efficiency integrated strategy for photovoltaic (PV) hidden crack detection is implemented by acquiring real-time motion parameters of the rail-mounted motion module and combining them with a stroboscopic control and image acquisition timing coordination mechanism. The motion direction and speed of the rail-mounted motion module, which carries several light sources and cameras, are acquired in real time. Based on these dynamic parameters, stroboscopic control signals and image acquisition control signals are generated. The stroboscopic control signals define the start and end times of illumination, ensuring that the light sources are precisely illuminated only at critical moments in image acquisition, avoiding image blur or brightness drift caused by asynchronous illumination. Accordingly, during the illumination period, the image acquisition control signals synchronously drive multiple cameras to capture images of the PV modules, forming a sequence of PV images covering the inspection area. Subsequently, an image recognition process is executed frame by frame to extract module surface feature information and accurately determine the presence of hidden cracks. The recognition results serve as the basis for subsequent quality analysis and location annotation, assisting in the refined tracking and traceability management of PV module defects. This method effectively addresses issues such as image jitter, uneven lighting, and image misalignment during the rail-mounted motion of the modules, improving the capture clarity and recognition stability of defect images. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 This is a flow chart of a photovoltaic hidden crack detection method provided in an embodiment of the present application;

[0019] Figure 2 Schematic diagram of the structure of a photovoltaic hidden crack detection device provided in an embodiment of the present application;

[0020] Figure 3 This is a flow chart for determining the light source control time point provided by an embodiment of the present application;

[0021] Figure 4 This is a flow chart of camera acquisition frequency control provided by an embodiment of the present application;

[0022] Figure 5 is a structural diagram of a photovoltaic hidden crack detection device provided in an embodiment of the present application;

[0023] Figure 6 Schematic diagram of the hardware structure of the photovoltaic hidden crack detection device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0024] To further clarify the objectives, technical solutions, and advantages of this application, specific embodiments of this application are described in further detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are intended only to illustrate this application and are not intended to limit it. It should also be noted that, for ease of description, the drawings only illustrate portions relevant to this application, not all of them. Before discussing the exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts depict the operations (or steps) as being performed sequentially, many of the operations can be performed in parallel, concurrently, or simultaneously. Furthermore, the order of the operations can be rearranged. A process may terminate upon completion of its operations, but may also have additional steps not shown in the accompanying drawings. A process may correspond to a method, function, procedure, subroutine, subprogram, and the like.

[0025] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the data used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than those illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects connected before and after are in an "or" relationship.

[0026] With the large-scale deployment of photovoltaic power plants and the increasing demand for module reliability, the need to detect hidden cracks in photovoltaic panels is becoming increasingly urgent. While traditional electroluminescence detection methods offer a certain level of accuracy, they have numerous limitations in practical applications. For example, they require the photovoltaic panels to be disassembled from their mountings before testing, the detection process is limited by low-light conditions at night, and they struggle to meet the demands of rapid large-scale module screening. These limitations severely restrict their widespread application in on-site inspections and operational maintenance.

[0027] In response to the above problems, this application has constructed a rail-mounted photovoltaic hidden crack detection system that supports high-precision and high-efficiency non-contact automatic detection of photovoltaic panels without the need to disassemble the components and without day or night time restrictions. High-quality image acquisition of the component surface is achieved through a rail-mounted motion platform equipped with distributed industrial cameras and near-infrared light sources. The collected images are fused with timestamps and high-precision RTK geographic location information, and are stored while being collected on an external hard drive, and uploaded to the back-end server for AI image recognition and hidden crack annotation, forming an integrated detection closed loop from image acquisition to analysis. In order to ensure image clarity in motion, the infrared light source is used as a key lighting component to provide necessary light intensity compensation during the imaging process. This design makes full use of the reflection characteristics of photovoltaic materials in the near-infrared band to achieve high-contrast imaging of hidden crack details.

[0028] However, due to the high power consumption of the infrared light source itself, in a multi-station parallel detection system, the continuous lighting of the light source will bring about excessive energy consumption and heat load problems, seriously affecting the stability and endurance of the system. To this end, this application proposes a dynamic light source control mechanism based on a light source controller and a serial communication protocol. By real-time monitoring of the speed of the hanging rail motion module and the camera exposure timing, the on and off rhythm of the infrared light source is accurately controlled to form a stroboscopic lighting mechanism that is highly coupled with the shooting window. Under this mechanism, the infrared light source only flashes at the critical moment of image acquisition, thereby significantly reducing the average power consumption and system temperature rise while ensuring image quality. As a key technical means in machine vision systems, light source stroboscopic control is widely used in industrial production lines such as printing, textiles, and steel to achieve clear imaging and precise monitoring in high-speed dynamic processes. In the fields of scientific research and image analysis, stroboscopic control is also commonly used for high-speed phenomenon observation and microscopic motion tracking. Although the stroboscopic mechanism has been maturely applied in the above-mentioned industries, its synergistic mechanism combining track motion, infrared imaging and power consumption control in photovoltaic crack detection is still innovative, especially in achieving dual optimization of imaging quality and power consumption control under motion conditions. This application proposes a more practical system-level solution.

[0029] To address the aforementioned issues, this embodiment provides a method for detecting photovoltaic (PV) cracks. By integrating rail motion control, strobe lighting scheduling, and image recognition, this method forms an integrated intelligent detection process with high timing accuracy and image analysis capabilities. This method first obtains the real-time motion direction and speed of the rail motion module, which carries several light sources and cameras. Based on the motion state, it dynamically generates strobe control signals and image acquisition control signals, and specifies the start and end times of illumination to achieve precise control of the light sources during the critical imaging period. Driven by the strobe signal, each light source illuminates the PV module with high synchronization during specific periods, ensuring stable and uniform illumination of the PV module. Simultaneously, the image acquisition control signal coordinates the industrial cameras to complete image acquisition during the effective illumination period, producing a sequence of PV images with high contrast and clear edge features. Subsequently, image recognition analysis is performed frame by frame on the captured images to extract structural features and abnormal morphology on the module surface. Using a pre-set algorithm, the presence of crack defects is determined and their precise location within the image is precisely calibrated, completing a closed-loop process from image acquisition to crack detection. This method significantly improves image quality and recognition accuracy through the timing linkage of light source control and motion image acquisition, effectively solving problems such as blurred acquisition, unstable lighting, and low detection efficiency of photovoltaic modules in motion. On the basis of image recognition, functional modules such as intelligent labeling, abnormality statistics, and automatic archiving can be further expanded to provide basic data support for back-end quality traceability and intelligent maintenance. This solution has good software and hardware compatibility and deployment flexibility, and is particularly suitable for intelligent inspection tasks of component quality in large-scale photovoltaic power stations, production lines, or intelligent operation and maintenance scenarios. By integrating multiple modules such as track perception, strobe drive, and visual recognition, this method constructs a stable, efficient, and low-interference hidden crack detection system. While ensuring the reliability of detection data, it improves environmental adaptability and engineering practicality, providing a practical technical path for promoting the automation and intelligent upgrade of photovoltaic detection.

[0030] The photovoltaic crack detection method provided in this embodiment can be performed by a photovoltaic crack detection device. The photovoltaic crack detection device can be implemented through software and / or hardware. The photovoltaic crack detection device can be composed of two or more physical entities, or a single physical entity. For example, the photovoltaic crack detection device can be an operation and maintenance server used to maintain normal business operations.

[0031] The photovoltaic crack detection device is installed with at least one operating system, including but not limited to Android, Linux, and Windows. The photovoltaic crack detection device can install at least one application based on the operating system. The application can be native to the operating system or downloaded from a third-party device or server. In this embodiment, the photovoltaic crack detection device has at least one application that can execute the photovoltaic crack detection method.

[0032] For ease of understanding, this embodiment is described by taking an operation and maintenance server as an example of the main body for executing the photovoltaic hidden crack detection method.

[0033] Figure 1 A flow chart of a photovoltaic crack detection method provided by an embodiment of the present application is given. Figure 1 The photovoltaic hidden crack detection method specifically includes:

[0034] S110. Obtain the movement direction and movement speed of a rail motion module for carrying a plurality of light sources and a plurality of cameras, and generate a stroboscopic control signal and an image acquisition control signal based on the movement direction and the movement speed, wherein the stroboscopic control signal includes an illumination start time point and an illumination end time point.

[0035] In some embodiments, the motion direction and speed of a rail-mounted motion module, which supports a plurality of light sources and a plurality of cameras, are first obtained. The rail-mounted motion module refers to a movable structure that moves along a predetermined track to complete image acquisition tasks. The motion direction refers to the direction of the rail-mounted motion module's movement path in space, and the motion speed refers to its displacement per unit time. Subsequently, based on the motion direction and speed, a stroboscopic control signal and an image acquisition control signal are generated. The stroboscopic control signal is used to control the flash timing of the light source, including the illumination start and end times, to achieve high-quality image exposure in accordance with the motion state. The image acquisition control signal is used to trigger the camera to acquire images, ensuring that image frames are captured within a critical time window.

[0036] In one embodiment, the stroboscopic control signal may be generated by dynamically predicting the time interval during which the light source passes through the shooting area according to the motion direction and speed, and setting corresponding start and end lighting moments.

[0037] In one embodiment, the image acquisition control signal may be generated by calculating the optimal image acquisition time point based on the real-time position information and movement trend of the rail-hanging motion module, and synchronously issuing an image acquisition instruction to each camera node.

[0038] Optionally, generating a stroboscopic control signal and an image acquisition control signal based on the motion direction and the motion speed includes:

[0039] When the movement direction is the first movement direction and / or the second movement direction, generating a stroboscopic control signal and an image acquisition control signal based on the movement speed;

[0040] The rail-hanging motion module performs alternating motion in the first motion direction and the second motion direction, the first motion direction and the second motion direction are opposite directions, and the rail-hanging motion module performs intermittent motion in the third motion direction.

[0041] Exemplarily, in the process of generating a stroboscopic control signal and an image acquisition control signal based on the direction of motion and the speed of motion, when the direction of motion is in the first direction of motion and / or the second direction of motion, the stroboscopic control signal and the image acquisition control signal are generated based on the current speed of motion. The first direction of motion and the second direction of motion refer to the reciprocating motion directions of the rail-hanging motion module on the track, which are opposite directions and are used to cover the two-way patrol of the photovoltaic panel; the third direction of motion refers to the interval adjustment of the rail-hanging motion module in a direction perpendicular to the first and second directions, which is used to complete the line-by-line scanning of multiple rows. The stroboscopic control signal includes the lighting start time point and the lighting end time point, which are used to accurately control the timing of turning on the light source; the image acquisition control signal is used to instruct the camera to capture the image at the appropriate time.

[0042] In one embodiment, the method of generating a control signal based on the first or second movement direction can be: detecting the current movement direction identifier and real-time speed data, and calculating the corresponding lighting window and image acquisition time according to preset synchronization rules to adapt to the exposure requirements under different scanning directions.

[0043] In one embodiment, the alternating motion may be controlled by setting a reversing trigger mechanism at both ends of the track so that the rail-hanging motion module automatically switches the motion direction when reaching the travel limit, thereby achieving continuous back-and-forth inspection.

[0044] In one embodiment, the intermittent movement may be: after each reciprocating movement in the first and second directions, the rail motion module is driven to move to the next scanning line in the third direction according to a set step distance to ensure that the entire photovoltaic area is completely covered.

[0045] In one embodiment, referring to Figure 2The hanging rail motion module is set on the photovoltaic panel array and is used to carry the hidden crack detection device for movement. The hidden crack detection device is equipped with 8 infrared light sources and their corresponding 8-channel light source controllers. The hidden crack detection device is also equipped with 4 cameras. Normally, the hidden crack detection device moves in a first direction. After reaching the edge, it moves a certain distance in the third direction and stops. Then it moves in the negative direction of the first direction, that is, it runs in the second direction. After reaching the edge, it moves a certain distance in the third direction and stops. Then it runs in the first direction. It moves in this regular pattern until the entire photovoltaic panel array is detected. The 8-channel light source controller is used to control the strobe of the 8 groups of light sources. The strobe frequency matches the movement speed of the device and the shooting frequency of the camera, and the signal delay time is redundant. When the hidden crack detection device is working in an outdoor environment of 35 degrees, the maximum temperature at the light source is only 40°C, which is nearly 30°C lower than the working state of the constant light source, with significant effect. Specifically, measured data show that under a configuration of 4 workstations and 8 light sources, if strobe control is not used, the average operating current is 7A, the total power consumption is as high as 336W, and the temperature of the hidden crack detection device can rise to 70-80°C; after introducing strobe control, the average current drops to 2A, the power consumption drops to 96W, and the overall energy consumption drops by 71.4%. The temperature of the hidden crack detection device is maintained at room temperature, effectively improving the synergy between the equipment's operating stability and image acquisition performance.

[0046] Optionally, Figure 3 A flow chart of determining the light source control time point provided by an embodiment of the present application is given. Figure 3 The method for determining the light source control time point specifically includes:

[0047] S1101. Generate an image acquisition control signal based on the motion direction and the motion speed, and extract a camera image acquisition time point and a camera shooting time of the image acquisition control signal, where the camera shooting time includes a camera image acquisition time and a camera exposure time.

[0048] For example, a capture control signal is first generated based on the direction of motion and the speed of motion, wherein the direction of motion refers to the direction of movement of the rail-mounted motion module along the track, the speed of motion refers to the distance moved per unit time, and the capture control signal refers to the timing instructions for scheduling the camera's capture action. Subsequently, the camera capture time point and camera capture time in the capture control signal are extracted, wherein the camera capture time point refers to the specific moment when the camera is triggered to capture an image; the camera capture time refers to the time interval required for the entire capture process, including the camera capture time and the camera exposure time. The exposure time refers to the length of time the camera's photosensitive element is in the on state and used for imaging exposure.

[0049] In one embodiment, the image acquisition control signal may be generated by calculating an optimal capture time window adapted to the current speed conditions according to the current position and motion trend of the rail-hanging motion module, and forming a precise control instruction.

[0050] In one embodiment, the method of extracting the camera image acquisition time point may be: parsing the image acquisition control signal to obtain a time mark associated with the camera trigger signal, and using the time mark to drive the camera shutter action.

[0051] In one embodiment, the camera shooting time may be determined by setting specific numerical ranges of the image acquisition time and the exposure time in combination with device parameters to ensure clear imaging and synchronization with the light source illumination timing.

[0052] Optionally, Figure 4 A flow chart of camera acquisition frequency control provided by an embodiment of the present application is given. Figure 4 , the camera acquisition frequency control method specifically includes:

[0053] S11011. Determine the collection distance of the camera images collected by each camera in the movement direction of the hanging rail movement module.

[0054] Exemplarily, the acquisition distance of the camera images captured by each camera in the movement direction of the rail-hanging motion module is first determined, wherein the camera image refers to the photovoltaic image frame acquired by the camera installed on the rail-hanging motion module at a specific acquisition time point, the movement direction refers to the direction of movement of the rail-hanging motion module along the track, and the acquisition distance refers to the displacement of the rail-hanging motion module in the movement direction during the image acquisition process, which is used to characterize the spatial coverage range of each frame image.

[0055] In one embodiment, the method for determining the acquisition distance can be: based on the camera acquisition time point and the camera shooting time, combined with the real-time movement speed of the hanging rail motion module within the time period, calculate the corresponding displacement value to obtain the actual acquisition distance corresponding to the camera image.

[0056] In one embodiment, the motion speed can be obtained by recording the speed information of the rail-hanging motion module in real time through a track encoder, laser ranging, or inertial measurement unit, etc., as a basic parameter for distance calculation.

[0057] In one embodiment, the acquisition distance may be used to provide a spatial alignment basis for subsequent image stitching, hidden crack location, or image region annotation, thereby ensuring that the image processing result has accurate physical reference coordinates.

[0058] S11012. Determine an acquisition frequency of each camera based on the acquisition distance and the movement speed, and generate an image acquisition control signal based on the camera acquisition frequency.

[0059] For example, the acquisition frequency of each camera is first determined based on the acquisition distance and motion speed. The acquisition distance refers to the displacement length covered by the camera in the direction of the rail's motion during each acquisition process; the motion speed refers to the real-time movement rate of the rail's motion module during the image acquisition phase; and the acquisition frequency refers to the number of times the camera performs image acquisition per unit time, which is used to ensure image coverage continuity and spatial sampling consistency. Subsequently, an acquisition control signal is generated based on the determined camera acquisition frequency, which is used to drive the camera to perform image acquisition operations at precise moments.

[0060] In one embodiment, in order to ensure continuous coverage between image frames without overlap or omission at a set motion speed, the camera acquisition frequency can be determined as follows: acquisition frequency = motion speed ÷ acquisition distance

[0061] In one embodiment, the image acquisition control signal may be generated by constructing a periodic trigger signal that matches the calculated acquisition frequency, and accurately scheduling the camera to perform a shooting action at the position where the image should be acquired in each frame.

[0062] In one embodiment, the dynamic adjustment mechanism of the acquisition frequency may be: updating the acquisition frequency in real time according to the change of the motion speed of the rail-hanging motion module, thereby maintaining the consistency of the image sampling density under different operating conditions.

[0063] S1102: Determine a lighting delay time based on the movement direction and the movement speed, where the lighting delay time includes a lighting advance time and a lighting delay time.

[0064] Exemplarily, the lighting delay time is determined based on the direction of motion and the speed of motion, wherein the direction of motion refers to the direction information of the rail-mounted motion module running along the track, and the speed of motion refers to the distance it moves per unit time. The lighting delay time refers to the time parameter used to accurately adjust the timing of the light source lighting up and off to achieve spatiotemporal matching between the illuminated area and the camera capture area; the lighting delay time includes the lighting advance time and the lighting delay time. The lighting advance time refers to the amount of time the light source is turned on in advance before the camera captures the image, which is used to preheat or stabilize the light output; the lighting delay time refers to the time the light source continues to illuminate after the camera captures the image, which is used to ensure complete lighting coverage during the capture process.

[0065] In one embodiment, the lighting delay time can be determined by determining the entry and exit paths of the light source in space based on the current direction of movement, and calculating the time interval before and after the light source reaches the mapping area in combination with the movement speed, so as to dynamically adjust the start and end times of the lighting.

[0066] In one embodiment, the lighting advance time can be set by measuring the response time required for the light source to reach stable brightness from being turned on, and calculating the time when the light source should be started in advance in combination with the moving speed of the hanging rail motion module.

[0067] In one embodiment, the lighting delay time may be set by considering the peripheral light support required after the camera exposure is completed and delaying the light source shutoff timing in combination with the motion trend to avoid insufficient image brightness due to premature shutoff.

[0068] Optionally, determining the lighting delay time based on the movement direction and the movement speed includes:

[0069] An illumination advance time is determined based on the motion direction and the motion speed, and an illumination delay time is determined based on the motion direction, the motion speed, and the camera exposure time.

[0070] For example, in the process of determining the lighting delay time based on the motion direction and speed, the lighting advance time is determined based on the motion direction and speed, and the lighting delay time is determined based on the motion direction, speed, and camera exposure time. The lighting advance time refers to the period of time during which the light source is pre-activated before the camera captures an image, ensuring that the illumination has reached a stable state when the exposure begins; the lighting delay time refers to the period of time during which the light source continues to illuminate after the camera completes the exposure, covering the entire exposure process and preventing insufficient brightness during the capture period.

[0071] In one embodiment, the lighting advance time may be determined by combining the movement speed and the estimated time for the rail motion module to reach the image acquisition area, and calculating the length of time the light source should be started in advance to synchronously enter the effective lighting state.

[0072] In one embodiment, the lighting delay time can be determined by estimating the exposure end time based on the camera exposure time, and then delaying the light source shutdown time in combination with the movement trend and speed of the hanging rail motion module to ensure that the entire exposure interval is continuously covered by light.

[0073] S1103: Calculate the lighting start time point and the lighting end time point according to the camera image acquisition time point, the camera shooting time, and the lighting delay time.

[0074] Exemplarily, the illumination start and end times are calculated based on the camera capture time, camera shooting time, and illumination delay time. The camera capture time refers to the moment the camera is triggered to perform the capture operation, and the camera shooting time includes the period from the capture trigger to the end of exposure. The illumination delay time includes the illumination advance time and the illumination delay time, which is used to compensate for the light source control timing. The illumination start time refers to the time when the light source begins to illuminate, and the illumination end time refers to the time when the light source turns off. Together, these two ensure stable lighting conditions in the image acquisition area throughout the entire capture cycle.

[0075] In one embodiment, the lighting start time point may be calculated by subtracting the lighting advance time from the camera image acquisition time point to obtain the earliest time point at which the light source needs to be turned on.

[0076] In one embodiment, the lighting termination time point may be calculated by summing the camera image acquisition time point and the camera shooting time, and then adding the lighting delay time to obtain the latest time point when the light source should be turned off.

[0077] In one embodiment, the calculation process can be used to generate a precise strobe control signal to drive the light source to provide continuous, stable and synchronized lighting support throughout the entire image acquisition process.

[0078] Optionally, the calculating the lighting start time point and the lighting end time point according to the camera image acquisition time point, the camera shooting time and the lighting delay time includes:

[0079] The control signal response time of the stroboscopic control signal is obtained, and the lighting start time point and the lighting end time point are calculated based on the camera image acquisition time point, the camera shooting time, the lighting delay time and the control signal response time.

[0080] For example, the control signal response time of the strobe control signal is obtained. The control signal response time refers to the system delay required for the light source to actually switch between on and off states after receiving the control signal. Subsequently, the lighting start and end times are calculated based on the camera capture time, camera shooting time, lighting delay time, and control signal response time to compensate for the system response lag and achieve precise synchronization between lighting and image capture.

[0081] In one embodiment, the lighting start time point can be calculated by subtracting the sum of the lighting advance time and the control signal response time from the camera image acquisition time point to schedule the light source to start in advance and ensure stable lighting output before image acquisition begins.

[0082] In one embodiment, the lighting termination time point may be calculated by adding the camera capture time point to the camera shooting time, and then adding the lighting delay time and the control signal response time to delay the scheduling of the light source to turn off, thereby ensuring continuous lighting during the capture process.

[0083] In one embodiment, the control signal response time may be obtained by recording the average delay time from receiving the control command to completing the lighting action based on the light source hardware specification table or through experimental measurement.

[0084] S120, controlling each of the light sources to perform illumination based on the illumination start time point and the illumination end time point, and controlling each of the cameras to perform image acquisition based on the image acquisition control signal to obtain a plurality of photovoltaic images when the light sources illuminate the photovoltaic panels.

[0085] In some embodiments, each light source is first controlled to illuminate based on an illumination start and end time, where the illumination start and end time points indicate the start and end times of the light source, respectively. The light source refers to a controllable lighting device on the rail-mounted motion module that illuminates the photovoltaic panel. Subsequently, while the light source illuminates the photovoltaic panel, each camera is controlled to capture images based on an image acquisition control signal that indicates when the camera initiates image acquisition. The camera refers to an imaging device mounted on the rail-mounted motion module. Ultimately, this image acquisition operation generates a number of photovoltaic images for subsequent detection and analysis.

[0086] In one embodiment, the method of controlling the illumination of the light source may be: driving each light source to turn on and off according to a preset timing parameter to ensure that the illumination area covers the target photovoltaic module.

[0087] In one embodiment, the camera image acquisition is controlled by triggering the camera shutter according to an image acquisition control signal during stable illumination of the light source, so that image acquisition is synchronized with the illumination state to obtain a clear and evenly exposed photovoltaic image.

[0088] Optionally, controlling each of the cameras to acquire images based on the image acquisition control signal to obtain a plurality of photovoltaic images includes:

[0089] The camera exposure time is extracted from the image acquisition control signal, and each of the cameras is controlled to acquire images according to the camera exposure time to obtain a plurality of photovoltaic images.

[0090] For example, the camera exposure time is extracted from the acquisition control signal. Exposure time refers to the duration of time the camera's photosensitive element receives light during each image acquisition process and is a key parameter affecting image brightness and clarity. Subsequently, each camera is controlled to perform acquisition based on the extracted exposure time, thereby acquiring a number of photovoltaic images. Photovoltaic images are image data that characterize the surface condition of photovoltaic panels and are used for defect detection.

[0091] In one embodiment, the camera exposure time may be extracted by parsing a parameter field included in the image acquisition control signal to obtain exposure time information set for each camera.

[0092] In one embodiment, the method of controlling the camera to capture images can be: scheduling the camera shutter action according to the exposure time defined by the image capture control signal, accurately controlling the opening and closing timing of the photosensitive element, and ensuring that the image exposure is sufficient and synchronized with the lighting control.

[0093] S130 , performing image recognition on each of the photovoltaic images to obtain photovoltaic image recognition results, and determining locations of photovoltaic hidden cracks based on the photovoltaic image recognition results.

[0094] In some embodiments, image recognition is first performed on each photovoltaic image. A photovoltaic image refers to image data captured by a camera under specific lighting conditions that reflects the surface condition of a photovoltaic panel. Image recognition refers to the process of extracting image features and classifying defects from photovoltaic images to identify possible structural anomalies. This image recognition process yields photovoltaic image recognition results, which indicate whether cracks, damage, or other structural defects are present in the image. Subsequently, based on the photovoltaic image recognition results, the location of photovoltaic microcracks is determined. The location of the photovoltaic microcrack refers to the spatial coordinates or regional position of the identified microcrack defect in the photovoltaic panel surface image.

[0095] In one embodiment, image recognition may be performed by inputting a photovoltaic image into a trained deep neural network model, such as a convolutional neural network, and performing multi-scale feature extraction and classification on texture and edge information in the image.

[0096] In one embodiment, the location of the photovoltaic hidden crack can be determined by performing image segmentation or region annotation on the identified crack features, and combining the image shooting parameters with the hanging rail position information to infer the specific location of the hidden crack in the physical space of the photovoltaic panel.

[0097] Based on the above embodiments, Figure 5 This is a schematic diagram of the structure of the photovoltaic crack detection device provided in the embodiment of the present application. Figure 5The photovoltaic hidden crack detection device provided in this embodiment specifically includes: a control signal module 21, a photovoltaic image acquisition module 22, and a hidden crack detection module 23.

[0098] Among them, the control signal module 21 is configured to obtain the movement direction and movement speed of the hanging rail motion module for carrying several light sources and several cameras, and generate a stroboscopic control signal and a picture acquisition control signal based on the movement direction and the movement speed, and the stroboscopic control signal includes an illumination start time point and an illumination end time point; the photovoltaic picture acquisition module 22 is configured to control each of the light sources to perform illumination based on the illumination start time point and the illumination end time point, and when the light source irradiates the photovoltaic panel, control each of the cameras to perform picture acquisition based on the picture acquisition control signal to obtain several photovoltaic pictures; the hidden crack detection module 23 is configured to perform image recognition on each of the photovoltaic pictures, obtain a photovoltaic picture recognition result, and determine the location of the photovoltaic hidden crack based on the photovoltaic picture recognition result.

[0099] Based on the above embodiment, the photovoltaic imaging module 22 includes: a photovoltaic imaging module unit, configured to extract the camera exposure time from the imaging control signal, and control each camera to perform imaging according to the camera exposure time to obtain a plurality of photovoltaic images.

[0100] Based on the above embodiment, the control signal module 21 includes: a motion direction unit, configured to generate a stroboscopic control signal and a mapping control signal based on the motion speed when the motion direction is in the first motion direction and / or the second motion direction; wherein the hanging rail motion module performs alternating motion in the first motion direction and the second motion direction, the first motion direction and the second motion direction are in opposite directions, and the hanging rail motion module performs intermittent motion in the third motion direction.

[0101] Based on the above embodiment, the control signal module 21 includes: a picture acquisition time unit, which is configured to generate a picture acquisition control signal based on the movement direction and the movement speed, and extract the camera picture acquisition time point and camera shooting time of the picture acquisition control signal, and the camera shooting time includes the camera picture acquisition time and the camera exposure time; a lighting delay unit, which is configured to determine the lighting delay time based on the movement direction and the movement speed, and the lighting delay time includes the lighting advance time and the lighting delay time; a lighting time unit is configured to calculate the lighting start time point and the lighting end time point according to the camera picture acquisition time point, the camera shooting time and the lighting delay time.

[0102] Based on the above embodiment, the lighting delay unit includes: a lighting delay subunit, configured to determine the lighting advance time based on the movement direction and the movement speed, and determine the lighting delay time based on the movement direction, the movement speed and the camera exposure time.

[0103] Based on the above embodiment, the lighting time unit includes: a lighting time sub-unit, which is configured to obtain the control signal response time of the stroboscopic control signal, and calculate the lighting start time point and the lighting end time point based on the camera image acquisition time point, the camera shooting time, the lighting delay time and the control signal response time.

[0104] Based on the above embodiment, the image acquisition time unit includes: an acquisition distance subunit, which is configured to determine the acquisition distance of the camera image acquired by each camera in the movement direction of the hanging rail motion module; an acquisition frequency subunit, which is configured to determine the acquisition frequency of each camera based on the acquisition distance and the movement speed, and generate an image acquisition control signal based on the camera acquisition frequency.

[0105] The photovoltaic crack detection device provided in the embodiments of this application integrates key modules such as motion sensing, strobe control, image acquisition, and intelligent recognition, creating an intelligent photovoltaic detection processing architecture centered on track parameter drive, image quality assurance, and defect identification and analysis. The device, comprised of multiple functional units, forms a fully automated detection chain from motion data sensing and image acquisition control to crack identification and analysis, significantly improving the accuracy and efficiency of photovoltaic module inspection.

[0106] The photovoltaic crack detection device provided in the embodiment of the present application can be used to execute the photovoltaic crack detection method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0107] Figure 6 This is a schematic diagram of the structure of a photovoltaic crack detection device provided in an embodiment of the present application, with reference to Figure 6 The photovoltaic crack detection device includes: a processor 31, a memory 32, a communication device 33, an input device 34, and an output device 35. The number of processors 31 in the photovoltaic crack detection device can be one or more, and the number of memories 32 in the photovoltaic crack detection device can be one or more. The processor 31, memory 32, communication device 33, input device 34, and output device 35 in the photovoltaic crack detection device can be connected via a bus or other means.

[0108] Memory 32, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as the program instructions / modules corresponding to the photovoltaic crack detection method of any embodiment of the present application (e.g., the control signal module 21, photovoltaic mapping module 22, and crack detection module 23 in the photovoltaic crack detection device). Memory 32 may primarily include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function; the data storage area may store data generated during device use. Memory 32 may also include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state memory device. In some embodiments, the memory may further include memory located remotely from the processor, which can be connected to the device via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0109] The communication device 33 is used for data transmission.

[0110] The processor 31 executes the software programs, instructions and modules stored in the memory 32 to perform various functional applications and data processing of the device, that is, to implement the above-mentioned photovoltaic crack detection method.

[0111] The input device 34 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the device. The output device 35 may include a display device such as a display screen.

[0112] The photovoltaic crack detection device provided above can be used to execute the photovoltaic crack detection method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0113] An embodiment of the present application also provides a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to execute a photovoltaic crack detection method, the photovoltaic crack detection method comprising: obtaining a movement direction and a movement speed of a hanging rail motion module for carrying a plurality of light sources and a plurality of cameras, generating a stroboscopic control signal and a picture acquisition control signal based on the movement direction and the movement speed, the stroboscopic control signal comprising an illumination start time point and an illumination end time point; controlling each of the light sources to perform illumination based on the illumination start time point and the illumination end time point, and controlling each of the cameras to perform picture acquisition based on the picture acquisition control signal to obtain a plurality of photovoltaic pictures when the light source irradiates a photovoltaic panel; performing image recognition on each of the photovoltaic pictures to obtain a photovoltaic picture recognition result, and determining the location of the photovoltaic crack based on the photovoltaic picture recognition result.

[0114] Storage medium—any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media, such as CD-ROMs, floppy disks, or tape drives; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, and Rambus RAM; non-volatile memory, such as flash memory, magnetic media (e.g., hard disks or optical storage); registers or other similar types of memory elements; and the like. Storage media may also include other types of memory or a combination thereof. Furthermore, a storage medium may be located in a first computer system where a program is executed, or in a different second computer system connected to the first computer system via a network (such as the Internet). The second computer system may provide program instructions to the first computer system for execution. The term "storage medium" may include two or more storage media residing in different locations (e.g., in different computer systems connected via a network). A storage medium may store program instructions (e.g., embodied as a computer program) that are executable by one or more processors.

[0115] Of course, the computer executable instructions of the storage medium containing computer executable instructions provided in the embodiment of the present application are not limited to the above photovoltaic crack detection method, and can also execute related operations in the photovoltaic crack detection method provided in any embodiment of the present application.

[0116] The photovoltaic crack detection device, storage medium and photovoltaic crack detection equipment provided in the above embodiments can execute the photovoltaic crack detection method provided in any embodiment of the present application. For technical details not described in detail in the above embodiments, please refer to the photovoltaic crack detection method provided in any embodiment of the present application.

[0117] The above are only preferred embodiments of the present application and the technical principles employed. The present application is not limited to the specific embodiments described herein, and any obvious changes, readjustments, and substitutions that are apparent to those skilled in the art will not depart from the scope of protection of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments and may include many other equivalent embodiments without departing from the scope of the present application. The scope of the present application is determined by the scope of the claims.

Claims

1. A photovoltaic crack detection method, characterized in that: include: Obtaining a movement direction and a movement speed of a rail motion module for carrying a plurality of light sources and a plurality of cameras, and generating a stroboscopic control signal and an image acquisition control signal based on the movement direction and the movement speed, wherein the stroboscopic control signal includes an illumination start time point and an illumination end time point; Controlling each of the light sources to perform illumination based on the illumination start time point and the illumination end time point, and controlling each of the cameras to perform image acquisition based on the image acquisition control signal to obtain a plurality of photovoltaic images when the light sources illuminate the photovoltaic panels; Performing image recognition on each of the photovoltaic images to obtain photovoltaic image recognition results, and determining the location of photovoltaic cracks based on the photovoltaic image recognition results; The step of generating a stroboscopic control signal and an image acquisition control signal based on the movement direction and the movement speed includes: Generate an image acquisition control signal based on the motion direction and the motion speed, and extract a camera image acquisition time point and a camera shooting time of the image acquisition control signal, wherein the camera shooting time includes a camera image acquisition time and a camera exposure time; determining a lighting delay time based on the movement direction and the movement speed, wherein the lighting delay time includes a lighting advance time and a lighting delay time; Calculate the lighting start time point and the lighting end time point according to the camera image acquisition time point, the camera shooting time and the lighting delay time; The method for generating the image acquisition control signal includes: constructing a periodic trigger signal matching the acquisition frequency according to the acquisition frequency, and accurately scheduling the camera to perform a shooting action at the position to be acquired in each frame. The method for controlling the acquisition frequency specifically includes: determining the acquisition distance of the camera image acquired by each camera in the movement direction of the hanging rail motion module, determining each acquisition frequency based on the acquisition distance and the movement speed, and generating the image acquisition control signal based on the acquisition frequency. The method for determining the acquisition frequency includes: acquisition frequency = movement speed ÷ acquisition distance; The method of determining the lighting advance time includes: calculating the time for which the light source should be started in advance based on the movement speed and the estimated time for the rail motion module to arrive at the map collection area, so as to synchronously enter the effective lighting state; The method of determining the lighting delay time includes: calculating the exposure end time based on the camera exposure time, and delaying the light source shutdown time according to the movement trend and speed of the hanging rail motion module to ensure that the entire exposure interval is continuously covered by light; The method for calculating the lighting start time point includes: subtracting the sum of the lighting advance time and the control signal response time from the camera image acquisition time point to schedule the light source to start in advance to ensure stable lighting output before image acquisition begins; Among them, the method of calculating the lighting termination time point includes: adding the camera image acquisition time point to the camera shooting time, and adding the lighting delay time and the control signal response time to delay the scheduling of the light source to turn off and ensure continuous lighting during the image acquisition process.

2. The photovoltaic crack detection method according to claim 1, characterized in that: The controlling each of the cameras to acquire images based on the image acquisition control signal to obtain a plurality of photovoltaic images includes: The camera exposure time is extracted from the image acquisition control signal, and each of the cameras is controlled to acquire images according to the camera exposure time to obtain a plurality of photovoltaic images.

3. The photovoltaic crack detection method according to claim 1, characterized in that: The generating of the stroboscopic control signal and the image acquisition control signal based on the motion direction and the motion speed includes: When the movement direction is the first movement direction and / or the second movement direction, generating a stroboscopic control signal and an image acquisition control signal based on the movement speed; The rail-hanging motion module performs alternating motion in the first motion direction and the second motion direction, the first motion direction and the second motion direction are opposite directions, and the rail-hanging motion module performs intermittent motion in the third motion direction.

4. The photovoltaic crack detection method according to claim 1, characterized in that: The determining of the lighting delay time based on the movement direction and the movement speed includes: An illumination advance time is determined based on the motion direction and the motion speed, and an illumination delay time is determined based on the motion direction, the motion speed, and the camera exposure time.

5. The photovoltaic crack detection method according to claim 1, characterized in that: The calculating of the lighting start time point and the lighting end time point according to the camera image acquisition time point, the camera shooting time and the lighting delay time includes: The control signal response time of the stroboscopic control signal is obtained, and the lighting start time point and the lighting end time point are calculated based on the camera image acquisition time point, the camera shooting time, the lighting delay time and the control signal response time.

6. The photovoltaic crack detection method according to claim 1, characterized in that: The generating of the image acquisition control signal based on the movement direction and the movement speed includes: Determine the acquisition distance of the camera images acquired by each of the cameras in the movement direction of the rail-hanging motion module; The acquisition frequency of each camera is determined based on the acquisition distance and the movement speed, and an image acquisition control signal is generated based on the camera acquisition frequency.

7. A photovoltaic crack detection device, characterized in that: include: a control signal module, configured to obtain a motion direction and a motion speed of a rail motion module for carrying a plurality of light sources and a plurality of cameras, and generate a stroboscopic control signal and an image acquisition control signal based on the motion direction and the motion speed, wherein the stroboscopic control signal includes an illumination start time point and an illumination end time point; a photovoltaic image acquisition module, configured to control each of the light sources to perform illumination based on the illumination start time point and the illumination end time point, and to control each of the cameras to perform image acquisition based on the image acquisition control signal to obtain a plurality of photovoltaic images when the light sources illuminate the photovoltaic panels; a hidden crack detection module, configured to perform image recognition on each of the photovoltaic images to obtain photovoltaic image recognition results, and determine the location of the photovoltaic hidden crack based on the photovoltaic image recognition results; The step of generating a stroboscopic control signal and an image acquisition control signal based on the movement direction and the movement speed includes: Generate an image acquisition control signal based on the motion direction and the motion speed, and extract a camera image acquisition time point and a camera shooting time of the image acquisition control signal, wherein the camera shooting time includes a camera image acquisition time and a camera exposure time; determining a lighting delay time based on the movement direction and the movement speed, wherein the lighting delay time includes a lighting advance time and a lighting delay time; Calculate the lighting start time point and the lighting end time point according to the camera image acquisition time point, the camera shooting time and the lighting delay time; The method for generating the image acquisition control signal includes: constructing a periodic trigger signal matching the acquisition frequency according to the acquisition frequency, accurately scheduling the camera to perform a shooting action at the position to be acquired in each frame, wherein the method for controlling the acquisition frequency specifically includes: determining the acquisition distance of the camera image acquired by each camera in the movement direction of the hanging rail motion module, determining each acquisition frequency based on the acquisition distance and the movement speed, and generating the image acquisition control signal based on the acquisition frequency, wherein the method for determining the acquisition frequency includes: acquisition frequency = movement speed ÷ acquisition distance; The method of determining the lighting advance time includes: calculating the time for which the light source should be started in advance based on the movement speed and the estimated time for the rail motion module to arrive at the map collection area, so as to synchronously enter the effective lighting state; The method of determining the lighting delay time includes: calculating the exposure end time based on the camera exposure time, and delaying the light source shutdown time according to the movement trend and speed of the hanging rail motion module to ensure that the entire exposure interval is continuously covered by light; The method for calculating the lighting start time point includes: subtracting the sum of the lighting advance time and the control signal response time from the camera image acquisition time point to schedule the light source to start in advance to ensure stable lighting output before image acquisition begins; Among them, the method of calculating the lighting termination time point includes: adding the camera image acquisition time point to the camera shooting time, and adding the lighting delay time and the control signal response time to delay the scheduling of the light source to turn off and ensure continuous lighting during the image acquisition process.

8. A photovoltaic hidden crack detection device, characterized in that: include: one or more processors; The memory stores one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement the photovoltaic crack detection method according to any one of claims 1 to 6.

9. A storage medium containing computer-executable instructions, characterized in that: The computer executable instructions, when executed by a computer processor, are used to perform the photovoltaic crack detection method according to any one of claims 1 to 6.

Images