Image detection system based on unmanned aerial vehicle aircraft

By configuring image acquisition, posture monitoring and displacement detection devices on the gimbal of the drone aircraft, the problem of relying on manual recording of test information in traditional systems is solved, automatic detection and judgment is realized, and work efficiency and imaging quality are improved.

CN223200306UActive Publication Date: 2025-08-08TONGWEI SOLAR (HEFEI) CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202422510208.X
Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
Filing Date
2024-10-16
Publication Date
2025-08-08
Estimated Expiration
2034-10-16

AI Technical Summary

Technical Problem

The traditional image detection system based on drone aircraft relies on operators to record test information during shooting, resulting in low work efficiency and lack of scientificity in the judgment of imaging effects, and relies on operators' intuition.

Method used

An image acquisition device, a posture monitoring device and a displacement detection device are arranged on the gimbal of the drone aircraft to realize automatic posture information and instantaneous displacement detection of the image acquisition device, and automatically record and judge the image quality with the control device.

Benefits of technology

It improves the work efficiency and accuracy of image detection, reduces dependence on operators, and ensures automatic recording and scientific judgment of test information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN223200306U_ABST
    Figure CN223200306U_ABST
Patent Text Reader

Abstract

The utility model relates to an image detection system based on an unmanned aerial vehicle aircraft. The image detection system comprises an image acquisition device, a pose monitoring device and a displacement detection device. The displacement detection device is connected with the image acquisition device; the image acquisition device, the pose monitoring device and the displacement detection device are all arranged on a holder of the unmanned aerial vehicle aircraft. Wherein the image acquisition device is used for shooting an assembly image of a photovoltaic assembly; the pose monitoring device is used for detecting pose information of the image acquisition device; and the displacement detection device is used for detecting the instantaneous displacement of the image acquisition device in the process that the image acquisition device shoots the assembly image. By adopting the image detection system, the working efficiency can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of image detection technology, and in particular to an image detection system based on an unmanned aerial vehicle. Background Art

[0002] With the rapid development of image detection technology, drone-based image detection technology has emerged. This technology can test photovoltaic modules in clusters, adapting to complex on-site terrain and finding widespread use in large-scale photovoltaic power plants.

[0003] Traditional UAV-based image detection systems rely on operators to record test information during the shooting process, which greatly delays the test time and has the problem of low work efficiency. Utility Model Content

[0004] Based on this, it is necessary to provide an image detection system based on UAV aircraft that can improve work efficiency in response to the above technical problems.

[0005] In a first aspect, the present application provides an image detection system based on an unmanned aerial vehicle, comprising an image acquisition device, a posture monitoring device, and a displacement detection device; the displacement detection device is connected to the image acquisition device; the image acquisition device, the posture monitoring device, and the displacement detection device are all arranged on a gimbal of the unmanned aerial vehicle;

[0006] The image acquisition device is used to capture component images of the photovoltaic components;

[0007] The posture monitoring device is used to detect the posture information of the image acquisition device;

[0008] The displacement detection device is used to detect the instantaneous displacement of the image acquisition device when the image acquisition device is capturing the component image.

[0009] In one embodiment, the posture monitoring device includes a height detection device for monitoring the flight height of the UAV aircraft.

[0010] In one embodiment, the system further includes an angle adjustment device for adjusting the shooting angle of the image acquisition device; the posture monitoring device further includes an inclination monitoring device for monitoring the shooting angle of the image acquisition device.

[0011] In one embodiment, the system further includes a communication device; the communication device is connected to the height detection device and the inclination monitoring device.

[0012] In one embodiment, the system further includes a wind speed monitoring device for detecting wind speed information of the environment in which the UAV aircraft is located.

[0013] In one embodiment, the image acquisition device is an electroluminescent camera.

[0014] In one embodiment, the system further includes a timing device; the timing device is connected to the image acquisition device and the posture monitoring device to record the respective acquisition times of the component image and the posture information.

[0015] In one embodiment, the system further includes a control device; the control device is connected to the image acquisition device, the posture monitoring device and the displacement detection device; the control device is used to determine the image quality label of the component image based on the posture information and instantaneous displacement corresponding to the component image.

[0016] In one embodiment, the system further includes a first storage device for storing component images with qualified image quality labels.

[0017] In one embodiment, the system further includes a second storage device for storing component images with image quality labels as unqualified.

[0018] The above-mentioned image detection system based on the UAV aircraft is configured with an image acquisition device on the gimbal of the UAV aircraft to capture the component images of the photovoltaic components. It can realize global image acquisition of the photovoltaic power station by controlling the movement of the UAV aircraft and adjusting the shooting position of the image acquisition device; it is configured with a posture monitoring device for detecting the posture information of the image acquisition device, and a displacement detection device for detecting the instantaneous displacement of the image acquisition device during the process of the image acquisition device capturing the component image. It can automatically detect the posture information and instantaneous displacement of the image acquisition device while capturing the component image, which can not only improve the accuracy of the posture information and instantaneous displacement, but also automatically complete the recording of test information without relying on operators, which is conducive to improving work efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following briefly introduces the drawings required for use in the embodiments of the present application or related technical descriptions. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying any creative work.

[0020] Figure 1 is a structural block diagram of an image detection system based on a UAV in one embodiment;

[0021] Figure 2 is a structural block diagram of an image detection system based on a UAV in another embodiment;

[0022] Figure 3 This is a structural block diagram of an image detection system based on a UAV in another embodiment. DETAILED DESCRIPTION

[0023] To facilitate understanding of the present application, the present application will be described more fully below with reference to the accompanying drawings. The accompanying drawings provide embodiments of the present application. However, the present application may be implemented in many different forms and is not limited to the embodiments described herein. Rather, these embodiments are provided to make the disclosure of the present application more thorough and comprehensive.

[0024] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application pertains. The terms used herein in the specification of this application are for the purpose of describing specific embodiments only and are not intended to limit this application.

[0025] Spatially relative terms such as "under," "beneath," "beneath," "under," "above," "above," etc., may be used herein to describe the relationship of an element or feature shown in the figures to other elements or features. It should be understood that in addition to the orientations shown in the figures, spatially relative terms also include different orientations of the device in use and operation. For example, if the device in the drawings is turned over, the element or feature described as "under" or "beneath" or "beneath" the other elements will be oriented as "above" the other elements or features. Thus, the exemplary terms "under" and "under" can include both upper and lower orientations. In addition, the device can also include alternative orientations (e.g., rotated 90 degrees or other orientations), and the spatial descriptors used herein are interpreted accordingly.

[0026] It should be noted that when an element is considered to be "connected" to another element, it can be directly connected to the other element or connected to the other element through an intervening element. In addition, the "connection" in the following embodiments should be understood as "electrical connection", "communication connection", etc., if there is transmission of electrical signals or data between the connected objects.

[0027] As used herein, the singular forms "a," "an," and "the" may also include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the terms "include," "comprising," "having," and the like specify the presence of stated features, integers, steps, operations, components, parts, or combinations thereof, but do not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof. Furthermore, the term "and / or" as used in this specification includes any and all combinations of the relevant listed items.

[0028] Unmanned aerial vehicle (UAV)-based image inspection systems have emerged in the past two years as a new on-site inspection system for large-scale photovoltaic power plants. Compared to traditional portable inspection methods, UAV-based image inspection systems can test clusters of modules, breaking away from the limitations of portable inspection methods that limit them to testing individual modules. These systems offer advantages such as faster inspection speeds and flexibility in complex on-site terrain. However, UAV-based image inspection technology requires high operator expertise. Unprofessional photography techniques and unclear image interpretation methods can seriously impact the reliability of test results. Therefore, traditional techniques typically require operators to simultaneously capture module images while controlling the image inspection system and record test information for subsequent screening and evaluation to ensure the reliability of test results. However, recording test information during the imaging process significantly delays testing time and reduces work efficiency. While not recording test information and instead directly evaluating the module image quality based on the test information can reduce the impact on work efficiency to a certain extent, this evaluation relies heavily on operator intuition and lacks scientific accuracy.

[0029] Based on this, the present application provides an image detection system based on an unmanned aerial vehicle, which is not only equipped with an image acquisition device for capturing component images of photovoltaic components, but also equipped with a posture monitoring device for detecting the posture information of the image acquisition device, and a displacement detection device for detecting the instantaneous displacement of the image acquisition device during the process of the image acquisition device capturing component images. In this way, the automatic collection of test information such as posture information and instantaneous displacement can be realized during the shooting process, which is conducive to improving work efficiency.

[0030] In one embodiment, Figure 1As shown, an image detection system based on an unmanned aerial vehicle is provided, comprising an image acquisition device 100, a posture monitoring device 200, and a displacement detection device 300. The displacement detection device 300 is connected to the image acquisition device 100; the image acquisition device 100, the posture monitoring device 200, and the displacement detection device 300 are all mounted on the gimbal of the unmanned aerial vehicle. The image acquisition device 100 is used to capture images of photovoltaic modules; the posture monitoring device 200 is used to detect the posture information of the image acquisition device 100; and the displacement detection device 300 is used to detect the instantaneous displacement of the image acquisition device 100 while the image acquisition device 100 is capturing module images.

[0031] Among them, an unmanned aerial vehicle refers to an aircraft that does not require a pilot and is usually controlled by a radio remote control device. The gimbal of an unmanned aerial vehicle is a support device used to install and fix mission payloads such as cameras, and may include a shell, a support structure, a vibration reduction structure, and a rotating connection structure. In this embodiment, the image acquisition device 100, the posture monitoring device 200, and the displacement detection device 300 are all arranged on the gimbal of the unmanned aerial vehicle. This may refer to the image acquisition device 100, the posture monitoring device 200, and the displacement detection device 300 being arranged on the gimbal as independent components, or it may refer to the image acquisition device 100, the posture monitoring device 200, and the displacement detection device 300 being integrated into the gimbal. Furthermore, the fixing method of each device on the gimbal is not unique. It can be fixed by a gimbal adapter plate, or it can be fixed by a robotic arm and a clamp, which is not limited here. The position of each device on the gimbal is also not unique. It is only necessary to ensure that the lens of the image acquisition device 100 is not blocked by other components.

[0032] The image acquisition device 100 is a hardware device with image acquisition capabilities. The image acquisition device 100 may include a camera, a lens, an image acquisition card, and a light source. The camera is responsible for capturing image information; the lens is used to focus and adjust image quality; the image acquisition card is used to convert image signals into digital signals and transmit them to the back-end controller for processing; and the light source provides illumination to ensure clarity and accuracy during image acquisition. In an optional embodiment, the image acquisition device 100 may include multiple types of image acquisition components for capturing different types of component images for the same photovoltaic component, so that the photovoltaic component can be subsequently analyzed from multiple dimensions. The image acquisition components may include visible light image acquisition components, infrared image acquisition components, electroluminescent image acquisition components, and the like.

[0033] The posture monitoring device 200 is a hardware device capable of detecting posture information. Alternatively, the posture monitoring device 200 can be a machine vision-based monitoring device that detects posture through optical imaging and sensor data fusion. Alternatively, the posture monitoring device 200 can be a laser radar-based monitoring device that detects posture through laser radar scanning.

[0034] Furthermore, the pose information of the image acquisition device 100 may specifically include position information, attitude information, etc. The position information may be the position of the image acquisition device 100 in the world coordinate system, and the attitude information may refer to the orientation of the image acquisition device in the world coordinate system. In a specific implementation, the pose information of the image acquisition device 100 may be represented by a transformation matrix from the camera coordinate system to the world coordinate system. The transformation matrix may include a rotation matrix representing the orientation and a translation matrix representing the position.

[0035] It is understood that, when the shooting angle of the image acquisition device 100 is fixed, the posture monitoring device 200 may only include a height detection device for the UAV aircraft, thereby determining the posture information of the image acquisition device 100 based on the flight altitude of the UAV aircraft, the installation position of the image acquisition device 100 on the UAV aircraft, and the preset shooting angle. When the shooting angle is not fixed, the posture monitoring device 200 may include a height detection device for the UAV aircraft and a tilt monitoring device for the image acquisition device 100, thereby determining the posture information of the image acquisition device 100 based on the altitude of the UAV aircraft, the installation position of the image acquisition device 100 on the UAV aircraft, and the tilt angle of the image acquisition device 100.

[0036] The displacement detection device 300 is a hardware device capable of instantaneous displacement detection. Specifically, the displacement detection device 300 may include at least one of a piezoelectric displacement sensor, a laser displacement sensor, an eddy current sensor, or a differential transformer displacement sensor, among other high-precision sensors. This device can capture and process subtle changes and movements of the image acquisition device 100 during capture, providing accurate measurement results.

[0037] Specifically, the image acquisition device 100, the posture monitoring device 200, and the displacement detection device 300 are all arranged on the gimbal of the unmanned aerial vehicle. The operator can operate the unmanned aerial vehicle to place the image detection system above the photovoltaic module and capture the component image of the photovoltaic module. The posture monitoring device 200 is used to detect the posture information of the image acquisition device 100. This posture information can assist the operator in determining the shooting time, or be used to automatically determine the shooting time of the image acquisition device 100, so as to obtain multiple component images with good consistency for the same photovoltaic module at different operating periods, facilitating subsequent image data analysis. For example, the staff can pre-set the desired shooting posture. When the posture monitoring device 200 detects that the image acquisition device 100 is in the desired shooting posture, it sends a shooting instruction to the image acquisition device 100 to instruct the image acquisition device 100 to capture the component image of the photovoltaic module. It can be understood that in this case, the posture monitoring device 200 can be connected to the image acquisition device 100.

[0038] Image consistency includes consistency in image size and deformation. Image size is primarily determined by the distance between the image acquisition device 100 and the photovoltaic module, while deformation is primarily determined by the inclination of the image acquisition device 100 relative to the photovoltaic module. In practical applications, photovoltaic modules are typically stationary. Therefore, the position information of the image acquisition device 100 can represent the distance between the image acquisition device 100 and the photovoltaic module, while the posture information of the image acquisition device 100 can represent the inclination of the image acquisition device 100 relative to the photovoltaic module. In other words, detecting the position and posture information of the image acquisition device 100 provides an effective data basis for determining image consistency.

[0039] On the other hand, while the image acquisition device 100 is capturing component images, the displacement detection device 300 detects the instantaneous displacement of the image acquisition device 100. Because instantaneous displacement during the capture process directly affects the quality of the component images, this instantaneous displacement information can assist in determining the image quality of the component images, rather than relying solely on the operator's judgment. This can reduce the influence of subjective factors on the judgment results and improve accuracy.

[0040] The above-mentioned image detection system based on the unmanned aerial vehicle is configured with an image acquisition device 100 on the gimbal of the unmanned aerial vehicle to capture the component images of the photovoltaic components. By controlling the movement of the unmanned aerial vehicle, the shooting position of the image acquisition device 100 can be adjusted to achieve global image acquisition of the photovoltaic power station; a posture monitoring device 200 for detecting the posture information of the image acquisition device 100 and a displacement detection device 300 for detecting the instantaneous displacement of the image acquisition device 100 during the process of the image acquisition device 100 capturing the component images are configured. While capturing the component images, the posture information and instantaneous displacement of the image acquisition device 100 can be automatically detected. This can not only improve the accuracy of the posture information and instantaneous displacement, but also automatically complete the recording of test information without relying on operators, which is conducive to improving work efficiency.

[0041] In one embodiment, Figure 2 As shown, the posture monitoring device 200 includes a height detection device 210 for monitoring the flight height of the UAV aircraft.

[0042] Flight altitude detection devices are devices used to measure and monitor the altitude of an aircraft. Depending on the application scenario and technical means, flight altitude detection devices can be divided into various types, including barometric altimeters, radio altimeters, and lidar altimeters.

[0043] Specifically, a height detection device 210 can be set on the gimbal of the UAV aircraft to monitor the flight height of the UAV aircraft in real time, so that the distance between the image acquisition device 100 and the photovoltaic component can be determined based on the flight height, the installation position of the image acquisition device 100 on the UAV aircraft, and the installation height of the photovoltaic component.

[0044] In this embodiment, the height detection device 210 is configured on the gimbal of the UAV aircraft, which can realize real-time monitoring of the flight height and provide richer test information, which is conducive to improving the work efficiency of image detection and the accuracy of detection results.

[0045] In one embodiment, Figure 2 As shown, the image detection system based on the UAV aircraft further includes an angle adjustment device 400 for adjusting the shooting angle of the image acquisition device 100. In this embodiment, the posture monitoring device 200 further includes an inclination monitoring device 220 for monitoring the shooting angle of the image acquisition device 100.

[0046] The angle adjustment device 400 is a hardware device for adjusting the shooting angle of the image acquisition device 100. Figure 2As shown, the angle adjustment device 400 is connected to the image acquisition device 100. The specific structure of the angle adjustment device 400 is not unique. Exemplarily, the angle adjustment device 400 may include a first base, a supporting plate, a column, and a second support. The supporting plate is hinged to the second support, and the shooting angle of the image acquisition device 100 fixed on the supporting plate is adjusted by an adjustment mechanism; the angle adjustment device 400 may also include a mounting plate and an arc plate, the mounting plate is provided with a slide bar, and the arc plate is provided with an arc groove. By controlling the slide bar to slide in the arc groove, the shooting angle of the image acquisition device 100 mounted on the mounting plate is adjusted. In an optional embodiment, the image acquisition device 100 remains stationary on the gimbal, and the angle adjustment device 400 adjusts the shooting angle of the image acquisition device 100 by adjusting the posture of the unmanned aerial vehicle.

[0047] Tilt monitoring device 220 is a hardware device used to measure the tilt angle of image acquisition device 100. Tilt monitoring device 220 may include a tilt sensor that determines the tilt angle by measuring gravitational acceleration and the object's acceleration relative to the vertical. The shooting angle may refer to the angle of image acquisition device 100 relative to the photovoltaic module (i.e., relative to the world coordinate system).

[0048] Specifically, during the operation of the UAV aircraft, the angle adjustment device 400 adjusts the shooting angle of the image acquisition device 100, and the inclination monitoring device 220 measures the real-time shooting angle of the image acquisition device 100. Therefore, during the image acquisition process, the shooting angle can be continuously detected and adjusted to maintain consistency as much as possible, and component images with similar deformation degrees can be obtained, thereby simplifying the subsequent data processing process and further improving work efficiency.

[0049] In one of the embodiments, please refer to Figure 2 The image detection system based on the UAV aircraft further includes a communication device 500 ; the communication device 500 is connected to the height detection device 210 and the tilt monitoring device 220 .

[0050] The communication device 500 includes wireless transmission components such as 4G, 5G, Wi-Fi, and Bluetooth, which can realize communication between the UAV and ground equipment. The ground equipment can be, for example, the control terminal of the UAV or the terminal held by the operator.

[0051] Specifically, the communication device 500 connects the height detection device 210 and the inclination monitoring device 220, and can transmit the flight height detected by the height detection device 210 and the shooting angle detected by the inclination monitoring device 220 to the ground equipment, so that the operator can operate according to the flight height and shooting angle, thereby reducing the requirements of the detection process on the operator and further improving the work efficiency of the image detection process.

[0052] In one embodiment, the image detection system based on the UAV aircraft further includes a wind speed monitoring device 600 for detecting wind speed information of the environment in which the UAV aircraft is located.

[0053] The wind speed monitoring device 600, also known as a wind speed sensor or anemometer, is a hardware device used to measure and monitor wind speed. Wind speed sensors can be classified into various types, including mechanical, ultrasonic, hot wire, Pitot tube, and laser Doppler, depending on their operating principles and measurement methods.

[0054] Specifically, a wind speed monitoring device 600 is also provided on the gimbal of the UAV aircraft to detect the wind speed information of the environment in which the UAV aircraft is located, which can provide a richer data basis for the operation of the image detection system. For example, when the wind speed level represented by the wind speed information exceeds the safe wind speed level of the UAV aircraft, an early warning message can be sent to the ground equipment through the communication device 500 to remind the operator to recall the UAV aircraft. The wind speed information collected by the wind speed monitoring device 600 can also be used to assist in the judgment of the imaging quality in combination with the instantaneous displacement collected by the displacement detection device 300 to improve the accuracy of the judgment result. For example, when the expected displacement caused by the ambient wind represented by the wind speed information and the actual collected instantaneous displacement both reach the displacement threshold, it can be determined that the quality of the component image currently captured is unqualified. Among them, the displacement threshold refers to the maximum displacement that can be accepted under the imaging quality requirements.

[0055] In the above embodiment, a wind speed monitoring device 600 is configured to detect the wind speed information of the environment in which the UAV aircraft is located, which can not only improve the convenience of system operation, but also improve the accuracy of subsequent component image quality judgment results, and can ensure the accuracy of image detection results while improving work efficiency.

[0056] In an optional embodiment, the image acquisition device 100 is an electroluminescent camera.

[0057] Among them, electroluminescence (EL) cameras are devices specifically designed to detect internal defects in solar panels and cells, operating on the principle of electroluminescence (EL). Unlike conventional cameras, EL cameras are primarily used for rapid, large-scale inspections of photovoltaic power plants, particularly those on water and rooftops. EL cameras apply an electric field to stimulate photovoltaic panels to produce electroluminescence, then capture these luminescent images with a highly sensitive camera. They can detect the faint near-infrared light emitted by solar panels when powered on.

[0058] Specifically, an EL camera is deployed on the gimbal of a drone. Using the EL inspection camera mounted on the drone, EL inspection images of photovoltaic modules (i.e., module images) can be captured, enabling long-distance, highly efficient, non-destructive testing of PV modules. This method is particularly suitable for inspecting areas that are difficult to access or difficult to detect with the human eye, significantly improving inspection efficiency and accuracy.

[0059] In one embodiment, Figure 2 As shown, the image detection system based on the UAV aircraft also includes a timing device 700; the timing device 700 is connected to the image acquisition device 100 and the posture monitoring device 200 to record the respective acquisition times of the component image and posture information.

[0060] The timing device 700 is a hardware device for measuring time and may include an electronic timer or a programmable timer. In short, the present embodiment does not limit the specific structure of the timing device 700.

[0061] Specifically, the timing device 700 is connected to the image acquisition device 100 and the posture monitoring device 200 to record the acquisition time of the component image and the posture information, respectively, so that the association relationship between the component image and the posture information can be established based on the acquisition time. The posture information associated with the component image can refer to the posture information whose acquisition time is closest to the acquisition time of the component image. Furthermore, since the instantaneous displacement is detected during the process of the image acquisition device 100 capturing the component image, it is equivalent to establishing the association relationship between the component image and the instantaneous displacement during the instantaneous displacement detection process.

[0062] In an optional embodiment, the timing device 700 is further connected to the displacement detection device 300 and is further configured to record the acquisition time of the instantaneous displacement. This allows for establishing a correlation between the component image, the posture information, and the instantaneous displacement based on the acquisition time. The instantaneous displacement associated with the component image may be the instantaneous displacement whose acquisition time is closest to the acquisition time of the component image.

[0063] In the above embodiment, by configuring a timing device 700 for recording the acquisition time of the component image and the posture information, a correlation relationship can be established among the component image, the posture information and the instantaneous displacement. This is equivalent to recording the corresponding posture information and instantaneous displacement for each component image, which can provide a data basis for subsequent image quality judgment and is conducive to improving the accuracy of the image detection results.

[0064] In an optional embodiment, the timing device 700 is further connected to the wind speed monitoring device 600 and is further configured to record the acquisition time of the wind speed information. This allows for establishing a correlation between the component image, posture information, instantaneous displacement, and wind speed information based on the acquisition time. The wind speed information associated with the component image may be the wind speed information whose acquisition time is closest to the acquisition time of the component image, thereby providing a richer data basis for subsequent image quality assessment and further improving the accuracy of the image detection results.

[0065] In one embodiment, Figure 2 As shown, the image detection system based on the UAV aircraft also includes a control device 800; the control device 800 is connected to the image acquisition device 100, the posture monitoring device 200 and the displacement detection device 300, and is used to determine the image quality label of the component image according to the posture information and instantaneous displacement corresponding to the component image.

[0066] The image quality label can include qualified and unqualified, or it can include a specific quality level, for example, S for high-quality images, A for qualified images, and B for risky images. The control device 800 can be directly connected to the image acquisition device 100, the posture monitoring device 200, and the displacement detection device 300, or it can be indirectly connected to the image acquisition device 100, the posture monitoring device 200, and the displacement detection device 300 via the communication device 500.

[0067] In practical applications, image inspection systems test a large number of photovoltaic modules, with the same module requiring three to five tests during different periods of operation. The control device 800 receives pose information, such as flight altitude detection data and camera angle detection data, to determine pose consistency for the module image and determine an image quality label that matches the judgment result. The quality level represented by the image quality label is positively correlated with the consistency between the pose information corresponding to the module image and the expected pose.

[0068] On the other hand, the instantaneous displacement during the shooting process will directly affect the image quality. Based on this, the control device 800 can judge the imaging quality of the component image according to the instantaneous displacement corresponding to the component image, and determine the image quality label that matches the judgment result. Among them, the quality level represented by the image quality label is positively correlated with the imaging quality of the component image. In an optional embodiment, Figure 2 As shown, the control device 800 can also be connected to the wind speed monitoring device 600 to judge the imaging quality in combination with the instantaneous displacement collected by the displacement detection device 300 and the wind speed information collected by the wind speed monitoring device 600.

[0069] In the above embodiment, the configuration control device 800 determines the image quality label of the component image, which can facilitate the subsequent selection of component images with better quality for processing, thereby improving the working efficiency of the image data processing process.

[0070] In one embodiment, Figure 2 As shown, the UAV-based image detection system further includes a first storage device 910 for storing component images with image quality labels as qualified.

[0071] The image quality label is determined based on the pose information and instantaneous displacement corresponding to the component image. The process for determining the component quality label is described above and will not be repeated here. The first storage device 910 can be a built-in storage device such as a random access memory (RAM) or read-only memory (ROM), or an external storage device such as an optical disk, a universal serial bus (USB) memory, or a memory card.

[0072] Specifically, a first storage device 910 can be configured in the image detection system. The first storage device 910 can be connected to the control device 800 and the image acquisition device 100 to obtain the component image captured by the image acquisition device 100 and the image quality label determined by the control device 800 for the component image. If the image quality label is qualified, the first storage device 910 stores the component image. The first storage device 910 can also be connected to the control device 800, so that if the image quality label of the component image is qualified, the control device 800 transmits the component image to the first storage device 910 for storage.

[0073] In the above embodiment, the first storage device 910 is configured to store component images with qualified image quality labels, which can facilitate subsequent reading of qualified component images directly from the first storage device 910, thereby improving the work efficiency of subsequent image processing processes.

[0074] Furthermore, component images with unqualified image quality labels may be directly discarded to save storage space, or may be stored in another storage device different from the first storage device 910 .

[0075] In one embodiment, Figure 2As shown, the UAV-based image detection system further includes a second storage device 920 for storing component images with image quality labels as unqualified.

[0076] The image quality label is determined based on the pose information and instantaneous displacement corresponding to the component image. The process for determining the component quality label is described above and will not be repeated here. The second storage device 920 can be a built-in storage device such as a random access memory (RAM) or a read-only memory (ROM), or an external storage device such as an optical disc, a universal serial bus (USB) memory device, or a memory card. The first storage device 910 and the second storage device 920 can be of the same or different types.

[0077] Specifically, a second storage device 920 can be configured in the image detection system. The second storage device 920 can be connected to the control device 800 and the image acquisition device 100 to obtain the component image captured by the image acquisition device 100 and the image quality label determined by the control device 800 for the component image. If the image quality label indicates an unqualified component image, the second storage device 920 can also be connected to the control device 800, so that if the image quality label indicates an unqualified component image, the control device 800 can transfer the component image to the second storage device 920 for storage.

[0078] In the above embodiment, a second storage device 920 is configured to store component images with image quality labels as unqualified, which can facilitate the operator to subsequently read the unqualified component images from the second storage device 920 and then make a secondary judgment to meet application needs in scenarios where qualified images are insufficient, rather than directly performing secondary image acquisition. This is equivalent to providing an emergency plan for special circumstances, which is conducive to further improving the work efficiency of image detection.

[0079] In a specific embodiment, Figure 3 As shown, the image detection system based on the UAV aircraft includes an image acquisition device 100, a height monitoring device 210, a tilt monitoring device 220, a wind speed monitoring device 600, a displacement detection device 300, a control device 800, and a first storage device 910. The control device 800 is connected to the image acquisition device 100, the height monitoring device 210, the tilt monitoring device 220, the wind speed monitoring device 600, the displacement detection device 300, and the first storage device 910.

[0080] Among them, the height monitoring device 210 is integrated on the gimbal of the UAV aircraft, and is used to monitor the changes in the flight height of the UAV aircraft in real time; the tilt monitoring device 220 is integrated on the gimbal of the UAV aircraft, and is used to monitor the changes in the shooting angle of the image acquisition device 100 in real time; the wind speed monitoring device 600 is integrated on the gimbal of the UAV aircraft, and is used to detect changes in the wind speed level of the environment in which the UAV aircraft is located during the operation of the UAV aircraft; the displacement detection device 300 is integrated on the gimbal of the UAV aircraft, and is used to detect the instantaneous displacement generated by the image acquisition device 100 at the moment of shooting; the control device 800 is used to perform consistency judgment and imaging judgment on the component image taken by the image acquisition device 100 according to the flight altitude, shooting angle, wind speed level and instantaneous displacement, and determine the image quality of the component image; the first storage device 910 is used to store high-quality images that have passed the consistency judgment and imaging judgment.

[0081] The aforementioned drone-based image detection system provides a scientific approach, digitizing and standardizing subjective personal judgment criteria as much as possible. This improves the accuracy of judgment results and the efficiency of the judgment process. Furthermore, by collecting test information such as flight altitude, shooting angle, wind speed level, and instantaneous displacement, it provides a basis for judging image quality, which helps improve overall image quality and reduce subsequent image analysis time, further enhancing work efficiency.

[0082] The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0083] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. An image detection system based on an unmanned aerial vehicle, characterized in that: It includes an image acquisition device, a posture monitoring device and a displacement detection device: the displacement detection device is connected to the image acquisition device; the image acquisition device, the posture monitoring device and the displacement detection device are all arranged on the gimbal of the unmanned aerial vehicle; The image acquisition device is used to capture component images of the photovoltaic components; The posture monitoring device is used to detect the posture information of the image acquisition device; The displacement detection device is used to detect the instantaneous displacement of the image acquisition device when the image acquisition device is capturing the component image.

2. The image detection system according to claim 1, characterized in that The posture monitoring device includes a height detection device for monitoring the flight height of the UAV aircraft.

3. The image detection system according to claim 2, characterized in that The system further comprises an angle adjustment device for adjusting the shooting angle of the image acquisition device; The posture monitoring device also includes an inclination monitoring device for monitoring the shooting angle of the image acquisition device.

4. The image detection system according to claim 3, characterized in that The system further comprises a communication device; the communication device is connected to the height detection device and the inclination monitoring device.

5. The image detection system according to claim 1, wherein: The system also includes a wind speed monitoring device for detecting wind speed information of the environment in which the UAV aircraft is located.

6. The image detection system according to claim 1, characterized in that The image acquisition device is an electroluminescent camera.

7. The image detection system according to any one of claims 1 to 6, characterized in that: The system further comprises a timing device; The timing device is connected to the image acquisition device and the posture monitoring device to record the acquisition time of the component image and the posture information respectively.

8. The image detection system according to claim 7, characterized in that: The system further includes a control device; the control device is connected to the image acquisition device, the posture monitoring device and the displacement detection device; The control device is used to determine the image quality label of the component image according to the posture information and instantaneous displacement corresponding to the component image.

9. The image detection system according to claim 8, characterized in that The system further includes a first storage device for storing component images with qualified image quality labels.

10. The image detection system according to claim 8, characterized in that: The system further includes a second storage device for storing component images with unqualified image quality labels.

Citation Information

Cited By

  • Unmanned aerial vehicle land survey system and survey method based on multi-source sensor fusion

    CN121453005A