Defect detection report generation method, system and electronic equipment

Through the positioning of the vehicle detection equipment and the camera device to obtain information in real time, detailed defect detection reports are generated, which solves the problem of low accuracy of defect detection reports in the prior art, and improves the detection accuracy and maintenance efficiency of photovoltaic power plants.

CN118671090BActive Publication Date: 2024-12-03FANTASTIC ENERGY & ENVIRONMENT (ZHEJIANG) CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411140596.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-20
Publication Date
2024-12-03
Estimated Expiration
2044-08-20

AI Technical Summary

Technical Problem

Existing photovoltaic power plant defect detection equipment has the problem of low accuracy in forming inspection reports, especially the inability to accurately locate the defect location of specific components.

Method used

The vehicle-mounted detection device is equipped with a positioning device, a first imaging device and a second imaging device, and the positioning information and images are obtained in real time, the defect location of the target object is determined, and a detailed defect detection report is generated, including the target object in the preset coordinate system. Location information and location information of sub-targets in the target object.

Benefits of technology

It improves the accuracy of defect detection and the readability of reports, can more accurately characterize the specific location of target objects with defects, and improves the maintenance efficiency of photovoltaic power stations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118671090B_ABST
    Figure CN118671090B_ABST
Patent Text Reader

Abstract

The present application proposes a defect detection report generation method, system and electronic device, the defect detection report generation method comprising: acquiring in real time the positioning information of the vehicle-mounted detection device sent by the positioning device, and the first image sent by the first camera device; wherein the first image and the positioning information both correspond to a first timestamp; acquiring in real time a second image including a target object sent by the second camera device, the second image corresponding to a second timestamp; determining a target image including the defect of the target object from the second image; determining a target second timestamp corresponding to the target image, and determining a target timestamp based on the target second timestamp; determining the corresponding positioning information and the first image based on the target timestamp; generating a defect detection result based on the target positioning information and the target first image. The present application relates to the field of defect detection technology, and can improve the accuracy of defect detection.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of defect detection technology, and in particular to a defect detection report generation method, system and electronic equipment. Background Art

[0002] At present, with the continuous advancement of renewable energy technology, photovoltaic power stations, as an important part of clean energy, are becoming more and more valued for their operating efficiency and safety. Defect detection in photovoltaic power stations, especially subtle hidden crack defects, is crucial to the long-term stable operation of power stations. The traditional method of generating defect detection reports requires the photovoltaic modules to be disassembled for manual inspection, which is not only time-consuming and labor-intensive, but also easy to cause secondary damage to the modules. In recent years, with the development of vehicle-mounted detection equipment, defect detection in photovoltaic power stations has gradually become automated and intelligent. By carrying advanced equipment such as high-definition cameras and laser sensors, vehicle-mounted equipment can detect subtle defects in photovoltaic modules in real time, greatly improving detection efficiency and accuracy. However, existing vehicle-mounted detection equipment still has some shortcomings in forming detection reports, such as relying on manual marking of defect locations and being unable to accurately locate specific components. Summary of the invention

[0003] In view of the above, it is necessary to propose a defect detection report generation method, system and electronic device to solve the technical problem of low accuracy of defect detection.

[0004] The present application provides a defect detection report generation method, which is applied to an electronic device, wherein the electronic device is communicatively connected to a vehicle-mounted detection device, and the vehicle-mounted detection device includes a positioning device, a first camera device, and a second camera device. The method includes: receiving a plurality of positioning information sent by the positioning device during the movement of the vehicle-mounted detection device, and a plurality of first images sent by the first camera device; wherein each first image and each positioning information corresponds to a first timestamp; receiving a plurality of second images including a target object sent by the second camera device, wherein each second image corresponds to a second timestamp; determining a target image including a defect of the target object from the second image; determining a second timestamp corresponding to the target image, and determining a target timestamp according to the second timestamp corresponding to the target image; determining corresponding positioning information and a first image according to the target timestamp; outputting a defect detection report corresponding to the target object according to the determined positioning information and the first image; wherein the defect detection report is used to record the position information of the target object with defects in the preset coordinate system, and is also used to record the position information of a sub-target with defects in the target object in the target object.

[0005] In some embodiments, the positioning information includes: position information of the positioning device in a preset coordinate system; and a heading angle of the vehicle-mounted detection equipment.

[0006] In some embodiments, the method further includes: determining a current position of the vehicle-mounted detection device according to the positioning information and the first image; and controlling the vehicle-mounted detection device to move within a preset inspection range based on the current position.

[0007] In some embodiments, determining the current position of the vehicle-mounted detection equipment based on the positioning information and the first image includes: determining the position information of the positioning device in a preset coordinate system as the position information of the vehicle-mounted detection equipment in the preset coordinate system; determining the current position of the vehicle-mounted detection equipment based on the position information, edge features in the first image, and identification information in the first image.

[0008] In some embodiments, controlling the vehicle-mounted detection device to move within a preset inspection range based on the current position includes: controlling the vehicle-mounted detection device to move within the preset inspection range according to the current position, a boundary of the preset inspection range, and the heading angle.

[0009] In some embodiments, controlling the movement of the vehicle-mounted detection device within the preset inspection range based on the current position, the boundary of the preset inspection range and the heading angle includes: determining the distance between the current position and the boundary; and sending a preset movement control instruction to the vehicle-mounted detection device based on the distance, the heading angle and the size data of the vehicle-mounted detection device.

[0010] In some embodiments, determining the target second timestamp corresponding to the target image and determining the target timestamp based on the target second timestamp include: determining the second timestamp corresponding to the target image as the target second timestamp; determining the difference between the target second timestamp and each first timestamp; and determining the first timestamp corresponding to the smallest difference as the target timestamp.

[0011] In some embodiments, the first image includes: texture information of the target object; and identification information of sub-targets in the target object.

[0012] The embodiment of the present application also provides a defect detection report generation system, the system comprising: an electronic device and a vehicle-mounted detection device, the electronic device being communicatively connected to the vehicle-mounted detection device, the vehicle-mounted detection device comprising a positioning device, a first camera device and a second camera device; the electronic device is used to receive a plurality of positioning information sent by the positioning device during the movement of the vehicle-mounted detection device, and a plurality of first images sent by the first camera device; wherein each first image and each positioning information corresponds to a first timestamp; the electronic device is also used to receive a plurality of second images including a target object sent by the second camera device, each second image corresponding to a second timestamp; the electronic device is also used to determine a target image including a defect of the target object from the second image; the electronic device is also used to determine a second timestamp corresponding to the target image, and determine a target timestamp according to the second timestamp corresponding to the target image; the electronic device is also used to output a defect detection report corresponding to the target object according to the determined positioning information and the first image; wherein the defect detection report is used to record the position information of the target object with defects in the preset coordinate system, and is also used to record the position information of the sub-target with defects in the target object in the target object.

[0013] An embodiment of the present application also provides an electronic device, comprising: a memory storing at least one instruction; and a processor executing the instruction stored in the memory to implement the defect detection report generating method.

[0014] It can be seen from the above technical solutions that the embodiment of the present application first obtains the positioning information of the vehicle-mounted detection equipment and the first image around the vehicle-mounted detection equipment in real time, and obtains the second image including the target object in real time, so that the position information of each target object within the inspection range is recorded in the process of defect detection of the target object, which provides data support for the subsequent generation of defect detection results. Then, the target image including the defect of the target object is determined from the second image, and the target timestamp with the smallest time difference is determined according to the target second timestamp corresponding to the target image, and finally the corresponding positioning information and first image are determined according to the target timestamp to generate the defect detection result. Thereby, the readability of the defect detection result can be improved, and the specific location of the target object with defects can be characterized based on the target positioning information and the target first image in the defect detection result, thereby improving the accuracy of defect detection. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 This is an application scenario diagram of a defect detection report generation method provided in one embodiment of the present application.

[0016] Figure 2 It is an architectural diagram of a defect detection system provided in one embodiment of the present application.

[0017] Figure 3 This is a flowchart of a defect detection report generation method provided in one embodiment of the present application.

[0018] Figure 4 This is a flow chart of a method for controlling the movement of a vehicle-mounted detection device provided in one embodiment of the present application.

[0019] Figure 5 It is a schematic diagram of a defect detection report provided in an embodiment of the present application.

[0020] Figure 6 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0021] In order to more clearly understand the purpose, features and advantages of the present application, the present application is described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that, in the absence of conflict, the embodiments of the present application and the features in the embodiments can be combined with each other. In the following description, many specific details are set forth to facilitate a full understanding of the present application, and the embodiments described are only a part of the embodiments of the present application, rather than all of the embodiments.

[0022] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0023] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those generally understood by those skilled in the art to which the present application belongs. The terms used herein in the specification of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. The term "and / or" used herein includes any and all combinations of one or more of the related listed items.

[0024] An embodiment of the present application provides a defect detection report generation method, which can be applied to one or more electronic devices. The electronic device is a device that can automatically perform numerical calculations and / or information processing according to pre-set or stored instructions, and its hardware includes but is not limited to a microprocessor, an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a programmable gate array (Field-Programmable Gate Array, FPGA), a digital processor (Digital Signal Processor, DSP), an embedded device, etc.

[0025] An electronic device can be any electronic product that can interact with customers, such as personal computers, tablet computers, smart phones, personal digital assistants (PDAs), game consoles, Internet Protocol Television (IPTV), smart wearable devices, etc.

[0026] like Figure 1 As shown, a defect detection report generation method provided by the present application can be applied to an electronic device 100, and the electronic device 100 is connected to a vehicle-mounted detection device 200 for communication. The vehicle-mounted detection device 200 includes a carrier 210, a guide device 220, a positioning device 230, a first camera device 240, and a second camera device 250. The carrier 210 is used to drive the first camera device 240 and the second camera device 250 to perform defect detection on a target object within an inspection range 300. The electronic device 100 can control the vehicle-mounted detection device 200 to move within the inspection range 300.

[0027] The vehicle-mounted detection device 200 is equipped with a positioning device 230, a first camera device 240, and a second camera device 250. The first camera device 240 may be an environmental camera, which is used to photograph the target objects (such as target objects 310, target objects 320, and target objects 330) within the inspection range 300 to obtain the position information of the target objects within the inspection range 300. The second camera device 250 may be a detection camera, which is used to identify the defects of the targets (such as target objects 310, target objects 320, and target objects 330) within the inspection range 300. The electronic device 100 sends a preset movement control instruction to the vehicle-mounted detection device 200, so that the vehicle-mounted detection device 200 controls the vehicle-mounted detection device 200 to move within the preset inspection range 300 according to the movement control instruction, wherein the inspection range 300 includes multiple targets, such as target objects 310, target objects 320, and target objects 330. Each target object includes multiple sub-targets, such as sub-target 311, sub-target 312 and sub-target 313 in target object 310, sub-target 321, sub-target 322 and sub-target 323 in target object 320, and sub-target 331, sub-target 332 and sub-target 333 in target object 330. Exemplarily, the target object may be a battery module to be inspected within the inspection range, and the sub-target in the target object may be a battery in the battery module; the target object may also be a fixture to be inspected within the inspection range, and the sub-target in the target object may be a component in the fixture. This application does not limit the specific categories of the target objects and sub-targets.

[0028] The electronic device 100 generates a corresponding defect detection report based on the defect information of the target object within the inspection range 300 collected by the vehicle-mounted detection device 200. The defect detection report is used to record the position information of the defective target object within the inspection range 300, and the position information of the defective sub-target in the corresponding target object.

[0029] like Figure 2 As shown, it is an architecture diagram of a defect detection system provided by an embodiment of the present application. The electronic device 100 is used to obtain the positioning information sent by the positioning device 230 and the first image sent by the first camera device 240, wherein the first image and the positioning information both correspond to the first timestamp. The electronic device 100 is also used to obtain in real time a second image including a target object sent by the second camera device 250, and the second image corresponds to a second timestamp. The electronic device 100 is also used to determine a target image including defects of the target object from the second image; the electronic device 100 is also used to determine a target second timestamp corresponding to the target image, and determine a target timestamp based on the target second timestamp; the electronic device 100 is also used to determine the corresponding positioning information and the first image based on the target timestamp; the electronic device 100 is also used to generate a defect detection result based on the determined positioning information and the first image.

[0030] like Figure 3 , is a flow chart of a defect detection report generation method provided in an embodiment of the present application. According to different requirements, the order of the steps in the flow chart can be changed, and some steps can be omitted. A defect detection report generation method provided in an embodiment of the present application includes the following steps.

[0031] S20, receiving a plurality of positioning information sent by the vehicle-mounted detection equipment through the positioning device during movement, and a plurality of first images sent by the first camera device.

[0032] In one embodiment of the present application, the vehicle-mounted detection device moves within a preset inspection range according to the instruction sent by the electronic device, so that the positioning device can record the positioning information of the vehicle-mounted detection device along the preset inspection path, and the first camera device can record the first image of the vehicle-mounted detection device along the preset inspection path, so that the second camera device can capture the second image of the target object within the inspection range along the preset inspection path. For specific methods of controlling the movement of the vehicle-mounted detection device according to the positioning information and the first image, please refer to Figure 4 The corresponding detailed description.

[0033] In one embodiment of the present application, the preset inspection range is used to characterize the latitude and longitude range of the vehicle-mounted detection device during movement. Specifically, the inspection range can be characterized based on the latitude and longitude coordinates of a plurality of pre-set vertices. For example, when the latitude and longitude coordinates of the four pre-set vertices are (A1, B1), (A2, B2), (A3, B3) and (A4, B4), respectively, the quadrilateral area with the above four longitude and latitude coordinates as vertices can be determined as the inspection range.

[0034] In one embodiment of the present application, before starting the inspection, the starting point of the vehicle-mounted detection device within the inspection range is first determined, the edge of the target object is determined according to the edge features of the target object captured by the environmental camera, and the target object is moved along the arrangement direction at the edge of the target object. Specifically, the vehicle-mounted detection device determines the morphological features of the target object, and adjusts the heading of the vehicle-mounted detection device in real time according to the Hoffman line principle and the heading data sent by the positioning device, ensuring that the vehicle-mounted detection device can move in a preset direction. During the movement of the vehicle-mounted detection device, edge detection is performed on the first image captured by the first camera device to obtain the edge features in the first image, and the relative position between the vehicle-mounted detection device and the target object and the boundary of the inspection range is determined according to the edge features. In addition, the vehicle-mounted detection device also includes a distance sensor for detecting faults or obstacles around the vehicle-mounted detection device, which can avoid the vehicle-mounted detection device from falling or colliding with obstacles. When the vehicle-mounted detection equipment reaches the boundary of the inspection range, it will turn and move to the uninspected area within the inspection range. Before the vehicle-mounted detection equipment turns, it will record the location information sent by the positioning device and move a preset distance along the edge of the inspection range, thereby ensuring that the vehicle-mounted detection equipment can fully cover the inspection range during the movement.

[0035] In one embodiment of the present application, in order to ensure that the vehicle-mounted detection equipment can move according to the preset inspection track within the preset inspection range, the electronic device can obtain the positioning information of the vehicle-mounted detection equipment sent by the positioning device and the first image sent by the first camera device in real time. The positioning device can be a real-time kinematic measurement device (Real Time Kinematic, RTK), which is used to obtain the positioning information of the vehicle-mounted detection equipment according to a preset sampling frequency, for example, the preset sampling frequency can be 10 Hz.

[0036] In one embodiment of the present application, the positioning information is used to characterize the position of the vehicle-mounted detection equipment in a preset coordinate system. Specifically, the positioning information includes: the position information of the positioning device in the preset coordinate system; and the heading angle of the vehicle-mounted detection equipment. Among them, the preset coordinate system can be a three-dimensional coordinate system or a two-dimensional coordinate system preset within the inspection range. Among them, the heading angle is used to characterize the angle between the longitudinal axis of the vehicle-mounted detection equipment and the north direction. Specifically, the value range of the heading angle can be (-π, π] or (-180, 180) degrees. The method for calculating the heading angle depends on the posture and position information of the vehicle-mounted detection equipment. For example, the value of the heading angle can be obtained by a real-time dynamic measurement device and a navigation system, wherein the navigation system can be an inertial navigation system (INS), a global positioning system (GPS), etc.

[0037] In one embodiment of the present application, in order to ensure that the vehicle-mounted detection equipment moves within a preset inspection range, the electronic device can obtain the first image sent by the first camera device in real time. Among them, the first camera device is used to determine the first image around the vehicle-mounted detection equipment. Specifically, the first image includes: texture information of the target object; and identification information of the sub-target in the target object, wherein the identification information is used to characterize the position information of the sub-target in the target object. Exemplarily, the target object can be a battery module to be detected within the inspection range, and the sub-target in the target object can be a battery in the battery module; the first image includes texture information of the battery module collected by the first camera device, and identification information of the battery, the texture information is used to characterize the position of the battery module within the inspection range, the identification information can be the serial number of the battery, and the serial number is used to characterize the position of the battery in the battery module. The target object can also be a fixture to be detected within the inspection range, and the sub-target in the target object can be a component in the fixture; then the first image includes edge features of the fixture collected by the first camera device, and identification information of the component, the identification information can be the serial number of the component, which needs to be used to characterize the position of the component in the fixture.

[0038] In an embodiment of the present application, each first image and each positioning information corresponds to a first timestamp.

[0039] S21, receiving a plurality of second images including a target object sent by the second camera device, each second image corresponding to a second timestamp.

[0040] In one embodiment of the present application, in order to perform defect detection on a target object in an inspection area, a second image including the target object may be captured in real time using a second camera device, wherein the second image is a two-dimensional image. The second image corresponds to a second timestamp, and the second timestamp is used to represent the time point when the second camera device captured the second image.

[0041] In one embodiment of the present application, while the vehicle-mounted detection device is moving, the second camera device adjusts the frequency of photographing the target object according to the moving speed of the vehicle-mounted detection device and automatically and continuously photographs the second image. In order to subsequently analyze the second image using a high-performance defect detection algorithm, the second image can be stored in the memory of the electronic device and named according to the timestamp corresponding to the second image, so as to provide data support for the subsequent generation of a defect detection report.

[0042] S22, determining a target image including the defect of the target object from the second image.

[0043] In one embodiment of the present application, in order to determine whether a target object in an inspection area has defects, a preset defect detection model may be used to process a second image including the target object, thereby identifying defects in the target object in the second image. For example, when the target object is a battery module within the inspection range, it is necessary to perform defect detection on the batteries in the battery module, and the preset defect detection model may be used to process the second image including the battery module, thereby identifying defects in the battery module in the second image; when the target object is a fixture within the inspection range, it is necessary to perform defect detection on the components in the fixture, and the preset defect detection model may be used to process the second image including the fixture, thereby identifying defects in the fixture in the second image.

[0044] In one embodiment of the present application, the preset defect detection model can be a pre-trained fully connected neural network model, a pre-trained convolutional neural network, a pre-trained generative model, etc. The present application does not limit the specific category of the defect detection model. Exemplarily, the second image can be input into the preset defect detection model to obtain the category of each pixel in the second image, where the category includes at least defect and non-defect. When the category of any pixel in the second image is defect, the second image is determined to be a target image, and the target object in the target image has defects. Exemplarily, when the target object within the inspection range is a battery module, the battery module in the target image has defects; when the target object within the inspection range is a fixture, the fixture in the target image has defects.

[0045] S23, determining a second timestamp corresponding to the target image, and determining a target timestamp according to the second timestamp corresponding to the target image.

[0046] In one embodiment of the present application, in order to determine the position of a target object with defects in a target image within an inspection range, the second timestamp corresponding to the target image can be determined as the target second timestamp, and the first timestamp with the smallest time difference with the target second timestamp can be determined as the target timestamp. Among them, the positioning information corresponding to the target timestamp is used to characterize the position of the target object with defects within the inspection range. Specifically, determining the second timestamp corresponding to the target image, and determining the target timestamp based on the second timestamp corresponding to the target image includes: determining the second timestamp corresponding to the target image as the target second timestamp; determining the difference between the target second timestamp and each first timestamp; determining the first timestamp corresponding to the smallest difference as the target timestamp. Exemplarily, when the second timestamp corresponding to the target image is "2024 / 06 / 30 17:00:00:00", and the first timestamps are "2024 / 06 / 30 17:00:00:01", "2024 / 06 / 30 17:00:00:02" and "2024 / 06 / 30 17:00:00:03", the difference between the second timestamp and each first timestamp is 1 millisecond, 2 milliseconds and 3 milliseconds respectively, then the first timestamp "2024 / 06 / 30 17:00:00:01" corresponding to the smallest difference of 1 millisecond can be determined as the target timestamp.

[0047] S24: Determine corresponding positioning information and a first image according to the target timestamp.

[0048] In one embodiment of the present application, in order to determine the defective target within the inspection range and generate the corresponding defect detection result, the corresponding positioning information and the first image can be determined according to the target timestamp. The target positioning information is used to characterize the position information of the defective target within the inspection range, and the heading angle of the vehicle-mounted detection device when the electronic device receives the target positioning information sent by the positioning device; the target first image includes the edge features of the defective target and the identification information of the sub-target in the defective target.

[0049] Exemplarily, when the target positioning information corresponding to the target timestamp includes (1, 2) and 15°, it indicates that the coordinates of the positioning device in the preset coordinate system at the target timestamp are (1, 2), and the heading angle of the on-board detection equipment at the target timestamp is 15°.

[0050] Exemplarily, when the target object is a defective battery module within the inspection range, the sub-target may be a battery in the battery module; the texture information is used to characterize the edge features of the defective battery module, which can indicate the specific position of the battery module within the inspection range, and the identification information of the battery may be the serial number of the battery, which is used to characterize the position of the battery in the battery module. Specifically, the texture information may be the number of the battery module, the identification information may be the number of the battery, and the numbering method of the battery module is consistent with the numbering method of the battery. For example, the number of the battery module may be a two-dimensional coordinate, which is used to characterize the position of the battery module within the inspection range. When the number of the battery module is (1, 1), it indicates that the position of the battery module within the inspection range is the first row and the first column. During the movement of the vehicle-mounted detection device, the electronic device continuously analyzes the first image captured by the first camera device, and saves the number of each detected battery module and the number of the battery, and stores them in the memory of the electronic device in combination with the timestamp. Specifically, when the vehicle-mounted detection device moves along the longitudinal axis of the preset coordinate system, each time the first camera device in the vehicle-mounted detection device detects an edge feature, the number of detected battery modules increases by one. Since the field of view of the first camera device is usually between 20 cm and 30 cm, when the field of view of the first camera device spans two different battery modules, the vehicle-mounted detection device adjusts its position to ensure that the field of view of the first camera device can fully illuminate the same battery module.

[0051] Exemplarily, when the target object is a defective fixture within the inspection range, the sub-target may be a component in the fixture; the texture information is used to characterize the edge features of the defective fixture, which can indicate the specific position of the battery module within the inspection range, and the identification information of the component may be the serial number of the component, which is used to characterize the position of the component in the fixture.

[0052] S25: Outputting a defect detection result corresponding to the target object according to the determined positioning information and the first image.

[0053] In one embodiment of the present application, in order to improve the readability of the defect detection results, a defect detection report can be generated based on the determined positioning information and the first image. Specifically, a defect detection report corresponding to the target object is output based on the determined positioning information and the first image; wherein the defect detection report is used to record the position information of the defective target object in the preset coordinate system, and is also used to record the position information of the defective sub-target in the target object. For example, the target positioning information and the target first image can be formatted based on a pre-stored prompt template to obtain prompt data corresponding to the defective target object, and the prompt data is input into a pre-trained generative model to obtain a defect detection result. wherein the defect detection report is used to record the position information of the defective target object in the preset coordinate system.

[0054] Specifically, a defect detection report can be generated based on the number of the target object and the number of the sub-target therein. Since the inspection range is usually relatively wide, and the information of the target object and sub-target collected in a short period of time is relatively large, it is difficult to analyze the collected second image in real time, and it is also difficult to obtain the defect detection results in real time. Therefore, when generating a defect detection report, the number of the target object (for example, the battery module) obtained in real time and the corresponding timestamp can be bound, and the target object within the inspection range, the corresponding position of the target object, and the defective sub-target are presented to the customer in the form of a two-dimensional plane map. The format of the defect detection report can be a text format (for example, a Word document) or a mixed format of text and images (for example, a PDF document).

[0055] For example, Figure 5The figure shows a schematic diagram of a defect detection report provided by an embodiment of the present application. Among them, the inspection range of the defect detection report 500 includes battery module 510, battery module 520, battery module 530, battery module 540, battery module 550, battery module 560, battery module 570, battery module 580, and battery module 590. Among them, each battery module includes 16 batteries, and the 16 batteries in each battery module are arranged in the form of 4 rows and 4 columns. The defect detection report 500 is used to show the user the defective battery modules and defective batteries within the inspection range according to the two-dimensional plane information therein. For example, the defective battery modules in the defect detection report 500 include battery module 510, battery module 520, battery module 530, and battery module 540; the battery in the second row and second column of battery module 510 is a defective battery; the battery in the third row and third column of battery module 520 is a defective battery; the battery in the fourth row and fourth column of battery module 530 is a defective battery; and the battery in the first row and first column of battery module 540 is a defective battery. In this way, the two-dimensional plane information in the defect detection report can be used to intuitively display the defective battery modules and the positions of the batteries in the inspection range to the user, thereby improving the efficiency of maintaining the batteries in the inspection range.

[0056] In one embodiment of the present application, the target positioning information and the target first image corresponding to the defective target object can be arranged in order from early to late according to the second timestamps to obtain the defect detection result, wherein the defect detection result is used to characterize the specific location of the defective target object within the inspection range.

[0057] In this way, a defect detection result including the location information of the target object can be provided to the user, and the defect detection result can show the location information of the target object with defects within the inspection range, thereby improving the accuracy of defect detection on the target object.

[0058] It can be seen from the above technical solutions that the embodiment of the present application first obtains the positioning information of the vehicle-mounted detection equipment and the first image around the vehicle-mounted detection equipment in real time, and obtains the second image including the target object in real time, so that the position information of each target object within the inspection range is recorded in the process of defect detection of the target object, which provides data support for the subsequent generation of defect detection results. Then, the target image including the defect of the target object is determined from the second image, and the target timestamp with the smallest time difference is determined according to the target second timestamp corresponding to the target image, and finally the corresponding positioning information and first image are determined according to the target timestamp to generate the defect detection result. Thereby, the readability of the defect detection result can be improved, and the specific location of the target object with defects can be characterized based on the target positioning information and the target first image in the defect detection result, thereby improving the accuracy of defect detection.

[0059] like Figure 4 As shown, it is a flow chart of a method for controlling the movement of a vehicle-mounted detection device provided in an embodiment of the present application. According to different requirements, the order of the steps in the flow chart can be changed, and some steps can be omitted. The method for controlling the movement of a vehicle-mounted detection device provided in an embodiment of the present application includes the following steps.

[0060] S30: Determine the current position of the vehicle-mounted detection device according to the positioning information and the first image.

[0061] In one embodiment of the present application, in order to ensure that the vehicle-mounted detection equipment can move within a preset inspection range, the current position of the vehicle-mounted detection equipment can be determined in real time based on the real-time acquired positioning information and the first image, and subsequently the vehicle-mounted detection equipment can be controlled to move within the preset inspection range based on the current position of the vehicle-mounted detection equipment.

[0062] In one embodiment of the present application, determining the current position of the vehicle-mounted detection equipment based on the positioning information and the first image includes: determining the position information of the positioning device in a preset coordinate system as the position information of the vehicle-mounted detection equipment in the preset coordinate system; determining the current position of the vehicle-mounted detection equipment based on the position information, edge features in the first image, and identification information in the first image.

[0063] Exemplarily, when the position information of the positioning device in the preset coordinate system is (1, 2), the position information of the vehicle-mounted detection equipment in the preset coordinate system is determined to be (1, 2); when the edge feature of the target object in the first image represents the target object number as "1239", and the identification information of the sub-target in the first image is "2345", it can be determined that the coordinates of the current position of the vehicle-mounted detection equipment in the preset coordinate system are (1, 2), and the target object closest to the current position of the vehicle-mounted detection equipment is numbered "1239", and the identification information of the sub-target in the target object is "2345".

[0064] S31, controlling the guiding device of the vehicle-mounted detection device based on the current position, so that the vehicle-mounted detection device moves within a preset inspection range.

[0065] In one embodiment of the present application, in order to ensure that the vehicle-mounted detection device can change the driving direction in time when it reaches the edge of the inspection range, the electronic device can control the vehicle-mounted detection device to move within the preset inspection range based on the current position of the vehicle-mounted detection device. Specifically, controlling the vehicle-mounted detection device to move within the preset inspection range based on the current position includes: controlling the guide device of the vehicle-mounted detection device according to the current position, the boundary of the preset inspection range, and the heading angle, so that the vehicle-mounted detection device moves within the preset inspection range.

[0066] In one embodiment of the present application, controlling the movement of the vehicle-mounted detection device within the preset inspection range based on the current position, the boundary of the preset inspection range and the heading angle includes: determining the distance between the current position and the boundary; determining a movement control instruction based on the distance, the heading angle and the size data of the vehicle-mounted detection device; and sending the movement control instruction to a guide device of the vehicle-mounted detection device so that the vehicle-mounted detection device moves within the preset inspection range.

[0067] Exemplarily, the vehicle-mounted detection device also includes a ranging sensor, which is used to send a ranging signal to obstacles around the vehicle-mounted detection device, and receive a response signal returned by the obstacle, determine the distance between the obstacle and the ranging sensor according to the response signal, and finally determine the category of the obstacle according to the distance. For example, the ranging sensor can be an ultrasonic sensor or a laser sensor. When the ranging sensor is an ultrasonic sensor, the ranging signal and the response signal are both ultrasonic signals; when the ranging sensor is a laser sensor, the ranging signal and the response signal are both laser signals. Among them, the obstacles at least include battery modules within the inspection range, and the obstacles also include boundary obstacles within the inspection range. Specifically, the battery modules within the inspection range have the same height, and the height of the battery modules is different from the height of the remaining obstacles. The ranging sensor continuously sends detection signals to the surrounding of the vehicle-mounted detection device according to a preset pitch angle, and receives the response signal returned by the obstacle in real time, determines the distance between the obstacle and the ranging sensor according to the response signal, and finally determines the category of the obstacle according to the distance. For example, when the response signal received at the first moment indicates that the distance between the obstacle and the ranging sensor is 5 centimeters, and the response signal received at the second moment indicates that the distance between the obstacle and the ranging sensor is 10 centimeters, it means that the obstacles around the vehicle-mounted detection equipment have changed. The electronic device can control the vehicle-mounted detection equipment to change the inspection direction to avoid obstacles by sending a preset control instruction to the vehicle-mounted detection equipment.

[0068] For example, when the distance between the current position of the vehicle-mounted detection device and the boundary of the preset inspection range in the due north direction is 5 cm, the heading angle is 0°, and the length and width of the vehicle-mounted detection device are both 5 cm, then when it is determined based on the above information that the vehicle-mounted detection device is at risk of touching the boundary of the inspection range, a movement control instruction for turning around or steering can be determined to the vehicle-mounted detection device, thereby controlling the vehicle-mounted detection device to change the driving direction. For example, the preset movement control instruction can adjust the vehicle-mounted detection device to turn left, turn right, or turn around.

[0069] See also Figure 6, is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device 100 includes a memory 12 and a processor 13. The memory 12 is used to store computer-readable instructions, and the processor 13 is used to execute the computer-readable instructions stored in the memory to implement a defect detection report generation method described in any of the above embodiments.

[0070] In an embodiment of the present application, the electronic device 100 further includes a bus, and a computer program stored in the memory 12 and executable on the processor 13, such as a defect detection program.

[0071] Figure 6 Only the electronic device 100 having the memory 12 and the processor 13 is shown, and those skilled in the art can understand that Figure 6 The structure shown does not constitute a limitation on the electronic device 100 , and the electronic device 100 may include fewer or more components than shown in the figure, or combine some components, or arrange the components differently.

[0072] Combination Figure 3 , the memory 12 in the electronic device 100 stores multiple computer-readable instructions to implement a defect detection report generation method, and the processor 13 can execute the multiple instructions to achieve: receiving multiple positioning information sent by the vehicle-mounted detection equipment during movement through the positioning device, and multiple first images sent by the first camera device; wherein each first image and each positioning information corresponds to a first timestamp; receiving multiple second images including the target object sent by the second camera device, each second image corresponds to a second timestamp; determining a target image including the defect of the target object from the second image; determining the second timestamp corresponding to the target image, and determining the target timestamp according to the second timestamp corresponding to the target image; determining the corresponding positioning information and the first image according to the target timestamp; outputting the defect detection report corresponding to the target object according to the determined positioning information and the first image; wherein the defect detection report is used to record the position information of the target object with defects in the preset coordinate system, and is also used to record the position information of the sub-target with defects in the target object in the target object.

[0073] Specifically, the specific implementation method of the processor 13 for the above instructions can refer to Figure 3 The description of the relevant steps in the corresponding embodiments will not be repeated here.

[0074] Those skilled in the art will appreciate that the schematic diagram is merely an example of the electronic device 100 and does not constitute a limitation on the electronic device 100. The electronic device 100 may be a bus-type structure or a star-type structure. The electronic device 100 may also include more or less other hardware or software than shown in the diagram, or a different arrangement of components. For example, the electronic device 100 may also include input and output devices, network access devices, etc.

[0075] It should be noted that the electronic device 100 is only an example, and other existing or future electronic products that are suitable for the present application should also be included in the protection scope of the present application and included here by reference.

[0076] Among them, the memory 12 includes at least one type of readable storage medium, and the readable storage medium can be non-volatile or volatile. The readable storage medium includes flash memory, mobile hard disk, multimedia card, card-type memory (for example: SD or DX memory, etc.), magnetic memory, disk, optical disk, etc. In some embodiments, the memory 12 can be an internal storage unit of the electronic device 100, such as a mobile hard disk of the electronic device 100. In other embodiments, the memory 12 can also be an external storage device of the electronic device 100, such as a plug-in mobile hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (FlashCard), etc. equipped on the electronic device 100. The memory 12 can not only be used to store application software and various types of data installed in the electronic device 100, such as a code of a defect detection program, etc., but also can be used to temporarily store data that has been output or is to be output.

[0077] In some embodiments, the processor 13 may be composed of an integrated circuit, for example, a single packaged integrated circuit, or a plurality of packaged integrated circuits with the same or different functions, including one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and a combination of various control chips. The processor 13 is the control core (Control Unit) of the electronic device 100, and uses various interfaces and lines to connect various components of the entire electronic device 100, and executes various functions of the electronic device 100 and processes data by running or executing programs or modules stored in the memory 12 (for example, executing a defect detection program, etc.), and calling data stored in the memory 12.

[0078] The processor 13 executes the operating system of the electronic device 100 and various installed applications. The processor 13 executes the applications to implement the steps in each of the above-mentioned defect detection report generation method embodiments, for example Figure 3 Steps shown.

[0079] Exemplarily, the computer program may be divided into one or more modules / units, which are stored in the memory 12 and executed by the processor 13 to complete the present application. The one or more modules / units may be a series of computer-readable instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program in the electronic device 100.

[0080] The above-mentioned integrated unit implemented in the form of a software function module can be stored in a computer-readable storage medium. The above-mentioned software function module is stored in a storage medium, and includes a number of instructions for enabling a computer device (which can be a personal computer, a computer device, or a network device, etc.) or a processor to execute a part of a defect detection report generation method described in each embodiment of the present application.

[0081] If the module / unit integrated in the electronic device 100 is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also instruct the relevant hardware devices to complete through a computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by the processor, the steps of each of the above-mentioned method embodiments can be implemented.

[0082] The computer program includes computer program code, which may be in source code form, object code form, executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory and other memory, etc.

[0083] Furthermore, the computer-readable storage medium may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function, etc.; the data storage area may store data created according to the use of the blockchain node, etc.

[0084] The bus can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. Figure 6 Only one arrow is used in the figure, but it does not mean that there is only one bus or one type of bus. The bus is configured to realize the connection and communication between the memory 12 and at least one processor 13, etc.

[0085] An embodiment of the present application also provides a computer-readable storage medium (not shown), in which computer-readable storage medium is stored computer-readable instructions, and the computer-readable instructions are executed by a processor in an electronic device to implement a defect detection report generating method described in any of the above embodiments.

[0086] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative, for example, the division of the modules is only a logical function division, and there may be other division methods in actual implementation.

[0087] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present application and are not intended to limit it. Although the present application has been described in detail with reference to the preferred embodiments, a person of ordinary skill in the art should understand that the technical solution of the present application may be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the present application.

Claims

1. A defect detection report generation method, applied to electronic equipment, characterized in that: The electronic device is communicatively connected to a vehicle-mounted detection device, the vehicle-mounted detection device includes a positioning device, a first camera device, and a second camera device, and the method includes: Receive multiple positioning information sent by the positioning device during the movement of the vehicle-mounted detection device, and multiple first images sent by the first camera device; wherein each first image and each positioning information corresponds to a first timestamp; wherein the positioning information includes: position information of the positioning device in a preset coordinate system; and a heading angle of the vehicle-mounted detection device; Determining the current position of the vehicle-mounted detection device according to the positioning information and the first image; controlling the vehicle-mounted detection device to move within a preset inspection range based on the current position, including: controlling a guide device of the vehicle-mounted detection device according to the current position, a boundary of the preset inspection range, and the heading angle, so that the vehicle-mounted detection device moves within the preset inspection range; Receiving a plurality of second images including the target object sent by the second camera device, each second image corresponding to a second timestamp; wherein the second timestamp is used to represent the time point when the second camera device captured the second image; determining a target image including a defect of the target object from the second image; Determine a second timestamp corresponding to the target image, and determine a target timestamp according to the second timestamp corresponding to the target image; Determine corresponding positioning information and a first image according to the target timestamp; A defect detection report corresponding to the target object is output according to the determined positioning information and the first image, wherein the first image includes texture information of the target object and identification information of a sub-target in the target object, and the identification information is used to characterize position information of the sub-target in the target object; wherein the first camera device is used to photograph the target object within the inspection range to obtain position information of the target object within the inspection range, and the defect detection report is used to record position information of the defective target object in the preset coordinate system, and is also used to record position information of a defective sub-target in the target object.

2. The defect detection report generation method according to claim 1, characterized in that: Determining the current position of the vehicle-mounted detection device according to the positioning information and the first image includes: Determine the position information of the positioning device in the preset coordinate system as the position information of the vehicle-mounted detection equipment in the preset coordinate system; The current position of the vehicle-mounted detection device is determined according to the position information, the edge features in the first image, and the identification information in the first image.

3. The defect detection report generation method according to claim 1, characterized in that: The controlling the guiding device of the vehicle-mounted detection device according to the current position, the boundary of the preset inspection range and the heading angle so that the vehicle-mounted detection device moves within the preset inspection range comprises: determining a distance between the current position and the boundary; Determine a movement control instruction according to the distance, the heading angle and the size data of the vehicle-mounted detection device; The movement control instruction is sent to the guide device of the vehicle-mounted detection equipment, so that the vehicle-mounted detection equipment moves within the preset inspection range.

4. The defect detection report generation method according to claim 1, characterized in that: The determining of the second timestamp corresponding to the target image, and determining the target timestamp according to the second timestamp corresponding to the target image comprises: Determine the second timestamp corresponding to the target image as the target second timestamp; determining a difference between the target second timestamp and each first timestamp; The first timestamp corresponding to the minimum difference is determined as the target timestamp.

5. A defect detection report generation system, characterized in that: The system comprises: An electronic device and an on-board detection device, wherein the electronic device is communicatively connected to the on-board detection device, and the on-board detection device comprises a positioning device, a first camera device, and a second camera device; The electronic device is used to receive a plurality of positioning information sent by the positioning device during the movement of the vehicle-mounted detection device, and a plurality of first images sent by the first camera device; wherein each first image and each positioning information corresponds to a first timestamp; wherein the positioning information includes: position information of the positioning device in a preset coordinate system; and a heading angle of the vehicle-mounted detection device; The electronic device is further used to determine the current position of the vehicle-mounted detection device according to the positioning information and the first image; and control the vehicle-mounted detection device to move within a preset inspection range based on the current position, including: controlling the guide device of the vehicle-mounted detection device according to the current position, the boundary of the preset inspection range, and the heading angle, so that the vehicle-mounted detection device moves within the preset inspection range; The electronic device is further used to receive a plurality of second images including the target object sent by the second camera device, each second image corresponding to a second timestamp; wherein the second timestamp is used to represent the time point when the second camera device captures the second image; The electronic device is further used to determine a target image including a defect of the target object from the second image; The electronic device is further used to determine a second timestamp corresponding to the target image, and determine a target timestamp according to the second timestamp corresponding to the target image; The electronic device is further used to determine corresponding positioning information and the first image according to the target timestamp; The electronic device is further used to output a defect detection report corresponding to the target object based on the determined positioning information and the first image, the first image including texture information of the target object and identification information of a sub-target in the target object, the identification information being used to characterize position information of the sub-target in the target object; wherein the first camera device is used to photograph the target object within the inspection range to obtain position information of the target object within the inspection range, the defect detection report is used to record position information of the defective target object in the preset coordinate system, and is also used to record position information of a defective sub-target in the target object in the target object.

6. An electronic device, characterized in that: The electronic device includes a processor and a memory, and the processor is used to implement the defect detection report generation method as described in any one of claims 1 to 4 when executing a computer program stored in the memory.