Inspection data processing method, device, electronic equipment and storage medium

Abstract

The embodiment of the present application discloses a patrol data processing method, device, electronic device and storage medium. The method includes receiving patrol data sent by an infrared imager, determining detection component information corresponding to each frame of infrared image, determining key frame images corresponding to the same detection component information from multiple frames of infrared images corresponding to the same detection component information, generating a patrol video based on the key frame images of each frame and non-key frame images other than the key frame images in the multiple frames of infrared images. The electronic device generates the patrol video based on the received multiple frames of infrared images. Since the patrol video carries the key frame information corresponding to each detection component information, it can help the user quickly locate the infrared image corresponding to each to-be-detected component in the patrol video, so that the user can quickly find the infrared image corresponding to the to-be-detected component that the user needs to find in the patrol video, thereby improving the user's search efficiency for patrol data and saving personnel's search time.

Description

Technical Field

[0001] The present application relates to the field of inspection technology, and in particular to an inspection data processing method, device, electronic device and storage medium. Background Art

[0002] In order to ensure the safe operation of the oil pipeline, regular inspection of the oil pipeline is an important task for the staff.

[0003] Currently, inspection personnel will carry infrared imagers to the oil pipeline site to take pictures. After the inspection, the inspection personnel will transfer a large number of infrared images taken by the infrared imager from the infrared imager to the terminal device for storage, so that users can view the infrared images collected during the inspection on the terminal device. Due to the large amount of infrared images collected during the inspection, it takes a lot of time for users to find the required infrared images, and the search efficiency is low. Summary of the invention

[0004] The embodiments of the present application disclose a method, device, electronic device and storage medium for processing inspection data, which can help users quickly find required infrared images, thereby improving the efficiency of users' search for inspection data.

[0005] The present application discloses a method for processing inspection data, the method comprising:

[0006] Receiving inspection data sent by the infrared imager; the inspection data at least includes a plurality of frames of infrared images acquired by the infrared imager, the infrared images being acquired by the infrared imager on the pipeline to be inspected;

[0007] Determine the detection component information corresponding to each frame of the infrared image, wherein the detection component information is used to identify the component to be detected in the pipeline to be detected;

[0008] Determining a key frame image corresponding to the same detection component information from a plurality of frames of infrared images corresponding to the same detection component information;

[0009] An inspection video is generated according to the key frame images of each frame and non-key frame images other than the key frame images in the multiple frames of infrared images. The inspection video carries the key frame information corresponding to the key frame images of each frame.

[0010] As an optional implementation, the component to be detected is provided with an inspection mark, and the inspection data further includes a plurality of detection component information, and the detection component information is obtained by the infrared imager scanning the inspection mark;

[0011] The step of determining the detection component information corresponding to each frame of the infrared image includes:

[0012] Acquire first transmission times respectively corresponding to the plurality of detection component information;

[0013] Acquire second transmission times respectively corresponding to the plurality of frames of infrared images;

[0014] Determine the target first transmission time according to the first transmission times respectively corresponding to the information of the plurality of detection components and the second transmission time corresponding to the first infrared image; wherein the first infrared image is any infrared image in the plurality of infrared images;

[0015] The detection component information corresponding to the first transmission time of the target is used as the detection component information corresponding to the first infrared image.

[0016] As an optional implementation, the inspection data further includes a plurality of acquisition position information corresponding to the infrared imager, and the acquisition position information is obtained by positioning the infrared imager through a positioning device of the infrared imager;

[0017] The step of determining the detection component information corresponding to each frame of the infrared image includes:

[0018] Acquire second transmission times respectively corresponding to the plurality of frames of infrared images;

[0019] Acquire third transmission times respectively corresponding to the plurality of collection location information;

[0020] Determine a target third transmission time according to the plurality of third transmission times and a second transmission time corresponding to a second infrared image; the second infrared image is any infrared image in the plurality of infrared image frames;

[0021] Matching the target collection location information corresponding to the target third transmission time with a plurality of preset location information, and determining the target preset location information with the highest matching degree with the target location information;

[0022] The preset component information corresponding to the preset target position information is determined, and the preset component information corresponding to the preset target position information is used as the detection component information corresponding to the second infrared image.

[0023] As an optional implementation, the method further includes:

[0024] When it is determined that the inspection task is completed, determining a target inspection route corresponding to the inspection task according to the multiple acquisition position information corresponding to the infrared imager;

[0025] Determine the inspection duration corresponding to the target inspection route;

[0026] If the current inspection duration is less than the historical inspection duration corresponding to the historical inspection route, the historical inspection route is updated to the target inspection route.

[0027] As an optional implementation, the method further includes:

[0028] Acquire second transmission times respectively corresponding to the plurality of frames of infrared images;

[0029] Receiving multiple frames of voiceprint images sent by a voiceprint imaging device, and determining a fourth transmission time corresponding to each frame of the voiceprint image;

[0030] Matching the second transmission time corresponding to each frame of the infrared image with the fourth transmission time corresponding to each voiceprint image to determine the voiceprint image matched by each frame of the infrared image;

[0031] According to the first preset weight corresponding to the infrared image and the second preset weight corresponding to the voiceprint image, each frame of the infrared image is fused with the matching voiceprint image.

[0032] As an optional implementation, the method further includes:

[0033] Acquire second transmission times respectively corresponding to the plurality of frames of infrared images;

[0034] receiving a plurality of gas concentration values ​​sent by the gas concentration detector, and determining a fifth transmission time corresponding to each of the gas concentration values;

[0035] Determine a third infrared image matching the first gas concentration value according to the fifth transmission time corresponding to the first gas concentration value and the second transmission time corresponding to the multiple frames of infrared images; wherein the first gas concentration value is any one of the multiple gas concentration values;

[0036] The first gas concentration value is marked on the third infrared image.

[0037] As an optional implementation, the inspection data further includes a plurality of image capture information;

[0038] The method further comprises:

[0039] According to the plurality of image interception information, determining, from the plurality of frames of infrared images, intercepted infrared images corresponding to the respective image interception information;

[0040] An image report corresponding to the first detection component information is generated according to the captured infrared image corresponding to the first detection component information and the first detection component information; the first detection component information is the detection component information of any component to be detected in the pipeline to be detected.

[0041] The present application discloses a patrol data processing device, the device comprising:

[0042] A data receiving module is used to receive inspection data sent by the infrared imager; the inspection data at least includes a plurality of infrared images acquired by the infrared imager, and the infrared images are acquired by the infrared imager on the pipeline to be inspected;

[0043] A component determination module, used to determine the detection component information corresponding to each frame of the infrared image, wherein the detection component information is used to identify the component to be detected in the pipeline to be detected;

[0044] A key determination module, used to determine a key frame image corresponding to the same detection component information from multiple frames of infrared images corresponding to the same detection component information;

[0045] The video generation module is used to generate an inspection video based on the key frame images of each frame and non-key frame images other than the key frame images in the multiple frames of infrared images, and the inspection video carries the key frame information corresponding to the key frame images of each frame.

[0046] An embodiment of the present application discloses an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor implements any one of the inspection data processing methods disclosed in the embodiment of the present application.

[0047] An embodiment of the present application discloses a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, any one of the inspection data processing methods disclosed in the embodiment of the present application is implemented.

[0048] Compared with the related art, the embodiments of the present application have the following beneficial effects:

[0049] The embodiment of the present application discloses a patrol data processing method, device, electronic device and storage medium. The electronic device can receive patrol data sent by an infrared imager, and the patrol data at least includes multiple frames of infrared images acquired by the infrared imager. The electronic device determines the detection component information corresponding to each frame of the infrared image, and determines the key frame image corresponding to the same detection component information from the multiple frames of infrared images corresponding to the same detection component information. The patrol video is generated according to the key frame images of each frame and the non-key frame images other than the key frame images in the multiple frames of infrared images. The electronic device generates the patrol video according to the received multiple frames of infrared images. Since the patrol video carries the key frame information corresponding to each detection component information, the user can quickly locate the infrared image corresponding to each to-be-detected component in the patrol video, so that the user can quickly find the infrared image corresponding to the to-be-detected component that the user needs to find in the patrol video, thereby improving the user's search efficiency for patrol data and saving personnel's search time. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0051] Figure 1 It is a scenario diagram of a method for processing inspection data disclosed in an embodiment of the present application;

[0052] Figure 2 It is a flowchart of a method for processing inspection data disclosed in an embodiment of the present application;

[0053] Figure 3 This is a schematic diagram of an inspection interface disclosed in an embodiment of the present application;

[0054] Figure 4 It is a schematic diagram of an inspection video playback disclosed in an embodiment of the present application;

[0055] Figure 5 It is an image report corresponding to the detection component information disclosed in the embodiment of the present application;

[0056] Figure 6 It is a flowchart of another inspection data processing method disclosed in an embodiment of the present application;

[0057] Figure 7 It is a flowchart of another inspection data processing method disclosed in an embodiment of the present application;

[0058] Figure 8 is a schematic diagram of a labeled infrared image disclosed in an embodiment of the present application;

[0059] Fig. 9 It is a structural schematic diagram of a patrol data processing device disclosed in an embodiment of the present application;

[0060] Fig.10 It is a structural schematic diagram of an electronic device disclosed in an embodiment of the present application. DETAILED DESCRIPTION

[0061] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0062] It should be noted that the terms "including" and "having" and any variations thereof in the embodiments of the present application and the accompanying drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0063] Oilfield refers to a specific area where crude oil is produced. Oilfields generally produce oilfield gas, which is generally transported to the destination through oil pipeline systems, such as liquefied petroleum gas storage and distribution stations. The oil pipeline system, that is, the pipeline system used to transport crude oil and crude oil products, is mainly composed of oil pipelines, oil stations and other auxiliary related equipment. It is one of the main equipment in the crude oil storage and transportation industry, and it is also the most important transportation equipment for crude oil and crude oil products. Compared with railway and road oil transportation, which are also land transportation methods, pipeline oil transportation has the characteristics of large transportation volume, good airtightness, low cost and high safety factor.

[0064] However, gas leakage in oil pipelines may cause environmental pollution and safety risks. In order to ensure the safe operation of oil pipelines, regular inspections are required. In particular, parts of oil pipelines that are prone to leakage, such as valves and connection interfaces, are inspected. Currently, inspectors carry infrared imagers to the oil pipeline site for shooting. After the inspection, the inspectors transmit a large number of infrared images taken by the infrared imager to the terminal device for storage. However, when information about a certain part on the oil pipeline is needed, the user needs to find the infrared image corresponding to the part in a large number of infrared images in order to determine the information of the part, which takes a lot of time.

[0065] The embodiments of the present application disclose a method, device, electronic device and storage medium for processing inspection data, which can improve the efficiency of users' search for inspection data.

[0066] Please refer to Figure 1 , which shows a scenario diagram of a method for processing inspection data provided by an embodiment of the present application. Figure 1 As shown, the inspection data processing system may include an infrared imager 110 and an electronic device 120, which is connected to the infrared imager 110 in communication. The infrared imager 110 can collect infrared images of the pipeline to be inspected, and send the collected infrared images to the electronic device 120. The electronic device 120 can receive the inspection data sent by the infrared imager 110. During the entire inspection process, the inspection personnel can control the infrared imager 110 to be in the recording mode, so that the infrared imager 110 can collect multiple frames of infrared images corresponding to the pipeline to be inspected 130 during the entire inspection process. The infrared imager 110 can send the collected multiple frames of infrared images to the electronic device 120 in real time, without sending them to the electronic device 120 after the inspection is completed. The infrared imager 110 can send all the collected infrared images to the electronic device 120, and can also selectively send part of the infrared images to the electronic device 120. The pipeline to be inspected 130 may include multiple components to be inspected 131, such as valves, connection interfaces, etc. The inspection of the pipeline to be inspected 130 is mainly to determine the conditions of the components to be inspected 131.

[0067] Optionally, the infrared imager 110 may include a display screen, and the infrared image captured by the infrared imager 110 is displayed on the display screen, so that the inspection personnel can timely understand the situation of the pipeline to be inspected 130. Optionally, the electronic device 120 may store an inspection route, and the electronic device 120 may send the inspection route to the infrared imager 110, so that the inspection personnel can inspect the pipeline to be inspected 130 based on the inspection route. Exemplarily, the inspection route includes multiple inspection points, and the inspection points correspond to the components to be inspected 131.

[0068] Optionally, the infrared imager 110 may also include a positioning device, which is used to detect the position of the infrared imager 110 and generate the acquisition position information corresponding to the infrared imager 110. It is understandable that the acquisition position information corresponding to the infrared imager 110 may refer to the position information corresponding to the infrared imager 110. The positioning device may include but is not limited to a Beidou locator, a GPS (Global Positioning System) locator or an RTK (Real-time kinematic) positioning sensor, etc. The RTK positioning sensor uses carrier phase differential GPS technology to achieve real-time positioning, and the two measurement methods of differential correction and carrier phase ranging enable the accuracy of dynamic positioning to reach the centimeter level.

[0069] Optionally, the inspection data processing system may also include a voiceprint imager 140, which is in communication with the electronic device 120. The working principle of the voiceprint imager 140 is based on the physical properties of sound waves, and uses a series of high-precision MEMS (Micro-Electro-Mechanical System) digital microphone arrays to capture sound waves and form a voiceprint map. The voiceprint imager 140 can send the voiceprint map to the electronic device 120, and the electronic device 120 can receive the voiceprint map and fuse the voiceprint map with the matching infrared image to obtain a fused infrared image corresponding to the infrared image. Optionally, the microphone array includes multiple microphones, which are precisely arranged in the voiceprint imager so as to be able to receive sound waves from different angles and positions. Optionally, the voiceprint imager 140 can also be connected to the infrared imager 110 for communication, and the voiceprint imager 140 can also send the voiceprint image to the infrared imager 110. The infrared imager 110 receives the voiceprint image and fuses the voiceprint image with the matching infrared image to obtain a fused infrared image corresponding to the infrared image, and displays it through the display screen of the infrared imager 110.

[0070] Optionally, the inspection data processing system may also include one or more gas concentration detectors 150, which can be used to detect the gas concentration of the target gas, and each gas concentration detector 150 is evenly connected to the electronic device 120 for communication. The gas concentration detector 150 can send the detected gas concentration to the electronic device 120, and the electronic device 120 can mark the gas concentration value on one or more matching infrared images to obtain a marked infrared image, so that the user can obtain the information detected by the infrared imager 110 and the information detected by the gas concentration detector 150 according to the marked image. Exemplarily, the gas concentration detector 150 may include but is not limited to an inhalation concentration detector, a PID (Photo Ionization Detector), etc. It should be noted that the infrared imager 110 has a wide detection range and the gas concentration detector 150 has a high detection accuracy. By combining the detection results of the two detection instruments, more accurate detection information can be obtained.

[0071] Optionally, the inspection data processing system includes equipment with a higher explosion-proof level, such as the infrared imager 110, the voiceprint imager 140, the gas concentration detector 150, etc. The circuits are explosion-proof circuits, and the working voltage and working power of the above equipment are lower than the target threshold corresponding to the explosion-proof level, meeting the safety requirements of the inspection and ensuring that the inspection data processing system can be used in a cold environment. The cold environment may refer to an environment with a temperature less than or equal to 0°C.

[0072] Please refer to Figure 2 , which shows a flow chart of a method for processing inspection data provided by an embodiment of the present application, such as Figure 2 As shown, the inspection data processing method may include steps 202 to 208 .

[0073] Step 202: receiving inspection data sent by the infrared imager.

[0074] Among them, the inspection data at least includes multiple frames of infrared images, which are collected by the infrared imager on the pipeline to be inspected. It should be noted that the pipeline to be inspected may include but is not limited to oil pipelines, gas pipelines, etc. Optionally, the infrared imager may be a handheld infrared imager, which can receive the inspection route sent by the electronic device and display the inspection route through a display screen. The inspection personnel can inspect the pipeline to be inspected according to the inspection route displayed by the infrared imager, and collect infrared images of the pipeline to be inspected through the infrared imager during the inspection process to obtain multiple frames of infrared images corresponding to the pipeline to be inspected. It can be understood that the pipeline to be inspected includes multiple components to be inspected, and the multiple frames of infrared images include one or more frames of infrared images corresponding to each component to be inspected. The multiple frames of infrared images corresponding to each component to be inspected include infrared images corresponding to multiple angles of the component to be inspected. By collecting infrared images corresponding to multiple angles of the component to be inspected, the multi-angle infrared information of the component to be inspected can be understood to ensure that reliable inspection data is obtained.

[0075] Step 204: Determine the detection component information corresponding to each frame of infrared image.

[0076] The detection component information is used to identify the components to be detected in the pipeline to be detected. It should be noted that the components to be detected may include components that are prone to leakage in the pipeline to be detected. Exemplarily, the components to be detected may include but are not limited to valves and connection interfaces. The valves may include ball valves, cut-off valves, gate valves, etc. The detection component information corresponds to the components to be detected one by one, and the detection component information corresponding to the components to be detected may include the name of the components to be detected, the equipment type, etc.

[0077] Optionally, each component to be detected may be provided with an inspection mark, which is used to identify the detection component information of the component to be detected. The infrared imager may also scan the inspection mark to obtain the detection component information corresponding to the inspection mark. The infrared imager may also send the obtained detection component information to the electronic device. Exemplarily, the inspection mark may include but is not limited to a QR code, a barcode, etc. In an optional embodiment, the inspection data may also include multiple components to be detected information, which are obtained by the infrared imager scanning the inspection mark. Determining the detection component information corresponding to each frame of infrared image may include: the electronic device obtains the first transmission time corresponding to multiple preset component information, and obtains the second transmission time corresponding to multiple frames of infrared images, and the electronic device determines the target first transmission time according to the first transmission time corresponding to the multiple detection component information, and the second transmission time corresponding to the first infrared image. The electronic device uses the detection component information corresponding to the target first transmission time as the detection component information corresponding to the first infrared image. Wherein, the first infrared image is any infrared image in the multiple frames of infrared images. It should be noted that the first transmission time corresponding to the detection component information may refer to the transmission time corresponding to the detection component information, the second transmission time corresponding to the infrared image may refer to the transmission time corresponding to the infrared image, and the detection component information corresponding to the target first transmission time may refer to the detection component information whose transmission time is the target first transmission time. Among them, the transmission time may include the sending time or the receiving time. Exemplarily, the infrared imager may send a first timestamp when sending the detection component information to the electronic device, and the electronic device may use the first timestamp as the first transmission time corresponding to the preset component information, and the infrared imager may also send a second timestamp when sending the infrared image to the electronic device, and the electronic device may use the second timestamp as the second transmission time corresponding to the infrared image. Exemplarily, the electronic device may also record the current time when receiving the preset component information, and use the current time as the first transmission time corresponding to the preset component information. The electronic device may also record the current time when receiving the infrared image, and use the current time as the second transmission time corresponding to the infrared image.

[0078] In other examples, before obtaining the infrared image corresponding to the component to be detected, the inspection personnel first use an infrared imager to scan the inspection mark to obtain the detection component information, and send the detection component information to the electronic device, and then collect the component to be detected to obtain one or more infrared images corresponding to the component to be detected, and send them to the electronic device. Optionally, the target first transmission time is determined as the first transmission time that is before the second transmission time corresponding to the first infrared image and has the smallest absolute value of the difference with the second transmission time corresponding to the first infrared image. The electronic device determines the target first transmission time based on the first transmission times corresponding to the multiple detection component information and the second transmission time corresponding to the first infrared image, which may include: the electronic device determines the target first transmission time that is before the second transmission time corresponding to the first infrared image and has the smallest difference with the second transmission time corresponding to the first infrared image from the multiple first transmission times. In this embodiment, the infrared imager first obtains the detection component information, and then collects the infrared image of the component to be detected corresponding to the detection component information. Therefore, the first transmission time that is before the second transmission time corresponding to the first infrared image and has the smallest absolute value of the difference with the second transmission time corresponding to the first infrared image can be determined as the target transmission time corresponding to the first infrared image, and the detection component information corresponding to the target first transmission time is used as the detection component information corresponding to the first infrared image. The electronic device can automatically and accurately determine the detection component information corresponding to each infrared image, thereby improving the efficiency of generating inspection videos.

[0079] In other examples, the inspection personnel may first use an infrared imager to collect infrared images of the inspection component, obtain one or more infrared images corresponding to the component to be inspected, and send them to the electronic device. After collecting all the required infrared images corresponding to the component to be inspected, the inspection personnel may use the infrared imager to scan the inspection mark of the component to be inspected, obtain the inspection component information, and send the inspection component information to the electronic device. In this case, the target first transmission time can be determined as the first transmission time that is after the second transmission time corresponding to the first infrared image and has the smallest absolute value of the difference with the second transmission time corresponding to the first infrared image.

[0080] In this embodiment, the infrared imager has an inspection mark recognition device, and the infrared imager sends the collected infrared image and detection component information to the electronic device, so that the electronic device can automatically determine the binding of the infrared image and the detection component information based on the second transmission time corresponding to the multiple frames of infrared images and the first transmission time corresponding to the multiple detection component information, thereby improving accuracy and reducing labor.

[0081] In an optional embodiment, the inspection data may also include multiple acquisition position information corresponding to the infrared imager, wherein the acquisition position information is obtained by positioning the infrared imager through the positioning device of the infrared imager, that is, the acquisition position information can be used to indicate the position of the infrared imager. Determining the detection component information corresponding to each frame of infrared image may include: the electronic device obtains the second transmission time corresponding to the multiple frames of infrared images, and obtains the third transmission time corresponding to the multiple acquisition position information, and determines the target third transmission time according to the multiple third transmission times and the second transmission time corresponding to the second infrared image. The electronic device matches the target acquisition position information corresponding to the target third transmission time with the multiple preset position information, determines the target preset position information with the highest matching degree with the target position information, determines the preset component information corresponding to the target preset position information, and uses the preset component information corresponding to the target preset position information as the detection component information corresponding to the second infrared image. The second infrared image is any infrared image in the multiple frames of infrared images. It should be noted that the electronic device may pre-store multiple preset position information and multiple preset component information corresponding to the multiple preset position information. The multiple preset position information corresponds to the positions of multiple components to be detected. The electronic device may calculate the distance between the position corresponding to the target position information and the position corresponding to each preset position information, and determine the preset position information with the smallest distance to the position corresponding to the target acquisition position information as the target preset position information. Exemplarily, the target position information may include a first coordinate (x1, y1, z1), the preset position information may include a second coordinate (x2, y2, z2), and the distance between the position corresponding to the target position information and the position corresponding to each preset position information

[0082]

[0083] It should be noted that the infrared imager can send the collection position information to the electronic device according to preset rules, such as according to preset time intervals, or in response to the operation of the inspection personnel. Optionally, the infrared imager also includes a positioning button. When the inspection personnel arrive at the inspection point corresponding to the component to be inspected, they can perform a trigger operation to trigger the positioning button. In response to the trigger operation, the infrared imager sends the collection position information obtained by the positioning device to the electronic device. In this embodiment, the electronic device receives the collection position information of the infrared imager, matches the collection position information with multiple preset position information, determines the preset position information that matches each collection position information, and then automatically matches the infrared image collected by the infrared imager with the preset component information.

[0084] In an optional embodiment, when the electronic device determines that the inspection task is finished, the electronic device may determine whether there is a first preset position information in the multiple preset position information, based on the multiple acquisition position information and multiple preset position information corresponding to the infrared imager, whose matching degree with all the acquisition position information is less than the matching degree threshold, and output a prompt message if the first preset position information exists. The prompt message is used to prompt that there is a missed inspection in the current inspection task. It should be noted that in the process of performing the inspection task, the inspection personnel may fail to collect infrared images of one or some of the components to be inspected. The matching degree threshold is used to measure whether the position corresponding to the first preset position information is too far from the position corresponding to the acquisition position information. If the matching degree between the preset position information and the acquisition position information is less than the first preset matching degree threshold, it means that the distance between the position corresponding to the acquisition position information and the position corresponding to the preset position information is too far. If the degree of match between the preset location information and all the collected location information is less than the first preset matching degree threshold, it means that the inspection personnel may not have reached the position corresponding to the preset location information during the entire process of executing the inspection task. Therefore, it can be determined that the inspection personnel have missed the inspection and output a prompt message to promptly remind the user that a missed inspection has occurred, thereby improving the reliability of the inspection.

[0085] Optionally, the electronic device may send a historical inspection route to the infrared imager. The historical inspection route may be pre-stored in the electronic device. The historical inspection route is used to provide guidance for the inspection of the inspection personnel. However, the environment of the pipeline to be inspected may change, such as the construction of a new road, etc. Therefore, the inspection personnel may choose to inspect the pipeline to be inspected through the new road according to the actual situation. In an optional embodiment, the inspection data processing method may also include that the electronic device, when determining that the inspection task is completed, determines the target inspection route corresponding to the inspection task according to the multiple acquisition position information corresponding to the infrared imager, and determines the inspection time corresponding to the target inspection route. If the inspection time is less than the inspection time corresponding to the historical inspection route, the historical inspection route is updated to the target inspection route. It should be noted that the inspection time is the time corresponding to the execution of the inspection task, and the historical inspection time may be the time spent on inspecting the pipeline to be inspected based on the historical inspection route. The electronic device can determine the target inspection route corresponding to the inspection task based on the multiple acquisition location information sent by the infrared imager, and determine the inspection time corresponding to the inspection task, and compare the inspection time with the historical inspection time. If the inspection time is less than the historical inspection time corresponding to the historical inspection route, the historical inspection route is updated to the target inspection route. The next time the pipeline to be inspected is inspected, the electronic device can send the target inspection route to the infrared imager so that the inspection personnel can inspect based on the inspection route with higher inspection efficiency, thereby automatically updating the inspection route and improving the inspection efficiency. It is understandable that if the inspection time is greater than or equal to the historical inspection time corresponding to the historical inspection route, the historical inspection route is maintained, that is, the electronic device does not change the stored historical inspection route.

[0086] Optionally, determining the inspection duration corresponding to the target inspection route may include: the electronic device determines the inspection duration corresponding to the target inspection route according to the difference between the sixth transmission time corresponding to the pipeline to be inspected and the seventh transmission time corresponding to the pipeline to be inspected. The sixth transmission time is the transmission time corresponding to the first frame of the infrared image corresponding to the pipeline to be inspected, and the seventh transmission time is the transmission time corresponding to the last frame of the infrared image corresponding to the pipeline to be inspected. Optionally, the inspection duration corresponding to the target inspection route may be the difference between the sixth transmission time and the seventh transmission time.

[0087] Exemplarily, the display interface of the infrared imager may include an end control, and / or the infrared imager includes a screen-off button. When the electronic device detects that the end control and / or the screen-off button is triggered, the electronic device determines that the inspection task is finished. Exemplarily, when the electronic device receives the collection location information that matches the preset end location information, it determines that the inspection task is finished. It should be noted that the user can determine the end location of the inspection, and store the preset end location information corresponding to the end location in the electronic device in advance. The electronic device can determine the distance between the position corresponding to the collection location information and the position corresponding to the inspection end location information, thereby determining the matching degree between the collection location information and the inspection end location information. If the matching degree is greater than or equal to the second matching degree, it is considered that the collection location information matches the inspection end location information, and the inspection task is determined to be finished.

[0088] In this embodiment, the electronic device can determine the target inspection route corresponding to the inspection task based on multiple collected location information, and when the current inspection duration corresponding to the target inspection route is less than the historical inspection duration corresponding to the historical inspection route, the historical inspection route is updated to the target inspection route, so that the inspection duration corresponding to the inspection route received by the infrared imager is relatively short, thereby improving the inspection efficiency and flexibility of the inspection personnel.

[0089] Optionally, the electronic device may also send a plurality of preset component information to the infrared thermal imager, and the infrared imager displays the preset component information. Figure 3 , which shows a schematic diagram of an inspection interface provided by an embodiment of the present application. When the inspection personnel arrive at the detection position of the component to be detected corresponding to the current preset component information, they can perform a selection operation to select the current preset component information. In response to the selection operation, the infrared imager sends the current preset component information to the electronic device. Then the inspection personnel use the infrared thermal imager to collect the component to be detected corresponding to the current preset component information. When the collection is completed, move to the detection point of the component to be detected corresponding to the next preset component information, and repeat the above steps. The electronic device will determine the detection component information corresponding to the received multiple frames of infrared images before receiving the next preset component information as the current preset component information. The infrared imager also sends the transmission time corresponding to the preset component information to the electronic device, and the electronic device saves the transmission time corresponding to each preset component information, so that the user can determine the inspection time of the component to be inspected.

[0090] Step 206: Determine a key frame image corresponding to the same detection component information from the multiple frames of infrared images corresponding to the same detection component information.

[0091] Step 208 : Generate an inspection video based on each key frame image and non-key frame images other than the key frame images in the multiple infrared image frames.

[0092] Among them, the inspection video carries the key frame information corresponding to each key frame image. It should be noted that the inspection video may include video content and key frame information, and the key frame information may be used to indicate the position of the key frame image corresponding to the detection component information in the video content. The electronic device may determine the key frame image from multiple frames of infrared images corresponding to the same detection component information, and generate the inspection video according to the multiple frames of key frame images and multiple frames of non-key frame images, so that the user can quickly locate the video content corresponding to the required component to be detected from the video content. Exemplarily, the electronic device may form the video content from front to back according to the transmission time corresponding to the multiple frames of infrared images, so that the video content can reflect the inspection process of the inspection personnel. Exemplarily, the key frame image corresponding to the detection component information may refer to the first frame of infrared image in the multiple frames of infrared images corresponding to the same detection component information, that is, the infrared image with the earliest transmission time in the multiple frames of infrared images corresponding to the detection component information, and the key frame image may also refer to the last frame of infrared image in the multiple frames of infrared images corresponding to the same detection component information, that is, the infrared image with the last transmission time in the multiple frames of infrared images corresponding to the detection component information.

[0093] For example, please refer to Figure 4 , which shows a schematic diagram of a patrol video playback provided by an embodiment of the present application. Figure 4 As shown, a progress bar key frame 411 is formed in the progress bar 410, and multiple progress bar key frames 411 correspond to key frame images corresponding to multiple detection component information. When the progress bar key frame 411 of the detection component information is triggered (such as clicked), the key frame image corresponding to the detection component information in the video content can be located. Exemplarily, the electronic device can also display the total number of frames of the inspection content and the current number of frames currently displayed. Please continue to refer to Figure 4 , the total number of frames is 3300 and the current number of frames is 1317.

[0094] In some embodiments, in order to improve the reliability of inspection, in addition to using an infrared imager to collect data from the pipeline to be inspected, a voiceprint imager and / or a gas concentration detector can also be used to collect data from the pipeline to be inspected. In one embodiment, the electronic device can use the voiceprint image and / or gas concentration value collected by the voiceprint imager and / or the gas concentration detector to process multiple frames of infrared images to obtain processed multiple frames of infrared images, and determine the key frame images corresponding to the same detection component information from the processed multiple frames of infrared images, and generate an inspection video based on the key frame images of each frame, and the non-key frame images in the processed multiple frames of infrared images except the key frame images.

[0095] In another embodiment, the electronic device may first determine the key frame images from multiple frames of infrared images, and then use the voiceprint image and / or gas concentration value collected by the voiceprint imager and / or the gas concentration detector to process the key frame images and non-key frame images to obtain the processed key frame images of each frame and the processed multiple frames of non-key frame images, and then use the processed key frame images of each frame and the processed multiple frames of non-key frame images to generate an inspection video.

[0096] Optionally, the infrared imager may further include an interception button. When the infrared imager detects that the interception button is triggered, it generates image interception information, and the image interception information is used to indicate the infrared image used to generate the image report. When the inspection personnel moves the infrared imager toward the infrared image of the target angle of the component to be inspected, the inspection personnel can press the interception button, and the electronic device generates image interception information corresponding to the frame of infrared image in response to the interception operation. The image interception information is used to indicate that the infrared image of the target angle of the component to be inspected is used to generate the image report. In an optional embodiment, the inspection data processing method may also include that the electronic device determines the intercepted infrared image corresponding to each image interception information from multiple frames of infrared images based on multiple image interception information, and generates an image report corresponding to the first detection component information based on the intercepted infrared image corresponding to the first detection component information and the first detection component information. Wherein, the first detection component information is the detection component information of any component to be inspected in the pipeline to be inspected. For example, please refer to Figure 5 , which shows the image report corresponding to the detection component information. The detection component information may include the device name of the component to be detected, and the captured infrared image is the infrared image of each target angle of the component to be detected. In this embodiment, the electronic device can also generate image reports corresponding to each detection component information according to the image capture information, so that the user can obtain the image report, further improve the richness of the inspection results, and facilitate the user to quickly find the required information of the component to be detected. At the same time, the electronic device also generates an inspection video. When the infrared image in the image report is not clear, the position of the infrared image corresponding to the component to be detected in the inspection video can be quickly located according to the key frame information to obtain a clear infrared image, reduce the time required for the user to search, and improve the user experience.

[0097] In an embodiment of the present application, an electronic device can receive inspection data sent by an infrared imager, where the inspection data includes at least multiple frames of infrared images acquired by the infrared imager. The electronic device determines the detection component information corresponding to each frame of the infrared image, determines the key frame image corresponding to the same detection component information from the multiple frames of infrared images corresponding to the same detection component information, and generates an inspection video based on the key frame images of each frame and non-key frame images other than the key frame images in the multiple frames of infrared images. The electronic device generates an inspection video based on the received multiple frames of infrared images. Since the inspection video carries the key frame information corresponding to each detection component information, it can help the user quickly locate the infrared image corresponding to each component to be detected in the inspection video, so that the user can quickly find the infrared image corresponding to the component to be detected that the user needs to find in the inspection video, thereby improving the user's search efficiency for inspection data and saving personnel's search time.

[0098] Please refer to Figure 6 , which shows a flow chart of another inspection data processing method provided by an embodiment of the present application, such as Figure 6 As shown, the flowchart of the inspection data processing method includes steps 602 to 616.

[0099] Step 602: Receive inspection data sent by the infrared imager.

[0100] It should be noted that for the description of step 602, please refer to the description of step 202, which will not be repeated here.

[0101] Step 606, obtaining second transmission times corresponding to the plurality of frames of infrared images.

[0102] It should be noted that the second transmission time corresponding to the infrared image refers to the transmission time corresponding to the infrared image, such as the time when the electronic device receives the infrared image, or the time when the infrared imager sends the infrared image to the electronic device, or the time when the infrared imager generates the infrared image.

[0103] Step 606: Determine the detection component information corresponding to each frame of infrared image.

[0104] The detection component information is used to identify the components to be detected in the pipeline to be detected. For the description of step 606, please refer to step 206, which will not be repeated here.

[0105] Step 608: Receive multiple voiceprint frames sent by the voiceprint imager, and determine a fourth transmission time corresponding to each voiceprint frame.

[0106] Step 610, matching the second transmission time corresponding to each frame of infrared image with the fourth transmission time corresponding to each voiceprint image, and determining the voiceprint image matched by each frame of infrared image.

[0107] It should be noted that the electronic device can be connected to the voiceprint imager for communication, and the fourth transmission time corresponding to the voiceprint image can refer to the transmission time corresponding to the voiceprint image, such as the time when the electronic device receives the voiceprint image, or the time when the voiceprint imager sends the voiceprint image to the electronic device, or the time when the voiceprint imager obtains the voiceprint image. The electronic device can determine the voiceprint image that matches each frame of infrared image sent by the infrared imager based on the second transmission time corresponding to the frame infrared image and the fourth transmission time corresponding to each voiceprint image. During the inspection process, one inspector can hold the infrared imager, and another inspector can hold the voiceprint imager. Therefore, the voiceprint image and infrared image with similar transmission time can be considered as the voiceprint image and infrared image collected at the same position. The voiceprint image and infrared image collected at the same position are fused, and the infrared image can be corrected using the voiceprint image to obtain a more accurate image that can reflect the condition of the pipeline to be inspected.

[0108] Step 612, according to the first preset weight corresponding to the infrared image and the second preset weight corresponding to the voiceprint image, each frame of the infrared image is fused with the matching voiceprint image to obtain a fused infrared image.

[0109] It should be noted that, considering that the detection accuracy of the infrared imager is higher than that of the voiceprint imager, the first preset weight can be set higher than the second preset weight to ensure the accuracy of the gas leakage concentration determined based on the fused infrared image. Exemplarily, the first preset weight may be greater than or equal to 0.7, and the second preset weight may be less than or equal to 0.3. Optionally, the first preset weight is 0.7 and the second preset weight is 0.3; or, the first preset weight is 0.8 and the second preset weight is 0.2; or, the first preset weight is 0.9 and the second preset weight is 0.1.

[0110] Step 616, determining a key frame image corresponding to the same detection component information from multiple frames of fused infrared images corresponding to the same detection component information.

[0111] Step 616: Generate an inspection video based on the key frame images and non-key frame images other than the key frame images in the multi-frame fused infrared image.

[0112] It should be noted that the fused infrared image is formed by the fusion of the infrared image and the matched voiceprint image. Therefore, in this embodiment, the detection component information corresponding to the fused infrared image can be considered as the detection component information corresponding to the infrared image, and the transmission time corresponding to the fused infrared image can be considered as the transmission time corresponding to the infrared image. The key frame image corresponding to the detection component information can refer to the first frame of infrared image in the multi-frame fused infrared images corresponding to the same detection component information, that is, the fused infrared image with the earliest transmission time in the multi-frame fused infrared images corresponding to the detection component information. The key frame image can also refer to the last frame of infrared image in the multi-frame fused infrared images corresponding to the same detection component information, that is, the fused infrared image with the latest transmission time in the multi-frame fused infrared images corresponding to the detection component information. The inspection content of the inspection video includes multiple frames of fused infrared images arranged from front to back according to the transmission time.

[0113] In this embodiment, the electronic device obtains an infrared image sent by an infrared imager and a voiceprint map sent by a voiceprint imager, and fuses each frame of the infrared image with the matching voiceprint map to obtain a fused infrared image, and then determines the key frame image corresponding to the same detection component information from the multiple frames of fused infrared images corresponding to the same detection component information, generates an inspection video based on the key frame image and non-key frame images other than the key frame images in the multiple frames of fused infrared images, and obtains the video content corresponding to the fused infrared image, so that the user can obtain a more accurate infrared image. At the same time, based on the key frame information, it can help the user quickly locate the fused infrared image corresponding to the required component to be detected, thereby improving the user's search efficiency and providing a sense of user experience.

[0114] In an optional embodiment, the inspection data processing method may further include: the electronic device determines the key frame image corresponding to the same detection component information from the multiple frames of infrared images corresponding to the same detection component information, obtains the second transmission time corresponding to the multiple frames of infrared images, receives the multiple frames of voiceprint images sent by the voiceprint imager, and determines the fourth transmission time corresponding to each frame of the voiceprint image, and determines the voiceprint image matching each frame of the infrared image by comparing the second transmission time corresponding to each frame of the infrared image with the fourth transmission time corresponding to each frame of the voiceprint image. According to the first preset weight corresponding to the infrared image and the second preset weight corresponding to the voiceprint image, each frame of the key frame image is fused with the matching voiceprint image to obtain the key frame image after fusion of each frame, according to the first preset weight corresponding to the infrared image and the second preset weight corresponding to the voiceprint image, each frame of the non-key frame image is fused with the matching voiceprint image to obtain the non-key frame image after fusion of each frame, and generates the inspection video according to the key frame image after fusion of each frame and the non-key frame image after fusion of each frame. In this embodiment, the electronic device first determines the key frame image corresponding to the same detection component information from multiple frames of infrared images corresponding to the same detection component information, and then fuses the key frame image and the non-key frame image with the matching voiceprint image respectively to obtain a fused key frame image and a fused non-key frame image, and generates an inspection video based on the fused key frame image and the fused non-key frame image.

[0115] Please refer to Figure 7 , which shows a flow chart of another inspection data processing method provided in an embodiment of the present application, such as Figure 7 As shown, the inspection data processing method may include steps 702 to 716.

[0116] Step 702: Receive inspection data sent by the infrared imager.

[0117] It should be noted that for the description of step 702, please refer to the description of step 202, which will not be repeated here.

[0118] Step 704: Obtain second transmission times corresponding to the plurality of frames of infrared images.

[0119] Step 706: Determine the detection component information corresponding to each frame of infrared image.

[0120] The detection component information is used to identify the components to be detected in the pipeline to be detected. It should be noted that for the description of steps 704 to 706, please refer to the description of steps 604 to 606, which will not be repeated here.

[0121] Step 708: Receive multiple gas concentration values ​​sent by the gas concentration detector, and determine the fifth transmission time corresponding to each gas concentration value.

[0122] It should be noted that in this embodiment, the number of gas concentration detectors may be greater than or equal to 1, and the electronic device is communicatively connected to each gas concentration detector. The fifth transmission time corresponding to the gas concentration value may refer to the transmission time corresponding to the gas concentration value, such as the time when the electronic device receives the gas concentration value, or the time when the gas concentration detector sends the gas concentration value to the electronic device, or the time when the gas concentration detector obtains the gas concentration value.

[0123] Step 710: Determine a third infrared image matching the first gas concentration value according to the fifth transmission time corresponding to the first gas concentration value and the second transmission times corresponding to the plurality of frames of infrared images.

[0124] Among them, the first gas concentration value is any gas concentration value among multiple gas concentration values, that is, the electronic device can determine the infrared image matching each gas concentration value, and the third infrared image is the infrared image matching the first gas concentration value. It should be noted that the inspection task can be performed by multiple inspectors together, one inspector can carry an infrared imager, and another inspector can carry a gas concentration detector. In the process of performing the inspection task, the infrared imager can be in a recording mode, that is, real-time acquisition of infrared images, and the inspector can trigger the gas concentration detector to detect the component to be detected when reaching the detection position of the component to be detected. Since the multiple inspectors perform the inspection task together, the difference between the gas concentration value corresponding to the same component to be detected and the transmission time of the infrared image is within a certain time range, so the third infrared image matching the first gas concentration value can be determined according to the fifth transmission time corresponding to the first gas concentration value and the second transmission time corresponding to the multiple frames of infrared images. Among them, the inspectors can use the infrared imager to collect infrared images of multiple target angles of the component to be detected, so the infrared image matching the first gas concentration value may have multiple frames. Exemplarily, determining a third infrared image matching the first gas concentration value according to the fifth transmission time corresponding to the first gas concentration value and the second transmission time corresponding to the plurality of frames of infrared images may include: the electronic device determines the target time range corresponding to the first gas concentration value according to the fifth transmission time corresponding to the first gas concentration value and the preset time range, and determines the infrared image whose corresponding second transmission time belongs to the target time range as the third infrared image matching the first gas concentration value. It should be noted that two adjacent components to be detected are at a certain distance, so there is a time difference between the infrared images of the two components to be detected. By reasonably setting the target time range, the infrared image corresponding to the component to be detected is marked with the gas concentration value corresponding to the same component to be detected.

[0125] Step 712: Mark the first gas concentration value on the third infrared image to obtain a marked third infrared image.

[0126] It should be noted that the inspection personnel may carry a gas concentration detector to the inspection position corresponding to the component to be inspected, and use the gas concentration detector to detect the gas leakage concentration corresponding to the component to be inspected. The electronic device can mark the gas leakage concentration at the target position of the infrared image, such as the upper left corner or upper right corner of the infrared image.

[0127] For example, please refer to Figure 8 , which shows a schematic diagram of a labeled infrared image provided by an embodiment of the present application. The infrared image includes text information, and the text information includes the type of gas concentration detector and the gas concentration value detected by the gas concentration detector. It should be noted that by marking the gas concentration value on one or more matching infrared image frames, the user can obtain the gas concentration value detected by the gas concentration detector when watching the video content, without the need for manual association by the user, thereby reducing the user's workload. Figure 8 As shown, the gas concentration values ​​detected by the PID and the inhalation concentration detector are displayed, which are A1 and A2 respectively.

[0128] Step 714, determining a key frame image corresponding to the same detection component information from the third infrared image after multiple frames of annotation corresponding to the same detection component information and the infrared images other than the third infrared image in the multiple infrared images corresponding to the same detection component information.

[0129] It should be noted that the electronic device can determine the key frame images corresponding to each detection component information. In this embodiment, the detection component information corresponding to the annotated third infrared image is the detection component information corresponding to the third infrared image. As described in the above embodiment, the infrared imager can turn on the recording mode, so there may be multiple frames of infrared images marking the same gas concentration value, and the infrared imager may capture parts of the pipeline to be detected other than the components to be detected, so there may be infrared images without marked gas concentration values. Taking the determination of the key frame image corresponding to the second detection component information as an example, the key frame image corresponding to the second detection component information is determined from the multiple frames of annotated third infrared images corresponding to the second detection component information, and the infrared images other than the third infrared image in the multiple frames of infrared images corresponding to the second detection component information.

[0130] In this embodiment, the key frame image may be the first marked infrared image of the infrared image in the same detection component information, or may be the last marked infrared image of the multiple marked infrared images in the same detection component information. It is understandable that the transmission time of the marked third infrared image is the transmission time of the third infrared image, and therefore, the first marked infrared image corresponding to the same detection component information may be determined based on the transmission time of the marked third infrared image and the transmission time of the infrared images other than the third infrared image in the multiple infrared images.

[0131] Step 716 , generating an inspection video based on each key frame image, non-key frame images other than the key frame images in the plurality of third infrared image frames, and non-key frame images other than the key frame images in the plurality of fourth infrared image frames.

[0132] The inspection video carries key frame information corresponding to each key frame image, and the fourth infrared image is an infrared image other than the third infrared image in the multiple infrared images. The inspection content of the inspection video includes the third infrared image after multiple frames are annotated and arranged from front to back according to the transmission time, and the infrared images other than the third infrared image in the multiple infrared images.

[0133] In this embodiment, the electronic device obtains an infrared image sent by an infrared imager and a gas concentration value sent by a gas concentration detector, and marks the gas concentration value on a matching infrared image to obtain a marked infrared image, and then determines a key frame image corresponding to the same detection component information from multiple frames of annotated third infrared images corresponding to the same detection component information, and infrared images other than the third infrared image in multiple frames of infrared images corresponding to the same detection component information, and generates an inspection video based on the key frame images of each frame, non-key frame images other than the key frame images in multiple frames of third infrared images, and non-key frame images other than the key frame images in multiple frames of fourth infrared images, to obtain video content corresponding to the marked infrared image, so that the user can obtain the infrared image and the gas concentration value. At the same time, based on the key frame information, the user can quickly locate the infrared image corresponding to the required component to be detected, thereby improving the user's search efficiency and providing a sense of user experience.

[0134] In an optional embodiment, the electronic device determines the key frame image corresponding to the same detection component information from multiple frames of infrared image data corresponding to the same detection component information, marks the first gas concentration value on the matching first key frame image to obtain the marked first key frame image, and marks the first gas concentration value on the matching first non-key frame image to obtain the marked first non-key frame image, and generates an inspection video based on the marked first key frame image, the marked first non-key frame image, other key frame images except the first key frame image in the multiple key frame images, and other non-key frame images except the first non-key frame image in the multiple non-key frame images. It should be noted that the first key frame image is a key frame image that matches the first gas concentration value, and the first non-key frame image is a non-key frame image that matches the first gas concentration value. In this embodiment, the electronic device first determines the key frame image from multiple frames of infrared images, and then marks the first gas concentration value on the matching infrared image (i.e., the key frame image and the non-key frame image in this embodiment) to obtain the marked first key frame image and the marked first non-key frame image, and then generates an inspection video based on the marked first key frame image, the marked first non-key frame image, other key frame images in the multiple key frame images except the first key frame image, and other non-key frame images in the multiple non-key frame images except the first non-key frame image.

[0135] See also Fig. 9 , Fig. 9 Schematic diagram of the structure of a patrol data processing device disclosed in an embodiment of the present application. The patrol data processing device can be applied to Figure 1 The electronic device 120 shown is not specifically limited. Fig. 9 As shown, the inspection data processing device 900 may include a data receiving module 910, a component determination module 920, a key determination module 930, and a video generation module 940. The data receiving module 910 is used to receive the inspection data sent by the infrared imager; the inspection data at least includes multiple frames of infrared images acquired by the infrared imager, and the infrared images are acquired by the infrared imager on the pipeline to be inspected. The component determination module 920 is used to determine the detection component information corresponding to each frame of infrared image, and the detection component information is used to identify the components to be inspected in the pipeline to be inspected. The key determination module 930 is used to determine the key frame images corresponding to the same detection component information from the multiple frames of infrared images corresponding to the same detection component information. The video generation module 940 is used to generate an inspection video based on each frame of key frame images and non-key frame images other than the key frame images in the multiple frames of infrared images, and the inspection video carries the key frame information corresponding to each frame of key frame images.

[0136] In an optional embodiment, the component to be detected is provided with an inspection mark, and the inspection data also includes multiple detection component information, and the detection component information is obtained by scanning the inspection mark with an infrared imager. The component determination module 920 includes a first acquisition unit, a second acquisition unit, a first determination unit, and an information determination unit. Among them, the first acquisition unit is used to obtain the first transmission time corresponding to the multiple detection component information. The second acquisition unit is used to obtain the second transmission time corresponding to the multiple frames of infrared images. The first determination unit is used to determine the target first transmission time according to the first transmission time corresponding to the multiple detection component information and the second transmission time corresponding to the first infrared image; wherein the first infrared image is any infrared image in the multiple frames of infrared images. The information determination unit uses the detection component information corresponding to the target first transmission time as the detection component information corresponding to the first infrared image.

[0137] In an optional embodiment, the inspection data also includes a plurality of acquisition position information corresponding to the infrared imager, and the acquisition position information is obtained by positioning the infrared imager through the positioning device of the infrared imager. The component determination module 920 includes a second acquisition unit, a third acquisition unit, a second determination unit, a third determination unit, and a fourth determination unit. Among them, the second acquisition unit is used to obtain the second transmission time corresponding to the multiple frames of infrared images. The third acquisition unit is used to obtain the third transmission time corresponding to the multiple acquisition position information. The second determination unit is used to determine the target third transmission time according to the multiple third transmission times and the second transmission time corresponding to the second infrared image; the second infrared image is any infrared image in the multiple frames of infrared images. The third determination unit is used to match the target acquisition position information corresponding to the target third transmission time with the multiple preset position information, and determine the target preset position information with the highest matching degree with the target position information. The fourth determination unit is used to determine the preset component information corresponding to the target preset position information, and use the preset component information corresponding to the target preset position information as the detection component information corresponding to the second infrared image.

[0138] In an optional embodiment, the inspection data processing device 900 may also include a route determination module, a duration determination module, and an update module. The route determination module is used to determine the target inspection route corresponding to the inspection task according to the multiple acquisition position information corresponding to the infrared imager when the inspection task is determined to be completed. The duration determination module is used to determine the inspection duration corresponding to the target inspection route. The update module is used to update the historical inspection route to the target inspection route if the inspection duration is less than the historical inspection duration corresponding to the historical inspection route.

[0139] In an optional embodiment, the inspection data processing device 900 may also include a first acquisition module, a first receiving module, a first matching module and a fusion module. The first acquisition module is used to obtain the second transmission time corresponding to the multiple frames of infrared images. The first receiving module is used to receive the multiple frames of voiceprint images sent by the voiceprint imager, and determine the fourth transmission time corresponding to each frame of the voiceprint image. The first matching module is used to match the second transmission time corresponding to each frame of infrared image with the fourth transmission time corresponding to each voiceprint image, and determine the voiceprint image matching each frame of infrared image. The fusion module is used to fuse each frame of infrared image with the matching voiceprint image according to the first preset weight corresponding to the infrared image and the second preset weight corresponding to the voiceprint image.

[0140] In an optional embodiment, the inspection data processing device 900 may also include a first acquisition module, a second receiving module, a first determination module and a marking module. The first acquisition module is used to acquire the second transmission time corresponding to the multiple frames of infrared images. The second receiving module is used to receive multiple gas concentration values ​​sent by the gas concentration detector and determine the fifth transmission time corresponding to each gas concentration value. The first determination module is used to determine a third infrared image matching the first gas concentration value based on the fifth transmission time corresponding to the first gas concentration value and the second transmission time corresponding to the multiple frames of infrared images; wherein the first gas concentration value is any gas concentration value among the multiple gas concentration values. The marking module is used to mark the first gas concentration value on the third infrared image.

[0141] In an optional embodiment, the inspection data also includes multiple image interception information, and the inspection data processing device 900 may also include a second determination module and an image generation module. The second determination module is used to determine the intercepted infrared image corresponding to each image interception information from multiple frames of infrared images according to the multiple image interception information. The image generation module is used to generate an image report corresponding to the first detection component information according to the intercepted infrared image corresponding to the first detection component information and the first detection component information; the first detection component information is the detection component information of any component to be detected in the pipeline to be detected.

[0142] See also Fig.10 , Fig.10 Schematic diagram of the structure of an electronic device disclosed in the embodiment of the present application. Fig.10 As shown, the electronic device 1000 may include:

[0143] A memory 1010 storing executable program codes;

[0144] a processor 1020 coupled to the memory 1010;

[0145] The processor 1020 calls the executable program code stored in the memory 1010 to execute any inspection data processing method disclosed in the embodiments of the present application.

[0146] An embodiment of the present application discloses a computer-readable storage medium storing a computer program, wherein when the computer program is executed by the processor, the processor implements any one of the inspection data processing methods disclosed in the embodiment of the present application.

[0147] It should be understood that the "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. Those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required for the present application.

[0148] In the various embodiments of the present application, it should be understood that the size of the serial numbers of the above-mentioned processes does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0149] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0150] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0151] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for a computer device (which can be a personal computer, a server or a network device, etc., specifically a processor in a computer device) to perform some or all of the steps of the above-mentioned methods of various embodiments of the present application.

[0152] Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0153] The above is a detailed introduction to a patrol data processing method, device, electronic device and storage medium disclosed in the embodiment of the present application. The principle and implementation method of the present application are described in detail using specific examples. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application. At the same time, for those of ordinary skill in the art, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A method for processing inspection data, characterized in that: The method comprises: Receiving inspection data sent by the infrared imager; the inspection data at least includes a plurality of frames of infrared images acquired by the infrared imager, the infrared images being acquired by the infrared imager on the pipeline to be inspected; Acquire second transmission times respectively corresponding to the plurality of frames of infrared images; Determine the detection component information corresponding to each frame of the infrared image, wherein the detection component information is used to identify the component to be detected in the pipeline to be detected; Receiving multiple frames of voiceprint images sent by a voiceprint imaging device, and determining a fourth transmission time corresponding to each frame of the voiceprint image; Matching the second transmission time corresponding to each frame of the infrared image with the fourth transmission time corresponding to each voiceprint image to determine the voiceprint image matched by each frame of the infrared image; According to the first preset weight corresponding to the infrared image and the second preset weight corresponding to the voiceprint image, the infrared image of each frame is fused with the matching voiceprint image to obtain a fused infrared image; Determining a key frame image corresponding to the same detection component information from multiple frames of fused infrared images corresponding to the same detection component information; An inspection video is generated according to the key frame images of each frame and non-key frame images other than the key frame images in the infrared image after multi-frame fusion. The inspection video carries the key frame information corresponding to the key frame images of each frame.

2. The method according to claim 1, characterized in that: The component to be inspected is provided with an inspection mark, and the inspection data further includes a plurality of inspection component information, and the inspection component information is obtained by scanning the inspection mark by the infrared imager; The step of determining the detection component information corresponding to each frame of the infrared image includes: Acquire first transmission times respectively corresponding to the plurality of detection component information; Acquire second transmission times respectively corresponding to the plurality of frames of infrared images; Determine the target first transmission time according to the first transmission times respectively corresponding to the information of the plurality of detection components and the second transmission time corresponding to the first infrared image; wherein the first infrared image is any infrared image in the plurality of infrared images; The detection component information corresponding to the first transmission time of the target is used as the detection component information corresponding to the first infrared image.

3. The method according to claim 1, characterized in that The inspection data also includes a plurality of acquisition position information corresponding to the infrared imager, wherein the acquisition position information is obtained by positioning the infrared imager through a positioning device of the infrared imager; The step of determining the detection component information corresponding to each frame of the infrared image includes: Acquire second transmission times respectively corresponding to the plurality of frames of infrared images; Acquire third transmission times respectively corresponding to the plurality of collection location information; Determine a target third transmission time according to the plurality of third transmission times and a second transmission time corresponding to a second infrared image; the second infrared image is any infrared image in the plurality of infrared image frames; Matching the target collection position information corresponding to the target third transmission time with a plurality of preset position information, and determining the target preset position information with the highest matching degree with the target collection position information; The preset component information corresponding to the preset target position information is determined, and the preset component information corresponding to the preset target position information is used as the detection component information corresponding to the second infrared image.

4. The method according to claim 3, characterized in that The method further comprises: When it is determined that the inspection task is completed, determining a target inspection route corresponding to the inspection task according to the multiple acquisition position information corresponding to the infrared imager; Determine the inspection duration corresponding to the target inspection route; If the current inspection duration is less than the historical inspection duration corresponding to the historical inspection route, the historical inspection route is updated to the target inspection route.

5. The method according to claim 1, characterized in that The method further comprises: receiving a plurality of gas concentration values ​​sent by the gas concentration detector, and determining a fifth transmission time corresponding to each of the gas concentration values; Determine a third infrared image matching the first gas concentration value according to the fifth transmission time corresponding to the first gas concentration value and the second transmission time corresponding to the multiple frames of infrared images; wherein the first gas concentration value is any one of the multiple gas concentration values; The first gas concentration value is marked on the third infrared image.

6. The method according to claim 1, characterized in that The inspection data also includes a plurality of image capture information; The method further comprises: According to the plurality of image interception information, determining, from the plurality of frames of infrared images, intercepted infrared images corresponding to the respective image interception information; An image report corresponding to the first detection component information is generated according to the captured infrared image corresponding to the first detection component information and the first detection component information; the first detection component information is the detection component information of any component to be detected in the pipeline to be detected.

7. A patrol data processing device, characterized in that: The device comprises: A data receiving module is used to receive inspection data sent by the infrared imager; the inspection data at least includes a plurality of infrared images acquired by the infrared imager, and the infrared images are acquired by the infrared imager on the pipeline to be inspected; A component determination module, used to determine the detection component information corresponding to each frame of the infrared image, wherein the detection component information is used to identify the component to be detected in the pipeline to be detected; A key determination module, used to determine a key frame image corresponding to the same detection component information from multiple frames of infrared images corresponding to the same detection component information; A video generation module, used to generate an inspection video according to the key frame images of each frame and non-key frame images other than the key frame images in the multiple frames of infrared images, wherein the inspection video carries the key frame information corresponding to the key frame images of each frame; The device also includes: A first acquisition module, used for acquiring second transmission times respectively corresponding to the plurality of frames of infrared images; A first receiving module is used to receive multiple frames of voiceprint images sent by a voiceprint imaging device, and determine a fourth transmission time corresponding to each frame of the voiceprint image; A first matching module, used for matching the second transmission time corresponding to each frame of the infrared image with the fourth transmission time corresponding to each voiceprint image, to determine the voiceprint image matched by each frame of the infrared image; The fusion module is used to fuse the infrared image of each frame with the matching voiceprint image according to the first preset weight corresponding to the infrared image and the second preset weight corresponding to the voiceprint image.

8. An electronic device, characterized in that: The method comprises a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor implements the method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images