Gas leakage detection method, device, system, equipment, medium and program product

Abstract

The invention provides a gas leakage detection method, device, system and equipment, a medium and a program product, and relates to the technical field of equipment detection. The method comprises the following steps: acquiring a sound source positioning coordinate of a sound source positioning point; the sound source positioning coordinates are used for representing the relative position of the sound source positioning point relative to the sound source positioning device; converting the sound source positioning coordinate into a sound source image coordinate in a target image coordinate system; based on the sound source image coordinates and a plurality of to-be-detected areas of a to-be-detected device, determining a gas leakage detection result of the to-be-detected device; the plurality of to-be-detected areas are image areas under the target image coordinate system; wherein the plurality of to-be-detected areas are obtained by carrying out image segmentation on a scene image of a scene where the to-be-detected device is located, and the plurality of to-be-detected areas are all areas where the to-be-detected device may generate gas leakage. According to the invention, accurate positioning of gas leakage points can be realized, so that the accuracy of gas leakage detection is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of equipment detection, and particularly to a gas leakage detection method, device, system, equipment, medium and program product. Background Art

[0002] With the rapid development of technology, more and more equipment needs to be subjected to gas leakage detection. For example, the number and scale of large oil and gas pipelines and pressure vessels are increasing year by year. During long-term use, oil and gas pipelines and pressure vessels are prone to aging, resulting in gas leakage problems, causing serious safety hazards and property losses. Therefore, gas leakage detection is required to avoid gas leakage problems.

[0003] Currently, acoustic imaging method is used for gas leakage detection. However, the noise generated during the operation of many devices to be detected may interfere with acoustic imaging positioning, resulting in false alarms at the positioned points, that is, the accuracy of gas leakage detection is not high. Summary of the Invention

[0004] The present invention provides a gas leakage detection method, device, system, equipment, medium and program product to solve the defect of low accuracy in gas leakage detection in the prior art and achieve high-accuracy gas leakage detection.

[0005] The present invention provides a gas leakage detection method, including: Obtaining the sound source localization coordinates of a sound source localization point; the sound source localization coordinates are used to represent the relative position of the sound source localization point with respect to a sound source localization device, and the sound source localization device is used to determine the sound source localization coordinates based on the collected audio of the sound source localization point; Converting the sound source localization coordinates into sound source image coordinates in a target image coordinate system; Based on the sound source image coordinates and a plurality of regions to be detected of a device to be detected, determining a gas leakage detection result of the device to be detected; the plurality of regions to be detected are all image regions in the target image coordinate system; Wherein, the plurality of regions to be detected are obtained by performing image segmentation on a scene image of the scene where the device to be detected is located, and the plurality of regions to be detected are all regions where the device to be detected may have gas leakage.

[0006] According to the gas leakage detection method provided by the present invention, the plurality of regions to be detected are determined based on the following method: Obtaining a scene image of the scene where the device to be detected is located; Inputting the scene image into a first image segmentation model to obtain a plurality of regions to be detected output by the first image segmentation model; Among them, the first image segmentation model is used to segment the component areas in the device to be detected where gas leakage may occur.

[0007] According to a gas leakage detection method provided by the present invention, the inputting the scene image into the first image segmentation model to obtain a number of regions to be detected output by the first image segmentation model includes: Inputting the scene image into the first image segmentation model to obtain a number of component areas output by the first image segmentation model; Inputting the number of component areas into the second image segmentation model respectively to obtain a number of part areas output by the second image segmentation model; Determining the number of component areas and the number of part areas as the number of regions to be detected; Among them, the second image segmentation model is used to segment the part areas where gas leakage may occur in the component areas.

[0008] According to a gas leakage detection method provided by the present invention, the determining the gas leakage detection result of the device to be detected based on the sound source image coordinates and a number of regions to be detected of the device to be detected includes: If it is determined based on the sound source image coordinates that the sound source positioning point is in any of the regions to be detected, determining the sound source positioning point as a gas leakage point; If it is determined based on the sound source image coordinates that the sound source positioning point is outside all the regions to be detected among the number of regions to be detected, determining the sound source positioning point as a noise interference point.

[0009] According to a gas leakage detection method provided by the present invention, the number of regions to be detected includes a number of component areas in the device to be detected where gas leakage may occur, and part areas where gas leakage may occur in each of the component areas; The if it is determined based on the sound source image coordinates that the sound source positioning point is in any of the regions to be detected, determining the sound source positioning point as a gas leakage point includes: If it is determined based on the sound source image coordinates that the sound source positioning point is in any of the part areas, determining the sound source positioning point as a gas leakage point; If it is determined based on the sound source image coordinates that the sound source positioning point is in any of the component areas, and the sound source positioning point is outside the part areas in the component area, determining the sound source positioning point as a suspected gas leakage point.

[0010] The present invention also provides a gas leakage detection device, including: An acquisition module, configured to acquire the sound source localization coordinates of a sound source localization point; the sound source localization coordinates are used to represent the relative position of the sound source localization point with respect to a sound source localization device, and the sound source localization device is configured to determine the sound source localization coordinates based on the acquired audio of the sound source localization point; A conversion module, configured to convert the sound source localization coordinates into sound source image coordinates in a target image coordinate system; A determination module, configured to determine a gas leakage detection result of a device to be detected based on the sound source image coordinates and a plurality of regions to be detected of the device to be detected; the plurality of regions to be detected are all image regions in the target image coordinate system; Wherein, the plurality of regions to be detected are obtained by performing image segmentation on a scene image of the scene where the device to be detected is located, and the plurality of regions to be detected are all regions where the device to be detected may have gas leakage.

[0011] The present invention further provides a gas leakage detection system, including: A processor, configured to execute the gas leakage detection method according to any one of the above; A sound source localization device, configured to perform sound source localization; An image acquisition device, configured to acquire a scene image of the scene where the device to be detected is located.

[0012] The present invention further provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the gas leakage detection method according to any one of the above when executing the program.

[0013] The present invention further provides a non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the gas leakage detection method according to any one of the above is implemented.

[0014] The present invention further provides a computer program product, including a computer program, and when the computer program is executed by a processor, the gas leakage detection method according to any one of the above is implemented.

[0015] The gas leakage detection method, device, system, equipment, medium and program product provided by the present invention obtain the sound source localization coordinates of a sound source localization point, which are used to represent the relative position of the sound source localization point with respect to the sound source localization device. The sound source localization device is used to determine the sound source localization coordinates based on the collected audio of the sound source localization point, convert the sound source localization coordinates into sound source image coordinates in a target image coordinate system, and determine the gas leakage detection result of the device to be detected based on the sound source image coordinates and several regions to be detected of the device to be detected. The several regions to be detected are obtained by image segmentation of the scene image of the scene where the device to be detected is located, and all the several regions to be detected are regions where the device to be detected may have gas leakage. Therefore, even if the sound source localization point is not a region where the device to be detected may have gas leakage, through the limitation of each region to be detected, false detection can be avoided, that is, being affected by environmental noise or sound wave reflection, etc. That is, by combining several regions to be detected, the accurate positioning of the gas leakage point can be realized, and finally the accuracy of gas leakage detection can be improved; and all the several regions to be detected are image regions in the target image coordinate system, ensuring that based on the sound source image coordinates and several regions to be detected of the device to be detected, the gas leakage detection result of the device to be detected can be accurately determined, and finally the accuracy of gas leakage detection can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0017] Figure 1 is one of the flowcharts of the gas leakage detection method provided by the present invention.

[0018] Figure 2 is another flowchart of the gas leakage detection method provided by the present invention.

[0019] Figure 3 is yet another flowchart of the gas leakage detection method provided by the present invention.

[0020] Figure 4 is the structural schematic diagram of the gas leakage detection device provided by the present invention.

[0021] Figure 5 is the structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0022] To make the objectives, technical solutions, and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below with reference to the accompanying drawings in the present invention. Apparently, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present invention without creative efforts shall fall within the protection scope of the present invention.

[0023] With the rapid development of industries such as petroleum and petrochemical, the quantity and scale of large oil and gas pipelines, as well as pressure vessels, have been increasing year by year. During long-term use, oil and gas pipelines and pressure vessels are prone to aging, which may lead to gas leakage problems, posing serious potential safety hazards and property losses. Therefore, gas leakage detection is required to avoid gas leakage problems.

[0024] Currently, the acoustic imaging method can be applied to various gas leakage detection scenarios in the petrochemical industry, including pressure pipelines, pressure vessels, etc. However, in the actual application environment, the noise generated by the operation of many factory devices may interfere with acoustic imaging positioning, resulting in false alarms at the positioned points, which is not conducive to users' judgment of the safe operation of the devices.

[0025] In addition, gas leakage detection methods also include manual detection and positioning, negative pressure wave method, flow balance method, infrared detection method, chemical substance detection method, etc. The manual detection and positioning method requires personnel to conduct regular inspections and use their ears to listen for changes in the sound of the pipeline to determine whether there is gas leakage. This method is time-consuming and inefficient, resulting in too high costs for gas leakage detection. The negative pressure wave method and the flow balance method are difficult to detect minor leaks, and the detection effect needs to be improved, that is, the accuracy of gas leakage detection is not high. The infrared detection method is limited to scenarios with temperature differences and is difficult to achieve large-area online monitoring applications; the chemical substance detection method requires a large number of sensors to achieve better detection effects, and it is necessary for the leaked gas to accumulate to a certain extent before it can be detected. The detection cost is high and the accuracy is low.

[0026] Therefore, how to improve the accuracy of gas leakage detection while avoiding manual detection is an urgent problem to be solved currently.

[0027] In response to the above problems, the present invention proposes the following embodiments. The following combines Figures 1-3 to describe the gas leakage detection method of the present invention.

[0028] Figure 1 is one of the flow schematic diagrams of the gas leakage detection method provided by the present invention. As Figure 1 shown, the gas leakage detection method includes the following steps 110, step 120, and step 130.

[0029] Step 110, obtain the sound source localization coordinates of the sound source localization point.

[0030] Here, the sound source localization point is the point where sound source localization is performed by the sound source localization device, and this sound source localization device may be the point where gas leakage occurs.

[0031] Among them, the sound source localization coordinates are used to represent the relative position of the sound source localization point with respect to the sound source localization device, and the sound source localization device is used to determine the sound source localization coordinates based on the audio of the collected sound source localization point.

[0032] In a specific embodiment, the sound source localization coordinates include the pitch angle and the azimuth angle, that is, the sound source localization coordinates include the pitch angle and the azimuth angle of the sound source localization point with respect to the sound source localization device.

[0033] In a specific embodiment, the sound source localization device may be an acoustic imager. The acoustic imager may include a microphone array, so as to utilize the microphone array and sound source localization technology to identify the pitch angle and the azimuth angle of the collected sound source; for example, based on the microphone array and the beamforming algorithm, the pitch angle and the azimuth angle of the sound source are located.

[0034] Step 120, convert the sound source localization coordinates into sound source image coordinates in the target image coordinate system.

[0035] Specifically, based on the coordinate transformation matrix, the sound source localization coordinates are converted into sound source image coordinates in the target image coordinate system.

[0036] This coordinate transformation matrix can be set in advance, that is, as long as the position of the sound source localization device is fixed, it can be set in advance. Exemplarily, based on the position of the sound source localization device and the target image coordinate system, the coordinate transformation matrix is determined; that is, the sound field angle of the sound source localization device and the field of view angle of the image are coordinate registered to obtain this coordinate transformation matrix.

[0037] Step 130, based on the sound source image coordinates and several detection regions of the device to be detected, determine the gas leakage detection result of the device to be detected.

[0038] Here, the device to be detected is the device to be detected for gas leakage, and this device to be detected may be a pressure pipeline, a pressure vessel, etc., and no specific limitation is made here.

[0039] Among them, the several detection regions are all image regions in the target image coordinate system. Based on this, the sound source image coordinates and each detection region are coordinates or regions in the same coordinate system, ensuring accurate gas leakage detection.

[0040] Among them, the several regions to be detected are obtained by segmenting the scene image of the scene where the device to be detected is located, and all of the several regions to be detected are regions where the device to be detected may have gas leakage. Based on this, even if the sound source localization point is not a region where gas leakage may occur in the device to be detected, false detection can be avoided through the limitation of the regions to be detected.

[0041] Exemplarily, the regions to be detected can be pipelines, pipe joints, valves, flanges, connectors, pressure vessels, seals, etc., all of which are key regions where gas leakage may occur.

[0042] In one embodiment, the gas leakage detection result can be whether the sound source localization point is a gas leakage point. Further, the gas leakage detection result includes that the sound source localization point is a gas leakage point or the sound source localization point is a noise interference point. Further, the gas leakage detection result includes that the sound source localization point is a gas leakage point, the sound source localization point is a suspected gas leakage point, or the sound source localization point is a noise interference point.

[0043] In another embodiment, the gas leakage detection result can be whether there is gas leakage in each region to be detected. It should be understood that if the sound source localization point is a gas leakage point, there is gas leakage in the region to be detected; if the sound source localization point is a suspected gas leakage point, there is suspected gas leakage in the region to be detected; if the sound source localization point is a noise interference point, there is no gas leakage in the region to be detected.

[0044] Further, if the sound source localization point is a gas leakage point, the gas leakage detection result can also include the specific location where the gas leakage occurs, and this specific location can be determined during image segmentation.

[0045] It should be understood that the embodiment of the present invention is based on the scene image of the scene where the device to be detected is located, and through image segmentation (instance segmentation), the regions where gas leakage may occur are screened out, and on this basis, sound source localization is performed to ensure that the finally determined gas leakage point position is accurate, thereby improving the accuracy of gas leakage detection.

[0046] The gas leakage detection method provided by the embodiment of the present invention obtains the sound source localization coordinates of the sound source localization point, which are used to represent the relative position of the sound source localization point relative to the sound source localization device. The sound source localization device is used to determine the sound source localization coordinates based on the collected audio of the sound source localization point, convert the sound source localization coordinates into the sound source image coordinates in the target image coordinate system, and determine the gas leakage detection result of the device to be detected based on the sound source image coordinates and several regions to be detected of the device to be detected. The several regions to be detected are obtained by segmenting the scene image of the scene where the device to be detected is located, and all the several regions to be detected are regions where the device to be detected may have gas leakage. Therefore, even if the sound source localization point is not a region where the device to be detected may have gas leakage, through the limitation of each region to be detected, false detection can be avoided, that is, the influence of environmental noise or sound wave reflection can be avoided. That is, by combining several regions to be detected, the accurate positioning of the gas leakage point can be realized, and finally the accuracy of gas leakage detection can be improved; and all the several regions to be detected are image regions in the target image coordinate system, ensuring that the gas leakage detection result of the device to be detected can be accurately determined based on the sound source image coordinates and several regions to be detected of the device to be detected, and finally the accuracy of gas leakage detection can be improved.

[0047] Based on any of the above embodiments, Figure 2 is the second flowchart of the gas leakage detection method provided by the present invention, as Figure 2 shown, the several regions to be detected are determined based on the following steps 210 and 220.

[0048] Step 210, obtain the scene image of the scene where the device to be detected is located.

[0049] In one embodiment, the image acquisition device is arranged on the sound source localization device; the image acquisition device is used to acquire the scene image during the process of the sound source localization device acquiring the audio of the sound source localization point. That is, while the sound source localization device acquires the audio of the sound source localization point, the image acquisition device acquires a scene image. For example, when an acoustic imager performs a fault scan, a scene image is captured by a visible light camera. And the acquisition directions or acquisition regions of the sound source localization device and the image acquisition device are the same direction or region.

[0050] In another embodiment, for the scene where the device to be detected is located, multiple scene images are pre-acquired.

[0051] Step 220, input the scene image into the first image segmentation model to obtain several regions to be detected output by the first image segmentation model.

[0052] Among them, the first image segmentation model is used to segment and obtain the component regions in the device to be detected that may have gas leakage.

[0053] In a specific embodiment, the first image segmentation model extracts the area to be detected in the scene image through an object detection algorithm. For example, based on the scene image, an object detection algorithm is used to extract key components for gas leakage, such as pipe joints, valves, flanges, connectors, and seals; the type of object detection can be selected according to the scene, the extracted object is a four-point bounding box, and this four-point bounding box is determined as the area to be detected.

[0054] In one embodiment, if there are multiple scene images, the multiple scene images are respectively input into the first image segmentation model, and a number of areas to be detected output by the first image segmentation model are obtained.

[0055] In one embodiment, the first image segmentation model is trained based on sample scene images and their corresponding image segmentation result labels.

[0056] Furthermore, considering that the component areas where gas leakage may occur in different devices to be detected are different, based on this, different first image segmentation models correspond to different devices to be detected, that is, the scene image is input into the first image segmentation model corresponding to the device to be detected, and a number of areas to be detected output by the first image segmentation model are obtained. The first image segmentation model is trained based on the sample scene images corresponding to the device to be detected and their corresponding image segmentation result labels.

[0057] The gas leakage detection method provided by the embodiments of the present invention obtains a scene image of the scene where the device to be detected is located, inputs the scene image into the first image segmentation model, and obtains a number of areas to be detected output by the first image segmentation model. The first image segmentation model is used to segment the component areas where gas leakage may occur in the device to be detected. Thus, even if the sound source localization point is not the area where gas leakage may occur in the device to be detected, through the limitation of each area to be detected, false detection can be avoided, that is, being affected by environmental noise or sound wave reflection, etc. That is, by combining a number of areas to be detected, the accurate positioning of the gas leakage point is realized, and finally the accuracy of gas leakage detection is improved.

[0058] Based on any of the above embodiments, Figure 3 is the third flow chart of the gas leakage detection method provided by the present invention, as Figure 3 shown, the above step 220 includes step 221, step 222, and step 223.

[0059] Step 221, input the scene image into the first image segmentation model to obtain a number of component areas output by the first image segmentation model.

[0060] For example, based on the scene image, use the object detection algorithm to extract the key components for gas leakage, such as pipe joints, valves, flanges, connectors, and seals. The type of object detection can be selected according to the scene. The extracted object is a four-point bounding box, and this four-point bounding box is determined as the component area.

[0061] In one embodiment, if there are multiple scene images, input the multiple scene images into the first image segmentation model respectively to obtain several component areas output by the first image segmentation model.

[0062] Step 222, input the several component areas into the second image segmentation model respectively to obtain several part areas output by the second image segmentation model.

[0063] Wherein, the second image segmentation model is used to segment the part areas where gas leakage may occur in the component area.

[0064] Further, extract the contours of each component area to obtain the contours of each component. Input the contours of each component into the second image segmentation model respectively to obtain several part areas output by the second image segmentation model. Based on this, further extract the contour of the target for the extracted component area, fit the position of the target based on the contour, and thus extract the part area by combining the regional characteristics of the area where gas leakage occurs in the target, improve the determination accuracy of the part area, and then improve the determination accuracy of the area to be detected, and finally improve the accuracy of gas leakage detection.

[0065] Exemplarily, the component area can be a pipe, a pipe joint, a valve, a flange, a connector, a pressure vessel, a seal, etc., all of which are key areas where gas leakage may occur; the part area can be the gap or weld at the installation moving part of the pipe joint, the gap at the moving part of the valve, the sealing surface of the flange and the connector, the sealing surface of the seal, etc., all of which are more key areas where gas leakage may occur.

[0066] Step 223, determine the several component areas and the several part areas as the several areas to be detected.

[0067] The gas leakage detection method provided by the embodiment of the present invention inputs a scene image into a first image segmentation model to obtain a number of component regions output by the first image segmentation model, inputs the number of component regions into a second image segmentation model respectively to obtain a number of part regions output by the second image segmentation model, determines the number of component regions and the number of part regions as a number of regions to be detected, and the second image segmentation model is used to segment the part regions that may cause gas leakage in the component regions, so that not only the component regions that may cause gas leakage are segmented, but also the part regions that may cause gas leakage are segmented, the diversity of the regions to be detected is improved, and the part regions that are more likely to cause gas leakage are obtained, thereby more accurately realizing the positioning of the gas leakage point, and finally further improving the accuracy of gas leakage detection.

[0068] Based on any of the above embodiments, in this method, step 220 above includes: Input the scene image into a first image segmentation model to obtain a number of component regions output by the first image segmentation model; Input the number of component regions into a second image segmentation model respectively to obtain a number of regions to be detected output by the second image segmentation model.

[0069] Wherein, the second image segmentation model is used to segment the regions that may cause gas leakage in the component regions.

[0070] The number of regions to be detected is a number of part regions. The embodiments of the present invention can specifically refer to the above embodiments, and will not be elaborated here one by one.

[0071] The gas leakage detection method provided by the embodiment of the present invention inputs a scene image into a first image segmentation model to obtain a number of component regions output by the first image segmentation model, inputs the number of component regions into a second image segmentation model respectively to obtain a number of regions to be detected output by the second image segmentation model, and the second image segmentation model is used to segment the part regions that may cause gas leakage in the component regions, so as to obtain the part regions that are more likely to cause gas leakage, thereby more accurately realizing the positioning of the gas leakage point, and finally further improving the accuracy of gas leakage detection.

[0072] Based on any of the above embodiments, in this method, step 130 above includes: If it is determined that the sound source positioning point is in any of the regions to be detected based on the sound source image coordinates, determine the sound source positioning point as the gas leakage point; If it is determined that the sound source positioning point is outside all the regions to be detected among the number of regions to be detected based on the sound source image coordinates, determine the sound source positioning point as a noise interference point.

[0073] Here, the noise interference point means that it is not the gas leakage point position.

[0074] Specifically, the sound source image coordinates are combined with the area to be detected for judgment. When the sound source image coordinates fall within the area to be detected, the sound source positioning point is defined as a gas leakage point. When the sound source image coordinates fall outside the area to be detected, the sound source positioning point is defined as a noise interference point.

[0075] Furthermore, if it is determined that the sound source positioning point is a gas leakage point, a gas leakage prompt message (such as a fault alarm) is sent; if it is determined that the sound source positioning point is a noise interference point, no prompt message is sent.

[0076] Furthermore, if the sound source positioning point is a gas leakage point, the gas leakage detection result may further include the specific location where the gas leakage occurs, and this specific location can be determined during image segmentation.

[0077] In the gas leakage detection method provided by the embodiments of the present invention, if it is determined based on the sound source image coordinates that the sound source positioning point is in any area to be detected, it is determined that the sound source positioning point is a gas leakage point. If it is determined based on the sound source image coordinates that the sound source positioning point is outside all the areas to be detected among several areas to be detected, it is determined that the sound source positioning point is a noise interference point. Thus, even if the sound source positioning point is not in the area where gas leakage may occur in the device to be detected, through the limitation of each area to be detected, false detection can be avoided, that is, being affected by environmental noise or sound wave reflection, etc. That is, by combining several areas to be detected, accurate positioning of the gas leakage point is achieved, and finally the accuracy of gas leakage detection is improved; and through the above method, the sound source image coordinates are compared with all the areas to be detected to ensure that no gas leakage point is missed, thereby further improving the accuracy of gas leakage detection.

[0078] Based on any of the above embodiments, in this method, the several areas to be detected include several component areas in the device to be detected where gas leakage may occur, and the part areas where gas leakage may occur in each of the component areas.

[0079] Correspondingly, the step of determining that the sound source positioning point is a gas leakage point if it is determined based on the sound source image coordinates that the sound source positioning point is in any of the areas to be detected includes: If it is determined based on the sound source image coordinates that the sound source positioning point is in any of the part areas, it is determined that the sound source positioning point is a gas leakage point; If it is determined based on the sound source image coordinates that the sound source positioning point is in any of the component areas, and the sound source positioning point is outside the part area in the component area, it is determined that the sound source positioning point is a suspected gas leakage point.

[0080] Specifically, the sound source image coordinates are combined and judged with the component area and the part area. When the sound source image coordinates fall within the part area, the sound source positioning point is defined as a gas leakage point. When the sound source image coordinates fall within the component area and outside its part area, the sound source positioning point is defined as a suspected gas leakage point. When the sound source image coordinates fall outside all component areas, the sound source positioning point is defined as a noise interference point.

[0081] Furthermore, the gas leakage occurrence probability of the suspected gas leakage point is less than that of the gas leakage point.

[0082] Furthermore, if it is determined that the sound source positioning point is a gas leakage point, a gas leakage prompt message (such as a fault alarm) is issued; if it is determined that the sound source positioning point is a suspected gas leakage point, a suspected gas leakage prompt message (such as a fault warning) is issued; if it is determined that the sound source positioning point is defined as a noise interference point, no prompt message is issued.

[0083] Furthermore, if the sound source positioning point is a gas leakage point, the gas leakage detection result can also include the specific part where the gas leakage occurs, which can be determined when performing image segmentation to obtain the part area; if the sound source positioning point is a suspected gas leakage point, the gas leakage detection result can also include the specific component position where the gas leakage occurs, which can be determined when performing image segmentation to obtain the component area.

[0084] For the gas leakage detection method provided by the embodiments of the present invention, if it is determined based on the sound source image coordinates that the sound source positioning point is in any part area, the sound source positioning point is determined as a gas leakage point. If it is determined based on the sound source image coordinates that the sound source positioning point is in any component area and outside the part area in the component area, the sound source positioning point is determined as a suspected gas leakage point. Thus, not only can it be determined whether it is a gas leakage point, but also whether it is a suspected gas leakage point, thereby improving the diversity of gas leakage detection results, providing more gas leakage detection results for users to refer to, and further improving the accuracy of gas leakage detection to better avoid gas leakage and improve the safety of the device to be detected.

[0085] Based on any of the above embodiments, in this method, the sound source positioning coordinates include the pitch angle and the azimuth angle; the conversion of the sound source positioning coordinates into the sound source image coordinates in the target image coordinate system includes: based on the coordinate conversion matrix, converting the pitch angle and the azimuth angle into the sound source image coordinates in the target image coordinate system.

[0086] The gas leakage detection device provided by the present invention will be described below. The gas leakage detection device described below can be correspondingly referred to the gas leakage detection method described above.

[0087] Figure 4This is a schematic structural diagram of the gas leakage detection device provided by the present invention. As Figure 4 shown, the gas leakage detection device includes an acquisition module 410, a conversion module 420, and a determination module 430.

[0088] The acquisition module 410 is configured to acquire the sound source localization coordinates of the sound source localization point; the sound source localization coordinates are used to represent the relative position of the sound source localization point with respect to the sound source localization device, and the sound source localization device is configured to determine the sound source localization coordinates based on the acquired audio of the sound source localization point.

[0089] The conversion module 420 is configured to convert the sound source localization coordinates into sound source image coordinates in the target image coordinate system.

[0090] The determination module 430 is configured to determine the gas leakage detection result of the device to be detected based on the sound source image coordinates and a plurality of regions to be detected of the device to be detected; the plurality of regions to be detected are all image regions in the target image coordinate system.

[0091] Among them, the plurality of regions to be detected are obtained by performing image segmentation on the scene image of the scene where the device to be detected is located, and the plurality of regions to be detected are all regions where the device to be detected may have gas leakage.

[0092] The gas leakage detection device provided by the embodiment of the present invention acquires the sound source localization coordinates of the sound source localization point, and the sound source localization coordinates are used to represent the relative position of the sound source localization point with respect to the sound source localization device. The sound source localization device is configured to determine the sound source localization coordinates based on the acquired audio of the sound source localization point, convert the sound source localization coordinates into sound source image coordinates in the target image coordinate system, and determine the gas leakage detection result of the device to be detected based on the sound source image coordinates and a plurality of regions to be detected of the device to be detected. The plurality of regions to be detected are obtained by performing image segmentation on the scene image of the scene where the device to be detected is located, and the plurality of regions to be detected are all regions where the device to be detected may have gas leakage. Therefore, even if the sound source localization point is not a region where the device to be detected may have gas leakage, through the limitation of each region to be detected, false detection can be avoided, that is, the influence of environmental noise or sound wave reflection can be avoided. That is, by combining a plurality of regions to be detected, the accurate positioning of the gas leakage point can be realized, and finally the accuracy of gas leakage detection can be improved; and the plurality of regions to be detected are all image regions in the target image coordinate system, ensuring that based on the sound source image coordinates and a plurality of regions to be detected of the device to be detected, the gas leakage detection result of the device to be detected can be accurately determined, and finally the accuracy of gas leakage detection can be improved.

[0093] Based on any of the above embodiments, the device further includes: An image acquisition module, configured to acquire the scene image of the scene where the device to be detected is located; An image segmentation module, configured to input the scene image into a first image segmentation model to obtain a plurality of regions to be detected output by the first image segmentation model; Wherein, the first image segmentation model is used to segment and obtain component regions in the device to be detected where gas leakage may occur.

[0094] Based on any of the above embodiments, the image segmentation module is further configured to: Input the scene image into a first image segmentation model to obtain a plurality of component regions output by the first image segmentation model; Input the plurality of component regions into a second image segmentation model respectively to obtain a plurality of part regions output by the second image segmentation model; Determine the plurality of component regions and the plurality of part regions as the plurality of regions to be detected; Wherein, the second image segmentation model is used to segment and obtain part regions in the component regions where gas leakage may occur.

[0095] Based on any of the above embodiments, the determination module 430 is further configured to: If it is determined based on the sound source image coordinates that the sound source localization point is in any of the regions to be detected, determine the sound source localization point as a gas leakage point; If it is determined based on the sound source image coordinates that the sound source localization point is outside all the regions to be detected among the plurality of regions to be detected, determine the sound source localization point as a noise interference point.

[0096] Based on any of the above embodiments, the plurality of regions to be detected include a plurality of component regions in the device to be detected where gas leakage may occur, and part regions in each of the component regions where gas leakage may occur; the determination module 430 is further configured to: If it is determined based on the sound source image coordinates that the sound source localization point is in any of the part regions, determine the sound source localization point as a gas leakage point; If it is determined based on the sound source image coordinates that the sound source localization point is in any of the component regions, and the sound source localization point is outside the part regions in the component regions, determine the sound source localization point as a suspected gas leakage point.

[0097] The gas leakage detection system provided by the present invention is described below. The gas leakage detection system described below can be correspondingly referred to the gas leakage detection method described above.

[0098] An embodiment of the present invention further provides a gas leakage detection system, which includes: a processor, a sound source localization device, and an image acquisition device. The sound source localization device is used for sound source localization; the image acquisition device is used for acquiring a scene image of the scene where the device to be detected is located; the processor is used for executing the gas leakage detection method of any of the above embodiments.

[0099] Figure 5 The schematic physical structure diagram of an electronic device is exemplified, as Figure 5 shown, the electronic device may include: a processor 510, a communication interface 520, a memory 530, and a communication bus 540. Among them, the processor 510, the communication interface 520, and the memory 530 complete mutual communication through the communication bus 540. The processor 510 can call the logical instructions in the memory 530 to execute the gas leakage detection method, and the method includes: obtaining the sound source localization coordinates of the sound source localization point; the sound source localization coordinates are used to represent the relative position of the sound source localization point relative to the sound source localization device, and the sound source localization device is used to determine the sound source localization coordinates based on the collected audio of the sound source localization point; converting the sound source localization coordinates into the sound source image coordinates in the target image coordinate system; based on the sound source image coordinates and several regions to be detected of the device to be detected, determining the gas leakage detection result of the device to be detected; the several regions to be detected are all image regions in the target image coordinate system; wherein, the several regions to be detected are obtained by image segmentation of the scene image of the scene where the device to be detected is located, and the several regions to be detected are all regions where the device to be detected may have gas leakage.

[0100] In addition, when the logical instructions in the above-mentioned memory 530 can be implemented in the form of software functional units and sold or used as an independent product, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: various media such as a USB flash drive, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk, or an optical disc that can store program codes.

[0101] On the other hand, the present invention also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the gas leakage detection method provided by each of the above methods. The method includes: obtaining the sound source localization coordinates of a sound source localization point; the sound source localization coordinates are used to represent the relative position of the sound source localization point with respect to a sound source localization device, and the sound source localization device is used to determine the sound source localization coordinates based on the collected audio of the sound source localization point; converting the sound source localization coordinates into sound source image coordinates in a target image coordinate system; determining the gas leakage detection result of the device to be detected based on the sound source image coordinates and a plurality of regions to be detected of the device to be detected; the plurality of regions to be detected are all image regions in the target image coordinate system; wherein, the plurality of regions to be detected are obtained by performing image segmentation on a scene image of the scene where the device to be detected is located, and the plurality of regions to be detected are all regions where the device to be detected may have gas leakage.

[0102] In another aspect, the present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it is configured to execute the gas leakage detection method provided by each of the above methods. The method includes: obtaining the sound source localization coordinates of a sound source localization point; the sound source localization coordinates are used to represent the relative position of the sound source localization point with respect to a sound source localization device, and the sound source localization device is used to determine the sound source localization coordinates based on the collected audio of the sound source localization point; converting the sound source localization coordinates into sound source image coordinates in a target image coordinate system; determining the gas leakage detection result of the device to be detected based on the sound source image coordinates and a plurality of regions to be detected of the device to be detected; the plurality of regions to be detected are all image regions in the target image coordinate system; wherein, the plurality of regions to be detected are obtained by performing image segmentation on a scene image of the scene where the device to be detected is located, and the plurality of regions to be detected are all regions where the device to be detected may have gas leakage.

[0103] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without creative labor.

[0104] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the above technical solution, in essence, or the part that contributes to the prior art can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0105] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A gas leakage detection method, characterized in that: include: Acquire the sound source localization coordinates of the sound source localization point; the sound source localization coordinates are used to represent the relative position of the sound source localization point relative to the sound source localization device, and the sound source localization device is used to determine the sound source localization coordinates based on the collected audio of the sound source localization point; Converting the sound source localization coordinates into sound source image coordinates in a target image coordinate system; Determine the gas leakage detection result of the device to be detected based on the sound source image coordinates and a plurality of regions to be detected of the device to be detected; the plurality of regions to be detected are all image regions under the target image coordinate system; The plurality of areas to be detected are obtained by performing image segmentation on a scene image of a scene where the device to be detected is located, and the plurality of areas to be detected are all areas where the device to be detected may cause gas leakage.

2. The gas leakage detection method according to claim 1, characterized in that: The plurality of areas to be detected are determined based on the following method: Acquire a scene image of the scene where the device to be detected is located; Inputting the scene image into a first image segmentation model to obtain a plurality of areas to be detected output by the first image segmentation model; The first image segmentation model is used to segment and obtain a component area in the device to be detected where gas leakage may occur.

3. The gas leakage detection method according to claim 2, characterized in that: The step of inputting the scene image into a first image segmentation model to obtain a plurality of areas to be detected output by the first image segmentation model includes: Inputting the scene image into a first image segmentation model to obtain a plurality of component regions output by the first image segmentation model; Inputting the plurality of component regions into a second image segmentation model respectively to obtain a plurality of part regions output by the second image segmentation model; Determining the plurality of component areas and the plurality of part areas as the plurality of areas to be detected; The second image segmentation model is used to segment the component area to obtain the area where gas leakage may occur.

4. The gas leakage detection method according to any one of claims 1 to 3, characterized in that: The step of determining the gas leakage detection result of the device to be detected based on the sound source image coordinates and a plurality of areas to be detected of the device to be detected includes: If it is determined based on the sound source image coordinates that the sound source location point is in any of the to-be-detected areas, the sound source location point is determined to be a gas leakage point; If it is determined based on the sound source image coordinates that the sound source positioning point is outside all the areas to be detected among the plurality of areas to be detected, the sound source positioning point is determined to be a noise interference point.

5. The gas leakage detection method according to claim 4, characterized in that: The plurality of areas to be detected include a plurality of component areas in the device to be detected where gas leakage may occur, and a location area in each of the component areas where gas leakage may occur; If it is determined based on the sound source image coordinates that the sound source location point is in any of the to-be-detected areas, determining that the sound source location point is a gas leakage point includes: If it is determined based on the sound source image coordinates that the sound source location point is in any of the area, the sound source location point is determined to be a gas leakage point; If the sound source positioning point is determined to be in any of the component areas based on the sound source image coordinates, and the sound source positioning point is outside the part area in the component area, the sound source positioning point is determined to be a suspected gas leakage point.

6. A gas leakage detection device, characterized in that: include: An acquisition module, used to acquire the sound source localization coordinates of the sound source localization point; the sound source localization coordinates are used to represent the relative position of the sound source localization point relative to the sound source localization device, and the sound source localization device is used to determine the sound source localization coordinates based on the collected audio of the sound source localization point; A conversion module, used for converting the sound source localization coordinates into sound source image coordinates in a target image coordinate system; A determination module, configured to determine a gas leakage detection result of the device to be detected based on the sound source image coordinates and a plurality of regions to be detected of the device to be detected; the plurality of regions to be detected are all image regions under the target image coordinate system; The plurality of areas to be detected are obtained by performing image segmentation on a scene image of a scene where the device to be detected is located, and the plurality of areas to be detected are all areas where the device to be detected may cause gas leakage.

7. A gas leak detection system, characterized in that: include: A processor, wherein the processor is used to execute the gas leakage detection method according to any one of claims 1 to 5; A sound source localization device, wherein the sound source localization device is used to localize the sound source; An image acquisition device is used to acquire a scene image of a scene where the device to be detected is located.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that: When the processor executes the computer program, the gas leakage detection method according to any one of claims 1 to 5 is implemented.

9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the gas leakage detection method according to any one of claims 1 to 5 is implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the gas leakage detection method according to any one of claims 1 to 5 is implemented.

Images