Hydrogen leakage monitoring method, system, equipment and medium

Abstract

The invention provides a hydrogen leakage monitoring method, system and device and a medium. The method comprises the following steps: acquiring a target video stream; intercepting a key frame image; preprocessing the key frame image to obtain a preprocessed image; performing color space conversion on the preprocessed image to obtain a converted image; obtaining environment information based on the converted image; the environment information comprises environment background information and environment illumination information; determining a color threshold value based on the environment illumination information; analyzing the converted image to obtain target information; identifying the target information to obtain an identification result; performing comparative analysis on the color threshold value and the identification result to obtain a discrimination result; and under the condition that the judgment result indicates that the hydrogen leakage point exists, the position of the leakage point is determined based on the environment background information, and visual output and alarm are carried out. The scheme can adapt to complex illumination conditions, real-time online monitoring of hydrogen leakage is rapidly and accurately achieved at night or under the weak light condition, and more accurate leakage positioning is achieved.

Description

Technical Field

[0001] The present application relates to the technical field of hydrogen leakage monitoring, and in particular to a hydrogen leakage monitoring method, system, equipment and medium. Background Art

[0002] As a clean and efficient energy source, hydrogen has broad application prospects, especially in the fields of fuel cells, industrial manufacturing, and hydrogen energy storage and transportation. However, hydrogen itself is a gas with high safety risks. Its flammable and explosive properties make it crucial to promptly detect hydrogen leaks and accurately locate the leaks in hydrogen-related places (such as hydrogen refueling stations, hydrogen storage facilities, and industrial production lines) to ensure safe production and the safety of personnel and property. Due to the characteristics of hydrogen such as colorlessness and odorlessness, small molecular weight, and strong diffusion ability, hydrogen often exhibits hidden characteristics after a leak. Especially in the case of trace leaks, it is difficult to detect with the naked eye or simple intuitive detection methods. This characteristic greatly increases the difficulty of timely detection of leaks and brings huge potential safety risks.

[0003] At present, a variety of monitoring technologies have been developed for hydrogen leakage monitoring, including gas chromatography, electrochemical method, and optical method. Although these technologies have achieved the detection of hydrogen leakage to a certain extent, they also have many limitations, as follows: (1) Gas chromatography: Detecting hydrogen leaks by analyzing gas composition can achieve high accuracy. However, this method usually relies on complex hardware equipment and professional operation, and the analysis process is time-consuming, making it difficult to meet the requirements for real-time performance and rapid response. Therefore, it is more suitable for detection in laboratory environments or fixed locations, but not for dynamic and complex environments or scenarios that require continuous online monitoring.

[0004] (2) Electrochemical method: The electrical signal generated during the chemical reaction is used to monitor the hydrogen concentration. This method has the advantages of low monitoring equipment cost and easy implementation. However, its sensor is easily affected by the environment (such as temperature and humidity changes, air flow disturbances, etc.) and has poor stability in dynamic or complex industrial environments. In addition, the sensor itself may have drift problems, and the accuracy and maintenance cost after long-term use need to be considered.

[0005] (3) Optical method: The hydrogen concentration is monitored by detecting changes in the interaction between light and hydrogen molecules (such as absorption spectra and fluorescence signals). The optical method has the characteristics of high sensitivity and fast response speed. At the same time, its equipment can work non-contact, which has certain advantages in certain specific environments. However, optical equipment is usually expensive and has high maintenance costs. In complex environments, such as when there are multiple interference factors or uneven light distribution, its measurement accuracy may be limited. In addition, in actual deployment, the large-scale deployment of optical equipment will further increase costs and management difficulties.

[0006] Based on the limitations of the above monitoring technologies, a simpler, more economical and easy to deploy large-scale hydrogen leak monitoring method has gradually attracted attention, namely the technical solution of "combining hydrogen-sensitive tape and explosion-proof camera". In this solution, since hydrogen-sensitive tape is a special material that is sensitive to hydrogen, it will undergo a significant color change when it comes into contact with hydrogen (such as changing from the initial color to blue). By capturing and identifying this color change in real time with an explosion-proof camera, rapid perception and alarm of hydrogen leaks can be achieved. This technical architecture based on visual perception has the following advantages: (1) Low cost: The manufacturing cost of hydrogen-sensitive tape is low, which makes it more economical than other high-precision sensing equipment (such as optical instruments).

[0007] (2) Simplified structure: The system structure is simple and does not require complex analysis equipment or additional sensors, which greatly reduces hardware requirements.

[0008] (3) Real-time monitoring: By collecting images with explosion-proof cameras and combining them with image processing algorithms, online real-time monitoring and automatic alarm functions of multi-point control can be realized.

[0009] (4) Locating the scope of the leak: The location of the tape distribution can be used to preliminarily determine the scope of the leak, providing a reference for further processing.

[0010] However, although this solution has shown certain advantages in practical applications, it still faces some outstanding problems, especially the monitoring performance at night or in low-light environments has not been fully optimized. Specifically: (1) Difficulty in identification under low light conditions Current technology mainly relies on visual features for color detection. However, at night or in low light conditions, due to the low brightness of images captured by explosion-proof cameras, the contrast is significantly affected, which may result in the inability to accurately identify color change information. In addition, stray light or background noise may also interfere with the image processing system, thereby reducing monitoring accuracy and stability.

[0011] (2) New problems caused by nighttime supplementary lighting solutions Although night imaging can be enhanced by increasing infrared lighting, extending exposure time, etc., these methods usually lead to other effects. For example, color information is lost under infrared lighting conditions and can only be converted into black and white image mode for processing, which makes color recognition-based methods invalid; and extending exposure time may cause problems such as motion blur and increased noise, which is not conducive to accurate judgment.

[0012] (3) Insufficient positioning accuracy Current application solutions often use a single explosion-proof camera to monitor multiple tapes within a certain area. When a hydrogen leak occurs, only the color change of the target area can be found, but it is difficult to accurately determine the location of the specific tape. This means that operators need to further investigate the specific leakage point, which delays the emergency response time.

[0013] Therefore, how to optimize the existing hydrogen leak monitoring system based on explosion-proof cameras and hydrogen-sensitive tapes to make it adapt to complex lighting conditions and improve the monitoring capabilities in low-light environments while achieving more accurate leak location is an important technical problem that needs to be solved urgently. Summary of the invention

[0014] In order to overcome the defects of the above-mentioned prior art, the present application provides a hydrogen leakage monitoring method, system, equipment and medium, which can adapt to complex lighting conditions and quickly and accurately realize real-time online monitoring of hydrogen leakage at night or under low light conditions. It has the characteristics of high automation level, simple implementation, high recognition accuracy and real-time online, which improves the monitoring capability in low light environment and realizes more accurate leakage location.

[0015] In order to solve the above technical problems, this application provides the following technical solutions: According to a first aspect of an embodiment of the present application, a hydrogen leakage monitoring method is provided, comprising: Get the target video stream; Based on the target video stream, intercepting a key frame image; Preprocessing the key frame image to obtain a preprocessed image; Performing color space conversion on the preprocessed image to obtain a converted image; Based on the converted image, environmental information is obtained; the environmental information includes environmental background information and environmental lighting information; Determining a color threshold based on the ambient lighting information; Analyzing the converted image to obtain target information; Identifying the target information to obtain an identification result; Compare and analyze the color threshold and the recognition result to obtain a discrimination result; When the discrimination result indicates that there is a hydrogen leakage point, the location of the leakage point is determined based on the environmental background information, and a visual output and an alarm are performed.

[0016] In an exemplary embodiment, obtaining environmental information based on the converted image includes: Comparing and analyzing the conversion image with a plurality of sample images to obtain a comparison result; When the comparison result satisfies a preset comparison condition, the environmental information is determined.

[0017] In an exemplary embodiment, the method further comprises: When the comparison result does not satisfy the preset comparison condition, the environmental background information is determined according to the operating parameters of the image acquisition device, and the environmental preset lighting information is determined as the environmental lighting information.

[0018] In an exemplary embodiment, analyzing the conversion image to obtain target information includes: When the comparison result satisfies the preset comparison condition, edge detection or texture analysis is used to extract key color features in the converted image to automatically select a target and obtain the target information.

[0019] In an exemplary embodiment, the method further comprises: When the comparison result does not satisfy the preset comparison condition, the target information is manually determined and the ambient light is supplemented in time.

[0020] In an exemplary embodiment, identifying the target information to obtain an identification result includes: Using a machine learning model, classify the target information to obtain a classification result; The recognition result is determined based on the category corresponding to the classification result.

[0021] In an exemplary embodiment, when the discrimination result indicates that there is a hydrogen leakage point, the leakage point location is determined based on the environmental background information, and a visual output and an alarm are performed, including: When the discrimination result indicates that there is a hydrogen leakage point, based on the environmental background information, obtaining a standard image corresponding to the environmental background information; Analyze the discrimination result and the standard image corresponding to the environmental background information to determine the location of the leakage point; The location of the leakage point is visually outputted, and an alarm instruction is triggered to sound an alarm.

[0022] According to a second aspect of an embodiment of the present application, a hydrogen leakage monitoring system is provided, which is implemented by using any of the above-mentioned hydrogen leakage monitoring methods, and the system includes: A video stream acquisition module is used to acquire a target video stream; An image capture module, used for capturing key frame images based on the target video stream; An image preprocessing module, used for preprocessing the key frame image to obtain a preprocessed image; An image conversion module, used for performing color space conversion on the preprocessed image to obtain a converted image; An environmental information acquisition module, used to obtain environmental information based on the converted image; the environmental information includes environmental background information and environmental lighting information; A color threshold determination module, used to determine a color threshold based on the ambient light information; A target information acquisition module, used for analyzing the conversion image to obtain target information; An identification module, used to identify the target information and obtain an identification result; A discrimination module, used for comparing and analyzing the color threshold and the recognition result to obtain a discrimination result; The visualization and alarm module is used to determine the location of the leakage point based on the environmental background information, and to perform visualization output and alarm when the discrimination result indicates that there is a hydrogen leakage point.

[0023] According to a third aspect of an embodiment of the present application, an electronic device is provided, comprising a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to implement any of the above-mentioned hydrogen leakage monitoring methods.

[0024] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, wherein at least one instruction or at least one program is stored in the storage medium, and the at least one instruction or the at least one program is loaded and executed by a processor to implement any of the above-mentioned hydrogen leakage monitoring methods.

[0025] By adopting the above technical solution, the present application has the following beneficial effects: (1) The present invention successfully developed an innovative solution that can detect hydrogen leaks in real time and accurately locate the leak point by utilizing the unique color-changing characteristics of hydrogen color-changing tape, combined with image acquisition, recognition algorithms and positioning algorithms. The design of the present invention can not only quickly detect hydrogen leaks (including rapid leaks and micro leaks) at the first time, but also determine the leak location with high precision, thereby preventing safety hazards caused by hydrogen leaks at an early stage, providing timely alarm reminders and maintenance guidance for relevant personnel, and effectively avoiding major safety risks such as explosions caused by hydrogen leaks and accumulation.

[0026] (2) Compared with traditional hydrogen detection methods, the present invention greatly improves the monitoring speed and accuracy, and realizes real-time online leakage monitoring, and its automation level and wide applicability are significantly improved. By using hydrogen color-changing tape and combining it with an image processing algorithm based on artificial intelligence, high-sensitivity detection of trace hydrogen leaks can be achieved in complex environments. Especially in industrial scenarios, this technology shows extremely high stability and is suitable for a variety of installation methods. It has strong applicability whether it is covering a large area or local key monitoring.

[0027] (3) The present invention successfully solves the problem of insufficient efficiency of traditional monitoring methods in low-light environments by optimizing the photosensitivity of the camera hardware and improving the algorithm processing mechanism at night or in low-light environments, thereby achieving all-weather monitoring capabilities. Not only can it ensure detection accuracy in high-light environments during the day, it also has the function of adapting to complex lighting conditions. It can still quickly and accurately identify hydrogen leaks and accurately locate leak points in low-light or night environments. This makes the present invention particularly suitable for industrial scenarios with 24-hour continuous operation, such as chemical plants, gas transmission pipeline facilities, hydrogen storage equipment, and energy production bases, greatly improving the reliability of hydrogen safety management in the industrial field.

[0028] (4) The design of the present invention takes into account the need for flexible deployment. It has a simple structure, is easy to implement, and is compatible with existing video surveillance systems, enabling rapid deployment and reducing implementation costs. Combined with highly integrated software algorithms, the system is not only highly intelligent, but also has strong detection capabilities for changes in hydrogen concentration (such as trace leaks) in dynamic environments. These features further expand its scope of application and provide an integrated solution for hydrogen disposal from leak detection to risk disposal.

[0029] (5) Through the present invention, industrial operation units and energy enterprises can significantly reduce the economic losses caused by equipment damage, shutdown, and even safety accidents due to hydrogen leakage, which not only effectively protects the safety of life and property, but also provides a solid safety guarantee for the hydrogen energy infrastructure in the development of new energy.

[0030] In summary, the present invention has the significant technical advantages of easy operation, high sensitivity, high recognition accuracy, real-time online, high automation level, and adaptability to complex environments. It is of great significance to the development of modern industrial safety supervision and new energy fields, and is expected to be widely promoted and applied in energy safety management and intelligent industries. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0032] Figure 1 A schematic diagram of a hydrogen leakage monitoring method provided in an embodiment of the present application; Figure 2 A tape positioning diagram of a hydrogen leakage monitoring method provided in an embodiment of the present application; Figure 3 An actual flow chart of a hydrogen leakage monitoring method provided in an embodiment of the present application; Figure 4 A structural block diagram of a hydrogen leakage monitoring system provided in an embodiment of the present application; Figure 5 An actual structural diagram of a hydrogen leakage monitoring system provided in an embodiment of the present application; Figure 6 An operation flow chart of a hydrogen leakage monitoring system provided in an embodiment of the present application; Figure 7 A hardware structure block diagram of an electronic device for running a hydrogen leakage monitoring method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0033] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0034] The term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure or characteristic that may be included in at least one implementation of the present application. In the description of the embodiments of the present application, it should be understood that the orientation or positional relationship indicated by the terms "upper", "lower", "top", "bottom", etc. is based on the orientation or positional relationship shown in the accompanying drawings, which is only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present application. In addition, the terms "first" and "second" are used only for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first" and "second" may include one or more of the features explicitly or implicitly. Moreover, the terms "first", "second", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described here can be implemented in an order other than those illustrated or described here.

[0035] See also Figure 1 , which is a flow chart of a hydrogen leakage monitoring method provided in an embodiment of the present application, the hydrogen leakage monitoring method comprising: Step S1: Obtain target video stream; Step S2: based on the target video stream, intercepting the key frame image; Step S3: preprocessing the key frame image to obtain a preprocessed image; Step S4: performing color space conversion on the preprocessed image to obtain a converted image; Step S5: obtaining environmental information based on the converted image; the environmental information includes environmental background information and environmental lighting information; Step S6: Determine a color threshold based on ambient lighting information; Step S7: Analyze the converted image to obtain target information; Step S8: Identify the target information and obtain the identification result; Step S9: Compare and analyze the color threshold and the recognition result to obtain the discrimination result; Step S10: When the judgment result indicates that there is a hydrogen leakage point, the location of the leakage point is determined based on the environmental background information, and a visual output and an alarm are performed.

[0036] In an optional embodiment, the target video stream in the above step S1 indicates that the content captured by the image acquisition module includes a video stream of the hydrogen color-changing tape. The target video stream can be obtained by training a relevant model to automatically identify and intercept the video stream containing the hydrogen color-changing tape, or by pre-setting relevant operating parameters of the image acquisition module to determine which parameters of the video stream contain the hydrogen color-changing tape, and automatically intercepting the video stream of the relevant operating parameters during the acquisition process of the image acquisition module. Specifically, the video monitoring frame selection technology is used to select and monitor a specific tape area, and the angle and focal length of the camera are adjusted to ensure that the tape area is clearly visible.

[0037] The hydrogen color-changing tape used is a gas-sensitive color-changing tape product composed of hydrogen-sensitive nanomaterials, pigments, silicone rubber and other colloidal materials; the color of the hydrogen color-changing tape depends on the ratio of the hydrogen-sensitive nanomaterials and the pigments, and is generally a striking light color, such as yellow; the tape has good air permeability, which is convenient for color change reaction after contact with hydrogen, shortening the reaction response time; the color of the hydrogen color-changing tape after the reaction with hydrogen is generally dark blue-black, etc., which is convenient for visual identification; the hydrogen color-changing tape should also be easy to paste, such as being self-adhesive; The image acquisition module is composed of an explosion-proof camera, a matching explosion-proof bracket, and communication and power supply auxiliary materials. Among them, a camera with high photosensitivity and auxiliary fill light devices or night vision functions should be selected, such as a full-color night vision camera; the camera can be selected from a variety of types such as a ball camera, a hemispherical camera, and a gun camera; the communication power supply is preferably POE power supply, which is safer for on-site applications; optionally, the image acquisition module can use a camera with high dynamic range (HDR) function to capture image details under wider lighting conditions, such as the Hikvision DS-2XE8147FWD-LS 4 million explosion-proof full-color hemispherical network camera.

[0038] In an optional embodiment, the key frame image in the above step S2 can be captured in one of the following ways: Method 1: Capture at fixed time intervals; specifically, extract some frame images in the target video stream according to the time intervals and save them as key frame images; Method 2: Capture based on scene changes; specifically, use a brightness histogram or other indicators to determine whether a scene has changed significantly. If it is determined to be a scene change, it is extracted as a key frame image.

[0039] Specifically, pictures may be captured from the received video stream of the fitted frame selection image at a fixed time interval, and the colors of the tapes in the five frame selection images before and after may be compared. The time interval may be customized, such as 5 seconds.

[0040] In an optional embodiment, the above step S3 may include: The key frame image is subjected to noise removal and contrast enhancement to obtain a preprocessed image to improve image quality.

[0041] In an optional embodiment, the above step S4 may include: The preprocessed image is converted from the RGB color space to a color space more suitable for color recognition, such as HSV (hue, saturation, brightness) or Lab (brightness, a color difference, b color difference), to obtain a converted image for easy color recognition and analysis.

[0042] In an optional embodiment, the above step S5 may include: Compare and analyze the converted image with multiple sample images to obtain a comparison result; When the comparison result meets the preset comparison condition, the environmental information is determined.

[0043] Specifically, the sample image is collected and verified in advance.

[0044] In an optional embodiment, the above step S5 may further include: When the comparison result does not satisfy the preset comparison condition, the environmental background information is determined according to the operating parameters of the image acquisition device, and the preset illumination information is determined as the environmental illumination information.

[0045] In an optional embodiment, the above step S6 dynamically sets the color recognition threshold based on the lighting characteristics of the target environment to distinguish color changes; specifically, the hue (H) and saturation (S) thresholds in the HSV color space are dynamically adjusted according to the real-time measurement value of the ambient light.

[0046] In an optional embodiment, the above step S7 may include: When the comparison result meets the preset comparison conditions, edge detection or texture analysis methods are used to extract key color features in the converted image to automatically select the target and obtain the target information.

[0047] Specifically, edge detection, texture analysis and other methods are used to extract key color features in the image, automatically select the target, and automatically position the tape.

[0048] In an optional embodiment, the above step S7 may further include: When the comparison result does not meet the preset comparison conditions, manually determine the target information and supplement the ambient lighting in time.

[0049] Specifically, the operator can supplement the ambient lighting by adding light on site or adjusting parameters of the image acquisition module.

[0050] Preferably, the Canny algorithm is used to detect the edge of the target and extract the contour of the color change in the image for automatic target recognition of the location where the hydrogen color-changing tape is pasted. Specifically, it includes: 1) Noise Reduction: First, the input image is smoothed using a Gaussian filter to reduce image noise, which helps avoid false edge detection caused by noise.

[0051] 2) Gradient calculation: Next, the algorithm calculates the gradient magnitude and direction of each pixel in the image. The gradient magnitude indicates the intensity of the change in image brightness, while the gradient direction indicates the direction of this change.

[0052] 3) Non-maximum suppression: In this step, the maximum values ​​of the local gradient magnitude are found, and only the edge pixels corresponding to these maximum values ​​are retained. Non-maximum suppression is achieved by comparing the gradient magnitude of each pixel with its neighboring pixels, ensuring that only pixels on the edge line are retained.

[0053] 4) Hysteresis Threshold: Finally, two thresholds (high threshold and low threshold) are used to determine and connect edges. If the gradient magnitude of a pixel is higher than the high threshold, the pixel is determined to be a strong edge; if it is between the two thresholds, it needs to be connected to a strong edge to be considered part of the edge; pixels below the low threshold are excluded.

[0054] For those that cannot be automatically identified, video surveillance frame selection technology is used to support manual free selection of the points to be monitored.

[0055] In an optional embodiment, the above step S8 may include: Use the machine learning model to classify the target information and obtain the classification results; Based on the category corresponding to the classification result, the recognition result is determined.

[0056] Specifically, a trained machine learning model, such as a support vector machine (SVM) or a convolutional neural network (CNN), is used to classify the extracted color features to identify color changes. The specific steps may include: A pre-trained convolutional neural network (CNN) is used to identify color features in the target. The CNN has been trained on a large amount of image data with different lighting conditions, especially nighttime image data, to identify different degrees and types of color changes.

[0057] In an optional embodiment, the above step S9 is used to perform differentiated discrimination for different lighting conditions, so as to achieve accurate discrimination of the color change of the hydrogen color-changing tape under different lighting conditions.

[0058] like Figure 2 As shown, in an optional embodiment, the above step S10 may include: When the discrimination result indicates that there is a hydrogen leakage point, a standard image corresponding to the environmental background information is obtained based on the environmental background information; Analyze the standard image corresponding to the discrimination result and environmental background information to determine the location of the leakage point; The location of the leakage point is visually output and the alarm command is triggered to sound an alarm.

[0059] Specifically, the output results are output through screen display or other means to facilitate further processing by monitoring personnel or automation systems. The alarm module should support multiple alarm forms, including but not limited to sound / light alarms, voice broadcasts, telephone text messages, etc.

[0060] In an optional embodiment, the above step S10 may further include: If the judgment result indicates that there is no hydrogen leakage point, continue monitoring.

[0061] like Figure 3 As shown, in a practical application, the hydrogen leakage monitoring method includes the following steps: 1. Image and video stream acquisition: You can improve the imaging quality of the camera in low light conditions and enhance the camera's photosensitivity by selecting a high-sensitivity camera or adding additional photosensitive elements.

[0062] 2. Image preprocessing: Remove noise and enhance contrast of the original image captured by the camera to improve image quality.

[0063] 3. Color space conversion: Convert the image from RGB color space to a color space more suitable for color recognition, such as HSV (hue, saturation, brightness) or Lab (brightness, a color difference, b color difference) 4. Set color threshold: Based on the lighting characteristics of the target environment, dynamically set the color recognition threshold to distinguish color changes.

[0064] 5. Target selection: Use edge detection, texture analysis and other methods to extract key color features in the image, automatically select the target, and automatically position the tape. Or, for those that cannot be automatically identified, use video surveillance selection technology to manually select the points to be monitored.

[0065] 6. Machine learning classification: Use a trained machine learning model, such as a support vector machine (SVM) or a convolutional neural network (CNN), to classify the extracted color features to identify color changes.

[0066] 7. Compare and judge the threshold value: compare and judge the classification result with the set color threshold value.

[0067] 8. Output the discrimination results: present the discrimination results in a visual way, such as marking a highlight box in the color change area or outputting the statistical information of the color change.

[0068] In a practical application scenario, the hydrogen leakage monitoring method may include: (1) Automatically identify and select the leak-prone points where the hydrogen color-changing tape is pasted on the monitoring screen of the image acquisition module. The color of the box is green; (2) Capture images of the received video stream of the fitted frame selection image at fixed time intervals, and compare the tape colors in the five frame selection images before and after. The time interval can be customized, such as 5 seconds. (3) If the color of the tape in the box selection does not change, no result is output; if the color of the tape in the box selection changes, the alarm result is output to the system platform, such as "suspected leakage"; (4) After receiving the alarm result, the corresponding alarm information is issued in the corresponding alarm form according to the customized alarm mechanism; (5) Automatically generate relevant records of the alarm information, including time, location, event name, abnormal picture, and support for input of event confirmation details, handler, processing / repair picture, processing / repair time, etc.

[0069] It can be seen from the above technical solutions of the embodiments of the present application that in the embodiments of the present application, by utilizing the color-changing characteristics of the hydrogen color-changing tape, combined with image acquisition, recognition algorithms and positioning algorithms, hydrogen leaks can be quickly discovered and the leak points can be accurately located, thereby reminding relevant personnel to repair and maintain in a timely manner, effectively avoiding the safety risks that may be caused by the accumulation of hydrogen leaks, and realizing rapid, accurate and real-time online monitoring of hydrogen leaks. It has the advantages of high automation level, simple operation, and high recognition accuracy. Especially at night or in low light conditions, by optimizing the camera's photosensitivity and improving the algorithm processing mechanism, the accuracy and stability of monitoring and identification are further improved, so that it has the ability to adapt to complex lighting environments, greatly improving the monitoring efficiency and positioning accuracy of hydrogen leaks at night or in low light environments, providing a strong technical guarantee for hydrogen safety management, and is of great significance to improving industrial safety.

[0070] Corresponding to the hydrogen leakage monitoring method provided in the above embodiment, the embodiment of the present application also provides a hydrogen leakage monitoring system. Since the hydrogen leakage monitoring system provided in the embodiment of the present application corresponds to the hydrogen leakage monitoring method provided in the above embodiment, the implementation method of the aforementioned hydrogen leakage monitoring method is also applicable to the hydrogen leakage monitoring system provided in this embodiment, and will not be described in detail in this embodiment.

[0071] See also Figure 4, which is a structural block diagram of a hydrogen leakage monitoring system provided in an embodiment of the present application; the system comprises: 01: Video stream acquisition module, used to acquire the target video stream; 02: Image capture module, used to capture key frame images based on the target video stream; 03: Image preprocessing module, used to preprocess the key frame image to obtain a preprocessed image; 04: Image conversion module, used to perform color space conversion on the preprocessed image to obtain a converted image; 05: Environmental information acquisition module, used to obtain environmental information based on the converted image; the environmental information includes environmental background information and environmental lighting information; 06: A color threshold determination module, used to determine a color threshold based on ambient light information; 07: Target information acquisition module, used to analyze the converted image and obtain target information; 08: Recognition module, used to identify the target information and obtain the recognition result; 09: a discrimination module, used to compare and analyze the color threshold and the recognition result to obtain a discrimination result; 10: Visualization and alarm module, used to determine the location of the leakage point based on the environmental background information, and perform visualization output and alarm when the judgment result indicates that there is a hydrogen leakage point.

[0072] like Figure 5 As shown, in a practical application, the hydrogen leakage monitoring system includes a hydrogen color changing tape, an image acquisition module, a hydrogen leakage identification algorithm module, an alarm module and a system platform; Among them, multiple hydrogen color-changing tapes are used to be pasted on leakage-prone points in the monitoring and identification image acquisition area. When hydrogen leakage occurs at the point, the color changes, and the hydrogen leakage information is converted into color change information of the hydrogen color-changing tape, such as changing from yellow to blue-black; the image acquisition module is used to collect real-time video images in the monitoring area and transmit them to the hydrogen leakage identification algorithm module; the hydrogen leakage identification algorithm module is used to process, identify, analyze and judge whether hydrogen leakage occurs on the received image information, and output the judgment result to the system platform; the system platform is used to display the real-time video of the image acquisition module, process the judgment result of the hydrogen leakage identification algorithm module and send alarm instructions to the alarm module, as well as statistically summarize and display relevant information charts, leakage fault handling records and other contents; the alarm module is used to receive alarm signals and issue alarm information.

[0073] Specifically, hydrogen color-changing tape is a gas-sensitive color-changing tape product composed of hydrogen-sensitive nanomaterials, pigments, silicone rubber and other colloidal materials; the color of the hydrogen color-changing tape depends on the ratio of the hydrogen-sensitive nanomaterials and the pigments, and is generally a striking light color, such as yellow; the tape has good air permeability, which is convenient for color change reaction after contact with hydrogen, shortening the reaction response time; the color of the hydrogen color-changing tape after the reaction with hydrogen is generally dark tones such as blue-black, which is convenient for visual identification; the hydrogen color-changing tape should be easy to paste, such as being self-adhesive; The image acquisition module is composed of an explosion-proof camera, a matching explosion-proof bracket, and communication and power supply auxiliary materials. The camera should be highly sensitive and have auxiliary light-filling devices or night vision functions, such as a full-color night vision camera. The camera can be a ball camera, a hemispherical camera, a gun camera, and other types. The communication power supply is preferably POE, which is safer for on-site applications. The hydrogen leak identification algorithm module is composed of hydrogen leak identification algorithm software, computer hardware and supporting power supply and communication auxiliary materials, wherein the hydrogen leak identification algorithm software is mainly used to process, identify, analyze and judge whether hydrogen leak occurs on the video stream transmitted by the received image acquisition module, and output the judgment result to the system platform; Optionally, the hydrogen leak identification algorithm module can only retain the algorithm software and use the computer hardware of the system platform for data processing and analysis; Optionally, the hydrogen leak identification algorithm module uses video monitoring frame selection technology to select and monitor specific tape areas in real time to reduce interference from irrelevant information; Preferably, the hydrogen leak identification algorithm software should have a night / dark light automatic identification function to facilitate all-weather use and improve identification accuracy; Optionally, the algorithm module continuously optimizes the algorithm to improve the accuracy and real-time performance of hydrogen leak identification; Preferably, the computer hardware should have a certain streaming media computing and processing capability, as well as a large storage space for local backup; The system platform is used to display the real-time video of the image acquisition module, process the judgment results of the hydrogen leakage identification algorithm module and send alarm instructions to the alarm module, as well as to summarize and display relevant information in charts, leakage fault processing records and other contents; preferably, the system platform should be convenient for local deployment and have certain compatibility with system versions, browsers, etc.; optionally, the system platform can support the setting of safety thresholds and alarm rules. According to actual needs, the safety threshold of hydrogen leakage can be set. Once the detected hydrogen leakage exceeds the safety threshold, the system will automatically trigger an alarm to remind the operator to take timely measures; The alarm module is used to receive the alarm signal sent by the system platform and send out corresponding alarm information according to the content of the alarm signal. The alarm forms include but are not limited to sound / light alarm, voice broadcast, telephone text message, etc.

[0074] As can be seen from the above, the system includes: hydrogen color-changing tape, image acquisition module, hydrogen leakage identification algorithm module, alarm module and system platform. Hydrogen color-changing tape is pasted at the point where hydrogen is prone to leakage. The image acquisition module collects the video of the hydrogen color-changing tape within the viewing angle in real time. The hydrogen leakage identification algorithm module processes, identifies, analyzes and judges whether hydrogen leakage occurs on the received video, and outputs the judgment result to the system platform. The platform issues a predetermined alarm instruction and releases alarm information. This method is fast and accurate, can detect hydrogen leakage at the first time, and can accurately locate the hydrogen leakage point, reminding personnel to carry out inspection and maintenance in time, so as to avoid the accumulation of hydrogen leakage and cause greater safety risks.

[0075] In a practical application scenario, the construction and operation process of the hydrogen leak monitoring system includes: (1) System construction: First, attach hydrogen color-changing tape to possible hydrogen leakage points; then, install a high-definition camera to capture the color changes of the hydrogen color-changing tape within the field of view; connect the camera electrical signal to the hydrogen leakage identification algorithm module for processing and analysis; connect the hydrogen leakage identification algorithm module electrical signal to the system platform to transmit the judgment result; the system platform electrical signal / wireless signal contacts the alarm module to issue an alarm command.

[0076] (2) Video surveillance frame selection: Use video surveillance frame selection technology to select and monitor a specific tape area; adjust the angle and focal length of the camera to ensure that the tape area is clearly visible; (3) Hydrogen leak detection: The real-time image processing system processes the image of the tape area and uses the hydrogen leak detection algorithm to identify the change in the color of the tape. Once the color change exceeds the safety threshold, the system immediately triggers an alarm. (4) Leak point location and alarm: The system accurately selects the tape area where the leak point is located based on the degree and range of the tape color change, and displays the leak point location results on the user interface; at the same time, the system issues an alarm sound and light prompt to remind the operator to take timely measures.

[0077] (5) System optimization and upgrade: Regularly optimize and upgrade the system to improve the accuracy and real-time performance of hydrogen leak identification; improve system performance and stability by updating algorithms and hardware equipment.

[0078] like Figure 6As shown, in a specific implementation case, the image acquisition module will shoot the hydrogen color-changing tape within the viewing angle in real time, and then transmit the video stream to the low-light environment hydrogen leak identification algorithm module for processing, analysis, classification, and discrimination, output the discrimination result, and transmit it to the system platform through an electrical signal. If the system platform receives a "normal" signal, it will not respond, and the real-time video screen will be displayed. If the system platform receives an "abnormal" signal, an alarm instruction will be sent to the alarm module, and an alarm message will be issued according to the preset alarm rules; at the same time, the green frame selection image of the abnormal point on the platform video screen will be changed to a red frame selection image, and the picture window will keep shaking for further prompts; in addition, the system platform automatically generates the alarm record. After the point returns to normal, the red frame selection image automatically returns to green, and the picture window no longer shakes.

[0079] The system realizes the hydrogen leak identification system by identifying the leakage point in the video surveillance frame through hydrogen color-changing tape. It has the advantages of real-time monitoring, accurate positioning, and automatic alarm. It provides a new solution for industrial safety monitoring. The solution is simple, low-cost, does not require manual judgment, and ensures timeliness and accuracy.

[0080] It should be noted that the system provided in the above embodiment, when implementing its functions, is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the system and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0081] The hydrogen leakage monitoring system of the embodiment of the present application can quickly detect hydrogen leakage and accurately locate the leakage point by utilizing the color-changing characteristics of hydrogen color-changing tape, combined with image acquisition, recognition algorithm and positioning algorithm, so as to remind relevant personnel to carry out timely repair and maintenance, effectively avoiding the safety risks that may be caused by the accumulation of hydrogen leakage, and realizing rapid, accurate and real-time online monitoring of hydrogen leakage, with the advantages of high automation level, simple operation and high recognition accuracy. Especially at night or in low light conditions, by optimizing the photosensitivity of the camera and improving the algorithm processing mechanism, the accuracy and stability of monitoring and identification are further improved, so that it has the ability to adapt to complex lighting environments, greatly improving the monitoring efficiency and positioning accuracy of hydrogen leakage at night or in low light environments, providing a strong technical guarantee for hydrogen safety management, which is of great significance to improving industrial safety.

[0082] An embodiment of the present application also provides an electronic device, including a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or at least one program is loaded and executed by the processor to implement the hydrogen leakage monitoring method provided in the above method embodiment.

[0083] The memory can be used to store software programs and modules. The processor executes various functional applications and realizes high-level autonomous driving by running the software programs and modules stored in the memory. The memory may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, application programs required for functions, etc.; the data storage area may store data created according to the use of the device, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. Accordingly, the memory may also include a memory controller to provide the processor with access to the memory.

[0084] The method embodiments provided in the embodiments of the present application may be executed in a computer terminal, a server or a similar computing device, that is, the above-mentioned electronic device may include a computer terminal, a server or a similar computing device.

[0085] Figure 7 is a hardware structure block diagram of an electronic device for running a hydrogen leakage monitoring method provided in an embodiment of the present application, such as Figure 7 As shown, the internal structure of the electronic device may include but is not limited to: a processor, a network interface and a memory. The processor, network interface and memory in the electronic device may be connected via a bus or other means. Figure 7 The example of connecting through bus is taken in the following.

[0086] Among them, the processor (or CPU (Central Processing Unit)) is the computing core and control core of the electronic device. The network interface may optionally include a standard wired interface, a wireless interface (such as WI-FI, a mobile communication interface, etc.). Memory is a memory device in an electronic device for storing programs and data. It is understandable that the memory here can be a high-speed RAM storage device or a non-volatile memory device, such as at least one disk storage device; optionally, it can also be at least one storage device located away from the aforementioned processor. The memory provides a storage space, which stores the operating system of the electronic device, including but not limited to: Windows system (an operating system), Linux (an operating system), Android (Android, a mobile operating system) system, IOS (a mobile operating system) system, etc., and this application does not limit this; and, in the storage space, one or more instructions suitable for being loaded and executed by the processor are also stored, and these instructions can be one or more computer programs (including program codes). In the embodiment of this specification, the processor loads and executes one or more instructions stored in the memory to implement the hydrogen leakage monitoring method provided in the above method embodiment.

[0087] An embodiment of the present application also provides a computer-readable storage medium, in which at least one instruction or at least one program is stored, and the at least one instruction or at least one program is loaded and executed by a processor to implement the hydrogen leakage monitoring method provided in the method embodiment.

[0088] Optionally, in this embodiment, the above-mentioned storage medium may include but is not limited to: a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and other media that can store program codes.

[0089] It should be noted that the above-mentioned sequence of the embodiments of the present application is for description only and does not represent the advantages and disadvantages of the embodiments. And the above describes a specific embodiment of this specification. Other embodiments are within the scope of the attached claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multi-small sample image classification and parallel processing are also possible or may be advantageous.

[0090] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0091] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0092] The above are only preferred embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A method for monitoring hydrogen leakage, characterized in that: include: Get the target video stream; Based on the target video stream, intercepting a key frame image; Preprocessing the key frame image to obtain a preprocessed image; Performing color space conversion on the preprocessed image to obtain a converted image; Based on the converted image, environmental information is obtained; the environmental information includes environmental background information and environmental lighting information; Determining a color threshold based on the ambient lighting information; Analyzing the converted image to obtain target information; Identifying the target information to obtain an identification result; Compare and analyze the color threshold and the recognition result to obtain a discrimination result; When the discrimination result indicates that there is a hydrogen leakage point, the location of the leakage point is determined based on the environmental background information, and a visual output and an alarm are performed.

2. The hydrogen leakage monitoring method according to claim 1, characterized in that: The obtaining of environmental information based on the converted image comprises: Comparing and analyzing the conversion image with a plurality of sample images to obtain a comparison result; When the comparison result satisfies a preset comparison condition, the environmental information is determined.

3. The hydrogen leakage monitoring method according to claim 2, characterized in that: The method further comprises: When the comparison result does not satisfy the preset comparison condition, the environmental background information is determined according to the operating parameters of the image acquisition device, and the preset lighting information is determined as the environmental lighting information.

4. The method for monitoring hydrogen leakage according to claim 3, characterized in that: The step of analyzing the converted image to obtain target information includes: When the comparison result satisfies the preset comparison condition, edge detection or texture analysis is used to extract key color features in the converted image to automatically select a target and obtain the target information.

5. The method for monitoring hydrogen leakage according to claim 4, characterized in that: The method further comprises: When the comparison result does not satisfy the preset comparison condition, the target information is manually determined and the ambient light is supplemented in time.

6. The method for monitoring hydrogen leakage according to claim 1, characterized in that: The identifying the target information to obtain an identification result includes: Using a machine learning model, classify the target information to obtain a classification result; The recognition result is determined based on the category corresponding to the classification result.

7. The method for monitoring hydrogen leakage according to any one of claims 1 to 6, characterized in that: When the discrimination result indicates that there is a hydrogen leakage point, the leakage point location is determined based on the environmental background information, and a visual output and an alarm are performed, including: When the discrimination result indicates that there is a hydrogen leakage point, based on the environmental background information, obtaining a standard image corresponding to the environmental background information; Analyze the discrimination result and the standard image corresponding to the environmental background information to determine the location of the leakage point; The location of the leakage point is visually outputted, and an alarm instruction is triggered to sound an alarm.

8. A hydrogen leakage monitoring system, implemented by the hydrogen leakage monitoring method according to any one of claims 1 to 7, characterized in that: The system comprises: A video stream acquisition module is used to acquire a target video stream; An image capture module, used for capturing key frame images based on the target video stream; An image preprocessing module, used for preprocessing the key frame image to obtain a preprocessed image; An image conversion module, used for performing color space conversion on the preprocessed image to obtain a converted image; An environmental information acquisition module, used to obtain environmental information based on the converted image; the environmental information includes environmental background information and environmental lighting information; A color threshold determination module, used to determine a color threshold based on the ambient light information; A target information acquisition module, used for analyzing the conversion image to obtain target information; An identification module, used to identify the target information and obtain an identification result; A discrimination module, used for comparing and analyzing the color threshold and the recognition result to obtain a discrimination result; The visualization and alarm module is used to determine the location of the leakage point based on the environmental background information, and to perform visualization output and alarm when the discrimination result indicates that there is a hydrogen leakage point.

9. An electronic device, characterized in that: It comprises a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to implement the hydrogen leakage monitoring method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, wherein at least one instruction or at least one program is stored in the storage medium, and the at least one instruction or the at least one program is loaded and executed by a processor to implement the hydrogen leakage monitoring method according to any one of claims 1 to 7.

Images