Method, system and medium for analyzing fire situation in integrated pipe gallery based on video image signals

Through video image signal analysis methods and equipment, the fire location is identified and calculated, and obstacles are overcome. Combined with temperature sensors and fire extinguishing strategies, the problem of unknown fire location in the integrated pipeline corridor is solved, and precise fire extinguishing is achieved.

CN116246412BActive Publication Date: 2025-09-30SHANGHAI TENSUN TRANSMART
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211560083.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-12-07
Publication Date
2025-09-30
Estimated Expiration
2042-12-07

AI Technical Summary

Technical Problem

In the existing technology, when a fire occurs in an integrated pipeline corridor, it is impossible to accurately determine the location of the fire, resulting in untimely fire extinguishing and affecting normal work.

Method used

A comprehensive pipeline corridor fire analysis method based on video image signals is adopted. Video images are obtained through monitoring equipment, fire points are identified, their actual locations are calculated, and fire warning information is generated. The camera position is adjusted using drive components to overcome obstructions and comprehensively capture the fire range. Combined with temperature sensors and preset fire extinguishing strategies, the accuracy of fire extinguishing is improved.

Benefits of technology

It achieves precise positioning of the fire location and timely response, and improves the accuracy and efficiency of fire fighting in the integrated pipeline corridor.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116246412B_ABST
    Figure CN116246412B_ABST
Patent Text Reader

Abstract

The present application relates to a method, system, and medium for analyzing fire conditions in an integrated pipe corridor based on video image signals, and relates to the field of fire early warning. The method comprises: obtaining a current video image captured by a monitoring device; identifying the current video image to determine whether a target point exists in the image corresponding to the current video image, wherein the target point is the location where the fire occurred; if so, obtaining a calibration point in the current video image; calculating the actual location of the target point based on the calibration point, and generating fire early warning information based on the actual location of the target point. The present application facilitates staff to understand the actual location of the fire occurrence point and improves the accuracy of fire extinguishing in the integrated pipe corridor.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of fire warning, and in particular to a method, system and medium for analyzing fire conditions in an integrated pipe gallery based on video image signals. Background Art

[0002] An integrated pipeline corridor is built underground in cities to accommodate structures and ancillary facilities for two or more types of urban engineering pipelines. This tunnel, constructed underground, integrates various engineering pipelines, including power, communications, gas, heating, water supply, and drainage. It features dedicated access points for maintenance and lifting, and is uniformly planned, designed, constructed, and managed. It is a vital infrastructure and lifeline that ensures the smooth operation of cities.

[0003] The integrated pipe corridor is equipped with various signal lines, thermal pipes, gas pipes, telecommunication pipes, water pipes, power pipes, etc. It is a place where multiple signals and transmission objects intersect. When a fire occurs in the integrated pipe corridor and cannot be handled in time, it will cause huge economic losses and affect the normal operation of the integrated pipe corridor.

[0004] In related technologies, in order to fully ensure the environmental safety of the pipeline corridor and reduce the damage caused by fire to the integrated pipeline corridor, corresponding smoke sensors will be installed in the integrated pipeline corridor, and the monitoring signals of the smoke sensors will be led out from the integrated pipeline corridor to the ground, and then transmitted to the monitoring center through wireless communication. The monitoring center will perform fire extinguishing work based on the monitoring signals of the smoke sensors.

[0005] The inventor believes that when extinguishing a fire based on the smoke sensor monitoring signal, it is necessary to obtain the installation location of the smoke sensor and then reach the corresponding location of the smoke sensor to extinguish the fire. The specific location of the fire cannot be directly known, which easily reduces the timeliness of extinguishing the fire at the location where the fire occurs. Summary of the Invention

[0006] In order to facilitate staff to understand the actual location of the fire, take relevant measures at the fire point, and improve the accuracy of fire extinguishing in the integrated pipeline corridor, the present application provides an integrated pipeline corridor fire analysis method, system and medium based on video image signals.

[0007] In the first aspect, the present application provides a method for analyzing fire conditions in an integrated pipe gallery based on video image signals, which adopts the following technical solutions:

[0008] A fire analysis method for an integrated pipe gallery based on video image signals, comprising:

[0009] Obtain the current video image collected by the monitoring device;

[0010] Identify the current video image and determine whether there is a target point in the picture corresponding to the current video image, wherein the target point is a point where a fire occurs;

[0011] If yes, obtaining the calibration points in the current video image;

[0012] The actual position of the target point is calculated based on the calibration point, and fire warning information is generated based on the actual position of the target point.

[0013] By adopting the above technical solution, the server can use network cables to transmit fire warning signals to the warning equipment. The staff can understand the actual location of the target point based on the warning status of the warning equipment, which facilitates the adoption of relevant measures at the target point and improves the accuracy of fire extinguishing in the integrated pipeline corridor.

[0014] Optionally, the monitoring device includes an image camera, and the current video image includes a current first image captured by the image camera;

[0015] After identifying the current video image, the method further includes:

[0016] Determining whether there are multiple discontinuous objects in the current first image;

[0017] If yes, and there are multiple adjacent discontinuous objects, first adjustment information of the image camera is generated.

[0018] By adopting the above technical solution, when there may be an obstacle in the integrated pipeline corridor that blocks the image camera, the server sends a first adjustment information to the driving component, and the driving component drives the image camera to adjust its position according to the first adjustment information, so that the image camera can shoot objects behind the obstacle, thereby obtaining a first image that could not be captured behind the obstacle, thereby improving the accuracy of obtaining the fire status of objects in the integrated pipeline corridor.

[0019] Optionally, the image camera is connected to a driving component for driving the image camera to move, and the first adjustment information includes first driving direction information and first driving distance information of the driving component;

[0020] Generating the first adjustment information of the image camera includes:

[0021] Acquire an obstacle range map based on the discontinuous positions of the plurality of discontinuous objects;

[0022] acquiring the first driving direction information based on the obstacle range map and the current first image;

[0023] Acquire a plurality of shooting boundaries of the image camera based on the shooting angle of the image camera;

[0024] acquiring a target shooting boundary among the plurality of shooting boundaries based on the first driving direction information;

[0025] acquiring a target edge of the obstacle range map based on the first driving direction information;

[0026] Acquire a plurality of movement distance information when the image camera moves to a point where the target shooting boundary and the target edge intersect and the shooting range overlaps with the current shooting range, and acquire the first driving distance information based on the plurality of movement distance information;

[0027] The first adjustment information is generated based on the first driving direction information and the first driving distance information.

[0028] Optionally, after obtaining the calibration points in the current video image, the method further includes:

[0029] Determining whether the distance between the target point and the boundary of the current first image is less than a preset distance threshold;

[0030] If so, second adjustment information of the image camera is generated.

[0031] By adopting the above technical solution, when a fire occurs in an integrated pipe corridor, the fire tends to spread in the integrated pipe corridor, and the current first image may not capture the entire fire range. The driving component can drive the image camera to move according to the second adjustment information, and then capture the area outside the current first image, thereby improving the accuracy of fire range judgment in the integrated pipe corridor.

[0032] Optionally, the second adjustment information includes second driving direction information and second driving distance information of the driving component;

[0033] Generating the second adjustment information of the image camera includes:

[0034] using the direction in which the center point in the current first image approaches the target point as the second driving direction information;

[0035] Obtaining the locations of multiple temperature sensors for temperature alarm near the target point;

[0036] determining an estimated fire range based on positions of the plurality of temperature sensors;

[0037] acquiring the second driving distance information based on the expected fire range;

[0038] The second adjustment information is generated based on the second driving information and the second driving distance information.

[0039] Optionally, the monitoring device includes a thermal imaging camera, the current video image includes a current second image captured by the thermal imaging camera, and the calibration point includes an infrared hotspot;

[0040] Calculating the actual position of the target point based on the calibration point includes:

[0041] Obtaining a preset position of the infrared hotspot;

[0042] Constructing a coordinate system of the current second image, and obtaining a coordinate difference between the target point and the infrared hotspot in the current second image;

[0043] The actual position of the target point is calculated based on the preset position and the coordinate difference.

[0044] By adopting the above technical solution, the actual position of the target point is calculated based on the infrared hotspot, which reduces the possibility of a decrease in the accuracy of the first image captured by the image camera due to a failure of lighting equipment such as lighting in the integrated pipeline corridor.

[0045] Optionally, generating fire warning information based on the actual position of the target point includes:

[0046] Identifying type information corresponding to all objects contained in the current first image;

[0047] Obtaining a preset fire extinguishing strategy based on the type information;

[0048] The fire warning information is generated based on the preset fire extinguishing strategy.

[0049] By adopting the above technical solution, fire warning information is generated according to the preset fire extinguishing strategy. The staff can adopt the correct fire extinguishing strategy corresponding to the type of object on fire through the fire warning information, thereby improving the efficiency of fire extinguishing in the integrated pipeline corridor.

[0050] In the second aspect, the present application provides a fire analysis device for an integrated pipe gallery based on video image signals, which adopts the following technical solutions:

[0051] A fire analysis device for an integrated pipe gallery based on video image signals, comprising:

[0052] A first acquisition module is used to acquire the current video image collected by the monitoring device;

[0053] an identification and judgment module, configured to identify the current video image and determine whether a target point exists in the picture corresponding to the current video image, wherein the target point is a point where a fire occurs;

[0054] A second acquisition module is used to acquire a calibration point in the current video image when a target point exists in the picture corresponding to the current video image;

[0055] A calculation and generation module is used to calculate the actual position of the target point based on the calibration point, and generate fire warning information based on the actual position of the target point.

[0056] In a third aspect, the present application provides a fire analysis system for an integrated pipe gallery based on video image signals, which adopts the following technical solutions:

[0057] A fire analysis system for an integrated pipe gallery based on video image signals, comprising electronic equipment, monitoring equipment, a drive assembly for driving the monitoring equipment to move, and an early warning device for prompting staff;

[0058] The electronic device is communicatively connected with the monitoring device, the driving component, and the early warning device respectively;

[0059] The electronic device is used to execute the method according to any one of claims 1 to 7.

[0060] In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solution:

[0061] A computer-readable storage medium stores a computer program that can be loaded by a processor and execute the method described in the third aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] Figure 1 It is a flow chart of a method for analyzing fire conditions in an integrated pipe gallery based on video image signals according to an embodiment of the present application.

[0063] Figure 2 This is a schematic diagram of an obstacle blocking the image camera in the integrated pipeline corridor of an embodiment of the present application.

[0064] Figure 3 This is a schematic diagram of adjusting the position of an image camera according to an obstacle range map in an embodiment of the present application.

[0065] Figure 4 This is a schematic diagram of adjusting the position of the image camera according to the position of the target point in an embodiment of the present application.

[0066] Figure 5 This is a structural block diagram of an integrated pipe gallery fire analysis device based on video image signals in an embodiment of the present application.

[0067] Figure 6 This is a structural block diagram of an integrated pipe gallery fire analysis system based on video image signals in an embodiment of the present application.

[0068] Explanation of the accompanying reference numerals: 1. Current first image; 11. Thermal pipe; 12. Gas pipe; 13. Water pipe; 2. Obstacle range map; 21. Target edge; 3. Image camera; 31. Target shooting boundary; 4. Target point. DETAILED DESCRIPTION

[0069] The present application is further described in detail below with reference to the accompanying drawings.

[0070] The present application provides a method for analyzing fire conditions in a utility corridor based on video image signals. The method can be executed by an electronic device, which can be a server or a terminal device. The server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The terminal device can be, but is not limited to, a smartphone, a tablet computer, or a desktop computer.

[0071] like Figure 1 As shown, a fire analysis method for an integrated pipe gallery based on video image signals is implemented with a server as the execution subject. The main process of the method is described as follows (steps S101 to S103):

[0072] Step S101: obtaining a current video image captured by a monitoring device;

[0073] The monitoring equipment includes an image camera and a thermal imaging camera, both of which are installed in the integrated pipeline corridor. The image camera and the thermal imaging camera are used to shoot objects such as signal lines, thermal pipes, gas pipes, telecommunication pipes, water pipes, and power pipes in the integrated pipeline corridor. The currently shot content is the current video image. In this embodiment, the current video image includes the current first image shot by the image camera and the current second image shot by the thermal imaging camera.

[0074] Step S102: Identify the current video image and determine whether there is a target point in the picture corresponding to the current video image. The target point is the point where the fire occurs. If so, proceed to step S103;

[0075] The server has preset reference images for when a target point is present in a video image. These reference images can be images of smoke and flames from fires of varying severity within the utility corridor. The server processes and analyzes the current first image, comparing it with the reference image to determine whether the target point exists within the current first image.

[0076] Since any object above absolute zero (-273°C) in nature will continuously radiate infrared rays, the thermal imaging camera converts the infrared radiation from the surfaces of multiple objects in the integrated pipe corridor into a visible current second image. The current second image includes multiple colors, and the different colors in the current second image represent the different temperatures of the measured object. The server has preset reference colors for when there are target points in the video image. The reference colors can be the colors of objects such as smoke and flames when fires of varying degrees occur in the integrated pipe corridor. The server can process and analyze the current second image, and compare the multiple colors on the current second image with the reference colors to determine whether there are target points in the current second image.

[0077] When there is an obstacle in the utility corridor that blocks the image camera, the current first image may not include the current status of all objects in the utility corridor within the shooting area. Therefore, in order to improve the accuracy of determining whether there is a target point in the current first image, the following processing is further included after the current video image is recognized in step S102:

[0078] Step S1021: Determine whether there are multiple discontinuous objects in the current first image. If yes, proceed to step S1022;

[0079] In this embodiment, the discontinuous object is an object having a discontinuous outline in the current first image.

[0080] Step S1022: Determine whether there are multiple adjacent discontinuous objects in the current first image. If so, proceed to step S1023;

[0081] Multiple adjacent discontinuous objects refer to multiple discontinuous objects being in an adjacent state. When multiple adjacent discontinuous objects exist in the current first image, there may be obstacles in the integrated pipeline corridor that block the image camera.

[0082] Exemplarily, the current first image includes a heating pipe, a gas pipe and a water pipe, and the heating pipe, the gas pipe and the water pipe are arranged adjacent to each other in the integrated pipe gallery; if the heating pipe and the gas pipe in the current first image are discontinuous objects and the water pipe is a continuous object, then there are obstacles in the integrated pipe gallery that block the heating pipe and the gas pipe in the current first image; if the gas pipe and the water pipe in the current first image are discontinuous objects and the heating pipe is a continuous object, then there are obstacles in the integrated pipe gallery that block the gas pipe and the water pipe in the current first image; if the heating pipe, the gas pipe and the water pipe in the current first image are discontinuous objects, then there are obstacles in the integrated pipe gallery that block the heating pipe, the gas pipe and the water pipe in the current first image.

[0083] like Figure 2As shown, there are obstacles in the integrated pipe corridor that block the heat pipe 11, gas pipe 12, and water pipe 13 in the current first image 1. The heat pipe 11, gas pipe 12, and water pipe 13 are all discontinuous objects. The obstacle range can be obtained based on the obstacles and the discontinuous points of the heat pipe 11, gas pipe 12, and water pipe 13. Figure 2 .

[0084] Step S1023: Generate first adjustment information of the image camera.

[0085] The image camera is connected to a driving component that drives the image camera to move, and the server is electrically connected to the driving component. When there is an obstacle in the integrated pipeline corridor that may block the image camera, the server sends a first adjustment message to the driving component. The driving component drives the image camera to adjust its position according to the first adjustment information, so that the image camera can shoot objects behind the obstacle, thereby obtaining a first image that could not be captured behind the obstacle, thereby improving the accuracy of obtaining the fire status of objects in the integrated pipeline corridor.

[0086] The first adjustment information includes first driving direction information and first driving distance information of the driving component. The driving component includes a first driving member for driving the image camera to translate and a second driving member for driving the image camera to rotate. Exemplarily, both the first driving member and the second driving member can be servo motors, and the matching structure of the servo motor connection is not limited here.

[0087] Step S1023 includes the following processing:

[0088] Step S1023a: Obtaining an obstacle range map based on the discontinuous positions of the plurality of discontinuous objects;

[0089] The discontinuous positions of the discontinuous objects are sequentially connected with the discontinuous positions of other adjacent discontinuous objects, and the objects in the current first image that overlap with the range map generated by connecting multiple discontinuous positions are the obstacle range map.

[0090] Step S1023b: acquiring first driving direction information based on the obstacle range map and the current first image;

[0091] In this embodiment, the distance between the boundary of the obstacle range map and the boundary of the current first image is calculated. In order to facilitate the image camera to bypass the location of the obstacle, movement along the side of the current first image boundary with the smallest distance from the boundary of the obstacle range map is used as the first driving direction information.

[0092] Step S1023c: acquiring a plurality of shooting boundaries of the image camera based on the shooting angle of the image camera;

[0093] Step S1023d: acquiring a target shooting boundary among the plurality of shooting boundaries based on the first driving direction information;

[0094] The first image is a rectangular image, so the image camera's capture boundaries consist of four consecutive, connected boundaries. The first driving direction information is vertical or horizontal. When the image camera moves along the first driving direction, a target capture boundary is selected from two capture boundaries perpendicular to the first driving direction. The target capture boundary is the capture boundary within the two capture boundaries of the image camera that does not intersect with the obstacle range map during the movement of the image camera along the first driving direction without changing its shooting angle.

[0095] For example, the shooting boundaries of the image camera include an upper boundary, a lower boundary, a left boundary, and a right boundary. Figure 3 As shown, the first driving direction information is the vertical downward direction indicated by the arrow, then the target shooting boundary needs to be selected from the upper and lower boundaries of the image camera 3, and the server simulates and calculates the movement process of the image camera, and finally does not collide with the obstacle range. Figure 2 The imaging boundary where the intersection exists is the upper boundary, and thus the target imaging boundary 31 is the upper boundary.

[0096] Step S1023e: acquiring a target edge of the obstacle range map based on the first driving direction information;

[0097] In this embodiment, according to the movement process of the image camera simulated by the server, the edge of the obstacle range map that does not intersect with the target shooting boundary when the image camera does not change its shooting angle is used as the target edge.

[0098] For example, Figure 3 As shown, when the first driving direction information is the vertical downward direction indicated by the arrow, the obstacle range Figure 2 The lower edge in is the target edge 21.

[0099] Step S1023f: Acquire multiple movement distance information when the image camera moves to an intersection point where the target shooting boundary and the target edge intersect and the shooting range overlaps with the current shooting range, and acquire first driving distance information based on the multiple movement distance information;

[0100] The movement process of the image camera simulated by the server also includes the rotation angle of the image camera. The image camera can rotate the shooting angle during the translation process. The server calculates multiple movement distance information when there is an intersection between the target shooting boundary and the target edge and the shooting range overlaps with the current shooting range.

[0101] Step S1023g: Generate first adjustment information based on the first driving direction information and the first driving distance information.

[0102] The server sends the generated first adjustment information to the driving component, and the driving component drives the image camera to adjust its position according to the first adjustment information.

[0103] Step S103: obtaining calibration points in the current video image;

[0104] The calibration point is a point with a known position. The calibration point can be a specially set point in the integrated pipeline corridor, a point on an original object in the integrated pipeline corridor, or an infrared hotspot.

[0105] When a fire occurs in the utility corridor, the fire tends to spread in the utility corridor. The current first image may not capture the entire fire range. Therefore, in order to improve the accuracy of determining the fire range in the utility corridor, the following processing is further performed after step S103:

[0106] Step S1031: determining whether the distance between the target point and the boundary of the current first image is less than a preset distance threshold; if so, proceeding to step S1032;

[0107] If the distance between the target point and the boundary of the current first image is less than a preset distance threshold, it is possible that the target point has spread from an area outside the current first image to the current position. The preset distance threshold may be zero.

[0108] like Figure 4 As shown, a fire occurs on the heat pipe 11 , and the server identifies a target point 4 on the heat pipe 11 , and the distance between the target point 4 and the boundary of the current first image 1 is zero.

[0109] Step S1032: Generate second adjustment information of the image camera.

[0110] The server sends the second adjustment information to the driving component, and the driving component can drive the image camera to move according to the second adjustment information, thereby shooting an area outside the current first image.

[0111] The second adjustment information includes second driving direction information and second driving distance information of the driving component.

[0112] Step S1032 includes the following processing:

[0113] Step S1032a: The direction in which the center point in the current first image approaches the target point is used as the second driving direction information; Figure 4 As shown, the target point 4 is located at the rightmost side of the current first image 1 , so the direction indicated by the arrow is the direction in which the center point of the current first image 1 approaches the target point 4 .

[0114] Step S1032b: Acquire the locations of multiple temperature sensors with temperature alarms near the target point;

[0115] Multiple temperature alarms are installed in the integrated pipeline corridor to detect the temperature inside the integrated pipeline corridor. Multiple temperature alarms are evenly distributed along the length of the integrated pipeline corridor, and the temperature sensors are communicated with the server.

[0116] Step S1032c: determining an estimated fire range based on the positions of the multiple temperature sensors;

[0117] A temperature threshold is preset in the server. When the temperature value detected by the temperature sensor is greater than the temperature threshold, the temperature at the corresponding position of the temperature sensor is too high, and there is a possibility that a fire has occurred. The installation position of the temperature sensor is pre-stored in the server, and the range between multiple temperature alarm temperature sensors can be used as the expected fire range.

[0118] Step S1032d: obtaining second driving distance information based on the estimated fire range;

[0119] The adjacent supplementary second images are separated by a distance. The adjacent distance is no greater than the width of the current second image taken along the second driving direction, and the adjacent distance is greater than half the width of the current second image taken along the second driving direction. By setting the adjacent distance, the number of supplementary shots is reduced, and the efficiency of understanding the fire situation within the estimated fire area is improved.

[0120] The second driving distance information includes the shooting moving distance and the adjacent interval distance. The number of shots required for additional shooting is calculated based on the expected fire range and the shooting width of the current second image along the second driving direction, and the adjacent interval distance is calculated based on the number of shots and the shooting width.

[0121] In this embodiment, the number of required supplementary shooting times is calculated based on the expected fire range and the shooting width of the current second image along the second driving direction, including the following types:

[0122] 1. If the estimated fire range is an even multiple of the shooting width, the adjacent interval distance is equal to the shooting width. The quotient is calculated by dividing the estimated fire range by (2 * shooting width). This quotient is the number of supplementary shots.

[0123] 2. If the estimated fire range is an odd multiple of the shooting width, the adjacent interval distance is equal to the shooting width. Calculate the quotient of (preset fire range + shooting width) divided by the shooting width. This quotient is the number of supplementary shots.

[0124] 3. The estimated fire range is not an integer multiple of the shooting width, but the estimated fire range is The adjacent interval distance is equal to Get The quotient obtained is the number of shots for the supplementary shooting;

[0125] 4. The estimated fire range is not an integer multiple of the shooting width and the estimated fire range is not An integer multiple of The quotient of the integers obtained is equal to the number of shots for the supplementary shooting.

[0126] Step S1032e: Generate second adjustment information based on the second driving information and the second driving distance information.

[0127] Step S104: Calculate the actual position of the target point based on the calibration point, and generate fire warning information based on the actual position of the target point.

[0128] The server can use network cables to transmit fire warning signals to the warning equipment. Staff can understand the actual location of the target point based on the warning status of the warning equipment, making it easier to take relevant measures at the target point and improving the accuracy of fire extinguishing in the integrated pipeline corridor.

[0129] When lighting equipment such as lighting lamps in the integrated pipeline corridor fails, it will affect the accuracy of the first image captured by the image camera. Therefore, the calculation of the actual position of the target point based on the calibration point in step S104 also includes the following processing: obtaining the preset position of the infrared hotspot; constructing the coordinate system of the current second image, obtaining the coordinate difference between the target point and the infrared hotspot in the current second image; and calculating the actual position of the target point based on the preset position and the coordinate difference.

[0130] The types of multiple objects in the integrated pipeline corridor are different, and there are differences in the fire extinguishing strategies when different types of objects occur. For example, water cannot be used to extinguish a fire in an electric wire. Therefore, in order to facilitate the staff to adopt the correct fire extinguishing strategy and improve the efficiency of fire extinguishing in the integrated pipeline corridor, the generation of fire warning information based on the actual position of the target point in step S104 also includes the following processing: identifying the type information corresponding to all objects contained in the current first image; obtaining the preset fire extinguishing strategy based on the type information; and generating fire warning information based on the preset fire extinguishing strategy.

[0131] The server has preset images of all objects and preset types corresponding to the images. The server can obtain type information corresponding to the object by comparing the current first image with all preset object images. The server also has preset fire extinguishing strategies corresponding to the type information.

[0132] Based on the same technical concept, the present application also provides a fire analysis device for a comprehensive pipe gallery based on video image signals, such as Figure 5 As shown, the integrated pipe gallery fire analysis device 200 based on video image signals mainly includes:

[0133] The first acquisition module 201 is used to acquire the current video image collected by the monitoring device;

[0134] The identification and judgment module 202 is used to identify the current video image and determine whether there is a target point in the picture corresponding to the current video image, where the target point is the point where the fire occurs;

[0135] The second acquisition module 203 is used to acquire the calibration point in the current video image when there is a target point in the picture corresponding to the current video image;

[0136] The calculation and generation module 204 is used to calculate the actual position of the target point based on the calibration point, and generate fire warning information based on the actual position of the target point.

[0137] Optionally, the monitoring device includes an image camera, the current video image includes a current first image captured by the image camera, and the recognition and judgment module 202 further includes:

[0138] A first judging module, configured to judge whether there are multiple discontinuous objects in the current first image;

[0139] The second judgment module is configured to judge whether there are multiple adjacent discontinuous objects when there are multiple discontinuous objects in the current first image, and if so, generate first adjustment information of the image camera.

[0140] Optionally, the image camera is connected to a driving component for driving the image camera to move, the first adjustment information includes first driving direction information and first driving distance information of the driving component, and the second judgment module includes:

[0141] A first acquisition submodule is configured to acquire an obstacle range map based on the discontinuous positions of a plurality of discontinuous objects;

[0142] A second acquisition submodule is configured to acquire first driving direction information based on the obstacle range map and the current first image;

[0143] A third acquisition submodule is used to acquire multiple shooting boundaries of the image camera based on the shooting angle of the image camera;

[0144] A fourth acquisition submodule, configured to acquire a target shooting boundary among the plurality of shooting boundaries based on the first driving direction information;

[0145] A fifth acquisition submodule, configured to acquire a target edge of the obstacle range map based on the first driving direction information;

[0146] a sixth acquisition submodule, configured to acquire a plurality of movement distance information when the image camera moves to a point where a target shooting boundary and a target edge intersect and a shooting range overlaps with a current shooting range, and acquire first driving distance information based on the plurality of movement distance information;

[0147] The first generating submodule is configured to generate first adjustment information based on the first driving direction information and the first driving distance information.

[0148] Optionally, after obtaining the calibration points in the current video image, the following steps are further included:

[0149] The third judgment module is used to judge whether the distance between the target point and the current first image boundary is less than a preset distance threshold, and if so, generate second adjustment information of the image camera.

[0150] Optionally, the second adjustment information includes second driving direction information and second driving distance information of the driving component; and generating the second adjustment information of the image camera includes:

[0151] As a submodule, it is used to use the direction in which the center point in the current first image approaches the target point as the second driving direction information;

[0152] A seventh acquisition submodule is used to obtain the positions of multiple temperature sensors for temperature alarm near the target point;

[0153] a determination submodule, configured to determine an estimated fire range based on positions of a plurality of temperature sensors;

[0154] an eighth acquisition submodule, configured to acquire second driving distance information based on the estimated fire range;

[0155] The second generating submodule is configured to generate second adjustment information based on the second driving information and the second driving distance information.

[0156] Optionally, the monitoring device includes a thermal imaging camera, the current video image includes a current second image captured by the thermal imaging camera, and the calibration point includes an infrared hotspot; and calculating the actual position of the target point based on the calibration point includes:

[0157] A ninth acquisition submodule, configured to acquire a preset position of an infrared hotspot;

[0158] Constructing an acquisition submodule for constructing a coordinate system of the current second image and obtaining the coordinate difference between the target point and the infrared hotspot in the current second image;

[0159] The calculation submodule is used to calculate the actual position of the target point based on the preset position and the coordinate difference.

[0160] Optionally, generating fire warning information based on the actual location of the target point includes:

[0161] an identification submodule, configured to identify type information corresponding to all objects contained in the current first image;

[0162] A tenth acquisition submodule, configured to acquire a preset fire extinguishing strategy based on the type information;

[0163] The third generation submodule is used to generate fire warning information based on a preset fire extinguishing strategy.

[0164] In one example, the module in any of the above devices can be one or more integrated circuits configured to implement the above methods, such as: one or more application specific integrated circuits (ASICs), or one or more digital signal processors (DSPs), or one or more field programmable gate arrays (FPGAs), or a combination of at least two of these integrated circuit forms.

[0165] For another example, when the modules in the device can be implemented in the form of a processing element scheduling program, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processor capable of calling programs. For another example, these modules can be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0166] Various objects such as various messages / information / equipment / network elements / systems / devices / actions / operations / processes / concepts that may appear in this application are named. It can be understood that these specific names do not constitute a limitation on the relevant objects. The names assigned may change with factors such as scenarios, contexts or usage habits. The understanding of the technical meaning of the technical terms in this application should be mainly determined from the functions and technical effects embodied / executed in the technical solutions.

[0167] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and modules described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0168] Those skilled in the art will appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0169] Based on the same technical concept, this application also provides a comprehensive pipe gallery fire analysis system based on video image signals, such as Figure 6As shown, the integrated pipe corridor fire analysis system 300 based on video image signals includes an electronic device 301, a monitoring device 302, a driving component 303 for driving the monitoring device to move, and an early warning device 304 for prompting staff; the electronic device 301 is respectively communicated with the monitoring device 302, the driving component 303, and the early warning device 304; the electronic device 301 is used to execute the above-mentioned integrated pipe corridor fire analysis method based on video image signals.

[0170] Based on the same technical concept, the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned integrated pipeline corridor fire analysis method based on video image signals are implemented.

[0171] The computer-readable storage medium may include: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc., which can store program codes.

[0172] The terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed or inherent to such process, method, article, or apparatus.

[0173] The above description is merely a preferred embodiment of the present application and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of application involved in this application is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the aforementioned application concept. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions applied for in this application.

Claims

1. A fire analysis method for an integrated pipe gallery based on video image signals, characterized in that: include: Obtain the current video image collected by the monitoring equipment; Identify the current video image and determine whether there is a target point in the picture corresponding to the current video image, wherein the target point is a point where a fire occurs; If yes, obtaining the calibration points in the current video image; Calculating the actual position of the target point based on the calibration point, and generating fire warning information based on the actual position of the target point; The monitoring device includes an image camera, and the current video image includes a current first image captured by the image camera; After identifying the current video image, the method further includes: Determining whether there are multiple discontinuous objects in the current first image; If yes, and there are multiple adjacent discontinuous objects, first adjustment information of the image camera is generated.

2. The method according to claim 1, characterized in that The image camera is connected to a driving component for driving the image camera to move, and the first adjustment information includes first driving direction information and first driving distance information of the driving component; Generating the first adjustment information of the image camera includes: Acquire an obstacle range map based on the discontinuous positions of the plurality of discontinuous objects; acquiring the first driving direction information based on the obstacle range map and the current first image; Acquire a plurality of shooting boundaries of the image camera based on the shooting angle of the image camera; acquiring a target shooting boundary among the plurality of shooting boundaries based on the first driving direction information; acquiring a target edge of the obstacle range map based on the first driving direction information; Acquire a plurality of movement distance information when the image camera moves to a point where the target shooting boundary and the target edge intersect and the shooting range overlaps with the current shooting range, and acquire the first driving distance information based on the plurality of movement distance information; The first adjustment information is generated based on the first driving direction information and the first driving distance information.

3. The method according to claim 1, characterized in that After obtaining the calibration points in the current video image, the method further includes: Determining whether the distance between the target point and the boundary of the current first image is less than a preset distance threshold; If so, second adjustment information of the image camera is generated.

4. The method according to claim 3, characterized in that The image camera is connected to a driving component for driving the image camera to move, and the second adjustment information includes second driving direction information and second driving distance information of the driving component; Generating the second adjustment information of the image camera includes: using the direction in which the center point in the current first image approaches the target point as the second driving direction information; Obtaining the locations of multiple temperature sensors for temperature alarm near the target point; determining an estimated fire range based on positions of the plurality of temperature sensors; acquiring the second driving distance information based on the expected fire range; The second adjustment information is generated based on the second driving direction information and the second driving distance information.

5. The method according to claim 1, wherein The monitoring device includes a thermal imaging camera, the current video image includes a current second image captured by the thermal imaging camera, and the calibration point includes an infrared hotspot; Calculating the actual position of the target point based on the calibration point includes: Obtaining a preset position of the infrared hotspot; Constructing a coordinate system of the current second image, and obtaining a coordinate difference between the target point and the infrared hotspot in the current second image; The actual position of the target point is calculated based on the preset position and the coordinate difference.

6. The method according to claim 1, characterized in that Generating fire warning information based on the actual position of the target point includes: Identifying type information corresponding to all objects contained in the current first image; Obtaining a preset fire extinguishing strategy based on the type information; The fire warning information is generated based on the preset fire extinguishing strategy.

7. A fire analysis device for a comprehensive pipe gallery based on video image signals, characterized in that: include: A first acquisition module is used to acquire the current video image collected by the monitoring device; an identification and judgment module, configured to identify the current video image and determine whether a target point exists in the picture corresponding to the current video image, wherein the target point is a point where a fire occurs; A second acquisition module is used to acquire a calibration point in the current video image when a target point exists in the picture corresponding to the current video image; a calculation and generation module, configured to calculate the actual position of the target point based on the calibration point, and generate fire warning information based on the actual position of the target point; The monitoring device includes an image camera, the current video image includes the current first image captured by the image camera, and the recognition and judgment module further includes: A first judging module, configured to judge whether there are multiple discontinuous objects in the current first image; The second judgment module is configured to judge whether there are multiple adjacent discontinuous objects when there are multiple discontinuous objects in the current first image, and if so, generate first adjustment information of the image camera.

8. A fire analysis system for integrated pipe gallery based on video image signals, characterized in that: It includes electronic equipment, monitoring equipment, a driving component for driving the monitoring equipment to move, and an early warning device for prompting staff; The electronic device is communicatively connected with the monitoring device, the driving component, and the early warning device respectively; The electronic device is used to execute the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that A computer program is stored which can be loaded by a processor and execute the method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • A method of fire source identification and fire point location in power pipeline based on video image fusion analysis algorithm

    CN109145796A

  • Image target positioning method and device, computer equipment and storage medium

    CN112465904A