Fireproof monitoring test method, device and electronic equipment

Abstract

The application provides a fireproof monitoring test method, device and electronic equipment, and relates to the technical field of fireproof monitoring. The method comprises the following steps: acquiring original image data of a thermal imaging image collected by a thermal imaging camera; determining a target position area of a simulated fire point in the original image data and acquiring target fire point model data; modifying data corresponding to the target position area in the original image data based on the target fire point model data to obtain test image data; performing fire point detection and live video encoding on the test image data, and generating test result data according to the fire point detection result and the encoded live video, wherein the test result data is used to reflect the running state of a fireproof monitoring system in which the thermal imaging camera is located and guide parameter adjustment of the thermal imaging camera. The technical scheme provided by the application can realize fireproof monitoring test of the thermal imaging camera in a fire point simulation mode, is easy to implement, and improves test efficiency.

Description

Technical Field

[0001] This invention relates to the field of fire monitoring technology, and in particular to a fire monitoring test method, device, and electronic equipment. Background Technology

[0002] Thermal imaging cameras are devices that detect the energy of objects based on thermal infrared imaging technology, playing an important role in fire prevention monitoring. During project implementation, after the thermal imaging cameras are installed on-site, the fire prevention monitoring system needs to be tested to ensure its proper functioning.

[0003] Currently, testing by manually placing a fire source remotely requires a significant investment of manpower, and starting a fire on-site poses a considerable danger, making it impractical. Summary of the Invention

[0004] This invention provides a fire monitoring test method, device, and electronic device, which realizes fire monitoring test of thermal imaging cameras by simulating fire points, making the test easy to implement and improving the test efficiency.

[0005] This invention provides a fire monitoring test method, comprising:

[0006] Acquire raw image data, which is the raw data of thermal imaging images captured by a thermal imaging camera;

[0007] The target location region of the simulated fire point is determined in the original image data, and the target fire point model data is obtained. The target fire point model data is used to characterize the energy field distribution of the simulated fire point.

[0008] Based on the target fire point model data, the data corresponding to the target location region in the original image data is modified to obtain test image data;

[0009] Fire detection and live video encoding are performed on the test image data, and test result data is generated based on the fire detection results and the encoded live video. The test result data is used to reflect the operating status of the fire monitoring system where the thermal imaging camera is located and to guide the parameter adjustment of the thermal imaging camera.

[0010] According to a fire monitoring test method provided by the present invention, determining the target location area of ​​the simulated fire point in the original image data includes:

[0011] The location area information of the simulated fire point is read, and the location area information is determined based on a target object selected in the video image captured by the thermal imaging camera; wherein, the target object is the simulated fire point.

[0012] Based on the location area information, the target location area of ​​the simulated fire point in the original image data is determined.

[0013] According to a fire monitoring test method provided by the present invention, the video image is a real-time thermal imaging video image; before acquiring the original image data, the method further includes:

[0014] Acquire the real-time thermal imaging video images captured by the thermal imaging camera;

[0015] In response to a first selection operation for the thermal imaging live video image, a target region image is selected in the thermal imaging live video image;

[0016] The target area image is identified as the simulated fire point, and the location area information of the target area image is saved.

[0017] According to a fire monitoring test method provided by the present invention, the video image is a visible light video image; before acquiring the original image data, the method further includes:

[0018] Acquire the visible light video image captured by the visible light channel of the thermal imaging camera;

[0019] In response to a second selection operation on the visible light video image, a target object is selected in the visible light video image; wherein the target object is the target object.

[0020] Based on the mapping relationship between the visible light channel and the thermal imaging channel of the thermal imaging camera, the target object is mapped to the thermal imaging channel to obtain the position area information of the target object in the corresponding image of the thermal imaging channel;

[0021] Save the location area information.

[0022] According to a fire monitoring test method provided by the present invention, the thermal imaging camera is a pan-tilt camera; the step of determining the target location area of ​​the simulated fire point in the original image data based on the location area information includes:

[0023] The reference preset position of the thermal imaging camera is read, which is the preset position where the thermal imaging camera acquires the video image used to determine the location area information;

[0024] Based on the location area information, the reference preset position, and the current preset position of the thermal imaging camera, the target location area of ​​the simulated fire point in the original image data is determined.

[0025] According to a fire monitoring test method provided by the present invention, the step of acquiring target fire point model data includes:

[0026] Determine the distance between the simulated fire point corresponding to the target location area and the thermal imaging camera;

[0027] Based on the distance and the performance indicators of the thermal imaging camera, the target fire point model data is determined from the fire point model mapping table; wherein, the fire point model mapping table stores the correspondence between the distance, the performance indicators of the thermal imaging camera, and the fire point model data.

[0028] The present invention also provides a fire monitoring and testing device, comprising:

[0029] The acquisition module is used to acquire raw image data, which is the raw data of thermal imaging images captured by a thermal imaging camera;

[0030] The determination module is used to determine the target location area of ​​the simulated fire point in the original image data and to acquire target fire point model data, which is used to characterize the energy field distribution of the simulated fire point.

[0031] The modification module is used to modify the data corresponding to the target location region in the original image data based on the target fire point model data to obtain test image data;

[0032] The testing module is used to perform fire detection and live video encoding on the test image data, and generate test result data based on the fire detection results and the obtained live video. The test result data is used to reflect the operating status of the fire monitoring system where the thermal imaging camera is located and to guide the parameter adjustment of the thermal imaging camera.

[0033] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the fire monitoring test method as described above.

[0034] The present invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the fire monitoring test method as described above.

[0035] The present invention also provides a computer program product, including a computer program that, when executed by a processor, implements the fire monitoring test method as described above.

[0036] The fire monitoring test method, device, and electronic equipment provided by this invention determine the target location area of ​​the simulated fire point from the raw data of the thermal imaging image acquired by the thermal imaging camera, and obtain the target fire point model data. Based on the target fire point model data, the data corresponding to the target location area in the raw image data is modified to obtain test image data. Then, fire point detection and live video encoding are performed on the test image data to generate test result data. The target fire point model data can characterize the energy field distribution of the simulated fire point. In this way, by modifying the raw data of the thermal imaging image, the fire point of the actual scene can be simulated in the raw data of the thermal imaging image. Fire monitoring test of the thermal imaging camera is realized by fire point simulation. The obtained test result data can guide the parameter adjustment of the thermal imaging camera and reflect the operating status of the fire protection system in which the thermal imaging camera is located, making the fire monitoring test of the thermal imaging camera easy to implement and improving the testing efficiency. Attached Figure Description

[0037] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0038] Figure 1 This is one of the flowcharts of the fire monitoring and testing method provided in the embodiments of the present invention;

[0039] Figure 2 This is a schematic diagram illustrating the principle of the fire monitoring and testing method provided in this embodiment of the invention;

[0040] Figure 3 This is the second flowchart illustrating the fire monitoring and testing method provided in this embodiment of the invention.

[0041] Figure 4 This is a schematic diagram of the fire monitoring and testing device provided in an embodiment of the present invention;

[0042] Figure 5 This is a schematic diagram of the structure of the electronic device provided in an embodiment of the present invention. Detailed Implementation

[0043] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0044] It should be noted that the serial numbers assigned to components or objects in this invention, such as "first" and "second", are only used to distinguish the described objects and do not have any sequential or technical meaning.

[0045] Thermal imaging cameras play a crucial role in fire monitoring. During project implementation, after the thermal imaging cameras are installed, it is necessary to adjust various detection parameters of the cameras and test the operation of the entire fire monitoring system in which the cameras are located. However, in real-world applications, testing by placing a fire source on-site poses significant risks, requires substantial additional manpower, and is not very practical, especially when multiple thermal imaging cameras are installed.

[0046] In related technologies, alarms can be manually triggered in thermal imaging cameras to simulate fire alarms and report them. While this method can simulate fire alarms, it can only test the alarm receiving server and alarm link in the entire fire monitoring system, and cannot test the detection performance and parameter calibration of the front-end thermal imaging cameras.

[0047] Based on this, embodiments of the present invention provide a fire monitoring test method. This method can determine the target location area of ​​a simulated fire point from the raw data of thermal imaging images acquired by a thermal imaging camera, and obtain target fire point model data. Based on the target fire point model data, the data corresponding to the target location area in the raw image data is modified to obtain test image data. Then, fire point detection and live video encoding are performed on the test image data to generate test result data. By modifying the raw data of the thermal imaging image, a fire point in a real-world scene is simulated within the raw data, thus achieving fire monitoring testing of the thermal imaging camera through fire point simulation.

[0048] The following is combined Figures 1-3 The fire monitoring test method of the present invention is described. This fire monitoring test method can be applied to electronic devices, which may be thermal imaging cameras, or electronic devices such as servers, mobile phones, and computers that are communicatively connected to thermal imaging cameras; it can also be applied to fire monitoring test devices installed in electronic devices, which can be implemented through software, hardware, or a combination of both.

[0049] Figure 1 An exemplary schematic diagram of one of the fire monitoring test methods provided in this embodiment of the invention is shown below. Figure 1 As shown, the fire monitoring test method may include the following steps 110 to 140.

[0050] Step 110: Obtain the raw image data.

[0051] A thermal imaging camera is a camera that displays the energy field distribution on the surface of an object by detecting the infrared light emitted by the object. It can acquire thermal images of the monitored area through the principle of infrared imaging, and determine high-temperature targets by analyzing the energy field distribution of the thermal images, thereby identifying fire points in the monitored area.

[0052] For example, a thermal imaging camera may include two channels: thermal imaging and visible light, or it may only include a thermal imaging channel. The thermal imaging camera can acquire thermal images of the monitored area through the thermal imaging channel.

[0053] In this embodiment of the invention, the raw image data is the raw data of the thermal imaging image captured by the thermal imaging camera. The electronic device can acquire each frame of raw image data captured by the thermal imaging camera, or it can acquire one frame of raw image data at preset time intervals.

[0054] Step 120: Determine the target location area of ​​the simulated fire point in the original image data and obtain the target fire point model data.

[0055] After acquiring the raw image data, the target location region can be determined within the raw image data as the location region of the simulated fire point. For example, the position and size of the simulated fire point can be directly set in the raw image data to obtain the target location region of the simulated fire point; alternatively, the simulated fire point can be determined by selecting an image region on the video image captured by a thermal imaging camera, and the corresponding region in the raw image data of the selected image region can be determined as the target location region of the simulated fire point.

[0056] In this embodiment of the invention, there may be one, two, or more simulated fire points; the number of simulated fire points is not limited in this embodiment. Correspondingly, the target location region determined in the original image data may be at least one.

[0057] For example, each target location area corresponds to a simulated fire point. This target location area can correspond to a fixed location area in a real monitoring scenario, that is, the actual location area of ​​the simulated fire point. For this location area, methods such as binocular ranging or laser ranging can be used to obtain the distance between the simulated fire point and the thermal imaging camera. The electronic device can then select the corresponding fire point model data based on this distance to obtain the target fire point model data. For instance, a mapping table between distance and fire point model data can be pre-established. After obtaining the distance between the simulated fire point and the thermal imaging camera, the corresponding fire point model data can be found in the mapping table based on this distance.

[0058] In this embodiment of the invention, the target fire point model data can be used to characterize the energy field distribution of the simulated fire point, reflecting the pixel area occupied by a fire point in a thermal imaging image and the energy value of each pixel point. The fire point can be simulated through this target fire point model data.

[0059] For example, target fire point model data may include, but is not limited to, a set of fire point model data that changes dynamically over time, which can characterize dynamically changing fire points.

[0060] For example, real fire point data from similar monitoring scenarios can be collected in advance to form fire point model data. For instance, if real fire point data for a certain forest area is obtained in advance, this real fire point data can be recorded as fire point model data for the forest fire prevention and monitoring scenario. Alternatively, fire point model data can be simulated through simulation.

[0061] For example, the target fire point model data may also include fire point parameters, such as fire point state and fire point duration. The fire point state may be static or dynamic. These fire point parameters can characterize the presentation form of the fire point.

[0062] Step 130: Modify the data corresponding to the target location region in the original image data based on the target fire point model data to obtain test image data.

[0063] The target location region can indicate the position of the simulated fire point in the original image data and the range of pixels it occupies. The target fire point model data can represent the simulated fire point. By using the target fire point model data to modify the data in the original image data corresponding to the target location region, such as by direct replacement or by multiplying the target fire point model data by a preset scaling factor and then replacing it, fire point data can be simulated in the original image data.

[0064] Step 140: Perform fire detection and live video encoding on the test image data, and generate test result data based on the fire detection results and the encoded live video.

[0065] The test image data contains simulated fire point data. Fire point detection and live video encoding can be performed on this test image data to obtain fire point detection results and live video. For example, fire point detection can be performed by a fire point detection unit, and live video encoding can be performed by a thermal imaging live video processing unit. The fire point detection result indicates the presence of a fire point, and the live video can visually reflect the test image data in the form of video images. The electronic device can generate and output the fire point detection result and live video as test result data. For example, the electronic device can directly output the fire point detection result and live video as test result data; or, the electronic device can convert the fire point detection result into an alarm signal, and use the alarm signal and live video as test result data. For example, an alarm signal can be generated and output when a fire point is detected, and no alarm can be issued when no fire point is detected.

[0066] The test results can reflect the operational status of the fire monitoring system where the thermal imaging camera is located and guide the parameter adjustment of the thermal imaging camera. The operational status of the thermal imaging camera and the entire fire monitoring system can be understood based on the fire detection situation and the output live video. For example, if the target fire point model data represents a fire point at a distance L from the thermal imaging camera, the test image data obtained based on this target fire point model data should be able to detect the existence of the fire point during fire detection, and the live video, after encoding, should clearly show the fire point. If the fire point is detected, but the fire point image displayed in the output live video is blurry or even unrecognizable, the parameters of the thermal imaging camera can be adjusted accordingly, such as the camera's sensitivity and focal length, to clearly display the fire point. If the output live video can display the fire point image, but the fire point detection unit in the fire monitoring system does not alarm, it indicates that the operating status of the fire point detection unit may be abnormal.

[0067] The fire monitoring and testing method provided in this invention determines the target location area of ​​a simulated fire point from the raw data of thermal imaging images acquired by a thermal imaging camera, obtains target fire point model data, modifies the data corresponding to the target location area in the raw image data based on the target fire point model data to obtain test image data, and then performs fire point detection and live video encoding on the test image data to generate test result data. The target fire point model data can characterize the energy field distribution of the simulated fire point. In this way, by modifying the raw data of the thermal imaging image, a fire point in the actual scene can be simulated in the raw data of the thermal imaging image. Fire monitoring and testing of thermal imaging cameras can be achieved by simulating fire points. The obtained test result data can guide the parameter adjustment of thermal imaging cameras and reflect the operating status of the fire protection system in which the thermal imaging camera is located, making fire monitoring and testing of thermal imaging cameras easier to implement and improving testing efficiency.

[0068] based on Figure 1 In a corresponding embodiment of the fire monitoring test method, in one example embodiment, a simulated fire point can be determined by selecting an image region on a video image captured by a thermal imaging camera, and the corresponding region in the original image data of the selected image region is determined as the target location region of the simulated fire point. Specifically, determining the target location region of the simulated fire point in the original image data may include: reading the location region information of the simulated fire point, which can be determined based on a target object selected in the video image captured by the thermal imaging camera; and determining the target location region of the simulated fire point in the original image data based on the location region information. The selected target object can be used as the simulated fire point.

[0069] For example, the location area information of the simulated fire point can be determined in advance and saved. Then, the original image data can be modified based on the location area information. Fire point detection can be performed any number of times and under different test environments based on the location area information.

[0070] A thermal imaging camera can include two channels: thermal imaging and visible light. The image pixels of the thermal imaging channel and the visible light channel can be mapped to each other.

[0071] In one optional implementation, the video image used for image region selection can be a live thermal imaging video image acquired by a thermal imaging channel. Accordingly, before acquiring the original image data, the fire monitoring test method may further include: acquiring a live thermal imaging video image acquired by a thermal imaging camera; selecting a target region image in the live thermal imaging video image in response to a first selection operation on the live thermal imaging video image; identifying the target region image as a simulated fire point; and saving the location region information of the target region image.

[0072] In another optional implementation, the video image used for image region selection can be a visible light video image acquired through the visible light channel. Accordingly, before acquiring the original image data, the fire monitoring test method may further include: acquiring a visible light video image acquired through the visible light channel of a thermal imaging camera; selecting a target object in the visible light video image in response to a second selection operation on the visible light video image; wherein the target object is a target object serving as a simulated fire point; mapping the target object to the thermal imaging channel based on the mapping relationship between the visible light channel and the thermal imaging channel of the thermal imaging camera, obtaining the position region information of the target object in the corresponding image of the thermal imaging channel; and saving the position region information.

[0073] Among them, the visible light video images acquired by the visible light channel can intuitively display the real scene image of the monitored area and clearly distinguish each target object in the image, such as trees, houses, hills, etc. In this way, by selecting target objects in the visible light video images as simulated fire points, the selection of simulated fire points becomes more intuitive and convenient.

[0074] In this embodiment of the invention, the thermal imaging camera can be a pan-tilt camera with a gimbal or a camera without a gimbal. When the thermal imaging camera is a pan-tilt camera, determining the target location area of ​​the simulated fire point in the original image data based on the location area information may include: reading the reference preset position of the thermal imaging camera, which is the preset position where the thermal imaging camera is located when acquiring the video image used to determine the location area information; and determining the target location area of ​​the simulated fire point in the original image data based on the location area information, the reference preset position, and the current preset position of the thermal imaging camera.

[0075] Specifically, the preset position corresponding to the video image used for image region selection can be determined as the reference preset position. When the electronic device determines the simulated fire point based on the video image acquired by the thermal imaging camera by selecting the image region, it records the preset position of the thermal imaging camera at this time to obtain the reference preset position. The electronic device can then convert the position area information corresponding to the reference preset position into the original image data according to the conversion relationship between the current preset position of the thermal imaging camera and the reference preset position, thereby obtaining the target position area of ​​the simulated fire point in the original image data.

[0076] based on Figure 1 In a corresponding embodiment of the fire monitoring test method, in one example embodiment, acquiring target fire point model data may include: determining the distance between the simulated fire point corresponding to the target location area and the thermal imaging camera; and determining the target fire point model data from a fire point model mapping table based on the distance and the performance indicators of the thermal imaging camera. The fire point model mapping table may store the correspondence between distance, the performance indicators of the thermal imaging camera, and the fire point model data. The performance indicators of the thermal imaging camera may include at least one of sensitivity and resolution. In this way, appropriate fire point model data can be selected for fire point simulation according to the specific application scenario.

[0077] Based on the methods of the above embodiments, the following section takes a PTZ camera as an example of a thermal imaging camera, combined with... Figure 2 and Figure 3 The fire monitoring and testing method provided in this embodiment of the invention will be further illustrated with examples. The thermal imaging camera can be controlled by a pan-tilt system to adjust its monitoring position, and the pan-tilt-zoom (PTZ) method can be used to increase the monitoring range of the thermal imaging camera, thereby achieving fire detection over a wider area.

[0078] Figure 2An exemplary schematic diagram of the fire monitoring test method provided in an embodiment of the present invention is shown below. Figure 2 As shown, the fire detection program of a thermal imaging camera can include two processes: fire detection and live thermal imaging video processing. In this embodiment of the invention, after the thermal imaging camera acquires the raw data of the thermal imaging image through infrared detection, it can modify the raw data to simulate fire point data. Then, the original data simulating the fire point data is copied into two copies: one for fire detection and the other for live thermal imaging video processing. Fire monitoring testing of the thermal imaging camera is achieved through fire point simulation testing. For example, one copy of the data can be sent to the fire detection unit to determine whether a fire point exists. If a fire point exists, an alarm is reported. The other copy of the data can be sent to the live thermal imaging video processing unit, where it is encoded and output as live video.

[0079] Combination Figure 2 , Figure 3 The second illustrative flowchart of the fire monitoring test method provided in this embodiment of the invention is shown. This method can be applied to electronic devices, such as thermal imaging cameras or electronic devices like servers, mobile phones, and computers that are communicatively connected to the thermal imaging camera. (Refer to...) Figure 3 As shown, the method may include the following steps 310 to 360.

[0080] Step 310: Acquire live thermal imaging video images captured by the thermal imaging camera.

[0081] In the initial stage of fire monitoring testing of thermal imaging cameras, the raw data of thermal imaging images obtained by the thermal imaging cameras through infrared detection can be encoded into live video through the thermal imaging live video processing flow, and electronic devices can acquire a frame of thermal imaging live video image from the live video.

[0082] Step 320: Select the target area image as the simulated fire point in the live thermal imaging video image, and record the location area information of the target area image and the reference preset position of the thermal imaging camera.

[0083] The acquired live thermal imaging video image can be displayed on the system interface of the testing system. Test personnel can specify the target location and range on this live thermal imaging video image, forming a target area image. In response to a first selection operation on the live thermal imaging video image, the electronic device selects the target area image within the live thermal imaging video image, identifies this target area image as the simulated fire point, and records the location area information of the target area image. This location area information can include information such as the target location and range, where the range refers to the area occupied by a pixel. The target location and range can characterize the location and size of the simulated fire point.

[0084] The target location and range can correspond to a fixed location and area in the actual monitoring scene. For example, it can be the location and size of a target object, which can be a tree in the actual monitoring scene.

[0085] In this example embodiment, the thermal imaging camera may be a camera including a pan-tilt unit (PTZ). The PTG can be in a cruise state to monitor fire points in the cruise area. The thermal imaging camera can acquire thermal imaging images with different viewing angles at different preset positions. When recording the location information of the target area image selected from the thermal imaging live video image, the electronic device can also record the preset position when the thermal imaging camera acquires the thermal imaging live video image, thus obtaining a reference preset position.

[0086] Step 330: Determine the target fire point model data from the fire point model mapping table based on the distance between the simulated fire point and the thermal imaging camera and the performance indicators of the thermal imaging camera.

[0087] The target area image corresponds to a fixed location area in the real monitoring scene. This location area can be used as the actual location area of ​​the simulated fire point. The distance between the simulated fire point and the thermal imaging camera can be obtained using methods such as binocular ranging and laser ranging for this actual location area.

[0088] The performance metrics of a thermal imaging camera may include at least one of the following: sensitivity and resolution. For example, the performance metrics of a thermal imaging camera may be determined by the performance metrics of the infrared detector in the thermal imaging camera.

[0089] The fire point model mapping table stores the correspondence between distance, thermal imaging camera performance indicators, and fire point model data. After determining the distance between the simulated fire point and the thermal imaging camera, as well as the thermal imaging camera's performance indicators, the matching fire point model data can be found in the fire point model mapping table based on the determined distance and performance indicators to obtain the target fire point model data.

[0090] The target fire point model data can be a set of fire point model data that changes dynamically over time, but is not limited to this. For example, the fire point model data in the fire point model mapping table can be obtained from real fire point data in similar scenarios collected in advance. For instance, when applied to forest fire prevention, it can be obtained from real fire point data collected in the forest environment in advance; or, the fire point model data in the fire point model mapping table can also be obtained through simulation.

[0091] In this way, by simulating the distance between the fire point and the thermal imaging camera and selecting the target fire point model data from the fire point model mapping table based on the performance indicators of the thermal imaging camera, suitable simulated fire point model data can be selected according to the specific test environment, ensuring the smooth progress of the test.

[0092] Step 340: Acquire a frame of original image data, and determine the target location area of ​​the simulated fire point in the original image data based on the location area information of the target area image and the reference preset position.

[0093] The raw image data is the original data of the thermal imaging image acquired by the thermal imaging camera. After selecting the simulated fire point and recording the location area information of the simulated fire point and the corresponding reference preset position of the thermal imaging camera through steps 310 to 320, the electronic device can obtain the raw data of the current frame of thermal imaging image acquired by the thermal imaging camera, that is, a frame of raw image data. Based on the location area information of the simulated fire point and the corresponding reference preset position of the thermal imaging camera, the position and size of the simulated fire point in the frame of raw image data corresponding to the current preset position of the thermal imaging camera are calculated, thus obtaining the target location area of ​​the simulated fire point in the frame of raw image data.

[0094] For pan-tilt-zoom (PTZ) cameras, the position and size of the same object will differ in images captured at different preset positions. If the position and size of the object in the image corresponding to the first preset position are known, the position and size of the object in the image corresponding to the second preset position can be obtained through coordinate transformation based on the relationship between these two preset positions. Therefore, for a single frame of raw image data captured by a thermal imaging camera, the position area information of the simulated fire point corresponding to the reference preset position can be transformed into the raw image data of the current frame corresponding to the current preset position by using coordinate transformation, based on the relationship between the current preset position of the thermal imaging camera and the recorded reference preset position. This yields the position and size of the simulated fire point in the raw image data of that frame.

[0095] Step 350: Modify the data corresponding to the target location region in the original image data based on the target fire point model data to obtain test image data.

[0096] For example, the target fire point model data may include fire point parameters, such as fire point state and fire point duration. The fire point state may be static or dynamic. Accordingly, the target fire point model data can characterize the energy field distribution and fire point state of the simulated fire point, thereby enabling the simulation of a more realistic, continuous, and dynamically changing simulated fire point.

[0097] Step 360: Perform fire detection and live video encoding on the test image data, and generate test result data based on the fire detection results and the encoded live video.

[0098] After modifying the original image data, the electronic device can copy the modified test image data into two copies. One copy is sent to the fire detection unit for fire detection to determine the presence of a fire. The other copy is sent to the thermal imaging live video processing unit for encoding and outputting live video. The electronic device can use the fire detection results and the output live video as test result data to adjust the parameters of the thermal imaging camera. Simultaneously, it can monitor the operation of the entire fire monitoring system, including the thermal imaging camera, based on the test result data. For example, it can monitor the fire detection unit and the thermal imaging live video processing unit of the thermal imaging camera.

[0099] Then, steps 330 to 360 can be repeated to detect simulated fire points using the thermal imaging camera.

[0100] It should be noted that this example embodiment uses the selection of a target area image as a simulated fire point in a live thermal imaging video image as an example for illustration. In this embodiment of the invention, the simulated fire point can also be selected in other ways. For example, in one example embodiment, the thermal imaging camera can include two video channels: visible light and thermal imaging. A target object can be selected as a simulated fire point in the visible light video image acquired by the visible light channel. Then, through the mapping relationship between the visible light channel and the thermal imaging channel, the simulated fire point selected in the visible light video image can be mapped to the thermal imaging channel. In another example embodiment, the position and size of the simulated fire point can be set directly in the raw data of the thermal imaging image.

[0101] It is understood that, in this embodiment of the invention, it is sufficient to ensure that the target fire point model data and the target location area of ​​the simulated fire point in the original data are determined before modifying the original data of the thermal imaging image. Therefore, in this embodiment of the invention, the order of steps 330 and 340 is not limited; that is, step 330 can be executed first and then step 340, or step 340 can be executed first and then step 330.

[0102] The fire monitoring and testing method provided in this invention can dynamically determine the position, size, and shape of the simulated fire point in the original image data based on the target fire point model data and the preset position of the thermal imaging camera. It can generate more realistic, real-time, continuous, and dynamically changing simulated fire points from the original image data acquired by the thermal imaging camera, thus achieving fire monitoring and testing of the thermal imaging camera through fire point simulation. On the one hand, by simulating fire points, the fire monitoring system can be tested without placing a real fire source, making fire monitoring and testing of thermal imaging cameras easier to implement, effectively improving engineering installation efficiency and reducing manpower input. On the other hand, by modifying the original data of the thermal imaging image to simulate the generation of a fire point at a fixed location in a real scene, it is possible not only to adjust the parameters of the thermal imaging camera but also to detect the operation of the entire fire monitoring system, including the thermal imaging camera's fire point detection process and the thermal imaging live video processing process.

[0103] The fire monitoring and testing device provided by the present invention is described below. The fire monitoring and testing device described below can be referred to in correspondence with the fire monitoring and testing method described above.

[0104] Figure 4 An exemplary schematic diagram of the fire monitoring and testing device provided in an embodiment of the present invention is shown, with reference to... Figure 4 As shown, the fire monitoring test device 400 may include an acquisition module 410, a determination module 420, a modification module 430, and a test module 440. The acquisition module 410 acquires raw image data, which is the raw data of thermal imaging images captured by a thermal imaging camera. The determination module 420 determines the target location area of ​​the simulated fire point in the raw image data and acquires target fire point model data, which characterizes the energy field distribution of the simulated fire point. The modification module 430 modifies the data corresponding to the target location area in the raw image data based on the target fire point model data to obtain test image data. The test module 440 performs fire point detection and live video encoding on the test image data, and generates test result data based on the fire point detection results and the obtained live video. The test result data reflects the operating status of the fire monitoring system where the thermal imaging camera is located and guides the parameter calibration of the thermal imaging camera.

[0105] In one example embodiment, the determining module 420 may include: a reading unit for reading location area information of the simulated fire point, wherein the location area information is determined based on a target object selected in a video image acquired by a thermal imaging camera, wherein the target object is the simulated fire point; and a first determining unit for determining the target location area of ​​the simulated fire point in the original image data based on the location area information.

[0106] In one example embodiment, the video image is a live thermal imaging video image; correspondingly, the fire monitoring and testing device 400 may further include: a first image acquisition module, used to acquire the live thermal imaging video image captured by the thermal imaging camera; a first selection module, used to select a target area image in the live thermal imaging video image in response to a first selection operation on the live thermal imaging video image; and a first storage module, used to determine the target area image as a simulated fire point and store the location area information of the target area image obtained by the first selection module.

[0107] In one example embodiment, the video image is a visible light video image; correspondingly, the fire monitoring and testing device 400 may further include: a second image acquisition module, used to acquire a visible light video image acquired by the visible light channel of a thermal imaging camera; a second selection module, used to select a target object in the visible light video image in response to a second selection operation facing the visible light video image, wherein the target object is a target object; and a mapping module, used to map the target object to the thermal imaging channel based on the mapping relationship between the visible light channel and the thermal imaging channel of the thermal imaging camera, thereby obtaining the position area information of the target object in the corresponding image of the thermal imaging channel.

[0108] The second storage module is used to store the location area information obtained by the mapping module.

[0109] In one example embodiment, the thermal imaging camera is a pan-tilt camera, and the determining unit can be specifically used to: read the reference preset position of the thermal imaging camera, which is the preset position where the thermal imaging camera is located when acquiring video images used to determine location area information; and determine the target location area of ​​the simulated fire point in the original image data based on the location area information, the reference preset position, and the current preset position of the thermal imaging camera.

[0110] In one example embodiment, the acquisition module 410 may include: a second determining unit, configured to determine the distance between the simulated fire point corresponding to the target location area and the thermal imaging camera; and a third determining unit, configured to determine the target fire point model data from the fire point model mapping table based on the distance and the performance index of the thermal imaging camera, wherein the fire point model mapping table stores the correspondence between the distance, the performance index of the thermal imaging camera and the fire point model data.

[0111] Figure 5 The example illustrates the structure of an electronic device, which can be a thermal imaging camera, or an electronic device such as a server, mobile phone, or computer that is communicatively connected to the thermal imaging camera. Figure 5As shown, the electronic device may include a processor 510, a communication interface 520, a memory 530, and a communication bus 540, wherein the processor 510, the communication interface 520, and the memory 530 communicate with each other through the communication bus 540. The processor 510 can call logical instructions in the memory 530 to execute the fire monitoring test method provided in the above-described method embodiments. This method may include, for example, acquiring raw image data, which is the raw data of thermal imaging images collected by a thermal imaging camera; determining the target location area of ​​a simulated fire point in the raw image data and acquiring target fire point model data, wherein the target fire point model data is used to characterize the energy field distribution of the simulated fire point; modifying the data corresponding to the target location area in the raw image data based on the target fire point model data to obtain test image data; performing fire point detection and live video encoding on the test image data, and generating test result data based on the fire point detection results and the encoded live video, wherein the test result data is used to reflect the operating status of the fire monitoring system where the thermal imaging camera is located and to guide the parameter adjustment of the thermal imaging camera.

[0112] Furthermore, the logical instructions in the aforementioned memory 530 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, essentially, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0113] On the other hand, the present invention also provides a computer program product, which includes a computer program that can be stored on a computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the fire monitoring test method provided in the above-described method embodiments. This method may include, for example, acquiring raw image data, which is raw data of thermal imaging images collected by a thermal imaging camera; determining the target location area of ​​a simulated fire point in the raw image data and acquiring target fire point model data, wherein the target fire point model data is used to characterize the energy field distribution of the simulated fire point; modifying the data corresponding to the target location area in the raw image data based on the target fire point model data to obtain test image data; performing fire point detection and live video encoding on the test image data, and generating test result data based on the fire point detection results and the encoded live video, wherein the test result data is used to reflect the operating status of the fire monitoring system where the thermal imaging camera is located and to guide the parameter adjustment of the thermal imaging camera.

[0114] In another aspect, the present invention also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the fire monitoring test method provided in the above-described method embodiments. This method may include, for example,: acquiring raw image data, which is raw data of thermal imaging images acquired by a thermal imaging camera; determining the target location area of ​​a simulated fire point in the raw image data and acquiring target fire point model data, wherein the target fire point model data is used to characterize the energy field distribution of the simulated fire point; modifying the data corresponding to the target location area in the raw image data based on the target fire point model data to obtain test image data; performing fire point detection and live video encoding on the test image data, and generating test result data based on the fire point detection results and the encoded live video, wherein the test result data is used to reflect the operating status of the fire monitoring system where the thermal imaging camera is located and to guide the parameter adjustment of the thermal imaging camera.

[0115] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0116] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0117] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A fire prevention monitoring test method, characterized in that, include: Acquire raw image data, which is the raw data of thermal imaging images captured by a thermal imaging camera; The target location region of the simulated fire point is determined in the original image data, and the target fire point model data is obtained. The target fire point model data is used to characterize the energy field distribution of the simulated fire point. Based on the target fire point model data, the data corresponding to the target location region in the original image data is modified to obtain test image data; Fire detection and live video encoding are performed on the test image data, and test result data is generated based on the fire detection results and the encoded live video. The test result data is used to reflect the operating status of the fire monitoring system where the thermal imaging camera is located and to guide the parameter adjustment of the thermal imaging camera.

2. The fire monitoring and testing method according to claim 1, characterized in that, Determining the target location region of the simulated fire point in the original image data includes: The location area information of the simulated fire point is read, and the location area information is determined based on a target object selected in the video image captured by the thermal imaging camera; wherein, the target object is the simulated fire point. Based on the location area information, the target location area of ​​the simulated fire point in the original image data is determined.

3. The fire monitoring test method according to claim 2, characterized in that, The video images are live thermal imaging video images; Prior to acquiring the raw image data, the method further includes: Acquire the real-time thermal imaging video images captured by the thermal imaging camera; In response to a first selection operation for the thermal imaging live video image, a target region image is selected in the thermal imaging live video image; The target area image is identified as the simulated fire point, and the location area information of the target area image is saved.

4. The fire monitoring test method according to claim 2, characterized in that, The video image is a visible light video image; Prior to acquiring the raw image data, the method further includes: Acquire the visible light video image captured by the visible light channel of the thermal imaging camera; In response to a second selection operation on the visible light video image, a target object is selected in the visible light video image; wherein the target object is the target object. Based on the mapping relationship between the visible light channel and the thermal imaging channel of the thermal imaging camera, the target object is mapped to the thermal imaging channel to obtain the position area information of the target object in the corresponding image of the thermal imaging channel; Save the location area information.

5. The fire monitoring test method according to any one of claims 2 to 4, characterized in that, The thermal imaging camera is a pan-tilt camera; determining the target location region of the simulated fire point in the original image data based on the location region information includes: The reference preset position of the thermal imaging camera is read, which is the preset position where the thermal imaging camera acquires the video image used to determine the location area information; Based on the location area information, the reference preset position, and the current preset position of the thermal imaging camera, the target location area of ​​the simulated fire point in the original image data is determined.

6. The fire monitoring test method according to claim 1 or 2, characterized in that, The acquisition of target fire point model data includes: Determine the distance between the simulated fire point corresponding to the target location area and the thermal imaging camera; Based on the distance and the performance indicators of the thermal imaging camera, the target fire point model data is determined from the fire point model mapping table; wherein, the fire point model mapping table stores the correspondence between the distance, the performance indicators of the thermal imaging camera, and the fire point model data.

7. A fire prevention monitoring and testing device, characterized in that, include: The acquisition module is used to acquire raw image data, which is the raw data of thermal imaging images captured by a thermal imaging camera; The determination module is used to determine the target location area of ​​the simulated fire point in the original image data and to acquire target fire point model data, which is used to characterize the energy field distribution of the simulated fire point. The modification module is used to modify the data corresponding to the target location region in the original image data based on the target fire point model data to obtain test image data; The testing module is used to perform fire detection and live video encoding on the test image data, and generate test result data based on the fire detection results and the obtained live video. The test result data is used to reflect the operating status of the fire monitoring system where the thermal imaging camera is located and to guide the parameter adjustment of the thermal imaging camera.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the fire monitoring test method as described in any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the fire monitoring test method as described in any one of claims 1 to 6.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the fire monitoring test method as described in any one of claims 1 to 6.

Images