Calibrating infrared (IR) sensors in fire sensing devices
By using the camera and IR sensor automatic calibration in the fire sensing equipment, the fire detection failure caused by the infrared sensor deviating from the calibration state is solved, and automatic calibration without participation is achieved, which improves the reliability and maintenance efficiency of the equipment.
Patent Information
- Application Number
- CN202410455474.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-15
- Filing Date
- 2024-04-16
- Publication Date
- 2024-11-22
AI Technical Summary
Infrared (IR) sensors in existing fire sensing devices may prevent fire detection due to environmental conditions deviating from calibration state, and the calibration process is cumbersome and time-consuming, requiring professional participation.
A device, including a camera and IR sensor, was designed to compare the radiation levels detected by the camera with the camera to the IR sensor, automatically calibrate the IR sensor, reduce dependence on maintenance engineers, and achieve an unattended calibration process.
Improves the accuracy of fire sensing equipment, reduces the chances of failure to detect fires, simplifies the calibration process, reduces dependence on professionals, and improves equipment reliability and maintenance efficiency.
Smart Images

Figure CN119007379A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure generally relates to devices, methods, and systems for calibrating infrared (IR) sensors in fire sensing devices. Background Art
[0002] Large facilities (such as commercial buildings, office buildings, hospitals, etc.) as well as residential buildings (such as apartments, townhouses, single-family houses, etc.) may have fire alarm systems that can be triggered during an emergency (e.g., a fire) to warn occupants to evacuate. For example, a fire alarm system may include a fire control panel and a plurality of fire sensing devices (e.g., smoke detectors) throughout the building (e.g., on different floors and / or in different rooms of the building) that can sense a fire occurring in the building (e.g., by detecting smoke) and provide fire notification to occupants of the building via an alarm.
[0003] Maintaining a fire alarm system may include recalibrating the sensors of the system's fire sensing equipment. Over time, the sensors of the fire sensing equipment may deviate from a calibrated state due to environmental conditions. For example, an infrared (IR) sensor used for flame detection may deviate due to exposure to radiation. An uncalibrated IR sensor may prevent the fire sensing equipment from detecting a flame.
[0004] Recalibrating sensors often requires cumbersome procedures and is time consuming. For example, fire sensing equipment may have to be disassembled and transported off-site for calibration, which involves specialized calibration equipment used by trained personnel. BRIEF DESCRIPTION OF THE DRAWINGS
[0005] Figure 1 A block diagram of a fire sensing device according to an embodiment of the present disclosure is shown.
[0006] Figure 2 A flow chart of a method for calibrating an IR sensor in a fire sensing device according to an embodiment of the present disclosure is shown.
[0007] Figure 3 A flow chart of a method of detecting IR radiation levels of an image captured by a camera in a fire sensing device according to an embodiment of the present disclosure is shown.
[0008] Figure 4 A flow chart of a method for calibrating an IR sensor in a fire sensing device according to an embodiment of the present disclosure is shown.
[0009] Figure 5 A block diagram of a fire alarm system according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION
[0010] The present invention describes an apparatus, method and system for calibrating an infrared (IR) sensor in a fire sensing device. An apparatus includes a camera configured to capture an image of an environment; an IR sensor configured to detect a radiation level of the environment; and a controller configured to compare the radiation level of the image of the environment captured by the camera with the radiation level of the environment detected by the IR sensor, and based on the comparison result, calibrate the IR sensor.
[0011] Compared to previous fire sensing devices in which personnel (e.g., maintenance engineers and / or operators) must manually test and calibrate the IR sensors in the fire sensing device, the fire sensing device according to the present disclosure can test and calibrate its IR sensor itself without the involvement of a maintenance engineer or operator. For example, the fire sensing device can use a camera in the fire sensing device to determine when the fire sensing device is in extreme darkness, which means that the value displayed by the IR sensor should be zero. If the value displayed by the IR sensor is not zero, this may indicate that the IR sensor needs to be recalibrated, and the value can be used to calibrate (e.g., recalibrate) the IR sensor. Therefore, the fire sensing device according to the present disclosure can test its IR sensor, recalibrate its IR sensor, and / or transmit an alarm that the IR sensor is not calibrated, which can reduce the chance of the fire sensing device delaying or failing to detect a fire.
[0012] In the following detailed description, reference is made to the accompanying drawings which form a part thereof. The accompanying drawings show, by way of example, the manner in which one or more embodiments of the present disclosure may be practiced. These embodiments are described in sufficient detail to enable one of ordinary skill in the art to practice one or more embodiments of the present disclosure. It should be understood that other embodiments may be utilized and mechanical, electrical and / or process changes may be made without departing from the scope of the present disclosure.
[0013] It should be understood that the elements shown in the various embodiments herein may be added, exchanged, combined and / or eliminated to provide multiple additional embodiments of the present disclosure. The proportions and relative sizes of the elements provided in the accompanying drawings are intended to illustrate embodiments of the present disclosure and should not be limiting.
[0014] The figures herein follow the following numbering convention: one or more first digits correspond to the figure number, and the remaining digits identify the element or component in the figure. Similar elements or components between different figures can be identified by using similar numerals. For example, 100 can be referenced to Figure 1 element "00" in the Figure 5 Similar elements in the example may be referenced as 500.
[0015] As used herein, "a" or "a plurality of" things may refer to one or more such things, and "a plurality of" things may refer to more than one such thing. For example, "a plurality of components" may refer to one or more components, and "a plurality of components" may refer to more than one component.
[0016] Figure 1 A block diagram of a fire sensing device 100 according to an embodiment of the present disclosure is shown. The fire sensing device 100 includes a controller (e.g., a microcontroller) 102, a camera 108, and an IR sensor 110. The camera 108 can capture images of an environment (e.g., the environment in which the fire sensing device 100 is located), and the IR sensor 110 can detect the radiation level of the environment.
[0017] The controller 102 may include a processor 104 and a memory 106. The memory 106 may be any type of storage medium that can be accessed by the processor 104 to perform various examples of the present disclosure. For example, the memory 106 may be a non-transitory computer-readable medium having computer-readable instructions (e.g., computer program instructions) stored thereon, which instructions may be executed by the processor 104 to calibrate the IR sensor 110 in the fire sensing device 100 according to the present disclosure. For example, the processor 104 may execute the executable instructions stored in the memory 106 to determine that the radiation level of the environment (e.g., the environment where the fire sensing device is located) is equal to (e.g., at) or less than (e.g., below) a threshold radiation level based on an image captured by a camera 108 of the fire sensing device 100 (e.g., by comparing the radiation level of the image of the environment captured by the camera with the threshold radiation level), in response to determining that the radiation level of the environment (e.g., the image of the environment) is at or below the threshold radiation level, compare the radiation level with the radiation level of the environment detected by the IR sensor 110 of the fire sensing device 100, and based on the comparison result, calibrate the IR sensor 110.
[0018] In some examples, the camera 108 can be used for flame detection. The camera 108 can be a camera that uses visible light to capture an image of the environment. For example, the camera 108 can capture an image of the environment in red, green, and blue color spaces. The controller 102 can convert the image in the red, green, and blue color space into a plurality of hue saturation values and compare the plurality of hue saturation values with the plurality of hue saturation values detected by the IR sensor 110.
[0019] In various embodiments, the camera 108 may be a thermal imaging camera that captures a thermal image of the environment. Thus, the controller 102 may determine the radiation level of the thermal image of the environment.
[0020] The threshold radiation level may be a radiation level when the fire sensing device 100 is in extreme darkness, which may be a hue saturation value of 0%. Thus, if calibrated, the hue saturation value of the IR sensor 110 may be 0%. If the IR sensor 110 displays a hue saturation value other than 0%, this may indicate that the IR sensor needs to be calibrated, and the displayed hue saturation value may be used to calibrate (e.g., recalibrate) the IR sensor 110. Calibrating the IR sensor 110 may include compensating for a difference (e.g., calibration error) between the radiation level of the image captured by the camera 108 and the radiation level of the environment detected by the IR sensor 110 by adding a correction factor (e.g., offset) equal to the difference between the hue saturation value of the image and the hue saturation value of the radiation level of the environment detected by the IR sensor 110 to the radiation level of the environment detected by the IR sensor 110.
[0021] In some examples, controller 102 may determine an offset between the radiation level of the image of the environment captured by camera 108 and the radiation level of the environment detected by IR sensor 110 in response to the radiation level of the image being equal to or less than a threshold radiation level. Controller 102 may calibrate IR sensor 110 based on the determined offset.
[0022] The camera 108 may capture additional images of the environment in response to the radiation level of the image of the environment captured by the camera 108 being greater than a threshold radiation level. The controller 102 may determine whether the radiation level of the additional images of the environment captured by the camera 108 is equal to or less than the threshold radiation level, determine an additional offset between the radiation level of the additional images of the environment captured by the camera 108 and the radiation level of the environment detected by the IR sensor 110 in response to the radiation level of the additional images of the environment captured by the camera 108 being equal to or less than the threshold radiation level, and calibrate the IR sensor 110 based on the determined additional offset.
[0023] In various embodiments, the controller 102 may predict the end of the life of the IR sensor 110 based on the calibration frequency of the IR sensor 110. For example, if the IR sensor 110 is frequently calibrated or if the calibration error increases over time, the controller 102 may infer when the IR sensor 110 will deviate from its operating specifications. The threshold offset may be the amount of offset required for the radiation level of the environment detected by the IR sensor 110 to prevent the IR sensor 110 from deviating from its operating specifications before a certain amount of time (e.g., before nightfall) for another recalibration. If the offset used to calibrate the IR sensor 110 (e.g., the offset between the radiation level of the image captured by the camera 108 and the radiation level of the environment detected by the IR sensor 110) exceeds the threshold offset, the controller 102 may generate an alert (e.g., a message) that the IR sensor 110 is at the end of its life. In some examples, the controller 102 may transmit an alert.
[0024] Figure 2 A method flow chart 212 of calibrating an IR sensor in a fire sensing device according to an embodiment of the present disclosure is shown. In some embodiments, Figure 2 The method shown in the previous Figure 1 The fire sensing device described herein performs (for example, the IR sensor may be previously combined with Figure 1 IR sensor 110 described above).
[0025] At block 216, a controller (e.g., in conjunction with Figure 1 The controller 102 described above may determine that a camera including an IR emitter (eg, in combination with Figure 1 The controller may determine that the environment includes an IR emitter if the image includes any radiation or if the radiation level of the image is greater than a threshold radiation level. If the image includes an IR emitter, calibration is not initiated and the method ends at block 218.
[0026] At block 220, the controller may determine that the image of the environment includes a black body. If the image has no radiation or if the radiation level of the image is at or below a threshold radiation level, the controller may determine that the environment includes a black body. If the image includes a black body, the controller may determine that the environment is ideal for calibration, and calibration may begin at block 222.
[0027] The IR sensor radiation level may be compared to the radiation level of the image captured by the IR camera at block 224. Figure 3 ) describes the radiation level of the detected image. A correction factor may be determined at block 226 based on the comparison result.
[0028] The correction factor may be used to calibrate the IR sensor at block 228. Calibration of the IR sensor may compensate for the difference between the radiation level of the image captured by the camera and the radiation level of the environment detected by the IR sensor by adding an offset as a correction factor to the radiation level of the environment detected by the IR sensor. For example, a correction factor may be added to the radiation level of the environment detected by the IR sensor that is equal to the difference between the hue saturation value of the image and the hue saturation value of the radiation level of the environment detected by the IR sensor.
[0029] Figure 3 A method flow chart 340 of detecting IR radiation levels of an image captured by a camera in a fire sensing device according to an embodiment of the present disclosure is shown. In some embodiments, Figure 3 The method shown in the previous Figure 1 The fire sensing device described herein performs (for example, the camera may be previously combined with Figure 1 Camera 108 as described above).
[0030] At block 342, calibration may be initiated (eg, previously associated with Figure 2 described calibration). Camera (e.g., combined with Figure 1 The camera 108 described above may capture an image of the environment using thermal camera imaging at block 344. The camera may capture images in red, green, and blue color spaces.
[0031] Processor (e.g., in conjunction with Figure 1 The processor 104 described above may receive the image at block 346. The processor may pre-process the image at block 348. The pre-processing may include reading, denoising, and / or resizing the image. The processor may further convert the image from a red, green, and blue (RGB) color space to a hue saturation value (HSV) to define a range of black at block 350.
[0032] At block 352, post-processing of the image can be performed by the processor. For example, the processor can determine whether the image includes an IR emitter by comparing the hue saturation values of the image to the hue saturation values of an image without an IR emitter (e.g., without radiation) or to the hue saturation values of an image with radiation below a threshold radiation level. In some embodiments, the processor can determine that the image includes an IR emitter if multiple hue saturation values of the image are greater than the threshold hue saturation value.
[0033] The IR image may be displayed at 354, and the method may end at block 356. The IR image may then be used to calibrate the IR sensor, such as in conjunction with Figure 2 described.
[0034] Figure 4A method flow chart 460 of calibrating an IR sensor in a fire sensing device according to an embodiment of the present disclosure is shown. In some embodiments, Figure 4 The method shown in the previous Figure 1 The fire sensing device described herein performs (for example, the IR sensor may be previously combined with Figure 1 IR sensor 110 described above).
[0035] Cameras such as thermal cameras (e.g., combined with Figure 1 The camera 108 described above may capture an image of the environment at block 462. The camera may perform image pre-processing at block 464, including reading, denoising, and / or resizing.
[0036] After image preprocessing, the camera may output an image and / or thermal profile at block 466. The image and / or thermal profile may be output to a controller of a fire sensing device (e.g., in conjunction with a Figure 1 The controller 102 described above. The controller may perform feature extraction at block 468 to identify a thermal signature (eg, radiation level) of the image at block 470.
[0037] At block 472, the controller may determine whether the radiation level of the environment is greater than a threshold radiation level based on the image captured by the camera by comparing the radiation level of the image with the threshold radiation level. If the radiation level of the environment in the image is greater than the threshold radiation level, the controller may proceed to the next frame (e.g., the next image) captured by the camera at block 474.
[0038] If the radiation level of the environment in the image is at or below the threshold radiation level, the controller may compare the radiation level of the image with the radiation level of the environment in the image at block 476 detected by the IR sensor of the fire sensing device (e.g., in combination with the Figure 1 The controller may compare the radiation level of the environment detected by the IR sensor 110 described above to the radiation level of the environment detected by the IR sensor 110. If the radiation level of the IR sensor is at or within the threshold range of the radiation level of the image, the controller may advance to the next frame at block 474.
[0039] At block 478, if the radiation level detected by the IR sensor is greater than or outside a threshold range of radiation levels of the image, the controller may perform a difference analysis by calculating a difference between the radiation level detected by the IR sensor and the radiation level of the image. The controller may generate a correction factor based on the difference at block 480 and calibrate the IR sensor using the correction factor at block 482. In some examples, a user notification may be transmitted at 484 in response to updating the calibration value of the IR sensor to notify the user that the IR sensor has been calibrated.
[0040] Figure 55 shows a block diagram of a fire alarm system 590 according to an embodiment of the present disclosure. The system 590 may include a fire sensing device 500, a monitoring device 594, and a computing device 596. The fire sensing device 500 may be, for example, a previously described Figure 1 A fire sensing device 100 is described.
[0041] The fire sensing device 500 may include a user interface 501. The user interface 501 may be a graphical user interface (GUI) that may provide information to and / or receive information from a user, a monitoring device 594, and / or a computing device 596. In some examples, the user interface 501 may display a message. The message may be displayed in response to calibrating an IR sensor of the fire sensing device 500, failing to calibrate the IR sensor, or predicting the end of the life of the IR sensor.
[0042] The monitoring device 594 may be a cloud computing device of a control panel, a fire detection control system, and / or a fire alarm system. The monitoring device 594 may be configured to send commands to and / or receive messages from the fire sensing device 500 via a wired or wireless network. For example, the fire sensing device 500 may transmit (e.g., send) a message to the monitoring device 594 in response to calibrating the IR sensor, failing to calibrate the IR sensor, or predicting the end of the life of the IR sensor.
[0043] The monitoring device 594 may receive messages from a plurality of fire sensing devices similar to the fire sensing device 500. For example, the monitoring device 594 may receive messages from each of a plurality of fire sensing devices similar to the fire sensing device 500, and create a maintenance schedule based on the messages from each of the plurality of fire sensing devices.
[0044] In various embodiments, the monitoring device 594 may include a user interface 595. The user interface 595 may be a GUI that may provide information to and / or receive information from a user and / or the fire sensing device 500. The user interface 595 may display messages and / or data received from the fire sensing device 500. For example, the user interface 595 may display a message that the IR sensor requires maintenance, that the IR sensor is calibrated, that the IR sensor has failed to calibrate, and / or that the IR sensor is at the end of its life.
[0045] In various embodiments, the computing device 596 may receive messages from the fire sensing device 500 and / or the monitoring device 594 via a wired or wireless network. The computing device 596 may be a personal laptop computer, a desktop computer, a mobile device (such as a smart phone, a tablet computer, a wrist-worn device), and / or redundant combinations thereof, as well as other types of computing devices.
[0046] In some examples, the computing device 596 may include a user interface 597 to display messages from the monitoring device 594 and / or the fire sensing device 500. For example, the user interface 597 may display a message that the IR sensor requires maintenance, the IR sensor is calibrated, the IR sensor has failed to calibrate, and / or the IR sensor is at the end of its life.
[0047] The network described herein may be a network relationship through which the fire sensing device 500, the monitoring device 594, and / or the computing device 596 can communicate with each other. Examples of such network relationships may include a distributed computing environment (e.g., a cloud computing environment), a wide area network (WAN) such as the Internet, a local area network (LAN), a personal area network (PAN), a campus area network (CAN), or a metropolitan area network (MAN), as well as other types of network relationships. For example, a network may include a plurality of servers that receive information from the fire sensing device 500, the monitoring device 594, and the computing device 596 via a wired or wireless network and transmit information to the fire sensing device, the monitoring device, and the computing device.
[0048] As used herein, a "network" may provide a communication system that directly or indirectly links two or more computers and / or peripheral devices and allows the monitoring device 594 and / or computing device 596 to access data and / or resources on the fire sensing device 500 or vice versa. A network may allow a user to share resources on their own system with other network users and access information on a system located in a central location or a system located in a remote location. For example, a network may connect multiple computing devices together to form a distributed control network (e.g., a cloud).
[0049] The network can provide connections to the Internet and / or to the networks of other entities (e.g., organizations, institutions, etc.). Users can interact with network-enabled software applications to make network requests, such as to obtain data. Applications can also communicate with network management software, which can interact with network hardware to transfer information between devices on the network.
[0050] Although specific implementations have been illustrated and described herein, those of ordinary skill in the art will appreciate that any arrangement calculated to achieve the same technique may be substituted for the specific implementations shown. This disclosure is intended to cover any and all modifications or variations of various implementations of the present disclosure.
[0051] It should be understood that the above description is given in an illustrative rather than limiting manner.By reading the above description, combinations of the above embodiments, as well as other embodiments not specifically described herein, will be apparent to those skilled in the art.
[0052] The scope of the various embodiments of the present disclosure includes any other applications using the above-described structures and methods.The scope of the various embodiments of the present disclosure should therefore be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.
[0053] In the above detailed description, various features are grouped together in the exemplary embodiments shown in the drawings for the purpose of simplifying the disclosure. This method of disclosure should not be interpreted as reflecting an intention that the embodiments of the present disclosure require more features than are expressly recited in each claim.
[0054] Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment.Thus the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separate embodiment.
Claims
1. A fire sensing device (100, 500), comprising: a camera (108) configured to capture images of an environment; an infrared (IR) sensor (110) configured to detect a radiation level of the environment; and A controller (102), the controller being configured to: comparing a radiation level of the image of the environment captured by the camera (108) with the radiation level of the environment detected by the IR sensor (110); as well as Based on the comparison result, the IR sensor (110) is calibrated.
2. The device according to claim 1, wherein: The camera (108) is configured to capture the image of the environment using visible light.
3. The device according to claim 1, wherein: The camera (108) is a thermal imaging camera.
4. The device according to claim 1, wherein: The image of the environment is a thermal image of the environment.
5. The device according to claim 4, wherein: The controller (102) is configured to determine the radiation level of the thermal image of the environment.
6. The device according to claim 1, wherein: The camera (108) is used for flame detection.
7. The device according to claim 1, wherein: The controller (102) is configured to compare the radiation level of the image captured by the camera (108) to a threshold radiation level.
8. The device according to claim 7, wherein: The controller (102) is configured to compare the radiation level of the image of the environment captured by the camera (108) with the radiation level of the environment detected by the IR sensor (110) in response to the radiation level of the image captured by the camera (108) being at or below the threshold radiation level.
9. The device according to claim 1, wherein: Calibrating the IR sensor (110) includes compensating for a difference between the radiation level of the image captured by the camera (108) and the radiation level of the environment detected by the IR sensor (110).
10. The device according to claim 1, wherein: The controller (102) is configured to predict an end of life of the IR sensor (110) based on a calibration frequency of the IR sensor (110).
