Abnormality notification system

Abstract

To make it possible to receive abnormality notification when abnormality is generated in a selected monitoring object, by arbitrarily selecting the monitoring object according to user's application.SOLUTION: An abnormality notification system includes: setting an abnormal movement / temperature pattern determined as a pattern of an abnormal movement and temperature according to a type of a selected monitoring object; determining that the measured movement and temperature of the monitoring object are identical to the abnormal movement / temperature pattern corresponding to a type of the monitoring object; and notifying a preregistered terminal of the fact that abnormality has occurred in the monitoring object when it is determined that the movement and temperature of the monitoring object are identical to the abnormal movement / temperature pattern corresponding to the type of the monitoring object.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an abnormality notification system. [Background technology]

[0002] Patent Document 1 (JP 2018-149236 A) describes an embodiment that includes a plurality of infrared sensors configured to acquire thermal images representing the temperature distribution within a monitored area, and a health management device that detects the body temperatures of occupants staying within the area from the thermal images of the area acquired by the plurality of infrared sensors, and manages the health conditions of the occupants based on the obtained body temperatures, in which the health management device acquires thermal images from the plurality of infrared sensors, acquires the positions of the occupants staying within the area, detects the body temperatures of the occupants from the thermal images based on the positions, determines whether or not the occupants have an abnormality in their health based on the body temperatures, and notifies a pre-set external device of the occurrence of the abnormality in the health of the occupants.

[0003] Patent Document 2 (Republished Publication No. 2014-188661) describes a mode in which the possibility of communication with an external device outside the vehicle at the parking lot where the vehicle is parked is inspected, notification information based on the inspection results is notified, images (infrared images, thermal images) are taken while the vehicle is parked, and the captured images are transmitted to the external device, the captured images are analyzed to detect the occurrence of an abnormality, and if the inspection result denies the possibility of communication and the occurrence of an abnormality is detected, information indicating the occurrence of the abnormality is notified.

[0004] Patent document 3 (JP 2022-115613 A) describes an embodiment in which image data in the visible light region and temperature distribution data in the infrared light region corresponding to the image data are generated, and a person's facial image data and temperature information corresponding to the facial image data are generated from the image data and the temperature distribution data, respectively, the facial image data are compared with registered facial image data included in the registration information, body temperature information of the person according to the environmental information is generated, an abnormality in the person's body temperature is determined based on the body temperature information, and the subject is notified that an abnormality in body temperature has been detected.

[0005] Patent document 4 (WO2023 / 286248) describes a mode in which thermal images taken within a residence in a chronological order are acquired, the acquired thermal images are input into a trained model that has been trained to infer thermal anomalies, the urgency and notification range corresponding to the thermal anomaly are inferred, and based on the inferred urgency and notification range, a user to be notified and a notification method for that user are determined, and the determined user is notified of the thermal anomaly using the notification method. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2018-149236 A [Patent Document 2] Republished Publication No. 2014-188661 [Patent Document 3] JP 2022-115613 A [Patent Document 4] WO2023 / 286248 Summary of the Invention [Problem to be solved by the invention]

[0007] An object of the present invention is to enable a user to arbitrarily select a monitoring target according to the user's purpose, and to receive an abnormality notification when an abnormality occurs in the selected monitoring target.

[0008] Another object of the present invention is to enable a user to arbitrarily set the level of an abnormality in a monitored object according to the user's purpose, and to receive an abnormality notification when an abnormality of the set level occurs. [Means for solving the problem]

[0009] A first aspect is an abnormality notification system including a monitoring target type selection unit which selects a type of monitoring target within a monitored space, a thermal distribution image acquisition unit which acquires thermal distribution images within the monitored space in time series, a movement measurement unit which measures the movement of the monitoring target in a measurement mode corresponding to the type of monitoring target selected by the monitoring target type selection unit based on the acquired thermal distribution image, a temperature measurement unit which measures the temperature of the monitoring target in a measurement mode corresponding to the type of monitoring target selected by the monitoring target type selection unit based on the acquired thermal distribution image, an abnormal movement / temperature pattern setting unit which sets an abnormal movement / temperature pattern that is determined to be an abnormal movement and temperature pattern corresponding to the type of monitoring target selected by the monitoring target type selection unit, an abnormality determination unit which determines whether the movement and temperature of the monitoring target measured by the movement measurement unit and the temperature measurement unit, respectively, match the abnormal movement / temperature pattern corresponding to the type of the monitoring target, and an abnormality notification unit which notifies a pre-registered terminal that an abnormality has occurred in the monitoring target when it is determined by the abnormality determination unit that the movement and temperature of the monitoring target match the abnormal movement / temperature pattern corresponding to the type of the monitoring target.

[0010] A second aspect is the abnormality notification system of the first aspect, wherein the abnormality movement / temperature pattern set by the abnormality movement / temperature pattern setting unit can be set manually. Effect of the Invention

[0011] According to the first and second aspects, a user can arbitrarily select a monitoring target according to the purpose of the user, and can receive an abnormality notification when an abnormality occurs in the selected monitoring target. Also, according to the first and second aspects, a user can arbitrarily set an abnormality level of a monitoring target according to the purpose of the user, and can receive an abnormality notification when an abnormality of the set level occurs. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a block diagram showing a functional configuration of an abnormality notification system according to an embodiment. [Diagram 2]FIG. 2 is a configuration diagram of a terminal, a server, and a network that communicatively connects the terminals and the server according to the embodiment. [Diagram 3] FIG. 3 is a diagram showing a hardware configuration for realizing the functional configuration of the embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a monitoring target type selection screen displayed on the display screen of the display device of the monitoring target terminal and the user terminal. [Diagram 5] FIG. 5 is a diagram showing the relationship between an infrared thermography camera, a monitored terminal, a user terminal, and a server. [Figure 6] FIG. 6 is a diagram showing an example of a monitoring target teaching screen displayed on the display screen of the display device of the monitoring target terminal and the user terminal. [Figure 7] FIG. 7 is a diagram showing an example of an abnormal behavior / temperature pattern setting screen displayed on the display screen of the display device of the monitored terminal and the user terminal. [Figure 8A] FIG. 8A is a diagram illustrating an example of an abnormality notification screen displayed on the display screen of the display device of the user terminal. [Figure 8B] FIG. 8B is a diagram illustrating an example of an abnormality notification screen displayed on the display screen of the display device of the user terminal. [Figure 8C] FIG. 8C is a diagram illustrating an example of an abnormality notification screen displayed on the display screen of the display device of the user terminal. [Figure 8D] FIG. 8D is a diagram illustrating an example of an abnormality notification screen displayed on the display screen of the display device of the user terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0014] (Functional configuration of the abnormality notification system)

[0015] FIG. 1 is a block diagram showing a functional configuration of an abnormality notification system 100 according to an embodiment.

[0016] The abnormality notification system of the embodiment is configured to include a monitoring object type selection unit 110, a thermal distribution image acquisition unit 120, a movement / status measurement unit 130, a temperature measurement unit 140, an abnormal movement / temperature pattern setting unit 150, an abnormality determination unit 160, and an abnormality notification unit 170.

[0017] The functions of Figure 1 can be realized by a combination of a monitored terminal 50, one or more user terminals 60, a server 70, and a network 80 that communicatively connects each of the terminals 50, 60 and the server 70, as shown in Figure 2.

[0018] (Hardware configuration)

[0019] Fig. 3 is a hardware configuration diagram for realizing the functional configuration of the embodiment shown in Fig. 1. The diagram illustrates the hardware configuration of the monitored terminal 50, the user terminal 60, and the server 70. For example, the monitored terminal 50 can be configured as a personal computer provided on the monitored side, the user terminal 60 can be configured as a personal computer or smartphone provided on the user side away from the monitored object, and the server 70 can be configured as a personal computer.

[0020] As shown in FIG. 3, the monitored terminal 50, the user terminal 60, and the server 70 each include a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a storage 14, an input device 16, a display device 17, a communication I / F 18, and an external storage device 19, and are connected to each other so as to be able to communicate with each other via a system bus 15.

[0021] The CPU 11 is a central processing unit, and executes various programs and controls each device connected to the system bus 15. That is, the CPU 11 reads a program from the ROM 12 or the storage 14, and executes the program using the RAM 13 as a working area. The CPU 11 controls each device connected to the system bus 15 and performs various arithmetic processing according to the program recorded in the ROM 12 or the storage 14. The ROM 12 or the storage 14 holds a BIOS (Basic Input / Output System) and an OS (Operating System), which are control programs executed by the CPU 11, as well as various computer-readable and executable programs and various necessary data for realizing this embodiment.

[0022] The ROM 12 stores various control programs and various data. The RAM 13 functions as a main memory, work area, etc. for the CPU 11 and temporarily stores programs or data as a working area. The storage 14 is composed of an HDD (Hard Disk Drive) or SSD (Solid State Drive) and stores various programs including the BIOS and OS, and various data.

[0023] The input device 16 includes a pointing device such as a mouse, a keyboard, and a reading device such as a scanner, and is used for performing various input operations.

[0024] The display device 17 is, for example, a liquid crystal display, and displays various information. The display device 17 may function as the input device 16 by adopting a touch panel system.

[0025] The communication interface 18 is an interface for communicating with other devices such as the server 70, the terminals 50, 60, etc., and uses standards such as Ethernet (registered trademark), FDDI, Wi-Fi (registered trademark), etc. The communication interface 18 is connected to a network 80 and controls the transmission and reception of data.

[0026] The external storage device 19 is composed of various types of memory cards such as a USB memory, an HDD, an SSD, or other external storage media that can be detachably connected.

[0027] (Monitoring target type selection section)

[0028] The monitoring target type selection unit 110 selects the type of monitoring target in the monitoring target space. The monitoring target space is a room, the inside of a car (bus), etc., in which the monitoring target exists.

[0029] 4 illustrates an example of a monitoring target type selection screen 41 displayed on the display screen of the display device 17 of the monitoring target terminal 50 and the user terminal 60. When the user is in the monitoring target (a room, a car, a bus), he or she can select the type of monitoring target by operating the input device 16 of the monitoring target terminal 50 (the screen of the display device 17 in the case of a touch panel system). When the user is away from the monitoring target, he or she can select the type of monitoring target by operating the input device 16 of the user terminal 60 (the screen of the display device 17 in the case of a touch panel system).

[0030] The monitoring target type selection screen 41 is configured as an interface screen having the functions of a monitoring target type selection unit 110 .

[0031] The selection section 410 is arranged on the monitoring target type selection screen 51. The selection section 410 is configured with, for example, radio buttons.

[0032] In the selection unit 410, in response to a user's instruction, one of the types of objects to be monitored in a monitored space such as a room or the inside of a vehicle can be selected from among "person to be monitored" 111, "pet" 112, "source of fire" 113, and "babies and infants in a vehicle (bus)" 114. Any type can be selected according to the user's purpose. The objects to be monitored include, for example, elderly people living alone, people with disabilities, and people requiring care. The pets are pets such as dogs and cats, and the health condition of the pets is monitored according to the state of the pets and the feces, urine, and vomit discharged from the pets. The source of fire is a heating element that can cause a fire, such as a gas stove in a burning state, an electric stove in a heated state, or a lit cigarette.

[0033] (Heat distribution image acquisition unit)

[0034] The thermal distribution image acquiring unit 120 acquires thermal distribution images in a monitored space in time series. The thermal distribution image acquiring unit 120 can be configured to include an infrared thermography camera 121, for example.

[0035] 5 shows the relationship between the infrared thermography camera 121, the monitored terminal 50, the user terminal 60, and the server 70. The infrared thermography camera 121 and the monitored terminal 50 are connected to each other so as to be able to transmit and receive imaging signals and control signals via a wired signal line 122. The infrared thermography camera 121 and the monitored terminal 50 may also be connected to each other so as to be able to transmit and receive signals via wireless communication based on standards such as Wi-Fi (registered trademark).

[0036] The infrared thermography camera 121 is installed, for example, on the ceiling of a room R or a vehicle, and captures an image of the room R or the vehicle interior where a monitoring target (for example, a person being watched 126) is present, at a predetermined angle of view. The infrared thermography camera 121 captures an infrared image of the room R, converts the amount of infrared radiation for each pixel into corresponding temperature data, and acquires an image signal of a two-dimensional temperature distribution image at a predetermined frame rate. The higher the amount of infrared radiation in the two-dimensional temperature distribution image, the higher the temperature. The image signal of the acquired two-dimensional temperature distribution image is transmitted from the infrared thermography camera 121 to the monitored side terminal 50 via a wired signal line 122, and is displayed on the screen of the display device 17 of the monitored side terminal 50 in a hue corresponding to the magnitude of temperature, for example, a high temperature part is displayed in red hue and a low temperature part is displayed in blue hue. Furthermore, the image signal of the two-dimensional temperature distribution image is transmitted from the monitored side terminal 50 to the user side terminal 60 via the network 80 and the server 70, and the two-dimensional temperature distribution image is similarly displayed on the screen of the display device 17 of the user side terminal 60.

[0037] (Movement Measurement Department)

[0038] The movement measuring unit 130 measures the movement of the monitoring target in a measurement mode according to the type of monitoring target selected by the monitoring target type selecting unit 110 based on the thermal distribution image acquired by the thermal distribution image acquiring unit 120 .

[0039] For example, an imaging signal of a two-dimensional temperature distribution image acquired by the infrared thermography camera 121 is transmitted to the server 70 via the monitored terminal 50 and the network 80. The server 70 executes the following measurement process.

[0040] The following movement measurement process is executed in the measurement modes MD1, MD2, MD3, and MD4 according to the monitoring target.

[0041] Measurement mode MD1 of type 111 “Monitored Person”: Measures whether a watched person such as an elderly person living alone remains motionless for a predetermined time T1 or more.

[0042] Measurement mode MD2 of type 112 "Pet": Measures the time τ2 and the number of times N2 (number of times per unit time or unit days) that pets such as dogs and cats excrete feces, urine, and vomit.

[0043] · Class 113 "Fire source" measurement mode MD3: Measures the time τ3 when a gas stove, electric stove, or cigarette is ignited, and the duration of combustion T3 after ignition.

[0044] Measurement mode MD4 of type 114 "Infant in vehicle (bus)": Measures whether or not there is an infant in the vehicle (bus) after time τ4 when a predetermined time T4 has elapsed since the vehicle's engine key was turned off. The time when the vehicle's engine key was turned off can be detected by the fact that the electrical connection of the engine key is turned off or the temperature inside the vehicle has risen.

[0045] The motion measurement process using the measurement modes MD1, MD2, MD3, and MD4 may be performed automatically in response to the selection of the monitoring target. Also, after the monitoring target is selected, the monitoring target may be taught on the image, and then the motion measurement process may be performed.

[0046] (Automatic movement measurement processing)

[0047] For example, a monitoring target in an image is identified by pattern recognition, and then movement measurement processing is performed.

[0048] In the storage medium of the server 70, image recognition patterns (image templates) PM1, PM2, PM3, and PM4, exemplified below, for identifying a monitoring target in an image are stored for each of the types 111, 112, 113, and 114.

[0049] Image recognition pattern PM1: Features such as the size, shape, contour length, brightness, and color of the person being watched in the image

[0050] Image recognition pattern PM2: Features such as size, shape, contour length, brightness, and color of dogs, cats, other pets, and their excrement in the image

[0051] Image recognition pattern PM3: Features such as size, shape, contour length, brightness, and color of the gas stove, electric stove, or cigarette in the image

[0052] Image recognition pattern PM4: Features such as the size, shape, contour length, brightness, and color of the infant in the image

[0053] For example, when the type 111 "person being watched" is selected as the monitoring target, the image recognition pattern PM1 is retrieved from the storage medium of the server 70, and the image recognition pattern PM1 is compared with each image portion of the two-dimensional temperature distribution image to determine whether or not the feature amounts of the two match. If it is determined that the feature amounts of the image recognition pattern PM1 and the image portion of the two-dimensional temperature distribution image match, it is specified that the person being watched is located in that image portion of the two-dimensional temperature distribution image. Thereafter, the changes and displacements of the image portion of the "person being watched" on the two-dimensional temperature distribution image are tracked at predetermined time intervals, and the movement is measured in the above-mentioned measurement mode MD1 (whether or not the person being watched is stationary for a predetermined time T1 or more).

[0054] Similarly, when a monitoring target of another type 112, 113, 114 is selected, the monitoring target is identified in the two-dimensional temperature distribution image by pattern recognition using the corresponding image recognition patterns PM2, PM3, PM4, and the changes and displacements of the image portion of the identified monitoring target on the two-dimensional temperature distribution image are tracked at predetermined time intervals, and the movement is measured using the corresponding measurement modes MD2, MD3, MD4.

[0055] (Movement measurement processing using teaching)

[0056] 6 illustrates a monitoring target teaching screen 42 displayed on the display screen of the display device 17 of the monitoring target terminal 50 and the user terminal 60. When the user is in the monitoring target (a room, a car, a bus), the user can teach the monitoring target by operating the input device 16 of the monitoring target terminal 50 (the screen of the display device 17 in the case of a touch panel system). When the user is away from the monitoring target, the user can teach the monitoring target by operating the input device 16 of the user terminal 60 (the screen of the display device 17 in the case of a touch panel system).

[0057] FIG. 6 shows a case where, for example, the type 111 "person being watched" is selected as the monitoring subject.

[0058] The teaching frame calling section 421 is arranged on the monitoring target teaching screen 42. The teaching frame 421F is called by clicking on the teaching frame calling section 421, and any image area on the two-dimensional temperature distribution image 125 can be selected by dragging the teaching frame 421F. The teaching frame 421F can be positioned in an image area surrounding the person 126 to be watched over. The size of the teaching frame 421F can be changed to any size according to the operation.

[0059] The monitoring target confirmation button 422 is arranged on the monitoring target teaching screen 42 .

[0060] By pressing the monitoring target confirmation button 422, it is possible to confirm that the object in the image area surrounded by the teaching frame 421F is the monitoring target (the person being watched over 126). That is, image processing is performed to identify the contour line 421B and the background 421C in the image area 421A surrounded by the teaching frame 421F on the two-dimensional temperature distribution image 125, and the person being watched over 126 is identified.

[0061] Thereafter, changes and displacements in the image area of ​​the monitored person 126 on the two-dimensional temperature distribution image are tracked at predetermined time intervals, and the movements are measured in the above-mentioned measurement mode MD1 (whether the monitored person remains stationary for a predetermined time T1 or longer).

[0062] Similarly, when a monitoring target of another type 112, 113, or 114 is selected, the monitoring target is identified in the two-dimensional temperature distribution image by teaching, and the changes and displacements of the image portion of the identified monitoring target on the two-dimensional temperature distribution image are tracked at predetermined time intervals, and the movement is measured in the corresponding measurement mode MD2, MD3, or MD4.

[0063] (Temperature measurement section)

[0064] The temperature measurement unit 140 measures the temperature of the monitoring target in a measurement mode according to the type of monitoring target selected by the monitoring target type selection unit 110 based on the thermal distribution image acquired by the thermal distribution image acquisition unit 120 .

[0065] The measurement modes MT1, MT2, MT3, and MT4 for each monitored object are as follows:

[0066] Measurement mode MT1 for type 111 "Monitored person": Measures the body temperature tm1 of the person being monitored, such as an elderly person living alone, the area SF1 (percentage of the total) of the body surface that is above high temperature tm11 or below low temperature tm12, and the room temperature rtm1.

[0067] Measurement mode MT2 for type 112 “Pet”: Measures the amount of feces, urine, and vomit excreted from pets such as dogs and cats, the size of feces K2, the body temperature tm2 of pets such as dogs and cats, the range SF2 (percentage of the total) of the body surface that is above high temperature tm21 or below low temperature tm22, and the room temperature rtm2.

[0068] Category 113 "Fire source" measurement mode MT3: Measures the temperature tm3 near the gas stove, electric stove or cigarette, and the range SF3 where the temperature is above tm31.

[0069] Measurement mode MT4 for type 114 "Infants in a vehicle (bus)": Measures the body temperature tm4 of the infant in the vehicle (bus), the area SF4 (percentage of the total) of the body surface that is above high temperature tm41 or below low temperature tm42, and the temperature rtm4 inside the vehicle (bus).

[0070] The temperature measurement processing using the measurement modes MT1, MT2, MT3, and MT4 may be performed automatically in response to the selection of the monitoring target, similar to the moving / still measurement processing, or may be performed after the selection of the monitoring target and the processing of teaching (instructing) the monitoring target on the image.

[0071] (Abnormal Activity / Temperature Pattern Setting Section)

[0072] The abnormal movement / temperature pattern setting unit 150 sets abnormal movement / temperature patterns PT1, PT2, PT3, and PT4 that are determined to be abnormal movement and temperature patterns according to the type of monitoring target selected by the monitoring target type selection unit 110.

[0073] The abnormal behavior / temperature patterns PT1, PT2, PT3, and PT4 are stored in the storage medium of the server 70 in association with the types 111, 112, 113, and 114 of the monitored objects, respectively.

[0074] Abnormal movement and temperature patterns PT1, PT2, PT3, and PT4 are patterns that are determined to be abnormal movement and temperature patterns, and are as follows.

[0075] Abnormal movement and temperature pattern PT1: This is a pattern of movement and temperature that satisfies all of the following conditions J11, J12, and J13.

[0076] Condition J11: A person to be watched, such as an elderly person living alone, remains motionless for a predetermined period of time T1 or longer during daytime hours LT11.

[0077] Condition J12: The body temperature tm1 of the person being monitored, such as an elderly person living alone, is abnormally high (body temperature tm11 or higher) or abnormally low (body temperature tm12 or lower) over a wide area of ​​the body surface (surface area SF11 or greater).

[0078] Condition J13: Room temperature rtm1 is abnormally high (room temperature rtm11 or higher) or abnormally low (room temperature rtm12 or lower).

[0079] · Abnormal movement and temperature pattern PT2: This is a pattern of movement and temperature that satisfies all of the following conditions J21, J22, J23, and J24.

[0080] Condition J21: The time τ2 or the number of times N2 when a pet such as a dog or cat excretes feces, urine, or vomit is abnormally long (LT21) (such as a time outside the appropriate time after a meal) or the number of times is abnormal (greater than the upper limit N21 or less than the lower limit N22 per day).

[0081] Condition J22: The amount of feces, urine, or vomit excreted from pets such as dogs and cats, or the size of the feces K2, is abnormal (amount or size is greater than K21 or less than K22).

[0082] Condition J23: The body temperature tm2 of a pet such as a dog or cat is abnormally high (body temperature tm21 or higher) or abnormally low (body temperature tm22 or lower) over a wide area of ​​the body surface (surface area SF21 or more).

[0083] Condition J24: Room temperature rtm2 is abnormally high (room temperature rtm21 or higher) or abnormally low (room temperature rtm22 or lower).

[0084] · Abnormal movement and temperature pattern PT3: This is a pattern of movement and temperature that satisfies all of the following conditions J31 and J32.

[0085] Condition J31: The duration of combustion T3 from the time τ3 when the gas stove, electric stove, or cigarette is ignited is equal to or longer than a predetermined time T31.

[0086] Condition J32: The temperature tm3 around the gas stove or electric stove or cigarette is abnormally high (temperature tm31 or higher) over a wide area (area SF31 or higher).

[0087] · Abnormal movement and temperature pattern PT4: This is a pattern of movement and temperature that satisfies all of the following conditions J41, J42, and J43.

[0088] Condition J41: An infant is present inside the vehicle (bus) after a time τ4 when a predetermined time T4 has elapsed since the engine key of the vehicle was turned off.

[0089] Condition J42: The body temperature tm4 of an infant or young child in a vehicle (bus) is abnormally high (body temperature tm41 or higher) or abnormally low (body temperature tm42 or lower) over a wide area of ​​the body surface (surface area SF41 or more).

[0090] Condition J43: The temperature rtm4 inside the vehicle (bus) is abnormally high (interior temperature rtm41 or higher) or abnormally low (interior temperature rtm42 or lower).

[0091] (Manual setting of abnormal activity and temperature patterns)

[0092] The abnormal movement / temperature patterns PT1, PT2, PT3, and PT4 can be manually set by the abnormal movement / temperature pattern setting unit 150. The manual setting may be performed by the user himself or by a serviceman of the abnormality notification system.

[0093] 7 illustrates an abnormal movement / temperature pattern setting screen 90 displayed on the display screen of the display device 17 of the monitored terminal 50 and the user terminal 60. A serviceman or a user can manually set an abnormal movement / temperature pattern by operating the input device 16 of the monitored terminal 50 (the screen of the display device 17 in the case of a touch panel system). When the user is away from the monitored subject, he or she can manually set an abnormal movement / temperature pattern by operating the input device 16 of the user terminal 60 (the screen of the display device 17 in the case of a touch panel system).

[0094] The abnormal movement / temperature pattern setting screen 90 has a condition setting section 910. In the condition setting section 910, conditions (J11, J12, J13), (J21, J22, J23, J24), (J31, J32), (J41, J42, J43) can be manually set for each of the abnormal movement / temperature patterns PT1, PT2, PT3, PT4. For example, by clicking a check box 911 associated with each of the conditions J11 to J43, a desired condition can be set for each of the abnormal movement / temperature patterns PT1, PT2, PT3, PT4. In addition, a set threshold value for a body temperature or the like that is determined to be abnormal can be set to a desired value.

[0095] For example, for abnormal movement / temperature pattern PT1, the setting can be changed to any one of conditions J11, J12, and J13 (for example, condition J11 only) or a combination of two (for example, conditions J11 and J12 only). Also, by inputting values ​​for daytime time zone setting value LT11, stillness time setting value T1, body surface range setting value SF11, high body temperature setting value tm11, low body temperature setting value tm12, high room temperature setting value rtm11, and low room temperature setting value rtm12 in text box 912, various setting threshold values ​​can be changed.

[0096] Similarly, for abnormal activity / temperature pattern PT2, the setting can be changed to any one of conditions J21, J22, J23, and J24 (for example, condition J21 only), or a combination of two (for example, conditions J21 and J22 only), or a combination of three (for example, conditions J21, J22, and J23 only). Also, various setting thresholds can be changed by inputting values ​​in the text boxes for excretion time period setting value LT21, high frequency side setting value N21, low frequency side setting value N22, high frequency side setting value K21, low frequency side setting value K22, body surface range setting value SF21, high body temperature side setting value tm21, low body temperature side setting value tm22, high room temperature side setting value rtm21, and low room temperature side setting value rtm22.

[0097] Similarly, for abnormal behavior / temperature pattern PT3, the setting can be changed to either condition J31 or J32 (for example, condition J31 only). Also, by inputting values ​​for the combustion duration setting value T31, high temperature range area setting value SF31, and high temperature setting value tm31 in the text boxes, various setting threshold values ​​can be changed.

[0098] Similarly, for abnormal movement / temperature pattern PT4, the setting can be changed to any one of conditions J41, J42, and J43 (for example, condition J41 only) or a combination of two (for example, conditions J41 and J42 only).In addition, various setting thresholds can be changed by inputting values ​​for engine key-off elapsed time setting value T4, body surface range setting value SF41, high body temperature setting value tm41, low body temperature setting value tm42, interior high temperature setting value rtm41, and interior low temperature setting value rtm42 in the text boxes.

[0099] (Abnormality judgment section)

[0100] The abnormality determination unit 160 determines whether the movement and temperature of the monitored object measured by the movement measurement unit 130 and the temperature measurement unit 140, respectively, match the abnormal movement and temperature patterns PT1, PT2, PT3, and PT4 corresponding to the type of the monitored object.

[0101] (Abnormal notification section)

[0102] When the abnormality determination unit 160 determines that the movement and temperature of the monitored object match the abnormal movement and temperature patterns PT1, PT2, PT3, and PT4 corresponding to the type of monitored object, the abnormality notification unit 170 notifies the pre-registered terminal 60 that an abnormality has occurred in the monitored object.

[0103] The terminal 60 to which the notification should be sent can be registered according to the type of the monitored object, 111 "person to be watched", 112 "pet", 113 "fire source", 114 "babies and small children in the vehicle (bus)".

[0104] Fig. 8A illustrates an example of an abnormality notification screen 43 displayed on the display screen of the display device 17 of the user terminal 60. Fig. 8A shows the content of the notification when, for example, type 111 "person being watched over" is selected as the monitoring subject and a personal computer or smartphone owned by a family member of the person being watched over is registered as the user terminal 60. It is assumed that conditions J11 and J13 are set for abnormal movement / temperature pattern PT1.

[0105] When it is determined that the movement and temperature of the person being watched 126 measured by the movement and temperature measuring unit 130 and the temperature measuring unit 140, respectively, match the abnormal movement and temperature pattern PT1, the display screen of the display device 17 of the user side terminal 60 transitions to the abnormality notification screen 43, where the two-dimensional temperature distribution image 125 of the room is displayed, and the abnormality notification 126A, for example, "The person being watched 126 is not moving. The room is hot. Please rush to the room" is displayed in a pop-up. This allows the family of the person being watched to recognize that the person being watched 126 is at risk of heat stroke, etc., and they can rush to the room and take the necessary measures.

[0106] Fig. 8B illustrates an example of an abnormality notification screen 44 displayed on the display screen of the display device 17 of the user terminal 60. Fig. 8B shows the content of the notification when, for example, the type 112 "pet" is selected as the monitoring target and a personal computer or smartphone owned by a pet owner is registered as the user terminal 60. It is assumed that the condition J21 is set for the abnormal movement / temperature pattern PT2.

[0107] When it is determined that the movement and temperature of the pet 127 measured by the movement and temperature measuring unit 130 and the temperature measuring unit 140, respectively, match the abnormal movement and temperature pattern PT2, the display screen of the display device 17 of the user side terminal 60 transitions to the abnormality notification screen 44, where the two-dimensional temperature distribution image 125 in the room is displayed, and an abnormality notification 127A, for example, "The pet 127 is urinating 127B more frequently. Please rush to the room." is displayed in a pop-up. This allows the pet owner to recognize that a health problem has occurred in the pet 127, and he or she can rush to the room and take the necessary measures.

[0108] Fig. 8C illustrates an example of an abnormality notification screen 45 displayed on the display screen of the display device 17 of the user terminal 60. Fig. 8C shows the content of the notification when, for example, type 113 "fire source" is selected as the monitoring target and the personal computer or smartphone owned by the room owner is registered as the user terminal 60. It is assumed that condition J31 is set for abnormal behavior / temperature pattern PT3.

[0109] When it is determined that the movement and temperature of the fire source 128 measured by the movement and movement measuring unit 130 and the temperature measuring unit 140, respectively, match the abnormal movement and temperature pattern PT3, the display screen of the display device 17 of the user side terminal 60 transitions to the abnormality notification screen 45, where the two-dimensional temperature distribution image 125 in the room is displayed, and an abnormality notification 128A, for example, "The fire source 128 has been left on. Please rush to the room" is displayed in a pop-up. This allows the owner of the room to recognize that a fire source 128 has been left on in the room, and he or she can rush to the room and take the necessary measures.

[0110] Fig. 8D illustrates an example of an abnormality notification screen 46 displayed on the display screen of the display device 17 of the user terminal 60. Fig. 8D shows the content of the notification when, for example, type 114 "infant in vehicle (bus)" is selected as the monitoring target and the personal computer or smartphone owned by the bus driver is registered as the user terminal 60. It is assumed that condition J41 is set for abnormal movement / temperature pattern PT4.

[0111] When it is determined that the movement and temperature of the infant 129 inside the vehicle (bus) measured by the movement measuring unit 130 and the temperature measuring unit 140, respectively, match the abnormal movement and temperature pattern PT4, the display screen of the display device 17 of the user side terminal 60 transitions to the abnormality notification screen 46, where the two-dimensional temperature distribution image 125 inside the bus is displayed, and an abnormality notification 129A, for example, "Infant 129 has been left behind in the bus. Please return to the bus" is displayed in a pop-up. This allows the bus driver to recognize that an infant has been left behind on the bus, and he or she can return to the bus and take necessary measures.

[0112] The above-described embodiment is merely an example, and various modifications are possible.

[0113] (Area setting)

[0114] A specific area where the monitoring target is located may be specified on the two-dimensional temperature distribution image 125, and the condition for an abnormal movement / temperature pattern may be determined to be that the monitoring target is outside the specific area.

[0115] For example, the location of the bed (bedding) of the person being monitored 126 can be designated as a specific area, and the condition J11 for the abnormal movement / temperature pattern PT1 can be set such that the person being monitored 126 is stationary outside the specific area (bed (bedding)).

[0116] In addition, the location of the toilet of the pet 127 can be specified as a specific area, and the fact that the pet 127 excretes (vomits) in a location outside the specific area (toilet) can be set as the condition J21 of the abnormal movement and temperature pattern PT2.

[0117] (Additional settings for monitoring)

[0118] It is also possible to set additional types of monitoring targets and perform abnormality determination and abnormality notification in a similar manner.

[0119] For example, it is possible to add the following types of monitoring objects 115, 116, and 117 and perform abnormality determination and abnormality notification in a similar manner. The types of monitoring objects 115, 116, and 117 may be added manually by a serviceman or a user, or may be previously incorporated in the abnormality notification system together with the types 111 to 114 so as to be selectable.

[0120] Category 115: Pet Location Monitoring

[0121] A specific area where a pet 127 always stays is set on a two-dimensional temperature distribution image 125, and when the pet 127 hides in a place outside the specific area, the hiding place is identified and the owner is notified of the pet's location.

[0122] Category 116: Cooking Recipe Monitoring

[0123] The heat temperature indicated in the cooking recipe (for example, a temperature corresponding to medium heat) is set, and if the temperature of the heat source (electric stove or gas stove) 128 deviates from the set temperature, the cook is notified that the temperature is not as specified in the cooking recipe.

[0124] Category 117: Monitoring of drivers or passengers in moving vehicles

[0125] As in the case where type 111 is selected, the driver's condition is monitored from the driver's body temperature while the vehicle is moving, and if an abnormality occurs with the driver, the labor manager is notified of the abnormality. Also, as in the case where type 111 is selected, the passenger's condition is monitored from the passenger's body temperature while the vehicle is moving, and if an abnormality occurs with a passenger, a medical institution such as a fire department or emergency hospital is notified of the abnormality with the passenger while the vehicle is moving. [Explanation of symbols]

[0126] 100 Abnormality Notification System 110 Monitoring target type selection section 120 Heat distribution image acquisition section 130 Movement Measurement Department 140 Temperature measurement section 150 Abnormal movement and temperature pattern setting section 160 Abnormality judgment section 170 Abnormality notification section

Claims

1. a monitoring target type selection unit for selecting a type of monitoring target in the monitoring target space; a thermal distribution image acquisition unit that acquires thermal distribution images in a monitored space in time series; a movement measurement unit that measures the movement of the monitoring target in a measurement mode corresponding to the type of the monitoring target selected by the monitoring target type selection unit based on the acquired thermal distribution image; a temperature measurement unit that measures the temperature of the monitoring target in a measurement mode corresponding to the type of the monitoring target selected by the monitoring target type selection unit based on the acquired thermal distribution image; an abnormal movement / temperature pattern setting unit that sets an abnormal movement / temperature pattern that is determined to be an abnormal movement and temperature pattern according to the type of the monitoring target selected by the monitoring target type selection unit; an abnormality determination unit that determines whether the movement and temperature of the monitoring target measured by the movement and temperature measurement unit and the temperature measurement unit, respectively, match the abnormal movement and temperature pattern corresponding to the type of the monitoring target; an abnormality notification unit that notifies a preregistered terminal that an abnormality has occurred in the monitored object when the abnormality determination unit determines that the movement and temperature of the monitored object match an abnormal movement and temperature pattern corresponding to the type of the monitored object; An abnormality notification system.

2. The abnormal movement / temperature pattern set by the abnormal movement / temperature pattern setting unit can be set manually. The abnormality notification system according to claim 1 .

Images