Danger detection system, danger detection method, and program

Abstract

A danger detection system according to the present invention includes a determination unit, an in-vehicle person detection unit, and a control unit. The determination unit determines whether the inside of a vehicle is in a dangerous state on the basis of information about the environment inside a parked vehicle and / or information about the environment outside the vehicle. When it is determined that the vehicle is in a dangerous state, the in-vehicle person detection unit detects a person in the vehicle from an image of the inside the vehicle. When a person is detected, the control unit performs at least one of: sending a notification to the outside the vehicle; unlocking the vehicle doors through an operation on the vehicle by a person authorized for the vehicle; and opening the vehicle windows through an operation by the authorized person.

Description

Danger detection system, danger detection method, and recording medium

[0001] The present disclosure relates to a hazard detection system in a vehicle.

[0002] For example, children and other vulnerable people may be left behind in cars, resulting in accidents such as heatstroke.

[0003] For example, Patent Document 1 describes that when the temperature inside the vehicle is equal to or higher than a reference value, the presence or absence of a living organism inside the vehicle is detected, and an alarm is issued if a living organism is present inside the vehicle. Also, for example, Patent Document 2 describes that based on the temperature inside the vehicle and the amount of carbon monoxide in the atmosphere inside the vehicle, it is determined whether the environment inside the vehicle is dangerous for a living organism left behind, and a warning alarm is issued to warn that a predetermined time has passed since a living organism was left inside the vehicle.

[0004] JP 2017-218032 A JP 2020-149487 A

[0005] Still, vulnerable people in vehicles may go unnoticed and be put at risk.

[0006] An example of an object of the present disclosure is to provide a danger detection system or the like that aims to avoid dangers that occur inside a vehicle.

[0007] A danger detection system in one aspect of the present disclosure includes a determination means for determining whether the inside of a parked vehicle is in a dangerous state based on at least one of information about the environment inside the vehicle and information about the environment outside the vehicle, an in-vehicle person detection means for detecting a person inside the vehicle from video footage of the inside of the vehicle when it is determined that the dangerous state is present, and a control means for performing at least one of the following when the person is detected: issuing an alert outside the vehicle, unlocking the vehicle doors by an authorized person operating the vehicle, and opening the vehicle windows by an authorized person operating the vehicle.

[0008] A danger detection system in one aspect of the present disclosure includes an in-vehicle person detection means for detecting a person inside a parked vehicle, a determination means for determining whether the inside of the vehicle is in a dangerous state based on the state of the person inside the vehicle, and a control means for performing at least one of the following when it is determined that the inside of the vehicle is in a dangerous state: issuing an alert outside the vehicle, unlocking the vehicle doors by an authorized person operating the vehicle, and opening the vehicle windows by an authorized person operating the vehicle.

[0009] A danger detection method in one aspect of the present disclosure determines whether the inside of a parked vehicle is in a dangerous state based on at least one of information about the environment inside the vehicle and information about the environment outside the vehicle, and if it is determined that the inside of the vehicle is in a dangerous state, detects a person inside the vehicle from video footage of the inside of the vehicle, and if the person is detected, performs at least one of alerting the outside of the vehicle, unlocking the vehicle doors by an authorized person operating the vehicle, and opening the vehicle windows by an authorized person operating the vehicle.

[0010] A danger detection method in one aspect of the present disclosure detects a person inside a parked vehicle, determines whether the inside of the vehicle is in a dangerous state based on the state of the person inside the vehicle, and if it is determined that the inside of the vehicle is in a dangerous state, performs at least one of alerting the outside of the vehicle, unlocking the vehicle doors by an authorized person operating the vehicle, and opening the vehicle windows by an authorized person operating the vehicle.

[0011] A program in one aspect of the present disclosure causes a computer to execute processing to determine whether the inside of a parked vehicle is in a dangerous state based on at least one of information about the environment inside the vehicle and information about the environment outside the vehicle, and if it is determined that the inside of the vehicle is in a dangerous state, detect a person inside the vehicle from video footage of the inside of the vehicle, and if the person is detected, perform at least one of alerting outside the vehicle, unlocking the vehicle doors by an authorized person operating the vehicle, and opening the vehicle windows by an authorized person operating the vehicle.

[0012] A program in one aspect of the present disclosure causes a computer to perform processing to detect a person inside a parked vehicle, determine whether the inside of the vehicle is in a dangerous state based on the state of the person inside the vehicle, and, if it is determined that the inside of the vehicle is in a dangerous state, perform at least one of the following: alerting the outside of the vehicle, unlocking the vehicle doors by an authorized person operating the vehicle, and opening the vehicle windows by an authorized person operating the vehicle.

[0013] Each program may be stored in a non-transitory computer-readable recording medium.

[0014] According to the present disclosure, dangers occurring inside a vehicle can be avoided.

[0015] 1 is a block diagram showing a configuration example of a danger detection system according to a first embodiment. FIG. 2 is an explanatory diagram showing a process flow for detecting a person after determining whether the inside of a vehicle is in a dangerous state. FIG. 3 is a flowchart showing an operation example 1 of the danger detection system according to the first embodiment. FIG. 4 is an explanatory diagram showing a process flow for determining whether the inside of a vehicle is in a dangerous state after detecting a person. FIG. 5 is a flowchart showing an operation example 2 of the danger detection system according to the first embodiment. FIG. 6 is an explanatory diagram showing an example of a connection between the danger detection system and other devices. FIG. 7 is a block diagram showing a configuration example of a danger detection system according to a second embodiment. FIG. 8 is an explanatory diagram showing an example of lighting of a lighting device. FIG. 9 is an explanatory diagram showing an example of a notification screen that the vehicle is in a dangerous state. FIG. 10 is an explanatory diagram showing an example of a face authentication screen. FIG. 11 is a flowchart showing an operation example 1 of the danger detection system according to the second embodiment. FIG. 12 is a flowchart showing an operation example 2 of the danger detection system according to the second embodiment. FIG. 13 is an explanatory diagram showing an example of the hardware configuration of a computer.

[0016] Hereinafter, embodiments of a danger detection system, a danger detection method, a program, and a non-transitory recording medium for recording the program according to the present disclosure will be described in detail with reference to the drawings. The disclosed technology is not limited to these embodiments.

[0017] (Embodiment 1) First, in embodiment 1, basic functions of a danger detection system will be described. Fig. 1 is a block diagram showing an example configuration of a danger detection system according to embodiment 1. The danger detection system 10 includes a determination unit 101, an in-vehicle person detection unit 102, and a control unit 103.

[0018] Next, two examples of basic functions of the danger detection system 10 will be given.

[0019] First, the basic function example 1 will be described.

[0020] 2 is an explanatory diagram showing the flow of processing for detecting a person after determining whether the inside of a vehicle is in a dangerous state. In basic function example 1, the determination unit 101 determines whether the inside of the vehicle is in a dangerous state, and if it is determined that the inside of the vehicle is in a dangerous state, the inside-vehicle person detection unit 102 detects a person inside the vehicle from the video inside the vehicle.

[0021] The determination unit 101 determines whether the inside of the vehicle is in a dangerous state based on at least one of information about the environment inside the parked vehicle and information about the environment outside the vehicle. "Parked" refers to a state in which the vehicle is stopped temporarily or continuously. The timing at which the determination unit 101 starts determining whether the inside of the vehicle is in a dangerous state is not particularly limited. For example, this timing may be from the time when the vehicle engine is stopped, or may be the time when a predetermined time has elapsed since the vehicle engine was stopped. Furthermore, the timing at which the determination starts may be the time when the driver leaves the vehicle, or may be the time when a predetermined time has elapsed since the driver left the vehicle.

[0022] Here, the information about the environment inside the vehicle and the information about the environment outside the vehicle are information about parameters that may affect the safety of people inside the vehicle, such as their health and lives. For example, the information about the environment inside the vehicle may be information representing at least one of temperature, humidity, carbon monoxide concentration, oxygen concentration, and carbon dioxide concentration. For example, the information about the environment outside the vehicle may be information representing at least one of weather, climate, temperature, humidity, brightness, and parking location. The parking location may be, for example, sunny or shady. Furthermore, the information about the environment outside the vehicle may be information about surrounding flooding due to flooding or the like. Furthermore, the information about the environment outside the vehicle may be information about fires in surrounding buildings or the like.

[0023] In describing a specific determination method, temperature will be used as an example of environmental information. The temperature may be either the temperature inside the vehicle or the temperature outside the vehicle. For example, if the inside of the vehicle is too hot, the determination unit 101 determines that the inside of the vehicle is in a dangerous state. More specifically, the determination unit 101 may determine whether the inside of the vehicle is in a dangerous state based on whether the temperature inside the vehicle is equal to or higher than a threshold. If the temperature inside the vehicle is equal to or higher than the threshold, the determination unit 101 determines that the inside of the vehicle is in a dangerous state, and if the temperature inside the vehicle is not equal to or higher than the threshold, the determination unit 101 determines that the inside of the vehicle is not in a dangerous state.

[0024] Alternatively, for example, if the interior of the vehicle is too cold, the determination unit 101 determines that the interior of the vehicle is in a dangerous state. More specifically, the determination unit 101 may determine whether the interior of the vehicle is in a dangerous state based on whether the temperature inside the vehicle is equal to or lower than a threshold. If the temperature inside the vehicle is equal to or lower than the threshold, the determination unit 101 determines that the interior of the vehicle is in a dangerous state, and if the temperature inside the vehicle is higher than the threshold, the determination unit 101 determines that the interior of the vehicle is not in a dangerous state.

[0025] When the information about the environment inside the vehicle is humidity, carbon monoxide concentration, oxygen concentration, and carbon dioxide concentration, as in the example of temperature, the judgment unit 101 can judge whether the state is dangerous by comparing the information about the environment inside the vehicle with a threshold value, and therefore detailed explanation will be omitted.

[0026] Furthermore, when the information on the environment outside the vehicle is weather, climate, temperature, or humidity, the judgment unit 101 can determine whether the situation is dangerous by comparing the information on the environment outside the vehicle with a threshold value, as with the information on the environment at the vehicle location, and therefore detailed explanations will be omitted.

[0027] Further, the location where the vehicle is parked will be taken as an example of information about the environment outside the vehicle. The determination unit 101 may determine whether the interior of the vehicle is in a dangerous state based on the information about the environment outside the vehicle, depending on whether the location where the vehicle is parked is in the shade or in the sun. Furthermore, for example, the determination unit 101 may determine that the interior of the vehicle is in a dangerous state if the vehicle is parked in the sun after a predetermined time has elapsed since the vehicle was parked.

[0028] Furthermore, if the information about the environment outside the vehicle is information about flooding in the surrounding area, the determination unit 101 may determine whether the inside of the vehicle is in a dangerous state based on the depth of the flooded water, the distance from the flooded location to the vehicle, etc. Specifically, for example, the determination unit 101 may determine that the deeper the flooded water is, the more dangerous the state. Alternatively, for example, the determination unit 101 may determine that the shorter the distance from the flooded location to the vehicle, the more dangerous the state.

[0029] Furthermore, when the information about the environment outside the vehicle is information about a fire in a surrounding building or the like, the determination unit 101 may determine whether the inside of the vehicle is in a dangerous state based on the size of the fire and the distance from the location of the fire to the vehicle. Specifically, for example, the determination unit 101 determines that the larger the size of the fire, the more dangerous the state. Alternatively, for example, the determination unit 101 determines that the shorter the distance from the location of the fire to the vehicle, the more dangerous the state.

[0030] Furthermore, the determination unit 101 may determine whether the inside of the vehicle is in a dangerous state based on the difference between the information on the environment inside the vehicle and the information on the environment outside the vehicle. For example, on a cold winter day, if the temperature difference between the inside and outside of the vehicle is too large, the inside of the vehicle may be dangerous.

[0031] When it is determined that a dangerous state exists, the in-vehicle person detection unit 102 detects a person inside the vehicle from the video of the inside of the vehicle. The video may be a single image or a plurality of images in time series. When it is determined that a dangerous state exists, the in-vehicle person detection unit 102 detects a person inside the vehicle from the video of the inside of the vehicle captured by the imaging device. Existing technology may be used as a method for detecting a person from the video.

[0032] When a person is detected inside the vehicle, the control unit 103 performs at least one of the following: issuing a warning to the outside of the vehicle, unlocking the vehicle doors, and opening the vehicle windows.

[0033] There are various methods for notifying the outside of the vehicle.

[0034] For example, the control unit 103 may control a device of the vehicle to notify the outside of the vehicle. Specifically, for example, the control unit 103 may operate the wipers of the vehicle to notify the outside of the vehicle. For example, the control unit 103 may turn on or flash a lighting device of the vehicle to notify the outside of the vehicle. The control unit 103 may sound the horn of the vehicle.

[0035] The control unit 103 also controls the lighting devices in the parking lot to light up or flash.

[0036] Furthermore, for example, the control unit 103 may issue a notification to another terminal device outside the vehicle. The other terminal device may be, for example, the driver's terminal device or the vehicle owner's terminal device. The other terminal device may also be the terminal device of the manager of the parking lot where the vehicle is parked. If the parking lot is a facility parking lot, the manager of the parking lot is the facility manager. For example, if the facility is a store, the terminal device may be the terminal device of a store clerk, a device for registering products and making payments, signage installed in the store, etc. This makes it easier for people outside the vehicle to notice abnormalities in the vehicle.

[0037] The other terminal device may be a device installed in a parking lot. The device installed in the parking lot may be a signage that guides people to the parking lot. Furthermore, if the parking lot requires payment, the device installed in the parking lot may be a machine for paying parking fees. The other terminal device may be a terminal device that manages video footage of the vehicle while it is traveling. This terminal device may be a terminal device of a company that manages an imaging device that captures video footage, or a terminal device of a company that manages video footage of the vehicle while it is traveling. For example, the company may be a vehicle insurance company or a security company. The other terminal device may also be a police terminal device. The other terminal device may also be a terminal device installed in another vehicle that can communicate with the vehicle determined to be in a dangerous state. In this case, the other vehicle is a vehicle that can communicate with the vehicle determined to be in a dangerous state. For example, the other terminal device may be a terminal device of a vehicle traveling near the vehicle determined to be in a dangerous state, or a terminal device of a vehicle parked nearby. The means of communication between the vehicle determined to be in a dangerous state and the other vehicle is not particularly limited, and may be a carrier line, wireless communication such as Wi-Fi (registered trademark), or short-range wireless communication such as Bluetooth (registered trademark).

[0038] The methods for notifying the outside of the vehicle may be used in combination.

[0039] For example, the vehicle doors may be unlocked by an operation performed by a person with authority over the vehicle. The authorized person may be a predetermined person such as the vehicle driver, the vehicle owner, a police officer, or a parking lot manager. Furthermore, the vehicle windows may be opened by an operation performed by a person with authority over the vehicle. For example, a police officer may have a pre-registered master key that can unlock the vehicle doors and open the windows. The control unit 103 then unlocks the doors and opens the windows in response to the police officer's operation. Furthermore, an example of an operation performed by an authorized person is biometric authentication. An example of biometric authentication will be described in detail in embodiment 2.

[0040] The determination method by the determination unit 101 and the control method by the control unit 103 may be combined. The determination method for determining whether the inside of the vehicle is in a dangerous state based on the difference between the information on the environment inside the vehicle and the information on the environment outside the vehicle may be combined with the notification method for opening the windows.

[0041] For example, in winter, snow accumulation may cause the driver to park the vehicle on the road with the heater on. In such cases, the snow accumulation may cause carbon monoxide poisoning inside the vehicle. Therefore, the determination unit 101 may determine whether the inside of the vehicle is in a dangerous state based on whether the difference (large temperature difference) between the information on the environment inside the vehicle and the information on the environment outside the vehicle is equal to or greater than a threshold and whether the elapsed time since the difference became equal to or greater than the threshold is equal to or greater than a predetermined time. Taking temperature as an example, when the temperature inside the vehicle is high and the temperature outside the vehicle is low, the determination unit 101 determines that the inside of the vehicle is in a dangerous state if the difference between the temperature inside the vehicle and the temperature outside the vehicle is equal to or greater than a threshold and the elapsed time since the difference became equal to or greater than the threshold is equal to or greater than a predetermined time. Then, the control unit 103 opens the window when a person is detected inside the vehicle. This can prevent carbon monoxide poisoning.

[0042] 3 is a flowchart showing a first operation example of the danger detection system 10 according to the first embodiment. First, the determination unit 101 determines whether the inside of the vehicle is in a dangerous state based on at least one of information on the environment inside the parked vehicle and information on the environment outside the vehicle (step S101). If it is determined that the inside of the vehicle is not in a dangerous state (step S101: No), the determination unit 101 returns to step S101. This makes it possible to monitor whether the inside of the vehicle is in a dangerous state.

[0043] Next, if it is determined that the vehicle is in a dangerous state (step S101: Yes), the vehicle interior person detection unit 102 detects a person inside the vehicle from the video of the vehicle interior (step S102). If a person inside the vehicle is detected, the control unit 103 performs at least one of an alarm, unlocking the doors, and opening the windows (step S103).

[0044] Note that step S101 may be repeated, for example, until the driver returns or until the vehicle departs.

[0045] As described above, in the first embodiment, the danger detection system 10 determines whether the inside of the vehicle is in a dangerous state, and if the inside of the vehicle is in a dangerous state, detects a person from the video, and if a person is detected, issues an alert, unlocks the doors, and opens the windows. This allows the system to notify the driver that a person has been left behind in the vehicle in a dangerous state, and to take initial emergency measures such as opening the windows or unlocking the doors to the person in the vehicle in a dangerous state before other people notice. This allows danger to be avoided.

[0046] Although the example in which the in-vehicle person detection unit 102 uses video to detect people has been described, information other than video may be used to detect people inside the vehicle. The in-vehicle person detection unit 202 may detect people inside the vehicle based on information acquired from, for example, a weight sensor, an acceleration sensor, or an infrared sensor installed in the vehicle. Alternatively, the in-vehicle person detection unit 102 may detect people inside the vehicle by using an imaging device in combination with these sensors.

[0047] Next, a second example of basic functions of the danger detection system 10 will be described.

[0048] 4 is an explanatory diagram showing the flow of processing for determining whether the inside of the vehicle is in a dangerous state after detecting a person. In basic function example 1, the determination unit 101 determines whether the inside of the vehicle is in a dangerous state, and if it is determined that the inside of the vehicle is in a dangerous state, the inside-vehicle person detection unit 102 detects a person inside the vehicle from the video inside the vehicle.

[0049] First, the vehicle interior person detection unit 102 detects a person inside the vehicle. As a method for detecting a person inside the vehicle, the vehicle interior person detection unit 102 may detect a person inside the vehicle from an image of the vehicle interior captured by an imaging device. The timing at which the vehicle interior person detection unit 102 starts detecting a person inside the vehicle is not particularly limited. For example, this timing may be when the vehicle engine is stopped, or when a predetermined time has elapsed since the vehicle engine was stopped. Furthermore, the timing at which the determination is started may be when the driver leaves the vehicle, or when a predetermined time has elapsed since the driver left the vehicle. Note that, as described in Basic Function Example 1, the vehicle interior person detection unit 102 may detect a person inside the vehicle using information other than an image.

[0050] Next, the determination unit 101 determines whether the inside of the vehicle is in a dangerous state based on the state of the person inside the vehicle. The state of the person inside the vehicle is represented by information such as the respiratory rate, body temperature, and heart rate of the person inside the vehicle. For example, the body temperature may be the surface temperature of the person obtained by an imaging device. The heart rate and respiratory rate may be obtained using short-range wireless communication from a wearable device worn by the person.

[0051] As a determination method, the determination unit 101 may determine that the inside of the vehicle is in a dangerous state if the person's body temperature is high. More specifically, for example, the determination unit 101 may determine that the inside of the vehicle is in a dangerous state if the person's body temperature is equal to or higher than a threshold. The threshold may be set for each person, or may be set according to attributes such as the person's age or gender. Furthermore, for example, the determination unit 101 may determine that the inside of the vehicle is in a dangerous state if the person's body temperature is low. More specifically, for example, the determination unit 101 may determine that the inside of the vehicle is in a dangerous state if the person's body temperature is equal to or lower than a threshold. Similarly, for the heart rate, the determination unit 101 may determine that the inside of the vehicle is in a dangerous state if the heart rate is too high or too low. Note that a specific determination method may involve comparing the person's heart rate with a threshold, as in the example of body temperature. Similarly, for the respiratory rate, the determination unit 101 may determine that the inside of the vehicle is in a dangerous state if the respiratory rate is too high or too low. As with the example of body temperature, a specific determination method may involve comparing the person's respiratory rate with a threshold value.

[0052] When a person is detected, the control unit 103 performs at least one of the following: issuing an alert to the outside of the vehicle, unlocking the vehicle doors, and opening the vehicle windows. Specific examples of the control unit 103 are the same as those in Functional Example 1, and therefore detailed descriptions thereof will be omitted.

[0053] 5 is a flowchart showing a second operation example of the danger detection system 10 according to the first embodiment. First, the vehicle-inside person detection unit 102 detects a person inside the vehicle (step S111). The determination unit 101 determines whether the inside of the vehicle is in a dangerous state based on the state of the person inside the vehicle (step S112). If the inside of the vehicle is not in a dangerous state (step S112: No), the control unit 103 returns to step S112. This makes it possible to monitor whether the inside of the vehicle is in a dangerous state.

[0054] If the inside of the vehicle is in a dangerous state (step S112: Yes), the control unit 103 performs at least one of the following actions: issuing an alarm, unlocking the doors, and opening the windows (step S113).

[0055] Note that step S112 may be repeated, for example, until the driver returns or until the vehicle departs.

[0056] As described above, in the first embodiment, the danger detection system 10 detects a person inside a vehicle, determines whether the vehicle is in a dangerous state based on the person's state, and if the vehicle is in a dangerous state, issues an alert, unlocks the doors, and opens the windows. This allows the system to notify the person that the vehicle is in a dangerous state and to take initial emergency measures, such as opening the windows or unlocking the doors, for the person in the vehicle in a dangerous state before other people notice. This allows danger to be avoided.

[0057] (Embodiment 2) Next, embodiment 2 will be described in detail with reference to the drawings. In embodiment 2, specific examples of notification, unlocking of doors, opening of windows, etc. will be described. Below, explanations of content that overlaps with the above explanation will be omitted to the extent that the explanation of embodiment 2 is not unclear.

[0058] 6 is an explanatory diagram showing an example of a connection between the danger detection system 20 and other devices. Here, an example will be described in which the danger detection system 20 is realized by an edge server in a vehicle. For this reason, it is assumed that the danger detection system 20 is installed in the vehicle.

[0059] For example, the danger detection system 20 is connected to various sensors such as an imaging device 22, a sound collection device 23, a temperature sensor 24, and an imaging device 25 via a communication network within the vehicle. The communication network is not particularly limited, as will be described later. The imaging device 22 captures images of the interior of the vehicle. The imaging device 25 captures images of the exterior of the vehicle. The sound collection device 23 collects sound from within the vehicle. The imaging device 22, the sound collection device 23, and the imaging device 25 may be combined into a single device. The temperature sensor 24 measures the temperature within the vehicle. The danger detection system 20 may be connected to other sensors, such as a sensor that measures humidity within the vehicle, a sensor that measures carbon monoxide concentration within the vehicle, a sensor that measures humidity outside the vehicle, and a sensor that measures temperature outside the vehicle.

[0060] In addition, the danger detection system 20 may be connected to a wearable device worn by a person in the vehicle via short-range wireless communication or the like.

[0061] The danger detection system 20 is also connected to an external terminal device 21 via a communication network or the like. The external terminal device 21 may be, for example, the terminal device 21 of the manager of the parking lot, the terminal device 21 of the driver, or the terminal device 21 of the police. For example, if the facility where the parking lot is located is a store, the manager of the parking lot may be a store clerk. The external terminal device 21 may also be a terminal device 21 installed in the parking lot. For example, if the parking lot is a paid parking lot, the terminal device 21 may be a machine for paying parking fees.

[0062] The terminal device 21 may be pre-installed with, for example, an application program capable of displaying notifications from the danger detection system 20 .

[0063] The type of the terminal device 21 is not particularly limited and may be a PC (Personal Computer), a tablet device, a smartphone, or various other devices.

[0064] Furthermore, in Figure 6, an example has been described in which the danger detection system 20 is realized by an edge server within a vehicle, but the danger detection system 20 may also be realized by an edge server within the vehicle and a server outside the vehicle, etc.

[0065] 7 is a block diagram showing an example of a configuration of a danger detection system 20 according to embodiment 2. The danger detection system 20 includes a determination unit 201, an in-vehicle person detection unit 202, a control unit 203, an acquisition unit 204, an authentication unit 205, and an outside-vehicle person detection unit 206.

[0066] The danger detection system 20 includes an acquisition unit 204, an authentication unit 205, and an outside-vehicle person detection unit 206 in addition to the components of the danger detection system 10 in the first embodiment. The determination unit 201 may have the function of the determination unit 101 described in the first embodiment as a basic function. The inside-vehicle person detection unit 202 may have the function of the inside-vehicle person detection unit 102 described in the first embodiment as a basic function. The control unit 203 may have the function of the control unit 103 described in the first embodiment as a basic function.

[0067] The danger detection system 20 may have a video DB 2001 , a vehicle interior environment DB 2002 , a vehicle exterior environment DB 2003 , a person state DB 2004 , and biometric information 2005 .

[0068] The video DB 2001 stores video of the inside of the vehicle captured by the imaging device 22. For example, the acquisition unit 204 acquires video from the imaging device 22 and stores the video in the video DB 2001. The video DB 2001 may also store video of the outside of the vehicle captured by the imaging device 25. The acquisition unit 204 acquires video of the outside of the vehicle from the imaging device 25 and stores the video in the video DB 2001.

[0069] The vehicle interior environment DB 2002 stores information about the environment inside the vehicle. The vehicle exterior environment DB 2003 stores information about the environment inside the vehicle. The person state DB 2004 stores information about the state of a person inside the vehicle. The information about the person's state is information such as the breathing rate, body temperature, and heart rate of the person inside the vehicle. The acquisition unit 204 acquires information from various sensors, etc., and stores the acquired information in either the vehicle interior environment DB 2002, the vehicle exterior environment DB 2003, or the person state DB 2004 depending on the type of information.

[0070] The biometric information 2005 is, for example, data used for biometric authentication. The type of biometric authentication is not particularly limited, and may be a fingerprint, iris, face, or the like. In the second embodiment, face authentication will be described as an example. The biometric information 2005 represents a feature amount of a face registered in advance.

[0071] Next, the determination unit 201 and the in-vehicle person detection unit 202 will be described.

[0072] As in basic function example 1 described in embodiment 1, the determination unit 201 may determine whether the inside of the vehicle is in a dangerous state based on environmental information, and the in-vehicle person detection unit 202 may detect a person inside the vehicle. For example, the determination unit 201 determines whether the inside of the vehicle is in a dangerous state based on at least one of information on the environment inside the vehicle stored in the in-vehicle environment DB 2002 and information on the environment outside the vehicle stored in the outside-vehicle environment DB 2003. The specific determination method is as described in embodiment 1. Then, if it is determined that the inside of the vehicle is in a dangerous state, the in-vehicle person detection unit 202 detects a person inside the vehicle from video of the vehicle inside the vehicle stored in the video DB 2001.

[0073] Furthermore, as in basic function example 2 described in embodiment 1, after the vehicle interior person detection unit 202 detects a person, the determination unit 201 determines whether the interior of the vehicle is in a dangerous state based on the state of the person inside the vehicle. For example, the vehicle interior person detection unit 202 detects a person inside the vehicle from a video of the vehicle interior contained in the video DB 2001. Then, for example, the determination unit 201 determines whether the person inside the vehicle is in a dangerous state based on information related to the state of the person contained in the person state DB 2004.

[0074] Note that the vehicle interior person detection unit 202 may detect a person inside the vehicle using information other than the video of the vehicle interior. For example, the vehicle interior person detection unit 202 may detect a person inside the vehicle based on information acquired from a weight sensor, an acceleration sensor, or an infrared sensor installed in the vehicle. Alternatively, the vehicle interior person detection unit 202 may detect a person inside the vehicle by using the imaging device 22 and these sensors in combination.

[0075] Next, a detailed description will be given of the control unit 203. The control unit 203 performs at least one of the following: issuing a notification to the outside of the vehicle, unlocking the vehicle doors, and opening the vehicle windows.

[0076] Examples of notification to the outside of the vehicle are as described in embodiment 1. Here, examples of notifying the terminal device 21, operating the windshield wipers, and turning on or blinking lighting devices installed in the parking lot will be described in detail.

[0077] First, a case where a notification is sent to the terminal device 21 will be described. An example of the terminal device 21 is as described above. Here, when notifying the terminal device 21, the control unit 203 may also notify the terminal device 21 with an image of the interior of the vehicle. This allows the status inside the vehicle to be visually confirmed. Furthermore, when notifying the terminal device 21, the control unit 203 may also notify the terminal device 21 with an image of the exterior of the vehicle. This makes it easier for other people who receive the notification, such as the driver or facility manager, to identify the parking location of the target vehicle. Furthermore, the control unit 203 may also notify environmental information, such as the temperature inside the vehicle. Furthermore, the control unit 203 may notify the time elapsed since the time when the vehicle is thought to have been abandoned. The time when the vehicle is thought to have been abandoned may be the time when the engine was turned off, the time when the vehicle doors were last locked, or the like.

[0078] The control unit 203 may operate the wipers of the vehicle to notify people outside the vehicle. This makes it easier for people outside the vehicle to notice something unusual inside the vehicle by spotting the vehicle with the wipers operating.

[0079] For example, operating the windshield wipers is useful when a person is outside the vehicle. Therefore, the outside-vehicle person detection unit 206 detects whether a person is near the vehicle. For example, the outside-vehicle person detection unit 206 detects whether a person is near the vehicle from video captured by the imaging device 25 capable of capturing images outside the vehicle. The imaging device 25 may be an imaging device that captures images outside the vehicle through the windshield of the vehicle, or an imaging device that captures images behind the vehicle. Here, the term "nearby" is not particularly limited as long as it is within the range that can be captured by the imaging device 25. The outside-vehicle person detection unit 206 may detect that a person is near the vehicle if a person is captured in the video. Then, the control unit 203 may activate the vehicle wipers when it detects that a person is near the vehicle. Note that the control unit 203 may combine a horn and operation of the windshield wipers to alert people outside the vehicle. This makes it easier for people outside the vehicle to notice something unusual about the vehicle.

[0080] Furthermore, the control unit 203 may, for example, turn on or blink a lighting device installed in the parking lot to alert people outside the vehicle so that the alert is easily identifiable. As an example of turning on or blinking a lighting device so that the alert is easily identifiable, the control unit 203 may turn on or blink a lighting device in a predetermined color. For example, the control unit 203 may turn on or blink a color different from the colors of other lighting devices. As an example of turning on or blinking a lighting device so that the alert is easily identifiable, the control unit 203 may blink a lighting device in a pattern different from the colors of other lighting devices.

[0081] Specifically, for example, the control unit 203 instructs the terminal device 21 of the parking lot manager to turn on or blink the lighting devices installed in the parking lot. When the terminal device 21 receives the instruction, it turns on or blinks the lighting devices. Note that there may be a mechanism that enables the control unit 203 to directly control the turning on and blinking of the lighting devices in an emergency.

[0082] FIG. 8 is an explanatory diagram showing an example of lighting of a lighting device. In FIG. 8, a lighting device is installed in each parking space in a parking lot. The control unit 203 turns on the lighting device where the vehicle is parked as a warning to people outside the vehicle. This makes it easier for people outside the vehicle to notice something unusual about the vehicle parked in the parking space where the lighting device is turned on.

[0083] Similarly to the example of operating the wipers, the outside-vehicle person detection unit 206 detects whether a person is near the vehicle. If a person is near the vehicle, the control unit 203 may turn on or flash a lighting device where the vehicle is parked as a warning to people outside the vehicle.

[0084] In this way, when the outside-vehicle person detection unit 206 detects that there is a person near the vehicle, the control unit 203 may issue some kind of notification.

[0085] Next, an example will be described in which the control unit 203 unlocks the vehicle doors or opens the vehicle windows. As described in the first embodiment, the control unit 203 may unlock the vehicle doors or open the vehicle windows in response to an operation by a person who has authority over the vehicle.

[0086] Here, an example will be described in which an authorized person performs biometric authentication, and the control unit 203 unlocks the vehicle doors or opens the vehicle windows if the person is authenticated.

[0087] The acquisition unit 204 acquires information about the face of a person outside the vehicle. The information about the face of the authorized person may be a facial image or facial feature values. The authentication unit 205 then compares the biometric information 2005 with the facial information to authenticate whether the person is authorized. If authenticated, the control unit 203 either unlocks the vehicle doors or opens the vehicle windows.

[0088] Here, examples of notification and authentication will be described in more detail with reference to the drawings. For example, the control unit 203 notifies the terminal device 21 of an authorized person that the vehicle is in a dangerous state and instructs the terminal device 21 to perform face authentication. Furthermore, for example, the control unit 203 may cause the terminal device 21 to display a current image of the person inside the vehicle.

[0089] 9 is an explanatory diagram showing an example of a notification screen indicating that the vehicle is in a dangerous state. In FIG. 9, the screen of the terminal device 21 displays a message indicating that the vehicle is in a dangerous state. Furthermore, the screen of the terminal device 21 displays a current image of a person inside the vehicle.

[0090] A face authentication button is provided on the screen of the terminal device 21. For example, when the face authentication button is tapped, the control unit 203 causes the terminal device 21 to perform face authentication.

[0091] 10 is an explanatory diagram showing an example of a screen for face authentication. For example, in FIG. 10, the screen of the terminal device 21 is a screen for performing face authentication. For example, the imaging device 22 of the terminal device 21 captures an image of a face captured within a frame on the screen. The terminal device 21 transmits facial features extracted from the captured facial image to the danger detection system 20.

[0092] The acquisition unit 204 acquires information about the person's face from the terminal device 21. Then, the authentication unit 205 compares the biometric information 2005 with the facial feature amount to authenticate whether the person is an authorized person. Next, the control unit 203 performs at least one of unlocking the door and opening the window if the person is authenticated as an authorized person.

[0093] The biometric authentication may be performed by the terminal device 21 .

[0094] Furthermore, the control unit 203 may control the air conditioning when a dangerous condition exists. For example, the control unit 203 may control the air conditioning to lower the temperature inside the vehicle when it is too hot. For example, the control unit 203 may control the air conditioning to raise the temperature inside the vehicle when it is too low. If the humidity is too high and the air conditioning is off, the control unit 203 may control the air conditioning to turn on.

[0095] <Control According to Security Level> For example, a security level may be set in advance for the vehicle. The security level represents the degree of security. The higher the security level, the more restrictions there are on controllable operations, and the lower the security level, the fewer restrictions there are on controllable operations. The control that the control unit 203 can perform may be determined in advance for each security level. When the state inside the vehicle is dangerous, the control unit 203 lowers the security level of the vehicle and performs control according to the security level. For example, the control unit 203 may perform control such that the security level of the vehicle becomes lower as the state inside the vehicle becomes more dangerous. Note that the method of expressing the security level is not particularly limited. For example, the control unit 203 performs at least one of issuing an alert to the outside of the vehicle, unlocking the doors, and opening the windows according to the security level.

[0096] For example, when the inside of the vehicle is not in a dangerous state, i.e., during normal times, the security level may be set high, and when the control unit 203 determines that the inside of the vehicle is in a dangerous state, the control unit 203 may lower the security level.

[0097] Take an example where there are three security levels: high, medium, and low. The control unit 203 may set the security level to high if the inside of the vehicle is not in a dangerous state, and may set the security level to medium or low if the inside of the vehicle is in a dangerous state.

[0098] Here, an example of control according to security level will be described. If the security level is high, the windows cannot be opened or the doors cannot be unlocked with any device other than the driver's vehicle key. For example, if the security level is medium, the control unit 203 allows the windows to be opened or the doors to be unlocked by an authorized person. For example, if the security level is low, the control unit 203 automatically opens the windows or unlocks the doors. In this way, the control unit 203 may perform control such that the lower the security level, the more operations can be accepted from someone other than the vehicle owner.

[0099] Another example of control according to security level will be described. If the security level is high, only the driver's vehicle key can open the windows or unlock the doors. For example, if the security level is medium, the control unit 203 allows the vehicle owner to open the windows or unlock the doors. For example, if the security level is low, the control unit 203 allows police officers to open the windows or unlock the doors.

[0100] For example, in determining whether a person inside the vehicle is in a dangerous state based on the body temperature of the person inside the vehicle, the determination unit 201 determines that the inside of the vehicle is in a dangerous state if the body temperature of the person inside the vehicle is 37.0 degrees Celsius or higher. If it is determined that the inside of the vehicle is in a dangerous state, the control unit 203 may set the security level to medium if the body temperature of the person inside the vehicle is 37.0 degrees Celsius, and may set the security level to low if the body temperature of the person inside the vehicle is 37.5 degrees Celsius.

[0101] Furthermore, the control unit 203 may change the security level depending on the amount of time that has elapsed since the state was determined to be dangerous. For example, the control unit 203 may lower the security level as the amount of time that has elapsed increases.

[0102] The security levels, the settings of the security levels depending on the state inside the vehicle, and the control contents are merely examples and are not particularly limited.

[0103] 11 is a flowchart showing a first operation example of the danger detection system 20 according to the second embodiment. First, the determination unit 201 determines the state inside the vehicle based on at least one of information about the environment inside the parked vehicle and information about the environment outside the vehicle (step S201). Then, the determination unit 201 determines whether the state is dangerous (step S202). If it is determined that the state is not dangerous (step S202: No), the determination unit 201 returns to step S201. This makes it possible to monitor whether the state inside the vehicle is dangerous.

[0104] Next, if it is determined that the vehicle is in a dangerous state (step S202: Yes), the vehicle interior person detection unit 202 detects a person inside the vehicle from the video of the vehicle interior (step S203). If a person inside the vehicle is detected, the control unit 203 performs at least one of issuing an alarm, unlocking the doors, and opening the windows, depending on the state inside the vehicle (step S204). In step S204, the control unit 203 lowers the security level depending on the state inside the vehicle and performs processing according to the security level.

[0105] Note that steps S201 and S202 may be repeated, for example, until the driver returns or until the vehicle departs.

[0106] 12 is a flowchart showing a second operation example of the danger detection system 20 according to the second embodiment. First, the detection unit detects a person inside the vehicle (step S211). The determination unit 201 determines the state inside the vehicle based on the state of the person inside the vehicle (step S212).

[0107] The determination unit 201 determines whether the interior of the vehicle is in a dangerous state (step S213). If the interior of the vehicle is not in a dangerous state (step S213: No), the control unit 203 returns to step S212. This makes it possible to monitor whether the interior of the vehicle is in a dangerous state.

[0108] If the inside of the vehicle is in a dangerous state (step S213: Yes), the control unit 203 performs at least one of the following actions depending on the state inside the vehicle: issuing an alert, unlocking the doors, and opening the windows (step S214). In step S214, the control unit 203 lowers the security level depending on the state inside the vehicle, and performs processing depending on the security level.

[0109] Note that steps S212 and S213 may be repeated, for example, until the driver returns or until the vehicle departs.

[0110] As described above, in the second embodiment, the operation by the authorized person may be a biometric authentication operation of a person outside the vehicle who is registered in advance. This makes it possible to avoid danger while maintaining security.

[0111] The danger detection system 20 may also activate the vehicle's windshield wipers to alert people outside the vehicle. However, the danger detection system 20 may also activate the vehicle's windshield wipers when there is a person near the vehicle. This makes it easier for people outside the vehicle to notice an abnormality inside the vehicle.

[0112] Furthermore, the danger detection system 20 controls lighting devices installed in the parking lot where the vehicle is parked so that the warning can be identified as a warning to people outside the vehicle, thereby making it easier for people outside the vehicle to notice abnormalities inside the vehicle.

[0113] The danger detection system 20 also notifies the outside of the vehicle, by sending a notification to a terminal device 21 at the facility that manages the parking lot where the vehicle is parked. This makes it easier for the facility manager, who is a person outside the vehicle, to notice an abnormality with the vehicle. Furthermore, this increases the likelihood that the manager will make the necessary arrangements, thereby further avoiding danger.

[0114] Furthermore, the danger detection system 20 notifies the outside of the vehicle by sending a notification to a terminal device 21 that manages the video images of the vehicle while it is traveling. This terminal device 21 may be the terminal device 21 of a company that manages the imaging device 25, or the terminal device of a company that manages the video images of the vehicle while it is traveling. This makes it easier for people outside the vehicle to notice abnormalities in the vehicle. Furthermore, this increases the likelihood that they will make the necessary arrangements, thereby making it possible to better avoid danger.

[0115] Furthermore, the danger detection system 20 may notify a terminal device installed in another vehicle that can communicate with the vehicle as a notification outside the vehicle. This makes it easier for people outside the vehicle to notice an abnormality in the vehicle. For example, if the danger detection system 20 notifies using short-range wireless communication as a communication means, people closer to the vehicle will be more likely to notice an abnormality in the vehicle.

[0116] The above is the explanation of each embodiment. The embodiments may be used in combination as appropriate.

[0117] Furthermore, the embodiments are not limited to the examples described above and may be modified in various ways. Furthermore, the configuration of the danger detection system 20 in each embodiment is not particularly limited. For example, the danger detection system 20 may be realized by a single device, such as a single server. When each functional unit of the danger detection system 20 is realized by a single device, the single device may be called, for example, a danger detection device, an information processing device, or the like, and is not particularly limited. Alternatively, the danger detection system 20 in each embodiment may be realized by different devices for different functions or data. For example, each functional unit may be configured by multiple servers and realized as the danger detection system 20. For example, some functional units of the danger detection system 20 may be realized by an edge server within the vehicle and other functional units may be realized by a server outside the vehicle. For example, the danger detection system 20 may be realized by a database server including each DB (database) and a server having each functional unit. For example, if the insurance company's database server has a video DB, the danger detection system 20 may send the captured video to the insurance company's database server, and when the video is used in each functional unit, the acquisition unit 204 may acquire the video from the insurance company's database server.

[0118] In each embodiment, each piece of information or each DB may include a portion of the information described above. Each piece of information or each DB may also include information other than the information described above. Each piece of information or each DB may be divided into multiple DBs or multiple pieces of information in more detail. Thus, the method for realizing each piece of information or each DB is not particularly limited.

[0119] Furthermore, each screen is merely an example and is not particularly limited. Buttons, lists, check boxes, information display fields, input fields, etc. (not shown) may be added to each screen. Furthermore, the background color of the screen may be changed.

[0120] Furthermore, the process of generating information to be displayed on the display device of the terminal device 21 may be performed by the control units 103 and 203. This process may also be performed by the terminal device 21.

[0121] (Example of Computer Hardware Configuration) Next, an example of a hardware configuration when each device, such as the danger detection systems 10 and 20 described in each embodiment, is implemented by a computer will be described. Fig. 13 is an explanatory diagram showing an example of a computer hardware configuration. For example, some or all of each device can be implemented using any combination of a computer 80 and a program as shown in Fig. 13.

[0122] The computer 80 includes, for example, a processor 801, a ROM (Read Only Memory) 802, a RAM (Random Access Memory) 803, and a storage device 804. The computer 80 also includes a communication interface 805 and an input / output interface 806. The components are connected to each other, for example, via a bus 807. The number of each component is not particularly limited, and there may be one or more of each component.

[0123] The processor 801 controls the entire computer 80. Examples of the processor 801 include a CPU (Central Processing Unit), a DSP (Digital Signal Processor), and a GPU (Graphics Processing Unit). The computer 80 includes a storage unit such as a ROM 802, a RAM 803, and a storage device 804. Examples of the storage device 804 include a semiconductor memory such as a flash memory, a hard disk drive (HDD), and a solid state drive (SSD). For example, the storage device 804 stores an operating system (OS) program, application programs, and programs according to the embodiments. Alternatively, the ROM 802 stores application programs and programs according to the embodiments. The RAM 803 is used as a work area for the processor 801 .

[0124] The processor 801 also loads programs stored in the storage device 804, ROM 802, etc. The processor 801 then executes each process coded in the program. The processor 801 may also download various programs via the communication network NT. The processor 801 also functions as a part or all of the computer 80. The processor 801 may then execute the processes or instructions in the illustrated flowchart based on the program.

[0125] The communication interface 805 is connected to a communication network NT such as a LAN (Local Area Network) or a WAN (Wide Area Network) via a wireless or wired communication line. The communication network NT may be composed of multiple communication networks NT. As a result, the computer 80 is connected to external devices and external computers 80 via the communication networks NT. The communication interface 805 serves as an interface between the communication network NT and the inside of the computer 80. The communication interface 805 also controls the input and output of data from external devices and external computers 80.

[0126] Furthermore, the input / output interface 806 is connected to at least one of an input device, an output device, and an input / output device. The connection method may be wireless or wired. Examples of the input device include a keyboard, a mouse, and a microphone. Examples of the output device include a display device, a lighting device, and an audio output device that outputs audio. Examples of the input / output device include a touch panel display. Note that the input device, output device, and input / output device may be built into the computer 80 or may be external.

[0127] The hardware configuration of the computer 80 is an example. The computer 80 may have some of the components shown in FIG. 13 . The computer 80 may have components other than those shown in FIG. 13 . For example, the computer 80 may have a drive device or the like. The processor 801 may then read programs and data stored on a recording medium attached to the drive device or the like into the RAM 803. Examples of non-transitory tangible recording media include optical disks, flexible disks, magneto-optical disks, and USB (Universal Serial Bus) memories. As described above, the computer 80 may have input devices such as a keyboard and a mouse. The computer 80 may have an output device such as a display. The computer 80 may also have an input device, an output device, and an input / output device.

[0128] The computer 80 may also include various sensors (not shown). The types of sensors are not particularly limited. The computer 80 may also include an imaging device capable of capturing images or videos.

[0129] This concludes the description of the hardware configuration of each device. There are various variations in the method of realizing each device. For example, each device may be realized by any combination of a different computer and program for each component. Furthermore, multiple components of each device may be realized by any combination of a single computer and program.

[0130] Furthermore, some or all of the components of each device may be realized by circuits for specific applications. Furthermore, some or all of the components of each device may be realized by general-purpose circuits including a processor such as an FPGA (Field Programmable Gate Array). Furthermore, some or all of the components of each device may be realized by a combination of circuits for specific applications and general-purpose circuits. Furthermore, these circuits may be a single integrated circuit. Alternatively, these circuits may be divided into multiple integrated circuits. The multiple integrated circuits may be connected via a bus or the like.

[0131] Furthermore, when some or all of the components of each device are realized by a plurality of computers, circuits, etc., the plurality of computers, circuits, etc. may be centrally located or distributed.

[0132] The danger detection method described in each embodiment is realized by being executed by a danger detection system. Also, for example, the danger detection method is realized by having a computer such as a server or a terminal device execute a prepared program.

[0133] The programs described in each embodiment are recorded on a computer-readable recording medium such as a HDD, SSD, flexible disk, optical disk, magneto-optical disk, or USB memory. The programs are then read from the recording medium and executed by a computer. The programs may also be distributed via a communication network NT.

[0134] The functions of each component of the danger detection system in each embodiment described above may be realized by dedicated hardware, such as a computer. Alternatively, each component may be realized by software. Alternatively, each component may be realized by a combination of hardware and software.

[0135] Although the present disclosure has been described above with reference to various embodiments, the present disclosure is not limited to the above embodiments. The configuration and details of each of the present disclosures may include embodiments to which various modifications that would be apparent to those skilled in the art are applied within the scope of the present disclosure. The present disclosure may also include embodiments in which the details described herein are appropriately combined or substituted as necessary. For example, details described using a particular embodiment may also be applied to other embodiments to the extent that no contradiction occurs. For example, although multiple operations are described in sequence in the form of a flowchart, the order of the descriptions does not limit the order in which the multiple operations are performed. Therefore, when implementing each embodiment, the order of the multiple operations may be changed as long as it does not interfere with the content.

[0136] Some or all of the above embodiments can be described as in the following supplementary notes. However, some or all of the above embodiments are not limited to the following. (0152) (Supplementary Note 1) A danger detection system comprising: a determination means for determining whether the interior of a parked vehicle is in a dangerous state based on at least one of information about the environment inside the vehicle and information about the environment outside the vehicle; an in-vehicle person detection means for detecting a person inside the vehicle from video of the vehicle when it is determined that the dangerous state exists; and a control means for performing at least one of the following when the person is detected: issuing an alert to the outside of the vehicle, unlocking the vehicle doors by an operation by a person with authority over the vehicle, and opening a window of the vehicle by an operation by the authorized person. (Supplementary Note 2) The danger detection system according to Supplementary Note 1, wherein the operation by the authorized person is a biometric authentication operation of a person outside the vehicle that has been registered in advance. (Supplementary Note 3) The danger detection system according to Supplementary Note 1 or 2, wherein the control means activates the windshield wipers of the vehicle as the alert to the outside of the vehicle. (Supplementary Note 4) The danger detection system according to Supplementary Note 3, further comprising: an outside-vehicle person detection means for detecting whether a person is near the vehicle, wherein the control means activates the windshield wipers of the vehicle when it detects that a person is near. (Supplementary Note 5) The danger detection system according to Supplementary Note 1, wherein the control means controls a lighting device installed in a parking lot where the vehicle is parked so that the notification to be sent to outside the vehicle is identifiable. (Supplementary Note 6) The danger detection system according to any of Supplements 1 to 5, wherein the control means sends the notification to a terminal device of a facility that manages the parking lot where the vehicle is parked, as the notification to be sent to outside the vehicle. (Supplementary Note 7) The danger detection system according to any of Supplements 1 to 6, wherein the control means sends the notification to a terminal device that manages video of the vehicle while it is traveling, as the notification to be sent to outside the vehicle. (Supplementary Note 8) The danger detection system according to any one of Supplements 1 to 7, wherein the control means notifies a terminal device provided in another vehicle that can communicate with the vehicle as the notification to the outside of the vehicle. (Supplementary Note 9) The danger detection system according to any one of Supplements 1 to 8, wherein the control means further controls air conditioning inside the vehicle.(Supplementary Note 10) The danger detection system according to any one of Supplements 1 to 9, wherein the control means lowers the security level of the vehicle when the interior of the vehicle is in the dangerous state, and performs control according to the security level. (Supplementary Note 11) The danger detection system according to Supplementary Note 10, wherein the control means performs control such that the more dangerous the state inside the vehicle is, the lower the security level becomes. (Supplementary Note 12) The danger detection system according to Supplementary Note 10 or 11, wherein the lower the security level is, the more operations can be accepted by persons other than the owner of the vehicle. (Supplementary Note 13) The danger detection system according to any one of Supplements 1 to 12, wherein the information on the environment inside the vehicle is at least one of temperature, humidity, carbon monoxide concentration, oxygen concentration, and carbon dioxide concentration, and the information on the environment outside the vehicle is at least one of temperature, humidity, brightness, and a parking position. (Supplementary Note 14) The danger detection system according to any one of Supplementary Notes 1 to 13, wherein the determination means determines whether the inside of the vehicle is in a dangerous state based on whether a difference between the information on the environment inside the vehicle and the information on the environment outside the vehicle is equal to or greater than a threshold and whether a predetermined time has elapsed since the difference became equal to or greater than the threshold, and the control means opens the window if the inside of the vehicle is in a dangerous state. (Supplementary Note 15) A danger detection system comprising: in-vehicle person detection means for detecting a person inside a parked or stopped vehicle; determination means for determining whether the inside of the vehicle is in a dangerous state based on the state of the person inside the vehicle; and control means for, when it is determined that the dangerous state exists, issuing an alert to the outside of the vehicle, unlocking the vehicle doors by an operation of a person with authority over the vehicle, and opening the vehicle windows by an operation of the person with authority. (Supplementary Note 16) The danger detection system according to Supplementary Note 15, wherein the state of the person inside the vehicle is at least one of the respiratory rate, body temperature, and heart rate of the person inside the vehicle. (Supplementary Note 17) The danger detection system according to Supplementary Note 15 or 16, wherein the operation by the authorized person is a biometric authentication operation of a person outside the vehicle who has been registered in advance.(Supplementary Note 18) The danger detection system according to any one of Supplements 15 to 17, wherein the control means activates the windshield wipers of the vehicle as the notification to outside the vehicle. (Supplementary Note 19) The danger detection system according to Supplementary Note 18, further comprising: outside-vehicle person detection means for detecting whether a person is in the vicinity of the vehicle, wherein the control means activates the windshield wipers of the vehicle when the presence of a person in the vicinity is detected. (Supplementary Note 20) The danger detection system according to any one of Supplements 15 to 19, wherein the control means controls a lighting device installed in a parking lot where the vehicle is parked as the notification to outside the vehicle so that the notification can be identified. (Supplementary Note 21) The danger detection system according to any one of Supplements 15 to 20, wherein the control means issues the notification to a terminal device of a facility that manages the parking lot where the vehicle is parked as the notification to outside the vehicle. (Supplementary Note 22) The danger detection system according to any one of Supplements 15 to 21, wherein the control means issues the notification to a terminal device that manages video of the vehicle while it is traveling, as the notification to outside the vehicle. (Supplementary Note 23) The danger detection system according to any one of Supplements 15 to 22, wherein the control means issues the notification to a terminal device provided in another vehicle that is capable of communicating with the vehicle, as the notification to outside the vehicle. (Supplementary Note 24) The danger detection system according to any one of Supplements 15 to 23, wherein the control means further controls air conditioning inside the vehicle. (Supplementary Note 25) The danger detection system according to any one of Supplements 15 to 24, wherein the control means lowers a security level of the vehicle when the inside of the vehicle is in the dangerous state, and performs control according to the security level. (Supplementary Note 26) The danger detection system according to Supplementary Note 25, wherein the control means performs control such that the security level becomes lower as the state inside the vehicle becomes more dangerous. (Supplementary Note 27) The danger detection system according to Supplementary Note 25 or 26, wherein the control means performs control such that the lower the security level, the more operations from persons other than the owner of the vehicle can be accepted.(Supplementary Note 28) A danger detection method which determines whether the inside of a parked or stopped vehicle is in a dangerous state based on at least one of information about the environment inside the vehicle and information about the environment outside the vehicle, and if it is determined that the inside of the vehicle is in a dangerous state, detects a person inside the vehicle from video footage of the inside of the vehicle, and if it is determined that the person is in a dangerous state, performs at least one of notifying the outside of the vehicle, unlocking the doors of the vehicle by an operation by a person who has authority over the vehicle, and opening a window of the vehicle by an operation by the person who has authority over the vehicle. (Supplementary Note 29) A danger detection method which detects a person inside a parked or stopped vehicle, and determines whether the inside of the vehicle is in a dangerous state based on the state of the person inside the vehicle, and if it is determined that the inside of the vehicle is in a dangerous state, performs at least one of notifying the outside of the vehicle, unlocking the doors of the vehicle by an operation by a person who has authority over the vehicle, and opening a window of the vehicle by an operation by the person who has authority over the vehicle. (Supplementary Note 30) A non-transitory computer-readable recording medium having recorded thereon a program that causes a computer to execute the following processes: determine whether the inside of a parked or stopped vehicle is in a dangerous state based on at least one of information about the environment inside the vehicle and information about the environment outside the vehicle; if it is determined that the inside of the vehicle is in a dangerous state, detect a person inside the vehicle from video footage of the inside of the vehicle; if it is determined that the person is in a dangerous state, issue a warning to the outside of the vehicle, unlock the doors of the vehicle by an operation by a person who has authority over the vehicle, and open a window of the vehicle by an operation by the person who has authority over the vehicle. (Supplementary Note 31) A non-transitory computer-readable recording medium having recorded thereon a program that causes a computer to execute the following processes: detect a person inside a parked or stopped vehicle, determine whether the inside of the vehicle is in a dangerous state based on the state of the person inside the vehicle, and if it is determined that the inside of the vehicle is in a dangerous state, issue a warning to the outside of the vehicle, unlock the doors of the vehicle by an operation by a person who has authority over the vehicle, and open a window of the vehicle by an operation by the person who has authority over the vehicle.(Supplementary Note 32) A program that causes a computer to execute the following processes: determine whether the inside of a parked vehicle is in a dangerous state based on at least one of information about the environment inside the vehicle and information about the environment outside the vehicle, and if it is determined that the inside of the vehicle is in a dangerous state, detect a person inside the vehicle from video of the inside of the vehicle, and if it is determined that the person is in a dangerous state, perform at least one of: notifying the outside of the vehicle, unlocking the doors of the vehicle by an operation by a person who has authority over the vehicle, and opening a window of the vehicle by an operation by the person who has authority over the vehicle. (Supplementary Note 33) A program that causes a computer to execute the following processes: detect a person inside a parked vehicle, determine whether the inside of the vehicle is in a dangerous state based on the state of the person inside the vehicle, and if it is determined that the inside of the vehicle is in a dangerous state, perform at least one of: notifying the outside of the vehicle, unlocking the doors of the vehicle by an operation by a person who has authority over the vehicle, and opening a window of the vehicle by an operation by the person who has authority over the vehicle.

[0137] 10, 20 Danger detection system 21 Terminal device 22 Imaging device 23 Sound collection device 24 Temperature sensor 25 Imaging device 80 Computer 101, 201 Determination unit 102, 202 In-vehicle person detection unit 103, 203 Control unit 204 Acquisition unit 205 Authentication unit 206 Out-of-vehicle person detection unit 801 Processor 802 ROM 803 RAM 804 Storage device 805 Communication interface 806 Input / output interface 807 Bus 2001 Video DB 2002 In-vehicle environment DB 2003 Out-vehicle environment DB 2004 Person state DB 2005 Biometric information NT Communication network

Claims

1. a determination means for determining whether an environment inside the parked vehicle is dangerous based on at least one of information about the environment inside the vehicle and information about the environment outside the vehicle; a vehicle interior person detection means for detecting a person inside the vehicle from the image of the vehicle interior determined to be in the dangerous state; a control means for performing at least one of the following based on the result of detecting the person inside the vehicle: issuing a warning to the outside of the vehicle; unlocking a door of the vehicle by an operation of a person having authority over the vehicle; and opening a window of the vehicle by an operation of the person having authority over the vehicle; A hazard detection system comprising:

2. The operation by the authorized person is a biometric authentication operation of a person outside the vehicle who has been registered in advance. The hazard detection system of claim 1 .

3. The control means operates wipers of the vehicle as the notification to the outside of the vehicle. The danger detection system according to claim 1 or 2.

4. an outside-vehicle person detection means for detecting whether a person is present in the vicinity of the vehicle; Equipped with The control means activates the wipers of the vehicle when it detects that a person is nearby. The hazard detection system according to claim 3 .

5. a vehicle person detection means for detecting a person in a parked vehicle; a determination means for determining whether the inside of the vehicle is in a dangerous state based on the state of the person inside the vehicle; a control means for, when it is determined that the vehicle is in a dangerous state, performing at least one of the following: issuing a warning to an outside of the vehicle; unlocking a door of the vehicle by an operation of a person having authority over the vehicle; and opening a window of the vehicle by an operation of the person having authority; A hazard detection system comprising:

6. The state of the person in the vehicle is at least one of the respiratory rate, body temperature, and heart rate of the person in the vehicle. The hazard detection system according to claim 5 .

7. A computer comprising: determining whether an environment inside the parked vehicle is dangerous based on at least one of information about the environment inside the parked vehicle and information about the environment outside the vehicle; Detecting a person inside the vehicle from the video of the vehicle inside which the dangerous state has been determined; Based on the result of detecting the person inside the vehicle, at least one of issuing a warning to the outside of the vehicle, unlocking a door of the vehicle by an operation of a person having authority over the vehicle, and opening a window of the vehicle by an operation of the person having authority. Hazard detection methods to perform processing.

8. A computer comprising: Detect people inside parked vehicles, determining whether the inside of the vehicle is in a dangerous state based on the state of the person inside the vehicle; When it is determined that the vehicle is in a dangerous state, at least one of the following is performed: issuing a warning to an outside of the vehicle; unlocking the doors of the vehicle by an operation of a person having authority over the vehicle; and opening the windows of the vehicle by an operation of the person having authority. Hazard detection methods to perform processing.

9. On the computer, determining whether an environment inside the parked vehicle is dangerous based on at least one of information about the environment inside the parked vehicle and information about the environment outside the vehicle; Detecting a person inside the vehicle from the video of the vehicle inside which the dangerous state has been determined; Based on the result of detecting the person inside the vehicle, at least one of issuing a warning to the outside of the vehicle, unlocking a door of the vehicle by an operation of a person having authority over the vehicle, and opening a window of the vehicle by an operation of the person having authority. A program that executes a process.

10. On the computer, Detect people inside parked vehicles, determining whether the inside of the vehicle is in a dangerous state based on the state of the person inside the vehicle; When it is determined that the vehicle is in a dangerous state, at least one of the following is performed: issuing a warning to an outside of the vehicle; unlocking the doors of the vehicle by an operation of a person having authority over the vehicle; and opening the windows of the vehicle by an operation of the person having authority. A program that executes a process.