Detection system and space utilization system

Abstract

An object of the present invention is to provide a detection system and a detection method that can detect with high accuracy the occurrence of a specific event in a predetermined space. [Solution] A detection system comprising at least one computer device, a first information acquisition means for acquiring first information from a specified space, a second information acquisition means for acquiring second information different from the first information from the specified space, and a condition determination means for determining whether the acquired first information and second information satisfy a specified condition indicating that a specific event has occurred in the specified space, wherein the first information is information relating to an image of the specified space, the second information is information relating to the temperature in the specified space, and the specific event is a state of dozing off by a person in the specified space or a sign of dozing off.

Description

[Technical field]

[0001] The present invention relates to a detection system and a detection method capable of detecting the occurrence of a specific event in a predetermined space, and also to a space utilization system and a space utilization method for granting a privilege to a user who uses the predetermined space. [Background technology]

[0002] Services for renting or sharing vehicles such as automobiles have been provided for some time now. These services have the advantage that a person can use a vehicle at any time without owning the vehicle.

[0003] In these car rental and car sharing services, vehicles are used by unspecified users, so if the previous user soils the interior of the vehicle without keeping it clean, the next user will not be able to use the same vehicle comfortably. To solve this problem, for example, an information processing system has been disclosed that acquires the odor intensity inside the vehicle and outputs information for requesting cleaning of the vehicle if the odor intensity is equal to or greater than a threshold value (see, for example, Patent Document 1).

[0004] Meanwhile, there are other devices capable of detecting the occurrence of a specific event using a sensor besides that described in Patent Document 1. For example, a monitoring system has been disclosed that, for the purpose of caring for a sick person, infant, or the like, acquires image data of a subject, acquires odor data around the subject, and determines the subject's condition level based on the image data and odor data (see, for example, Patent Document 2).

[0005] Although such a system has been disclosed, there are cases where the occurrence of a specific event in a specified space cannot be detected with high accuracy. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2020-189599 A [Patent Document 2] JP 2013-164684 A Summary of the Invention [Problem to be solved by the invention]

[0007] The present invention has been made to solve such problems. That is, a first object of the present invention is to provide a detection system and a detection method that are capable of detecting with high accuracy the occurrence of a specific event in a predetermined space.

[0008] A second object of the present invention is to provide a novel space utilization system and method for providing a privilege to a user who uses a specified space. [Means for solving the problem]

[0009] The object of the present invention is to [1] A detection system comprising at least one computer device, a first information acquisition means for acquiring first information from a predetermined space, a second information acquisition means for acquiring second information different from the first information from the predetermined space, and a condition determination means for determining whether the acquired first information and second information satisfy a predetermined condition indicating that a specific event has occurred in the predetermined space; [2] The detection system according to [1] above, wherein the condition determination means includes a first condition determination means for determining whether the acquired first information satisfies a predetermined first condition, and a second condition determination means for determining whether the acquired second information satisfies a predetermined second condition, and further, the condition determination means determines whether the predetermined condition is satisfied depending on whether the acquired first information satisfies the predetermined first condition and whether the acquired second information satisfies the predetermined second condition; [3] The detection system according to [1] or [2], wherein the first information is information about an image captured of a predetermined space, the second information is information about a temperature or a carbon dioxide concentration in the predetermined space, and the specific event is a state of a person in the predetermined space falling asleep or a sign of falling asleep; [4] A detection system according to [1] or [2], further comprising a third information acquisition means for acquiring third information different from the first information and the second information from the specified space, wherein a condition determination means determines whether the acquired first information, second information, and third information satisfy a specified condition indicating that a specific event has occurred in the specified space, wherein the first information is information on an image captured of the specified space, the second information is information on a thermal image of the specified space, the third information is information on the carbon dioxide concentration in the specified space, and the specific event is the presence of an item left behind in the specified space; [5] The detection system according to [1] or [2], wherein the first information is information relating to an image captured of a specified space, the second information is information relating to a thermal image in the specified space, and the specific event is the presence of a person in the specified space; [6] A third information acquisition means for acquiring third information different from the first information and the second information from the specified space, wherein the condition determination means determines whether the acquired first information, second information, and third information satisfy a predetermined condition indicating that a specific event has occurred in the specified space, and the first information is information about an image captured of the specified space, The detection system according to any one of [1] to [2], wherein the second information is information regarding a thermal image in the specified space, the third information is information regarding an odor in the specified space, and the specific event is the presence of an animal other than a human in the specified space; [7] The detection system according to [1] or [2], wherein the first information is information about an image captured of a specified space, the second information is information about a thermal image in the specified space, and the specific event is the presence of a heat emitter in the specified space; [8] The detection system according to [1] or [2], wherein the first information is information about an image captured of a specified space, the second information is information about an odor in the specified space, and the specific event is a person or animal vomiting in the specified space; [9] The detection system according to any one of [1] to [8], wherein the information for determining whether a condition indicating that a specific event has occurred in the specified space is satisfied includes information regarding a sound generated in the specified space;

[10] The detection system according to any one of [3] to [9], wherein the first condition determination means determines whether or not a predetermined first condition is satisfied based on a feature amount extracted from the captured image;

[11] The detection system according to any one of [1] to

[10] above, wherein the computer device is a server device capable of communicating with other computer devices, and the server device includes an event information transmission means for transmitting information indicating that a specific event has occurred to the other computer devices when the condition determination means determines that a predetermined condition is satisfied.

[12] A detection method executed in a detection system including at least one computer device, the detection method including: a first information acquisition step of acquiring first information from a predetermined space; a second information acquisition step of acquiring second information different from the first information from the predetermined space; and a condition determination step of determining whether the acquired first information and second information satisfy a predetermined condition indicating that a specific event has occurred in the predetermined space;

[13] A space utilization system for a user to utilize a specified space, comprising at least one computer device, the space utilization system comprising a selection means for selecting information to be actually acquired from information acquireable from an information acquisition device installed in the specified space when the user utilizes the specified space, or for selecting information to be subjected to calculations by the computer device from information acquireable from the information acquisition device installed in the specified space;

[14] The space utilization system according to

[13] , further comprising a specific granting means for granting a reward to a user who uses a specified space, the reward granting means granting different types and / or amounts of rewards depending on the selected information;

[15] The space utilization system according to

[14] , wherein the benefit can be utilized in connection with the user's use of a specified space;

[16] A space utilization method that is executed in a space utilization system that has at least one computer device and that enables a user to utilize a specified space, the space utilization method having a selection step of selecting information to be actually acquired when the user uses the specified space from among information that can be acquired from an information acquisition device installed in the specified space, or selecting information to be subject to calculation by the computer device from among the information that can be acquired from an information acquisition device installed in the specified space. Effect of the Invention

[0010] According to the present invention, it is possible to provide a detection system and a detection method capable of detecting with high accuracy the occurrence of a specific event in a specified space. According to the present invention, it is possible to provide a novel space utilization system and a space utilization method that provide a privilege to a user who uses a specified space. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram showing a configuration of a detection system according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a block diagram showing a configuration of a server device according to an embodiment of the present invention. [Diagram 3] FIG. 4 is a flowchart of a first detection process according to the embodiment of the present invention. [Figure 4] FIG. 11 is a flowchart of a second detection process according to the embodiment of the present invention. [Diagram 5] FIG. 11 is a flowchart showing a privilege granting process according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, the embodiments of the present invention will be described, but the present invention is not limited to the following embodiments as long as they are not contrary to the spirit of the present invention. The detection system of the present invention can detect the occurrence of a specific event in a predetermined space, but the predetermined space is not particularly limited. In the detection system and space utilization system of the present invention, the predetermined space can be, for example, a moving body, the periphery of the moving body, or the inside of the moving body. Hereinafter, the detection system and space utilization system of the present invention will be described mainly assuming a case where the detection system and space utilization system are used for car sharing or car rental services.

[0013] Examples of mobile objects include not only automobiles and other vehicles, but also aircraft such as drones, helicopters, airships, gliders, and jet planes, ships such as ferries and cargo ships, and vehicles used in public transportation such as buses and trains, and any other vehicles on which people can ride. In other words, the concept of a mobile object includes not only vehicles, but also the above-mentioned aircraft and ships.

[0014] 1 is a block diagram showing the configuration of a detection system and a space utilization system according to an embodiment of the present invention. As shown in the figure, the detection system is composed of a server device 1, an information acquisition device 3 provided in a vehicle 2, and a communication network 6. The server device 1 can be connected to other computer devices, that is, a user terminal 4 or an administrator terminal 5, via the communication network 6. The server device 1 will be described later.

[0015] The vehicle 2 is not particularly limited as long as it is a vehicle capable of moving on land, but is preferably one having wheels. The concept of the vehicle 2 includes not only bicycles, motorized bicycles, motorcycles, and automobiles, but also vehicles used for special purposes, such as construction vehicles used for construction purposes, such as dump trucks and bulldozers, industrial vehicles used for loading and transporting, such as forklifts, and agricultural vehicles used for agricultural purposes, such as tractors.

[0016] In one vehicle 2, the information acquisition device 3 is provided with at least a first information acquisition device 3a and a second information acquisition device 3b, but may be provided with three or more information acquisition devices, such as a third information acquisition device 3c, a fourth information acquisition device 3d, and a fifth information acquisition device 3e. The information acquisition device 3 may be provided with a plurality of devices of the same type (i.e., devices capable of acquiring the same information), or may be provided with a plurality of different types of devices.

[0017] The information acquisition device 3 is not particularly limited as long as it is capable of acquiring information about the surroundings of the information acquisition device 3. The information acquisition device 3 is capable of acquiring information about the vehicle 2, the surroundings of the vehicle 2, or the inside (inside) of the vehicle 2. Here, the information about the vehicle 2 is information about the whole or a part of the vehicle 2, and is a concept including, for example, information about parts and devices that constitute the vehicle, such as the tires and engine of the vehicle 2, or information about the vicinity thereof. The information about the surroundings of the vehicle 2 is information about the outside of the vehicle 2.

[0018] The space utilization system of the present invention acquires first information and second information different from the first information by an information acquisition device 3 from a vehicle 2, the periphery of the vehicle 2, or the inside of the vehicle 2, and determines whether the first information and the second information satisfy a predetermined condition indicating the occurrence of a specific event. More specifically, whether a specific event has occurred may be determined depending on whether the first information satisfies a predetermined first condition and whether the second information satisfies a predetermined second condition. Note that the first information and the second information may be acquired from the same information acquisition device 3, or the first information and the second information may be acquired from different information acquisition devices 3.

[0019] In addition, the space utilization system of the present invention may acquire the first information, the second information, and the third information from the vehicle 2, the periphery of the vehicle 2, or the inside of the vehicle 2 by the information acquisition device 3, and determine whether the first information, the second information, and the third information satisfy a predetermined condition indicating the occurrence of a specific event. More specifically, it may determine whether a specific event has occurred depending on whether the first information satisfies a predetermined first condition, whether the second information satisfies a predetermined second condition, and whether the third information satisfies a predetermined third condition. As described above, the first information, the second information, and the third information may be acquired from the same information acquisition device 3, or the first information, the second information, and the third information may be acquired from different information acquisition devices 3.

[0020] In the space utilization system of the present invention, the number of pieces of information to be used for determining whether a predetermined condition indicating the occurrence of a specific event is satisfied is not particularly limited as long as it is equal to or greater than 2. Whether a specific event has occurred may be determined depending on whether each of the pieces of information acquired from the information acquisition device 3 satisfies a condition set for each piece of information.

[0021] Examples of the information acquisition device 3 include a driver monitoring system (DMS) and an in-vehicle device. The DMS can detect whether the driver is in an appropriate state or not. The in-vehicle device can acquire location information from a GPS or the like and acceleration information from an acceleration sensor.

[0022] Other examples of the information acquisition device 3 include a gas sensor, an alcohol checker, a body temperature sensor, and a temperature sensor. The gas sensor can detect air pollution, the amount of carbon dioxide inside the vehicle 2, and the like. The alcohol checker can detect the alcohol concentration contained in the user's breath. The temperature sensor can measure the temperature inside the vehicle 2.

[0023] Moreover, the information acquisition device 3 may be an imaging device capable of capturing still or moving images. From the difference in image information of the interior of the vehicle 2 before use and during or after use, or by utilizing AI, it is possible to detect the presence or absence of dirt, the presence or absence of forgotten items, the presence or absence of vomiting or other behavior, the presence or absence of small children or the like left in the vehicle, etc. From the change over time in the image information acquired by the imaging device, it is possible to detect the movement of people, animals, etc.

[0024] The mounting position of the imaging device is not particularly limited, but for example, it can be mounted on the ceiling of the vehicle 2 to capture images of the state inside the vehicle 2. The imaging device can be placed in the center of the ceiling to capture images of all the states of the driver's seat, passenger seat, and rear seat, or multiple imaging devices can be placed above the driver's seat, passenger seat, and rear seat on the ceiling of the vehicle 2. Examples of imaging devices include an infrared camera and a 360-degree camera.

[0025] However, if a user covers the imaging device with tape or the like, it becomes impossible to accurately capture an image of the interior state of the vehicle 2. For example, it is possible to detect that the imaging device has been hidden by using the fact that the imaging device is no longer able to detect illuminance as a trigger. When it is detected that the imaging device has been hidden, it is possible to alert the user by issuing an alarm using audio output or illumination.

[0026] For example, as described below, in a car sharing service or rental car service, even if points are awarded to a user in accordance with the use of a vehicle 2, if the user sticks tape over the imaging device and it is detected that the imaging device has been hidden for a certain period of time or more, measures can be taken such as reducing the points awarded to the user or not awarding any points at all.

[0027] Furthermore, the information acquisition device 3 can also measure and acquire the air pressure and temperature inside the tire using a tire sensor installed in the tire (or in the vicinity of the tire) of the vehicle 2. It is also possible to estimate the presence or absence of a puncture based on the information acquired from the tire sensor. The information acquisition device 3 can also measure and acquire the engine RPM and temperature using an engine sensor installed in the engine (or in the vicinity of the engine) of the vehicle 2.

[0028] Another example of the information acquisition device 3 is a drive recorder. When a large impact is applied to the vehicle, such as when the vehicle collides with an obstacle and stops suddenly, the drive recorder can capture images and audio of the outside of the vehicle (the front or rear of the vehicle) for a period of several tens of seconds before and after the impact.

[0029] As the information acquisition device 3, not only the voice sensor provided in the drive recorder described above, but also a voice sensor installed separately from the drive recorder can be used. The voice sensor detects voice collected from a microphone provided in the vehicle 2. The voice sensor can detect and analyze voice within the vehicle 2. Voice analysis can improve the accuracy of determining whether an object present in the vehicle 2 is a person or an animal, or whether an object present in the vehicle 2 is a lost item or a person. Voice analysis also makes it possible to perform voice recognition to convert speech into text.

[0030] In addition, by combining image information captured by an imaging device with audio analysis, it is possible to estimate the presence or absence of danger or violence inside the vehicle 2. Furthermore, by combining location information from a position sensor such as a GPS, acceleration information from an acceleration sensor, and audio analysis, it is possible to detect accidents and near misses.

[0031] The vehicle 2 may be equipped with all or some of the DMS, GPS, acceleration sensor, gas sensor, breathalyzer, body temperature sensor, temperature sensor, imaging device, tire sensor, drive recorder, and sound sensor exemplified here as the information acquisition device 3. In addition, the information acquisition device 3 may be equipped with sensors and measuring devices other than those exemplified here.

[0032] Each of the information acquisition devices 3 has a wireless communication function, and the information acquired by the information acquisition devices 3 may be transmitted to the server device 1 via this communication function. Also, instead of each of the information acquisition devices 3 having a long-distance communication function, the information acquisition devices 3 may perform short-distance wireless or wired communication with a communication device provided in the vehicle 2, and the information acquired by each of the information acquisition devices 3 may be transmitted to the server device 1 via the communication device.

[0033] In addition, the information acquired by the information acquisition device 3 may be processed by a calculation device provided in the vehicle 2, and only the feature information may be transmitted to the server device 1. In addition, a threshold may be determined based on the feature information processed by the calculation device, and only information such as a pass / fail result may be transmitted to the server device 1. This prevents information identifying the user from being stored in the server device 1, allowing the user to use the vehicle with peace of mind without worrying about privacy. The information acquired by the information acquisition device 3, or the information processed by the calculation device based on this information, may be encrypted from the viewpoint of security before being transmitted to the server device 1.

[0034] In addition, the threshold values ​​required for various judgments in the computing device can also be rewritten via the cloud or by using remote communication means.

[0035] The information acquisition by the information acquisition device 3 may be performed periodically at predetermined time intervals. Also, the information acquisition by the information acquisition device 3 may be triggered by a predetermined operation on the vehicle 2 by the user (for example, unlocking the door, running the engine, etc.). The frequency and timing of information acquisition by the information acquisition device 3 may be the same for all information acquisition devices 3, or may be different depending on the type of information acquisition device 3.

[0036] When the vehicle 2 is used for a car sharing or car rental service, the information acquisition device 3 can be set to automatically acquire information only during the reservation period for which the user of the vehicle 2 has reserved use, a certain period immediately prior to the reservation period, and even a certain period immediately following the reservation period.

[0037] The detection system and space utilization system of the present invention include at least two or more information acquisition devices 3, and the combination thereof can be designed appropriately according to the phenomenon to be detected.

[0038] For example, when the engine is running, the driver's drowsy state or signs of drowsiness can be detected by combining image information of the driver acquired by the DMS with the carbon dioxide concentration inside the vehicle 2 and / or the temperature inside the vehicle 2 acquired by the gas sensor. More specifically, based on information on the driver's face image acquired by the DMS, the occurrence of yawning or continued closed eyes can be detected, and if the carbon dioxide concentration inside the vehicle 2 acquired by the gas sensor is equal to or higher than a threshold value and / or the temperature inside the vehicle 2 is equal to or higher than a predetermined temperature, the driver's drowsy state or signs of drowsiness can be detected. Note that whether the engine is running can be detected by the engine sensor (the same applies below).

[0039] In addition, when the engine is not running, the presence or absence of a left-behind item can be detected by combining image information from an imaging device in the vehicle 2 and image information related to a thermal image inside the vehicle 2 acquired by a thermal camera. More specifically, the image information captured when the engine of the vehicle 2 is not running is different from the image information of the initial state before the start of use of the vehicle 2, and the presence of an object that did not exist in the initial state is detected. Furthermore, the captured image information does not change over time, and the object is in a stationary state without movement is detected. Then, when the carbon dioxide concentration inside the vehicle 2 does not change over time and the body temperature of a living organism is not detected by the thermal image of the thermosensor, it is possible to detect that an object has been left behind. When the image information captured when the engine of the vehicle 2 is not running is used to detect the presence of an object that did not exist in the initial state, the analysis of the voice acquired by the voice sensor can be used to improve the accuracy of determining whether the object remaining in the vehicle 2 is a person or an animal, or a left-behind item.

[0040] Furthermore, when the engine is not running, it is possible to detect whether a child such as an infant has been left behind by combining image information of the inside of the vehicle 2 acquired by the imaging device with image information related to a thermal image of the inside of the vehicle 2 acquired by the thermal camera. More specifically, it is possible to detect the possibility of a child such as an infant being left behind when it is detected that the image information of the inside of the vehicle 2 acquired by the imaging device changes over time and the body temperature of a living being is detected by the thermal image of the thermosensor.

[0041] Furthermore, by combining image information of the inside of the vehicle 2 acquired by the imaging device, odors inside the vehicle 2 acquired by the gas sensor, and image information related to a thermal image inside the vehicle 2 acquired by the thermal camera, it is possible to detect the presence of an animal such as a pet. More specifically, when image information of the inside of the vehicle 2 acquired by the imaging device changes over time, it is detected that an object is in a moving state, the strength of the odor acquired by the gas sensor is equal to or greater than a threshold value (or is greater than the threshold value), and further, the body temperature of a living organism is detected by the thermal image of the thermosensor, it is possible to detect the presence of a non-human animal such as a pet. In this case, the accuracy of determining whether the living organism remaining in the vehicle 2 is a human or an animal such as a pet can be improved by utilizing an analysis of the sound acquired by the sound sensor.

[0042] Furthermore, by combining image information of the inside of the vehicle 2 acquired by the imaging device with thermal image information related to the thermal image of the inside of the vehicle 2 acquired by the thermal camera, it is possible to detect that a person with a fever is in the vehicle. More specifically, it is possible to detect the presence of movement from the image information of the inside of the vehicle 2 acquired by the imaging device, and further, when the body temperature of a living being detected by the thermal image of the thermosensor is equal to or higher than a predetermined body temperature, it is possible to detect the possibility that a person with a fever is in the vehicle. Furthermore, if AI or the like can detect coughing or sneezing actions or the generation of droplets associated with coughing or sneezing from the image information acquired by the imaging device, it is possible to detect that a person who is not feeling well is in the vehicle 2.

[0043] Furthermore, by combining image information of the inside of the vehicle 2 acquired by the imaging device with information on the odor inside the vehicle 2 acquired by the gas sensor, it is possible to detect that a person or animal has vomited. More specifically, it is possible to detect that the image information of the inside of the vehicle 2 acquired by the imaging device is different from the image information of the initial state before the user of the vehicle 2 starts using the vehicle 2 when there are no people or animals on board, and to detect that vomiting or other dirt has occurred when the odor intensity acquired by the gas sensor is equal to or greater than a threshold value. Furthermore, when utterances such as "I vomited," "I got dirty," or "I spilled something" are detected inside the vehicle 2 by voice recognition, it is possible to detect with high accuracy that cleaning is required.

[0044] The criteria and data thresholds for determining whether or not these specific events have occurred can be appropriately determined by the administrator who operates and manages the detection system and space utilization system (or the administrator of the car sharing or car rental service) after accumulating numerous demonstration experiments and operational records and reflecting user feedback. In addition, these demonstration experiments, operational records, user feedback, etc. can be used as training data for machine learning in AI (artificial intelligence), allowing the AI ​​to determine whether or not certain conditions are met and to identify appropriate thresholds.

[0045] 2 is a block diagram showing a configuration of a server device according to an embodiment of the present invention. The server device 1 includes at least a control unit 11, a RAM 12, a storage unit 13, and a communication interface 14, which are connected to each other via an internal bus.

[0046] The control unit 11 is composed of a CPU and a ROM, and executes programs stored in the storage unit 13 to control the server device 1. The control unit 11 also has an internal timer that measures time. The RAM 12 is a work area for the control unit 11. The storage unit 13 is a storage area for saving programs and data. The control unit 11 reads out the programs and data from the RAM 12, and performs program execution processing based on information received from the information acquisition device 3, etc.

[0047] The communication interface 14 can be connected to the communication network 3 wirelessly or via a wire, and can transmit and receive data to and from the server device 1 via the communication network 6. Data received via the communication interface 14 is loaded into the RAM 12, and the control unit 11 performs arithmetic processing on the data.

[0048] The user terminal 4 is a terminal operated by a user who uses the vehicle 2. The administrator terminal 5 is a terminal operated by an administrator who operates and manages the detection system and / or the space utilization system (or an administrator who operates and manages a car sharing or car rental service). When a specific event occurs in the vehicle 2, the server device 1 notifies the user terminal 4 and / or the administrator terminal 5 of information that the specific event has occurred. The user terminal 4 and / or the administrator terminal 5 are not particularly limited as long as they are computer devices having a display screen and an input unit, and examples of the user terminal 4 and / or the administrator terminal 5 include conventional mobile phones, tablet terminals, smartphones, and notebook personal computers. The user terminal 4 and / or the administrator terminal 5 can be connected to the communication network 6 wirelessly or by wire, and can transmit and receive data to and from the server device 1 via the communication network 6.

[0049] 3 is a diagram showing a flowchart of a first detection process according to an embodiment of the present invention. The first detection process is executed by a computing device provided in the server device 1 or the vehicle 2. The server device 1 or the computing device executes the following process based on information acquired by the information acquisition device 3. The following process is executed periodically at predetermined time intervals.

[0050] First, based on the face image data of the driver acquired by the DMS, it is determined whether the driver yawned within a predetermined time and whether the eyes are closed for a certain period of time (step S1). The determination of whether the driver yawned or the eyes are closed for a certain period of time is performed by using an AI trained by machine learning such as deep learning. If it is determined that neither the driver yawned nor the eyes are closed for a certain period of time (No in step S1), the fact that no problem has occurred in the vehicle 2 is registered as history information in the server device 1 or the computing device (step S2), and the first detection process ends. The history information is registered by associating the user who uses the vehicle 2 with an identifiable user ID and / or by associating the vehicle 2 with an identifiable vehicle ID. The same applies to the registration of the history information below.

[0051] On the other hand, if it is determined that yawning or continued closed-eyes state has occurred (Yes in step S1), it is determined whether the carbon dioxide concentration inside the vehicle 2 acquired by the gas sensor is equal to or higher than a threshold value (or higher than the threshold value) (step S3). Note that in step S3, it may also be determined whether the temperature inside the vehicle 2 acquired by the temperature sensor is equal to or higher than a threshold value (or higher than the threshold value) instead of the carbon dioxide concentration. It may also be determined whether both conditions, that the carbon dioxide concentration inside the vehicle 2 is equal to or higher than a threshold value and that the temperature inside the vehicle 2 is equal to or higher than a threshold value, are satisfied.

[0052] If the result of the determination in step S3 is No, the fact that no problem has occurred in the vehicle 2 is registered as history information in the server device 1 or the arithmetic device (step S4), and the first detection process ends.

[0053] On the other hand, if the determination in step S3 is Yes, the driver is dozing off or has signs of dozing off, and a message to that effect is transmitted to the user terminal 4 and / or the administrator terminal 5 (step S5). Then, the server device 1 or the computing device registers, as history information, that the driver of the vehicle 2 is dozing off or has signs of dozing off (step S6), and the first detection process ends.

[0054] 4 is a diagram showing a flowchart of a second detection process according to an embodiment of the present invention. The second detection process is executed by a calculation device provided in the server device 1 or the vehicle 2. The server device 1 or the calculation device executes the following process based on the information acquired by the information acquisition device 3. Note that the following process is executed periodically at predetermined time intervals while the vehicle 2 is being used by the user.

[0055] First, it is determined whether the engine is running based on information such as the engine speed acquired by the engine sensor (step S11). If the engine is not running (No in step S11), it is determined whether image information captured by the imaging device is different from image information in an initial state before the use of the vehicle 2 is started (step S12). Here, image information in the initial state refers to image information captured before the user starts using the vehicle 2 and in a state where no one is in the vehicle 2. For example, the image information in the initial state can be acquired by capturing an image of the inside of the vehicle 2 immediately after receiving a signal requesting the unlocking of the door of the vehicle 2 from the outside, which is used as a trigger.

[0056] In addition, for example, a background difference method can be used to determine whether the image information captured by the imaging device in step S12 is different from the image information of the initial state before the start of use of the vehicle 2. For example, this is a method of calculating the absolute value of the difference between the image information of the initial state and the image captured by the imaging device as a background image to obtain a difference image. If a difference image is obtained, it is known that the image captured by the imaging device is different from the image of the initial state. In addition to the background difference method, an edge detection method can also be used. By extracting contours from both the image of the initial state and the image captured by the imaging device using the edge detection method and comparing the contours extracted from each image, it is possible to determine whether the image information captured by the imaging device is different from the image information of the initial state before the start of use of the vehicle 2.

[0057] If it is determined that the image information captured by the imaging device is not different from, or is the same as, the image information in the initial state before the start of use of the vehicle 2 (No in step S12), it is determined whether the odor intensity acquired by the gas sensor is equal to or greater than the threshold value (step S13). If the odor intensity acquired by the gas sensor is less than the threshold value (No in step S13), a particular event has not occurred, and the fact that no problem has occurred in the vehicle 2 is registered as history information in the server device 1 or the computing device (step S14), and the second detection process ends.

[0058] If the odor intensity acquired by the gas sensor is equal to or greater than the threshold value (Yes in step S13), there is a possibility that soiling due to vomit or the like has occurred, and a message indicating that soiling due to vomit or the like has occurred inside the vehicle 2 is transmitted to the user terminal 4 and / or the administrator terminal 5 (step S15). Then, the message indicating that soiling due to vomit or the like has occurred in the vehicle 2 is registered as history information in the server device 1 or the computing device (step S16), and the second detection process ends.

[0059] If it is determined that the image information captured by the imaging device is different from the image information in the initial state before the start of use of the vehicle 2 (Yes in step S12), it is determined whether the image information captured by the imaging device has changed over time (step S17). The determination in step S17 can also use the background difference method or edge detection method, as in step S12.

[0060] If it is determined that the image information captured by the imaging device has not changed over time (No in step S17), it is determined whether or not the carbon dioxide concentration inside the vehicle 2 measured by the gas sensor has changed over time (step S18). If the carbon dioxide concentration inside the vehicle 2 has not changed over time (No in step S18), it is determined whether or not data corresponding to a predetermined temperature or higher is present in the thermal imaging data acquired by the thermal camera (step S19). Here, the predetermined temperature can be set appropriately, for example, 35°C. The body temperature of warm-blooded animals, including humans, is generally 35 to 43°C, and by setting the predetermined temperature in this manner, it is possible to detect the presence of many warm-blooded animals, including humans.

[0061] If there is no data corresponding to a temperature equal to or higher than the predetermined temperature in the thermal imaging data acquired by the thermo camera (No in step S19), it is highly likely that the user has left something behind in the vehicle 2, and a message to that effect is sent to the user terminal 4 and / or the administrator terminal 5 (step S20). Then, the server device 1 or the computing device registers as history information that the driver or passenger has left something behind in the vehicle 2 (step S21), and the second detection process ends.

[0062] If the thermal imaging data acquired from the thermo camera contains data corresponding to a temperature equal to or higher than the predetermined temperature (Yes in step S19), it is unlikely that a child such as an infant has been left behind in the vehicle 2, but some kind of trouble may have occurred, so a message indicating that there may be trouble is sent to the user terminal 4 and / or the administrator terminal 5 (step S22). Then, the server device 1 or the computing device in the vehicle 2 registers the information indicating that there may be trouble as history information (step S23), and the second detection process ends.

[0063] If it is determined that the image information captured by the imaging device has changed over time (Yes in step S17), or if the carbon dioxide concentration inside the vehicle 2 has changed over time (Yes in step S18), it is possible that a child such as an infant or a pet has been left behind inside the vehicle 2, and a message indicating that a child or a pet may have been left behind is sent to the user terminal 4 and / or the administrator terminal 5 (step S24). Then, the message indicating that a child may have been left behind in the vehicle 2 is registered as history information in the server device 1 or the computing device (step S25), and the second detection process ends. Note that, before sending a message indicating that a child or a pet may have been left behind to the user terminal 4 and / or the administrator terminal 5 in step S24, it may be possible to determine whether a child or a pet has been left behind by using the odor intensity acquired by the gas sensor.

[0064] Next, a case where the result of the judgment in step S11 is Yes will be described. It is judged whether or not the image information captured by the imaging device has changed over time (step S26). The judgment in step S26 can use the background difference method or the edge detection method, as in step S13. If it is judged that the image information captured by the imaging device has not changed over time (No in step S26), the fact that no problem has occurred in the vehicle 2 is registered as history information in the server device 1 or the computing device (step S27), and the second detection process is terminated.

[0065] If it is determined that the image information captured by the imaging device changes over time (Yes in step S26), it is determined whether or not there is data corresponding to a temperature equal to or higher than a predetermined temperature in the thermal imaging data acquired from the thermo camera (step S28). In step S28, 37°C can be set as the predetermined temperature. Many warm-blooded animals other than humans have body temperatures of 37°C or higher, and step S28 makes it possible to determine whether or not there is a possibility that a person or animal with a fever is present in the vehicle 2.

[0066] If there is no data in the thermal imaging data that corresponds to a temperature above the predetermined temperature (No in step S28), the presence of a person or animal with a fever cannot be confirmed inside the vehicle 2, and therefore the fact that no particular problem has occurred is registered as historical information in the server device 1 or the computing device (step S29), and the second detection process ends.

[0067] On the other hand, if the thermal imaging data contains data corresponding to a temperature equal to or higher than the predetermined temperature (Yes in step S28), it is determined whether the odor intensity acquired by the gas sensor is equal to or higher than the threshold (or is greater than the threshold) (step S30). If the odor intensity acquired by the gas sensor is less than the threshold (No in step S30), a message indicating that a person generating heat is present in the vehicle 2 is transmitted to the user terminal 4 and / or the administrator terminal 5 (step S31). Then, the message indicating that a person generating heat is present in the vehicle 2 is registered as history information in the server device 1 or the computing device (step S32), and the second detection process ends.

[0068] If the odor intensity acquired by the gas sensor is equal to or greater than the threshold value (Yes in step S30), a message indicating that a pet is in the vehicle 2 is transmitted to the user terminal 4 and / or the administrator terminal 5 (step S33). Then, the message indicating that a pet is in the vehicle 2 is registered as history information in the server device 1 or the computing device (step S34), and the second detection process ends.

[0069] In addition, the specified conditions in the detection system of the present invention may be determined by an administrator of the detection system and the determined conditions may be registered in the server device 1. However, the user may determine the conditions himself, input the conditions by operating the user terminal 4, and transmit the input conditions to the server device 1, thereby registering the conditions determined by the user in the server device 1.

[0070] Next, the space utilization system of the present invention will be described. In a car sharing service or rental car service in which the detection system and space utilization system of the present invention are introduced, a user can make a reservation for the use of a vehicle 2. When making a reservation for the use of the vehicle 2, the user can select which of the multiple information acquisition devices 3 provided in the vehicle 2 to permit to acquire information from. Alternatively, when making a reservation for the use of the vehicle 2, the user can select which of the multiple pieces of information acquired from the information acquisition device 3 provided in the vehicle 2 to be the subject of analysis in the server device 1 (for example, the subject of calculation in the above-mentioned first detection process or second detection process).

[0071] Many users have a psychological resistance to the acquisition and utilization of information on the vehicle 2. Therefore, in order to provide an incentive to users for utilizing the information on the vehicle 2, many points can be provided to users who have permitted the acquisition or utilization of information from the information acquisition device 3. In addition, among the information acquisition devices 3, there are some, such as imaging devices, that tend to cause a large psychological resistance when used. Therefore, the number of points provided to users can be changed depending on the type of information acquisition device 3, or points with different rarity or value can be provided to users, thereby encouraging the acquisition or utilization of information by such information acquisition device 3.

[0072] Next, the space utilization system of the present invention will be described. Fig. 5 is a diagram showing a flowchart of reservation processing in the space utilization system according to an embodiment of the present invention. A user who wishes to use a car sharing service or a rental car operates the user terminal 4 and accesses a predetermined website. A user ID and password are registered for each user, and the user logs in to the website by inputting the user ID and password into the user terminal 4 (step S41).

[0073] When the user logs in to the website and inputs conditions such as the date and time of use and the budget, information about multiple vehicles that can be reserved and match the conditions is transmitted from the Web server and displayed on the user terminal 4 (step S42). The vehicle information includes, for example, the vehicle type, the number of passengers that can ride, the cost, and an exterior image of the vehicle. The user can select one vehicle to reserve from the multiple vehicles by operating the user terminal 4 (step S43). Next, the user can select which information acquisition device is to be allowed to acquire or use information from among the multiple information acquisition devices provided in the vehicle when actually using the vehicle (step S44). Note that the concept of "selecting information" includes not only the selection of information such as image information captured by an imaging device and audio information captured by an audio sensor, but also the selection of an information acquisition device such as an imaging device or an audio device.

[0074] When the selection is completed in step S44, the points to be given to the user are calculated (step S45). The points given can be used to reduce the cost for the user to use the car sharing service or rental car service from the next time onwards, or to reserve preferentially over other users. Different types and / or amounts of points can be given depending on the selected information. The method of calculating the points can be set appropriately, but for example, the more information that is permitted to be used, the more points can be given. For example, points are determined for each piece of information that can be selected, and points are added according to the selected information. For information that has a high psychological resistance to use, such as image information acquired by an imaging device, more points can be given than for other information. Different types of points can also be given depending on the information that is permitted to be used.

[0075] Next, information regarding the confirmed reservation is registered in the server device 2 (step S46). The server device 2 records the date and time of vehicle use, the reserved vehicle, and the information permitted to be acquired in association with the user ID. The server device 2 also adds the points calculated in step S45 in association with the user ID. The reservation process is completed through the processes of steps S41 to S46.

[0076] In step S44, the user can operate the user terminal 4 to select from which information acquisition device 3 the acquisition or use of information is permitted, but the server device 1 can automatically select the information to actually be acquired or used by the information acquisition device 3. For example, the server device 1 can automatically select whether to permit the acquisition or use of information from the information acquisition device 3 according to the attributes of the user or information registered in advance by the user.

[0077] In the embodiment described above, when a user makes a reservation for the use of the vehicle 2, the user selects from which information acquisition device 3 the user is permitted to acquire or use information, but the user may be allowed to select from which information acquisition device 3 the user is permitted to acquire or use information at a time other than when the user makes a reservation for the use of the vehicle 2. For example, the user may be allowed to select from which information acquisition device 3 the user is permitted to acquire or use information immediately before, immediately after, or during the start of use of the vehicle 2.

[0078] In the above-described embodiment, the detection system and the space utilization system of the present invention are mainly applied to car sharing services and rental car services, but they can also be preferably used in car leasing services. Car leasing differs from car sharing in that the same user uses the same vehicle for a long period of time, and by using this detection system, the leasing company can grasp the deterioration state of the vehicle body. The leasing company can evaluate the vehicle using the information obtained from the detection system, and can present appropriate resale conditions for reselling the vehicle to the user when the user returns the vehicle.

[0079] In addition, the detection system and space utilization system of the present invention can detect the occurrence of a specific event in the space inside a moving body such as a vehicle. For example, the system can be used in any space, such as an ordinary home, a school, a hospital, an office, a factory, various stores, or public transportation.

[0080] According to the present invention, a system is provided with at least one computer device, and determines whether first information and second information acquired from a specified space satisfy specified conditions indicating the occurrence of a specific event, thereby enabling a more accurate determination than determining whether a specific event has occurred based on information obtained from a single sensor, etc.

[0081] According to the present invention, whether or not a specified condition is satisfied is determined depending on whether or not the acquired first information satisfies a specified first condition, and whether or not the acquired second information satisfies a specified second condition, so that it is possible to determine with greater accuracy whether or not a specified event has occurred in a specified space.

[0082] According to the present invention, the first information is information relating to an image captured of a specified space, and the second information is information relating to the temperature or carbon dioxide concentration in the specified space, making it possible to detect whether a person in the specified space is dozing off, or signs of dozing off.

[0083] According to the present invention, the first information is information relating to an image captured of a specified space, the second information is information relating to a thermal image of the specified space, and the third information is information relating to the carbon dioxide concentration in the specified space, thereby making it possible to detect the presence of an item left behind in a specified space.

[0084] According to the present invention, the first information is information relating to an image captured of a specified space, and the second information is information relating to a thermal image of the specified space, thereby making it possible to detect the presence of a person in the specified space.

[0085] According to the present invention, the first information is information relating to an image captured of a specified space, the second information is information relating to a thermal image of the specified space, and the third information is information relating to odors in the specified space, thereby making it possible to detect the presence of an animal other than a human within the specified space.

[0086] According to the present invention, the first information is information relating to an image captured of a specified space, and the second information is information relating to a thermal image of the specified space, making it possible to detect the presence of a fever generator within the specified space.

[0087] According to the present invention, the first information is information relating to an image captured of a specified space, and the second information is information relating to an odor in the specified space, making it possible to detect that a person or animal has vomited in the specified space.

[0088] According to the present invention, by including information regarding a sound generated in a specified space as information for determining whether a condition indicating that a specific event has occurred in a specified space is satisfied, it is possible to determine with greater accuracy whether a specified event has occurred.

[0089] According to the present invention, a determination is made as to whether or not the first information satisfies a predetermined first condition based on features extracted from a captured image, so that it is possible to determine with greater accuracy whether or not a predetermined event has occurred in a predetermined space.

[0090] According to the present invention, a user terminal operated by a user who uses a specified space and a server device capable of communication connection with the user terminal are provided, and when it is determined that a specified condition is satisfied, a message is sent to the user terminal indicating that a specific event has occurred, so that the user can be notified that a specific event has occurred. Also, according to the present invention, a manager terminal that operates and manages the detection system and a server device capable of communication connection with the manager terminal are provided, and when it is determined that a specified condition is satisfied, a message is sent to the manager terminal indicating that a specific event has occurred, so that the manager / operator can be notified that a specific event has occurred.

[0091] According to the present invention, when a user uses a specific space, from among the information obtainable from an information acquisition device installed in the specific space, the user can select the information to actually obtain, or from among the information obtainable from an information acquisition device installed in the specific space, the user can select the information to be calculated by a computer device. Therefore, depending on the user using the specific space, or even for the same user, it is possible to select which information acquisition device to use to obtain information, or which information obtained from the information acquisition device to use, each time the user uses the specific space.

[0092] According to the present invention, when granting benefits to users who use a specified space, different types and / or amounts of benefits are granted depending on the information selected, thereby providing users with an incentive to have more of the information in the specified space available to the administrator, or to have information that the user does not actively wish to have available to the administrator available to the administrator.

[0093] According to the present invention, the benefit can be utilized in connection with the user's use of a specified space, thereby encouraging the user to use the specified space. [Explanation of symbols]

[0094] 1 server device, 2 vehicle, 3 information acquisition device, 4 user terminal, 5 Administrator terminal, 6 Communication network, 11 Control unit, 12 RAM, 13 storage unit, 14 communication interface

Claims

1. A server device capable of communicating with other computer devices, A first information acquisition means for acquiring first information from a predetermined space; A second information acquisition means for acquiring second information different from the first information from the predetermined space; a condition determination means for determining whether or not the acquired first information and second information satisfy a predetermined condition indicating that a specific event has occurred in a predetermined space; Equipped with A server device, an event information transmission means for transmitting information indicating that a specific event has occurred to a user terminal operated by a user or an administrator terminal operated by an administrator when the condition determination means determines that a predetermined condition is satisfied; Equipped with The condition determination means is a first condition determination means for determining whether the acquired first information satisfies a predetermined first condition; a second condition determination means for determining whether the acquired second information satisfies a predetermined second condition; Equipped with Furthermore, the condition determination means whether or not a predetermined condition is satisfied is determined based on whether or not a predetermined first condition is satisfied and whether or not a predetermined second condition is satisfied; The first information is information about an image captured of a predetermined space, The second information is information related to a temperature of a predetermined space, A detection system in which a specific event indicates that a person in a given space is dozing off or is a sign of dozing off.

2. The detection system according to claim 1 , wherein the information for determining whether a condition indicating that a specific event has occurred in the specified space is satisfied includes information regarding a sound generated in the specified space.

3. The first condition determination means, The detection system according to claim 1 , further comprising: a determination as to whether or not a predetermined first condition is satisfied based on a feature amount extracted from a captured image.

4. A server device, an event information storage means for storing information indicating that a specific event has occurred when the condition determination means determines that a predetermined condition is satisfied; The detection system according to any one of claims 1 to 3, comprising:

5. 1. A detection method executed in a detection system including a server device communicatively connected to another computer device, comprising: a first information acquisition step of acquiring first information from a predetermined space; a second information acquisition step of acquiring second information different from the first information from the predetermined space; a condition determination step of determining whether or not the acquired first information and second information satisfy a predetermined condition indicating that a specific event has occurred in a predetermined space; an event information transmission step in which, when it is determined that the predetermined condition is satisfied by the condition determination step, the server device transmits information indicating that a specific event has occurred to a user terminal operated by a user or an administrator terminal operated by an administrator; having The condition determination step is a first condition determination step of determining whether or not the acquired first information satisfies a predetermined first condition; a second condition determination step of determining whether or not the acquired second information satisfies a predetermined second condition; having Furthermore, the condition determination step whether or not a predetermined condition is satisfied is determined based on whether or not a predetermined first condition is satisfied and whether or not a predetermined second condition is satisfied; The first information is information about an image captured of a predetermined space, The second information is information related to a temperature of a predetermined space, A detection method in which a specific event is a state in which a person in a specified space is dozing off, or a sign of dozing off.

Images