Information processing device and program

Abstract

To provide an information processing device and a program to determine accident occurrence using sensors that estimate biological information of passengers.SOLUTION: An information processing device (1) includes: an acquisition unit (100) that acquires a detection signal from a sensor (20) detecting vibrations transmitted from an occupant to a seat; an estimation unit (101) that estimates biological information of the occupant based on the detected signal; and a determination unit (102) that determines whether or not a mobile body has been involved in a collision accident based on the detected signal.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device and a program. [Background technology]

[0002] Patent Document 1 discloses an emergency notification device for a vehicle that determines that a serious vehicle accident has occurred when the acceleration value detected by an acceleration sensor exceeds a predetermined threshold value, and transmits occupant seating information detected by an occupant detection sensor to a management center. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-30481 Summary of the Invention [Problem to be solved by the invention]

[0004] The vehicle emergency notification device of Patent Document 1 uses separate sensors to determine whether an accident has occurred and to determine the state of the occupants. One aspect of the present disclosure aims to provide an information processing device that can determine whether an accident has occurred using a sensor that is used to estimate the biometric information of the occupants. [Means for solving the problem]

[0005] In order to solve the above problems, an information processing device according to one aspect of the present disclosure includes an acquisition unit that acquires a detection signal from a sensor disposed in a seat of a moving body and that detects vibrations transmitted to the seat from an occupant seated in the seat, an estimation unit that estimates biometric information of the occupant, including at least one of the occupant's heart rate and breathing, based on the detection signal acquired by the acquisition unit, and a determination unit that determines whether the moving body has been involved in a collision accident, based on the detection signal acquired by the acquisition unit.

[0006] The information processing device according to each aspect of the present disclosure may be realized by a computer. In this case, the information processing device program that causes the computer to operate as each part (software element) of the information processing device to realize the information processing device on the computer, and the computer-readable recording medium on which the program is recorded, also fall within the scope of the present disclosure. [Effects of the Invention]

[0007] According to one aspect of the present disclosure, the occurrence of an accident can be determined using a sensor used to estimate the biological information of an occupant. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of an internal structure of a moving body equipped with an information processing device according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a diagram used to explain the arrangement position of a sensor. [Figure 3] FIG. 1 is a diagram illustrating an example of a configuration of an information processing device according to an embodiment of the present disclosure. [Figure 4] 4 is a diagram used to explain the processing of the determination unit in FIG. 3. [Figure 5] 10 is a flowchart illustrating a flow of processing of an information processing device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0009] FIG. 1 is a diagram illustrating an example of the internal structure of a vehicle equipped with an information processing device according to an embodiment of the present disclosure. Hereinafter, the front-rear direction and the left-right direction will be defined as indicated by the arrows in FIG. 1. The vehicle 200 illustrated in FIG. 1 is an automobile, and is equipped with seats 2A, 2B, and 2C in the vehicle interior where passengers can sit. Seat 2A is the driver's seat of the vehicle 200, seat 2B is the passenger seat of the vehicle 200, and seat 2C is the rear seat of the vehicle 200, and two passengers can be seated therein.

[0010] The information processing device 1 is mounted on a moving object 200. The information processing device 1 is placed in a position where it is less susceptible to the effects of accidents such as collisions. In FIG. 1, the information processing device 1 is placed under a seat 2C.

[0011] In seats 2A, 2B, and 2C shown in Fig. 1, a sensor 20 and a seating detection unit 21 are disposed at each seating position. In seats 2A and 2B, a sensor 20 is disposed to the left of the center of the seat surface, and one seating detection unit 21 is disposed at the position of the seat belt buckle. In seat 2C, which has two seating positions, one sensor 20 is disposed at the left of the center of the seat surface at each seating position. In addition, in seat 2C, one seating detection unit 21 is disposed at the position of the seat belt buckle for each seating position.

[0012] The sensor 20 detects vibrations transmitted from a seated occupant to the seat and outputs a detection signal corresponding to the detected vibrations. For example, the sensor 20 is a piezoelectric sensor that detects ballistocardiograms of the seated occupant.

[0013] The seat belt wearing detection unit 21 detects that the occupant is wearing a seat belt. For example, the seat belt wearing detection unit 21 detects that the occupant is wearing a seat belt when the tongue of the seat belt is inserted into the buckle of the seat belt.

[0014] Fig. 2 is a diagram used to explain the placement position of the sensor. As shown in Fig. 2, sensor 20 is placed on the seat surface of seat 2A, and is located near ischial tuberosities 30 of occupant P seated in seat 2A. By placing sensor 20 on the seat surface, if moving body 200 is involved in a collision accident, even if occupant P leans forward due to inertial force, vibrations transmitted from the occupant to the seat can be detected.

[0015] FIG. 3 is a diagram illustrating an example configuration of an information processing device according to an embodiment of the present disclosure. As illustrated in FIG. 3, the information processing device 1 includes a control unit 10, a storage unit 11, and a communication unit 12. The control unit 10 includes, for example, a central processing unit (CPU) and a random access memory (RAM). The storage unit 11 includes, for example, a hard disk drive (HDD), a solid state drive (SSD), or the like. The storage unit 11 may be a non-volatile storage medium configured to be detachable from the information processing device 1, or may be a storage medium located on the cloud. The storage unit 11 stores a program executed by the control unit 10. The communication unit 12 is, for example, a communication module connected to a mobile phone network.

[0016] The main power source 3 and the backup power source 4 supply power to the information processing device 1, the sensor 20, and the wearing detection unit 21. The main power source 3 is a battery mounted on the moving body 200, and is used, for example, to drive electrical components of the moving body 200. The backup power source 4 supplies power to the information processing device 1, etc., when a malfunction occurs in the main power source 3 due to the effects of an accident. The backup power source 4 is placed in a location that is unlikely to be affected by an accident such as a collision, for example, under a seat 2C, etc. The backup power source 4 has a capacity that allows it to continuously supply power at least until an ambulance or the like arrives at the accident scene.

[0017] The control unit 10 functions as an acquisition unit 100, an estimation unit 101, a determination unit 102, a notification unit 103, and a storage unit 104 by executing a program stored in the storage unit 11 or the like.

[0018] The acquisition unit 100 acquires a detection signal from the sensor 20 at predetermined time intervals. The predetermined time is, for example, two seconds. The predetermined time may be changed depending on the state of the moving body 200. For example, the predetermined time may be shortened after the moving body 200 has been involved in a collision accident. The acquisition unit 100 acquires a detection signal indicating that an occupant is fastening a seat belt from the fastening detection unit 21. The detection signal acquired by the acquisition unit 100 is input to the estimation unit 101, the determination unit 102, and the storage unit 104.

[0019] The estimation unit 101 estimates the biological information of the occupant P based on the detection signal acquired by the acquisition unit 100. The biological information of the occupant P includes, for example, either the ballistocardiogram or the respiration of the occupant P. Since a method for estimating the heart rate of the occupant P from the ballistocardiogram of the occupant detected by the sensor 20 is well known, a detailed description thereof will be omitted here.

[0020] The determination unit 102 determines whether or not the moving object 200 has caused a collision accident based on the detection signal acquired by the acquisition unit 100. Details of the determination made by the determination unit 102 will be described later.

[0021] When the determination unit 102 determines that the moving body 200 has caused a collision accident, the notification unit 103 notifies the occupant P and people around the moving body 200 that the moving body 200 has caused a collision accident. The notification by the notification unit 103 is performed using, for example, a display device, a speaker, a lighting device, etc. The display device includes, for example, a monitor of a navigation device, a monitor for providing video content arranged on the moving body 200, and an information terminal carried by the occupant. The lighting device includes, for example, a headlamp, a brake lamp, a turn signal lamp, a hazard lamp, etc.

[0022] After starting the notification, the notification unit 103 performs a notification determination to determine whether or not to notify the occurrence of the accident. In the notification determination, for example, when either of the following determination conditions (A1) and (A2) is satisfied, an emergency notification is sent via the communication unit 12 to a medical institution or an emergency call center of a vehicle emergency notification system. (A1) One of the occupants P performed the prescribed reporting operation. (A2) Neither the cancellation operation to cancel the alarm nor the reporting operation was performed within the specified time after the alarm started.

[0023] When the determination unit 102 determines that the moving body 200 has caused a collision accident, the saving unit 104 saves data on the detection signals and the like acquired by the acquisition unit 100 after a timing that is a predetermined time before the timing of the accident occurrence in the memory unit 11. The data that the saving unit 104 saves in the memory unit 11 is not limited to the detection signals acquired by the acquisition unit 100, but may also save the estimation results of the estimation unit 101, the determination results of the determination unit 102, information on the operation amounts of the operation members of the moving body 200, images captured by a camera provided in the moving body 200, and the like. Examples of the operation members of the moving body 200 include an accelerator pedal, a brake pedal, and a steering wheel. The cameras provided in the moving body 200 include, for example, a camera that captures images of the surroundings of the moving body 200, a camera that captures images of the interior space where the occupant P of the moving body 200 is seated, and the like.

[0024] (Judgment Department) Fig. 4 is a diagram used to explain the processing of the determination unit in Fig. 3. Fig. 4 illustrates an example of a change over time in voltage V of the detection signal acquired by acquisition unit 100 from sensor 20. In Fig. 4, occupant P sits in seat 2A just before time T1, causing the absolute value of the detection signal from sensor 20 to increase gradually. Also, just before time T2, moving body 200 has a collision accident, causing the absolute value of the detection signal from sensor 20 to increase sharply.

[0025] The determination unit 102 determines that the moving object 200 has been involved in a collision accident when the detection signal acquired by the acquisition unit 100 from the sensor 20 satisfies both of the following determination conditions (B1) and (B2). (B1) The absolute value |V(t)| of the detection signal acquired by the acquisition unit 100 from any one of the sensors 20 arranged in the moving object 200 is equal to or greater than the first threshold value Vth. (B2) The gradient dV / dt of the time change of the detection signal acquired by the acquisition unit 100 from any one of the sensors 20 arranged in the moving body 200 is equal to or greater than the second threshold value.

[0026] The first threshold value is a value that will not be exceeded by normal ballistocardiogram of the occupant P, and is a value that is determined in advance at the design stage of the information processing device 1. In Fig. 4, at times T1 and T2, the absolute value |V(t)| of the voltage of the detection signal is equal to or greater than the first threshold value Vth.

[0027] The second threshold is a value that will not be exceeded by vibrations when an occupant P is seated, and is a value that is determined in advance at the design stage of the information processing device 1. That is, in Fig. 4, the gradient dV / dt(T1) of the time change in voltage of the detection signal at time T1 is less than the second threshold, and dV / dt(T2) is equal to or greater than the second threshold.

[0028] For example, at time T1, the determination unit 102 determines that the moving body 200 has not caused a collision accident because the determination condition (B2) is not satisfied. On the other hand, at time T2, the determination unit 102 determines that the moving body 200 has caused a collision accident because both the determination conditions (B1) and (B2) are satisfied.

[0029] The determination unit 102 may further use the signal acquired by the acquisition unit 100 from the seating detection unit 21 to determine whether the moving object 200 has been involved in a collision accident. For example, the determination unit 102 may use only the detection signal acquired from the sensor 20 arranged in the moving object 200, which is arranged in a seat or seating position where a seat belt is fastened.

[0030] In addition, if there are multiple seating positions where seat belts are fastened, the condition for determining that the moving body 200 has been involved in a collision accident may be added such that the detection signals of at least two of the multiple seating positions satisfy the following determination condition (B3). (B3) The time variations of the detection signals acquired by the acquisition unit 100 from the sensors 20 arranged at a plurality of seating positions where the seat belts are fastened are similar.

[0031] The time changes of the detection signals being similar means, for example, that the timings at which both the judgment conditions (B1) and (B2) are satisfied coincide. If two seating positions where the seat belts are fastened are separated from each other, the distance between the two seating positions may be taken into consideration when determining whether the timings at which both the judgment conditions (B1) and (B2) are satisfied coincide.

[0032] 5 is a flowchart showing a processing flow of an information processing device according to an embodiment of the present disclosure. When power supply to the information processing device 1 starts, the control unit 10 of the information processing device 1 starts the processing shown in FIG.

[0033] In S100, the control unit 10 functions as the acquisition unit 100 and starts acquiring detection signals. Thereafter, the control unit 10 acquires detection signals from the sensors 20 and the wearing detection unit 21 arranged at each seating position of the moving object 200 at predetermined time intervals.

[0034] In the following S110, the control unit 10 functions as the estimation unit 101 and estimates the biological information of the occupant P based on the detection signal acquired by the acquisition unit 100. In the following S120, the control unit 10 functions as the determination unit 102 and determines whether or not the moving object 200 has caused a collision accident based on the detection signal acquired by the acquisition unit 100. For example, if the detection signal acquired by the acquisition unit 100 satisfies both of the above-mentioned determination conditions (B1) and (B2), the control unit 10 determines that the moving object 200 has caused a collision accident (S120: YES) and proceeds to the processing of S130. For example, if the detection signal acquired by the acquisition unit 100 does not satisfy either of the above-mentioned determination conditions (B1) and (B2), the control unit 10 determines that the moving object 200 has not caused a collision accident (S120: NO) and proceeds to the processing of S110.

[0035] In S130, the control unit 10 functions as the saving unit 104 and saves data on the detection signals etc. acquired by the acquisition unit 100 after a predetermined time before the time when the moving body 200 caused the collision accident in the memory unit 11. If the memory unit 11 is a non-volatile storage medium configured to be detachable from the information processing device 1, the data at the time of the accident can be easily retrieved by removing the memory unit 11 from the accident site after the data has been saved.

[0036] In the following S140, the control unit 10 functions as the notification unit 103 and notifies that the moving body 200 has been involved in a collision accident. In the following S150, the control unit 10 functions as the notification unit 103 and makes a notification determination. If either of the determination conditions (A1) and (A2) is satisfied (S150: YES), the control unit 10 transmits an emergency notification to a medical institution or an emergency call center of the vehicle emergency notification system via the communication unit 12 (S160). On the other hand, if either of the determination conditions (A1) and (A2) is not satisfied (S150: NO), the control unit 10 proceeds to the processing of S110.

[0037] (Action and effect) As described above, the information processing device 1 according to this embodiment provides the following advantageous effects.

[0038] The information processing device 1 includes an acquisition unit 100 that is arranged in a seat 2A or the like of the moving body 200 and acquires a detection signal from a sensor 20 or the like that detects vibrations transmitted to the seat 2A or the like from an occupant P seated in the seat 2A or the like, an estimation unit 101 that estimates biometric information of the occupant P including at least one of the heartbeat and breathing of the occupant P based on the detection signal acquired by the acquisition unit 100, and a determination unit 102 that determines whether the moving body 200 has caused a collision accident based on the detection signal acquired by the acquisition unit 100. According to the above configuration, the occurrence of an accident can be determined using the sensor used to estimate the biometric information of the occupant.

[0039] When an airbag or the like is deployed due to a collision accident of the moving body 200, if an attempt is made to estimate the biometric information of the occupant P using a camera or the like, the occupant P may be hidden by the airbag or the like, making it impossible to acquire the biometric information. By estimating the biometric information of the occupant P using the detection signal of the sensor 20 that detects vibrations transmitted from the occupant P to the seat 2A or the like, the biometric information can be estimated appropriately even when the airbag or the like is deployed.

[0040] In the information processing device 1, the determination unit 102 determines that the moving body 200 has been involved in a collision accident when the absolute value of the detection signal is equal to or greater than a first threshold and the slope of the time change of the detection signal is equal to or greater than a second threshold. To correctly determine even small-scale collision accidents, the first threshold needs to be set low; however, if the first threshold is set too low, there is a risk that the first threshold will be exceeded by the impact when an occupant takes a seat. By including in the determination conditions for determining that the moving body 200 has been involved in a collision accident that the slope of the time change of the detection signal is equal to or greater than the second threshold, it is possible to prevent the impact when an occupant takes a seat from being erroneously determined to be a collision accident.

[0041] A seat 2A or the like of the moving body 200 is provided with a seat belt wearing detection unit 21 that detects whether an occupant P is wearing a seat belt. The determination unit 102 of the information processing device 1 determines whether the moving body 200 has been involved in a collision accident based on a detection signal of a sensor 20 that is arranged at a seating position where the seat belt wearing detection unit 21 has detected that the seat belt is being worn. There may be cases where a sensor at a seat where the occupant P is not seated does not detect an expected signal. By determining whether the moving body 200 has been involved in a collision accident based on the detection signal of the sensor 20 that is arranged at a seating position where the seat belt wearing detection unit 21 has detected that the seat belt is being worn, it is possible to perform a collision determination with high accuracy.

[0042] The moving body 200 has a plurality of seats 2A, etc., and each seating position where an occupant P is seated is provided with a sensor 20 and a seat belt wearing detection unit 21 that detects whether the occupant P is wearing a seat belt. When there are a plurality of seating positions where a seat belt is worn, the determination unit 102 determines that the moving body 200 has been involved in a collision accident as a condition that the detection signals acquired from the sensors 20 arranged at the plurality of seating positions where the seat belt is worn are similar in time change. When the moving body 200 is involved in a collision accident, an impact applied from outside the moving body 200 can be detected by any of the sensors 20 at each seating position. On the other hand, an impact occurring at a seat 2A, etc., may not be detected by the sensors 20 arranged at other seats, such as 2B. With the above configuration, it is possible to accurately determine that the moving body 200 has been involved in a collision accident.

[0043] [Software implementation example] The functions of the information processing device 1 (hereinafter referred to as the "device") can be realized by a program that causes a computer to function as the device, and a program that causes a computer to function as each control block of the device (particularly each part included in the control unit 10).

[0044] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program, thereby realizing the functions described in each of the above embodiments.

[0045] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

[0046] In addition, some or all of the functions of each of the control blocks can be realized by logic circuits. For example, integrated circuits in which logic circuits that function as each of the control blocks are formed are also included in the scope of the present disclosure. In addition, the functions of each of the control blocks can also be realized by, for example, a quantum computer.

[0047] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI ​​may run on the control device or on another device (for example, an edge computer or a cloud server).

[0048] (Variation) In the above embodiment, the information processing device 1 is mounted on an automobile, but the same effects as those described above can be obtained even when the information processing device 1 is mounted on a moving body other than an automobile. For example, the information processing device 1 may be mounted on a moving body such as a bus, taxi, train, airplane, or ship.

[0049] In the above embodiment, the sensor 20 is a piezoelectric sensor. However, any sensor can be used as the sensor 20 as long as it can detect vibrations transmitted to the seat 2A or the like from the occupant P seated in the seat 2A or the like.

[0050] In the above embodiment, one sensor 20 is disposed at a position to the left of the center of the seat surface at each seating position such as seat 2A. However, the positions and number of sensors 20 at each seating position are not limited to those shown in the above embodiment. For example, the sensor 20 may be disposed at a position to the right of the center of the seat surface, or the sensor 20 may be disposed on the backrest.

[0051] [Additional notes] The present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present disclosure. [Explanation of symbols]

[0052] 1. Information processing equipment 2A, 2B, 2C seats 10 Control Unit 20 sensors 21 Wearing detection unit 100 Acquisition Department 101 Estimation part 102 Judgment section 200 Mobile Vth First threshold

Claims

1. an acquisition unit that acquires a detection signal from a sensor that is disposed in a seat of the vehicle and detects vibrations transmitted to the seat from an occupant sitting in the seat; an estimation unit that estimates biological information of the occupant including at least one of a heartbeat and a respiration of the occupant based on the detection signal acquired by the acquisition unit; an information processing device comprising: a determination unit that determines whether or not the moving body has caused a collision accident based on the detection signal acquired by the acquisition unit.

2. The information processing device according to claim 1 , wherein the determination unit determines that the moving body has been involved in a collision accident when the absolute value of the detection signal is equal to or greater than a first threshold value and the slope of the time change of the detection signal is equal to or greater than a second threshold value.

3. The seat is provided with a seat belt detection unit that detects whether the occupant is wearing a seat belt, 2. The information processing device according to claim 1, wherein the determination unit determines whether the moving body has been involved in a collision accident based on the detection signal of the sensor disposed in the seat where the wearing detection unit detects that the seat belt is being worn.

4. the moving body has a plurality of the seats, The plurality of seats are provided with the sensor and a seat belt wearing detection unit that detects whether the occupant is wearing a seat belt at each seat position where the occupant is seated, The information processing device according to claim 2, wherein the conditions for determining that the moving body has been involved in a collision accident when there are multiple seating positions where the seat belt is fastened include similarity in the time changes of the detection signals obtained from the sensors located at the multiple seating positions where the seat belt is fastened.

5. A program for causing a computer to function as the information processing device according to claim 1 , the program causing a computer to function as the acquisition unit, the estimation unit, and the determination unit.

Images