Device
The device improves driving safety by assessing the driver's conscious state through biometric data, particularly brain activity, to provide personalized support based on awareness of their condition, reducing accident risks.
Patent Information
- Application Number
- JP2024156545
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-09-10
- Publication Date
- 2024-11-28
- Estimated Expiration
- 2041-02-26
AI Technical Summary
Existing driving support technologies fail to accurately determine the degree of driving risk based on the driver's awareness of their condition, leading to potential safety risks.
A device that acquires biometric information to determine the user's conscious state by measuring brain activity in specific regions like the parietal lobe and prefrontal cortex, distinguishing between the user's actual and perceived state to provide tailored driving support.
Enhances the accuracy of determining driving danger by accounting for the driver's awareness, thereby reducing the risk of accidents through targeted alerts and interventions.
Smart Images

Figure 2024166308000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an apparatus for determining the degree of risk to a user's driving. [Background technology]
[0002] A method for providing driving assistance by determining and predicting the driver's condition from biometric information has been disclosed. In Patent Document 1, a driving control system is developed based on information about the driver's surrounding environment and biometric information such as the driver's brain waves. A technology has been disclosed that predicts the driver's operations and provides driving assistance based on the prediction results.
[0003] In Patent Document 2, a system is developed that determines whether a driver feels uncomfortable based on biological information such as brain waves. A technology is disclosed in which a driver is given a sense of discomfort depending on the result of the determination. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2020-15418 A [Patent Document 2] JP 2018-82805 A Summary of the Invention [Problem to be solved by the invention]
[0005] The degree of risk of driving changes depending on whether the driver himself is aware of his own condition, and the method of driving assistance changes accordingly. However, in Patent Document 1 and Patent Document 2, even if the driver's condition can be estimated, whether the driver himself is aware of it cannot be reflected in the judgment of the degree of risk of driving, and there is room for improvement in the accuracy of judging the degree of risk of the user's driving.
[0006] The present disclosure aims to provide a device that can improve the accuracy of determining the degree of danger to a user's driving by solving such problems. [Means for solving the problem]
[0007] The device of the present disclosure acquires biometric information of a user, and judges the degree of risk to the user's driving based on the subjective state of awareness of the user's condition indicated by the biometric information. Alternatively, the device of the present disclosure acquires at least one of information on the activity of the parietal lobe region of the user's brain and the activity of the prefrontal cortex region of the user, and judges the degree of risk to the user's driving based on the information. Effect of the Invention
[0008] The present disclosure makes it possible to provide a device that can determine the degree of risk associated with a user's driving. [Brief description of the drawings]
[0009] [Figure 1] 1 is a block diagram showing a configuration of a driving assistance device according to a first embodiment. [Diagram 2] 4 is a flowchart showing the operation of the driving assistance device according to the first embodiment. [Diagram 3] 4 is a flowchart showing the operation of the driving assistance device according to the first embodiment. [Figure 4] 4 is a table showing an example of a notification to a user of the driving assistance device according to the first embodiment. [Diagram 5] FIG. 2 is a block diagram showing the configuration of a computer according to the first embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, specific embodiments to which the present disclosure is applied will be described in detail with reference to the drawings. In the various drawings, the same elements are designated by the same reference numerals, and for the sake of clarity, Therefore, duplicate explanations will be omitted where necessary.
[0011] (First embodiment) First, the configuration of a driving assistance device 10 according to the first embodiment will be described with reference to FIG. The assistance device 10 includes an acquisition unit 11, a first state estimation unit 12, a second state estimation unit 13, and a driving assistance unit 1 The driving assistance device 10 includes a terminal dedicated to driving assistance, e.g. The driving support device 10 is implemented as a terminal such as a smartphone or a tablet. The driving support device 10 may be realized as one of the functions of the device. The functions may be realized by a plurality of devices, for example by having a terminal and a server.
[0012] The acquisition unit 11 acquires biometric information of a user who is a target of driving assistance using a dedicated sensor, a camera, a smartphone, or the like. Biometric data is acquired from various sensors and measuring devices such as smartwatches and wearable devices. The information may include, for example, pulse rate, heart rate, eye movement, eye opening, breathing rate, cerebral blood flow, or beta waves. The acquisition unit 11 includes these various sensors and measuring devices. Good too.
[0013] The first state estimation unit 12 is a unit for acquiring biological information such as a pulse rate, a respiratory rate, and an amount of eye movement. The first state estimation unit 12 then uses the acquired biometric information to estimate the user's The first state indicates whether the user is in a state that impairs driving. For example, it indicates whether the user is feeling stress, tension, fatigue, or other such bad conditions. The first state is a physical condition such as fever, or mental conditions such as lack of concentration, anger, or anxiety. For example, the first state estimation unit 12 may detect that the pulse rate is not within the normal range. In this case, if the user is in a state of stress, it is considered that the user is in a state where driving is impaired. Other known techniques for estimating the user's condition may be used. Whether the value is within the normal range is determined by comparing it with values set individually for each user, time period, etc. It is preferable to make such a judgment.
[0014] The second state estimation unit 13 is configured to estimate, for example, the amount or fluctuation of cerebral blood flow, which is an index of the amount of activity of the user's brain. biometric information such as blood volume, hemoglobin level, brainwave frequency, heart rate and heart rate fluctuations The second state estimation unit 13 estimates the first state by using the acquired biological information. A second state indicating whether or not the user is aware of the state is estimated from the biological information.
[0015] Specifically, the second state estimation unit 13 estimates the state of the user based on the amount of brain activity, for example, the amount of cerebral blood flow. Specifically, the second state estimation unit estimates whether the user is aware of the first state. 13, when the amount of brain activity reaches or exceeds a predetermined value, the user is aware of the first state. The second state estimation unit 13 estimates that the amount of brain activity is smaller than a predetermined value. In this case, it is estimated that the user is not aware of the first state. For example, the parietal lobe of the user's brain is an important area for processing and integrating sensory information such as body sensation, vision, and hearing. It is preferable to estimate this from measurements of the amount of cerebral blood flow and hemoglobin levels in the area in question. The second state estimation unit 13 estimates the state of a part of the brain that plays an important role in cognitive function, such as the prefrontal cortex of the user's brain. It may be estimated from the amount of cerebral blood flow and hemoglobin value of the area that plays a role. Any known technique may be used to estimate whether a user is aware of their own condition.
[0016] The driving assistance unit 14 provides driving assistance to the user corresponding to the first state and the second state. Driving assistance methods include voice output using output devices such as speakers, and display. This is achieved by outputting text using an output device such as a ray.
[0017] Specifically, the first state estimation unit 12 estimates that the user is in a state that interferes with driving. In this case, the driving support unit 14 determines that the second state estimation unit 13 is in a state that interferes with driving. In the case where the second state estimation unit 13 estimates that the user is not aware of the above, The user is given a stronger warning than if the user were assumed to be aware of the condition. For example, when the first state estimation unit 12 estimates that the user is in a stressful state and the second state estimation unit 13 estimates that the user is in a stressful state, When the state estimation unit 13 estimates that the user is not aware that he / she is in a stressful state, This is more dangerous for driving than if the user were aware that they were in a stressful state. It is determined that this is the case and strongly urges users to be careful.
[0018] On the other hand, the first state estimation unit 12 estimates that the user is not in a state that impedes driving. For example, when the pulse rate is within the normal range, the state estimation unit 12 determines that the user is feeling stressed. A relaxed state where the user is not distracted from driving. The estimation unit 12 further determines whether the user is in a relaxed state or in a non-relaxed state depending on, for example, the pulse rate. In this case, the driving support unit 14 may estimate whether the vehicle is in a neutral state or not. The user is not aware that the determination unit 13 is not in a state that interferes with driving. For example, when the first state estimation unit 12 estimates that the user is The second state estimation unit 13 estimates that the user is in a relaxed state. If it is assumed that the user is not aware that he / she is in a relaxed state, Users may be more overconfident, distracted, and engrossed in their driving than if they were aware of the The driving support unit 14 judges that there is a possibility of the vehicle being driven by the vehicle and strongly warns the user of the possibility of the vehicle being driven by the vehicle. In the second state estimation unit 13, the user is not aware that the state is not interfering with driving. If the system assumes that the user is in a normal state, it will not warn the user. This is also fine.
[0019] Next, an example of the operation of the driving support device 10 according to the first embodiment will be described with reference to FIGS. In the example shown in FIG. 2-FIG. 3, the first state estimation unit 12 determines that the user is feeling stressed. The first state is estimated as being whether or not the vehicle is in a stopped state.
[0020] First, the acquisition unit 11 acquires the user's biological information from a dedicated sensor or a sensor such as a smart watch. The biological information is acquired from a measuring device or the like (step S101). For example, the acquisition unit 11 may acquire the following information: the degree of opening of the mouth, the respiratory rate, the cerebral blood flow, the brain wave, etc. The image is input and the measured pulse rate, eye opening, breathing rate, etc. are acquired. The acquisition unit 11 also The headband-type sensor irradiates near-infrared light and measures the amount of light that returns to the brain. The measured cerebral blood flow information is obtained by detecting changes in blood flow in the tissue. The acquisition unit 11 then transmits the acquired biological information to the first state estimation unit 12 and the second state estimation unit 13. Supply to 13.
[0021] Next, the first state estimation unit 12 estimates the user's Whether or not the user is in a stressed state is estimated as a first state (step S102). For example, the first state estimation unit 12 acquires a pulse rate from the acquisition unit 11. Then, the first state estimation unit When the pulse rate is not within the normal range, the determining unit 12 determines that the user is in a stressed state. If the pulse rate is within the normal range, the first condition estimation unit 12 estimates that the user The first state estimation unit 12 estimates that the user is not feeling stressed. The first condition estimation unit 12 acquires the respiratory rate from the first condition estimation unit 11. If the value is not within the range, it is assumed that the user is in a stressed state. When the respiratory rate is within the normal range, the state estimation unit 12 determines that the user is not feeling stressed. It is estimated that the situation is good.
[0022] Next, when the first state estimation unit 12 determines that the user is feeling stressed (step (S103 YES), the second state estimation unit 13 determines that the user himself is feeling stressed. Whether or not the state is conscious is estimated as a second state (step S104).
[0023] For example, the second state estimation unit 13 estimates the first state as the user's own state based on the amount of brain activity of the user. The brain, especially the parietal lobe, processes sensory information such as body sensation, vision, and hearing. It plays an important role in processing and integrating information, and measures the amount and fluctuation of cerebral blood flow, such as blood flow in the parietal lobe. By measuring this, we can estimate the amount of activity, which is the amount of sensory information processed by the brain. The second state estimation unit 13 acquires information on the amount of cerebral blood flow from the acquisition unit 11, and estimates the amount of cerebral blood flow. and estimating a brain activity amount based on the brain activity amount, and determining a user's own awareness of the first state based on the brain activity amount. In detail, the second condition estimation unit 13 estimates the symptom when the amount of cerebral blood flow becomes equal to or exceeds a predetermined value. In this case, the user is assumed to be in an active state where the amount of processing of his / her own sensory information is large, and the user is The second state estimation unit 13 estimates that the person is aware that he or she is feeling a lack of consciousness. If is smaller than a certain value, the subject is in a calm and absent-minded state, with less processing of their own sensory information. It is estimated that the user is not aware that he or she is feeling stressed.
[0024] In addition, the second state estimation unit 13 acquires the frequency of the brain waves from the acquisition unit 11 and estimates the frequency of the brain waves such as alpha waves, beta waves, etc. The system estimates the amount of brain activity based on the frequency of brain waves, and detects whether the user is feeling stressed. It may be possible to estimate whether the person is aware of the above.
[0025] Next, the second state estimation unit 13 estimates a state in which the user is aware that he or she is feeling stressed. When it is estimated that the driver is in a resting state (YES in step S105), the driving support unit 14 prompts the driver to take a rest. The driving support unit 14 notifies the user of the alert (step S106). For example, Output relaxing music, suggest a break, and be nagging-free. The system provides support to users, such as minimizing vehicle route guidance.
[0026] On the other hand, the second state estimation unit 13 may not be aware that the user is feeling stressed. If it is determined that the driver has reached the limit (NO in step S105), the driving support unit 14 issues an alarm strongly encouraging the driver to take a rest. By doing so, the user is prevented from lowering his / her attention. Improve what users do to get them to take a break from driving. The support unit 14 plays music with a good tempo to encourage the user to become aware of his or her own condition. Outputting alerts and changing the frequency, volume, and wording of alerts to more strongly suggest breaks In order to ensure that users do not miss any part of the route guidance, the volume and frequency of the navigation system guidance will be increased. Here, in step S107, the driving support unit 14 determines whether the accident has occurred more frequently than in step S106. As the possibility of this happening is high, users will be strongly warned.
[0027] In addition, when the first state estimation unit 12 estimates that the user is not feeling stressed, If (NO in step S103), the second state estimation unit 13 determines that the user himself / herself is feeling stressed. Whether or not the user is aware that he or she is not in a position to move is estimated as a second state (step S108). Here, the second state estimation unit 13 estimates the user's The present invention estimates whether the user himself / herself is aware that he / she is not feeling stressed.
[0028] The second state estimation unit 13 is in a state where the user is aware that he or she is not feeling stressed. If it is estimated that the vehicle is safe (step S109 YES), the driving support unit 14 The driving support unit 1 determines that the vehicle is rotating and does not issue an alert (step S110). 4 may notify the user with an alert to inform them that they are driving safely.
[0029] On the other hand, if the second state estimation unit 13 detects that the user is not aware that he or she is not feeling stressed, When it is estimated that the vehicle is in a state where the driver is not driving (NO in step S109), the driving support unit 14 issues a warning. By doing so, the driving support unit 1 4 is a measure to prevent accidents due to the possibility that the user is overconfident, distracted, or drunk while driving. Prevents accidents caused by overspeeding.
[0030] Next, with reference to FIG. 4, other driving assistance in the driving assistance device 10 according to the first embodiment will be described. In the example described above with reference to FIG. 2 and FIG. 3, the first state estimation unit 12 detects whether the user is The first state was estimated as being whether or not the subject was feeling stressed.
[0031] In the example shown in FIG. 4, the first state estimation unit 12 determines whether the user is in a tense state as a first In this case, the driving support unit 14 estimates the second state estimation unit 13 as a tense state. If it is assumed that the user is aware of this, the driver will be able to drive in a relaxed manner. The driving support unit 14 notifies the driver of an alert that the driver should go. If it is assumed that the user is not aware that he or she is tense, the relaxation The driving support unit 14 also notifies the driver of an alert to take a short rest to The second state estimation unit 13 estimates that the user is aware that he or she is not nervous. If this happens, an alert will be sent to inform the driver that there is no problem and that they should continue driving safely. The driving support unit 14 detects whether the second state estimation unit 13 is aware that the user is not nervous. If it is estimated that the vehicle is not in a safe condition, it is recommended that you concentrate on driving for a while and continue driving safely. Notify alerts.
[0032] The first state estimation unit 12 estimates whether the user is tired as the first state. In this case, the driving support unit 14 determines whether the second state estimation unit 13 is tired or not by the user. If you suspect that you are aware of this condition, take a break from time to time to relieve your fatigue. The driving support unit 14 notifies the driver of the fact that the second state estimation unit 13 is tired. If we assume that the user is not aware of this, then fatigue is at its maximum. The driving support unit 14 notifies the driver of an alert to take a rest immediately. If we assume that the user is aware that he or she is not tired, then The driving support unit 14 issues an alert to the driver to continue driving safely. The state estimation unit 13 estimates that the user is not aware that he or she is not tired. In this case, an alert will be sent to advise you to concentrate on driving and continue driving safely.
[0033] The driving assistance device 10 of the present disclosure provides a third display that indicates whether or not the user is in a state that impedes driving. Whether or not the user is aware of the first state is estimated as the second state. The driving assistance device 10 notifies the user of the second state by issuing an alert or other driving assistance. In other words, the driving support device 10 changes the state of the driver when the driver himself is aware of the state of the driver. Being able to estimate whether or not the vehicle is moving can improve the accuracy of driving assistance.
[0034] The present invention is not limited to the above-described embodiment, and may be modified as appropriate without departing from the spirit and scope of the present invention. It is possible to change it.
[0035] <Hardware configuration> Next, the hardware of the computer 1000 related to the driving support device 10 will be described with reference to FIG. A configuration example will be described. In FIG. 5, a computer 1000 includes a processor 1001 and a memory. The processor 1001 is, for example, a microprocessor, an MPU, It may be a Micro Processing Unit (CPU) or a Central Processing Unit (CPU). The processor 1001 may include multiple processors. The memory 1002 may include a volatile memory. The memory 1002 is configured by a combination of a processor, a logic unit, and a non-volatile memory. 1001. In this case, the processor 100 1 may access the memory 1002 via an I / O interface (not shown). good.
[0036] Each device in the above-described embodiment may be implemented as hardware or software, or and may be composed of a single piece of hardware or software, The device may be composed of multiple pieces of hardware or software. The functions (processing) of the device may be realized by a computer. A program for carrying out the driving support method according to the embodiment is stored in the memory 100. 2 may be executed by the processor 1001.
[0037] These programs may be stored on various types of non-transitory computer readable media. The information is stored on a data storage computer readable medium and can be provided to a computer. Non-transitory computer-readable media can include any type of tangible storage medium. Examples of non-transitory computer readable media include magnetic recording media (e.g., (e.g. flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g. magneto-optical disk), CD-ROM (Read Only Memory), CD-R, CD-R / W, semiconductor memory (e.g., mask ROM, PROM (Programmable ROM), EPROM) (Erasable PROM), Flash ROM, and RAM (random access memory). The program may be stored on various types of transitory computer readable media. The information may be provided to a computer on a computer readable medium. Examples of computer-readable media include electrical signals, optical signals, and electromagnetic waves. The program is transmitted to a computer via a wired communication path such as an electric wire or an optical fiber, or via a wireless communication path. The data can be supplied to the computer. [Explanation of symbols]
[0038] 10 Driving assistance device (device) 11 Acquisition Department 12 First state estimation unit 13 Second state estimation unit 14 Driving Support Department 1000 Computers 1001 Processor 1002 Memory
Claims
1. Acquire biometric information of the user; determining a degree of risk to the user's driving based on a subjective state indicated by the biological information regarding the user's condition; Device.
2. Acquire information on at least one of the amount of activity in the parietal lobe region of the user's brain and the amount of activity in the prefrontal cortex region of the user's brain; Based on the information, a degree of risk to the user's driving is determined. Device.
Citation Information
Patent Citations
Biological state estimation device, biological state estimation method, computer program, and recording medium
JP2018093997A
Awareness detection system and method
US20090123031A1
Discomfort discrimination method and discomfort discrimination device
JP2018082805A
Driving support method and driving support device
JP2020015418A
