Driver assistance system, driver assistance method, and driver assistance program

The vehicle navigation system assesses a driver's health through biometric data and interactive responses to adjust vehicle operations, ensuring safe driving by accurately determining and responding to health conditions.

JP7773450B2Active Publication Date: 2025-11-19HONDA MOTOR CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2022146525
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-09-14
Publication Date
2025-11-19
Estimated Expiration
2042-09-14

AI Technical Summary

Technical Problem

Existing systems fail to accurately determine a driver's health condition and provide appropriate assistance for safe driving based solely on exhaled breath data.

Method used

A vehicle navigation system that includes biometric data acquisition, evaluation, and interaction units to assess a driver's health condition through biometric data, prompting responses, and adjusting vehicle operations based on the driver's suitability, applying different settings for automatic braking conditions depending on the health assessment.

Benefits of technology

Accurately determines a driver's health condition, providing appropriate assistance for safe driving by adjusting vehicle settings, preventing dangerous situations due to poor health conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007773450000001
    Figure 0007773450000001
  • Figure 0007773450000002
    Figure 0007773450000002
  • Figure 0007773450000003
    Figure 0007773450000003
Patent Text Reader

Abstract

To appropriately determine a health condition of a driver of a movable body and provide the driver with appropriate support for safe driving.SOLUTION: A driver support system comprises: an acquisition unit for acquiring biological data on a driver of a movable body; an evaluation unit for evaluating a health condition of the driver; and an interactive response unit for executing interaction operation for interactive response between itself and the driver using an HMI device mounted on the movable body. When estimating the health condition of the driver to be poor on the basis of the biological data on the driver, the evaluation unit instructs the interactive response unit to execute the interaction operation, acquires a response input which is a response of the driver to a response prompting output for prompting the driver to respond in the interaction operation, and determines the health condition of the driver on the basis of a degree of suitability of the response input to the response prompting output.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a driver assistance system, a driver assistance method, and a driver assistance program. [Background technology]

[0002] Patent document 1 discloses a mobile radio device system in which an exhalation detection unit is provided in the audio microphone of the mobile radio device to record the exhalation data of the driver of the mobile vehicle, and the physical condition of the driver can be understood based on the recorded exhalation data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-130066 Summary of the Invention [Problem to be solved by the invention]

[0004] When diagnosing a person's health condition, there may be cases where an appropriate diagnosis cannot be made based solely on changes in the person's exhaled breath.

[0005] An object of the present invention is to appropriately determine the health condition of a driver of a mobile body and provide the driver with appropriate assistance for safe driving. [Means for solving the problem]

[0006] One aspect of the present invention is a vehicle navigation system including: an acquisition unit that acquires biometric data of a driver of a vehicle; an evaluation unit that evaluates the health condition of the driver; and an interaction unit that executes an interaction operation to interact with the driver using an HMI device mounted on the vehicle; a setting unit for setting the operation of the moving body;When the evaluation unit estimates that the health condition of the driver is poor based on the biometric data of the driver, the evaluation unit instructs the interactive response unit to execute the interaction operation, acquires a response input that is a response of the driver to a response prompting output that prompts the driver to respond in the interaction operation, and judges the health condition of the driver based on a degree of suitability of the response input to the response prompting output. death , The setting unit applies a predetermined first setting to an automatic braking start condition as an operation setting of the moving body when the evaluation unit determines that the driver's health condition is good based on the biometric data, and applies a predetermined second setting, different from the first setting, to an automatic braking start condition as an operation setting of the moving body when the evaluation unit determines that the driver's health condition is good based on the degree of suitability after estimating that the driver's health condition is poor based on the biometric data. It is a driver assistance system. According to another aspect of the present invention, a setting unit is provided for setting the operation of the moving body, and the setting unit prohibits the moving body from moving when the mutual response unit does not receive the response input in the interaction operation. According to another aspect of the present invention, when the interactive response unit does not receive the response input from the driver in response to the response prompting output, the interactive response unit repeatedly executes the response prompting output at predetermined time intervals. According to another aspect of the present invention, the device includes a recording unit that records the evaluation results of the evaluation unit regarding the driver's health condition, and when the evaluation unit estimates the driver's health condition to be poor based on the biometric data and then determines that the driver's health condition is good based on the degree of suitability, the recording unit associates the biometric data with the result of the judgment and stores them in a storage device. According to another aspect of the present invention, The second setting is a setting of the automatic brake initiation condition such that deceleration is initiated earlier than the first setting. According to another aspect of the present invention, the response prompting output prompts the driver to respond verbally, the response input is a verbal response from the driver to the response prompting output, the mutual response unit executes the interaction operation with an open question as the response prompting output, and the evaluation unit evaluates the presence or absence of symptoms of speech disorder or delirium in the driver or the severity of such symptoms based on the verbal response that is the response input in the interaction operation, and judges the driver's health condition based on the results of the evaluation. According to another aspect of the present invention, the response prompting output is output to the driver via a speaker and / or a display device mounted on the vehicle, and the response input is received by a microphone and / or a touch panel mounted on the vehicle. Another aspect of the present invention is a driver assistance method executed by a computer, the method including: an acquisition step of acquiring biometric data of a driver of a mobile body; an evaluation step of evaluating a health state of the driver; and an interaction step of executing an interaction action between the mobile body and the driver, the interaction action being mutually responsive to each other. a setting step for setting the operation of the moving body; and when the evaluation step estimates that the health condition of the driver is poor based on the biometric data of the driver, the interactive response step is executed to execute the interaction operation using an HMI device mounted on the moving body, acquire a response input that is a response of the driver to a response prompting output that prompts the driver to respond in the interaction operation, and judge the health condition of the driver based on a degree of suitability of the response input to the response prompting output. death , In the setting step, when the evaluation step determines that the driver's health condition is good based on the biometric data, a predetermined first setting is applied to an automatic braking start condition as an operation setting of the moving body, and when the evaluation step determines that the driver's health condition is good based on the degree of suitability after the driver's health condition is estimated to be poor based on the biometric data, a predetermined second setting different from the first setting is applied to an automatic braking start condition as an operation setting of the moving body. This is a driver assistance method. Another aspect of the present invention is a computer of a driver assistance system, comprising an acquisition unit that acquires biometric data of a driver of a mobile body, an evaluation unit that evaluates the health condition of the driver, and a device that evaluates the health condition of the driver. Part, front an interactive response unit in the vehicle that executes an interaction operation in which the vehicle responds to the driver; and a setting unit for setting the operation of the moving body. and when the evaluation unit estimates that the health condition of the driver is poor based on the biometric data of the driver, the evaluation unit instructs the interactive response unit to execute the interaction operation using an HMI device mounted on the moving body, acquires a response input that is the response of the driver to a response prompting output that prompts the driver to respond in the interaction operation, and judges the health condition of the driver based on the degree of suitability of the response input to the response prompting output. death , The setting unit applies a predetermined first setting to an automatic braking start condition as an operation setting of the moving body when the evaluation unit determines that the driver's health condition is good based on the biometric data, and applies a predetermined second setting, different from the first setting, to an automatic braking start condition as an operation setting of the moving body when the evaluation unit determines that the driver's health condition is good based on the degree of suitability after estimating that the driver's health condition is poor based on the biometric data. It is a driver assistance program. [Effects of the Invention]

[0007] According to the present invention, the health condition of a driver of a mobile body can be appropriately determined, and appropriate assistance for safe driving can be provided to the driver. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing the configuration of a driver assistance system according to one embodiment of the present invention. [Figure 2] FIG. 2 is a diagram showing an example of the configuration of a vehicle equipped with an assistance device that constitutes a driver assistance system, as viewed from inside the vehicle cabin. [Figure 3] FIG. 3 is a diagram showing the configuration of a mobile terminal that constitutes the driver assistance system. [Figure 4] FIG. 4 is a diagram showing the configuration of an assistance device that constitutes the driver assistance system. [Figure 5] FIG. 5 is a flowchart showing the procedure of the driver assistance method executed by the driver assistance system. DETAILED DESCRIPTION OF THE INVENTION

[0009] [Embodiment] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. 1 is a diagram illustrating the configuration of a driver assistance system 1 according to an embodiment of the present invention, along with an example of a usage scenario. The driver assistance system 1 evaluates the health state of a driver P when the driver P gets into a vehicle 2, which is a moving object.

[0010] The driver assistance system 1 includes a wearable device 3 and a mobile device 4 used by a driver P, and an assistance device 5 mounted on a vehicle 2 driven by the driver P. The wearable device 3 and the mobile device 4, and the mobile device 4 and the assistance device 5 are communicatively connected via short-range communication such as Bluetooth (registered trademark). The vehicle 2 also includes a vehicle control device 6 that realizes ADAS (Advanced Driver Assistance System) functions such as adaptive cruise control and automatic braking. The vehicle control device 6 is an example of an in-vehicle device in the present disclosure that performs operational settings for the vehicle 2 by the driver assistance system 1.

[0011] The mobile terminal 4 is, for example, a smartphone, and is equipped with a camera, an acceleration sensor, and / or a Global Navigation Satellite System (GNSS) sensor, etc. The wearable terminal 3 is, for example, a wristwatch-type terminal device, and is equipped with various sensors such as a pulse wave sensor, a heart rate sensor, a blood pressure sensor, an acceleration sensor, and / or a GNSS sensor according to conventional technology, to measure biometric data of the driver P and transmit the measured biometric data to the mobile terminal 4.

[0012] 2 is a diagram showing an example of the configuration of a vehicle 2 as seen from inside the vehicle cabin. An AV (Audio-Visual) device 12 and an interior camera 14 are arranged on an instrument panel 11 in front of a driver's seat 10, approximately in the center of the vehicle width direction. The AV device 12 is, for example, a display audio device, and displays images and videos (hereinafter simply referred to as images) on a first touch panel 13 and acquires information input by touch operations on the first touch panel 13. The AV device 12 also outputs audio and receives audio inputs through a speaker 15 and a microphone 16 provided on the driver's seat side of the instrument panel 11. Here, the display screen of the first touch panel 13 corresponds to the display device in this disclosure.

[0013] The interior camera 14 is, for example, a DMC (Driver Monitoring Camera) that captures images of the interior of the vehicle, including an image of the driver. Here, the first touch panel 13, the speaker 15, and the microphone 16 correspond to the HMI device in the present disclosure.

[0014] The vehicle 2 also includes an external camera 18 provided on the door mirror 17 on the driver's seat 10 side. The external camera 18 captures an image of the surrounding environment on the outside right side of the vehicle 2. For example, the external camera 18 captures an image of a person approaching the vehicle door (not shown) on the driver's seat 10 side from the outside right side of the vehicle 2. The external camera 18 is not limited to one camera, and may be configured with multiple cameras distributed around the body of the vehicle 2, and may capture an image of all or part of the surrounding environment of the vehicle 2.

[0015] The driver's seat 10 is provided with a seating sensor 21 that detects whether a person is seated. The seating sensor 21 is, for example, a pressure sensor that detects the pressure applied to the seat by the weight of the seated person. The vehicle 2 may also be provided with a heart rate sensor 20 on the steering wheel 19.

[0016] The mobile terminal 4 acquires, for example, biometric data of the driver P from the wearable terminal 3 worn by the driver P. Then, for example, when the driver P sits in the driver's seat 10 of the vehicle 2, the mobile terminal 4 estimates the health condition of the driver P based on the acquired biometric data.

[0017] Next, when the mobile terminal 4 estimates that the health condition of the driver P is poor based on the biometric data, it uses the HMI device mounted on the vehicle 2 to perform an interaction operation in which the mobile terminal 4 and the driver P respond to each other. In the interaction operation, the mobile terminal 4 outputs a response prompting output from the HMI device to the driver P to prompt a response, and acquires a response input, which is the driver P's response to the response prompting output, via the HMI device. Then, the mobile terminal 4 evaluates the degree of suitability of the response input of the driver P to the response prompting output, and determines the suitability. If The health condition of the driver P is judged based on the degree of sexuality. This makes it possible to appropriately judge the health condition of the driver P of the vehicle 2, including from the perspective of the possibility of brain disease, and to provide the driver P with appropriate support for safe driving.

[0018] The response prompt output is preferably an audio output from the speaker 15 . For example, the response prompting output may prompt the driver P to respond by voice. For example, the response prompting output may be an open question with no limit on the range of response content, such as "Where are you going today?" or "What should we do about the air conditioning?" By acquiring the driver P's voice as a response input from the driver P in response to this, the mobile terminal 4 can evaluate the suitability of the response input by assessing the presence or severity of symptoms of language disorders or delirium in the driver P as signs or precursors of brain damage. Here, language disorders may include dysarthria (disorders of speech) and aphasia (disorders of speech production).

[0019] Alternatively, the response prompting output may present a question for a cognitive test. Such a response prompting output may be composed of a cognitive test question output displayed by text or graphics on the screen of the first touch panel 13, and an operation instruction such as "Please quickly touch the lit icon." A response input from the driver P in response to this may be, for example, various operations performed by touching the first touch panel 13 with a finger.

[0020] When the portable terminal 4 does not receive a response input from the driver P in response to the response prompting output, the portable terminal 4 may repeatedly execute the response prompting output at predetermined time intervals. This prevents the health condition of the driver P from being determined to be poor even when the driver P is distracted and unable to make a response input, thereby making it possible to more appropriately determine the health condition of the driver P. Furthermore, when the mobile terminal 4 does not receive a response input from the driver P in the above-described interaction operation, the mobile terminal 4 prohibits the vehicle 2 from moving. As a result, when no response input is made by the driver P and it can be determined that the driver P may have a brain disease, the mobile terminal 4 prohibits the vehicle 2 from moving, thereby making it possible to prevent dangerous driving that may occur due to the driver's health condition.

[0021] Furthermore, when the mobile device 4 estimates the driver P's health condition to be poor based on the biometric data acquired from the wearable device 3 and then determines that the driver P's health condition is "good" based on the degree of suitability of the driver P's response input in the interaction action, the mobile device 4 associates the biometric data with the result of the determination that the driver P is "good" and stores the association information in the storage device. This makes it possible to improve the accuracy of the estimation of the health condition based on the biometric data by using the association information between the biometric data stored in the storage device and the result of the determination.

[0022] Furthermore, when the mobile terminal 4 estimates that the driver P's health condition is good based on the biometric data, it instructs the assistance device 5 to apply a predetermined first setting to the operation settings of the vehicle control device 6 of the vehicle 2. On the other hand, when the mobile terminal 4 estimates that the driver P's health condition is poor based on the biometric data and then determines that the driver P's health condition is good based on the degree of suitability of the driver P's response input in the interaction action, it instructs the assistance device 5 to apply a predetermined second setting, which is different from the first setting, to the operation settings of the vehicle control device 6 of the vehicle 2. Here, the second setting may be, for example, a safety setting that takes safety into consideration more than the first setting. If the biometric data is not good but the response input is normal, it is considered that the driver P is fatigued or sleep-deprived. Therefore, by switching the operation settings of the vehicle 2 as described above, it is possible to provide the driver P with appropriate assistance for safe driving.

[0023] Specifically, for example, the mobile terminal 4 cooperates with the assistance device 5 to set the following distance setting for following vehicle in front, which is part of the ADAS function of the vehicle control device 6, to be longer in the second setting than in the first setting. Alternatively, the mobile terminal 4 cooperates with the assistance device 5 to set the initiation condition for automatic braking, which is part of the ADAS function of the vehicle control device 6, so that deceleration starts earlier in the second setting than in the first setting.

[0024] The configurations of the mobile terminal 4 and the support device 5 will be described below. FIG. 3 is a diagram showing the configuration of the mobile terminal 4 that constitutes the driver assistance system 1. As shown in FIG. The mobile terminal 4 is, for example, a smartphone. The mobile terminal 4 includes a first processor 40, a first memory 41, a first communicator 42, a second touch panel 43, a first GNSS sensor 44, and an acceleration sensor 45. The acceleration sensor 45 is, for example, a nine-axis acceleration sensor.

[0025] The first memory 41 may be configured with a volatile and / or non-volatile semiconductor memory. The first communicator 42 includes a transceiver for communicating between the mobile terminal 4 and the wearable terminal 3 and the assistance device 5. For example, the first communicator 42 may include a short-range communicator for performing short-range communication in accordance with the Bluetooth (registered trademark) communication standard between the wearable terminal 3 and the assistance device 5 of the vehicle 2. The first communicator 42 may also include a long-range communicator for performing communication via a communication network such as the Internet.

[0026] The first processor 40 is, for example, a computer including a CPU (Central Processing Unit) and the like. The first processor 40 may also include a ROM (Read Only Memory) in which a program is written, a RAM (Random Access Memory) for temporary data storage, and the like. The first processor 40 includes, as functional elements or units, a seating detection unit 50, a mutual response unit 51, an acquisition unit 52, an evaluation unit 53, a recording unit 54, and a setting unit 55.

[0027] These functional elements of the first processor 40 are realized, for example, by the first processor 40, which is a computer, executing a first program 59 stored in the first memory 41. The first program 59 can be stored in any computer-readable storage medium. Alternatively, all or part of the functional elements of the first processor 40 may be configured by hardware including one or more electronic circuit components. Here, the first program 59, together with a second program 79 executed by the assistance device 5, constitutes the driver assistance program of the present disclosure.

[0028] The seating detection unit 50 detects that the driver P is seated in the driver's seat 10 of the vehicle 2. Specifically, the seating detection unit 50 detects that the driver P is seated in the driver's seat 10 by acquiring seating information, which is information on whether or not a person is seated in the driver's seat 10, from the assistance device 5 through Bluetooth communication with the assistance device 5 via the first communication device 42.

[0029] For example, the seating detection unit 50 first determines whether the mobile terminal 4 is in the immediate vicinity of the vehicle 2 based on the distance between the mobile terminal 4 and the vehicle 2 measured from the received radio wave intensity of the Bluetooth communication. More specifically, for example, the seating detection unit 50 determines whether the mobile terminal 4 is within a predetermined distance range (for example, within 1 meter) from the vehicle 2. Then, when the mobile terminal 4 is within the predetermined distance range from the vehicle 2, the seating detection unit 50 repeatedly acquires seating information from the assistance device 5, and determines that the driver P is seated in the driver's seat 10 when seating information indicating that a person is seated in the driver's seat 10 is received.

[0030] Alternatively, the seating detection unit 50 may acquire an image of the interior of the vehicle 2 captured by the interior camera 14 of the vehicle 2 from the assistance device 5 when Bluetooth communication is established with the assistance device 5 of the vehicle 2, and may detect that the driver P is seated in the driver's seat 10 based on the acquired image of the interior.

[0031] The mutual response unit 51 executes an interaction operation in which the mutual response is performed between the vehicle 2 and the driver P using an HMI device mounted on the vehicle 2. The mutual response unit 51 executes the above-mentioned interaction operation using the HMI device mounted on the vehicle 2 in accordance with instructions from the evaluation unit 53, which will be described later. In the interaction operation, the mutual response unit 51 performs a response prompting output that prompts the driver P to respond, and acquires a response input that is a response from the driver P to the response prompting output.

[0032] As described above, the response prompting output can be performed by the speaker 15 or the first touch panel 13, which is a display device. However, from the viewpoint of increasing the acceptability of the response prompting output to the driver P, it is desirable that the response prompting output be an audio output from the speaker 15. Furthermore, a response input from the driver P is received by the microphone 16 and / or the first touch panel 13 mounted on the vehicle 2.

[0033] The response prompting output may be a question and answer prompting the driver P to make a voice response. The response input may be a voice response from the driver P. For example, the response prompting output may be an open question that does not limit the range of response content (for example, a simple response such as "yes" or "no" is not an appropriate response), such as "Where are you going today?" or "What should we do about the air conditioning?" For example, the mutual response unit 51, in response to an instruction from the evaluation unit 53, selects one scenario from a plurality of predetermined question-and-answer scenarios and outputs one or more open questions to the driver P in accordance with the selected scenario. For each scenario, a standard sequence of questions and responses may be defined, for example, in such a way that, for each of a plurality of responses expected to one open question, a further open question to be asked in response to that response is defined.

[0034] The mutual response unit 51 acquires, by the microphone 16, the speech of the driver P as a response input from the driver P to each open question as a response prompting output.

[0035] Alternatively, the response prompting output may present questions for a cognitive test, as described above. For example, the interactive response unit 51, in response to an instruction from the evaluation unit 53, selects one cognitive test from a plurality of predetermined cognitive tests and outputs a series of tasks for the selected cognitive test on the screen of the first touch panel 13. The cognitive test may be a reaction time test in which a plurality of icons displayed on the screen of the first touch panel 13 are touched according to specific conditions, or a trail making test in which a plurality of icons are traced with a finger in an order that conforms to specific conditions.

[0036] The response prompting output presenting such cognitive test questions can be composed of cognitive test question output performed by displaying text and figures on the screen of first touch panel 13, as described above, and operation instructions such as "Please quickly touch the lit icon." The interactive response unit 51 can perform the response prompting output described above after audio output as an introduction to the cognitive test, such as "Please take a simple test before driving."

[0037] The response input from the driver P in response to the response prompting output configured as a cognitive test question may be, for example, various operations performed by touching the first touch panel 13 with a finger (for example, touch, swipe, tap, flick, etc.). The interactive response unit 51 obtains response input from the driver P to each question in the cognitive test via the first touch panel 13 (including, for example, information on the reaction time from the question being asked to touching, the time required for answering operations such as tracing, and the accuracy thereof).

[0038] Furthermore, when no response input is received from the driver P in response to the response prompting output, the mutual response unit 51 repeatedly executes the response prompting output at predetermined time intervals. This prevents the driver P from being judged as being in poor health even when the driver P is distracted and unable to make a response input, thereby enabling the driver's health condition to be more appropriately determined.

[0039] The acquisition unit 52 acquires biometric data of the driver P of the vehicle 2. In this embodiment, the acquisition unit 52 acquires the biometric data of the driver P (pulse wave, heart rate, blood pressure, etc.) from the wearable device 3 worn by the driver P. However, the wearable device 3 is just an example, and the acquisition unit 52 can acquire the biometric data of the driver P from various devices that can measure biometric data.

[0040] For example, the acquisition unit 52 may acquire biometric data (e.g., blood pressure) of the driver P from a facial image of the driver P captured in an image of the surroundings of the vehicle 2 captured by the external camera 18 or an interior image captured by the interior camera 14, according to conventional technology (see, for example, Japanese Patent Application Laid-Open No. 2022-008806). Alternatively, the acquisition unit 52 may acquire the driver's heart rate, which is biometric data of the driver, using the heart rate sensor 20 when the driver P grips the steering wheel 19.

[0041] When the first communicator 42 establishes Bluetooth communication with the support device 5, the acquisition unit 52 can acquire images captured by the external camera 18 and the indoor camera 14 and a sensor signal from the heart rate sensor 20 from the support device 5. The acquisition unit 52 can also extract an image of the driver P from the surrounding image or the indoor image using face image recognition processing according to conventional technology, and acquire the blood pressure value of the driver P.

[0042] The evaluation unit 53 evaluates the health condition of the driver P. In this embodiment, particularly, when the seating detection unit 50 detects that the driver P is seated in the driver's seat 10, the evaluation unit 53 estimates the health condition of the driver P based on the biometric data of the driver P acquired by the acquisition unit 52. Furthermore, when the evaluation unit 53 estimates that the health condition of the driver P is poor based on the biometric data, it instructs the interactive response unit 51 to execute the interaction operation and acquire a response input of the driver P in response to the response prompting output. Then, the evaluation unit 53 determines the health condition of the driver P based on the degree of suitability of the acquired response input with respect to the response prompting output.

[0043] For example, the evaluation unit 53 instructs the interactive response unit 51 to perform an interaction operation in the form of the question and answer described above, and evaluates the presence or absence of symptoms of language disorder or delirium in the driver P, or the severity of the symptoms, based on the voice response that is the response input from the driver P acquired by the interactive response unit 51. Then, the evaluation unit 53 judges the health condition of the driver P based on the results of the evaluation of the symptoms of language disorder. This makes it possible to detect signs or symptoms of a brain disease in the driver P and appropriately judge the health condition of the driver P.

[0044] Symptoms of speech disorders may include, for example, dysarthria (slurred speech) and aphasia (impaired speech production), and symptoms of delirium may include, for example, disorientation, memory impairment, and / or emotional or mood disorders.

[0045] The evaluation unit 53 evaluates the clarity of pronunciation (articulation), speech delay (word finding difficulty), pronunciation disturbance (fluency disorder), speech errors (phonological errors or word errors), etc., of the voice input of the driver P acquired as a response input, thereby evaluating the presence or absence of symptoms of a language disorder or the severity of the symptoms, and evaluates the suitability of the response input.In addition, the evaluation unit 53 evaluates the presence or absence of symptoms of delirium or the severity of the symptoms, by evaluating the voice input of the driver P acquired as a response input, including errors in recognition of time and place (disorientation, memory disorder), changes in speech tone (emotional and mood disorders), etc., and evaluates the suitability of the response input.

[0046] The results of these evaluations are expressed, for example, as scores that indicate the number of matching symptoms, and the higher the score, the lower the matching of the response input can be determined. For example, when the score exceeds a predetermined threshold, the evaluation unit 53 can determine that the health condition of the driver P is poor, and when the score is equal to or less than the threshold, the evaluation unit 53 can determine that the health condition of the driver P is good.

[0047] Alternatively, the evaluation unit 53 instructs the interactive response unit 51 to perform an interaction operation in the form of the above-mentioned cognitive test, and the interactive response unit 51 evaluates whether or not the driver P has a tendency toward dementia or the degree of the tendency toward dementia based on the response input from the driver P acquired by the first touch panel 13. Then, the evaluation unit 53 judges the health condition of the driver P based on the result of the above evaluation of the tendency toward dementia. This makes it possible to detect signs or symptoms of a brain disease in the driver P and appropriately judge the health condition of the driver P, just as in the case of an interaction operation in the form of a question and answer.

[0048] The evaluation result of the interaction action in the form of a cognitive test is expressed, for example, as a score indicating the rate of correct answers in the cognitive test, and it can be determined that the higher the score, the higher the suitability of the response input. For example, when the score exceeds a predetermined threshold, the evaluation unit 53 can determine that the health condition of the driver P is good, and when the score is equal to or less than the threshold, the evaluation unit 53 can determine that the health condition of the driver P is poor.

[0049] The recording unit 54 records the evaluation result of the driver P's health condition by the evaluation unit 53. In this embodiment, particularly, when the evaluation unit 53 estimates the driver P's health condition as poor based on the driver P's biometric data and then determines the driver P's health condition as "good" based on the degree of suitability of the response input from the driver P in the interaction action, the recording unit 54 stores correspondence information that associates the biometric data with the determination result of "good" in the storage device. As a result, when the evaluation unit 53 estimates the driver P's health condition based on the biometric data, the evaluation unit 53 can improve the accuracy of the estimation of the health condition by referring to the correspondence information stored in the storage device. Furthermore, for example, if the evaluation unit 53 is configured with a machine learning model that learns the relationship between the biometric data and the health condition by machine learning, the accuracy of the estimation of the health condition from the biometric data by the evaluation unit 53 can be improved by using the correspondence information as training data.

[0050] The storage device that stores the correspondence information may be a server provided outside the vehicle 2. The recording unit 54 may transmit the correspondence information to the server via a communication network such as the Internet according to conventional techniques. Alternatively or additionally, the storage device may be the first memory 41 of the mobile terminal 4 and / or the second memory 61 of the assistance device 5.

[0051] The setting unit 55, for example, cooperates with the assistance device 5 to set the operation of the vehicle 2. In this embodiment, particularly when the mutual response unit 51 does not receive a response input from the driver P during the interaction operation, the setting unit 55 instructs the assistance device 5 of the vehicle 2 to prohibit movement of the vehicle 2. As a result, when no response input is made by the driver P and it can be determined that the driver P may have a brain disease, movement of the vehicle 2 can be prohibited, thereby preventing dangerous driving that may occur due to the driver's health condition.

[0052] Furthermore, when the evaluation unit 53 determines that the health condition of the driver P is good based on the biometric data, the setting unit 55 instructs the assistance device 5 to apply a predetermined first setting to the operation settings of the vehicle 2. On the other hand, when the evaluation unit 53 estimates that the health condition of the driver P is poor based on the biometric data and then determines that the health condition of the driver P is good based on the degree of suitability of the response input from the driver P in the interaction operation, the setting unit 55 instructs the assistance device 5 to apply a predetermined second setting, which is different from the first setting, to the operation settings of the vehicle 2. As described above, the second setting may be, for example, a safety setting that is more considerate of safety than the first setting. If the biometric data is not good but the response input is normal, it is likely that the driver P is tired or sleep-deprived, and by switching the operating settings of the vehicle 2, appropriate assistance for safe driving can be provided to the driver P.

[0053] Here, the specific contents of the first setting and the second setting can be determined in advance in the assistance device 5 according to the vehicle functions provided in the vehicle 2. As described above, in the present embodiment, as an example, the assistance device 5 sets the following distance setting in the following vehicle running performed by the vehicle control device 6 of the vehicle 2 to be longer in the second setting than in the first setting. In addition, the assistance device 5 sets the initiation condition of the automatic brake performed by the vehicle control device 6 of the vehicle 2 so that deceleration starts earlier in the second setting than in the first setting.

[0054] In addition, if the evaluation unit 53 estimates that the health condition of the driver P is poor based on the biometric data, and then determines that the health condition of the driver P is also poor based on the degree of suitability of the response input from the driver P in the interaction operation, the setting unit 55 may instruct the assistance device 5 to apply the above-mentioned second setting to the operation setting of the vehicle 2, or may prohibit the movement of the vehicle 2.

[0055] FIG. 4 is a diagram showing the configuration of the assistance device 5 provided in the vehicle 2. As shown in FIG. The support device 5 includes a second processor 60, a second memory 61, a second communicator 62, and a second GNSS sensor 63.

[0056] The second memory 61 may be configured with a volatile and / or non-volatile semiconductor memory. The second communicator 62 is a transceiver for the assistance device 5 to communicate with other in-vehicle devices of the vehicle 2, such as the mobile terminal 4 and the vehicle control device 6. For example, the second communicator 62 may include a short-range communicator for performing short-range communication with the mobile terminal 4 in accordance with the Bluetooth communication standard, and a transceiver for performing communication via an in-vehicle network with various in-vehicle electronic control devices that control and monitor the operation of the vehicle 2, including the vehicle control device 6.

[0057] The second processor 60 is, for example, a computer including a CPU, etc. The second processor 60 may have a configuration including a ROM in which a program is written, a RAM for temporarily storing data, etc. The second processor 60 includes, as functional elements or functional units, an image providing unit 71, a sensor information providing unit 72, an operation setting unit 73, and an AV control unit 74.

[0058] These functional elements of the second processor 60 are realized, for example, by the second processor 60, which is a computer, executing a second program 79 stored in the second memory 61. The second program 79 can be stored in any computer-readable storage medium. Alternatively, all or part of the functional elements of the second processor 60 may be configured by hardware including one or more electronic circuit components. As described above, the second program 79, together with the first program 59 executed by the mobile terminal 4, constitutes the driver assistance program of the present disclosure.

[0059] In response to receiving a request from the mobile terminal 4, the image providing unit 71 transmits to the mobile terminal 4 images of the interior of the vehicle 2 taken by the interior camera 14 and / or images of the surroundings of the vehicle 2 taken by the external camera 18.

[0060] In response to receiving a request from the mobile terminal 4, the sensor information providing unit 72 transmits to the mobile terminal 4 information about a person sitting in the driver's seat 10 and the heart rate of the person touching the heart rate sensor 20, based on the sensor signals of the seating sensor 21 and the heart rate sensor 20, respectively.

[0061] The operation setting unit 73 performs operation settings for the vehicle 2. In response to an instruction from the mobile terminal 4, the operation setting unit 73 instructs the vehicle control device 6 included in the vehicle 2 to prohibit movement of the vehicle 2 (i.e., prohibits the vehicle 2 from running). Furthermore, in response to an instruction from the mobile terminal 4, the operation setting unit 73 applies a predetermined first setting or second setting to the operation settings of the vehicle control device 6 included in the vehicle 2.

[0062] As described above, the second setting can be a safety setting that takes safety into consideration more than the first setting. In this embodiment, in the second setting, the following distance in the preceding vehicle following running performed by the vehicle control device 6 is set to be longer than in the first setting. Alternatively or in addition to this, in the second setting, the start condition for the automatic brake performed by the vehicle control device 6 is set so that deceleration starts earlier than in the first setting.

[0063] The AV control unit 74 outputs image information and audio information from the first touch panel 13 and the speaker 15 using the AV device 12. The AV control unit 74 also receives and processes operation input from the first touch panel 13 and audio input from the microphone 16. In this embodiment, in particular, the AV control unit 74 follows instructions from the interactive response unit 51 received from the mobile terminal 4 and instructs the AV device 12 to perform an interaction operation using the first touch panel 13, the speaker 15, and / or the microphone 16, which are HMI devices.

[0064] Next, a description will be given of the procedure of the operation of the driver assistance system 1. Fig. 5 is a flow diagram showing the procedure of the process of the driver assistance method executed by the driver assistance system 1. The process of Fig. 5 is executed repeatedly.

[0065] When the process starts, first, the seating detection unit 50 of the mobile terminal 4 constituting the driver assistance system 1 determines whether or not the driver P carrying the mobile terminal 4 is seated in the driver's seat 10 of the vehicle 2 (S100). If the driver P is not seated in the driver's seat 10 (S100, NO), the seating detection unit 50 returns to step S100 and repeats the process, waiting for the driver P to sit in the driver's seat 10.

[0066] On the other hand, when the driver P is seated in the driver's seat (S100, YES), the acquisition unit 52 acquires biometric data of the driver P, for example, from the wearable device 3 (S102), and the evaluation unit 53 estimates the health condition of the driver P based on the biometric data (S104). As a result of the estimation, the evaluation unit 53 determines whether the health condition of the driver P can be estimated to be good (S106).

[0067] Then, when the evaluation unit 53 estimates that the driver's health condition is good (S106, YES), the setting unit 55 instructs the assistance device 5 to apply the first setting to the operation setting of the vehicle 2 in the vehicle control device 6 (S108), and ends this processing. Here, the first setting may be a default setting of the vehicle 2, and may be applied in advance to the vehicle control device 6 when the power switch of the vehicle 2 is turned on. In this case, in step S108, the setting unit 55 confirms that the first setting is applied to the vehicle control device 6, and maintains the application of the first setting.

[0068] On the other hand, when the driver's health condition is estimated to be poor in step S106 (S106, NO), the evaluation unit 53 instructs the interactive response unit 51 to execute an interaction operation (S112). The interactive response unit 51 determines whether or not a response input from the driver P in response to the response prompting output has been acquired (S114). For example, the interactive response unit 51 determines whether or not all response inputs from the driver P in response to a series of response prompting outputs have been acquired. As described above, when there is no response input from the driver P, the interactive response unit 51 repeats the corresponding response prompting output at predetermined time intervals. When there is no response input from the driver P for a predetermined number of times, the interactive response unit 51 ultimately determines that a response input from the driver P has not been acquired.

[0069] If no response input is received from the driver (S114, NO), the setting unit 55 instructs the assistance device 5 to prohibit the vehicle control device 6 from moving the vehicle 2 (S126), and ends this process.

[0070] On the other hand, when a response input from the driver P is acquired in step S114 (S114, YES), the evaluation unit 53 evaluates the degree of suitability of the response input from the driver P with respect to the response prompting output in the interaction operation (S116), and the evaluation unit 53 judges the health state of the driver P based on the degree of suitability (S118). The evaluation unit 53 judges whether the health state of the driver P can be judged as good (S120), and if it cannot be judged as good (S120, NO), the setting unit 55 instructs the assistance device 5 to instruct the vehicle control device 6 to prohibit movement of the vehicle 2 (S114), and ends this process.

[0071] On the other hand, if the evaluation unit 53 determines in step S120 that the health condition of the driver P is good (YES in step S120), the recording unit 54 stores, in a storage device (S122), correspondence information that associates the biometric data used to estimate the health condition in step S104 with the determination result of "good" in step S120. The storage device may be a server external to the vehicle 2, the first memory 41 of the mobile terminal 4, and / or the second memory 61 of the assistance device 5.

[0072] Next, the setting unit 55 instructs the assistance device 5 to apply a second setting, which is different from the first setting, to the operation setting of the vehicle 2 in the vehicle control device 6 (S124), and ends this process. As described above, the second setting may be a safety setting that takes safety into consideration more than the first setting.

[0073] In the above, step S102 corresponds to the acquisition step in this disclosure, steps S104, S116, and S118 correspond to the evaluation step in this disclosure, and step S112 corresponds to the mutual response step in this disclosure.

[0074] [Other embodiments] In the above-described embodiment, the vehicle 2 is shown as an example of a moving body, but the moving body that the driver P gets into is not limited to a vehicle and may be any moving body including a ship, an aircraft, or the like.

[0075] In the above-described embodiment, when the driver P sits in the driver's seat, operations such as estimating a health condition based on biometric data, determining a health condition based on an interaction action, and applying an operation setting to the vehicle control device 6 are performed. However, the timing of performing these operations is not limited to when the driver P sits in the driver's seat 10. These operations may also be performed when the vehicle 2 stops moving. For example, in the flow diagram shown in FIG. 5 , instead of determining whether the driver P is seated in the driver's seat 10 in step S100, the acquisition unit 52, the evaluation unit 53, etc. may determine whether the vehicle 2 has stopped, and when the vehicle has stopped, execute the subsequent steps.

[0076] In addition, in the flow chart of FIG. 5, when a response input from the driver P cannot be obtained in the interaction operation (NO in step S114), or when the health condition of the driver P cannot be determined to be good based on the suitability of the response input (NO in step S120), the movement of the vehicle 2 is prohibited in step S126 as an example, but the processing in step S126 is not limited to this.

[0077] The process in step S126 may be any process for supporting the driver P who is estimated to be in poor health. For example, in step S126, instead of or in addition to prohibiting the movement of the vehicle 2, the mobile terminal 4 constituting the driver assistance system 1 may report information that the driver P is in poor health, together with information about the current location of the driver P, to a medical institution, a support service operated by a private company, or the like, or may notify a person (for example, a family member of the driver P) registered in advance in the mobile terminal.

[0078] Furthermore, some of the functional elements provided in the mobile terminal 4 of this embodiment may be provided in a distributed manner in another device such as a support device 5 that is communicatively connected to the mobile terminal 4. For example, the mutual response unit 51, the acquisition unit 52, the evaluation unit 53, the recording unit 54, and / or the setting unit 55 provided in the mobile terminal 4 shown in FIG.

[0079] Alternatively, the driver assistance system 1 may include an additional server for information processing that is communicatively connected to the mobile terminal 4 and the assistance device 5, and the mutual response unit 51, the acquisition unit 52, the evaluation unit 53, the recording unit 54, and / or the setting unit 55 may be realized in a computer of the additional server. Alternatively, the mutual response unit 51, the acquisition unit 52, the evaluation unit 53, the recording unit 54, and / or the setting unit 55 may be realized in a distributed manner in the mobile terminal 4, the assistance device 5, and the additional server. In these cases, the first program 59 executed by the mobile terminal 4, the second program 79 executed by the assistance device 5, and the program executed by the computer of the additional server as a whole correspond to the driver assistance program in the present disclosure.

[0080] In the above-described embodiment, the HMI devices used for the interaction operation between the interactive unit 51 and the driver P are, as an example, the first touch panel 13, the speaker 15, and the microphone 16, but are not limited to these. The HMI devices used for the interaction operation may be any apparatus, equipment, and / or device that can prompt the driver P to respond and / or acquire a response from the driver P. Such HMI devices may be, in addition to the above-described first touch panel 13, the speaker 15, and the microphone 16, for example, a physical switch (a switch that operates by moving physically or mechanically in response to a human operation, unlike a virtual switch displayed on a touch panel, etc.), a display device that does not have a touch panel and only displays, or an imaging device such as the indoor camera 14 for receiving input operations by gestures from the user.

[0081] The present invention is not limited to the configurations of the above-described embodiments, and can be implemented in various forms without departing from the spirit of the present invention.

[0082] [Configurations supported by the above embodiments] The above-described embodiment supports the following configurations.

[0083] (Configuration 1) A driver assistance system comprising an acquisition unit that acquires biometric data of a driver of a mobile body, an evaluation unit that evaluates the health condition of the driver, and an interactive response unit that executes an interaction operation in which the evaluation unit responds to the driver using an HMI device mounted on the mobile body, wherein when the evaluation unit estimates that the driver's health condition is poor based on the driver's biometric data, it instructs the interactive response unit to execute the interaction operation, acquires a response input that is the driver's response to a response prompting output that prompts the driver to respond in the interaction operation, and judges the driver's health condition based on the degree of suitability of the response input to the response prompting output. According to the driver assistance system of configuration 1, the health condition of the driver of a mobile vehicle can be appropriately judged, including from the perspective of the possibility of brain disease, and appropriate assistance can be provided to the driver for safe driving.

[0084] (Configuration 2) A driver assistance system as described in Configuration 1, further comprising a setting unit that sets the operation of the moving body, and the setting unit prohibits the moving body from moving when the interactive response unit does not receive the response input in the interaction operation. According to the driver assistance system of configuration 2, when the driver does not input a response and it is determined that the driver may have a brain disease, the movement of the moving body can be prohibited, thereby preventing dangerous driving that may occur due to the driver's health condition.

[0085] (Configuration 3) A driver assistance system according to configuration 1 or 2, wherein the mutual response unit, when not receiving the response input from the driver in response to the response prompting output, repeatedly executes the response prompting output at predetermined time intervals. According to the driver assistance system of configuration 3, even when the driver is distracted and unable to input a response, the health condition of the driver is not judged to be poor, and the health condition of the driver can be more appropriately judged.

[0086] (Configuration 4) A driver assistance system according to any one of configurations 1 to 3, further comprising a recording unit that records the evaluation results of the evaluation unit regarding the driver's health condition, and when the evaluation unit estimates the driver's health condition to be poor based on the biometric data and then determines the driver's health condition to be good based on the degree of suitability, the recording unit associates the biometric data with the result of the judgment and stores the result in a storage device. According to the driver assistance system of configuration 4, it is possible to improve the accuracy of estimating the health state based on the biological data by using the correspondence information between the biological data and the judgment results stored in the storage device.

[0087] (Configuration 5) A driver assistance system according to any one of configurations 1 to 4, further comprising a setting unit that sets operation settings for the moving body, wherein the setting unit applies a predetermined first setting to the operation settings for the moving body when the evaluation unit determines that the driver's health condition is good based on the biometric data, and applies a predetermined second setting, different from the first setting, to the operation settings for the moving body when the evaluation unit estimates that the driver's health condition is poor based on the biometric data and then determines that the driver's health condition is good based on the degree of suitability. According to the driver assistance system of configuration 5, if the biometric data is not good but the response input is normal, it is considered that the driver is tired or sleep-deprived, and by switching the operation settings of the vehicle, appropriate assistance for safe driving can be provided to the driver.

[0088] (Configuration 6) A driver assistance system described in any one of configurations 1 to 5, wherein the response prompting output prompts the driver to respond by voice, the response input is a voice response from the driver to the response prompting output, the mutual response unit executes the interaction operation with an open question as the response prompting output, and the evaluation unit evaluates the presence or absence of symptoms of speech disorder or delirium in the driver or the degree of such symptoms based on the voice response that is the response input in the interaction operation, and judges the health condition of the driver based on the results of the evaluation. According to the driver assistance system of configuration 6, signs or symptoms of brain disease can be detected through conversation with the driver using open questions, making it possible to more appropriately judge the driver's health condition.

[0089] (Configuration 7) A driver assistance system described in any one of configurations 1 to 5, wherein the response prompting output is output to the driver via a speaker and / or a display device mounted on the mobile body, and the response input is received by a microphone and / or a touch panel mounted on the mobile body. According to the driver assistance system of configuration 7, various HMI devices can be used to communicate with the driver and determine the driver's health condition.

[0090] (Configuration 8) A driver assistance method executed by a computer, comprising: an acquisition step of acquiring biometric data of a driver of a mobile body; an evaluation step of evaluating the health condition of the driver; and an interactive response step of executing an interaction operation in the mobile body in which the driver responds to each other; wherein, in the evaluation step, when the driver's health condition is estimated to be poor based on the driver's biometric data, the interactive response step is executed to execute the interaction operation using an HMI device mounted on the mobile body, a response input which is the driver's response to a response prompting output that prompts the driver to respond in the interaction operation, and the health condition of the driver is judged based on the degree of suitability of the response input to the response prompting output. According to the driver assistance method of configuration 8, the health condition of the driver of a mobile vehicle can be appropriately judged, including from the perspective of the possibility of brain disease, and appropriate assistance can be provided to the driver for safe driving.

[0091] (Configuration 9) A driver assistance program that causes a computer of a driver assistance system to function as an acquisition unit that acquires biometric data of a driver of a mobile body, an evaluation unit that evaluates the health condition of the driver, and an interactive response unit that performs an interaction operation in the mobile body in which the evaluation unit responds to the driver, wherein when the evaluation unit estimates that the driver's health condition is poor based on the driver's biometric data, the evaluation unit instructs the interactive response unit to perform the interaction operation using an HMI device mounted on the mobile body, acquires a response input that is the driver's response to a response prompting output that prompts the driver to respond in the interaction operation, and judges the driver's health condition based on the degree of suitability of the response input to the response prompting output. According to the driver assistance program of configuration 9, a driver assistance system can be realized that can appropriately assess the health condition of a driver of a mobile vehicle, including the possibility of brain disease, and provide the driver with appropriate assistance for safe driving. [Explanation of symbols]

[0092] 1...Driver assistance system, 2...Vehicle, 3...Wearable terminal, 4...Mobile terminal, 5...Assistance device, 6...Vehicle control device, 10...Driver's seat, 11...Instrument panel, 12...AV device, 13...First touch panel, 14...Interior camera, 15...Speaker, 16...Microphone, 17...Door mirror, 18...External camera, 19...Steering wheel, 20...Heart rate sensor, 21...Seat occupancy sensor, 40...First processor, 41...First memory, 42...First communication device, 43...second touch panel, 44...first GNSS sensor, 45...acceleration sensor, 50...seating detection unit, 51...mutual response unit, 52...acquisition unit, 53...evaluation unit, 54...recording unit, 55...setting unit, 59...first program, 60...second processor, 61...second memory, 62...second communicator, 63...second GNSS sensor, 70...communication control unit, 71...image providing unit, 72...sensor information providing unit, 73...operation setting unit, 74...AV control unit, 79...second program.

Claims

1. an acquisition unit that acquires biometric data of a driver of a mobile object; an evaluation unit for evaluating the health state of the driver; an interactive response unit that executes an interaction operation in which the vehicle responds to the driver using an HMI device mounted on the vehicle; a setting unit for setting the operation of the moving body; Equipped with When the evaluation unit estimates that the health condition of the driver is poor based on the biological data of the driver, instructing the interactive response unit to execute the interaction operation, and acquiring a response input that is a response of the driver to a response prompting output that prompts the driver to respond in the interaction operation; determining a health state of the driver based on a degree of conformance of the response input with respect to the response prompting output; The setting unit When the evaluation unit determines that the driver's health state is good based on the biological data, a predetermined first setting is applied to an automatic braking start condition as an operation setting of the moving body; When the evaluation unit estimates that the driver's health state is poor based on the biological data and then determines that the driver's health state is good based on the degree of suitability, a predetermined second setting different from the first setting is applied to an automatic braking start condition as an operation setting of the moving body. Driver assistance systems.

2. a setting unit for setting the operation of the moving body, the setting unit prohibits the moving object from moving when the mutual response unit does not receive the response input in the interaction operation. The driver assistance system of claim 1 .

3. the interactive response unit repeatedly executes the response prompting output at predetermined time intervals when the interactive response unit does not receive the response input from the driver in response to the response prompting output. The driver assistance system of claim 1 .

4. a recording unit that records the evaluation result of the evaluation unit regarding the driver's health condition, When the evaluation unit determines that the driver's health condition is good based on the degree of suitability after estimating that the driver's health condition is poor based on the biometric data, the recording unit associates the biometric data with the result of the determination and stores the result in a storage device. The driver assistance system of claim 1 .

5. The second setting is a setting that sets the initiation condition for the automatic brake so that deceleration begins earlier than the first setting. The driver assistance system of claim 1 .

6. the response prompting output prompts the driver to make a voice response, and the response input is a voice response from the driver in response to the response prompting output, the interactive response unit executes the interaction operation with an open question as the response prompting output; the evaluation unit evaluates the presence or absence of symptoms of a speech disorder or delirium in the driver or the severity of the symptoms based on the voice response that is the response input in the interaction operation, and determines the health condition of the driver based on the result of the evaluation. A driver assistance system according to any one of claims 1 to 5.

7. the response prompting output is output to the driver via a speaker and / or a display device mounted on the vehicle; The response input is received by a microphone and / or a touch panel mounted on the mobile object. A driver assistance system according to any one of claims 1 to 5.

8. 1. A computer-implemented driver assistance method, comprising: an acquisition step of acquiring biometric data of a driver of a mobile object; an evaluation step of evaluating the driver's health status; a mutual response step of executing an interaction action in which the vehicle responds to the driver; a setting step for setting the operation of the moving body; and In the evaluation step, When the driver's health condition is estimated to be poor based on the driver's biological data, executing the mutual response step, executing the interaction operation using an HMI device mounted on the moving body, and acquiring a response input that is a response of the driver to a response prompting output that prompts the driver to respond in the interaction operation; determining a health state of the driver based on a degree of conformance of the response input with respect to the response prompting output; In the setting step, When the evaluation step determines that the driver's health condition is good based on the biological data, a predetermined first setting is applied to an automatic braking start condition as an operation setting of the moving body; When the driver's health condition is estimated to be poor based on the biological data in the evaluation step and then the driver's health condition is determined to be good based on the degree of suitability, a predetermined second setting different from the first setting is applied to an automatic braking start condition as an operation setting of the moving body. Driver assistance methods.

9. Driver assistance system computer, an acquisition unit that acquires biometric data of a driver of the mobile object; an evaluation unit for evaluating the health state of the driver; an interactive response unit that executes an interaction operation in which the vehicle responds to the driver; and a setting unit for setting the operation of the moving body; A driver assistance program that functions as When the evaluation unit estimates that the health condition of the driver is poor based on the biological data of the driver, instructing the interactive response unit to execute the interaction operation using an HMI device mounted on the vehicle, and acquiring a response input that is a response of the driver to a response prompting output that prompts the driver to respond in the interaction operation; determining a health state of the driver based on a degree of conformance of the response input with respect to the response prompting output; The setting unit When the evaluation unit determines that the driver's health state is good based on the biological data, a predetermined first setting is applied to an automatic braking start condition as an operation setting of the moving body; When the evaluation unit estimates that the driver's health state is poor based on the biological data and then determines that the driver's health state is good based on the degree of suitability, a predetermined second setting different from the first setting is applied to an automatic braking start condition as an operation setting of the moving body. Driver assistance programs.

Citation Information

Patent Citations

  • Transmitter / receiver and system constituted by microphone with built-in exhalation sensor

    JP2008130066A

  • Safety driving support device compatible with physical information of vehicle driver

    JP2018195249A

  • Control device of vehicle

    JP2019127238A

  • Wearable sensor and operation support system using the same

    JP2020177577A

  • Vehicular control device

    JP2021133842A