Notification control device, notification control method, and notification control program
The notification control system addresses the inadequacies of existing driver assistance systems by using a smartphone, smartwatch, and in-vehicle device to adjust audio output based on biometric and driving behavior, thereby enhancing safety and convenience in sustainable transportation.
Patent Information
- Application Number
- JP2024121013
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-26
- Publication Date
- 2026-02-05
AI Technical Summary
Existing driver assistance systems fail to adequately improve traffic safety and convenience by adjusting audio output based on a driver's health condition and response to audio, which is crucial for developing sustainable transportation systems.
A notification control system that includes a smartphone, smartwatch, and in-vehicle device to acquire biometric and driving behavior information, calculate driving risk levels, output audio advice, and adjust audio based on driver response.
Enables audio output tailored to a driver's health and behavior, enhancing safety and convenience by improving driver response to audio notifications.
Smart Images

Figure 2026019447000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a notification control device, a notification control method, and a notification control program. [Background technology]
[0002] Conventionally, a device has been proposed that acquires biometric information of a driver and driving information related to the driver's driving operation, and determines the driver's driving suitability based on the acquired information (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 2023-145468 Summary of the Invention [Problem to be solved by the invention]
[0004] In recent years, efforts to provide access to sustainable transport systems that take into consideration vulnerable transport participants have become more active. To achieve this, we are focusing on research and development into driver assistance systems that support the safety and health of drivers, thereby further improving road safety and convenience.
[0005] However, driver assistance systems have the challenge of further improving traffic safety and convenience by outputting audio according to the driver's health condition and driving behavior, and controlling the audio output based on the driver's response to the audio output.
[0006] To solve the above problems, the present application aims to output audio in accordance with the driver's health condition and driving behavior, and to control the audio output based on the driver's response to the audio output, thereby contributing to the development of a sustainable transportation system. [Means for solving the problem]
[0007] A first aspect for achieving the above object is a notification control device comprising: a first biometric information acquisition unit that acquires first biometric information, which is biometric information of a driver while driving a vehicle; a driving behavior acquisition unit that acquires driving behavior information indicating the driving behavior of the driver; a risk calculation unit that calculates a driving risk level that indicates the degree of risk the driver poses while driving the vehicle based on the first biometric information and the driving behavior information; an audio output unit that outputs audio to the driver depending on the degree of change in the driving risk level; a response acquisition unit that acquires response information indicating the driver's response to the audio output; and an output control unit that controls the audio output unit based on the response information.
[0008] A second aspect for achieving the above object is a notification control method including a first acquisition step of acquiring first biometric information, which is biometric information of the driver while driving the vehicle; a second acquisition step of acquiring driving behavior information indicating the driving behavior of the driver; a calculation step of calculating a driving risk level indicating the degree of risk to the driver while driving the vehicle based on the first biometric information and the driving behavior information; an output step of providing audio output to the driver depending on the degree of change in the driving risk level; a third acquisition step of acquiring response information indicating the driver's response to the audio output; and an output control step of controlling the audio output based on the response information.
[0009] A third aspect for achieving the above object is a notification control program that causes a processor provided in a notification control device to function as a first biometric information acquisition unit that acquires first biometric information, which is biometric information of the driver while driving the vehicle; a driving behavior acquisition unit that acquires driving behavior information that indicates the driving behavior of the driver; a risk calculation unit that calculates a driving risk level that indicates the degree of risk the driver is in while driving the vehicle based on the first biometric information and the driving behavior information; an audio output unit that outputs audio to the driver depending on the degree of change in the driving risk level; a response acquisition unit that acquires response information that indicates the driver's response to the audio output; and an output control unit that controls the audio output unit based on the response information. [Effects of the Invention]
[0010] According to the above-mentioned notification control device, notification control method, and notification control program, audio can be output according to the driver's health condition and driving behavior, and the audio output can be appropriately controlled based on the driver's response to the audio output. [Brief explanation of the drawings]
[0011] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a notification control system. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of a smartwatch. [Figure 3] FIG. 3 is a diagram illustrating an example of the configuration of the in-vehicle device. [Figure 4] FIG. 4 is a diagram illustrating an example of the configuration of the in-vehicle device. [Figure 5] FIG. 5 is a diagram illustrating an example of the configuration of a smartphone. [Figure 6] FIG. 6 is a diagram illustrating an example of the correlation between biometric information, health scores, and advice information. [Figure 7] FIG. 7 is a flowchart illustrating an example of processing by the smartphone. DETAILED DESCRIPTION OF THE INVENTION
[0012] Hereinafter, embodiments of a notification control device, a notification control method, and a notification control program will be described with reference to the drawings.
[0013] [1. Notification control system configuration] First, the configuration of the notification control system 100 will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of the notification control system 100. The notification control system 100 corresponds to an example of the above-mentioned "driver assistance system." As shown in Fig. 1, the notification control system 100 includes a smartphone 1, a smartwatch 2, and an in-vehicle device 3. The dashed two-dot lines in Fig. 1 indicate that the smartphone 1, the smartwatch 2, and the vehicle VC are owned by a driver DV. The driver DV is the driver who drives the vehicle VC.
[0014] The smartphone 1 wirelessly communicates with the smartwatch 2 and the in-car device 3 in accordance with a communication standard such as Wi-Fi (registered trademark). In addition, the smartphone 1 may wirelessly communicate with the smartwatch 2 and the in-car device 3 using a communication method compatible with communication standards such as Bluetooth (registered trademark), BLE (Bluetooth Low Energy), Wi-Fi (registered trademark), and Zigbee (registered trademark).
[0015] The smartphone 1 acquires biometric information BJ of the driver DV from the smartwatch 2. The smartphone 1 also acquires driving behavior information QJ from the in-vehicle device 3. Furthermore, the smartphone 1 calculates a driving risk level DR indicating the degree of risk that the driver DV poses while driving the vehicle VC based on the biometric information BJ and the driving behavior information QJ. The smartphone 1 also outputs audio in response to changes in the driving risk level DR. As the audio output, the smartphone 1 outputs, for example, advice information AD for the driver by audio. Furthermore, the smartphone 1 controls the audio output based on the driver DV's response to the audio output. The smartphone 1 corresponds to an example of a "notification control device." The smartphone 1 will be further described with reference to Figures 5-7.
[0016] The smartwatch 2 is worn on the wrist of the driver DV. The smartwatch 2 generates first biological information BJ1. The first biological information BJ1 includes, for example, the heart rate of the driver DV. The smartwatch 2 is further described with reference to FIG.
[0017] The in-vehicle device 3 is mounted on the vehicle VC. The in-vehicle device 3 generates driving behavior information QJ. The driving behavior information QJ includes operation information when the driver DV drives the vehicle VC. The in-vehicle device 3 will be further described with reference to FIGS.
[0018] [2. Smartwatch configuration] Next, the configuration of the smartwatch 2 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of the smartwatch 2. As shown in FIG. 2, the smartwatch 2 includes a second control unit 21, a second timing unit 22, a second wireless communication interface 23, a second touch panel 24, a biometric information generation unit 25, and a second position detection unit 26.
[0019] The second control unit 21 controls each unit of the smartwatch 2. The second control unit 21 includes a second processor 211 and a second memory 212.
[0020] The second memory 212 is configured, for example, by a non-volatile semiconductor memory or a combination of volatile and non-volatile semiconductor memories. The second processor 211 is configured by a CPU (Central Processing Unit) or an MPU (Micro Processor Unit). The second processor 211 may be configured by a single processor or by multiple processors. The second processor 211 controls each part of the smartwatch 2 by executing a second control program stored in the second memory 212.
[0021] The second clock unit 22 has a clocking function that measures the date and time. The second clock unit 22 also acquires date and time information from a server device (not shown). The second clock unit 22 adjusts the clocking function using the acquired date and time information. The second clock unit 22 displays the date and time information on the second touch panel 24.
[0022] The second wireless communication interface 23 includes an antenna for receiving wireless signals and an interface circuit for processing the wireless signals received by the antenna, and performs wireless communication with external devices including a server device (not shown) and the smartphone 1.
[0023] The second touch panel 24 includes a display panel and a touch sensor. The display panel is configured with a liquid crystal panel, an organic EL (Electro-Luminescence) panel, etc. The touch sensor detects a touch operation on the display panel by the driver DV. The second touch panel 24 displays an image on the display panel in accordance with an instruction from the second control unit 21. The second touch panel 24 also detects a touch operation on the display panel by the driver DV.
[0024] The biometric information generating unit 25 generates biometric information BJ. The biometric information generating unit 25 measures biometric information BJ, which is biometric information of the driver DV wearing the smart watch 2, at predetermined intervals. The biological information BJ includes first biological information BJ1 and second biological information BJ2. The first biological information BJ1 is biological information of the driver DV while the driver DV is driving the vehicle VC. The second biological information BJ2 is biological information of the driver DV before the driver DV starts driving.
[0025] The first biological information BJ1 includes, for example, first sleep information BJ11, first exercise information BJ12, and first stress information BJ13. The second biological information BJ2 includes, for example, second sleep information BJ21, second exercise information BJ22, and second stress information BJ23. The first sleep information BJ11, the first exercise information BJ12, the first stress information BJ13, the second sleep information BJ21, the second exercise information BJ22, and the second stress information BJ23 will be further described with reference to FIGS.
[0026] The biological information generation unit 25 outputs the measured biological information BJ to the second control unit 21. The second control unit 21 transmits the biological information BJ to the smartphone 1 via the second wireless communication interface .
[0027] The second position detection unit 26 includes a GNSS (Global Navigation Satellite System) sensor, and receives positioning signals transmitted from GNSS satellites to determine the position of the smartwatch 2, i.e., latitude, longitude, altitude, etc. The second position detection unit 26 outputs position information indicating the determined position to the second control unit 21.
[0028] [3. Configuration of in-vehicle device] Next, the configuration of the in-vehicle device 3 will be described with reference to Fig. 3 and Fig. 4. Fig. 3 is a diagram showing an example of the configuration of the in-vehicle device 3. As shown in FIG. 3, the in-vehicle device 3 includes an ECU (Electronic Control Unit) 31, a third timing unit 32, a third wireless communication interface 33, a third touch panel 34, a driving information generation unit 35, a response information generation unit 36, and a third position detection unit 37.
[0029] The ECU 31 controls each part of the in-vehicle device 3. The ECU 31 includes a third processor 311 and a third memory 312.
[0030] The third memory 312 is configured, for example, by a non-volatile semiconductor memory, or a combination of volatile and non-volatile semiconductor memories, etc. The third processor 311 is configured by a CPU, an MPU, etc. The third processor 311 may be configured by a single processor, or may be configured by multiple processors. The third processor 311 controls each part of the in-vehicle device 3 by executing a third control program stored in the third memory 312 .
[0031] The third clock unit 32 has a clocking function that measures the date and time. The third clock unit 32 also acquires date and time information from a server device (not shown). The third clock unit 32 adjusts the clocking function using the acquired date and time information. The third clock unit 32 displays the date and time information on the third touch panel 34.
[0032] The third wireless communication interface 33 includes an antenna for receiving wireless signals and an interface circuit for processing the wireless signals received by the antenna, and performs wireless communication with external devices including a server device (not shown) and the smartphone 1.
[0033] The third touch panel 34 includes a display panel and a touch sensor. The display panel is configured with a liquid crystal panel, an organic EL panel, etc. The touch sensor detects a touch operation on the display panel by the driver DV. The third touch panel 34 displays an image on the display panel in accordance with an instruction from the ECU 31. The third touch panel 34 also detects a touch operation on the display panel by the driver DV.
[0034] The driving information generating unit 35 generates the driving behavior information QJ. The driving information generator 35 acquires driving behavior information QJ from various sensors arranged in the vehicle VC. The driving behavior information QJ includes, for example, vehicle speed information, acceleration information, accelerator operation information, brake operation information, and steering operation information. The driving behavior information QJ may include road information on which the vehicle VC is traveling. The road information includes, for example, construction information, traffic congestion information, and the like.
[0035] The vehicle speed information indicates the traveling speed of the vehicle VC. The acceleration information indicates the acceleration detected by an acceleration sensor. The acceleration sensor detects, for example, the vertical acceleration, the longitudinal acceleration, and the lateral acceleration of the vehicle VC. The accelerator operation information indicates the state of operation of the accelerator pedal 341 by the driver DV. The accelerator operation information includes, for example, the depression amount and depression speed of the accelerator pedal 341. The brake operation information indicates the state of operation of the brake pedal 342 by the driver DV. The brake operation information includes, for example, the depression amount and depression speed of the brake pedal 342. The steering operation information indicates the state of operation of the steering wheel 340 by the driver DV. The steering operation information includes, for example, the steering angle of the steering wheel 340 and the rate of change of the steering angle. The accelerator pedal 341, brake pedal 342, and steering wheel 340 are further described with reference to FIG.
[0036] The driving information generating unit 35 outputs the driving behavior information QJ acquired from various sensors to the ECU 31. The ECU 31 transmits the driving behavior information QJ to the smartphone 1 via the third wireless communication interface 33.
[0037] The response information generating unit 36 acquires response information AJ from various sensors arranged in the vehicle VC. The response information AJ indicates the response of the driver DV to the audio output to the driver DV. The response information generating unit 36 acquires the response information AJ from various sensors arranged in the vehicle VC. The response information AJ includes, for example, driver image information and driver voice information. The driver image information indicates an image of the driver DV. The image of the driver DV is generated by the driver camera 331. The driver voice information indicates the voice uttered by the driver DV. The voice uttered by the driver DV is acquired by the driver microphone 332. The driver camera 331 and the driver microphone 332 will be further described with reference to FIG.
[0038] The response information generating unit 36 outputs the response information AJ acquired from the various sensors to the ECU 31. The ECU 31 transmits the response information AJ to the smartphone 1 via the third wireless communication interface 33.
[0039] The third position detection unit 37 includes a GNSS sensor, and receives positioning signals transmitted from GNSS satellites to determine the position of the vehicle VC, i.e., latitude, longitude, altitude, etc. The third position detection unit 37 outputs position information indicating the determined position to the ECU 31.
[0040] Next, the configuration of the in-vehicle device 3 will be further described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the configuration of the in-vehicle device 3. Fig. 4 is a diagram of the vehicle VC viewed from above the driver's seat toward the front. As shown in Fig. 4, the steering wheel 340 described with reference to Fig. 3 is disposed, for example, in front of the driver DV. The accelerator pedal 341 and the brake pedal 342 described with reference to Fig. 3 are disposed, for example, at the feet of the driver DV. The third touch panel 34 described with reference to Fig. 3 is disposed, for example, on the left side of the steering wheel 340, approximately in the center of the dashboard. The driver camera 331 and the driver microphone 332 described with reference to Fig. 3 are disposed, for example, in front of the steering wheel 340 on the dashboard. The ECU 31 described with reference to Fig. 3 is disposed, for example, in the dashboard in front of the passenger seat. The third wireless communication interface 33 described with reference to Fig. 3 is disposed, for example, in the dashboard in front of the passenger seat. It should be noted that the third timer 32, driving information generator 35, response information generator 36, and third position detector 37 described with reference to FIG. 3 are omitted in FIG.
[0041] The driver camera 331 is equipped with an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor), captures an image of the driver DV, and generates a captured image. A driver image is generated. The driver image includes, for example, at least the driver's head. It is also preferable that the driver image includes, for example, both hands of the driver. The driver camera 331 outputs the generated driver image to the ECU 31. The driver camera 331 constitutes a part of the response information generating unit 36. The driver image corresponds to an example of response information AJ.
[0042] As shown in FIG. 4, the in-vehicle device 3 further includes a navigation device 321, a front camera 330, a left speaker 333a, a right speaker 333b, an acceleration sensor 334, and a holder 350. The navigation device 321 includes the third position detection unit 37 described with reference to Fig. 3, and displays, for example, the position of the vehicle VC on a map on the third touch panel 34. The navigation device 321 is placed inside the dashboard in front of the passenger seat.
[0043] The front camera 330 captures an image of the area in front of the vehicle VC. The front camera 330 is disposed inside the upper part of the windshield. The left speaker 333a is disposed inside the left door of the vehicle VC. The right speaker 333b is disposed inside the right door of the vehicle VC. The left speaker 333a and the right speaker 333b output audio. For example, the left speaker 333a and the right speaker 333b may output audio indicating advice information AD.
[0044] The acceleration sensor 334 detects, for example, the acceleration of the vehicle VC in the vertical, longitudinal, and lateral directions. The acceleration sensor 334 is disposed, for example, inside the dashboard. The holder 350 supports the smartphone 1 so that it can be fixed to the dashboard. When the driver DV drives the vehicle VC, the driver DV attaches the smartphone 1 to the holder 350. The holder 350 is, for example, arranged on the dashboard on the left front side of the driver's seat.
[0045] [4. Smartphone configuration] Next, the configuration of the smartphone 1 will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of the configuration of the smartphone 1. The smartphone 1 includes a first control unit 11, a first clock unit 12, a first wireless communication interface 13, a first touch panel 14, a first position detection unit 15, a speaker 16, a microphone 17, and a camera 18.
[0046] The first control unit 11 controls each unit of the smartphone 1. The first control unit 11 includes a first processor 11A and a first memory 11B.
[0047] The first memory 11B is configured, for example, by a non-volatile semiconductor memory or a combination of volatile and non-volatile semiconductor memories. The first processor 11A is configured by a CPU, an MPU, etc. The first processor 11A may be configured by a single processor, or may be configured by multiple processors. The first processor 11A controls each part of the smartphone 1 by executing a first control program PG1 stored in the first memory 11B.
[0048] The first clock unit 12 has a clocking function that measures the date and time. The first clock unit 12 also acquires date and time information from a server device (not shown). The first clock unit 12 adjusts the clocking function using the acquired date and time information. The first clock unit 12 displays the date and time information on the first touch panel 14.
[0049] The first wireless communication interface 13 includes an antenna for receiving wireless signals and an interface circuit for processing the wireless signals received by the antenna, and performs wireless communication with external devices including a server device, a smart watch 2, and an in-vehicle device 3 (not shown).
[0050] The first touch panel 14 includes a display panel and a touch sensor. The display panel is configured with a liquid crystal panel, an organic EL panel, etc. The touch sensor detects a touch operation on the display panel by the driver DV. First touch panel 14 displays an image on the display panel in accordance with an instruction from first control unit 11. First touch panel 14 displays, for example, an image showing advice information AD on the display panel in accordance with an instruction from first control unit 11. The first touch panel 14 also detects touch operations made by the driver DV on the display panel.
[0051] The first position detection unit 15 includes a GNSS sensor and receives positioning signals transmitted from GNSS satellites to determine the position of the smartphone 1, i.e., the latitude, longitude, altitude, etc. The first position detection unit 15 outputs position information indicating the determined position to the first control unit 11.
[0052] The speaker 16 outputs various sounds in accordance with instructions from the first control unit 11. For example, the speaker 16 outputs sounds indicating advice information AD in accordance with instructions from the first control unit 11. The output of the voice indicating the advice information AD corresponds to an example of "voice output."
[0053] The microphone 17 receives various types of audio input in accordance with instructions from the first control unit 11. The microphone 17 outputs the received audio to the first control unit 11. Furthermore, the microphone 17 may receive, for example, audio from the driver's DV. The voice from the driver DV corresponds to an example of response information AJ.
[0054] Camera 18 captures various images in accordance with instructions from first control unit 11. Camera 18 includes an image sensor such as a CCD or CMOS. Camera 18 outputs the generated images to first control unit 11. Furthermore, the camera 18 may capture, for example, a driver DV and generate a captured image. The image captured by the driver DV corresponds to an example of response information AJ.
[0055] The first control unit 11 includes a first biometric information acquisition unit 111, a driving behavior acquisition unit 112, a risk calculation unit 113, an audio output unit 114, a response acquisition unit 115, an image output unit 116, a second biometric information acquisition unit 117, a health condition evaluation unit 118, an output control unit 119, and an information storage unit 110. Specifically, the first processor 11A executes the first control program PG1 stored in the first memory 11B to function as a first biological information acquisition unit 111, a driving behavior acquisition unit 112, a risk calculation unit 113, a voice output unit 114, a response acquisition unit 115, an image output unit 116, a second biological information acquisition unit 117, a health state evaluation unit 118, and an output control unit 119. Furthermore, the first processor 11A executes the first control program PG1 stored in the first memory 11B to cause the first memory 11B to function as an information storage unit 110. The first processor 11A corresponds to an example of a "processor." The first control program PG1 corresponds to an example of a "notification control program."
[0056] The information storage unit 110 stores biological information BJ and driving behavior information QJ. The biological information BJ includes first biological information BJ1 and second biological information BJ2. The first biological information BJ1 is acquired from the smartwatch 2 by the first biological information acquisition unit 111, and stored in the information storage unit 110 by the first biological information acquisition unit 111, for example. The second biological information BJ2 is acquired from the smartwatch 2 by the second biological information acquisition unit 117, and stored in the information storage unit 110 by the second biological information acquisition unit 117, for example. The driving behavior information QJ is acquired from the in-vehicle device 3 by the driving behavior acquisition unit 112, and is stored in the information storage unit 110 by the driving behavior acquisition unit 112, for example.
[0057] The first biological information acquisition unit 111 acquires first biological information BJ1. The first biological information BJ1 is biological information of the driver DV while driving the vehicle VC. "While driving the vehicle VC" refers to the period from when the driver DV starts driving the vehicle VC to when the driver DV finishes driving the vehicle VC. The first biological information acquisition unit 111 acquires the first biological information BJ1 from, for example, the smart watch 2. The first biological information BJ1 includes, for example, first sleep information BJ11, first exercise information BJ12, and first stress information BJ13.
[0058] The first sleep information BJ11 indicates, for example, the level of drowsiness estimated from the second sleep information BJ21 described below. The first exercise information BJ12 indicates, for example, the level of athletic ability estimated from the second exercise information BJ22 described below. The first stress information BJ13 indicates the level of stress felt by the driver DV. The first stress information BJ13 includes heart rate information and heart rate variability information. The heart rate information indicates, for example, the number of heart rates per minute. The heart rate variability information indicates the state of change in heart rate.
[0059] The driving behavior acquisition unit 112 acquires driving behavior information QJ indicating the driving behavior of the driver DV. The driving behavior acquisition unit 112 acquires the driving behavior information QJ, for example, from the in-vehicle device 3. The driving behavior information QJ includes, for example, vehicle speed information, acceleration information, accelerator operation information, brake operation information, and steering operation information.
[0060] The risk calculation unit 113 calculates a driving risk DR indicating the degree of risk that the driver DV poses while driving the vehicle VC, based on the first biological information BJ1 and the driving behavior information QJ. The risk calculation unit 113 generates a reference driving characteristic indicating the characteristics of the driving behavior of the driver DV, for example, based on the history of the driving behavior information QJ of the driver DV's past driving. The risk calculation unit 113 also evaluates the degree of variation of the driving behavior indicated by the driving behavior information QJ acquired by the driving behavior acquisition unit 112 during the current driving compared to the reference driving characteristic. Then, based on the degree of variation, the risk calculation unit 113 calculates a driving risk DR indicating the degree of risk of the driver DV while driving the vehicle VC.
[0061] For example, a case where the driving behavior is accelerator operation when starting will be described. The risk calculation unit 113 generates a reference driving characteristic that indicates the characteristics of the accelerator operation of the driver DV when starting, for example, based on the history of accelerator operation at the time of starting in the driver DV's past driving. The reference driving characteristic is, for example, an acceleration distribution that indicates the frequency distribution of the average value of acceleration due to accelerator operation at the time of starting.
[0062] Next, the risk calculation unit 113 evaluates the degree of variation in the acceleration distribution of the accelerator operation at the time of starting indicated by the driving behavior information QJ acquired by the driving behavior acquisition unit 112 during the current drive. For example, if the acceleration due to accelerator operation at the time of starting the current driving is within the range of the first threshold value with respect to the average value of the acceleration distribution, the risk calculation unit 113 calculates the driving risk level DR as "0." The first threshold value is, for example, twice the standard deviation. The risk calculation unit 113 sets a smaller first threshold value as the health condition indicated by the first biological information BJ1 becomes worse.
[0063] For example, if the acceleration due to accelerator operation at the time of starting in the current driving is outside the range of the first threshold value of the acceleration distribution with respect to the average value of the acceleration distribution and is included in the range of the second threshold value of the acceleration distribution, the risk calculation unit 113 calculates the driving risk level DR as "1." The range of the second threshold value is, for example, three times the standard deviation. For example, if the acceleration due to the accelerator operation in the current driving is outside the range of the second threshold value of the acceleration distribution with respect to the average value of the acceleration distribution, the risk calculation unit 113 calculates the driving risk level DR as "2". The risk calculation unit 113 sets the second threshold to a smaller value as the health condition indicated by the first biological information BJ1 becomes worse. In this way, the risk calculation unit 113 calculates the driving risk DR of the accelerator operation indicated by the driving behavior information QJ acquired during the current driving.
[0064] The audio output unit 114 outputs audio to the driver DV according to the degree of change in the driving risk level DR. The audio output unit 114 causes the speaker 16 to output, for example, audio indicating advice information AD for the driver DV. The audio output unit 114 may output audio indicating advice information AD for the driver DV to the left speaker 333a and right speaker 333b of the vehicle VC. In this case, the audio output unit 114 instructs the ECU 31 of the vehicle VC to output audio indicating advice information AD for the driver DV to the left speaker 333a and right speaker 333b of the vehicle VC.
[0065] Furthermore, the audio output unit 114 outputs audio indicating advice information AD at a predetermined frequency depending on the degree of change in the driving risk level DR and the travel route on which the vehicle VC is traveling. The audio output unit 114 acquires the route along which the vehicle VC is traveling from the navigation device 321 via the ECU 31 of the vehicle VC, for example. Furthermore, the audio output unit 114 calculates an integrated value of the driving risk level DR after the driver DV starts driving, for example. Then, when the integrated value of the driving risk level DR reaches a third threshold value or more, the audio output unit 114 outputs audio indicating advice information AD to the driver DV. The third threshold value is, for example, "3." Furthermore, even if the accumulated value of the driving risk level DR has not reached the third threshold value or higher, if there is an intersection or the like where accidents frequently occur in the direction of travel of the vehicle VC on the route on which the vehicle VC is traveling, the audio output unit 114 outputs audio indicating advice information AD.
[0066] The response acquisition unit 115 acquires response information AJ indicating the response of the driver DV to the audio output. The response information AJ includes, for example, driver image information and driver voice information. The response acquisition unit 115 acquires the response information AJ from, for example, the in-vehicle device 3.
[0067] The output control unit 119 controls the audio output unit 114 based on the response information AJ. For example, if the response information AJ acquired by the response acquisition unit 115 indicates an unpleasant emotion of the driver DV, the audio output unit 114 is instructed to stop audio output indicating the advice information AD or to reduce the frequency of audio output indicating the advice information AD. The response information AJ indicates the unpleasant emotion of the driver DV when, for example, it is estimated from the driver image information that the driver has an unpleasant facial expression. Also, the response information AJ indicates the unpleasant emotion of the driver DV when, for example, it is estimated from the driver voice information that the driver is making a statement that indicates an unpleasant emotion.
[0068] Furthermore, when the response information AJ acquired by the response acquisition unit 115 indicates an unpleasant feeling of the driver DV, the output control unit 119 instructs the image output unit 116 to output an image to the driver DV. For example, the output control unit 119 instructs the image output unit 116 to output an image showing advice information AD to the driver DV.
[0069] The image output unit 116 outputs an image showing advice information AD for the driver DV according to the degree of change in the driving risk level DR. The image output unit 116 outputs an image showing advice information AD for the driver DV, for example, to the first touch panel 14. The image output unit 116 may also output an image showing advice information AD for the driver DV, for example, to the third touch panel 34 of the vehicle VC. In this case, the image output unit 116 instructs the ECU 31 of the vehicle VC to output an image showing advice information AD for the driver DV to the third touch panel 34 of the vehicle VC.
[0070] The second biological information acquisition unit 117 acquires the second biological information BJ2. The second biological information BJ2 is biological information of the driver DV before starting to drive the vehicle VC. The second biological information acquisition unit 117 acquires the second biological information BJ2 from, for example, the smart watch 2. The second biological information BJ2 includes second sleep information BJ21, second exercise information BJ22, and second stress information BJ23.
[0071] The second sleep information BJ21 includes, for example, sleep time information and information indicating sleep quality. The sleep time information indicates, for example, the driver DV's sleep time per day. The information indicating sleep quality includes, for example, the driver DV's REM sleep time information and non-REM sleep time information per day.
[0072] The second exercise information BJ22 includes, for example, step count information and exercise time information. The step count information indicates, for example, the cumulative number of steps taken by the driver DV per day. The exercise time information indicates, for example, the cumulative amount of exercise time taken by the driver DV per day.
[0073] The second stress information BJ23 includes heart rate information and heart rate variability information. The heart rate information indicates, for example, the number of heart rates per minute. The heart rate variability information indicates the state of changes in the heart rate.
[0074] The health condition evaluation unit 118 evaluates the health condition of the driver DV based on the second biological information BJ2 and generates a health rating RS indicating the level of the driver DV's health condition. The health rating RS is a health rating corresponding to each of the five abilities indicating the driver DV's driving ability AB. The driving ability AB is composed of, for example, planning ability AB1, perception ability AB2, attention ability AB3, judgment ability AB4, and operation ability AB5. The health rating RS is composed of a planning ability rating RS1, a perceptual ability rating RS2, an attention ability rating RS3, a judgment ability rating RS4, and an operational ability rating RS5.
[0075] The planning ability score RS1 indicates the health score RS for the planning ability AB1. The planning ability AB1 is, for example, the ability of the driver DV to plan a driving plan. The driving plan is, for example, a plan to drive the vehicle VC from a parking position to a destination.
[0076] The perceptual ability score RS2 indicates the health score RS for the perceptual ability AB2. The perceptual ability AB2 is, for example, the ability of the driver DV to perceive the surrounding situation while driving. The attention ability score RS3 indicates the health score RS for the attention ability AB3. The attention ability AB3 is, for example, the ability of the driver DV to pay attention to the surrounding situation in order to foresee danger while driving.
[0077] The judgment ability score RS4 indicates the health score RS for the judgment ability AB4. The judgment ability AB4 is the driver DV's ability to determine what operation to perform depending on the surrounding situation while driving. The driving ability score RS5 indicates the health score RS for the driving ability AB5. The driving ability AB5 is the ability of the driver DV to perform appropriate driving operations in accordance with the surrounding situation while driving.
[0078] The audio output unit 114 outputs audio based on the degree of change in the health score RS and the driving risk level DR. Audio output means, for example, outputting advice information AD by audio. The correlation between the health score RS and the advice information AD will be further explained with reference to FIG.
[0079] The output control unit 119 controls the audio output unit 114 to adjust the frequency of audio output. For example, if the health score RS is equal to or greater than a predetermined value and the driving behavior acquisition unit 112 acquires driving behavior information QJ indicating an increase in the driving risk level DR, and then the driving behavior acquisition unit 112 acquires driving behavior information QJ indicating no improvement in driving behavior during the first period, the output control unit 119 increases the frequency of audio output from the audio output unit 114. Audio output indicates that audio indicating advice information AD for the driver DV is output.
[0080] The health rating RS is composed of a planning ability rating RS1, a perceptual ability rating RS2, an attention ability rating RS3, a judgment ability rating RS4, and an operational ability rating RS5. A health rating RS equal to or greater than a predetermined value means, for example, that all of the planning ability rating RS1, the perceptual ability rating RS2, the attention ability rating RS3, the judgment ability rating RS4, and the operational ability rating RS5 are equal to or greater than the predetermined value. The health state evaluation unit 118 evaluates each of the planning ability score RS1, perception ability score RS2, attention ability score RS3, judgment ability score RS4, and operation ability score RS5, for example, on a scale of 10. In this case, the predetermined value is, for example, "7 points."
[0081] The driving behavior information QJ that increases the driving risk level DR includes, for example, sudden acceleration, sudden braking, sudden steering, operations that cause the inter-vehicle distance to be less than the appropriate value, and operations that cause the vehicle VC to sway. The driving behavior information QJ indicating that the driving behavior will not improve is, for example, driving behavior information QJ in which the driving risk level DR increases. The first period is, for example, "10 minutes."
[0082] Furthermore, for example, if the health score RS is equal to or greater than a predetermined value and the driving behavior acquisition unit 112 acquires driving behavior information QJ indicating an increase in the driving risk level DR, and then the driving behavior acquisition unit 112 acquires driving behavior information QJ indicating an improvement in driving behavior in the second period, the output control unit 119 reduces the frequency of audio output from the audio output unit 114. Audio output refers to outputting audio showing advice information AD for the driver DV.
[0083] The driving behavior information QJ indicating that the driving behavior has improved is, for example, driving behavior information QJ in which the driving risk level DR does not increase. The second period is, for example, "20 minutes."
[0084] Furthermore, for example, if the response information AJ acquired by the response acquisition unit 115 indicates the unpleasant feelings of the driver DV and the driving behavior acquisition unit 112 acquires driving behavior information QJ indicating that the driving behavior will not improve in the third period, the output control unit 119 instructs the audio output unit 114 to output audio having content that is not directly related to the driving operation of the driver DV. The audio output indicates that audio indicating advice information AD for the driver DV is to be output.
[0085] The content that is not directly related to the driving operation of the driver DV corresponds to the content indicated by the advice information AD. An example of advice information AD that is not directly related to the driving operation of the driver DV is advice information AD that says, "Please take a break." Also, if there is a passenger in the vehicle VC who is capable of driving, an example of advice information AD that is not directly related to the driving operation of the driver DV is advice information AD that says, "Please have the passenger take over driving." The third period is, for example, "10 minutes."
[0086] Further, for example, the output control unit 119 instructs the audio output unit 114 to output audio with different content when the driving risk level DR increases based on the first biometric information BJ1 and when the driving risk level DR increases based on the driving behavior information QJ. An example of a case where the driving risk level DR has increased based on the first biological information BJ1 is when the driver DV's heart rate exceeds the normal range. The normal range is set based on, for example, the driver DV's heart rate history. As an example of a case where the driving risk level DR has increased based on the first biometric information BJ1, if the driver DV's heart rate exceeds the normal range, audio output is made indicating advice information AD such as, "You seem to be feeling unwell, so please take a break." As an example of a case where the driving risk level DR has increased based on the driving behavior information QJ, if a sudden acceleration occurs, audio output is provided showing advice information AD such as, "A sudden acceleration has been detected. It is dangerous, so please be careful in the future."
[0087] [5. Correlation between biometric information, health score, and address information] Next, the correlation between the biometric information BJ, the health rating score RS, and the advice information AD will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the correlation between the biometric information BJ, the health rating score RS, and the advice information AD. The health rating score RS is a rating for each of five abilities that indicate the driving ability AB. Fig. 6 shows a correlation diagram 500. The correlation diagram 500 includes biometric information BJ, health rating score RS, and advice information AD.
[0088] As shown in FIG. 6, the biometric information BJ includes first biometric information BJ1 and second biometric information BJ2. The first biological information BJ1 is biological information of the driver DV while the driver DV is driving, and includes, for example, first sleep information BJ11, first exercise information BJ12, and first stress information BJ13. The second biological information BJ2 is biological information of the driver DV before the driver DV starts driving, and includes, for example, second sleep information BJ21, second exercise information BJ22, and second stress information BJ23. The health score RS also includes a planning ability score RS1, a perception ability score RS2, an attention ability score RS3, a judgment ability score RS4, and an operation ability score RS5.
[0089] The health condition evaluation unit 118 evaluates the health condition of the driver DV based on the second biological information BJ2 and generates a health score RS indicating the level of the health condition of the driver DV. The health score RS is composed of a planning ability score RS1, a perception ability score RS2, an attention ability score RS3, a judgment ability score RS4, and an operation ability score RS5. The health state evaluation unit 118 may correct the health score RS using the first biological information BJ1.
[0090] The arrow between the first biological information BJ1 and the health score RS in FIG. 6 indicates that there is a correlation. For example, the planning ability score RS1 is correlated with the second sleep information BJ21, so the health state evaluation section 118 generates the planning ability score RS1 based on the second sleep information BJ21. Furthermore, for example, the perceptual ability score RS2 is correlated with the second sleep information BJ21, so the health state evaluation section 118 generates the perceptual ability score RS2 based on the second sleep information BJ21.
[0091] Furthermore, for example, the attention ability score RS3 is correlated with the second sleep information BJ21, the second exercise information BJ22, and the second stress information BJ23. Therefore, the health state evaluation unit 118 generates the attention ability score RS3 based on the second sleep information BJ21, the second exercise information BJ22, and the second stress information BJ23. Furthermore, for example, the judgment ability score RS4 is correlated with the second sleep information BJ21 and the second exercise information BJ22. Therefore, the health state evaluation section 118 generates the judgment ability score RS4 based on the second sleep information BJ21 and the second exercise information BJ22. Furthermore, for example, the operation ability score RS5 is correlated with the second sleep information BJ21 and the second exercise information BJ22. Therefore, the health state evaluation unit 118 generates the operation ability score RS5 based on the second sleep information BJ21 and the second exercise information BJ22.
[0092] As shown in FIG. 6, the advice information AD includes, for example, first advice information AD1, second advice information AD2, third advice information AD3, fourth advice information AD4, and fifth advice information AD5. The driving behavior information QJ includes first behavior information QJ1, second behavior information QJ2, third behavior information QJ3, fourth behavior information QJ4, and fifth behavior information QJ5 as driving behavior information QJ that increases the driving risk level DR.
[0093] The first advice information AD1 is, for example, advice information AD regarding the operation of the accelerator pedal 341 when the driver DV starts the vehicle VC. The first advice information AD1 is, for example, advice information AD urging the driver DV not to make a sudden start. The first behavior information QJ1 is the operation of the accelerator pedal 341 when the driver DV starts the vehicle VC. When the driving risk level DR increases due to the first behavior information QJ1, the audio output unit 114 outputs, for example, audio indicating the first advice information AD1 to the speaker 16.
[0094] The second advice information AD2 is, for example, advice information AD regarding the operation of the brake pedal 342 when the driver DV stops the vehicle VC. The second advice information AD2 is, for example, advice information AD urging the driver DV not to make a sudden stop. The second behavior information QJ2 is the operation of the brake pedal 342 when the driver DV stops the vehicle VC. When the driving risk level DR increases due to the second behavior information QJ2, the audio output unit 114 causes the speaker 16 to output, for example, audio indicating the second advice information AD2.
[0095] The third advice information AD3 is, for example, advice information AD regarding the operation of the steering wheel 340 when the driver DV makes the vehicle VC overtake another vehicle. The third advice information AD3 is, for example, advice information AD urging the driver DV not to make abrupt turns. The third behavior information QJ3 is the operation of the steering wheel 340 when the driver DV makes the vehicle VC overtake another vehicle. When the driving risk level DR increases due to the third behavior information QJ3, the audio output unit 114 causes the speaker 16 to output, for example, audio indicating the third advice information AD3.
[0096] The fourth advice information AD4 is, for example, advice information AD regarding the distance between the vehicle VC driven by the driver DV and another vehicle traveling ahead. The fourth advice information AD4 is, for example, advice information AD urging the driver DV to maintain an appropriate distance between the vehicles. The fourth behavior information QJ4 is an operation that changes the distance between the vehicle VC driven by the driver DV and another vehicle traveling ahead. The fourth behavior information QJ4 includes, for example, operation of the accelerator pedal 341 and operation of the brake pedal 342. When the driving risk level DR increases due to the fourth behavior information QJ4, the audio output unit 114 outputs, for example, audio indicating the fourth advice information AD4 from the speaker 16.
[0097] The fifth advice information AD5 is advice information AD related to lateral sway of the vehicle VC driven by the driver DV. The fifth advice information AD5 is, for example, advice information AD urging the driver DV to suppress lateral sway of the vehicle VC. The fifth behavior information QJ5 is an operation that causes the vehicle VC driven by the driver DV to sway left or right. The fifth behavior information QJ5 includes, for example, a loose grip on the steering wheel 340. When the driving risk level DR increases due to the fifth behavior information QJ5, the audio output unit 114 causes the speaker 16 to output, for example, audio indicating the fifth advice information AD5.
[0098] The arrow between the health score RS and the advice information AD in FIG. 6 indicates that there is a correlation. The audio output unit 114 selects, for example, advice information AD corresponding to the lowest score among the planning ability score RS1, the perception ability score RS2, the attention ability score RS3, the judgment ability score RS4, and the operation ability score RS5.
[0099] 6, for example, the planning ability score RS1 is correlated with the first advice information AD1 and the second advice information AD2. Therefore, when the planning ability score RS1 is the lowest score, the audio output unit 114 notifies, for example, the first advice information AD1 and the second advice information AD2 with priority.
[0100] Furthermore, the perceptual ability rating RS2 is correlated with the third advice information AD3 and the fifth advice information AD5. Therefore, when the perceptual ability rating RS2 is the lowest rating, the audio output unit 114 notifies, for example, the third advice information AD3 and the fifth advice information AD5 with priority.
[0101] Furthermore, the attention ability rating score RS3 is correlated with the first advice information AD1, the third advice information AD3, and the fourth advice information AD4. Therefore, when the attention ability rating score RS3 is the lowest rating score, the audio output unit 114 notifies, for example, the first advice information AD1, the third advice information AD3, and the fourth advice information AD4 with priority.
[0102] Furthermore, the judgment ability rating RS4 is correlated with the second advice information AD2, the third advice information AD3, and the fifth advice information AD5. Therefore, when the judgment ability rating RS4 is the lowest rating, the audio output unit 114 notifies, for example, the second advice information AD2, the third advice information AD3, and the fifth advice information AD5 with priority.
[0103] Furthermore, the operation ability score RS5 is correlated with the fifth advice information AD5. Therefore, when the operation ability score RS5 is the lowest score, the voice output unit 114 notifies the fifth advice information AD5 with priority, for example.
[0104] [6. Smartphone Processing] Next, the processing of the smartphone 1 will be described with reference to Fig. 7. Fig. 6 is a flowchart showing an example of the processing of the smartphone 1. First, in step S101, the second biological information acquisition unit 117 acquires the second biological information BJ2 from, for example, the smart watch 2. The second biological information BJ2 is the biological information of the driver DV before starting to drive the vehicle VC. Next, in step S103, the health condition evaluation unit 118 evaluates the health condition of the driver DV based on the second biological information BJ2, and generates a health score RS indicating the level of the driver DV's health condition.
[0105] Next, in step S105, the first control unit 11 determines whether the driver DV has started driving the vehicle VC. For example, the first control unit 11 determines that the driver DV has started driving the vehicle VC when the smartphone 1 is attached to the holder 350. If the first control unit 11 determines that the driver DV has not started driving the vehicle VC (step S105; NO), the process returns to step S101. If the first control unit 11 determines that the driver DV has started driving the vehicle VC (step S105; YES), the process proceeds to step S107. Then, in step S107, the first biological information acquisition unit 111 acquires the first biological information BJ1 from the smartwatch 2. Next, in step S109, the health state evaluation unit 118 corrects the health score RS generated in step S103 based on the first biological information BJ1.
[0106] Next, in step S111, the driving behavior acquisition unit 112 acquires driving behavior information QJ indicating the driving behavior of the driver DV from the in-vehicle device 3, for example. Next, in step S113, the risk calculation unit 113 calculates a driving risk DR indicating the degree of risk that the driver DV poses while driving the vehicle VC, based on the first biological information BJ1 and the driving behavior information QJ. Next, in step S115, the audio output unit 114 outputs audio to the driver DV indicating advice information AD for the driver DV according to the degree of change in the driving risk level DR. Also, for example, when the audio output from the audio output unit 114 is stopped, the image output unit 116 outputs an image indicating advice information AD for the driver DV according to the degree of change in the driving risk level DR. In the following description, a case will be described in which the audio output unit 114 outputs audio indicating advice information AD for the driver DV to the driver DV according to the degree of change in the driving risk level DR.
[0107] Next, in step S117, the response acquisition unit 115 acquires, from the in-vehicle device 3, for example, response information AJ indicating the response of the driver DV to the audio output. Next, in step S119, the output control unit 119 determines whether or not the response information AJ indicates an unpleasant feeling of the driver DV. If the output control unit 119 determines that the response information AJ does not indicate the unpleasant feeling of the driver DV (step S119; NO), the process proceeds to step S125. If the output control unit 119 determines that the response information AJ indicates the unpleasant feeling of the driver DV (step S119; YES), the process proceeds to step S121. Then, in step S121, the output control unit 119 instructs the audio output unit 114 to stop outputting the audio indicating the advice information AD. Next, in step S123, the output control unit 119 instructs the image output unit 116 to start outputting images to the driver DV.
[0108] Next, in step S125, the first control unit 11 determines whether the driver DV has finished driving the vehicle VC. For example, the first control unit 11 determines that the driver DV has finished driving the vehicle VC when the smartphone 1 is removed from the holder 350. If the first control unit 11 determines that the driver DV has not finished driving the vehicle VC (step S125; NO), the process returns to step S107. If the first control unit 11 determines that the driver DV has finished driving the vehicle VC (step S125; YES), the process then ends.
[0109] Step S107 corresponds to an example of a "first acquisition step." Step S111 corresponds to an example of a "second acquisition step." Step S113 corresponds to an example of a "calculation step." Step S115 corresponds to an example of an "output step." Step S117 corresponds to an example of a "third acquisition step." Step S121 corresponds to an example of an "output control step."
[0110] [7. Composition and Effects] As described with reference to Figures 1 to 7, the smartphone 1 of this embodiment includes a first biometric information acquisition unit 111 that acquires first biometric information BJ1, which is biometric information of the driver DV while driving the vehicle VC, a driving behavior acquisition unit 112 that acquires driving behavior information QJ that indicates the driving behavior of the driver DV, a risk calculation unit 113 that calculates a driving risk level DR that indicates the degree of risk while the driver DV is driving the vehicle VC based on the first biometric information BJ1 and the driving behavior information QJ, an audio output unit 114 that outputs audio to the driver DV depending on the degree of change in the driving risk level DR, a response acquisition unit 115 that acquires response information AJ that indicates the response of the driver DV to the audio output, and an output control unit 119 that controls the audio output unit 114 based on the response information AJ.
[0111] Therefore, the driving risk level DR indicating the degree of risk while the driver DV is driving the vehicle VC is calculated based on the first biometric information BJ1 and the driving behavior information QJ, and audio output is given to the driver DV according to the degree of change in the driving risk level DR, so that audio output can be given appropriately. Also, response information AJ indicating the response of the driver DV to the audio output is obtained, and the audio output is controlled based on the response information AJ, so that audio output can be given appropriately.
[0112] The smartphone 1 also includes a second biometric information acquisition unit 117 that acquires second biometric information BJ2, which is biometric information of the driver DV before starting to drive the vehicle VC, and a health condition evaluation unit 118 that evaluates the health condition of the driver DV based on the second biometric information BJ2 and generates a health rating RS that indicates the degree of health condition, and the audio output unit 114 outputs audio based on the health rating RS and the degree of change in the driving risk level DR.
[0113] Therefore, since the audio output is performed based on the health rating RS indicating the degree of health state of the driver DV and the degree of change in the driving risk level DR, the audio output can be performed appropriately.
[0114] In addition, in the smartphone 1, if the health rating RS is equal to or greater than a predetermined value, and the driving behavior acquisition unit 112 acquires driving behavior information QJ that increases the driving risk level DR, and then the driving behavior acquisition unit 112 acquires driving behavior information QJ during the first period that indicates that the driving behavior has not improved, the output control unit 119 increases the frequency of audio output from the audio output unit 114.
[0115] That is, when the driver DV is in a healthy state and acquires driving behavior information QJ that indicates an increase in the driving risk level DR, and then acquires driving behavior information QJ in the first period that indicates no improvement in the driving behavior, the frequency of audio output is increased. Therefore, by appropriately setting the first period, the frequency of audio output can be appropriately increased.
[0116] In addition, in the smartphone 1, if the health rating RS is equal to or greater than a predetermined value, and the driving behavior acquisition unit 112 acquires driving behavior information QJ that increases the driving risk level DR, and then the driving behavior acquisition unit 112 acquires driving behavior information QJ in a second period that indicates that the driving behavior has improved, the output control unit 119 causes the audio output unit 114 to reduce the frequency of audio output.
[0117] That is, when the driver DV is in a healthy state and acquires driving behavior information QJ that increases the driving risk level DR, and then acquires driving behavior information QJ that indicates an improvement in the driving behavior during the second period, the frequency of audio output is reduced. Therefore, by appropriately setting the second period, the frequency of audio output can be appropriately reduced.
[0118] In addition, in the smartphone 1, the audio output unit 114 outputs audio at a predetermined frequency depending on the degree of change in the driving risk level DR and the travel route on which the vehicle VC is traveling.
[0119] Therefore, the frequency of audio output can be appropriately adjusted because audio output is performed at a predetermined frequency depending on the degree of change in the driving risk level DR and the route traveled by the vehicle VC. For example, if there are multiple locations close to each other where traffic accidents frequently occur on the route traveled by the vehicle VC, it is preferable to increase the frequency of audio output.
[0120] In addition, in the smartphone 1, the risk calculation unit 113 generates standard driving characteristics that indicate the characteristics of the driver's driving behavior based on the history of driving behavior information QJ from the driver DV's past driving, evaluates the degree of variation of the driving behavior indicated by the driving behavior information QJ acquired by the driving behavior acquisition unit 112 during the current driving compared to the standard driving characteristics, and calculates a driving risk DR that indicates the degree of danger the driver DV poses while driving the vehicle VC based on the degree of variation.
[0121] That is, based on the driving behavior history of the driver DV in the past, a reference driving characteristic indicating the characteristics of the driver's driving behavior is generated, the degree of variation of the driving behavior indicated by the driving behavior information QJ acquired in the current driving compared to the reference driving characteristic is evaluated, and based on the degree of variation, a driving risk level DR indicating the degree of risk that the driver DV poses while driving the vehicle VC is calculated. Therefore, the driving risk level DR can be calculated appropriately.
[0122] In addition, in the smartphone 1, if the response information AJ acquired by the response acquisition unit 115 indicates an unpleasant feeling of the driver DV, the output control unit 119 instructs the audio output unit 114 to stop audio output or reduce the frequency of audio output.
[0123] Therefore, if the response information AJ indicates the unpleasant feelings of the driver DV, it instructs the audio output to be stopped or the frequency of audio output to be reduced, so that the audio output can be appropriately controlled according to the feelings of the driver DV.
[0124] The smartphone 1 also has an image output unit 116 that outputs an image to the driver DV depending on the degree of change in the driving risk level DR, and the output control unit 119 instructs the image output unit 116 to output an image to the driver DV when the response information AJ acquired by the response acquisition unit 115 indicates an unpleasant feeling on the part of the driver DV.
[0125] Therefore, when the response information AJ indicates an unpleasant emotion of the driver DV, an image output to the driver DV is instructed, and the image output can be appropriately controlled according to the emotion of the driver DV, because an image output is less likely to cause an unpleasant emotion to the driver DV than an audio output.
[0126] Furthermore, in the smartphone 1, if the response information AJ acquired by the response acquisition unit 115 indicates the unpleasant feelings of the driver DV and the driving behavior acquisition unit 112 acquires driving behavior information QJ during the third period indicating that the driving behavior will not improve, the output control unit 119 instructs the audio output unit 114 to output audio content that is not directly related to the driving operation of the driver DV.
[0127] If the response information AJ indicates the unpleasant feelings of the driver DV and driving behavior information QJ indicating that the driving behavior will not improve is acquired during the third period, the audio output is instructed to have content that is not directly related to the driving operation of the driver DV. Therefore, by appropriately setting the third period, the audio output can be appropriately controlled according to the feelings of the driver DV.
[0128] In addition, in the smartphone 1, the output control unit 119 instructs the audio output unit 114 to output audio with different content when the driving risk level DR increases based on the first biometric information BJ1 and when the driving risk level DR increases based on the driving behavior information QJ.
[0129] Therefore, when the driving risk level DR increases based on the first biometric information BJ1 and when the driving risk level DR increases based on the driving behavior information QJ, different audio output content is instructed to be output, thereby allowing the audio output to be controlled appropriately.
[0130] In addition, the notification control method of this embodiment includes a first acquisition step of acquiring first biometric information BJ1, which is biometric information of the driver DV while driving the vehicle VC; a second acquisition step of acquiring driving behavior information QJ indicating the driving behavior of the driver DV; a calculation step of calculating a driving risk level DR indicating the degree of risk to the driver DV while driving the vehicle VC based on the first biometric information BJ1 and the driving behavior information QJ; an output step of providing audio output to the driver DV depending on the degree of change in the driving risk level DR; a third acquisition step of acquiring response information AJ indicating the response of the driver DV to the audio output; and an output control step of controlling the audio output based on the response information AJ.
[0131] Therefore, the notification control method according to this embodiment has the same effects as the smartphone 1 according to this embodiment.
[0132] In addition, the first control program PG1 of this embodiment causes the first processor 11A provided in the smartphone 1 to function as a first biometric information acquisition unit 111 that acquires first biometric information BJ1, which is biometric information of the driver DV while driving the vehicle VC, a driving behavior acquisition unit 112 that acquires driving behavior information QJ that indicates the driving behavior of the driver DV, a risk calculation unit 113 that calculates a driving risk level DR that indicates the degree of risk that the driver DV is facing while driving the vehicle VC based on the first biometric information BJ1 and the driving behavior information QJ, an audio output unit 114 that outputs audio to the driver DV depending on the degree of change in the driving risk level DR, a response acquisition unit 115 that acquires response information AJ that indicates the response of the driver DV to the audio output, and an output control unit 119 that controls the audio output unit 114 based on the response information AJ.
[0133] Therefore, the first control program PG1 according to this embodiment has the same effects as the smartphone 1 according to this embodiment.
[0134] 8. Other Embodiments The above-described embodiment is a preferred embodiment of the present invention, but the present invention is not limited to the above-described embodiment and various modifications are possible within the scope of the gist of the present invention.
[0135] In the present embodiment, the case where the "notification control device" is configured by the smartphone 1 has been described, but the embodiment is not limited to this. The "notification control device" may be configured by, for example, a personal computer, a tablet device, a server device, etc. Furthermore, at least a part of the "notification control device" may be configured by the ECU 31 of the in-vehicle device 3.
[0136] In this embodiment, the smart watch 2 generates biometric information of the driver DV, but the embodiment is not limited to this. A "device" that generates biometric information of the driver DV may be attached to the driver DV and generate the biometric information BJ. For example, a "device" that generates biometric information of the driver DV may be attached to the arm, head, foot, etc. of the driver DV. Also, for example, the "device" may be a smart innerwear that is attached to the innerwear worn by the user U. Also, for example, the "device" may be a sensing device that is attached to the skin or inside the body of the user U.
[0137] In this embodiment, a case will be described in which the audio output unit 114 outputs the audio indicating the advice information AD from the speaker 16, but the embodiment is not limited to this. The audio output unit 114 may output the audio indicating the advice information AD from at least one of the left speaker 333a and the right speaker 333b of the vehicle VC. In addition, in the present embodiment, a case will be described in which the image output unit 116 displays an image showing the advice information AD on the first touch panel 14, but the embodiment is not limited to this. The image output unit 116 may also display an image showing the advice information AD on the fourth touch panel 44 provided in the in-car device 3.
[0138] For example, the configurations of the smartwatch 2 shown in Fig. 2, the in-car device 3 shown in Fig. 3, and the smartphone 1 shown in Fig. 5 each show functional configurations, and the specific implementation form is not particularly limited. In other words, it is not necessarily necessary to implement hardware corresponding to each functional unit individually, and it is also possible to implement a configuration in which a single processor executes a program to realize the functions of multiple functional units. Furthermore, some of the functions realized by software in the above embodiments may be realized by hardware, or some of the functions realized by hardware may be realized by software.
[0139] 7 are divided according to the main processing content to facilitate understanding of the processing of the smartphone 1, and the present invention is not limited by the manner in which the processing units are divided or the names of the processing units shown in the flowchart of FIG. 7. Furthermore, the processing of the smartphone 1 can be divided into more processing units according to the processing content, or one processing unit can be divided so as to include more processes. Furthermore, the processing order of the above flowchart is not limited to the example shown in the figure.
[0140] 9. Configurations Supported by the Above Embodiments The above embodiment is a specific example of the following configuration.
[0141] (Configuration 1) A notification control device comprising: a first biometric information acquisition unit that acquires first biometric information, which is biometric information of a driver while driving a vehicle; a driving behavior acquisition unit that acquires driving behavior information that indicates the driving behavior of the driver; a risk calculation unit that calculates a driving risk level that indicates the degree of risk the driver poses while driving the vehicle based on the first biometric information and the driving behavior information; an audio output unit that outputs audio to the driver depending on the degree of change in the driving risk level; a response acquisition unit that acquires response information that indicates the driver's response to the audio output; and an output control unit that controls the audio output unit based on the response information.
[0142] The notification control device of configuration 1 calculates a driving risk level indicating the degree of risk while the driver is driving the vehicle based on the first biological information and the driving behavior information, and outputs audio to the driver according to the degree of change in the driving risk level, so that the audio output can be appropriately performed. Also, response information indicating the driver's response to the audio output is acquired, and the audio output is controlled based on the response information, so that the audio output can be appropriately controlled.
[0143] (Configuration 2) The notification control device according to configuration 1 includes a second biometric information acquisition unit that acquires second biometric information, which is biometric information of the driver before starting to drive the vehicle, and a health condition evaluation unit that evaluates the driver's health condition based on the second biometric information and generates a health rating that indicates the level of the health condition, and the audio output unit performs the audio output based on the health rating and the level of change in the driving risk level.
[0144] The notification control device of configuration 2 outputs audio based on the health score indicating the degree of health condition of the driver and the degree of change in the driving risk level, so that audio can be output appropriately.
[0145] (Configuration 3) The notification control device according to configuration 2, wherein, when the health score is equal to or greater than a predetermined value and the driving behavior acquisition unit acquires driving behavior information indicating that the driving risk level is increasing, and then the driving behavior acquisition unit acquires driving behavior information indicating that the driving behavior is not improving in a first period, the output control unit increases the frequency of the audio output by the audio output unit.
[0146] The notification control device of configuration 3 can appropriately increase the frequency of audio output by appropriately setting the first period.
[0147] (Configuration 4) The notification control device according to configuration 2 or 3, wherein, when the health score is equal to or greater than a predetermined value and the driving behavior acquisition unit acquires driving behavior information in which the driving risk level increases, and then the driving behavior acquisition unit acquires driving behavior information in a second period that indicates that the driving behavior has improved, the output control unit causes the audio output unit to reduce the frequency of outputting the audio.
[0148] The notification control device of configuration 4 can appropriately reduce the frequency of audio output by appropriately setting the second period.
[0149] (Configuration 5) 5. The notification control device according to any one of configurations 1 to 4, wherein the audio output unit performs the audio output at a predetermined frequency depending on the degree of change in the driving risk level and the driving route on which the vehicle is traveling.
[0150] The notification control device of configuration 5 outputs audio at a predetermined frequency depending on the degree of change in the driving risk level and the route the vehicle is traveling, so the frequency of audio output can be appropriately adjusted.
[0151] (Configuration 6) The notification control device described in any one of configurations 1 to 5, wherein the risk calculation unit generates reference driving characteristics indicating the characteristics of the driver's driving behavior based on a history of the driving behavior information in the driver's past driving, evaluates the degree of variation of the driving behavior indicated by the driving behavior information acquired by the driving behavior acquisition unit in the current driving from the reference driving characteristics, and calculates a driving risk indicating the degree of risk the driver poses while driving the vehicle based on the degree of variation.
[0152] The notification control device of configuration 6 can properly calculate the driving risk level.
[0153] (Configuration 7) The notification control device according to any one of configurations 1 to 6, wherein, when the response information acquired by the response acquisition unit indicates an unpleasant feeling of the driver, the output control unit instructs the audio output unit to stop the audio output or reduce the frequency of the audio output.
[0154] The notification control device of configuration 7 instructs the driver to stop audio output or reduce the frequency of audio output when the response information indicates the driver's unpleasant emotions, thereby enabling the audio output to be appropriately controlled according to the driver's emotions.
[0155] (Configuration 8) The notification control device according to any one of configurations 1 to 7, further comprising an image output unit that outputs an image to the driver depending on the degree of change in the driving risk level, and the output control unit instructs the image output unit to output an image to the driver when the response information acquired by the response acquisition unit indicates an unpleasant feeling of the driver.
[0156] The notification control device of configuration 8 instructs the driver to output an image to the driver when the response information indicates that the driver is feeling uncomfortable, and can therefore appropriately control the image output in accordance with the driver's feelings, because image output is less likely to cause discomfort to the driver than audio output.
[0157] (Configuration 9) The notification control device according to any one of configurations 1 to 8, wherein, when the response information acquired by the response acquisition unit indicates the driver's discomfort and the driving behavior acquisition unit acquires driving behavior information in a third period indicating that the driving behavior will not improve, the output control unit instructs the audio output unit to output audio content that is not directly related to the driver's driving operation.
[0158] The notification control device of configuration 9 can appropriately control the audio output in accordance with the emotion of the driver DV by appropriately setting the third period.
[0159] (Configuration 10) The notification control device according to any one of configurations 1 to 9, wherein the output control unit instructs the audio output unit to output audio with different content when the driving risk level increases based on the first biometric information and when the driving risk level increases based on the driving behavior information.
[0160] The notification control device of configuration 10 instructs the device to output different audio content when the driving risk level increases based on the first biometric information and when the driving risk level increases based on the driving behavior information, thereby enabling appropriate control of the audio output.
[0161] (Configuration 11) A notification control method comprising: a first acquisition step of acquiring first biometric information, which is biometric information of a driver while driving a vehicle; a second acquisition step of acquiring driving behavior information indicating the driving behavior of the driver; a calculation step of calculating a driving risk level indicating the degree of risk to the driver while driving the vehicle based on the first biometric information and the driving behavior information; an output step of providing audio output to the driver depending on the degree of change in the driving risk level; a third acquisition step of acquiring response information indicating the driver's response to the audio output; and an output control step of controlling the audio output unit based on the response information.
[0162] The notification control method of configuration 11 has the same configuration as the notification control device of configuration 1, and therefore has the same effects as the notification control device of configuration 1.
[0163] (Configuration 12) A notification control program that causes a processor provided in a notification control device to function as a first biometric information acquisition unit that acquires first biometric information, which is biometric information of the driver while driving the vehicle, a driving behavior acquisition unit that acquires driving behavior information that indicates the driving behavior of the driver, a risk calculation unit that calculates a driving risk level that indicates the degree of risk the driver is experiencing while driving the vehicle based on the first biometric information and the driving behavior information, an audio output unit that outputs audio to the driver depending on the degree of change in the driving risk level, a response acquisition unit that acquires response information that indicates the driver's response to the audio output, and an output control unit that controls the audio output unit based on the response information.
[0164] The notification control program of configuration 12 has the same configuration as the notification control device of configuration 1, and therefore has the same effects as the notification control device of configuration 1. [Explanation of symbols]
[0165] 100...Notification control system, 1...Smartphone (notification control device), 11...First control unit, 11A...First processor (processor), 11B...First memory, 110...Information storage unit, 111...First biometric information acquisition unit, 112...Driving behavior acquisition unit, 113...Danger level calculation unit, 114...Audio output unit, 115...Response acquisition unit, 116...Image output unit, 117...Second biometric information acquisition unit, 118...Health state evaluation unit, 119...Output control unit, 16...Speaker, 17...Microphone, 14...First touch panel, 2...Smart watch, 25...Biometric information generation unit, 3...In-vehicle device, 31...ECU, 35...Driving information generation unit, AB...Driving ability, AB1...Plan Ability, AB2...perceptual ability, AB3...attention ability, AB4...judgment ability, AB5...operational ability, AD...advice information, AJ...response information, BJ...biological information, BJ1...first biological information, BJ11...first sleep information, BJ12...first movement information, BJ13...first stress information, BJ2...second biological information, BJ21...second sleep information, BJ22...second movement information, BJ23...second stress information, DV...driver, PG1...first control program (notification control program), QJ...driving information, RS...rating, RS1...planning ability rating, RS2...perceptual ability rating, RS3...attention ability rating, RS4...judgment ability rating, RS5...operational ability rating, VC...vehicle.
Claims
1. a first biometric information acquisition unit that acquires first biometric information that is biometric information of a driver while driving a vehicle; a driving behavior acquisition unit that acquires driving behavior information indicating the driving behavior of the driver; a risk level calculation unit that calculates a driving risk level indicating a degree of risk that the driver is experiencing while driving the vehicle based on the first biological information and the driving behavior information; a voice output unit that outputs a voice to the driver according to the degree of change in the driving risk level; a response acquisition unit that acquires response information indicating a response of the driver to the audio output; an output control unit that controls the audio output unit based on the response information; A notification control device comprising:
2. a second biometric information acquisition unit that acquires second biometric information, which is biometric information of the driver before starting to drive the vehicle; a health condition evaluation unit that evaluates the driver's health condition based on the second biological information and generates a health score that indicates the level of the driver's health condition; Equipped with The audio output unit performs the audio output based on the health rating and the degree of change in the driving risk level. The notification control device according to claim 1 .
3. When the health rating is equal to or greater than a predetermined value, and the driving behavior acquisition unit acquires driving behavior information indicating that the driving risk level increases, and then the driving behavior acquisition unit acquires driving behavior information indicating that the driving behavior does not improve in a first period, the output control unit increases the frequency with which the audio output unit outputs the audio; The notification control device according to claim 2 .
4. When the health rating is equal to or greater than a predetermined value, and the driving behavior acquisition unit acquires driving behavior information indicating an increase in the driving risk level, and then the driving behavior acquisition unit acquires driving behavior information indicating an improvement in the driving behavior in a second period, the output control unit controls the audio output unit to reduce the frequency of outputting the audio; The notification control device according to claim 2 .
5. The audio output unit outputs the audio at a predetermined frequency depending on the degree of change in the driving risk level and the driving route on which the vehicle is traveling. The notification control device according to claim 1 .
6. The risk calculation unit generating a reference driving characteristic indicating a characteristic of the driving behavior of the driver based on a history of the driving behavior information of the driver in the past; evaluating a degree of variation of the driving behavior indicated by the driving behavior information acquired by the driving behavior acquisition unit during the current driving with respect to the reference driving characteristic; calculating a driving risk level indicating a degree of risk to the driver while driving the vehicle based on the degree of the variation; The notification control device according to claim 1 .
7. The output control unit When the response information acquired by the response acquisition unit indicates an unpleasant feeling of the driver, the audio output unit is instructed to stop the audio output or to reduce the frequency of the audio output. The notification control device according to any one of claims 1 to 6.
8. an image output unit that outputs an image to the driver according to the degree of change in the driving risk level; The output control unit When the response information acquired by the response acquisition unit indicates an unpleasant feeling of the driver, the image output unit is instructed to output an image to the driver. The notification control device according to any one of claims 1 to 6.
9. When the response information acquired by the response acquisition unit indicates an unpleasant feeling of the driver, and the driving behavior acquisition unit acquires the driving behavior information indicating that the driving behavior will not be improved in a third period, The output control unit instructs the audio output unit to output audio having content not directly related to the driving operation of the driver. The notification control device according to any one of claims 1 to 6.
10. The output control unit instructs the audio output unit to output audio having different contents when the driving risk level has increased based on the first biological information and when the driving risk level has increased based on the driving behavior information. The notification control device according to any one of claims 1 to 6.
11. a first acquisition step of acquiring first biometric information that is biometric information of a driver while driving a vehicle; a second acquisition step of acquiring driving behavior information indicating the driving behavior of the driver; a calculation step of calculating a driving risk level indicating a degree of risk of the driver driving the vehicle based on the first biological information and the driving behavior information; an output step of outputting a voice to the driver according to the degree of change in the driving risk level; a third acquisition step of acquiring response information indicating a response of the driver to the audio output; an output control step of controlling the audio output based on the response information; A notification control method comprising:
12. A processor included in the notification control device a first biometric information acquisition unit that acquires first biometric information that is biometric information of a driver while driving a vehicle; a driving behavior acquisition unit that acquires driving behavior information indicating the driving behavior of the driver; a risk level calculation unit that calculates a driving risk level indicating a degree of risk that the driver is taking while driving the vehicle, based on the first biological information and the driving behavior information; a voice output unit that outputs a voice to the driver according to the degree of change in the driving risk level; a response acquisition unit that acquires response information indicating a response of the driver to the audio output; and an output control unit that controls the audio output unit based on the response information; A notification control program that acts as a notification control program.
Citation Information
Patent Citations
System for determining appropriateness of driving
JP2023145468A