Driver State Guidance Device and Driver State Guidance Method

Abstract

To apply a stimulation of a type more corresponding to a change of situation on a route of a vehicle as stimulation for guiding a driver state into a preferable state.SOLUTION: A driver state guiding device includes: a state identification unit 201 for identifying a state of a driver of an own vehicle; a target estimation unit 202 for estimating a target state that the driver aims at; a route prediction unit 203 for predicting a route of the own vehicle; a situation prediction unit 206 for predicting a travel situation along the predicted route predicted by the route prediction unit 203; a plan determination unit 207 for determining a plan of stimulation to the driver, to be used during a travel along the predicted route, in order to guide the state of the driver into the target state in accordance with the travel situation on the predicted route predicted by the situation prediction unit 206 in addition to the state of the driver identified by the state identification unit 201 and the target state estimated by the target estimation unit; and a stimulation control unit 209 for applying the stimulation to the driver in accordance with the stimulation plan determined by the plan determination unit 207 during the travel along the predicted route.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure relates to a driver state guidance device and a driver state guidance method.

Background Art

[0002] Patent Document 1 discloses a technique for presenting a plurality of types of stimuli according to the mental and physical load level calculated from the driving history of the driver. Patent Document 1 describes that as the mental and physical load level increases, the duration of the stimulus is increased, which starts immediately after the start of the vehicle equipment operation such as when starting driving.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the technique disclosed in Patent Document 1, the changes in the situation on the route from when the driver gets in the vehicle until arriving at the destination are not considered. Therefore, depending on the changes in the situation on this route, there is a high possibility that an appropriate type of stimulus cannot be performed.

[0005] One object of this disclosure is to provide a driver state guidance device and a driver state guidance method that enable a type of stimulus corresponding to changes in the situation on the vehicle route to be performed as a stimulus for guiding the driver state to a preferable state.

Means for Solving the Problems

[0006] The above object is achieved by the combination of features described in the independent claims, and the dependent claims define further advantageous specific examples of the disclosure. The reference signs in parentheses described in the claims indicate the correspondence with the specific means described in the embodiments described later as one aspect, and do not limit the technical scope of the present disclosure.

[0007] To achieve the above object, the First driver state guidance device of the present disclosure is a driver state guidance device that can be used in a vehicle, and includes a state identification unit (201) that identifies the state of the driver of the vehicle, a target estimation unit (202) that estimates the target state that is the state the driver aims for, a route prediction unit (203) that predicts the route of the vehicle, a situation prediction unit (206) that predicts the situation on the predicted route predicted by the route prediction unit, and in addition to the state of the driver identified by the state identification unit and the target state estimated by the target estimation unit, according to the situation on the predicted route predicted by the situation prediction unit, a plan determination unit (207, 207a) that determines a plan for the stimulus to the driver used on the predicted route to guide the state of the driver to the target state, and a stimulus control unit (209) that causes a stimulus to the driver along the plan determined by the plan determination unit on the predicted route. , for stimuli whose planned duration is less than the threshold, the planning determination unit omits such stimuli and replaces them with the stimuli before and after that stimulus, and determines the plan of stimuli to the driver. is provided. To achieve the above object, the second driver state induction device of the present disclosure is a driver state induction device that can be used in a vehicle, and includes a state identification unit (201) that identifies the state of the driver of the vehicle, a target estimation unit (202) that estimates the target state that is the state the driver aims for, a route prediction unit (203) that predicts the route of the vehicle, a situation prediction unit (206) that predicts the situation on the predicted route predicted by the route prediction unit, and in addition to the state of the driver identified by the state identification unit and the target state estimated by the target estimation unit, according to the situation on the predicted route predicted by the situation prediction unit, a planning determination unit (207, 207a) that determines the plan of the stimuli to the driver used on the predicted route to induce the state of the driver to the target state, and a stimulus control unit (209) that gives stimuli to the driver along the plan determined by the planning determination unit on the predicted route. The situation prediction unit also predicts the situation that changes the state of the driver as a situation. When a driver state different from that state is actually identified by the state identification unit in the section where the planning determination unit predicts the situation that changes the driver state, the planning determination unit re-determines the plan of the stimuli to the driver so as to use the stimuli corresponding to the driver state actually identified by the state identification unit for that section. In order to achieve the above object, a third driver state guidance device of the present disclosure is a driver state guidance device that can be used in a vehicle, and includes a state identification unit (201) that identifies the state of the driver of the vehicle, a target estimation unit (202) that estimates a target state that is the state the driver aims for, a route prediction unit (203) that predicts the route of the vehicle, a situation prediction unit (206) that predicts the situation on the predicted route predicted by the route prediction unit, and a plan determination unit (207, 207a) that determines a plan for stimulating the driver to guide the driver's state to the target state according to the situation on the predicted route predicted by the situation prediction unit in addition to the driver's state identified by the state identification unit and the target state estimated by the target estimation unit, and a stimulation control unit (209) that causes the driver to be stimulated along the plan determined by the plan determination unit on the predicted route. The state identification unit identifies a state including a specific state that is at least one of drowsiness, a distracted state, and a stressed state as the driver's state. The stimulation control unit causes the driver to be stimulated with a stimulation estimated to improve the specific state identified by the state identification unit on the predicted route, regardless of the plan determined by the plan determination unit, based on the fact that the state identification unit has identified the specific state.

[0008] To achieve the above object, the First A driver state guidance method is a driver state guidance method that can be used in a vehicle and is executed by at least one processor. It includes a state identification step of identifying the state of the driver of the vehicle, a target estimation step of estimating a target state that is the state the driver aims for, a route prediction step of predicting the route of the vehicle, a situation prediction step of predicting the situation on the predicted route predicted in the route prediction step, and in addition to the driver state identified in the state identification step and the target state estimated in the target estimation step, according to the situation on the predicted route predicted in the situation prediction step, a plan determination step of determining a plan for stimulating the driver to guide the driver's state to the target state for use on the predicted route, and a stimulation control step of stimulating the driver along the plan determined in the plan determination step on the predicted route. In the plan determination step, for a stimulation whose scheduled duration is less than the threshold, the stimulation is omitted and replaced with stimulations before and after the stimulation, and a plan for stimulating the driver is determined. 。 To achieve the above object, a second driver state guidance method of the present disclosure is a driver state guidance method that can be used in a vehicle and is executed by at least one processor. It includes a state identification step of identifying the state of the driver of the vehicle, a target estimation step of estimating a target state that is the state the driver aims for, a route prediction step of predicting the route of the vehicle, a situation prediction step of predicting the situation on the predicted route predicted in the route prediction step, and in addition to the driver state identified in the state identification step and the target state estimated in the target estimation step, according to the situation on the predicted route predicted in the situation prediction step, a plan determination step of determining a plan for the stimulation to the driver used on the predicted route to guide the driver's state to the target state, and a stimulation control step of causing stimulation to the driver along the plan determined in the plan determination step on the predicted route. In the situation prediction step, the situation also includes predicting a situation that changes the driver's state. In the plan determination step, when a driver state different from that state is actually identified in the state identification step in the section where the situation that changes the driver's state is predicted in the situation prediction step, for that section, the plan for the stimulation to the driver is re-determined so as to use the stimulation corresponding to the driver state actually identified in the state identification step. To achieve the above object, a third driver state guidance method of the present disclosure is a driver state guidance method that can be used in a vehicle, and includes a state identification step of identifying the state of a driver of the vehicle, which is executed by at least one processor, a target estimation step of estimating a target state that is the state the driver aims for, a route prediction step of predicting the route of the vehicle, a situation prediction step of predicting the situation on the predicted route predicted in the route prediction step, and in addition to the driver state identified in the state identification step and the target state estimated in the target estimation step, according to the situation on the predicted route predicted in the situation prediction step, a plan determination step of determining a plan for the stimulation to the driver used on the predicted route to guide the driver's state to the target state, and a stimulation control step of causing the driver to be stimulated along the plan determined in the plan determination step on the predicted route. In the state identification step, as the driver state, a state including a specific state that is at least one of drowsiness, a distracted state, and a stressed state is identified. In the stimulation control step, on the predicted route, based on the fact that the specific state is identified in the state identification step, regardless of the plan determined in the plan determination step, a stimulation estimated to improve the specific state identified in the state identification step is caused to be performed as the stimulation to the driver.

[0009] According to this, in addition to the identified driver state and the target state that is the state the driver aims for, according to the situation on the predicted route, a plan for stimulating the driver to guide the driver's state to the target state for use on the predicted route of the vehicle is determined, so it becomes possible to plan a more suitable type of stimulation for changes in the situation on the vehicle's route. And on the predicted route, the driver is stimulated along the determined plan, so it becomes possible to give the driver a type of stimulation that responds to changes in the situation on the vehicle's route as a stimulation to guide the driver state to a favorable state.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Embodiments for Carrying Out the Invention

[0011] While referring to the drawings, a plurality of embodiments for disclosure will be described. For the sake of convenience in description, among the plurality of embodiments, for parts having the same functions as those shown in the drawings used in the previous description, the same reference numerals may be assigned, and the description thereof may be omitted. For parts assigned the same reference numerals, the description in other embodiments can be referred to.

[0012] (Embodiment 1) <Schematic Configuration of Vehicle System 1> Hereinafter, this embodiment will be described with reference to the drawings. The vehicle system 1 shown in FIG. 1 is used in an automobile (hereinafter simply referred to as a vehicle), and includes an HMI (Human Machine Interface) system 2, an air conditioning system 3, a near-field communication module (hereinafter referred to as NFCM) 4, a wide-area communication module (hereinafter referred to as WACM) 5, a locator 6, a map database (hereinafter referred to as DB) 7, a vehicle state sensor 8, and a data collection device 9. The HMI system 2, the air conditioning system 3, the NFCM 4, the WACM 5, the locator 6, the map DB 7, the vehicle state sensor 8, and the data collection device 9 are assumed to be connected to, for example, an in-vehicle LAN. The vehicle equipped with the vehicle system 1 will be hereinafter referred to as the host vehicle.

[0013] The air conditioning system 3 is a vehicle heating, ventilation, and air conditioning (HVAC) system. The air conditioning system 3 acquires air conditioning request information including air conditioning-related set values and the like set by the occupants of the host vehicle from an HCU 20 described later. Then, according to the acquired air conditioning request information, it adjusts the temperature, air flow, and fragrance in the vehicle interior of the host vehicle. The air conditioning system 3 includes an air conditioning control ECU 30, an air conditioner unit 31, and an aroma unit 32.

[0014] The air conditioner unit 31 generates warm air and cold air (hereinafter referred to as air-conditioning air). The air-conditioning air is supplied into the vehicle interior from an air outlet provided, for example, on the instrument panel of the vehicle. The aroma unit 32 has beads or the like (hereinafter referred to as an impregnated material) impregnated with an aroma oil such as an essential oil containing an aromatic component. Then, by passing the air flow generated by the air conditioner unit 31 around this impregnated material, the aroma is supplied into the vehicle interior. Alternatively, the aroma unit 32 may atomize the aroma oil. In this case, the aromatic component atomized by the aroma unit 32 may be mixed with the air flow generated by the air conditioner unit 31 and supplied into the vehicle interior. The air conditioner unit 31 gives a wind stimulus to the occupants of the vehicle. Further, the air conditioner unit 31 gives a warm and cold stimulus to the occupants of the vehicle due to the difference in the temperature of the air-conditioning air. That is, the air conditioner unit 31 gives a tactile stimulus. The aroma unit 32 gives a stimulus by aroma to the occupants of the vehicle. That is, the aroma unit 32 gives an olfactory stimulus. Both the air conditioner unit 31 and the aroma unit 32 are presenting devices that present stimuli. The air-conditioning control ECU 30 is an electronic control device that controls the operations of the air conditioner unit 31 and the aroma unit 32. The air-conditioning control ECU 30 is connected to the air conditioner unit 31 and the aroma unit 32.

[0015] The NFCM 4 is a communication module for performing short-range wireless communication. When a communication connection is established between the NFCM 4 and a mobile terminal of an occupant of the vehicle, short-range wireless communication is performed between the NFCM 4 and the mobile terminal. The short-range wireless communication is, for example, wireless communication whose communication range is limited to about several tens of meters at most. As the short-range wireless communication, for example, wireless communication compliant with Bluetooth (registered trademark) Low Energy may be used. Examples of the mobile terminal include a multifunctional mobile phone and a wearable device. The WACM 5 transmits and receives information to and from a center outside the vehicle via wireless communication. That is, it performs wide-area communication.

[0016] The locator 6 is equipped with a GNSS (Global Navigation Satellite System) receiver and an inertial sensor. The GNSS receiver receives positioning signals from a plurality of artificial satellites. The inertial sensor includes, for example, a gyro sensor and an acceleration sensor. The locator 6 sequentially measures the current vehicle position of the host vehicle by combining the positioning signals received by the GNSS receiver and the measurement results of the inertial sensor. The vehicle position may be represented by coordinates of latitude and longitude, for example. Note that, for the measurement of the vehicle position, a configuration may be adopted in which the travel distance obtained from the signals sequentially output from a vehicle speed sensor mounted on the host vehicle is used.

[0017] The map DB 7 is a non-volatile memory that stores map data. The map data includes, for example, link data, node data, and data such as road attributes. The link data is composed of each data of a unique number for specifying a link, a link length indicating the length of the link, a link direction, a link travel time, link shape information, node coordinates of the start and end points of the link, and road attributes. Examples of road attributes include road name, road type, road width, number of lanes, and speed limit value. On the other hand, the node data is composed of each data such as a node ID with a unique number assigned to each node on the map, node coordinates, node name, node type, a connection link ID in which the link ID of the link connected to the node is described, and intersection type. Note that the map data may be configured to be acquired from the outside of the host vehicle using the WACM 5.

[0018] The vehicle state sensor 8 is a group of sensors for detecting the state of the host vehicle, such as the driving state and operation state of the host vehicle. Examples of the vehicle state sensor 8 include a vehicle speed sensor, a steering angle sensor, an acceleration / deceleration sensor, an accelerator position sensor, a brake switch, a turn signal switch, etc. The vehicle speed sensor detects the vehicle speed of the host vehicle. The steering angle sensor detects the steering angle of the steering of the host vehicle. The acceleration / deceleration sensor detects the acceleration / deceleration of the host vehicle. The accelerator position sensor detects the opening degree of the accelerator pedal of the host vehicle. The brake switch outputs a signal according to whether the brake pedal of the host vehicle is depressed or not. The turn signal switch detects the lamp lighting operation of the direction indicator of the host vehicle. The vehicle state sensor 8 outputs the detection result to the in-vehicle LAN. Note that the detection result by the vehicle state sensor 8 may be configured to be output to the in-vehicle LAN via the ECU mounted on the host vehicle.

[0019] The data collection device 9 collects information related to the driving history of the host vehicle (hereinafter referred to as driving history related information). Examples of the driving history information include information on the driving route, traffic congestion information, and driving load information. The information on the driving route may be the time-series data of the vehicle positions sequentially measured by the locator 6 during the driving of the host vehicle. That is, it may be a data group in which the vehicle position and the time when the vehicle position is obtained are associated. Therefore, the information on the driving route also includes the information on the driving time. It is preferable to associate the information on the collected day of the week with the information on the driving route.

[0020] Regarding the traffic congestion information, the data collection device 9 may be configured to sequentially specify and collect the traffic congestion based on, for example, the vehicle speed of the host vehicle during the driving of the host vehicle. The vehicle speed of the host vehicle may use the detection result of the vehicle speed sensor among the vehicle state sensors 8. As an example, a state in which the vehicle speed of the host vehicle is below a threshold value for distinguishing the low speed during traffic congestion and the vehicle travels for a certain period of time or more may be regarded as having traffic congestion. The traffic congestion may be in two stages, i.e., with or without traffic congestion. Also, it may be configured to specify the traffic congestion in three or more stages according to the duration of the traffic congestion. The traffic congestion information may be associated with the vehicle position, time, day of the week, etc. when the traffic congestion is obtained.

[0021] Regarding the information on the driving load, the data collection device 9 may be configured to sequentially identify and collect the driving load based on the frequency of driving operations such as, for example, the accelerator operation, brake operation, steering operation, and turn signal lamp lighting operation of the host vehicle while the host vehicle is traveling. The driving load shall be higher as the driver's driving task is busier. The driving task shall be, for example, steering, acceleration / deceleration, and peripheral monitoring. The driving load may be identified as higher as the frequency of driving operations is higher. The driving load may be divided into two levels: whether the load is high or not. Regarding the frequency of driving operations, it may be identified based on the degree of change in the detection results of a steering angle sensor, acceleration sensor, accelerator position sensor, brake pedal force sensor, etc. The driving load may also be higher as the frequency of change in the face orientation of the driver detected by the in-vehicle camera 21 described later is higher. This is because when the change in face orientation for peripheral monitoring is intense, it is considered that the driving load is also high. When the inter-vehicle distance from the preceding vehicle of the host vehicle can be identified by the peripheral monitoring sensor, the driving load may be configured to be identified as higher as the inter-vehicle distance sequentially identified during the traveling of the host vehicle is shorter. The information on the driving load may also be associated with the vehicle position, time, day of the week, etc. at which the driving load was obtained.

[0022] The driving history-related information collected by the data collection device 9 may also be associated with identification information for identifying individual drivers. The driving history-related information collected by the data collection device 9 may be uploaded to the center via the WACM 5. Thereby, as the driver's personal history data, information on the driving route associated with the time and day of the week, information on the congestion level, and information on the driving load are accumulated in the center.

[0023] The HMI system 2 acquires information on the driver of the host vehicle. The HMI system 2 receives an input from the driver of the host vehicle. The HMI system 2 presents a stimulus to the driver of the host vehicle. The stimulus here also includes the provision of information. The details of the HMI system 2 will be described below.

[0024] <Schematic Configuration of HMI System 2> The HMI system 2 includes an HCU (Human Machine Interface Control Unit) 20, an in-vehicle camera 21, a biometric sensor 22, a lighting device 23, a display device 24, an audio output device 25, and a user input device 26. The HCU is a unit that controls the presentation content of information by means of stimuli such as vision and / or sound.

[0025] The in-vehicle camera 21 images a predetermined range inside the vehicle of the host vehicle. The in-vehicle camera 21 shall image at least the range including the driver's seat of the host vehicle. The in-vehicle camera 21 is composed of, for example, a near-infrared light source and a near-infrared camera, and a control unit that controls these. The in-vehicle camera 21 photographs the driver irradiated with near-infrared light by the near-infrared light source using the near-infrared camera. The captured image by the near-infrared camera is analyzed by the control unit. The control unit analyzes the captured image to detect the feature amount of the driver's face. The control unit may detect the driver's face orientation, arousal level, etc. based on the detected feature amount of the driver's face. The detection of the arousal level may be performed, for example, based on the degree of opening and closing of the eyelids.

[0026] The biometric sensor 22 measures the biometric information of the driver. The biometric sensor 22 sequentially outputs the measured biometric information to the HCU 20. The biometric sensor 22 may be configured to be provided in the host vehicle. The biometric sensor 22 may be configured to be provided in a wearable device worn by the driver. When the biometric sensor 22 is provided in the host vehicle, it may be provided, for example, on the steering wheel, seat, etc. When the biometric sensor 22 is provided in a wearable device, for example, the HCU 20 may be configured to acquire the measurement result of the biometric sensor 22 via NFCM4. Examples of the biometric information measured by the biometric sensor 22 include respiration, pulse, heartbeat, etc. Note that the biometric sensor 22 may be configured to use a device that measures biometric information other than respiration, pulse, and heartbeat. For example, the biometric sensor 22 may measure brain waves, heartbeat fluctuations, sweating, body temperature, blood pressure, skin conductance, etc.

[0027] The lighting device 23 is provided at a position visible to the driver and gives the driver a stimulus by light emission. That is, it gives a visual stimulus. The lighting device 23 is a presenting device that presents a stimulus. As the lighting device 23, a light-emitting device such as an LED may be used. Preferably, the lighting device 23 is capable of switching the color of light emission. The lighting device 23 is controlled by the HCU 20 for the timing of turning on and off and the color of light emission.

[0028] The display device 24 displays information. The display device 24 is provided at a position visible to the driver and gives the driver a stimulus by display. That is, it gives a visual stimulus. The display device 24 is a presenting device that presents a stimulus. The display device 24 displays at least an image. The display device 24 may display text or the like in addition to the image. The display of the display device 24 is controlled by the HCU 20.

[0029] As the display device 24, for example, a meter MID (Multi Information Display), CID (Center Information Display), a display of a navigation device, or a HUD (Head-Up Display) can be used. The meter MID is a display device provided in front of the driver's seat in the vehicle interior. As an example, the meter MID may be configured to be provided on the meter panel. The CID is a display device arranged in the center of the instrument panel of the host vehicle. The HUD is provided, for example, on the instrument panel in the vehicle interior. The HUD projects a display image formed by a projector onto a predetermined projection area on the front windshield as a projection member. The light of the image reflected to the vehicle interior side by the front windshield is perceived by the driver sitting in the driver's seat. Thereby, the driver can visually recognize a virtual image of the display image formed in front of the front windshield by overlapping it with a part of the foreground. The HUD may be configured to project the display image onto a combiner provided in front of the driver's seat instead of the front windshield.

[0030] The voice output device 25 gives the driver a sonic stimulus. That is, it gives an auditory stimulus. The voice output device 25 is a presenting device that presents the stimulus. Examples of the sound output from the voice output device 25 include music, environmental sounds, etc. The music may include BGM. The environmental sound may be a sound that reproduces a specific environment. As the voice output device 25, for example, an audio speaker that outputs voice may be used.

[0031] The user input device 26 receives input from the driver. The user input device 26 may be an operating device that receives an operation input from the driver. The operating device may be a mechanical switch or a touch panel integrated with the display device 24. Note that the user input device 26 is not limited to an operating device that receives an operation input as long as it is a device that receives input from the user. For example, it may be a voice input device that receives input of a command by voice from the user.

[0032] The HCU 20 is mainly composed of a microcomputer including a processor, a memory, an I / O, and a bus connecting these. The HCU 20 executes various processes such as processes related to guiding the driver's state (hereinafter, driver state guidance related processes) by executing a control program stored in the memory. This HCU 20 corresponds to the driver state guidance device. The memory mentioned here is a non-transitory tangible storage medium that non-temporarily stores a program and data readable by a computer. The non-transitory tangible storage medium is realized by a semiconductor memory, a magnetic disk, or the like. Details of the driver state guidance related processes in the HCU 20 will be described below.

[0033] <Schematic Configuration of HCU20> Next, the schematic configuration of the HCU 20 will be described with reference to FIG. 2. As shown in FIG. 2, for the driving state guidance related processing, the HCU 20 includes, as functional blocks, a state identification unit 201, a target estimation unit 202, a route prediction unit 203, a presentation control unit 204, a route selection unit 205, a situation prediction unit 206, a plan determination unit 207, a plan selection unit 208, and a stimulus control unit 209. Further, the execution of the processing of these functional blocks by a computer corresponds to the execution of the driver state guidance method. Note that part or all of the functions executed by the HCU 20 may be configured hardware-wise by one or more ICs or the like. Further, part or all of the functional blocks included in the HCU 20 may be realized by a combination of software execution by a processor and hardware members.

[0034] The state identification unit 201 identifies the state of the driver of the host vehicle. The processing in the state identification unit 201 corresponds to the state identification step. The states dealt with in this embodiment are classified using a circular model that represents the mental state on two axes, the axis of pleasure-displeasure and the axis of activity-inactivity, as shown in FIG. 3. That is, it is assumed to be a mental state. This circular model is the so-called Russell's affect circumplex model. The axis of activity-inactivity may be rephrased as the axis of arousal-sedation. Note that in Russell's affect circumplex model, fatigue and drowsiness are also included in the mental state. Hereinafter, as the mental states classified by this circular model, "irritation", "boredom", "fatigue", "drowsiness", "excitement", "happiness", and "relaxation" shown in FIG. 3 will be taken as examples for explanation.

[0035] "Irritation" is a mental state with both increased discomfort and increased activity. In this embodiment, for example, "irritation" is considered to be included in the stress state. "Boredom", "fatigue", and "drowsiness" are mental states with increased discomfort but decreased activity. Among "boredom", "fatigue", and "drowsiness", the activity decreases in the order of "boredom" > "fatigue" > "drowsiness". In this embodiment, for example, "boredom" is considered to be included in the listless state. Note that "fatigue" may also be included in the listless state. In this embodiment, "fatigue" is also included in the listless state. "Excitement" is a mental state with both increased pleasure and increased activity. "Happiness" is a mental state with increased pleasure and neither increased nor decreased activity. "Relaxation" is a mental state with increased pleasure but decreased activity. "Irritation", "boredom", "fatigue", and "drowsiness" are mental states in the direction of discomfort. "Excitement", "happiness", and "relaxation" are mental states in the direction of comfort.

[0036] In this embodiment, "irritation", "depression", "excitement", "happiness", and "relaxation" are taken as examples of mental states for explanation, but it is not necessarily limited to this. For example, it may be configured to handle other mental states such as "fear", "aversion", and "surprise". "Fear" is a mental state with both increased discomfort and increased activity, and its activity is higher than that of "irritation". "Aversion" is a mental state with both increased discomfort and increased activity, and its discomfort is higher than that of "irritation". In the example of this embodiment, "irritation", "boredom", "fatigue", and "drowsiness" correspond to specific states. "Fear" and "aversion" correspond to discomfort states other than specific states. "Irritation", "boredom", "fatigue", and "drowsiness" also fall under discomfort states. "Excitement", "happiness", and "relaxation" correspond to comfortable states.

[0037] The state identification unit 201 may identify the driver's state from the detection results of the in-vehicle camera 21. For example, "drowsiness" may be identified from the level of wakefulness. Alternatively, the driver's state may be identified based on whether characteristic facial feature amounts corresponding to the driver's state are recognized. The state identification unit 201 may also identify the driver's state from the biometric information of the driver measured by the biometric sensor 22. For example, the driver's state may be identified based on whether characteristic amounts of the biometric information corresponding to the driver's state are recognized. The state identification unit 201 may also identify the driver's state from the detection results of the vehicle state sensor 8. For example, the driver's state may be identified based on whether characteristic driving behaviors corresponding to the driver's state are recognized. When the biometric information of the driver can be measured in advance by the driver's mobile terminal, the state identification unit 201 may identify the driver's state from the biometric information obtained from the mobile terminal via the NFCM4. Note that when the mobile terminal can estimate the driver's state from the biometric information, the state identification unit 201 may identify the driver's state by obtaining the estimation result via the NFCM4.

[0038] The target estimation unit 202 estimates the state that the driver aims for (hereinafter referred to as the target state). The processing in this target estimation unit 202 corresponds to the target estimation step. When the state of the driver identified by the state identification unit 201 is an uncomfortable state, the target estimation unit 202 may estimate the target state so as to guide the driver to a comfortable state. Even when the state of the driver identified by the state identification unit 201 is neither an uncomfortable state nor a comfortable state, the target estimation unit 202 may estimate the target state so as to guide the driver to a comfortable state. When the state of the driver identified by the state identification unit 201 is a comfortable state, the target estimation unit 202 may estimate the target state so as to maintain the comfortable state.

[0039] The target estimation unit 202 may estimate which state among the comfortable states is the target state, for example, from the driver's schedule, destination, etc. The driver's schedule may be obtained from the schedule application of the driver's mobile terminal via the NFCM4. If there is a destination input to the navigation device, the destination may be obtained. If the destination prediction is performed by the route prediction unit 203 described later, the predicted destination may be obtained. If the driver's immediate schedule is the schedule of a family member's birthday, for example, "excited" may be estimated as the target state. If the driver's immediate schedule is a meeting, for example, "relaxed" may be estimated as the target state. If the driver has no schedule and the destination is home, for example, "happy" may be estimated as the target state. If the destination is the company, for example, "excited" may be estimated as the target state.

[0040] The route prediction unit 203 predicts the route of the host vehicle. The processing in this route prediction unit 203 corresponds to the route prediction step. The route prediction unit 203 may predict a group of position coordinates that form the route and the travel time of the route. If there is a destination input to the navigation device, the route prediction unit 203 may predict the route connecting from the current vehicle position measured by the locator 6 to that destination as the route of the host vehicle. In this case, a plurality of route candidates may be predicted under conditions such as time priority and distance priority. The travel time of the route may be predicted from the link travel time stored in the map DB7.

[0041] The route prediction unit 203 may predict the destination and route based on the driver's personal history data obtained from the center via the WACM5. In this case, the route may be predicted by specifying the destination and travel route with a high travel frequency in the personal history data for the current vehicle position measured by the locator 6, the current time, and the current day of the week. In this case, a plurality of route candidates may be predicted. The travel time of the route may be predicted from the time for each vehicle position associated with the travel route information in the driver's personal history data.

[0042] When the route that the host vehicle actually travels deviates from the predicted route, it is preferable for the route prediction unit 203 to re-predict the route of the host vehicle. Deviating from the predicted route may be, for example, when entering a link different from the link of the predicted route. Further, it is preferable for the route prediction unit 203 to predict a plurality of candidate routes as the route of the host vehicle. This is to enable the driver to select the desired route.

[0043] The presentation control unit 204 causes the display device 24 or the audio output device 25 to present information. In the present embodiment, the case where information is presented from the display device 24 will be taken as an example for continued explanation. The presentation control unit 204 causes information related to the plan of the stimulus to the driver determined by the plan determination unit 207 described later (hereinafter, plan-related information) to be presented.

[0044] The presentation control unit 204 preferably causes at least the information of a plurality of candidate routes predicted by the route prediction unit 203 to be presented as the plan-related information. As an example, the information of a plurality of candidate routes may be displayed on the screen of a display, CID, etc. of the navigation device. As a display mode, the candidate routes may be displayed on a map or a list of candidate routes may be displayed. When the information of a plurality of candidate routes is presented by the presentation control unit 204, the driver makes a selection input to select one route from among the presented candidate routes. The presentation control unit 204 may perform a presentation to prompt this selection input.

[0045] The route selection unit 205 selects one route from among a plurality of candidate routes predicted by the route prediction unit 203 according to the selection input received from the driver. The selection input may be, for example, configured to be performed by a touch operation on the screen of a touch panel integrated with a display, CID, etc. of the navigation device.

[0046] The situation prediction unit 206 predicts the situation (hereinafter referred to as the in-route situation) in the middle of the predicted route predicted by the route prediction unit 203. The processing in this situation prediction unit 206 corresponds to the situation prediction step. When one predicted route is selected from a plurality of candidate routes by the route selection unit 205, the situation prediction unit 206 predicts the situation in the middle of the predicted route. The situation prediction unit 206 predicts at least one of a situation where the driver's driving load increases, the degree of traffic congestion, and the monotony of driving as the in-route situation. The situation prediction unit 206 predicts the situation, for example, by area in the predicted route. The area referred to here may be an area divided by categories such as links and nodes, for example.

[0047] The situation prediction unit 206 may predict, as the in-route situation, a situation where the driver's driving load increases, from the road type in the middle of the predicted route. The road type in the middle of the predicted route may be specified by collating the map data stored in the map DB 7 with the predicted route. The situation prediction unit 206 may predict a situation where the driver's driving load increases, for areas of road types such as narrow streets and residential streets. This is because in narrow streets and residential streets, the effort of peripheral monitoring is large and it is estimated that the driving load will increase. The situation prediction unit 206 may also specify a situation where the driver's driving load increases, from the driver's personal history data acquired from the center via the WACM 5. The situation prediction unit 206 may predict a situation where the driver's driving load increases, for areas where the driving load was high in the personal history data. By using the personal history data, it becomes possible to more accurately predict different in-route situations for each individual driver.

[0048] The situation prediction unit 206 may predict the traffic congestion level as the in-route situation from the traffic congestion information obtained from the center via WACM5. For example, the situation prediction unit 206 may identify the traffic congestion level for each link on the predicted route by comparing the traffic congestion information for each link with the predicted route. The situation prediction unit 206 may predict traffic congestion for areas where the traffic congestion level is equal to or higher than a specified value. The situation prediction unit 206 may also identify the traffic congestion level from the personal history data of the driver obtained from the center via WACM5. The situation prediction unit 206 may predict traffic congestion for areas where the congestion level was high in the personal history data. By using the personal history data, it becomes possible to more accurately predict different in-route situations for each individual driver. The predicted traffic congestion as the in-route situation corresponds to a situation that deteriorates the driver's state. This is because it is presumed that traffic congestion induces the driver into an "irritable" state.

[0049] The situation prediction unit 206 may predict the monotony of driving as the in-route situation from the map data of the predicted route. The situation prediction unit 206 may predict the monotony of driving from the road type on the predicted route. The situation prediction unit 206 may predict that driving is monotonous for areas with road types such as highways and motorways. Also, the situation prediction unit 206 may predict that driving is monotonous for areas where straight roads continue for a specified distance or more. The situation prediction unit 206 may also identify the monotony of driving from the personal history data of the driver obtained from the center via WACM5. The situation prediction unit 206 may predict that driving is monotonous for areas where a state of low driving load continued for a specified distance or more in the personal history data. By using the personal history data, it becomes possible to more accurately predict different in-route situations for each individual driver. The predicted monotony of driving as the in-route situation corresponds to a situation that deteriorates the driver's state. This is because it is presumed that driving monotony induces the driver into a "boring" and "sleepy" state.

[0050] In addition, when using the personal history data, the situation prediction unit 206 may create maps of driving load and congestion level by location, day of the week, and time. Then, with reference to this map, the driving load and congestion level on the predicted route may be identified. Since the day of the week and time are associated with the personal history data, it is possible to identify the driving load and congestion level not only by location but also by day of the week and time. Therefore, the situation prediction unit 206 can predict situations where the driving load increases, traffic jams, and monotonous driving not only by location but also by day of the week and time.

[0051] The situation prediction unit 206 may predict a situation that changes the driver's state other than deteriorating the driver's state as the in-route situation. For example, the situation prediction unit 206 may predict a situation that changes the driver's state to "relaxed" for the area facing the coast in the predicted route.

[0052] When the route prediction unit 203 re-predicts the route of the host vehicle, the situation prediction unit 206 may predict the in-route situation of the re-predicted predicted route. When the route prediction unit 203 predicts a plurality of candidate routes, the situation prediction unit 206 uses the route selected by the route selection unit 205 among the candidate routes as the predicted route and predicts the in-route situation of the predicted route.

[0053] In addition to the driver's state identified by the state identification unit 201 and the target state estimated by the target estimation unit 202, the plan determination unit 207 determines a plan for stimulating the driver (hereinafter referred to as the stimulation plan) to be used on the predicted route to guide the driver's state to the target state according to the situation on the predicted route predicted by the situation prediction unit 206. The processing by this plan determination unit 207 corresponds to the plan determination step. The driver's state identified by the state identification unit 201 is hereinafter referred to as the current state. The stimulation plan may be scheduling such as the type of stimulation to be provided, the timing of providing the stimulation, and the time distribution of providing the stimulation.

[0054] Hereinafter, the determination of the stimulation plan will be described with reference to FIG. 4. FIG. 4 is a diagram for explaining an example of the stimulation plan. In FIG. 4, an example is shown in the case where the current state is specified as "fatigue" and the target state is estimated as "excitement". In the example of FIG. 4, it is assumed that traffic congestion, high load, and driving monotony are predicted as the in-route situations.

[0055] The plan determination unit 207 may determine the ideal state of the driver on the predicted route (hereinafter, the ideal state) from the current state specified by the state specification unit 201 and the target state estimated by the target estimation unit 202. The plan determination unit 207 may refer to the correspondence relationship between the combination of the current state and the target state that are pre-associated and the ideal state, and determine the ideal state. The ideal state may be such that the state (hereinafter, the intermediate state) that is desirable to pass through when transitioning from the current state to the target state and the target state are allocated. In the example of FIG. 4, the ideal state is determined such that the first half is "relaxed" and the second half is "excited". In FIG. 4, "relaxed" is represented by D and "excited" is represented by E. The ratio of the time allocation between the intermediate state and the target state in the ideal state may be arbitrarily set. Also, a configuration may be adopted in which the target state is used as the ideal state as it is.

[0056] The plan determination unit 207 anticipates the change in the state of the driver on the predicted route from the situation on the predicted route predicted by the situation prediction unit 206. As an example, for the area where the in-route situation is predicted to be traffic congestion, a state change to "irritation" may be anticipated (A in FIG. 4). For the area where the in-route situation is predicted to be high load, a state change to a state with low receptivity to stimulation (hereinafter, the low receptivity state) may be anticipated (B in FIG. 4). For the area where the in-route situation is predicted to be driving monotony, a state change to "boredom" or "drowsiness" may be anticipated (C in FIG. 4).

[0057] For the sections in the predicted route where no state change is expected, the planning decision unit 207 may determine a tentative plan that provides a stimulus estimated to induce the determined ideal state. For example, as shown by F in FIG. 4, for a section where no state change is expected and "relaxed" is determined as the ideal state, a tentative plan that provides a stimulus estimated to induce "relaxed" may be determined. Examples of stimuli to induce "relaxed" include the following. The period of the lighting of the lighting device 23 may be provided at a slow period, such as a period of 8 seconds or more. The lighting device 23 may emit light in a light-emitting color estimated to have a relaxing effect. An aroma estimated to have a relaxing effect may be generated from the aroma unit 32 via the air-conditioning control ECU 30. Slow-tempo music may be output from the audio output device 25.

[0058] Also, as shown by I in FIG. 4, for a section where no state change is expected and "excited" is determined as the ideal state, a tentative plan that provides a stimulus estimated to induce "excited" may be determined. Examples of stimuli to induce "excited" include the following. Up-tempo music may be output from the audio output device 25.

[0059] For the sections in the middle of the predicted route where a state change is expected, the planning decision unit 207 may determine a tentative plan that provides a stimulus corresponding to the expected state change. For sections where a state change that deteriorates the driver's state is expected, the planning decision unit 207 determines a tentative plan that provides a stimulus estimated to improve that deterioration. For example, as shown by G in FIG. 4, for a section where "irritated" due to traffic congestion is expected, a tentative plan that provides a stimulus estimated to improve "irritated" is determined. Examples of stimuli estimated to improve "irritated" include the following. An aroma estimated to have a calming effect may be generated from the aroma unit 32 via the air-conditioning control ECU 30. The period of the lighting of the lighting device 23 may be provided at a slow period, such as a period of 6 seconds or more.

[0060] Also, in a section where "boredom" or "drowsiness" due to monotonous driving is predicted, such as J in FIG. 4, a tentative plan is determined to provide a stimulus that is estimated to improve the state of listlessness or drowsiness. Examples of stimuli estimated to improve the state of listlessness or drowsiness include the following. An air-conditioning control ECU 30 may cause an aroma unit 32 to generate a refreshing fragrance. An air-conditioning unit 31 may generate cold air via the air-conditioning control ECU 30. An upbeat tempo music may be output from the audio output device 25.

[0061] The plan determination unit 207 preferably determines a tentative plan for the stimulus so as to suppress the stimulus for a section in the predicted route where a situation in which the driver's driving load is predicted to increase by the situation prediction unit 206. That is, in a section where a low acceptance state due to high load is predicted, such as H in FIG. 4, a tentative plan not to provide a stimulus may be determined. This is because it is useless to provide a stimulus in a low acceptance state. For a section where a situation in which the driving load is predicted to increase, a tentative plan for the stimulus may be determined so as to suppress the stimulus from the viewpoint of reducing the influence on driving. In this case, the suppression of the stimulus may be realized by a configuration that weakens the intensity of the stimulus in addition to a configuration that does not perform the stimulus.

[0062] The plan determination unit 207 preferably determines a stimulus plan from the tentative plan so as to provide a more comfortable stimulus mode for the driver by using the fact that the situation prediction unit 206 can predict the situation in the predicted route.

[0063] For stimuli whose planned duration is less than the threshold, it is preferable that the planning determination unit 207 omits such stimuli and replaces them with the stimuli before and after that stimulus to determine the stimulus plan. The threshold mentioned here may be a value estimated that the driver will frequently feel the switching of stimuli. According to this, the stimuli do not need to be switched frequently, and the driver will not be bothered. In the example of FIG. 4, since the duration of the F stimulus between the G and H stimuli is short, this F stimulus is replaced with the G and H stimuli respectively to determine the stimulus plan (see EX in FIG. 4). When omitting a stimulus whose planned duration is less than the threshold and replacing it with the stimuli before and after that stimulus, the stimulus plan may be determined such that the previous stimulus fades out and the subsequent stimulus fades in.

[0064] For a section in the predicted route where a situation that deteriorates the driver's state is predicted by the situation prediction unit 206, it is preferable that the planning determination unit 207 determines the stimulus plan to start a stimulus estimated to improve the deterioration prior to entering that section. According to this, compared with starting to improve after the state deteriorates, it becomes easier to guide the driver's state in a favorable direction. In the example of FIG. 4, prior to entering the section where "boring" and "drowsiness" of C are predicted, the stimulus plan is determined to start a stimulus J estimated to improve the deterioration (see FI in FIG. 4).

[0065] In this embodiment, a configuration in which the planning determination unit 207 determines the stimulus plan based on the provisional plan after determining the provisional plan is shown, but it is not necessarily limited to this. For example, the planning determination unit 207 may be configured to determine the provisional plan as the stimulus plan.

[0066] The planning decision-making unit 207 preferably determines a plurality of candidate plans for one predicted route as the stimulation plan. According to this, the driver can select a stimulation plan according to their preference. The presentation control unit 204 preferably presents information on the plurality of candidate plans determined by the planning decision-making unit 207 as at least plan-related information. As an example, the information on the plurality of candidate plans may be displayed on the display of the navigation device, the screen of the CID, etc. As the display mode, a graph showing the type of stimulation, timing, and time distribution as shown in FIG. 4 may be displayed for each candidate plan. When the presentation control unit 204 presents information on the plurality of candidate plans, the driver makes a selection input to select one stimulation plan from the plurality of candidate plans based on the presented information on the candidate plans. The presentation control unit 204 may perform a presentation to prompt this selection input.

[0067] The presentation control unit 204 may superimpose and display on the map, as plan-related information, information on the predicted route, the type of stimulation (hereinafter referred to as the act type) to be given to the driver during the journey of the predicted route along the plan determined by the planning decision-making unit 207, and the ideal state of the driver (hereinafter referred to as the ideal state) to be induced by the stimulation. According to this, the driver can more intuitively recognize the act type and the ideal state planned during the journey of the predicted route.

[0068] Here, an example of the display of plan-related information will be described with reference to FIG. 5. The plan-related information can also be referred to as scheduling information. FIG. 5 shows an example in which the scheduling information is superimposed and displayed on the electronic map on the screen of the display device 24. The icon shown in IMIc of FIG. 5 corresponds to the information in the ideal state. SR in FIG. 5 indicates the predicted route being selected. NSR in FIG. 5 indicates the predicted route not being selected. Note that the selection of the predicted route may be accepted by the plan selection unit 208 described later. On the predicted route in FIG. 5, lines of different line types indicate the information of the act type. Specifically, the line type indicated by FA represents performing a stimulus estimated to improve "irritation". The line type indicated by RA represents performing a stimulus estimated to induce "relaxation". The line type indicated by EA represents performing a stimulus estimated to induce "excitement". The line type indicated by AA represents performing a stimulus estimated to improve a wandering state and drowsiness. The line type indicated by AR represents suppressing the stimulus. Note that the same symbols in the following drawings shall also be the same.

[0069] As shown in FIG. 5, for the predicted route being selected, the act type in the middle of the predicted route is represented by the difference in the line type superimposed on the predicted route. Note that the act type may also be represented by color coding. Also, for the predicted route being selected, the ideal state in the middle of the predicted route is represented by an icon. As the types of the ideal state, for example, it may be classified into "neutral", "happy", "excited", "relaxed", "frustrated", "irritated". "Neutral" is a neutral state that is not classified into types other than "neutral". Each type of the ideal state may be represented by an icon imitating a different expression, as shown in FIG. 6. In FIG. 6, the reason for listing frustrated and irritated, which are unpleasant states, as candidates for the types of the ideal state is that the effect of making driving safe is also considered. For example, rough driving caused by a strong irritated state is considered to decrease by being induced into a frustrated state. Also, a decrease in the sensitivity of driving operations caused by a strong frustrated state is considered to improve by being induced into an irritated state. However, since the induction to unpleasantness is difficult to be accepted by the driver, it may be excluded from the target of the ideal state in actual operation.

[0070] According to the selection input received from the driver, the plan selection unit 208 selects one candidate plan from among a plurality of candidate plans. Then, the plan determination unit 207 determines the selected candidate plan as the stimulation plan. For the selection input, for example, it may be configured to be performed by a touch operation on the screen of a touch panel integrated with the display of the navigation device, CID, etc.

[0071] After the stimulation plan is determined by the plan determination unit 207, the presentation control unit 204 may present, for example, the following plan-related information. As the plan-related information, the predicted route and travel time predicted by the route prediction unit 203 may be presented. The destination may be included in the predicted route. As the plan-related information, the in-route situation predicted by the situation prediction unit 206 may be presented. For example, sections corresponding to traffic jams, high loads, and monotonous driving may be displayed on the map. As the plan-related information, the current state identified by the state identification unit 201 may be presented. As the plan-related information, the type of stimulation being provided or scheduled to be provided, the content of the stimulation, and the time of providing the stimulation may be presented.

[0072] Note that this plan-related information is not limited to being configured to be displayed on the display device 24. This plan-related information may also be output as audio from the audio output device 25. Additionally, this plan-related information may be transmitted to the driver's mobile terminal via NFCM4 and displayed on the screen of the mobile terminal. For example, the presentation of the plan-related information may be configured to be performed when the user input device 26 or the driver's mobile terminal receives an input requesting the presentation of the plan-related information.

[0073] When the route prediction unit 203 re-predicts the route of the host vehicle, the plan determination unit 207 may re-determine the stimulation plan according to the road conditions of the re-predicted route. When the plan determination unit 207 re-determines the stimulation plan, it is preferable that the presentation control unit 204 presents, at least as plan-related information, the content of the change in the stimulation plan due to the re-determination of the stimulation plan. As an example, it may be displayed on the display device 24 how each stimulation is changed, or may be output as voice from the voice output device 25.

[0074] In a section where the situation prediction unit 206 predicts a situation that changes the state of the driver, when the state of the driver different from that state is actually specified by the state specification unit 201, for that section, it is preferable that the plan determination unit 207 re-determines the plan for the stimulation to the driver so as to use the stimulation corresponding to the state of the driver actually specified by the state specification unit 201. According to this, it becomes possible to perform stimulation according to the actual state of the driver and induce the state of the driver into a more accurate and preferable state. For example, when the state of the driver is not "irritable" in a section predicted to be congested, the plan may be re-determined so as to provide a stimulation estimated to induce "relaxation" instead of a stimulation estimated to improve "irritability".

[0075] The stimulation control unit 209 causes the driver to be stimulated along the stimulation plan determined by the plan determination unit 207 on the road of the predicted route used for the determination of the stimulation plan. The processing by this stimulation control unit 209 corresponds to the stimulation control step. The road of the predicted route refers to the road on which the host vehicle is advancing along the predicted route. The stimulation control unit 209 selects the type of stimulation and provides or suppresses the stimulation along the stimulation plan. When a plurality of candidate plans are determined by the plan determination unit 207, the stimulation control unit 209 causes the driver to be stimulated along the plan selected by the plan selection unit 208 among the candidate plans on the road of the predicted route.

[0076] When the state identification unit 201 identifies a specific state during the process of the predicted route used for determining the stimulation plan, the stimulation control unit 209 preferably causes the driver to receive a stimulation that is estimated to improve the specific state identified by the state identification unit 201, regardless of the stimulation plan determined by the plan determination unit 207. As described above, the specific state is an unpleasant state such as "irritation", "boredom", "fatigue", or "drowsiness". According to this, by prioritizing the improvement of a specific state that is considered to have a stronger adverse impact on driving, it becomes possible to further suppress the adverse impact on driving. When the state identification unit 201 identifies a specific state, it is preferable to immediately improve the specific state by causing a stimulation that is estimated to be effective in a short time for the improvement of the specific state.

[0077] After the stimulation control unit 209 causes a stimulation that is estimated to improve the specific state and the state identified by the state identification unit 201 improves from that specific state, during the process of the predicted route, based on the fact that a stimulation (hereinafter referred to as non-inductive stimulation) that is estimated not to induce the specific state again and a stimulation along the stimulation plan determined by the plan determination unit 207 do not match, regardless of the stimulation plan determined by the plan determination unit 207, it is preferable to preferentially cause the non-inductive stimulation. According to this, it becomes possible to prevent immediately returning to the specific state despite the improvement of the specific state. The non-inductive stimulation may be a stimulation corresponding to the type of the specific state. For example, if it is "drowsiness", the improvement of the specific state may be achieved by an aromatic with a refreshing feeling, while the non-inductive stimulation may be performed by outputting upbeat music, etc. Note that the process of preferentially causing the non-inductive stimulation may be configured to be limited within a certain period after the improvement from the specific state. The so-called certain period here may be set arbitrarily.

[0078] When a request occurs to apply a stimulus that does not match the stimulus along the predicted route used for determining the stimulus plan in the middle of the predicted route, the stimulation control unit 209 preferably causes the higher-priority one of the stimulus along the stimulus plan determined by the plan determination unit 207 and the stimulus that does not match that stimulus to be applied according to a predetermined priority order. The predetermined priority order is, from the highest priority, a stimulus corresponding to drowsiness, a stimulus corresponding to a wandering state, a stimulus corresponding to a stress state, a stimulus corresponding to an uncomfortable state other than a specific state, and a stimulus corresponding to a comfortable state. According to this, by being able to preferentially provide a stimulus with a higher priority, it becomes possible to preferentially perform a response with a higher priority. For example, even in the same specific state, a stimulus corresponding to drowsiness is preferably applied preferentially to a stimulus corresponding to a wandering state.

[0079] The presentation control unit 204 preferably causes the display device 24 to display information on the state of the driver identified by the state identification unit 201 (hereinafter, the current driver state) while the vehicle is traveling on the predicted route, and the type of stimulus (hereinafter, the current act type) being applied to the driver at the time (that is, the current time) when the state of the driver is identified. According to this, it becomes easier for the driver to recognize his or her current state and the stimulus being applied to him or her at the current time. In addition to the information on the current driver state and the current act type, as plan-related information, the type of stimulus (hereinafter, the planned act type) that was to be applied to the driver at the current time in the stimulus plan determined by the plan determination unit 207, and the ideal state of the driver (that is, the ideal state) that was to be induced by that stimulus are also preferably displayed on the display device 24. According to this, it becomes easier for the driver to recognize the differences in the driver's state and act type between the plan and the actual situation. The presentation control unit 204 may display the information on the current driver state and the current act type and the information on the ideal state and the planned act type on the same screen of the display device 24 in a comparable manner. Note that the vehicle being in the middle of traveling on the predicted route includes the case where the vehicle is temporarily stopped with the power switch, which will be described later, being on.

[0080] Here, with reference to FIGS. 7 and 8, an example of the display of the information on the current driver state and the current act type, and the information on the ideal state and the planned act type will be described. First, an example of the case of being superimposed and displayed on the electronic map will be described using FIG. 7. The CP in FIG. 7 indicates the current position of the own vehicle. The PU in FIG. 7 indicates the information on the current driver state and the current act type. The PMIc in FIG. 7 indicates the information on the current driver state. The CTS in FIG. 7 indicates the information on the current act type. As shown in FIG. 7, the display of the information on the current driver state and the current act type may be performed by a pop-up display starting from the current position. For the current driver state, as shown in the PMIC of FIG. 7, it may be represented by an icon. For the current act type, as shown in the CTS of FIG. 7, the name of the current act type and an example of the display of the current act type may be displayed. For the ideal state, as shown by the IMIc in FIG. 7, it may be superimposed and displayed on the electronic map along the predicted route. For the planned act type, as shown in FIG. 7, it may be represented by the difference in the line types to be superimposed on the predicted route. The proper use of the line types for each act type may be the same as the example in FIG. 5.

[0081] Subsequently, an example of the case of displaying the information on the current driver state and the current act type, and the information on the ideal state and the planned act type without being superimposed on the electronic map will be described using FIG. 8. In this case, the information on the current driver state and the current act type, and the information on the ideal state and the planned act type may be displayed in front of the driver, for example, by HUD. The Pr in FIG. 8 is an example of the display of the information on the current driver state and the current act type. The Sc in FIG. 8 is an example of the display of the information on the ideal state and the planned act type. For both the current driver state and the ideal state, as shown in FIG. 8, they may be represented by icons. For the current act type, as shown in the Pr of FIG. 8, the name of the current act type and an example of the display of the current act type may be displayed. For the planned act type, as shown in the Sc of FIG. 8, the name of the planned act type and an example of the display of the planned act type may be displayed.

[0082] While the stimulation control unit 209 is performing stimulation, the prompting control unit 204 preferably presents information (hereinafter referred to as "advance notice information") that notifies the driver of the stimulation that is scheduled to be performed next in the stimulation plan determined by the plan determination unit 207. In the plan determined by the plan determination unit 207, the stimulation scheduled to be performed next after a certain stimulation is, of course, a different type of stimulation from that certain stimulation. According to this, when a stimulation that is not preferable for the driver is scheduled as the next stimulation, the driver can change the next stimulation. The timing for presenting the advance notice information may be set at the end stage of the previous stimulation. For example, the timing for presenting the advance notice information may be set to 10 seconds before the stimulation is switched. The advance notice information may be presented by being displayed on the display device 24. The advance notice information may also be presented by voice output from the voice output device 25. The prompting control unit 204 may identify the next stimulation to be performed based on the stimulation plan determined by the plan determination unit 207 and the current vehicle position measured by the locator 6.

[0083] Hereinafter, an example of the display of the advance notice information will be described with reference to FIG. 9. The advance notice information may be displayed on the HUD, or may be displayed on the display of the navigation device, the CID, etc. As the advance notice information, as shown in FIG. 9, an image representing the image of the next stimulation may be displayed. As the advance notice information, as shown in FIG. 9, the remaining time until the switch to the next stimulation may also be displayed. As the advance notice information, information indicating the type of the next stimulation may also be displayed. As an example, as shown in the NTS in FIG. 9, the name of the type of the next stimulation and an example of the display of the type of the stimulation may be displayed.

[0084] <Driver state induction related processing in HCU20> Next, an example of the flow of driver state guidance-related processing in the HCU 20 will be described using the flowchart of FIG. 10. The flowchart of FIG. 10 may be configured to start when the power of the HCU 20 is also turned on when, for example, a switch (hereinafter, a power switch) for starting the internal combustion engine or the motor generator of the host vehicle is turned on. Alternatively, in the case of a configuration in which the on / off setting of the function for executing the driver state guidance-related processing can be switched via the user input device 26, the configuration may be such that the condition that the function for executing the driver state guidance-related processing is on is added.

[0085] First, in step S1, the state specifying unit 201 specifies the current state of the driver of the host vehicle. In step S2, planning-related processing is performed, and the process proceeds to step S3. Here, an example of the flow of the planning-related processing will be described using the flowchart of FIG. 11.

[0086] In step S201, the target estimation unit 202 estimates the target state of the driver. In step S202, the route prediction unit 203 predicts the route of the host vehicle. In the example of FIG. 5, the route prediction unit 203 will be described as predicting a plurality of candidate routes. In step S203, the presentation control unit 204 causes the information of the plurality of candidate routes predicted in S202 to be presented. In step S204, the route selection unit 205 selects one route from among the plurality of candidate routes predicted in S202 according to the selection input received from the driver. Note that the configuration may be such that the route prediction unit 203 narrows down the prediction to one route in S202. In this case, the processes of S203 to S204 may be omitted.

[0087] In step S205, the situation prediction unit 206 predicts the on-road situation of the predicted route selected in S204. If in S202 the route prediction unit 203 is configured to narrow down the prediction to one route, then the on-road situation of the predicted route predicted in S203 may be predicted. In step S206, the plan determination unit 207 determines a stimulation plan according to the state of the driver specified in S1, the target state estimated in S201, and the on-road situation on the predicted route predicted in S205. In the example of FIG. 5, it is described as determining a plurality of candidate plans for one predicted route.

[0088] In step S207, the presentation control unit 204 causes the information of the plurality of candidate plans determined in S206 to be presented. In step S208, the plan selection unit 208 selects one candidate plan from the plurality of candidate plans determined in S206 according to the selection input received from the driver. In step S209, the plan determination unit 207 determines the candidate plan selected in S208 as the stimulation plan and proceeds to step S3. Note that in S206, the plan determination unit 207 may be configured to narrow down and determine to one stimulation plan. In this case, the processes of S207 to S208 may be omitted, and in S209, the stimulation plan determined in S206 may be directly determined as the stimulation plan.

[0089] Returning to FIG. 10, in step S3, the stimulation control unit 209 starts the stimulation to the driver according to the stimulation plan determined in S209. The stimulation to the driver will be performed along the stimulation plan determined in S209 on the road of the predicted route. For example, in a congested section, a stimulation estimated to improve "irritation" is performed. In a section with monotonous driving, a stimulation estimated to improve a distracted state or drowsiness is performed. In a high-load section, the stimulation is suppressed. For a section where no state change is predicted, a stimulation to induce the ideal state in that section is performed.

[0090] In step S4, the state identification unit 201 identifies the current state of the driver of the host vehicle. In step S5, if the stimulus according to the stimulus plan determined in S209 is different from the stimulus according to the current state identified in S4 (YES in S5), the process proceeds to step S6. On the other hand, if they are not different (NO in S5), the process proceeds to step S8. That is, the stimulus according to the stimulus plan is continued. The stimulus according to the current state may be determined by the stimulus control unit 209 with reference to the correspondence relationship between the pre-associated driver state and the stimulus. For example, for an uncomfortable state, a stimulus to eliminate the uncomfortable state may be determined. For a comfortable state, a stimulus to maintain the comfortable state may be determined.

[0091] In step S6, if the stimulus according to the current state identified in S4 should be the stimulus to be prioritized over the stimulus according to the stimulus plan determined in S209 (YES in S6), the process proceeds to step S7. On the other hand, if it is not the stimulus to be prioritized (NO in S6), the process proceeds to step S8. That is, the stimulus according to the stimulus plan is continued. Regarding the determination of priority, the stimulus control unit 209 may make a determination according to the priority order described above. In step S7, the stimulus control unit 209 causes the stimulus according to the current state identified in S4 to be performed preferentially over the stimulus according to the stimulus plan determined in S209.

[0092] In step S8, if the traveling route of the host vehicle deviates from the predicted route used in the stimulus plan determined in S209 (YES in S8), the process proceeds to step S9. On the other hand, if the traveling route of the host vehicle does not deviate from the predicted route (NO in S8), the process proceeds to step S12. That is, the stimulus according to the stimulus plan is continued. Regarding whether the traveling route of the host vehicle has deviated from the predicted route, it may be determined by, for example, the route prediction unit 203 using the vehicle position measured by the locator 6.

[0093] In step S9, re-planning related processing is performed. The re-planning related processing may be the same as the above-described planning related processing. Note that in the re-planning related processing, as the target state, the target state estimated in the planning related processing may be used, or a newly re-estimated configuration may be used.

[0094] In step S10, the presentation control unit 204 causes the changed content of the stimulation plan due to re - determining the stimulation plan to be presented. In step S11, the stimulation control unit 209 starts the stimulation to the driver according to the stimulation plan re - determined in the replanning related process of S9.

[0095] In step S12, if it is the end timing of the driver state guidance related process (YES in S12), the driver state guidance related process is ended. On the other hand, if it is not the end timing of the driver state guidance related process (NO in S12), the process returns to S4 and is repeated. As an example of the end timing of the driver state guidance related process, there are cases where the power switch of the own vehicle is turned off, the destination is reached, the function for executing the driver state guidance related process is switched to the off setting, etc.

[0096] <Summary of Embodiment 1> According to the configuration of Embodiment 1, in addition to the current state of the identified driver and the target state of the driver, according to the situation on the predicted route of the predicted route, a plan for the stimulation to the driver used on the predicted route of the own vehicle for guiding the driver's state to the target state is determined. Therefore, it becomes possible to plan a more suitable type of stimulation according to the change in the situation on the route of the own vehicle. And on the predicted route, the driver is stimulated according to the determined plan, so as a stimulation for guiding the driver state to a preferable state, it becomes possible to perform a type of stimulation corresponding to the change in the situation on the vehicle's route.

[0097] According to the configuration of Embodiment 1, it becomes possible to start or suppress the stimulation to the five senses of the driver according to the schedule according to the situation without disturbing the driving. Also, when the situation changes, the stimulation is rescheduled, so it becomes possible to perform a type of stimulation corresponding to the change in the situation on the vehicle's route.

[0098] (Embodiment 2) Not limited to the configuration of Embodiment 1, the configuration of the following Embodiment 2 may also be used. Hereinafter, an example of the configuration of Embodiment 2 will be described with reference to the drawings. The vehicle system 1 of Embodiment 2 is the same as the vehicle system 1 of Embodiment 1 except that it includes an HCU20a instead of the HCU20.

[0099] <Schematic Configuration of HCU20a> Subsequently, the schematic configuration of the HCU20a will be described with reference to FIG. 12. As shown in FIG. 12, the HCU20a includes, with respect to the driver state guidance related processing, a state identification unit 201, a presentation control unit 204a, a plan determination unit 207a, a stimulation control unit 209, a recording processing unit 210, a history storage unit 211, a mode switching unit 212, a state prediction unit 213, and an evaluation unit 214 as functional blocks. In FIG. 12, the illustration of functional blocks not related to the processing different from that of Embodiment 1 is omitted. That is, the HCU20a also includes, as functional blocks, a target estimation unit 202, a route prediction unit 203, a route selection unit 205, a situation prediction unit 206, and a plan selection unit 208 that perform the same processing as in Embodiment 1. The HCU20a is the same as the HCU20 of Embodiment 1 except that it includes a presentation control unit 204a and a plan determination unit 207a instead of the presentation control unit 204 and the plan determination unit 207, and that it includes a recording processing unit 210, a history storage unit 211, a mode switching unit 212, a state prediction unit 213, and an evaluation unit 214. This HCU20a also corresponds to a driver state guidance device. Also, the execution of the processing of each functional block of the HCU20a by a computer also corresponds to the execution of a driver state guidance method.

[0100] The recording processing unit 210 stores in the history storage unit 211 the history of the points where the vehicle has traveled in the past (hereinafter referred to as point history), the stimuli at those points (hereinafter referred to as stimulus history), and the driver's state at those points (hereinafter referred to as driver state history). The stimulus here refers to the stimulus given to the driver by the stimulus control unit 209 in accordance with the stimulus plan determined by the plan determination unit 207. The recording processing unit 210 only needs to identify the points where the vehicle has traveled from the current vehicle position measured by the locator 6. Then, the identified points may be used as the point history. The recording processing unit 210 may use the stimulus given by the stimulus control unit 209 at that point as the stimulus history at that point. The recording processing unit 210 may use the driver's state identified by the state identification unit 201 at that point as the driver state history at that point. Then, the recording processing unit 210 only needs to associate these histories and store them in the history storage unit 211. The recording processing unit 210 may store the histories separately for each trip. A trip is defined as the period from when the vehicle's power switch is turned on to when it is turned off. As the history storage unit 211, a non-volatile memory may be used.

[0101] The mode switching unit 212 switches the display mode according to the input received from the driver via the user input device 26. This input may be an input for selecting the display mode. Examples of the display mode include a normal mode, a history mode, a planned comparison mode, a past comparison mode, and a prediction mode. The normal mode is the default display mode. In the normal mode, for example, as shown in FIG. 7, the current planned related information during driving is displayed. The history mode is a display mode for presenting past history. The planned comparison mode is a display mode for displaying (hereinafter referred to as planned comparison display) information on the current driver state and the current act type and information on the ideal state and the planned act type, as shown in FIGS. 7 and 8. The planned comparison display may be configured to be performed in the normal mode, but here, it is configured to be performed when the planned comparison mode is selected. The past comparison mode is a display mode for displaying information on the current driver state and the current act type and information on the driver state and the act type in the past history. The prediction mode is a display mode for displaying the prediction of the change in the driver's state when a stimulus is provided and when it is not provided. Note that the display modes that can be switched by the mode switching unit 212 may be a part of the above-described display modes.

[0102] The state prediction unit 213 predicts the change in the driver's state when a stimulus is applied and when it is not applied in accordance with the stimulus plan determined by the plan determination unit 207. The state prediction unit 213 may predict the change from the current driver state. The current driver state may be specified by the state specifying unit 201. The state prediction unit 213 may predict the ideal state determined by the plan determination unit 207 as the change in the driver's state when a stimulus is applied in accordance with the stimulus plan. As described above, it is assumed that the transit state and the target state are allocated to the ideal state. The state prediction unit 213 may predict the change in the driver's state when a stimulus is not applied in accordance with the road situation predicted by the situation prediction unit 206. For example, at a timing when driving monotony is predicted as the road situation, the change in the driver's state to "bored" or "sleepy" may be predicted. In addition, at a timing when traffic congestion is predicted as the road situation, the change in the driver's state to "irritated" may be predicted.

[0103] The prompt control unit 204a preferably superimposes and displays the history information (hereinafter referred to as history information) stored in the history storage unit 211 on the map according to the input received from the driver by the user input device 26. According to this, the driver can check and evaluate the past history. The prompt control unit 204a displays the history information when the history mode is selected. The user input device 26 corresponds to the input reception unit.

[0104] Here, an example of the display of the history information will be described with reference to FIG. 13. The history information is superimposed and displayed on the electronic map on the screen of the display device 24. The icon shown in HMIc of FIG. 13 corresponds to the information of the driver state history. The route from the company to the home in FIG. 13 corresponds to the information of the point history for one trip. The group of point histories for one trip corresponds to the route for one trip traveled in the past. The display shown separately by line type in FIG. 13 corresponds to the information of the stimulus history. As shown in FIG. 13, for the route for one trip, the past driver state and the stimulus given in the past are associated and displayed. The prompt control unit 204a may display a plurality of pieces of history information separately for each trip. For example, as shown in FIG. 13, the history information may be displayed in a stack display format separately for each trip. In this case, the history information to be displayed at the forefront may be made switchable according to the input received from the driver by the user input device 26.

[0105] The prompt control unit 204a, in addition to causing the display device 24 to display information on the state of the driver identified by the state identification unit 201 (i.e., the current driver state) while the vehicle is traveling on the predicted route and the type of stimulus being given to the driver at the time when the state of the driver is identified (i.e., the current act type), preferably also causes the display device 24 to display information on the type of stimulus and the state of the driver at the same location in the past based on the history stored in the history storage unit 211. According to this, the driver can more easily recognize the differences in the state of the driver and the act type between the present and the past at the same location. Hereinafter, the type of stimulus at the same location in the past will be referred to as the past act type. Also, the state of the driver at the same location in the past will be referred to as the past driver state. When the past comparison mode is selected, the prompt control unit 204a causes the display device 24 to display information on the past driver state and the past act type in addition to the information on the current driver state and the current act type. The prompt control unit 204a may display the information on the current driver state and the current act type and the information on the past driver state and the past act type on the same screen of the display device 24 in a comparable manner.

[0106] The prompt control unit 204a preferably narrows down the past same location as described above to the past same location in the trip where the starting point of the current trip is the same as the starting point of the travel stored in the history storage unit 211. According to this, the driver can more easily recognize the differences in the state of the driver and the act type between the present and the past at the same location in a similar route. Therefore, the driver can more easily compare the differences in the state of the driver and the act type between the present and the past in a more similar situation. Also, the prompt control unit 204a preferably narrows down the past same location as described above to the past same location in the trip where the predicted route of the current trip and the route from the starting point to the destination are the same among the histories stored in the history storage unit 211. According to this, the driver can more easily recognize the differences in the state of the driver and the act type between the present and the past at the same location in the same route. Therefore, the driver can more easily compare the differences in the state of the driver and the act type between the present and the past, particularly in a similar situation.

[0107] Here, with reference to FIGS. 14 and 15, an example of the display of the information on the current driver state and the current act type, and the information on the past driver state and the past act type will be described. First, an example of the case where it is superimposed and displayed on the electronic map will be described using FIG. 14. The CP in FIG. 14 indicates the current position of the own vehicle. The PU in FIG. 14 indicates the information on the current driver state and the current act type. The PMIc in FIG. 14 indicates the information on the current driver state. The CTS in FIG. 14 indicates the information on the current act type. As shown in FIG. 14, the display of the information on the current driver state and the current act type may be performed by a pop-up display starting from the current position. For the current driver state, as shown in the PMIC of FIG. 14, it may be represented by an icon. For the current act type, as shown in the CTS of FIG. 14, the name of the current act type and an example of the display of the current act type may be displayed. For the past driver state, as shown by the HMIc in FIG. 14, it may be superimposed and displayed on the electronic map along the route as a group of location histories. For the past act type, as shown in FIG. 14, it may be represented by the difference in the line types superimposed on the route as a group of location histories. The proper use of line types for different act types may be the same as the example in FIG. 5.

[0108] Subsequently, an example of the case where the information on the current driver state and the current act type, and the information on the past driver state and the past act type are displayed without being superimposed on the electronic map will be described using FIG. 15. In this case, the information on the current driver state and the current act type, and the information on the past driver state and the past act type may be displayed in front of the driver, for example, on the HUD. The Pr in FIG. 15 is an example of the display of the information on the current driver state and the current act type. The Hi in FIG. 15 is an example of the display of the information on the past driver state and the past act type. For both the current driver state and the past driver state, as shown in FIG. 15, they may be represented by icons. For the current act type, as shown in the Pr of FIG. 15, the name of the current act type and an example of the display of the current act type may be displayed. For the past act type, as shown in the Hi of FIG. 15, the name of the past act type and an example of the display of the past act type may be displayed.

[0109] The prompt control unit 204a preferably causes the display device 24 to display the result predicted by the state prediction unit 213. According to this, the driver can predict the change in the driver's state when the stimulation according to the stimulation plan is performed and when it is not performed. Therefore, it becomes possible for the driver to select the presence or absence of stimulation in consideration of this change. The prompt control unit 204a displays the result predicted by the state prediction unit 213 when the prediction mode is selected.

[0110] Here, with reference to FIG. 16, an example of the display of the result predicted by the current state prediction unit 213 will be described. The prompt control unit 204a may cause a display that represents the predicted state transition of the driver starting from the current driver state, separately for the presence or absence of stimulation. As a specific example, as shown in FIG. 16, the driver's state may be represented by an icon imitating an expression. Then, this icon may be arranged and displayed in the order corresponding to the prediction of the state transition of the driver for each presence or absence of stimulation.

[0111] The evaluation unit 214 evaluates at least one of the stimuli being given to the driver, the stimuli planned to be given to the driver, and the past stimuli given to the driver, according to the input received from the driver by the user input device 26. As inputs regarding the evaluation, there may be an input for selecting the stimulus to be evaluated (hereinafter referred to as a stimulus selection input) and an input for evaluating the stimulus (hereinafter referred to as a stimulus evaluation input). As the user input device 26 for performing the stimulus selection input, a touch panel may be used. Thereby, a touch operation on the information of the act type displayed on the screen of the display device 24 may be received as a stimulus selection input. For example, a touch operation on the information of the current act type as shown in FIGS. 7, 8, 14, and 15 is an input for selecting the stimulus being given to the driver. For example, a touch operation on the information of the planned act type as shown in FIG. 5 is an input for selecting the stimulus planned to be given to the driver. A touch operation on the information of the section where the vehicle has not passed among the information of the planned act type as shown in FIG. 7 is also an input for selecting the stimulus planned to be given to the driver. A touch operation on the information indicating the type of the next stimulus as shown in FIG. 9 is also an input for selecting the stimulus planned to be given to the driver. For example, a touch operation on the information of the past act type as shown in FIGS. 13 and 14 is an input for selecting the past stimulus given to the driver. A touch operation on the information of the section where the vehicle has passed among the information of the planned act type as shown in FIG. 7 is also an input for selecting the past stimulus given to the driver.

[0112] The stimulus evaluation input may be based on a rating as shown in FIG. 17. In this case, the evaluation unit 214 may determine that the higher the numerical value of the rating, the higher the evaluation of the stimulus. The evaluation unit 214 may perform an evaluation of the stimulus for the same driving situation as the driving situation in which it is determined to perform the stimulus in the stimulus plan. Further, the stimulus evaluation input may be such that the user selects a preferred stimulus from the options as shown in FIG. 18 and changes the stimulus. In this case, the evaluation unit 214 may lower the evaluation of the changed stimulus while raising the evaluation of the selected stimulus.

[0113] The planning decision-making unit 207a preferably makes it easier for a stimulus with a higher evaluation in the evaluation unit 214 to be selected and changed in the stimulus plan, while making it more difficult for a stimulus with a lower evaluation in the evaluation unit 214 to be selected and changed in the stimulus plan. According to this, it becomes possible to improve so as to give a stimulus more in accordance with the driver's preference.

[0114] (Embodiment 3) Note that the stimulus for inducing the driver's state is not limited to the stimuli described in the foregoing embodiments. For example, it may be configured to induce the driver's state by other types of stimuli such as vibration by a vibrator.

[0115] (Embodiment 4) In the foregoing embodiments, the configuration in which the HCU 20, 20a is responsible for the driver state induction related processing has been shown, but it is not necessarily limited to this. For example, the configuration may be such that the HCU 20, 20a and other ECUs are responsible for the driver state induction related processing, or the configuration may be such that other ECUs are responsible for the driver state induction related processing.

[0116] Note that the present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present disclosure. Further, the control unit and its method described in the present disclosure may be realized by a dedicated computer configured to include a processor programmed to execute one or more functions embodied by a computer program. Alternatively, the device and its method described in the present disclosure may be realized by dedicated hardware logic circuits. Or, the device and its method described in the present disclosure may be realized by one or more dedicated computers configured by a combination of a processor that executes a computer program and one or more hardware logic circuits. Further, the computer program may be stored in a computer-readable non-transitory tangible recording medium as instructions to be executed by a computer.

[0117] (Disclosed technical idea) This specification discloses a plurality of technical ideas described in a plurality of clauses listed below. Some clauses may be described in a multiple dependent form that alternatively quotes a preceding clause in a subsequent clause. Furthermore, some clauses may be described in a multiple dependent form that quotes a clause in another multiple dependent form. The clauses described in these multiple dependent forms define a plurality of technical ideas.

[0118] Technical idea 1 A driver state guidance device that can be used in a vehicle, A state identification unit (201) that identifies the state of the driver of the vehicle, A target estimation unit (202) that estimates a target state that is the state the driver aims for, A route prediction unit (203) that predicts the route of the vehicle, A situation prediction unit (206) that predicts the situation on the predicted route predicted by the route prediction unit, In addition to the state of the driver identified by the state identification unit and the target state estimated by the target estimation unit, according to the situation on the predicted route predicted by the situation prediction unit, a plan determination unit (207, 207a) that determines a plan for the stimulus to the driver used on the predicted route to guide the state of the driver to its target state, A driver state guidance device including a stimulus control unit (209) that gives a stimulus to the driver along the plan determined by the plan determination unit on the predicted route.

[0119] Technical idea 2 The driver state guidance device according to Technical idea 1, The situation prediction unit also predicts, as the situation, a situation where the driving load of the driver increases, The planning determination unit is a driver state induction device that determines a plan for stimulating the driver so as to suppress the stimulation for a section in the predicted route where a situation in which the driving load of the driver increases is predicted by the situation prediction unit.

[0120] Technical idea 3 The driver state induction device according to Technical idea 1 or 2, For the stimulation whose planned duration is less than the threshold value, the planning determination unit omits the stimulation and replaces it with the stimulations before and after the stimulation, and determines a plan for stimulating the driver.

[0121] Technical idea 4 The driver state induction device according to any one of Technical ideas 1 to 3, The situation prediction unit also predicts, as the situation, a situation that deteriorates the state of the driver. For a section in the predicted route where a situation that deteriorates the state of the driver is predicted by the situation prediction unit, the planning determination unit determines a plan for stimulating the driver so as to perform a stimulation estimated to improve the deterioration, and prior to entering the section, determines a plan for stimulating the driver so as to start a stimulation estimated to improve the deterioration.

[0122] Technical idea 5 The driver state induction device according to any one of Technical ideas 1 to 4, The situation prediction unit predicts, as the situation, at least one of a situation in which the driving load of the driver increases, the degree of traffic congestion, and the monotony of driving.

[0123] Technical idea 6 The driver state induction device according to any one of Technical ideas 1 to 5, A driver state induction device including a presentation control unit (204, 204a) that presents plan-related information, which is information on a plan for stimulating the driver determined by the planning determination unit.

[0124] Technical idea 7 The driver state guidance device described in Technical idea 6, wherein the presentation control unit causes the plan-related information to be presented at least by display on a display device (24), and as the plan-related information, the predicted route, the type of the stimulus to be given to the driver on the way of the predicted route along the plan determined by the plan determination unit, and information on the ideal state of the driver to be induced by the stimulus are superimposed and displayed on a map. A driver state guidance device.

[0125] Technical idea 8 The driver state guidance device described in Technical idea 6 or 7, wherein the presentation control unit causes the plan-related information to be presented at least by display on a display device (24), and in addition to displaying information on the state of the driver specified by the state specifying unit and the type of the stimulus being given to the driver at the time of specifying the state of the driver while the vehicle is traveling on the predicted route, as the plan-related information, information on the type of the stimulus that was to be given to the driver at that time in the plan determined by the plan determination unit and the ideal state of the driver to be induced by the stimulus is also displayed. A driver state guidance device.

[0126] Technical idea 9 The driver state guidance device according to any one of Technical ideas 6 to 8, comprising a history storage unit (211) that stores a history of the points where the vehicle has traveled in the past, the stimuli at those points, and the states of the driver at those points, wherein the presentation control unit (204a) causes information to be presented at least by display on a display device (24), and in response to an input received by an input reception unit (26) that receives an input from the driver, the history information stored in the history storage unit is superimposed and displayed on a map. A driver state guidance device.

[0127] Technical idea 10 The driver state guidance device according to any one of Technical Ideas 6 to 9, comprising a history storage unit (211) that stores a history of locations where the vehicle has traveled in the past, the stimuli at those locations, and the states of the driver at those locations. The presentation control unit (204a) causes information to be presented at least by display on a display device (24). In addition to displaying information on the state of the driver identified by the state identification unit while the vehicle is traveling on the predicted route and the type of the stimulus being given to the driver at the time when the state of the driver is identified, information on the type of the stimulus and the state of the driver at the same location in the past based on the history stored in the history storage unit is also displayed. A driver state guidance device.

[0128] Technical Idea 11 The driver state guidance device according to any one of Technical Ideas 6 to 10, wherein the presentation control unit presents information for notifying of a stimulus that is scheduled to be given next to that stimulus in the plan determined by the plan determination unit, starting from the middle of the process of giving the stimulus by the stimulus control unit. A driver state guidance device.

[0129] Technical Idea 12 The driver state guidance device according to any one of Technical Ideas 6 to 11, comprising an evaluation unit (214) that evaluates at least one of the stimulus being given to the driver, the stimulus scheduled to be given to the driver, and the past stimulus given to the driver, according to an input received by an input reception unit (26) that receives an input from the driver. The plan determination unit (207a) is a driver state guidance device that makes it easier to select and change a stimulus with a higher evaluation by the evaluation unit in the plan, while making it more difficult to select and change a stimulus with a lower evaluation by the evaluation unit in the plan.

[0130] Technical Idea 13 The driver state guidance device according to any one of Technical Ideas 6 to 12, A state prediction unit (213) that predicts changes in the driver's state when the stimulation is performed and when it is not performed according to the plan determined by the plan determination unit is provided. The presentation control unit (204a) presents information at least by display on the display device (24), and is a driver state guidance device that displays the result predicted by the state prediction unit.

[0131] Technical idea 14 The driver state guidance device according to any one of technical ideas 6 to 13, When the route actually traveled by the vehicle deviates from the predicted route, the route prediction unit re-predicts the route of the vehicle. When the route prediction unit re-predicts the route of the vehicle, the situation prediction unit predicts the situation on the re-predicted predicted route. When the route prediction unit re-predicts the route of the vehicle, the plan determination unit re-determines the plan for stimulating the driver according to the situation on the re-predicted predicted route. When the plan determination unit re-determines the plan for stimulating the driver, the presentation control unit presents, as at least the plan-related information, the content of the change in the plan due to re-determining the plan for stimulating the driver. It is a driver state guidance device.

[0132] Technical idea 15 The driver state guidance device according to any one of technical ideas 6 to 14, The route prediction unit predicts a plurality of candidate routes as the route of the vehicle. The presentation control unit presents information on the plurality of candidate routes predicted by the route prediction unit as at least the plan-related information. A route selection unit (205) is provided that selects one route from the plurality of candidate routes predicted by the route prediction unit according to a selection input received from the driver. The situation prediction unit is a driver state guidance device that predicts the situation on the predicted route, using the route selected by the route selection unit from among the plurality of candidate routes predicted by the route prediction unit as the predicted route.

[0133] Technical idea 16 The driver state guidance device according to any one of technical ideas 6 to 15, wherein The plan determination unit determines a plurality of candidate plans for one of the predicted routes as a plan for stimulating the driver. The presentation control unit causes at least the plan-related information to present information on the plurality of candidate plans determined by the plan determination unit. A plan selection unit (208) that selects one plan from among the plurality of candidate plans determined by the plan determination unit according to a selection input received from the driver is provided. The stimulation control unit is a driver state guidance device that causes stimulation to the driver along the plan selected by the plan selection unit from among the plurality of candidate plans determined by the plan determination unit on the predicted route.

[0134] Technical idea 17 The driver state guidance device according to any one of technical ideas 1 to 16, wherein The situation prediction unit also predicts, as the situation, a situation that changes the state of the driver. The plan determination unit, when the state of the driver different from the state is actually specified by the state specifying unit in the section where the situation prediction unit predicts the situation that changes the state of the driver, re-determines the plan for stimulating the driver so as to use a stimulation corresponding to the state of the driver actually specified by the state specifying unit for that section.

[0135] Technical idea 18 The driver state guidance device according to any one of technical ideas 1 to 17, wherein The state specifying unit specifies a state including a specific state which is at least one of drowsiness, a distracted state, and a stressed state as the state of the driver. The stimulation control unit is a driver state guidance device that, on the predicted route, based on the fact that the specific state has been specified by the state specifying unit, causes the driver to receive a stimulation estimated to improve the specific state regardless of the plan determined by the plan determination unit.

[0136] Technical idea 19 The driver state guidance device according to Technical idea 18, The stimulation control unit causes a stimulation estimated to improve the specific state to be given. After the state specified by the state specifying unit has improved from the specific state, on the predicted route, based on the fact that a non-inductive stimulation, which is a stimulation estimated not to induce the specific state again, does not match the stimulation along the plan determined by the plan determination unit, the driver state guidance device preferentially causes the non-inductive stimulation to be given regardless of the plan determined by the plan determination unit.

[0137] Technical idea 20 The driver state guidance device according to Technical idea 18, The state specifying unit specifies at least one of drowsiness, a distracted state, a stressed state, an uncomfortable state other than the specific state, and a comfortable state as the state of the driver. The stimulation control unit, when a request to give a stimulation that does not match the stimulation along the plan determined by the plan determination unit occurs on the predicted route, according to the priority order of stimulation corresponding to drowsiness, stimulation corresponding to a distracted state, stimulation corresponding to a stressed state, stimulation corresponding to the uncomfortable state, and stimulation corresponding to the comfortable state in descending order of priority, causes the driver to receive the stimulation with the higher priority among the stimulation along the plan determined by the plan determination unit and the stimulation that does not match it.

[0138] Technical idea 21 A driver state guidance method that can be used in a vehicle, executed by at least one processor, a state identification step of identifying the state of the driver of the vehicle, a target estimation step of estimating a target state that is the state the driver aims for, a route prediction step of predicting the route of the vehicle, a situation prediction step of predicting the situation on the predicted route predicted in the route prediction step, In addition to the state of the driver identified in the state identification step and the target state estimated in the target estimation step, according to the situation on the predicted route predicted in the situation prediction step, a plan determination step of determining a plan for the stimulus to the driver to guide the state of the driver to its target state, for use in the middle of the predicted route; A driver state guidance method including a stimulus control step of causing a stimulus to the driver along the plan determined in the plan determination step in the middle of the predicted route.

Explanation of Signs

[0139] 1 Vehicle system, 20, 20a HCU (Driver state guidance device), 24 Display device, 26 User input device (Input reception unit), 201 State identification unit, 202 Target estimation unit, 203 Route prediction unit, 204, 204a Presentation control unit, 205 Route selection unit, 206 Situation prediction unit, 207, 207a Plan determination unit, 208 Plan selection unit, 209 Stimulus control unit, 210 Recording processing unit, 211 History storage unit, 212 Mode switching unit, 213 State prediction unit, 214 Evaluation unit 214

Claims

1. A driver state guidance device that can be used in a vehicle, a state identification unit (201) that identifies the state of the driver of the vehicle, a target estimation unit (202) that estimates the target state that is the state the driver aims for, a route prediction unit (203) that predicts the route of the vehicle, a situation prediction unit (206) that predicts the situation on the predicted route predicted by the route prediction unit, in addition to the state of the driver identified by the state identification unit and the target state estimated by the target estimation unit, according to the situation on the predicted route predicted by the situation prediction unit, a plan determination unit (207, 207a) that determines a plan for the stimulation to the driver used on the predicted route to guide the state of the driver to the target state, and a stimulation control unit (209) that causes stimulation to the driver along the plan determined by the plan determination unit on the predicted route, wherein the plan determination unit omits the stimulation whose planned duration is less than the threshold value and replaces it with the stimulations before and after that stimulation, and is a driver state guidance device that determines a plan for the stimulation to the driver.

2. A driver state guidance device that can be used in a vehicle, a state identification unit (201) that identifies the state of the driver of the vehicle, a target estimation unit (202) that estimates the target state that is the state the driver aims for, a route prediction unit (203) that predicts the route of the vehicle, a situation prediction unit (206) that predicts the situation on the predicted route predicted by the route prediction unit, in addition to the state of the driver identified by the state identification unit and the target state estimated by the target estimation unit, according to the situation on the predicted route predicted by the situation prediction unit, a plan determination unit (207, 207a) that determines a plan for the stimulation to the driver used on the predicted route to guide the state of the driver to the target state, and a stimulation control unit (209) that causes stimulation to the driver along the plan determined by the plan determination unit on the predicted route, wherein the situation prediction unit also predicts, as the situation, a situation that changes the state of the driver. When, in a section predicted by the situation prediction unit as a situation in which the state of the driver changes, a state of the driver different from that state is actually specified by the state specifying unit, for that section, the driving state induction device re-determines a plan for stimulating the driver so as to use a stimulus corresponding to the state of the driver actually specified by the state specifying unit.

3. The driver state induction device according to claim 2, wherein the state specifying unit specifies a state including a specific state which is at least one of a drowsy state, a distracted state, and a stressed state as the state of the driver; and the stimulus control unit, in the middle of the predicted route, based on the fact that the specific state is specified by the state specifying unit, causes a stimulus estimated to improve the specific state specified by the state specifying unit to be applied as a stimulus to the driver, regardless of the plan determined by the plan determination unit.

4. A driver state induction device that can be used in a vehicle, comprising a state specifying unit (201) that specifies the state of the driver of the vehicle, a target estimation unit (202) that estimates a target state which is the state the driver aims for, a route prediction unit (203) that predicts the route of the vehicle, a situation prediction unit (206) that predicts the situation in the middle of the predicted route predicted by the route prediction unit, a plan determination unit (207, 207a) that determines a plan for a stimulus to the driver to be used in the middle of the predicted route for guiding the state of the driver to the target state according to the state of the driver specified by the state specifying unit, the target state estimated by the target estimation unit, and the situation on the predicted route predicted by the situation prediction unit, and a stimulus control unit (209) that applies a stimulus to the driver along the plan determined by the plan determination unit in the middle of the predicted route; wherein the state specifying unit specifies a state including a specific state which is at least one of a drowsy state, a distracted state, and a stressed state as the state of the driver; and the stimulus control unit, in the middle of the predicted route, based on the fact that the specific state is specified by the state specifying unit, causes a stimulus estimated to improve the specific state specified by the state specifying unit to be applied as a stimulus to the driver, regardless of the plan determined by the plan determination unit.

5. The driver state induction device according to claim 3 or 4, The stimulation control unit causes a stimulation estimated to improve the specific state. After the state specified by the state specifying unit improves from the specific state, in the middle of the predicted route, it is estimated that the specific state will not be induced again. Based on the fact that a non-inductive stimulation different from the stimulation estimated to improve the specific state and the stimulation along the plan determined by the plan determination unit do not match, regardless of the plan determined by the plan determination unit, a driver state guidance device that preferentially performs the non-inductive stimulation.

6. The driver state guidance device according to any one of claims 1 to 4, The situation prediction unit also predicts, as the situation, a situation where the driving load of the driver increases. The plan determination unit determines a plan for stimulating the driver to suppress the stimulation for a section of the predicted route in which a situation where the driving load of the driver increases is predicted by the situation prediction unit. A driver state guidance device.

7. The driver state guidance device according to any one of claims 2 to 4, For the stimulation whose planned duration is less than the threshold value, the plan determination unit omits the stimulation and replaces it with the stimulations before and after the stimulation, and determines a plan for stimulating the driver. A driver state guidance device.

8. The driver state guidance device according to any one of claims 1 to 4, The situation prediction unit also predicts, as the situation, a situation that deteriorates the state of the driver. The plan determination unit determines a plan for stimulating the driver to perform a stimulation estimated to improve the deterioration for a section of the predicted route in which a situation that deteriorates the state of the driver is predicted by the situation prediction unit, and anticipates from before entering that section. A driver state guidance device that determines a plan for stimulating the driver to start a stimulation estimated to improve the deterioration.

9. The driver state guidance device according to any one of claims 1 to 4, The situation prediction unit predicts at least one of a situation where the driving load of the driver increases, the degree of traffic congestion, and the monotony of driving as the situation. A driver state guidance device.

10. The driver state guidance device according to any one of claims 1 to 4, A driver state guidance device including a presentation control unit (204, 204a) for presenting plan-related information which is information regarding the plan of a stimulus to the driver determined by the plan determination unit.

11. The driver state guidance device according to claim 10, wherein the presentation control unit causes the plan-related information to be presented at least by display on a display device (24), and as the plan-related information, information on the predicted route, the type of the stimulus to be given to the driver on the way of the predicted route along the plan determined by the plan determination unit, and the ideal state of the driver to be induced by the stimulus is superimposed and displayed on a map.

12. The driver state guidance device according to claim 10, wherein the presentation control unit causes the plan-related information to be presented at least by display on a display device (24), and in addition to displaying information on the state of the driver identified by the state identification unit and the type of the stimulus being given to the driver at the time when the state of the driver is identified while the vehicle is traveling on the predicted route, as the plan-related information, information on the type of the stimulus that was to be given to the driver at that time in the plan determined by the plan determination unit and the ideal state of the driver that was to be induced by the stimulus is also displayed.

13. The driver state guidance device according to claim 10, comprising a history storage unit (211) that stores a history of the points where the vehicle has traveled in the past, the stimuli at those points, and the states of the driver at those points, wherein the presentation control unit (204a) causes information to be presented at least by display on a display device (24), and in response to an input received by an input reception unit (26) that receives an input from the driver, the information of the history stored in the history storage unit is superimposed and displayed on a map.

14. The driver state guidance device according to claim 10, comprising a history storage unit (211) that stores a history of the points where the vehicle has traveled in the past, the stimuli at those points, and the states of the driver at those points. The prompt control unit (204a) is configured to present information at least by display on the display device (24). In addition to presenting information on the state of the driver identified by the state identification unit while the vehicle is traveling on the predicted route and the type of the stimulus being applied to the driver at the time when the state of the driver is identified, the driver state guidance device also presents information on the type of the stimulus and the state of the driver at the same location in the past based on the history stored in the history storage unit.

15. The driver state guidance device according to claim 10, wherein the prompt control unit presents information for notifying of the stimulus that is scheduled to be applied next to the stimulus being applied by the stimulus control unit in the middle of the application of the stimulus in the plan determined by the plan determination unit.

16. The driver state guidance device according to claim 10, comprising an evaluation unit (214) that evaluates at least any one of the stimulus being applied to the driver, the stimulus scheduled to be applied to the driver, and the past stimulus applied to the driver according to an input received by an input reception unit (26) that receives an input from the driver, wherein the plan determination unit (207a) is more likely to select and change the stimulus with a higher evaluation by the evaluation unit in the plan, while being less likely to select and change the stimulus with a lower evaluation by the evaluation unit in the plan.

17. The driver state guidance device according to claim 10, comprising a state prediction unit (213) that predicts a change in the state of the driver when the stimulus is applied and when the stimulus is not applied according to the plan determined by the plan determination unit, wherein the prompt control unit (204a) is configured to present information at least by display on the display device (24), and presents the result predicted by the state prediction unit.

18. The driver state guidance device according to claim 10, wherein when the route actually traveled by the vehicle deviates from the predicted route, the route prediction unit re-predicts the route of the vehicle, when the route prediction unit re-predicts the route of the vehicle, the situation prediction unit predicts the situation on the re-predicted predicted route, and when the route prediction unit re-predicts the route of the vehicle, the plan determination unit re-determines the plan for stimulating the driver according to the situation on the re-predicted predicted route. When the prompting control unit re - determines the plan for stimulating the driver in the plan - determining unit, as at least the plan - related information, it causes to present the content of the change in the plan due to re - determining the plan for stimulating the driver, a driver state guidance device.

19. The driver state guidance device according to claim 10, wherein the route prediction unit predicts a plurality of candidate routes as the route of the vehicle, the prompting control unit causes to present, as at least the plan - related information, the information of the plurality of candidate routes predicted by the route prediction unit, comprises a route selection unit (205) that selects one route from among the plurality of candidate routes predicted by the route prediction unit according to a selection input received from the driver, the situation prediction unit predicts the situation on the way of the predicted route, which is the route selected by the route selection unit from among the plurality of candidate routes predicted by the route prediction unit, as the predicted route, a driver state guidance device.

20. The driver state guidance device according to claim 10, wherein the plan - determining unit determines a plurality of candidate plans for one of the predicted routes as the plan for stimulating the driver, the prompting control unit causes to present, as at least the plan - related information, the information of the plurality of candidate plans determined by the plan - determining unit, comprises a plan selection unit (208) that selects one plan from among the plurality of candidate plans determined by the plan - determining unit according to a selection input received from the driver, the stimulation control unit causes the driver to be stimulated along the plan selected by the plan selection unit from among the plurality of candidate plans determined by the plan - determining unit on the way of the predicted route, a driver state guidance device.

21. A driver state guidance method that can be used in a vehicle, executed by at least one processor, a state - specifying step of specifying the state of the driver of the vehicle, a target - estimating step of estimating a target state that is the state the driver aims for, a route - predicting step of predicting the route of the vehicle, a situation - predicting step of predicting the situation on the way of the predicted route predicted in the route - predicting step In addition to the driver's state identified in the state identification process and the target state estimated in the target estimation process, according to the situation on the predicted route predicted in the situation prediction process, a plan determination process for determining a plan for stimulating the driver to guide the driver's state to its target state during the predicted route; A stimulation control process for stimulating the driver along the plan determined in the plan determination process during the predicted route; In the plan determination process, for a stimulation whose scheduled duration is less than a threshold value, the stimulation is omitted and replaced with stimulations before and after the stimulation, and a driver state guidance method for determining a plan for stimulating the driver.

22. A driver state guidance method that can be used in a vehicle, Executed by at least one processor, A state identification process for identifying the state of the driver of the vehicle; A target estimation process for estimating a target state that is the state the driver aims for; A route prediction process for predicting the route of the vehicle; A situation prediction process for predicting the situation on the predicted route predicted in the route prediction process; In addition to the driver's state identified in the state identification process and the target state estimated in the target estimation process, according to the situation on the predicted route predicted in the situation prediction process, a plan determination process for determining a plan for stimulating the driver to guide the driver's state to its target state during the predicted route; A stimulation control process for stimulating the driver along the plan determined in the plan determination process during the predicted route; In the situation prediction process, the situation also predicts a situation that changes the driver's state; In the plan determination process, in a section where the situation prediction process predicts a situation that changes the driver's state, if a state of the driver different from that state is actually identified in the state identification process, for that section, the plan for stimulating the driver is redetermined so as to use a stimulation corresponding to the state of the driver actually identified in the state identification process. Driver state guidance method.

23. A driver state guidance method that can be used in a vehicle, Executed by at least one processor, A state identification process for identifying the state of the driver of the vehicle; A target estimation process for estimating a target state that is the state the driver aims for; A route prediction process for predicting the route of the vehicle; A situation prediction step for predicting the situation on the predicted route predicted in the route prediction step; A plan determination step for determining a plan for stimulating the driver to guide the driver's state to the target state according to the state of the driver specified in the state specification step, the target state estimated in the target estimation step, and the situation on the predicted route predicted in the situation prediction step, which is used in the middle of the predicted route; A stimulation control step for stimulating the driver along the plan determined in the plan determination step in the middle of the predicted route, including: In the state specification step, the state of the driver is specified to include a specific state that is at least one of drowsiness, a distracted state, and a stressed state; In the stimulation control step, in the middle of the predicted route, based on the specification of the specific state in the state specification step, regardless of the plan determined in the plan determination step, a stimulation that is estimated to improve the specific state specified in the state specification step is performed as a stimulation to the driver. Driver state induction method.

Images