Awakening assistance device and awakening assistance method

Abstract

To provide an awakening support device capable of effectively urging awakening of a driver while securing safety.SOLUTION: An awakening support device 10 for urging awakening of a driver includes: a vehicle state determination section 12 for determining whether a vehicle of the driver is in a travel state or in a stop state; and a stimulation control section 13 for controlling a stimulation generation device 20 to generate a stimulation to be used for an awakening support of the driver based on a determination result of the vehicle state determination section 12. When the vehicle state determination section 12 determines that the vehicle is in a stop state, the stimulation control section 13 causes the stimulation generation device 20 to generate a stimulation stronger than that in a case where it is determined that the vehicle is in a travel state.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an awakening assistance device and an awakening assistance method for encouraging a driver to be awakened. [Background technology]

[0002] A driver of a vehicle is required to be sufficiently awake while driving the vehicle. In response to this, a device for waking up the driver from drowsiness, in other words, an awakening support device for encouraging the driver to be awake, has been proposed (for example, Patent Document 1).

[0003] According to the awakening assistance device disclosed in Patent Document 1, when it is determined that the driver of a vehicle is feeling drowsy, a stimulus generating device capable of generating multiple types of stimuli can generate a stimulus selected based on the environment around the driver, thereby effectively waking up the driver. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-151752 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, stimuli that have a high arousal effect on drowsiness tend to be distracting to the driver, which can increase the risk of danger depending on the driving situation. On the other hand, stimuli that are less distracting have a low arousal effect.

[0006] The present disclosure has been made in consideration of the above-mentioned circumstances, and provides an awakening assistance device etc. that can effectively encourage the driver to wake up while ensuring safety. [Means for solving the problem]

[0007] An awakening assistance device according to one embodiment of the present disclosure is an awakening assistance device that promotes the awakening of a driver, and includes a vehicle state determination unit that determines whether the driver's vehicle is in a moving state or a stopped state, and a stimulus control unit that controls a stimulus generating device that generates a stimulus used to assist the driver's awakening based on the determination result of the vehicle state determination unit, and when the vehicle state determination unit determines that the vehicle is in a stopped state, the stimulus control unit causes the stimulus generating device to generate a stimulus of higher intensity than when the vehicle is determined to be in a moving state.

[0008] These comprehensive or specific aspects may be realized as a system, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM, or may be realized as any combination of the system, the method, the integrated circuit, the computer program, and the recording medium. Effect of the Invention

[0009] According to the awakening assistance device and the like of the present disclosure, it is possible to effectively encourage the driver to wake up while ensuring safety. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a system according to the first embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of types of stimuli and parameters for generating the stimuli according to the first embodiment. [Diagram 3] FIG. 3 is a diagram showing an example of the relationship between a change in type of stimulation and a change in intensity of stimulation according to the first embodiment. [Figure 4] FIG. 4 is a flowchart showing an example of the operation of the awakening assistance device according to the first embodiment. [Diagram 5] FIG. 5 is an explanatory diagram conceptually showing the operation of the awakening assistance device according to the first embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a configuration of an awakening assistance device according to the second embodiment. [Figure 7]FIG. 7 is an example of a detailed configuration of the acquisition unit shown in FIG. [Figure 8] FIG. 8 shows an example of a detailed configuration of the estimation unit shown in FIG. [Figure 9] FIG. 9 is a diagram showing an example of the intensity of a stimulus generated by the stimulus generation device in accordance with a drowsiness level according to the second embodiment. [Figure 10] FIG. 10 is a flowchart showing an example of the operation of the awakening assistance device according to the second embodiment. [Figure 11] FIG. 11 is an explanatory diagram conceptually showing the operation of the awakening assistance device according to the second embodiment. [Figure 12] FIG. 12 is an explanatory diagram conceptually showing another example of the operation of the awakening assistance device according to the second embodiment. [Figure 13] FIG. 13 is a diagram illustrating an example of a configuration of an estimation unit according to the first modification of the second embodiment. As illustrated in FIG. [Figure 14] FIG. 14 shows an example of a time period that is set to a certain time period before the start timing according to the first modification of the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Each of the embodiments described below shows a specific example of the present disclosure. The numerical values, shapes, components, steps, and order of steps shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components that are not described in an independent claim are described as optional components. Furthermore, in all of the embodiments, the respective contents can be combined.

[0012] (Embodiment 1) Hereinafter, an awakening assistance device and the like according to an embodiment will be described with reference to the drawings.

[0013] [1 System Configuration] FIG. 1 is a diagram illustrating an example of a configuration of a system according to the first embodiment.

[0014] The system shown in FIG. 1 is composed of an awakening assistance device 10 and a stimulus generating device 20, and is typically mounted on a vehicle.

[0015] [1.1 Vehicle] The vehicle according to the first embodiment is an automobile, a motorcycle, a bicycle, or the like, driven by a driver who is a support target of the awakening support device 10.

[0016] The vehicle according to the first embodiment includes a camera and a communication device for acquiring vehicle exterior information. The camera and the communication device are connected to an in-vehicle network such as a controller area network (CAN). The vehicle according to the first embodiment may further include a sensor capable of acquiring internal information such as biometric information of the driver of the vehicle.

[0017] The outside-vehicle information is, for example, information about the surrounding environment of the vehicle (surrounding environment information), but is not limited to this. The outside-vehicle information may include information obtained from a traffic light in the direction in which the vehicle is traveling, information obtained from a railroad crossing in the direction in which the vehicle is traveling, and information about other vehicles in the direction in which the vehicle is traveling.

[0018] [1.2 Stimulus Generator 20] The stimulus generating device 20 generates a stimulus used to assist the driver in awakening. The stimulus generated by the stimulus generating device 20 is at least one of wind, sound, vibration, scent, and light, and is used to stimulate the driver's five senses to encourage the driver to awaken. The stimulus may be to make the driver perform a specific action or a specific operation.

[0019] In this embodiment, the stimulus generating device 20 is controlled by the stimulus control unit 13 of the awakening assistance device 10 to generate at least one of the stimuli of wind, sound, vibration, fragrance, and light, to stop the generated stimulus, and to change the intensity of the generated stimulus. Here, an example of the vibration stimulus is seat vibration that vibrates a protrusion formed inside a vehicle seat. The vibration stimulus is not limited to this, and may be vibration of a steering wheel.

[0020] In addition, the stimulus generation device 20 may be controlled by the stimulus control unit 13 of the awakening assistance device 10 to change the type of stimulus to be generated, thereby changing the intensity of the generated stimulus.

[0021] The stimulus generation device 20 may be configured in the awakening assistance device 10.

[0022] [1.3 Awakening Support Device 10] The awakening assistance device 10 is a device for encouraging the driver to be awakened.

[0023] 1, the awakening assistance device 10 includes an acquisition unit 11, a vehicle state determination unit 12, and a stimulus control unit 13. The awakening assistance device 10 may further include a stimulus generation device 20.

[0024] The acquisition unit 11 acquires outside information from a camera and a communication device of the vehicle in which the awakening assistance device 10 is mounted, and acquires inside information from an in-vehicle network of the vehicle. The inside information is, for example, information such as the speed of the vehicle, and may also be referred to as CAN information.

[0025] The vehicle state determination unit 12 determines whether the driver's vehicle is in a moving state or a stopped state.

[0026] In this embodiment, the vehicle state determination unit 12 determines whether the vehicle driven by the driver is in a running state indicating that the vehicle is running or in a stopped state indicating that the vehicle is stopped, based on the CAN information acquired by the acquisition unit 11. For example, the vehicle state determination unit 12 can determine that the vehicle is stopped (stopped state) when the vehicle speed indicated in the CAN information is zero, and determine that the vehicle is running (running state) when the vehicle speed indicated in the CAN information is not zero. The vehicle state determination unit 12 may determine that the vehicle is stopped (stopped state) when the vehicle speed indicated in the CAN information is equal to or less than a threshold, and may determine that the vehicle is running (running state) when the vehicle speed indicated in the CAN information exceeds the threshold.

[0027] The stimulus control unit 13 includes a computer including, for example, a memory and a processor (microprocessor), and the processor executes a control program stored in the memory to control the stimulus generation device 20 and realize various functions.

[0028] In this embodiment, the stimulus control unit 13 controls the stimulus generation device 20 based on the determination result of the vehicle state determination unit 12. When the vehicle state determination unit 12 determines that the vehicle is in a stopped state, the stimulus control unit 13 causes the stimulus generation device 20 to generate a stimulus with a higher intensity than when the vehicle is determined to be in a traveling state.

[0029] The stimulus control unit 13 can cause the stimulus generating device 20 to change the intensity of the stimulus by instructing the stimulus generating device 20 to change parameters to generate stimuli such as wind, sound, vibration, scent, and light.

[0030] Here, the stimulus when it is determined that the vehicle is in a moving state is a stimulus of an intensity that is unlikely to cause distraction to the driver, and is hereinafter also referred to as a weak stimulus, whereas the stimulus when it is determined that the vehicle is in a stopped state is a stimulus of an intensity that is likely to cause distraction to the driver, and is hereinafter also referred to as a strong stimulus.

[0031] Fig. 2 is a diagram showing an example of types of stimuli and parameters for generating the stimuli according to embodiment 1. Fig. 2 shows an example of parameters and their values ​​for generating a strong or weak stimulus when any one of wind, sound, vibration, scent, and light is used as the stimulus.

[0032] In the example shown in Fig. 2, for example, when only sound is used as a stimulus, the parameters for generating a sound stimulus are shown to be sound pressure, tempo, and the presence or absence of lyrics. In this case, the stimulus control unit 13 can cause the stimulus generation device 20 to generate a weak stimulus by instructing the stimulus generation device 20 to set a sound pressure value of less than 60 dB, a tempo value of less than 120 bpm, or parameters indicating the absence of lyrics. On the other hand, the stimulus control unit 13 can cause the stimulus generation device 20 to generate a strong stimulus by instructing the stimulus generation device 20 to set a sound pressure value of more than 80 dB, a tempo value of more than 180 bpm, or parameters indicating the presence of lyrics.

[0033] 2, for example, when only vibration such as seat vibration is used as a stimulus, the parameters for generating the vibration stimulus are the amount of pressing, the frequency, and the position of the vibration. In this case, the stimulus control unit 13 can cause the stimulus generating device 20 to generate a weak stimulus by instructing the stimulus generating device 20 to set a value of pressing less than 3 cm, a value of frequency less than 70 Hz, or parameters indicating that the position is the back of the left knee. On the other hand, the stimulus control unit 13 can cause the stimulus generating device 20 to generate a strong stimulus by instructing the stimulus generating device 20 to set a value of pressing more than 6 cm, a value of frequency more than 100 Hz, or parameters indicating that the position is the entire seat.

[0034] 2, for example, when only light is used as a stimulus, the parameters for generating a light stimulus are illuminance and color temperature. In this case, the stimulus control unit 13 can instruct the stimulus generation device 20 to generate a weak stimulus, i.e., not to generate light, by instructing the stimulus generation device 20 to use parameters indicating an illuminance value of 0 (none) or a color temperature value of 0 (none). On the other hand, the stimulus control unit 13 can instruct the stimulus generation device 20 to use parameters indicating an illuminance value of 1000Lx or a color temperature value of 12000K, by instructing the stimulus generation device 20 to use parameters indicating an illuminance value of 1000Lx or a color temperature value of 12000K.

[0035] 2, when only a scent such as peppermint is used as a stimulus, the parameters for generating the scent stimulus are the concentration of the liquid containing the scent to be sprayed and the spray frequency of the liquid. In this case, the stimulus control unit 13 can cause the stimulus generation device 20 to generate a weak stimulus, i.e., not to generate a scent, by instructing the stimulus generation device 20 to use parameters indicating a concentration value of less than 10% or a spray frequency value of 1 time / m (min). On the other hand, the stimulus control unit 13 can cause the stimulus generation device 20 to generate a strong stimulus by instructing the stimulus generation device 20 to use parameters indicating a concentration value of more than 20% or a spray frequency value of more than 4 times / m (min).

[0036] 2, for example, when only wind is used as a stimulus, the parameters for generating a wind stimulus are wind speed, wind temperature, and the position to which the wind is applied. In this case, the stimulus control unit 13 can cause the stimulus generation device 20 to generate a weak stimulus by instructing the stimulus generation device 20 to set a wind speed value of less than 2 m / s, a temperature value of 25° C., or parameters indicating that the position to which the wind is applied is the neck. On the other hand, the stimulus control unit 13 can cause the stimulus generation device 20 to generate a strong stimulus by instructing the stimulus generation device 20 to set a wind speed value of more than 4 m / s, a temperature value of 20° C., or parameters indicating that the position to which the wind is applied is the neck and face.

[0037] Therefore, as shown in FIG. 2, the stimulus control unit 13 can cause the stimulus generation device 20 to change the intensity of the stimulus by instructing the stimulus generation device 20 to change the value of a parameter for generating a stimulus.

[0038] In the above description, the stimulus control unit 13 changes the value of a parameter for generating one type of stimulus, such as sound, to change the intensity of the stimulus generated by the stimulus generation device 20, but the present invention is not limited to this. The stimulus control unit 13 may change the type of stimulus generated by the stimulus generation device 20 to change the intensity of the stimulus.

[0039] FIG. 3 is a diagram showing an example of the relationship between a change in type of stimulation and a change in intensity of stimulation according to the first embodiment.

[0040] As shown in the first row of Fig. 3, for example, a sound not including conversation may be generated as a weak stimulus, and a sound including conversation may be generated as a strong stimulus. More specifically, the stimulus control unit 13 may cause the stimulus generating device 20 to generate a weak stimulus by instructing the stimulus generating device 20 with a parameter indicating that the stimulus is only a sound not including conversation, such as an instrumental piece. This is because a sound not including conversation, such as an instrumental piece, is unlikely to attract the driver's attention. On the other hand, the stimulus control unit 13 can cause the stimulus generating device 20 to generate a strong stimulus by instructing the stimulus generating device 20 with a parameter indicating that the stimulus is a sound including conversation.

[0041] Also, as shown in the second row of FIG. 3, for example, only sound may be generated as a weak stimulus, and in addition to the sound being generated as a strong stimulus, the driver may be made to perform a predetermined action. More specifically, the stimulus control unit 13 may cause the stimulus generation device 20 to generate a weak stimulus by instructing the stimulus generation device 20 to provide a parameter indicating that the stimulus is sound only. In this case, the stimulus control unit 13 may instruct the stimulus generation device 20 to provide a parameter indicating that the stimulus is sound and also causes the driver to perform a predetermined action, and may cause the stimulus generation device 20 to generate a sound and generate a sound that makes the driver recognize that the predetermined action will be performed, thereby causing the driver to perform the predetermined action. The predetermined action may be, for example, a gesture action, but may also be an action of performing a specific operation, or an action of uttering a specific content, as long as it is an active action of the driver. In this way, the stimulus control unit 13 can cause the stimulus generation device 20 to generate a strong stimulus.

[0042] 3, for example, only sound may be generated as a weak stimulus, and sound and vibration may be generated simultaneously as a strong stimulus. More specifically, the stimulus control unit 13 may cause the stimulus generation device 20 to generate a weak stimulus by instructing the stimulus generation device 20 to use parameters indicating that the stimulus is only sound. In this case, the stimulus control unit 13 can cause the stimulus generation device 20 to generate a strong stimulus by instructing the stimulus generation device 20 to use parameters indicating that the stimulus is to be generated simultaneously as sound and vibration.

[0043] Similarly, as shown in the fourth and fifth lines of FIG. 3, for example, only sound may be generated as a weak stimulus, and sound and light may be generated simultaneously as a strong stimulus, or only scent may be generated as a weak stimulus, and scent and sound may be generated simultaneously as a strong stimulus. Also, as shown in the fifth and sixth lines of FIG. 3, for example, only wind may be generated as a weak stimulus, and wind and sound may be generated simultaneously as a strong stimulus, or only vibration may be generated as a weak stimulus, and vibration and light may be generated simultaneously as a strong stimulus. Also, as shown in the seventh and eighth lines of FIG. 3, for example, only scent may be generated as a weak stimulus, and scent and vibration may be generated simultaneously as a strong stimulus, or only wind may be generated as a weak stimulus, and wind and vibration may be generated simultaneously as a strong stimulus. Note that the combination of weak and strong stimuli is not limited to the example shown in FIG. 3, and other combinations may be used. For example, one type of stimulus from various stimuli may be generated as a weak stimulus, and two or more types of stimuli that stimulate at least two or more of the five senses may be generated as a strong stimulus. The weak stimuli may include a combination of multiple stimuli when no distraction occurs. Furthermore, the combination of weak and strong stimuli may include changing the type of stimulus, such as generating only a sound as a weak stimulus and generating a strong vibration as a strong stimulus.

[0044] [1.4 Operation of the awakening assistance device 10, etc.] Next, the operation of the above-mentioned awakening assistance device 10 will be described.

[0045] FIG. 4 is a flowchart showing an example of the operation of the awakening assistance device 10 according to the first embodiment.

[0046] First, the awakening assistance device 10 judges whether the driver's vehicle is in a running state or in a stopped state (S1). More specifically, the vehicle state judgment unit 12 of the awakening assistance device 10 judges whether the vehicle driven by the driver is in a running state or in a stopped state based on the CAN information such as the vehicle speed acquired by the acquisition unit 11 from the vehicle's in-vehicle network.

[0047] In step S1, when it is determined that the vehicle is in a stopped state (stopped state in S1), the awakening assistance device 10 causes the stimulus generation device 20 to generate a stimulus (the above-mentioned strong stimulus) having a higher intensity than when the vehicle is in a moving state (S2). More specifically, when it is determined that the vehicle is in a stopped state by the vehicle state determination unit 12, the stimulus control unit 13 of the awakening assistance device 10 causes the stimulus generation device 20 to generate a stimulus having a higher intensity than when the vehicle is determined to be in a moving state.

[0048] On the other hand, when it is determined in step S1 that the vehicle is in a moving state (moving state in S1), the awakening assistance device 10 returns to step S1 and repeats the process.

[0049] FIG. 5 is an explanatory diagram conceptually showing the operation of the awakening support device 10 according to the first embodiment. FIG. 5(a) shows the vehicle state of the vehicle driven by the driver, with the vertical axis representing speed and the horizontal axis representing time. In the example shown in FIG. 5(a), the vehicle is stopped (stopped state) while the speed of the vehicle is zero, and is running (running state) while the speed of the vehicle is not zero. FIG. 5(b) shows an example of the intensity of the stimulus given to the driver. As in the above, a stimulus with an intensity that is unlikely to cause a distraction is shown as weak, and a stimulus with an intensity that is likely to cause a distraction is shown as strong.

[0050] As shown in FIG. 5, in this embodiment, when the vehicle driven by the driver is moving, a weak stimulus that is unlikely to cause distraction is given to the driver, and when the vehicle driven by the driver is stopped, a stimulus that has a high arousal effect and is likely to cause distraction is given to the driver.

[0051] [1.5 Effects, etc.] As described above, the awakening assistance device 10 of the present embodiment provides the driver with a weak stimulus that is unlikely to cause a distraction when the vehicle driven by the driver is in a moving state, whereas when the vehicle driven by the driver is in a stopped state, the device provides the driver with a strong stimulus that is likely to cause a distraction but has a high awakening effect.

[0052] As a result, when the vehicle driven by the driver is moving, the driver is not given a strong stimulus that is likely to cause distraction, so the safety of the driver can be ensured. On the other hand, when the vehicle driven by the driver is stopped, the driver is given a stimulus that is likely to cause distraction and has a high awakening effect, so that the driver's awakening can be effectively promoted.

[0053] (Embodiment 2) In the first embodiment, a strong stimulus is given to the driver while the vehicle is stopped (parked), but this is not limited to the above. Even if the vehicle is stopped, the stimulus given to the driver may be changed to a weaker one a certain time before the start timing when the vehicle starts to move. This case will be described below as a second embodiment. The following description will focus on the differences from the first embodiment.

[0054] [2.1 Awakening Support Device 10A] Fig. 6 is a diagram showing an example of the configuration of an awakening support device 10A according to embodiment 2. Fig. 6 further shows a stimulus generation device 20. Elements similar to those in Fig. 1 are given the same reference numerals, and detailed description thereof will be omitted.

[0055] 6, the awakening support device 10A according to the second embodiment includes an acquisition unit 11, a vehicle state determination unit 12, a stimulus control unit 13, and an estimation unit 14. Note that the awakening support device 10 may further include a stimulus generation device 20, similar to the first embodiment.

[0056] An awakening support device 10A shown in FIG. 6 is configured such that an estimation unit 14 is added to the awakening support device 10 according to the first embodiment.

[0057] [2.1.1 Acquisition part 11] FIG. 7 shows an example of a detailed configuration of the acquisition unit 11 shown in FIG.

[0058] FIG. 7 further illustrates some components of a vehicle in which the awakening assistance device 10A is mounted, that is, a communication device 101, a camera 102, and a sensor 103.

[0059] The communication device 101 of the vehicle receives CAN information such as information indicating the speed of the vehicle via an in-vehicle network, and performs vehicle-to-vehicle communication with other vehicles in the traveling direction of the vehicle to acquire information about the other vehicles. The communication device 101 of the vehicle may also perform road-to-vehicle communication or V2X (Vehicle-to-everything) communication with roadside devices installed at traffic lights and railroad crossings in the traveling direction of the vehicle to receive outside vehicle information. As described above, the outside vehicle information includes information about the surrounding environment of the vehicle (surrounding environment information), information obtained from traffic lights in the direction in which the vehicle travels, information obtained from railroad crossings in the direction in which the vehicle travels, and information about other vehicles in the direction in which the vehicle travels. The camera 102 of the vehicle is a camera that captures the outside of the vehicle and acquires part of the outside vehicle information such as the surrounding environment information. The sensor 103 of the vehicle is a sensor that detects the state of the driver. The sensor 103 of the vehicle outputs detection information that detects the state of the driver, such as the frequency of the driver's blinking, the degree to which the driver's eyes are open, and eye movement. The vehicle sensor 103 may further output detection information that detects the driver's pulse or line of sight.

[0060] In the present embodiment, the acquisition unit 11 acquires outside-vehicle information from the vehicle in which the awakening assistance device 10A is mounted, acquires CAN information from the vehicle's in-vehicle network, and acquires biological information. More specifically, the acquisition unit 11 includes a CAN information acquisition unit 111, an outside-vehicle information acquisition unit 112, and a biological information acquisition unit 113, for example, as shown in FIG.

[0061] The CAN information acquisition unit 111 acquires CAN information, such as information indicating the vehicle speed, from the communication device 101 of the vehicle.

[0062] The outside-of-vehicle information acquisition unit 112 acquires outside-of-vehicle information from the communication device 101 and the camera 102 of the vehicle.

[0063] The biometric information acquisition unit 113 acquires detection information that detects the driver's condition from the sensor 103 of the vehicle, thereby acquiring biometric information that indicates the driver's condition.

[0064] [2.1.2 Vehicle state determination unit 12] The vehicle state determination unit 12 determines whether the driver's vehicle is in a moving state or a stopped state.

[0065] In this embodiment, vehicle state determination unit 12 determines whether the vehicle driven by the driver is in a running state or a stopped state based on the CAN information acquired by CAN information acquisition unit 111. For example, vehicle state determination unit 12 determines that the vehicle is in a stopped state when the vehicle speed indicated in the CAN information is zero, and determines that the vehicle is in a running state when the vehicle speed indicated in the CAN information is not zero.

[0066] [2.1.3 Estimation part 14] FIG. 8 shows an example of a detailed configuration of the estimation unit 14 shown in FIG.

[0067] The estimation unit 14 includes a drowsiness estimation unit 141 and a departure timing estimation unit 142, for example, as shown in FIG.

[0068] The drowsiness estimation unit 141 estimates a drowsiness level indicating the degree of drowsiness of the driver based on detection information from a sensor that detects the state of the driver.

[0069] In this embodiment, the drowsiness estimation unit 141 estimates the drowsiness level from the biometric information acquired by the biometric information acquisition unit 113. For example, the drowsiness estimation unit 141 estimates the drowsiness level indicating the degree of drowsiness according to the blink frequency of the driver indicated in the biometric information, since the driver is more drowsy as the driver blinks less frequently. The same applies whether the biometric information is the degree of opening of the driver's eyes or the driver's eye movement.

[0070] The start timing estimation unit 142 estimates the start timing of the vehicle, which is the timing at which the vehicle can start moving to travel, when the vehicle state determination unit 12 determines that the vehicle is in a stopped state. More specifically, the start timing estimation unit 142 estimates the start timing based on at least one of information obtained from a traffic light in the direction in which the vehicle is traveling, information obtained from a railroad crossing in the direction in which the vehicle is traveling (a roadside unit near the railroad crossing), and information on another vehicle in the direction in which the vehicle is traveling.

[0071] In this embodiment, the start timing estimation unit 142 estimates the start timing of the vehicle from the vehicle exterior information acquired by the vehicle exterior information acquisition unit 112. The start timing estimation unit 142 can estimate the start timing at which the vehicle can start moving to run from the vehicle exterior information indicating the timing at which the crossing gate will be lifted, for example, in how many seconds after the gate will be lifted. The start timing estimation unit 142 can also estimate the start timing at which the vehicle can start moving to run from the vehicle exterior information indicating the movement of a traffic jam, for example, another vehicle in the direction in which the vehicle is moving, several vehicles ahead, starting to move to run. The start timing estimation unit 142 can also estimate the start timing at which the vehicle can start moving to run from the vehicle exterior information indicating the timing at which a traffic light will switch, for example, in how many seconds after the traffic light in the direction in which the vehicle is moving will turn green (a color indicating proceeding).

[0072] [2.1.4 Stimulus control unit 13] The stimulus control unit 13 includes a computer including, for example, a memory and a processor (microprocessor), and the processor executes a control program stored in the memory to control the stimulus generation device 20 and realize various functions.

[0073] In this embodiment, the stimulus control unit 13 changes the intensity of the stimulus generated by the stimulus generation device 20 according to the drowsiness level estimated by the drowsiness estimation unit 141. Specifically, when the drowsiness level is estimated to be higher than the first threshold and it is determined that the vehicle is in a running state, the stimulus control unit 13 causes the stimulus generation device 20 to generate a stimulus of a first intensity. Also, when the drowsiness level is estimated to be higher than the first threshold and it is determined that the vehicle is in a stopped state, the stimulus control unit 13 generates a stimulus of a higher intensity than the stimulus of the first intensity when it is determined that the vehicle is in a running state. Note that the stimulus of the first intensity is, for example, a weak stimulus, and a stimulus of an intensity higher than the stimulus of the first intensity is a strong stimulus. For example, when it is determined that the vehicle is in a running state and the drowsiness level estimated by the drowsiness estimation unit 141 is estimated to be higher than the first threshold, the stimulus control unit 13 controls the stimulus generation device 20 to generate a weak stimulus. On the other hand, for example, when it is determined that the vehicle is in a stopped state and the drowsiness level estimated by the drowsiness estimation unit 141 is estimated to be higher than the first threshold, the stimulus control unit 13 controls the stimulus generation device 20 to generate a high-intensity stimulus (strong stimulus). Note that the first threshold is appropriately determined, and is 4 in the example shown in Fig. 9 described below.

[0074] 9 is a diagram showing an example of the intensity of a stimulus generated by the stimulus generation device 20 in accordance with a drowsiness level according to embodiment 2. Here, a higher drowsiness level indicates that the driver is in a drowsy state.

[0075] In FIG. 9, even if the vehicle is stopped, when the drowsiness level is 1, the drowsiness level is low and the driver is not drowsy, so it is shown that a weak stimulus should be given. Also, even if the vehicle is stopped, when the drowsiness level is 2 or 3, the drowsiness level is medium and the driver is slightly drowsy, so it is shown that a weak stimulus should be given. On the other hand, when the vehicle is stopped and the drowsiness level is 4 or 5, the drowsiness level is high and the driver is very sleepy, so it is shown that a strong stimulus should be given. In this way, the stimulus control unit 13 may adjust the intensity of the stimulus to the stimulus generation device 20 according to the drowsiness level estimated by the drowsiness estimation unit 141, even if the vehicle is stopped.

[0076] In addition, in FIG. 9, an example is shown in which the intensity of the stimulus is determined in three stages, namely, none (no stimulus), weak, and strong, but the present invention is not limited to this. The intensity of the stimulus may be weak or strong, or may have further degrees. In the example shown in FIG. 9, even if the intensity of the stimulus is "weak", a stronger intensity of the stimulus may be given to a sleepiness level of 3 than to a sleepiness level of 2. Similarly, even if the intensity of the stimulus is "strong", a stronger intensity of the stimulus may be given to a sleepiness level of 5 than to a sleepiness level of 4.

[0077] Also, as shown in Fig. 9, when the vehicle is in a running state and the drowsiness level is 1 to 3, the drowsiness level is low or medium and the driver is not drowsy or is slightly drowsy, so no stimulation is required. On the other hand, when the vehicle is in a running state and the drowsiness level is 4 or 5, the drowsiness level is high and the driver is very drowsy, so a weak stimulation is required. Note that when the vehicle is in a running state and the drowsiness level is 4 or 5, a strong stimulation is not provided in order to ensure the safety of the driver by not causing a distraction to the driver.

[0078] Furthermore, similarly to the first embodiment, when the vehicle state determination unit 12 determines that the vehicle is in a stopped state, the stimulus control unit 13 causes the stimulus generation device 20 to generate a stimulus with a higher intensity than when the vehicle is determined to be in a moving state. Note that the type of stimulus and the method for realizing the intensity of the stimulus are similar to those in the first embodiment, and therefore description thereof will be omitted. In this embodiment, the stimulus control unit 13 further causes the stimulus generation device 20 to change the intensity of the stimulus according to the start timing estimated by the start timing estimation unit 142.

[0079] Specifically, the stimulus control unit 13 causes the stimulus generation device 20 to change the intensity of the generated stimulus to the intensity when it is determined that the vehicle is in a traveling state, a certain time before the start timing estimated by the start timing estimation unit 142. In other words, when the vehicle is in a stopped state, the stimulus control unit 13 causes the stimulus generation device 20 to generate a strong stimulus, but changes the intensity of the stimulus a certain time before the start timing (e.g., 15 seconds before) to cause the stimulus generation device 20 to generate a weak stimulus.

[0080] Furthermore, the stimulus control unit 13 may change the intensity of the stimulus to the intensity when it is determined that the vehicle is in a running state at the estimated start timing by gradually lowering the stimulus intensity in the stimulus generation device 20 from a certain time before the estimated start timing to the start timing. In other words, the stimulus control unit 13 may cause the stimulus generation device 20 to generate a strong stimulus when the vehicle is stopped, but may cause the stimulus generation device 20 to generate a weak stimulus at the start timing by gradually lowering the stimulus intensity from a certain time point before the start timing.

[0081] As described above, in this embodiment, the stimulus control unit 13 controls the stimulus generation device 20 based on the determination result of the vehicle state determination unit 12 and the start timing estimated by the start timing estimation unit 142.

[0082] The stimulus control unit 13 may cause the stimulus generation device 20 to change the intensity of the stimulus depending on the length of time from when the vehicle state determination unit 12 determines that the vehicle is in a stopped state to the start timing estimated by the start timing estimation unit 142. For example, when the length of time from when the vehicle state determination unit 12 determines that the vehicle is in a stopped state to the start timing estimated by the start timing estimation unit 142 is longer than a second threshold, the stimulus control unit 13 may cause the stimulus generation device 20 to generate a stimulus with a higher intensity (strong stimulus) than when the time length is equal to or less than the second threshold. In other words, the stimulus control unit 13 may cause the stimulus generation device 20 to generate a strong stimulus when the time the vehicle is in a stopped state is relatively long based on the determination result of the vehicle state determination unit 12 and the start timing estimated by the start timing estimation unit 142. In other words, the stimulus control unit 13 may cause the stimulus generation device 20 not to generate a strong stimulus or to generate a weak stimulus when the time during which the vehicle is stopped is short based on the determination result of the vehicle state determination unit 12 and the start timing estimated by the start timing estimation unit 142. This makes it possible to better ensure the safety of the driver since a strong stimulus that is likely to cause distraction is not given to the driver when the time during which the vehicle is stopped is short, that is, when the traffic light is red and the vehicle is stopped but the light immediately turns green and the vehicle starts moving forward.

[0083] [2.2 Operation of awakening assistance device 10A, etc.] Next, the operation of the above-mentioned awakening assistance device 10A will be described.

[0084] FIG. 10 is a flowchart showing an example of the operation of the awakening assistance device 10A according to the second embodiment.

[0085] First, the awakening support device 10A estimates a drowsiness level (S10). More specifically, the drowsiness estimation unit 141 of the awakening support device 10A estimates a drowsiness level indicating the degree of drowsiness of the driver based on detection information from a sensor that detects the state of the driver.

[0086] Next, the awakening support device 10A judges whether the driver's vehicle is in a running state or a stopped state based on the CAN information (S11). More specifically, the vehicle state judgment unit 12 of the awakening support device 10A judges whether the vehicle driven by the driver is in a running state or a stopped state based on the CAN information, such as information indicating the vehicle speed, acquired from the vehicle's in-vehicle network.

[0087] Next, the awakening assistance device 10A confirms whether it is determined in step S11 that the vehicle is in a moving state or in a stopped state (S12).

[0088] In step S12, if it is determined that the vehicle is stopped in step S11 (Stopped in S12), the awakening support device 10A estimates the start timing based on the vehicle exterior information (S13). More specifically, the start timing estimation unit 142 of the awakening support device 10A estimates the start timing based on at least one of the vehicle exterior information, for example, information obtained from a traffic light in the direction in which the vehicle is traveling, information obtained from a railroad crossing in the direction in which the vehicle is traveling, and information on another vehicle in the direction in which the vehicle is traveling.

[0089] On the other hand, in step S12, if it is determined that the vehicle is in a moving state in step S11 (moving state in S12), the awakening assistance device 10A checks whether the drowsiness level estimated in step S10 is 1 (S14).

[0090] In step S14, if the drowsiness level estimated in step S10 is not 1 (No in S14), the awakening assistance device 10A checks whether the drowsiness level estimated in step S10 is 2 or 3 (S15). If the drowsiness level estimated in step S14 is 1 (Yes in S14), the awakening assistance device 10A proceeds to step S17.

[0091] In step S15, if the drowsiness level estimated in step S10 is 2 or 3 (Yes in S15), the awakening assistance device 10A further determines that the vehicle is stopped and determines whether there is a certain amount of time or more until the estimated departure timing (S16).

[0092] In step S16, if the vehicle is not stopped or if the time until the start timing is less than a certain time (No in S16), the awakening support device 10A does not cause the stimulus generation device 20 to generate a stimulus (S17). In addition, in step S16, if the vehicle is determined to be stopped and if the time until the start timing is more than a certain time (Yes in S16), the awakening support device 10A proceeds to step S20.

[0093] On the other hand, in step S15, if the drowsiness level estimated in step S10 is not 2 or 3 (No in S15), the awakening assistance device 10A determines that the drowsiness level estimated in step S10 is 4 or 5 (S18).

[0094] Next, the awakening assistance device 10A determines whether or not it is determined in step S11 that the vehicle is in a stopped state and whether or not there is a certain period of time or more until the start timing estimated in step S13 (S19).

[0095] In step S19, if the vehicle is not in a stopped state or the certain time is less than the start timing (No in S19), the awakening assistance device 10A causes the stimulus generation device 20 to generate a weak stimulus (S20).

[0096] In addition, in step S19, if it is determined that the vehicle is stopped and that there is a certain amount of time or more until the start timing (Yes in S19), the awakening assistance device 10A causes the stimulus generation device 20 to generate a strong stimulus (S21).

[0097] FIG. 11 is an explanatory diagram conceptually showing the operation of the awakening support device 10A according to the second embodiment. In FIG. 11(a), similarly to FIG. 5(a), the vehicle state of the vehicle driven by the driver is shown, with the vertical axis representing the speed and the horizontal axis representing the time. In the example shown in FIG. 11(a), the vehicle is stopped (stopped state) while the speed of the vehicle is zero, and is running (running state) while the speed of the vehicle is not zero. In FIG. 11(a), the start timing estimated from the vehicle outside information is also shown. In addition, FIG. 11(b) shows an example of the intensity of the stimulus given to the driver. As in FIG. 5(b), the stimulus with the intensity at which distraction is unlikely to occur is shown as weak, and the stimulus with the intensity at which distraction is likely to occur is shown as strong.

[0098] As shown in Fig. 11, in this embodiment, when the vehicle driven by the driver is moving, a weak stimulus that is unlikely to cause a distraction is given to the driver. On the other hand, when the vehicle driven by the driver is stopped, a stimulus that is likely to cause a distraction and has a high arousal effect is given to the driver until a certain time before the estimated start timing. Then, a weak stimulus that is unlikely to cause a distraction is given to the driver before the certain time, i.e., immediately before the start of the vehicle.

[0099] Fig. 12 is an explanatory diagram conceptually showing another example of the operation of the awakening support device 10A according to embodiment 2. Elements similar to those in (a) and (b) of Fig. 11 are given similar names and will not be described.

[0100] That is, in the above-mentioned Fig. 11, a stimulus with a high arousal effect that is likely to cause a distraction is given to the driver immediately after the vehicle driven by the driver is stopped. On the other hand, in the example shown in Fig. 12, a stimulus with a high arousal effect that is likely to cause a distraction is given to the driver from a certain time after the vehicle driven by the driver is stopped.

[0101] In this way, when the vehicle state determination unit 12 determines that the vehicle is in a stopped state, the stimulus control unit 13 of embodiment 2 may cause the stimulus generation device 20 to generate a strong stimulus a certain time after the vehicle has stopped.

[0102] [2.3 Effects, etc.] As described above, the awakening assistance device 10A of the present embodiment provides the driver with a weak stimulus that is unlikely to cause distraction when the vehicle driven by the driver is in a traveling state.

[0103] As a result, while the vehicle being driven by the driver is in motion, the driver is not subjected to strong stimuli that are likely to cause distraction, thereby ensuring the safety of the driver.

[0104] On the other hand, the awakening assistance device 10A of the present embodiment provides the driver with a stimulus that is likely to cause a distraction and has a high awakening effect until a certain time before the estimated start timing when the vehicle driven by the driver is stopped.Then, the awakening assistance device 10A provides the driver with a weak stimulus that is unlikely to cause a distraction until the certain time before the start, i.e., immediately before the start of the vehicle.

[0105] This not only effectively wakes up the driver while the vehicle is stopped, but also ensures greater safety by making the driver less likely to be distracted when he or she begins to drive the vehicle.

[0106] (Variation 1) In the above-mentioned second embodiment, the certain time before the start timing is described as a fixed time such as 15 seconds, but is not limited to this. It may be changed according to the driver's condition, the surrounding environment of the vehicle, etc., or according to the type of stimulation used, the intensity of the stimulation, etc. In the following, such a case will be described as a first modified example. In the following, the differences from the contents described in the second embodiment will be mainly described.

[0107] [3.1 Configuration] The awakening support device 10A according to the first modification is different from the awakening support device 10A according to the second embodiment in the operation of the stimulus control unit 13 and the configuration of the estimation unit 14.

[0108] [3.1.1 Estimation unit 14A according to modification example 1] Fig. 13 is a diagram showing an example of the configuration of an estimation unit 14A according to Modification 1 of Embodiment 2. The same elements as those in Fig. 8 are denoted by the same reference numerals, and detailed description thereof will be omitted.

[0109] The estimation unit 14A shown in FIG. 13 is obtained by adding configurations of an internal information estimation unit 143A and a stop timing estimation unit 144A to the estimation unit 14 shown in FIG.

[0110] The internal information estimation unit 143A estimates internal information indicating the state of the driver. In this modification, the internal information estimation unit 143A estimates internal information indicating the state of the driver, such as whether the driver's concentration level, distraction level, driver's stress, etc. are high or low, based on the biological information acquired by the acquisition unit 11. The internal information estimation unit 143A estimates whether the driver's concentration level, distraction level, driver's stress, etc. are high or low, based on biological information indicating, for example, the trajectory of the driver's line of sight, the driver's heart rate, the driver's posture, etc.

[0111] The stop timing estimation unit 144A estimates the stop timing at which the vehicle will be in a stopped state when the vehicle state determination unit 12 determines that the vehicle is in a running state. In this modification, the stop timing estimation unit 144A estimates the stop timing, which is the timing at which the running vehicle will stop, based on the outside vehicle information and CAN information acquired by the acquisition unit 11. For example, when a traffic light in the direction in which the vehicle is traveling turns red and the vehicle will arrive at the stop line indicated by the traffic light in 3 seconds, the stop timing estimation unit 144A can estimate that the stop timing will be 3 seconds later.

[0112] [3.1.2 Stimulus control unit 13 according to modification example 1] In addition to the various functions described in the second embodiment, the stimulus control unit 13 may change the certain time before the start timing depending on the driver's state, the surrounding environment of the vehicle, etc., or may change it depending on the type of stimulus used and the stimulus.

[0113] For example, the stimulus control unit 13 may change the length of the certain time period before the start timing according to the driver's concentration level indicated in the internal information estimated by the internal information estimation unit 143A.

[0114] Furthermore, the stimulus control unit 13 may change the length of the certain period of time before the start timing based on ambient environment information obtained from the ambient environment of the vehicle.

[0115] FIG. 14 shows an example of a time period that is set to a certain time period before the start timing according to the first modification of the second embodiment.

[0116] In the example shown in FIG. 14, the default value of the certain period of time before the start timing is 15 seconds.

[0117] 14, for example, when a strong stimulus is given to the driver while the vehicle is stopped due to the drowsiness level, the time set as the fixed time before the start timing is 10 seconds, which is shorter than the default value. On the other hand, when a weak stimulus is given to the driver while the vehicle is stopped, the time set as the fixed time before the start timing is 3 seconds, which is even shorter than when a strong stimulus is given.

[0118] 14 also shows that the time set for the certain time before the start timing is changed depending on the type of stimulus given to the driver when the vehicle is stopped. For example, the time set for the certain time before the start timing is 15 seconds, the same as the default value, when a scent or light stimulus is given, and is 10 seconds, which is shorter than the default value, when a stimulus other than a scent or light is given.

[0119] FIG. 14 also shows that the time set as the certain period of time before the start timing is changed depending on external information obtained from surrounding information such as traffic volume, blind spot amount, and accident occurrence rate.

[0120] Similarly, FIG. 14 shows that the time set as the certain period of time before the start timing is changed depending on internal information such as the degree of distraction and stress.

[0121] Furthermore, in this modification, the stimulus control unit 13 may change the intensity of the stimulus generated by the stimulus generation device 20 according to the stop timing estimated by the stop timing estimation unit 144A. More specifically, for example, the stimulus control unit 13 may change the intensity of the stimulus generated by the stimulus generation device 20 according to the time length until the stop timing estimated by the stop timing estimation unit 144A. For example, when the time length until the stop timing estimated by the stop timing estimation unit 144A is shorter than a third threshold, the stimulus control unit 13 may cause the stimulus generation device 20 to generate a stimulus with a higher intensity than when the time length until the stop timing is equal to or greater than the third threshold. In a situation where a stopped state and a short running state are repeated, such as during a traffic jam, it may be possible that there is no safety problem even if a strong stimulus that is likely to cause distraction is given to the driver immediately before the stop timing. In such a case, the intensity of a weak stimulus that is unlikely to cause distraction may be changed immediately before the stop timing to generate a stimulus with a strength that may cause distraction, a stimulus with a strength that is likely to cause distraction (strong stimulus), etc.

[0122] [3.2 Effects, etc.] As described above, the awakening support device 10A of this modified example may change the length of the certain time before the start timing depending on the driver's condition, the surrounding environment of the vehicle, etc., or may change the length depending on the type of stimulation used, the intensity of the stimulation, etc.

[0123] This not only effectively wakes up the driver while the vehicle is stopped depending on the driver's condition, the vehicle's surrounding environment, the type of stimulation used, the intensity of the stimulation, etc., but also makes it difficult for distractions to occur when the driver starts driving the vehicle. Therefore, it is possible to effectively wake up the driver while ensuring safety.

[0124] (Possibility of other embodiments) For example, an awakening assistance device according to one aspect of the present disclosure is an awakening assistance device that promotes the awakening of a driver, and includes a vehicle state determination unit that determines whether the driver's vehicle is in a moving state or a stopped state, and a stimulus control unit that controls a stimulus generating device that generates a stimulus used to assist the driver in awakening based on the determination result of the vehicle state determination unit, and when the vehicle state determination unit determines that the vehicle is in a stopped state, the stimulus control unit causes the stimulus generating device to generate a stimulus of higher intensity than when the vehicle is determined to be in a moving state.

[0125] In this way, when the vehicle driven by the driver is in a running state, a weak stimulus that is unlikely to cause a distraction is given to the driver, while when the vehicle driven by the driver is in a stopped state, a strong stimulus that is likely to cause a distraction but has a high awakening effect is given to the driver. This ensures the safety of the driver when the vehicle driven by the driver is running, since a strong stimulus that is likely to cause a distraction is not given to the driver. On the other hand, when the vehicle driven by the driver is stopped, a stimulus that is likely to cause a distraction and has a high awakening effect is given to the driver, so that the driver's awakening can be effectively promoted.

[0126] The vehicle may further include a drowsiness estimation unit that estimates a drowsiness level indicating the degree of drowsiness of the driver based on detection information from a sensor that detects the state of the driver, and the stimulation control unit may change the intensity of the stimulation to be generated by the stimulation generating device according to the drowsiness level estimated by the drowsiness estimation unit.

[0127] Here, for example, the stimulus control unit may control the stimulus generating device to generate the stimulus when the drowsiness level estimated by the drowsiness estimation unit is estimated to be higher than a first threshold, and when the drowsiness level is estimated to be higher than the first threshold and it is determined that the vehicle is in a moving state, cause the stimulus generating device to generate a stimulus of a first intensity, and when the drowsiness level is estimated to be higher than the first threshold and it is determined that the vehicle is in a stopped state, cause the stimulus generating device to generate a stimulus of a higher intensity than the first intensity when it is determined that the vehicle is in a moving state.

[0128] This eliminates the need to provide the driver with stimuli that have a high arousal effect and are likely to cause distraction even when the vehicle is stopped, unless the driver is drowsy, thereby ensuring greater safety.

[0129] The vehicle may further include a start timing estimation unit that estimates a start timing of the vehicle when the vehicle state determination unit determines that the vehicle is in a stopped state, and the stimulus control unit may cause the stimulus generation device to change the intensity of the stimulus according to the start timing estimated by the start timing estimation unit.

[0130] Here, for example, the stimulus control unit may cause the stimulus generation device to change the intensity of the stimulus to the intensity that would be generated if the vehicle were determined to be in a moving state a certain time before the departure timing estimated by the departure timing estimation unit.

[0131] Also, for example, the stimulus control unit may change the intensity of the stimulus to the intensity that would be generated if the vehicle were determined to be in a moving state at the start timing by causing the stimulus generating device to gradually reduce the intensity of the stimulus from a certain time before the start timing estimated by the start timing estimation unit until the start timing.

[0132] As a result, when the vehicle being driven by the driver is moving, the driver is not given strong stimuli that are likely to cause distraction, so the driver's safety can be ensured. Also, not only can the driver's awakening be effectively encouraged when the vehicle is stopped, but the driver is in a state where distraction is unlikely to occur when the vehicle is moving, so safety can be further ensured.

[0133] The stimulus control unit may change the length of the certain period of time depending on a concentration level of the driver.

[0134] The stimulus control unit may change the length of the certain period of time based on ambient environment information obtained from the ambient environment of the vehicle.

[0135] This not only effectively wakes up the driver while the vehicle is stopped depending on the driver's condition and the vehicle's surrounding environment, but also makes it difficult for distractions to occur when the driver starts to drive the vehicle. Therefore, it is possible to effectively wake up the driver while ensuring safety.

[0136] In addition, the stimulus control unit may cause the stimulus generation device to change the intensity of the stimulus depending on the length from when the vehicle state determination unit determines that the vehicle is in a stopped state to the departure timing estimated by the departure timing estimation unit.

[0137] Here, when the length of time from when the vehicle state determination unit determines that the vehicle is in a stopped state to the departure timing estimated by the departure timing estimation unit is longer than a second threshold value, the stimulus control unit may cause the stimulus generation device to generate a stimulus of a higher intensity than when the length of time is equal to or less than the second threshold value.

[0138] As a result, if the vehicle is stopped for a short period of time, it is not necessary to generate a strong stimulus while the vehicle is stopped. This allows the driver to be more assured of safety since a strong stimulus that is likely to cause distraction is not given to the driver when the vehicle is stopped for a short period of time, for example, when the traffic light is red and the vehicle is stopped but the light immediately turns green and the vehicle starts moving forward.

[0139] In addition, the departure timing estimation unit may estimate the departure timing of the vehicle based on at least one of information obtained from traffic lights in the direction the vehicle is traveling, information obtained from a railroad crossing in the direction the vehicle is traveling, and information regarding other vehicles in the direction the vehicle is traveling.

[0140] In this manner, the vehicle start timing can be estimated.

[0141] The vehicle may further include a stop timing estimation unit that estimates a stop timing at which the vehicle will be stopped when the vehicle state determination unit determines that the vehicle is in a running state, and the stimulus control unit may change the intensity of the stimulus to be generated by the stimulus generation device according to the stop timing estimated by the stop timing estimation unit.

[0142] Here, for example, the stimulus control unit changes the intensity of the stimulus to be generated by the stimulus generation device in accordance with the length of time until the stop timing estimated by the stop timing estimation unit.

[0143] Also, for example, when the time length until the stop timing estimated by the stop timing estimation unit is shorter than a third threshold, the stimulus control unit may cause the stimulus generation device to generate a stimulus of higher intensity than when the time length until the stop timing is equal to or greater than the third threshold.

[0144] As a result, in a given situation, a strong stimulus that is likely to cause distraction can be given to the driver immediately before the stopping timing. This is because there is no safety problem in cases where a stopped state and a short running state are repeated, such as during a traffic jam, even if a strong stimulus that is likely to cause distraction is given to the driver immediately before the stopping timing. Therefore, it is possible to effectively encourage the driver to wake up while ensuring safety.

[0145] In addition, when the vehicle state determination unit determines that the vehicle is in a stopped state, the stimulus control unit may cause the stimulus generating device to generate a stimulus of higher intensity than when the vehicle is determined to be in a running state, a certain time after the vehicle has stopped.

[0146] This not only effectively wakes up the driver while the vehicle is stopped, but also ensures greater safety by making the driver less likely to be distracted when he or she begins to drive the vehicle.

[0147] Also, for example, when the vehicle state determination unit determines that the vehicle is in a stopped state, the stimulus control unit may cause the stimulus generation device to change the intensity of the stimulus to the intensity that would be generated if the vehicle were determined to be in a stopped state by gradually increasing the intensity from the intensity that would be generated if the vehicle were determined to be in a moving state.

[0148] Also, for example, the stimulus control unit may change the intensity of the stimulus by changing the type of stimulus generated by the stimulus generation device.

[0149] Also, for example, the stimulus may be at least one of wind, sound, vibration, scent, and light.

[0150] Also, for example, generating a stimulus of higher intensity than when it is determined that the vehicle is in a moving state may make the driver aware that a predetermined action is to be performed, and have the driver perform the predetermined action.

[0151] This allows for active actions that stimulate the driver's five senses to be used as a strong stimulus.

[0152] In addition, an awakening assistance method according to one aspect of the present disclosure is an awakening assistance method for promoting awakening of a driver, and includes a vehicle state determination step of determining whether the driver's vehicle is in a moving state or a stopped state, and a stimulus control step of controlling a stimulus generating device that generates a stimulus used to assist the driver's awakening based on the determination result of the vehicle state determination step, wherein in the stimulus control step, when it is determined that the vehicle is in a stopped state in the vehicle state determination step, the stimulus generating device generates a stimulus of a higher intensity than when it is determined that the vehicle is in a moving state.

[0153] This not only effectively wakes up the driver while the vehicle is stopped, but also ensures greater safety by making the driver less likely to be distracted when he or she begins to drive the vehicle.

[0154] The awakening assistance device and the awakening assistance method according to one aspect of the present disclosure have been described above based on the embodiment, modified examples, etc., but the present disclosure is not limited to these embodiment, modified examples, etc. As long as they do not deviate from the spirit of the present disclosure, various modifications conceived by a person skilled in the art to the present embodiment, modified examples, etc., or forms constructed by combining components in different embodiment, modified examples, etc., are also included within the scope of the present disclosure.

[0155] The following cases are also included in this disclosure:

[0156] (1) In the present disclosure, it has been described that when the vehicle driven by the driver is in a running state, a weak stimulus that is unlikely to cause a distraction is given to the driver, whereas when the vehicle driven by the driver is in a stopped state, a strong stimulus that is likely to cause a distraction but has a high awakening effect is given to the driver. In the present disclosure, the current stimulus content (intensity, type, etc.) given to the driver may be notified to the driver by a sound, a lamp, a display, etc. Also, when a stimulus is to be given to the driver or when the stimulus content is to be changed, the driver may be notified in advance by a sound, a lamp, a display, etc.

[0157] (2) Specifically, each of the above devices can be realized as a computer system consisting of a microprocessor, ROM, RAM, a hard disk unit, a display unit, a keyboard, a mouse, etc. A computer program is stored in the RAM or the hard disk unit. Each device achieves its function by the microprocessor operating according to the computer program. Here, a computer program is composed of a combination of multiple instruction codes that indicate commands for a computer to achieve a specified function.

[0158] (3) Some or all of the components constituting each of the above devices may be composed of one system LSI (Large Scale Integration). A system LSI is an ultra-multifunctional LSI manufactured by integrating multiple components on a single chip, and specifically, is a computer system composed of a microprocessor, ROM, RAM, etc. The ROM stores computer programs. The microprocessor loads the computer program from the ROM to the RAM, and performs operations such as calculations in accordance with the loaded computer program, thereby causing the system LSI to achieve its functions.

[0159] (4) The present disclosure may be realized by the methods described above. In addition, these methods may be realized by a computer program that is executed by a computer, or by a digital signal that is a computer program.

[0160] Specifically, a program according to one aspect of the present disclosure is a program for causing a computer to execute an awakening assistance method for encouraging the driver to wake up, and includes a vehicle state determination step of determining whether the driver's vehicle is in a moving state or a stopped state, and a stimulus control step of controlling a stimulus generating device that generates a stimulus used to assist the driver in awakening based on the determination result of the vehicle state determination step, wherein in the stimulus control step, when it is determined that the vehicle is in a stopped state in the vehicle state determination step, the stimulus generating device is caused to generate a stimulus of a higher intensity than when it is determined that the vehicle is in a moving state.

[0161] The present disclosure may also be realized by a computer program or a digital signal recorded on a computer-readable recording medium, such as a flexible disk, a hard disk, a CD-ROM, an MO, a DVD, a DVD-ROM, a DVD-RAM, a BD (Blu-ray (registered trademark) Disc), a semiconductor memory, etc. Also, the present disclosure may be realized by a digital signal recorded on such a recording medium.

[0162] In addition, the present disclosure may transmit a computer program or digital signal via a telecommunications line, a wireless or wired communication line, a network such as the Internet, data broadcasting, and the like.

[0163] The present disclosure may also provide a computer system having a microprocessor and a memory, the memory storing a computer program, and the microprocessor operating according to the computer program.

[0164] Furthermore, the program or digital signal may be recorded on a recording medium and transferred, or the program or digital signal may be transferred via a network or the like, so that the program or digital signal may be implemented by another independent computer system.

[0165] (5) The above-described embodiments and modifications may be combined with each other. [Industrial Applicability]

[0166] The present disclosure can be used in an awakening assistance device and an awakening assistance method, and in particular in an awakening assistance device and an awakening assistance method for effectively assisting a driver of a vehicle in awakening while ensuring the safety of the driver. [Explanation of symbols]

[0167] 10, 10A Awakening aid device 11 Acquisition Department 12 Vehicle condition determination unit 13 Stimulation control section 14, 14A Estimation section 20 Stimulus Generator 101 Communication equipment 102 Camera 103 Sensors 111 CAN information acquisition section 112 External information acquisition unit 113 Biometric information acquisition unit 141 Drowsiness Estimation Unit 142 Departure timing estimation unit 143A Internal information estimation unit 144A Stop timing estimation unit

Claims

1. An awakening assistance device for urging a driver to be awakened, a vehicle state determination unit that determines whether the driver's vehicle is in a traveling state or a stopped state; a stimulus control unit that controls a stimulus generation device that generates a stimulus used for the driver's awakening assistance based on a determination result of the vehicle state determination unit; a drowsiness estimation unit that estimates a drowsiness level indicating a degree of drowsiness of the driver based on detection information from a sensor that detects a state of the driver, The stimulation control unit includes: when the drowsiness estimation unit estimates that the drowsiness level is higher than a first threshold and the vehicle state determination unit determines that the vehicle is in a traveling state, causing the stimulus generation device to generate a stimulus of a first intensity; When the drowsiness level is estimated to be higher than a first threshold and when it is determined that the vehicle is in a stopped state, a stimulus having an intensity higher than the first intensity when it is determined that the vehicle is in a moving state is generated; changing the intensity of the stimulus generated by the stimulus generating device according to the drowsiness level; Awakening aid device.

2. The vehicle state determination unit determines that the vehicle is in a stopped state, and a start timing estimation unit estimates a start timing of the vehicle. The stimulation control unit includes: causing the stimulus generation device to change intensity of the stimulus in accordance with the start timing estimated by the start timing estimation unit; The awakening assistance device according to claim 1 .

3. The stimulation control unit includes: causing the stimulus generation device to change the intensity of the stimulus to an intensity for when it is determined that the vehicle is in a traveling state, a certain time before the start timing estimated by the start timing estimation unit. The awakening assistance device according to claim 2.

4. An awakening assistance device for facilitating the awakening of a driver, a vehicle state determination unit that determines whether the driver's vehicle is in a traveling state or a stopped state; a stimulus control unit that controls a stimulus generation device that generates a stimulus used for the driver's awakening assistance based on a determination result of the vehicle state determination unit; a start timing estimation unit that estimates a start timing of the vehicle when the vehicle state determination unit determines that the vehicle is in a stopped state, The stimulation control unit includes: When the vehicle state determination unit determines that the vehicle is in a stopped state, the stimulus generation device generates a stimulus with a higher intensity than when the vehicle is determined to be in a traveling state; causing the stimulus generation device to gradually lower the intensity of the stimulus from a certain time before the start timing estimated by the start timing estimation unit to the start timing, thereby changing the intensity to an intensity that would be obtained if it were determined that the vehicle was in a traveling state at the start timing. Awakening aid device.

5. The stimulation control unit includes: changing the length of the certain period of time depending on the driver's concentration level; The awakening assistance device according to claim 3 or 4.

6. The stimulation control unit includes: changing the length of the certain period of time based on ambient environment information obtained from the ambient environment of the vehicle; The awakening assistance device according to claim 3 or 4.

7. The stimulation control unit includes: causing the stimulus generation device to change intensity of the stimulus in accordance with a length of time from when the vehicle state determination unit determines that the vehicle is in a stopped state to when the start timing estimation unit estimates the start timing; The awakening assistance device according to any one of claims 2 to 6.

8. An awakening assistance device for facilitating the awakening of a driver, a vehicle state determination unit that determines whether the driver's vehicle is in a traveling state or a stopped state; a stimulus control unit that controls a stimulus generation device that generates a stimulus used for the driver's awakening assistance based on a determination result of the vehicle state determination unit; a start timing estimation unit that estimates a start timing of the vehicle when the vehicle state determination unit determines that the vehicle is in a stopped state, The stimulation control unit includes: When the vehicle state determination unit determines that the vehicle is in a stopped state, the stimulus generation device generates a stimulus with a higher intensity than when the vehicle is determined to be in a traveling state; When the high intensity stimulus is generated by the stimulus generating device, When a time length from when it is determined by the vehicle state determination unit that the vehicle is in a stopped state to the start timing estimated by the start timing estimation unit is longer than a second threshold, causing the stimulus generation device to generate a stimulus having a higher intensity than when the time length is equal to or less than the second threshold. Awakening aid device.

9. The departure timing estimation unit, estimating the start timing of the vehicle based on at least one of information obtained from a traffic light in the direction in which the vehicle is traveling, information obtained from a railroad crossing in the direction in which the vehicle is traveling, and information regarding another vehicle in the direction in which the vehicle is traveling; The awakening assistance device according to any one of claims 2 to 8.

10. An awakening assistance device for facilitating the awakening of a driver, a vehicle state determination unit that determines whether the driver's vehicle is in a traveling state or a stopped state; a stimulus control unit that controls a stimulus generation device that generates a stimulus used for the driver's awakening assistance based on a determination result of the vehicle state determination unit; a stop timing estimation unit that estimates a stop timing at which the vehicle will be in a stopped state when the vehicle state determination unit determines that the vehicle is in a running state, The stimulation control unit includes: When the vehicle state determination unit determines that the vehicle is in a stopped state, the stimulus generation device generates a stimulus with a higher intensity than when the vehicle is determined to be in a traveling state; changing an intensity of the stimulus generated by the stimulus generation device in accordance with the stop timing estimated by the stop timing estimation unit; Awakening aid device.

11. The stimulation control unit includes: changing an intensity of the stimulus generated by the stimulus generation device according to a time length until the stop timing estimated by the stop timing estimation unit; The awakening assistance device according to claim 10.

12. The stimulation control unit includes: When the time length until the stop timing estimated by the stop timing estimation unit is shorter than a third threshold, causing the stimulus generation device to generate a stimulus having a higher intensity than when the time length until the stop timing is equal to or greater than the third threshold. The awakening assistance device according to claim 11.

13. The stimulation control unit includes: When the vehicle state determination unit determines that the vehicle is in a stopped state, the stimulus generation device generates a stimulus with a higher intensity than when the vehicle is determined to be in a moving state, after a certain time has elapsed since the vehicle stopped. The awakening assistance device according to any one of claims 1 to 12.

14. An awakening assistance device for facilitating the awakening of a driver, comprising: a vehicle state determination unit that determines whether the driver's vehicle is in a traveling state or a stopped state; A stimulus control unit controls a stimulus generating device that generates a stimulus used for the driver's awakening assistance based on a determination result of the vehicle state determination unit, The stimulation control unit includes: When the vehicle state determination unit determines that the vehicle is in a stopped state, the stimulus generation device generates a stimulus with a higher intensity than when the vehicle is determined to be in a traveling state; When the high intensity stimulus is generated by the stimulus generating device, causing the stimulus generation device to gradually increase the intensity of the stimulus from the intensity when it is determined that the vehicle is in a moving state to the intensity when it is determined that the vehicle is in a stopped state; Awakening aid device.

15. The stimulation control unit includes: changing the type of stimulus generated by the stimulus generating device to change the intensity of the stimulus; The awakening assistance device according to any one of claims 1 to 14.

16. The stimulus may be At least one of wind, sound, vibration, scent, and light; The awakening assistance device according to any one of claims 1 to 15.

17. Producing a stimulus with an intensity higher than that when it is determined that the vehicle is in a moving state, Making the driver recognize that a predetermined operation will be performed and having the driver perform the predetermined operation. The awakening assistance device according to any one of claims 1 to 15.

18. An awakening assistance method for encouraging a driver to be awakened, comprising: a vehicle state determination step of determining whether the driver's vehicle is in a running state or a stopped state; a stimulus control step of controlling a stimulus generating device that generates a stimulus used for the driver's awakening assistance based on a result of the determination step of the vehicle state determination step; A drowsiness estimation step of estimating a drowsiness level indicating a degree of drowsiness of the driver based on detection information from a sensor that detects a state of the driver, In the stimulus control step, When the drowsiness level is estimated to be higher than a first threshold in the drowsiness estimation step and when the vehicle state determination step determines that the vehicle is in a traveling state, a stimulus of a first intensity is generated by the stimulus generation device; When the drowsiness level is estimated to be higher than a first threshold and when it is determined that the vehicle is in a stopped state, a stimulus having an intensity higher than the first intensity when it is determined that the vehicle is in a moving state is generated; changing the intensity of the stimulus generated by the stimulus generating device according to the drowsiness level; Awakening support methods.

Images