Awakening device, awakening system, and awakening program

Abstract

To provide an awakening device capable of further reliably awakening a driver using awakening stimulus, an awakening system, and an awakening program.SOLUTION: An awakening device 10 includes a detection unit 19, a determination unit 21, and an execution unit 23. When the determination unit determines that an awake state detected by the detection unit satisfies awakening execution conditions, the execution unit uses awakening means to generate arousal stimuli in a vehicle. When the determination unit determines that the awake state detected by the detection unit again does not satisfy the awakening execution conditions, the execution unit instructs an outside of the vehicle to check whether or not a driver is awake. When it is notified from the outside of the vehicle that the driver is awake, the execution unit stops generation of the arousal stimuli using the awakening means.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an awakening device, an awakening system, and an awakening program. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known a device that detects a drowsiness level of a driver of a vehicle based on the state of the driver (see, for example, Patent Document 1).

[0003] The device disclosed in Patent Document 1 generates an awakening stimulus inside the vehicle according to the driver's drowsiness level when it determines that the driver's drowsiness level exceeds a threshold.

[0004] When the device generates the wake-up stimulus in the vehicle, the device redetects the driver's drowsiness level. When the device determines that the driver's drowsiness level has fallen below the threshold as a result of the redetection, the device stops the wake-up stimulus. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2020-52482 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, even if the above-mentioned device determines that the driver's drowsiness level is equal to or lower than the threshold, this does not necessarily mean that the driver is actually awake.

[0007] If the device determines that the driver's drowsiness level is below a threshold, even though the driver is not actually awake, the wake-up stimuli are immediately stopped and the device is no longer able to wake the driver up with wake-up stimuli.

[0008] For this reason, further improvements are needed in order to more reliably awaken the driver using an awakening stimulus.

[0009] The present invention has been made in consideration of the problems inherent in the conventional technology, and an object of the present invention is to provide an awakening device, an awakening system, and an awakening program that can more reliably awaken a driver by using an awakening stimulus. [Means for solving the problem]

[0010] An awakening device according to one embodiment of the present invention comprises a detection unit that detects the awakening state of a driver of a vehicle, a judgment unit that judges whether the awakening state detected by the detection unit satisfies an awakening execution condition, and an execution unit that generates an awakening stimulus within the vehicle using an awakening means when the judgment unit judges that the detected awakening state satisfies the awakening execution condition, wherein the detection unit redetects the awakening state of the driver when the awakening stimulus is generated, and the judgment unit judges whether the awakening state redetected by the detection unit satisfies the awakening execution condition, and when the judgment unit determines that the redetected awakening state does not satisfy the awakening execution condition, the execution unit instructs an outside of the vehicle to check whether the driver is awakened, and when the execution unit is notified from outside the vehicle that it has been confirmed that the driver is awakened, it stops generating the awakening stimulus using the awakening means.

[0011] An awakening system according to one embodiment of the present invention comprises the above-mentioned awakening device and an external device connected to the awakening device via wireless communication, wherein the external device receives instruction information instructing an external device outside the vehicle to check whether the driver is awake, and in response to receiving the instruction information, the external device transmits a response request to the vehicle, and when the external device receives a response from the driver to the response request from the vehicle, it notifies the awakening device that it has confirmed that the driver is awake.

[0012] An awakening program according to one embodiment of the present invention causes a computer to execute the following steps: a first detection step of detecting an awakening state of a driver of a vehicle; a first judgment step of determining whether the awakening state detected by the first detection step satisfies an awakening execution condition; an execution step of generating an awakening stimulus within the vehicle using an awakening means if the first judgment step determines that the detected awakening state satisfies the awakening execution condition; a second detection step of re-detecting the awakening state of the driver if the awakening stimulus is generated; a second judgment step of determining whether the awakening state re-detected by the second detection step satisfies the awakening execution condition; an instruction step of instructing an outside of the vehicle to check whether the driver is awakened if the second judgment step determines that the re-detected awakening state does not satisfy the awakening execution condition; and a stop step of stopping the generation of the awakening stimulus using the awakening means when notified from outside the vehicle that it has been confirmed that the driver is awakened. Effect of the Invention

[0013] According to the present invention, it is possible to provide an awakening device, an awakening system, and an awakening program that can more reliably awaken a driver by using an awakening stimulus. [Brief description of the drawings]

[0014] [Figure 1] FIG. 1 is a schematic diagram showing the overall configuration of a wake-up system according to this embodiment. [Diagram 2] FIG. 2 is a functional block diagram of the awakening device according to this embodiment. [Diagram 3] FIG. 3 is a diagram showing an example of the awakening execution condition according to the present embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a hardware configuration of the awakening device according to the present embodiment. [Diagram 5] FIG. 5 is a block diagram of the tachograph according to this embodiment. [Figure 6] FIG. 6 is a block diagram of the office PC according to this embodiment. [Figure 7] FIG. 7 is a diagram showing a sequence of a wake-up procedure using the wake-up device and the office PC according to this embodiment. [Figure 8] FIG. 8 is a diagram showing an example of the awakening execution condition according to the modified example of the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, the awakening device, the awakening system, and the awakening program according to the present embodiment will be described in detail with reference to the drawings. Note that the same or similar reference numerals are used to designate the same functions or configurations, and descriptions thereof will be omitted as appropriate.

[0016] [Overall configuration of the awakening system] First, a configuration of an awakening system 1 according to this embodiment will be described. The awakening system 1 is used to awaken a driver (not shown) of a vehicle 3 by using an awakening stimulus.

[0017] Fig. 1 is a schematic diagram of the overall configuration of the awakening system 1. As shown in Fig. 1, the awakening system 1 includes an awakening device 10, a tachograph 100, a terminal device 200, an in-vehicle camera 210, an outside-vehicle camera 220, and an office PC (PERSONAL COMPUTER) 300. The awakening device 10, the tachograph 100, the in-vehicle camera 210, and the outside-vehicle camera 220 are mounted on a vehicle 3.

[0018] The awakening device 10 is communicably connected to the tachograph 100, the terminal device 200, the in-vehicle camera 210, and the exterior camera 220. The awakening device 10 detects the driver's awakening state based on information from the tachograph 100, the in-vehicle camera 210, and the exterior camera 220. When the detected driver's awakening state satisfies an awakening execution condition described below, the awakening device 10 continuously generates an awakening stimulus in the vehicle 3 using an awakening means 25 described below. In this way, the awakening device 10 alerts the driver with an awakening stimulus according to the driver's awakening state.

[0019] The awakening device 10 is communicatively connected to the office PC 300 via the network 7 (Internet). After generating the awakening stimulus, the awakening device 10 redetects the driver's awakening state. When the redetected awakening state of the driver no longer satisfies the awakening execution condition, the awakening device 10 instructs the office PC 300 to check whether the driver is awakened or not. When the awakening device 10 is notified by the office PC 300 that it has confirmed that the driver of the vehicle 3 is awakened, the awakening device 10 stops generating the awakening stimulus using the awakening means 25.

[0020] When the awakening state of the driver satisfies the awakening execution condition, the awakening device 10 can continuously generate the awakening stimulus in the vehicle 3 using the terminal device 200. In this case, when the awakening device 10 is notified by the office PC 300 that it has been confirmed that the driver of the vehicle 3 is awakened, the awakening device 10 stops generating the awakening stimulus using the terminal device 200.

[0021] The tachograph 100 records operation information related to the operation of the vehicle 3 and the driving operation of the vehicle 3 at regular time intervals. The tachograph 100 is also called a digital tachograph. Based on a transmission instruction from the awakening device 10, the tachograph 100 continuously transmits designated operation data out of the operation information to the awakening device 10. The operation information recorded by the tachograph 100 includes, for example, the following operation data D1 to D9. Operation data D1: Current time (date and time) · Operation data D2: Current position of vehicle 3 (longitude / latitude) · Operation data D3: Travel time of vehicle 3 · Operation data D4: Mileage of vehicle 3 - Operation data D5: Vehicle 3 speed Operation data D6: Acceleration of vehicle 3 Operation data D7: Engine RPM of vehicle 3 Operation data D8: Brake operation on / off - Operation data D9: Accelerator operation on / off

[0022] The terminal device 200 is a portable electronic device such as a smartphone. The terminal device 200 is owned by the driver of the vehicle 3 and is held, for example, in the driver's pocket. The terminal device 200 generates an awakening stimulus in response to an instruction from the awakening device 10.

[0023] The in-vehicle camera 210 is installed inside the vehicle 3 at a position facing the driver of the vehicle 3. The in-vehicle camera 210 captures images of the driver of the vehicle 3 at regular time intervals and generates image data of the driver. The in-vehicle camera 210 continuously transmits the image data of the driver to the awakening device 10 based on a transmission instruction from the awakening device 10. When transmitting the image data of the driver to the awakening device 10, the in-vehicle camera 210 transmits time information at which the image data was generated to the awakening device 10.

[0024] The exterior camera 220 is installed outside the vehicle 3. The exterior camera 220 captures images of the periphery of the vehicle 3 (for example, the front of the vehicle 3) at regular time intervals and generates image data of the periphery of the vehicle 3. The exterior camera 220 continuously transmits image data of the periphery of the vehicle 3 to the awakening device 10 based on a transmission instruction from the awakening device 10. When transmitting image data of the periphery of the vehicle 3 to the awakening device 10, the exterior camera 220 transmits time information at which the image data was generated to the awakening device 10.

[0025] The office PC 300 is installed in the office 5 and manages the operation status of the vehicle 3, the driving status of the vehicle 3, the status of the driver of the vehicle 3, etc. Based on an instruction from the awakening device 10, the office PC 300 transmits a response request to the vehicle 3 to confirm whether or not the driver of the vehicle 3 is awake. When the office PC 300 receives a response from the driver of the vehicle 3 to the response request from the vehicle 3, the office PC 300 notifies the awakening device 10 that it has confirmed that the driver of the vehicle 3 is awake. The office PC 300 is also referred to as an external device.

[0026] [Functional block configuration of the awakening device] Next, a functional block configuration of the awakening device 10 will be described. Fig. 2 is a functional block configuration diagram of the awakening device 10. As shown in Fig. 2, the awakening device 10 includes a receiving unit 11, a transmitting unit 13, a control unit 15, a memory unit 17, a detecting unit 19, a determining unit 21, an executing unit 23, and awakening means 25.

[0027] The receiving unit 11 and the transmitting unit 13 execute communication between the awakening device 10 and the tachograph 100. The transmitting unit 13 transmits a transmission instruction to the tachograph 100 to instruct the tachograph 100 to transmit designated operation data from the operation information. The receiving unit 11 receives the designated operation data from the tachograph 100. The transmission instruction includes identification information of the designated operation data.

[0028] The receiving unit 11 and the transmitting unit 13 execute communication between the awakening device 10 and the in-vehicle camera 210. The transmitting unit 13 transmits a transmission instruction to the in-vehicle camera 210 to instruct the in-vehicle camera 210 to transmit image data of the driver. The receiving unit 11 receives the image data of the driver from the in-vehicle camera 210.

[0029] The receiving unit 11 and the transmitting unit 13 execute communication between the awakening device 10 and the exterior camera 220. The transmitting unit 13 transmits a transmission instruction to the exterior camera 220 to instruct the exterior camera 220 to transmit image data of the surroundings of the vehicle 3. The receiving unit 11 receives the image data of the surroundings of the vehicle 3 from the exterior camera 220.

[0030] The receiving unit 11 and the transmitting unit 13 execute wireless communication between the awakening device 10 and the terminal device 200. The receiving unit 11 receives a connection request from the terminal device 200. When the awakening device 10 connects to the terminal device 200 in response to the connection request, the transmitting unit 13 transmits a connection completion to the terminal device 200.

[0031] The transmission unit 13 can transmit an alarm signal and an alarm stop signal to the terminal device 200. When the terminal device 200 receives the alarm signal, it generates an awakening stimulus. When the terminal device 200 receives the alarm stop signal, it stops generating the awakening stimulus.

[0032] The receiver 11 and the transmitter 13 perform wireless communication via the network 7 between the awakening device 10 and the office PC 300. The transmitter 13 transmits instruction information to the office PC 300 instructing the office PC 300 to confirm whether the driver of the vehicle 3 is awake or not. The receiver 11 receives from the office PC 300 a confirmation that the driver of the vehicle 3 is awake. When the driver's awakening state satisfies the awakening execution condition, the transmitter 13 notifies the office PC 300 of the occurrence of an alarm. When the generation of the awakening stimulus using the awakening means 25 or the terminal device 200 is stopped, the transmitter 13 notifies the office PC 300 of the end of the alarm.

[0033] The control unit 15 controls the overall processing in the awakening device 10. Specifically, the control unit 15 controls the operation of each of the receiving unit 11, the transmitting unit 13, the memory unit 17, the detecting unit 19, the determining unit 21, the executing unit 23, and the awakening means 25.

[0034] The storage unit 17 stores the designated operation data, the image data of the driver, and the image data of the surroundings of the vehicle 3, which are received by the receiving unit 11. The storage unit 17 stores the awakening execution conditions in advance. As will be described later, in the case where the voices of family members or the like are output from the speaker 230 as the awakening stimulus, the storage unit 17 stores audio data such as the voices of family members that have been recorded in advance.

[0035] The detection unit 19 detects the wakefulness state of the driver based on the designated driving data, the image data of the driver, and the image data of the surroundings of the vehicle 3, which are stored in the storage unit 17 during the same period. The detection unit 19 performs the detection at regular time intervals.

[0036] The wakefulness state of the driver can be directly detected from the driving operation of the driver, the state of the driver, and the running state of the vehicle. Therefore, in this embodiment, the detection unit 19 detects the following information as the wakefulness state of the driver from the designated driving data, the image data of the driver, and the image data of the surroundings of the vehicle 3.

[0037] The detection unit 19 detects the speed of the vehicle 3 from the operation data D5, which is the specified operation data. The detection unit 19 performs image analysis of the image data of the driver to detect the state of the driver's eyelids and the inclination of the driver's body. The detection unit 19 performs image analysis of the image data of the periphery of the vehicle 3 to detect whether the vehicle 3 has departed from its lane and the number of lane changes made by the vehicle 3.

[0038] The specified operation data is not limited to the operation data D5, but may be any data capable of detecting the driving operation of the driver that is characteristically manifested in a dangerous driving state described below. The information detected from the image data of the driver is not limited to the state of the driver's eyelids and the inclination of the driver's body, but may be any information capable of detecting the state of the driver that is characteristically manifested in a dangerous driving state. The information detected from the image data of the surroundings of the vehicle 3 is not limited to the presence or absence of lane departure of the vehicle 3 and the number of lane changes of the vehicle 3, but may be any information capable of detecting the state of the vehicle 3 that is characteristically manifested in a dangerous driving state.

[0039] The determination unit 21 determines whether or not the awakening state detected by the detection unit 19 satisfies the awakening execution condition. The determination unit 21 performs this determination at regular time intervals.

[0040] In this embodiment, a dangerous driving state is set as an awakening state in which it is necessary for the awakening device 10 to generate an awakening stimulus. The dangerous driving state is an awakening state in which the driver's attention level is significantly reduced and there is a possibility that dangerous driving, such as drowsy driving, is occurring.

[0041] Fig. 3 is a diagram showing an example of the awakening execution conditions. Conditions A1 to A5 shown in Fig. 3 are the awakening execution conditions used for determining whether the driver's awakening state is in a dangerous driving state or not.

[0042] When the wakefulness state detected by the detection unit 19 satisfies the conditions A1 to A4, or the conditions A1 to A3 and A5, the determination unit 21 determines that the wakefulness state of the driver is a dangerous driving state.

[0043] When the awakening state detected by the detection unit 19 does not satisfy the conditions A1 to A5, the determination unit 21 determines that the awakening state of the driver does not satisfy the awakening execution condition. Note that the awakening execution condition is not limited to the conditions A1 to A5 shown in FIG. 3 and can be changed as appropriate.

[0044] When the determination unit 21 determines that the driver's wakefulness state is a dangerous driving state, the execution unit 23 uses at least one of the awakening means 25 and the terminal device 200 to continuously generate the wakefulness stimulus in the vehicle 3. Specifically, the execution unit 23 transmits an alarm signal to at least one of the awakening means 25 and the terminal device 200 to continuously generate the wakefulness stimulus.

[0045] The awakening means 25 continuously generates at least one of an alarm sound, an alarm light, an alarm odor, and an alarm wind as an awakening stimulus based on receiving the alarm signal. The awakening means 25 outputs, for example, an irregular buzzer sound or a sound such as a family member's voice as the alarm sound. The awakening means 25 turns on or blinks, for example, a blue light as the alarm light. The awakening means 25 diffuses, for example, a mist of aromatic oil having an awakening effect as the alarm odor. The awakening means 25 outputs, for example, cold air as the alarm wind.

[0046] The terminal device 200 continuously generates at least one of an alarm sound, an alarm light, and an alarm vibration based on the reception of the alarm signal. The terminal device 200 outputs, for example, an irregular buzzer sound as the alarm sound. The terminal device 200 turns on or blinks a blue light as the alarm light. The terminal device 200 generates, for example, a vibration as the alarm vibration.

[0047] The alarm sound, alarm light, and alarm odor are also referred to as auditory, visual, and olfactory stimuli, respectively. The alarm vibration and alarm wind are also referred to as somatosensory stimuli.

[0048] The execution unit 23 can generate the same awakening stimulus among an alarm sound and an alarm light by interlocking the awakening means 25 and the terminal device 200. The execution unit 23 can generate different awakening stimuli among an alarm sound, an alarm light, an alarm smell, an alarm wind, and an alarm vibration by interlocking the awakening means 25 and the terminal device 200.

[0049] The execution unit 23 can randomly generate at least one of an alarm sound, an alarm light, an alarm smell, and an alarm wind, using the awakening means 25, every time an awakening stimulus is generated in the vehicle 3. The execution unit 23 can randomly generate at least one of an alarm sound, an alarm light, and an alarm vibration, using the terminal device 200, every time an awakening stimulus is generated in the vehicle 3.

[0050] When the determination unit 21 determines that the wakefulness state of the driver satisfies the wakefulness execution condition, the execution unit 23 The occurrence of the alarm is notified to the office PC 300 via the transmission unit 13 .

[0051] When the determination unit 21 determines that the driver's awakening state does not satisfy the awakening execution condition after the awakening stimulus occurs, the execution unit 23 instructs the office PC 300 via the transmission unit 13 to check whether the driver is awakened or not. At this time, the execution unit 23 transmits a real-time video signal of the driver to the office PC 300 via the transmission unit 13.

[0052] When the execution unit 23 is notified by the office PC 300 via the receiving unit 11 that it has been confirmed that the driver is awake, the execution unit 23 stops the generation of the awakening stimulus using at least one of the awakening means 25 and the terminal device 200. Specifically, the execution unit 23 transmits an alarm stop signal to at least one of the awakening means 25 and the terminal device 200 to stop the generation of the awakening stimulus.

[0053] When the execution unit 23 transmits the alarm stop signal to at least one of the awakening means 25 and the terminal device 200, the execution unit 23 notifies the office PC 300 via the transmission unit 13 of the end of the alarm.

[0054] [Hardware configuration of the awakening device] Next, a description will be given of an example of a hardware configuration of the awakening device 10. Fig. 4 is a diagram showing an example of a hardware configuration of the awakening device 10. As shown in Fig. 4, the awakening device 10 includes a CPU (Central Processing Unit) 51, a non-volatile memory 53, a volatile memory 55, and a hard disk 57.

[0055] The CPU 51 executes a program stored in the non-volatile memory 53. The CPU 51 performs arithmetic processing of data loaded into the volatile memory 55 in accordance with the program, and controls each part of the awakening device 10 in an integrated manner.

[0056] The non-volatile memory 53 stores programs and the like executed by the CPU 51. The volatile memory 55 temporarily holds operation data when the CPU 51 executes the programs stored in the non-volatile memory 53.

[0057] The hard disk 57 stores basic software such as an OS (Operating System), application programs, and data related thereto. The hard disk 57 stores driving information, image data of the driver, image data of the surroundings of the vehicle 3, and awakening execution conditions. When the voices of family members or the like are output from the speaker 230 as the awakening stimulus, the hard disk 57 stores audio data such as pre-recorded voices of family members.

[0058] As shown in FIG. 4, the awakening device 10 includes a communication device 59, an input device 61, a display device 63, an RTC (REAL-TIME CLOCK) 65, a speaker 230, a light emitting device 240, a diffuser 250, and an air conditioner 260.

[0059] The communication device 59 executes wireless communication between the awakening device 10 and the terminal device 200. The communication device 59 executes wireless communication via the network 7 between the awakening device 10 and the office PC 300.

[0060] The input device 61 is composed of buttons, a touch panel, etc., and accepts input operations from the driver of the vehicle 3. The display device 63 is composed of a liquid crystal display, etc., and displays various information. The RTC 65 generates time information.

[0061] When an alarm sound is generated as the awakening stimulus, an alarm signal is input to the speaker 230 from the CPU 51. When the alarm signal is input, the speaker 230 continues to generate the alarm sound as the awakening stimulus. The speaker 230 outputs, for example, an irregular buzzer sound as the alarm sound. When an alarm stop signal is input from the CPU 51, the speaker 230 stops generating the alarm sound. When a sound such as the voice of a family member is output as the alarm sound, the speaker 230 continues to receive an alarm signal including a pre-recorded sound such as the voice of a family member from the CPU 51. The speaker 230 is mounted on the vehicle 3.

[0062] When generating the warning light as the awakening stimulus, an alarm signal is input from the CPU 51 to the light-emitting device 240. When the alarm signal is input, the light-emitting device 240 continues to generate the warning light as the awakening stimulus. The light-emitting device 240 turns on or blinks, for example, a blue light as the warning light. When an alarm stop signal is input from the CPU 51, the light-emitting device 240 stops generating the warning light.

[0063] When an alarm odor is generated as the awakening stimulus, an alarm signal is input from CPU 51 to diffuser 250. When the alarm signal is input, diffuser 250 continues to generate the alarm odor as the awakening stimulus. Diffuser 250 diffuses, for example, a mist of aromatic oil as the alarm odor. When an alarm stop signal is input from CPU 51, diffuser 250 stops generating the alarm odor.

[0064] When warning wind is generated as the awakening stimulus, an alarm signal is input to the air conditioner 260 from the CPU 51. When the alarm signal is input, the air conditioner 260 continues to generate the warning wind as the awakening stimulus. The air conditioner 260 outputs, for example, cool air as the warning wind. When an alarm stop signal is input from the CPU 51, the air conditioner 260 stops generating the warning wind. The air conditioner 260 is mounted on the vehicle 3.

[0065] As shown in FIG. 4, the awakening device 10 includes a camera I / F 67 and an external I / F 69 as interfaces.

[0066] An in-vehicle camera 210 and an outside-vehicle camera 220 are connected to the camera I / F 67. Image data of the driver is input to the camera I / F 67 from the in-vehicle camera 210. Image data of the surroundings of the vehicle 3 is input to the camera I / F 67 from the outside-vehicle camera 220.

[0067] The external I / F 69 is connected to a tachograph 100. Designated operation data is input to the external I / F 69 from the tachograph 100.

[0068] 2 are realized by a communication device 59, a camera I / F 67, and an external I / F 77. The control unit 15 shown in Fig. 2 is realized by a CPU 51, a non-volatile memory 53, and a volatile memory 55. The storage unit 17 shown in Fig. 2 is realized by a hard disk 57.

[0069] 2 are realized by the CPU 51 executing the corresponding programs stored in the non-volatile memory 53 or the hard disk 57. The awakening means 25 shown in FIG. 2 is realized by the speaker 230, the light emitting device 240, the diffuser 250, and the air conditioner 260.

[0070] [Configuration of the operation recorder] Next, a description will be given of the configuration of the tachograph 100. Fig. 5 is a block diagram of the tachograph 100. As shown in Fig. 5, the tachograph 100 includes a CPU 101, a non-volatile memory 103, a volatile memory 105, a hard disk 107, a communication device 109, an input device 111, a display device 113, and an RTC 115.

[0071] The CPU 101 executes a program stored in the non-volatile memory 103. The CPU 101 performs calculations on data loaded into the volatile memory 105 in accordance with the program, and controls each part of the tachograph 100 in an integrated manner.

[0072] The non-volatile memory 103 stores programs and the like executed by the CPU 101. The volatile memory 105 temporarily holds operation data when the CPU 101 executes the programs stored in the non-volatile memory 103.

[0073] The hard disk 107 stores basic software such as an OS, application programs, and data related thereto. The hard disk 107 may also store operation information.

[0074] The communication device 109 executes wireless communication via the network 7 between the tachograph 100 and the office PC 300. The communication device 109 may transmit operation information to the office PC 300. The communication device 109 executes communication between the tachograph 100 and a GPS (Global Positioning Satellite) (not shown).

[0075] The input device 111 is composed of buttons, a touch panel, etc., and accepts input operations from the driver of the vehicle 3. The display device 113 is composed of a liquid crystal display, etc., and displays various information. The RTC 115 generates time information.

[0076] As shown in FIG. 5, the tachograph 100 includes a camera I / F 117, a speed I / F 119, a rotation speed I / F 121, a sensor I / F 123, a vehicle signal I / F 125, a card I / F 127, and an external I / F 129 as interfaces.

[0077] An exterior camera 220 is connected to the camera I / F 117. When an instruction to record the traveling state of the vehicle 3 is input to the input device 111, image data of the surroundings of the vehicle 3 is input to the camera I / F 117 from the exterior camera 220.

[0078] A speed sensor 270 is connected to the speed I / F 119. A speed pulse is input to the speed I / F 119 from the speed sensor 270. A tire rotation pulse is input to the rotation speed I / F 121 from a tire rotation speed sensor (not shown).

[0079] An acceleration sensor 280 is connected to the sensor I / F 123. A signal from the acceleration sensor 280 is input to the sensor I / F 123. A signal indicating the on / off state of a brake operation is input to the vehicle signal I / F 125 from a brake operation sensor (not shown). A signal indicating the on / off state of an accelerator operation is input to the vehicle signal I / F 125 from an accelerator operation sensor (not shown).

[0080] A memory card 290 is removably attached to the card I / F 127. Operation information is recorded in the memory card 290. The memory card 290 is inserted into the card I / F 127 by the driver of the vehicle 3, for example, when the vehicle 3 leaves the depot. The memory card 290 is removed from the card I / F 127 and attached to the office PC 300, for example, when the vehicle 3 enters the depot. As a result, the operation information recorded in the memory card 290 is read into the office PC 300 and processed as data. As a result, the office PC 300 can manage the operation status of the vehicle 3, the driving status of the vehicle 3, the status of the driver of the vehicle 3, and the like.

[0081] The CPU 301 acquires the above-mentioned operation data D1 to D9 as operation information, for example, in the following manner, and records them in the memory card 290. Operation data D1: The CPU 301 obtains the current time (date and time) from the RTC 115. · Operation data D2: The CPU 301 acquires the current position (longitude / latitude) of the vehicle 3 from the GPS. Operation data D3: The CPU 301 acquires the traveling time of the vehicle 3 using the time information of the RTC 115. Operation data D4: The CPU 301 acquires the travel distance of the vehicle 3 by using the tire rotation pulses input to the rotation speed I / F 121. Operation data D5: The CPU 301 acquires the speed of the vehicle 3 by using the speed pulse input to the speed I / F 119. Operation data D6: The CPU 301 acquires the acceleration of the vehicle 3 using a signal from the acceleration sensor 280 input to the sensor I / F 123. · Operation data D7: The CPU 301 acquires the engine speed of the vehicle 3 by using an engine rotation pulse input to an engine I / F (not shown). Operation data D8: The CPU 301 obtains the on / off state of the brake operation using a signal that is input to the vehicle signal I / F 125 and indicates the on / off state of the brake operation. Operation data D9: The CPU 301 obtains the on / off state of the accelerator operation using a signal that is input to the vehicle signal I / F 125 and indicates the on / off state of the accelerator operation.

[0082] The method for acquiring the operational data D1 to D9 is not limited to the above-mentioned method, and any other method may be used as long as appropriate values ​​can be acquired.

[0083] The awakening device 10 is connected to the external I / F 129. A transmission instruction including identification information of the operation data to be specified is input from the awakening device 10 to the external I / F 129. When the transmission instruction is input, the CPU 101 outputs the operation data associated with the identification information included in the transmission instruction from the external I / F 129 to the awakening device 10.

[0084] The awakening device 10 may include the function of the tachograph 100. In this case, the awakening device 10 is further provided with a speed I / F 119, a rotation speed I / F 121, a sensor I / F 123, a vehicle signal I / F 125, and a card I / F 127.

[0085] [Office PC configuration] Next, a description will be given of the configuration of the office PC 300. Fig. 6 is a block diagram of the office PC 300. As shown in Fig. 6, the office PC 300 includes a CPU 301, a non-volatile memory 303, a volatile memory 305, a hard disk 307, a communication device 309, an input device 311, a display device 313, a card I / F 315, and an audio I / F 317.

[0086] The CPU 301 executes a program stored in the non-volatile memory 303. The CPU 301 performs calculations on data loaded into the volatile memory 305 in accordance with the program, and controls each unit of the office PC 300 in an integrated manner.

[0087] The non-volatile memory 303 stores programs and the like executed by the CPU 301. The volatile memory 305 temporarily holds operation data when the CPU 301 executes the programs stored in the non-volatile memory 303.

[0088] The hard disk 307 stores basic software such as an OS, application programs, and data related thereto. The hard disk 107 stores operation information recorded in the memory card 290. When operation information is transmitted from the operation recorder 100, the hard disk 307 may store the operation information.

[0089] The communication device 309 executes wireless communication via the network 7 between the awakening device 10 and the office PC 300. The communication device 309 receives instruction information from the awakening device 10 instructing the communication device 309 to confirm whether the driver of the vehicle 3 is awake or not. At this time, the communication device 309 receives a real-time video signal of the driver. The communication device 309 transmits to the awakening device 10 a message indicating that it has been confirmed that the driver of the vehicle 3 is awake.

[0090] When the wakefulness state of the driver satisfies the wakefulness execution condition, the communication device 309 receives a notification of the generation of the alert from the wakefulness device 10. When the generation of the alert stimulus is stopped, the communication device 309 receives a notification of the end of the alert from the wakefulness device 10.

[0091] The communication device 309 executes wireless communication via the network 7 between the vehicle 3 and the office PC 300. The communication device 309 transmits a response request to the vehicle 3 to confirm whether the driver of the vehicle 3 is awake or not. The communication device 309 receives a response from the driver of the vehicle 3 to the response request from the vehicle 3. The communication device 309 receives, as the response from the driver, at least one of a voice signal of the driver, an operation signal of the awakening device 10 by the driver, and a video signal of the driver including the response action of the driver.

[0092] The communication device 309 executes wireless communication via the network 7 between the tachograph 100 and the office PC 300. When operation information is transmitted from the tachograph 100, the communication device 309 receives the operation information.

[0093] The input device 311 is composed of buttons, a touch panel, etc., and accepts input operations from the driver of the vehicle 3. The display device 313 is composed of a liquid crystal display, etc., and displays various information.

[0094] Memory card 290 is removably attached to card I / F 315. Memory card 290 is inserted into card I / F 315 by the driver of vehicle 3, for example, when vehicle 3 is brought into a warehouse. Thus, the operation information recorded in memory card 290 is read into office PC 300 and processed as data.

[0095] A microphone 319 is connected to the audio I / F 317. When a response request is to be sent to the vehicle 3 to check whether the driver of the vehicle 3 is awake, the manager of the office 5 calls out to the vehicle 3 using the microphone 319. In this case, the manager's voice signal is input from the microphone 319 to the audio I / F 317. The manager's voice signal is transmitted to the vehicle 3 by the communication device 309 as a response request.

[0096] A speaker 320 is connected to the audio I / F 317. When the driver responds vocally to a response request from the office PC 300, the driver's voice signal is transmitted from the vehicle 3 to the communication device 309. In this case, the driver's voice signal is output from the audio I / F 317 to the speaker 320. As a result, the driver's voice is output from the speaker 320.

[0097] [Awakening system operation] Next, a description will be given of the operation of the awakening system 1. Specifically, a description will be given of a procedure for awakening performed by the awakening device 10 and the office PC 300. FIG.

[0098] The first awakening procedure is started when the ignition switch of the vehicle 3 is turned on. The second and subsequent awakening procedures are started when the previous awakening procedure is completed. In this manner, the awakening procedure is continuously executed from when the ignition switch of the vehicle 3 is turned on until the ignition switch is turned off.

[0099] As shown in Fig. 7, in the awakening device 10, the detection unit 19 detects the awakening state of the driver of the vehicle 3 (step S1). Specifically, the awakening state of the driver is detected based on designated driving data, image data of the driver, and image data of the surroundings of the vehicle 3 within the same period stored in the storage unit 17. In this embodiment, the detection unit 19 detects the speed of the vehicle 3, the state of the driver's eyelids, the inclination of the driver's body, whether or not the vehicle 3 has departed from its lane, and the number of lane changes made by the vehicle 3, as the awakening state of the driver. Note that step S1 is also referred to as a first detection step.

[0100] In the awakening device 10, the determination unit 21 determines whether or not the awakening state detected by the detection unit 19 satisfies the awakening execution condition (step S3). Specifically, the determination unit 21 determines whether or not the awakening state detected by the detection unit 19 satisfies the conditions A1 to A4 or the conditions A1 to A3 and A5 shown in Fig. 3. Note that step S3 is also referred to as a first determination step.

[0101] When the determination unit 21 determines that the detected awakening state does not satisfy the awakening execution condition, the process returns to step S1. On the other hand, when the determination unit 21 determines that the detected awakening state satisfies the awakening execution condition, the determination unit 21 notifies the office PC 300 of the occurrence of an alarm via the transmission unit 13 (step S5). As a result, the awakening device 10 and the office PC 300 transition from the alarm release state to the alarm state.

[0102] In the awakening device 10, when the determination unit 21 determines that the detected awakening state satisfies the awakening execution condition, the execution unit 23 uses at least one of the awakening means 25 and the terminal device 200 to continuously generate the awakening stimulus in the vehicle 3. As a result, the execution unit 23 warns the driver with the awakening stimulus (step S7). Note that step S7 is also referred to as an execution step.

[0103] Specifically, the execution unit 23 transmits an alarm signal to at least one of the awakening means 25 and the terminal device 200 to continuously generate an awakening stimulus. The awakening means 25 continuously generates at least one of an alarm sound, an alarm light, an alarm smell, and an alarm wind as the awakening stimulus based on the reception of the alarm signal. The terminal device 200 continuously generates at least one of an alarm sound, an alarm light, and an alarm vibration based on the reception of the alarm signal.

[0104] When the awakening stimulus occurs in the awakening device 10, the detection unit 19 detects the awakening state of the driver again (step S9). Note that step S9 is also referred to as a second detection step.

[0105] In the awakening device 10, the determination unit 21 determines whether or not the awakening state redetected by the detection unit 19 satisfies the awakening execution condition (step S11). Note that step S11 is also referred to as a second determination step.

[0106] When the determination unit 21 determines that the re-detected awakening state satisfies the awakening execution condition, the process returns to step S9. On the other hand, when the determination unit 21 determines that the re-detected awakening state does not satisfy the awakening execution condition, the execution unit 23 instructs the office PC 300 via the transmission unit 13 to check whether the driver is awakened or not (step S13). Note that step S13 is also referred to as an instruction step.

[0107] Specifically, the execution unit 23 transmits instruction information for instructing the office PC 300 to check whether the driver is awake or not, via the transmission unit 13. In step S13, the execution unit 23 transmits a real-time video signal of the driver to the office PC 300 via the transmission unit 13.

[0108] When the office PC 300 receives a real-time video signal of the driver, it displays the video of the driver on the display device 313. This allows the manager of the office 5 to check the condition of the driver from the video displayed on the display device 313.

[0109] Based on the instruction information from the awakening device 10, the office PC 300 transmits a response request to the vehicle 3 to check whether the driver of the vehicle 3 is awakened or not (step S15). Specifically, when transmitting a response request to the vehicle 3, the manager of the office 5 makes a call using the microphone 319. In this case, the manager's voice signal is input from the microphone 319 to the office PC 300. The office PC 300 transmits the manager's voice signal to the vehicle 3 as a response request. The manager's voice signal is input to a speaker in the vehicle 3. As a result, the call from the manager is output from the speaker in the vehicle 3. The speaker in the vehicle 3 is, for example, the speaker 230 of the awakening device 10 or the speaker of the terminal device 200.

[0110] When the office PC 300 transmits the response request to the vehicle 3, it determines whether or not there is a response from the driver (step S17). Specifically, the office PC 300 determines whether or not at least one of the driver's voice signal, the driver's operation signal for the awakening device 10, and the driver's video signal including the driver's response action has been received as a response from the driver.

[0111] When the driver responds by voice to a call from the manager in the vehicle 3, the office PC 300 receives the voice signal of the driver. In this case, the office PC 300 outputs the driver's voice from the speaker 320.

[0112] When the driver in the vehicle 3 responds to a call from the manager by operating the awakening device 10, the office PC 300 receives an operation signal from the driver to the awakening device 10. In this case, the office PC 300 displays on the display device 313 a message indicating that the operation signal has been received.

[0113] When the driver of the vehicle 3 responds to a call from the manager by waving his / her hand toward the in-vehicle camera 210, the office PC 300 receives a video signal of the driver including the driver's response. In this case, the office PC 300 displays the video of the driver on the display device 313.

[0114] This allows the manager to confirm the driver's response to the response request from the sound output from the speaker 320 or the image displayed on the display device 313. When the manager confirms the driver's response to the response request, the manager inputs into the input device 311 that he / she has confirmed that the driver is awake.

[0115] If the office PC 300 does not input information to the input device 311 indicating that the driver is awake, the office PC 300 determines that there is no response from the driver, and returns to step S15. On the other hand, if the office PC 300 inputs information to the input device 311 indicating that the driver is awake, the office PC 300 determines that there is a response from the driver, and transmits information to the awakening device 10 indicating that the driver of the vehicle 3 is awake (step S19).

[0116] In addition, when the office PC 300 receives at least one of the driver's voice signal, the driver's operation signal of the awakening device 10, and the driver's video signal including the driver's response action, the office PC 300 may transmit to the awakening device 10 a notification that it has confirmed that the driver of the vehicle 3 is awake.

[0117] In the awakening device 10, when the execution unit 23 is notified by the office PC 300 via the receiving unit 11 that it has been confirmed that the driver is awakened, the execution unit 23 stops the generation of the awakening stimulus using at least one of the awakening means 25 and the terminal device 200 (step S21). Specifically, the execution unit 23 transmits an alarm stop signal to at least one of the awakening means 25 and the terminal device 200 to stop the generation of the awakening stimulus. Note that step S21 is also referred to as a stop step.

[0118] In the awakening device 10, when the generation of the awakening stimulus using the awakening means 25 or the terminal device 200 is stopped, the execution unit 23 notifies the office PC 300 of the end of the alarm (step S23). Specifically, when the execution unit 23 transmits an alarm stop signal to at least one of the awakening means 25 and the terminal device 200, it notifies the office PC 300 of the end of the alarm via the transmission unit 13. As a result, the awakening device 10 and the office PC 300 transition from an alarm state to an alarm release state.

[0119] The above expression "instruction information for instructing to confirm whether the driver is awake or not" can be rephrased as "alarm cancellation request." Also, the above expression "notification that it has been confirmed that the driver is awake" can be rephrased as "alarm cancellation."

[0120] These paraphrases lead to the following: In step S13, if the determination unit 21 of the awakening device 10 determines that the redetected awakening state does not satisfy the awakening execution condition, the execution unit 23 transmits an alarm cancellation request to the office PC 300 via the transmission unit 13. In step S19, when the office PC 300 determines that there is a response from the driver, it transmits an alarm cancellation to the awakening device 10. In step S21, when the execution unit 23 of the awakening device 10 is notified of the cancellation of the alarm from the office PC 300, the execution unit 23 stops the generation of the awakening stimulus using at least one of the awakening means 25 and the terminal device 200. In this manner, based on the instruction from the office PC 300, the awakening device 10 stops generating the awakening stimulus.

[0121] [Actions and Effects] According to this embodiment, the awakening device 10 includes a detection unit 19, a determination unit 21, and an execution unit 23. The detection unit 19 detects the awakening state of the driver of the vehicle 3. The determination unit 21 determines whether or not the awakening state detected by the detection unit 19 satisfies the awakening execution condition. When the determination unit 21 determines that the detected awakening state satisfies the awakening execution condition, the execution unit 23 generates an awakening stimulus in the vehicle 3 using the awakening means 25.

[0122] When an awakening stimulus occurs, the detection unit 19 redetects the awakening state of the driver. The determination unit 21 determines whether or not the awakening state redetected by the detection unit 19 satisfies the awakening execution condition. When the determination unit 21 determines that the redetected awakening state does not satisfy the awakening execution condition, the execution unit 23 instructs the outside of the vehicle 3 to confirm whether or not the driver is awakened. When the execution unit 23 is notified from the outside of the vehicle 3 that it has been confirmed that the driver is awakened, it stops generating the awakening stimulus using the awakening means 25.

[0123] With this configuration, the awakening device 10 stops generating the awakening stimulus using the awakening means 25 when the driver's awakening state does not satisfy the awakening execution condition and confirmation that the driver is awakened is received from outside the vehicle 3.

[0124] Therefore, even if the awakening device 10 determines that the awakening state of the driver does not satisfy the awakening execution condition even though the driver is not actually awakened, the awakening stimulus is not immediately stopped. The awakening device 10 continues to generate the awakening stimulus using the awakening means 25 until it receives a confirmation from outside the vehicle 3 that the driver is awakened, so that the driver can be reliably awakened during this period.

[0125] Therefore, according to this embodiment, the awakening device 10 can more reliably awaken the driver by using an awakening stimulus.

[0126] According to this embodiment, when instructing the outside of the vehicle 3 to check whether the driver is awake or not, the execution unit 23 transmits a real-time video signal of the driver to the outside of the vehicle 3.

[0127] With this configuration, the state of the driver can be visually confirmed by displaying a real-time video signal of the driver on a display device outside the vehicle 3. Therefore, it can be reliably confirmed outside the vehicle 3 whether the driver is awake or not.

[0128] According to the present embodiment, the execution unit 23 generates, as the awakening stimulus, at least one of an auditory stimulus, a visual stimulus, an olfactory stimulus, and a somatosensory stimulus.

[0129] With this configuration, when the driver's awakening state satisfies the awakening execution condition, the awakening device 10 can wake up the driver by stimulating at least one of the driver's hearing, vision, smell, and somatic senses. Therefore, the awakening device 10 can easily wake up the driver by using the awakening stimulus.

[0130] According to the present embodiment, the detection unit 19 detects the wakefulness state based on the state of the driver, the traveling state of the vehicle 3, and the driving operation of the driver.

[0131] With this configuration, the detection unit 19 detects the wakefulness of the driver by combining the state of the driver, the running state of the vehicle 3, and the driving operation of the driver. Therefore, the detection unit 19 can detect the wakefulness of the driver in more detail than when the detection unit 19 detects the wakefulness of the driver based on one of the state of the driver, the running state of the vehicle 3, and the driving operation of the driver.

[0132] According to this embodiment, the awakening system 1 includes the above-mentioned awakening device 10 and an office PC 300 connected to the awakening device 10 via wireless communication. The office PC 300 receives instruction information that instructs the awakening device 10 to confirm whether the driver is awakened or not, from outside the vehicle 3. In response to receiving the instruction information, the office PC 300 transmits a response request to the vehicle 3. When the office PC 300 receives a response from the driver to the response request from the vehicle 3, the office PC 300 notifies the awakening device 10 that it has confirmed that the driver is awakened.

[0133] With this configuration, in the awakening system 1, the awakening device 10 stops generating the awakening stimulus using the awakening means 25 when the driver's awakening state does not satisfy the awakening execution condition and a confirmation that the driver is awakened is received from the office PC 300.

[0134] Therefore, even if the awakening device 10 determines that the awakening state of the driver does not satisfy the awakening execution condition even though the driver is not actually awakened, the awakening stimulus is not immediately stopped. The awakening device 10 continues to generate the awakening stimulus using the awakening means 25 until it receives a confirmation from the office PC 300 that the driver is awakened, so that the driver can be reliably awakened during this period.

[0135] Therefore, according to this embodiment, the awakening system 1 can more reliably awaken the driver by using the awakening stimulus.

[0136] According to this embodiment, the office PC 300 receives, as a response from the driver, at least one of the driver's voice signal, the driver's operation signal of the awakening device 10, and the driver's video signal including the driver's response action.

[0137] With this configuration, the driver is required to perform at least one of the following response actions in response to a response request from the office PC 300: responding with voice, operating the awakening device 10, and waving a hand. Therefore, the office PC 300 can reliably confirm that the driver is awakened.

[0138] According to this embodiment, when the office PC 300 receives the instruction information, the office PC 300 receives a real-time video signal of the driver from the awakening device. The office PC 300 displays the real-time video signal of the driver on the display device 313.

[0139] With this configuration, the office PC 300 can visually check the state of the driver by displaying a real-time video signal of the driver on the display device 313. Therefore, the office PC 300 can reliably check whether the driver is awake or not.

[0140] According to this embodiment, the awakening program causes a computer to execute a first detection step, a first determination step, an execution step, a second detection step, a second determination step, an instruction step, and a stop step.

[0141] The first detection step detects the awakening state of the driver of the vehicle 3. The first determination step determines whether or not the awakening state detected by the first detection step satisfies the awakening execution condition. The execution step generates an awakening stimulus in the vehicle 3 using the awakening means 25 when the first determination step determines that the detected awakening state satisfies the awakening execution condition.

[0142] The second detection step detects the wakefulness state of the driver again when the awakening stimulus occurs. The second determination step determines whether or not the wakefulness state redetected by the second detection step satisfies the awakening execution condition. The instruction step instructs an external device of the vehicle 3 to confirm whether or not the driver is awakened when the second determination step determines that the redetected wakefulness state does not satisfy the awakening execution condition. The stop step stops the generation of the awakening stimulus using the awakening means 25 when a notification is received from an external device of the vehicle 3 that it has been confirmed that the driver is awakened.

[0143] With this configuration, the configuration of the above-mentioned awakening device 10 can be realized as software by a program loaded into the memory. Therefore, according to this embodiment, the awakening program is executed by a computer, so that the driver can be more reliably awakened using an awakening stimulus.

[0144] [Variations] In the above-described embodiment, the dangerous driving state is set as the awakening state in which the awakening device 10 needs to generate an awakening stimulus, but this is not limiting. In this modified example, the low-awakening driving state and the dangerous driving state are set as the awakening states in which the awakening device 10 needs to generate an awakening stimulus.

[0145] The low-awareness driving state is a state of alertness in which the driver's attention is reduced due to the reduced change in the line of sight while driving. A driver who falls into the low-awareness driving state is in a state of reduced attention despite not feeling drowsy or having their eyes wide open. The low-awareness driving state is likely to occur on straight sections of expressways. In particular, if a vehicle has an auto-cruise function, the driver can drive the vehicle at a constant set speed without operating the accelerator on straight sections of expressways, so the low-awareness driving state is likely to occur.

[0146] In this way, the driver's alertness is affected by the road conditions on which the vehicle is traveling. For this reason, in this embodiment, the detection unit 19 detects the road conditions to complement the detection of the driver's alertness. The detection unit 19 detects the following information from image data of the periphery of the vehicle 3 as the road conditions. The detection unit 19 performs image analysis on the image data of the periphery of the vehicle 3 to detect the road shape, the presence or absence of traffic lights, and the presence or absence of pedestrian crossings on the road on which the vehicle 3 is traveling.

[0147] The information detected from the image data around the vehicle 3 is not limited to the road shape, the presence or absence of traffic lights, and the presence or absence of pedestrian crossings, but may be any information that can detect road conditions that are characteristic of expressways.

[0148] The detection unit 19 may detect the road condition from the operation data of the operation recorder 100. In this case, the operation recorder 100 records the road classification as new operation data D10. Specifically, the operation recorder 100 works in conjunction with an ETC (Electronic Toll Collection System) to identify whether the road on which the vehicle 3 is traveling is a general road or an expressway, and records the road condition.

[0149] In the present embodiment, the detection unit 19 detects the following information from the designated driving data, the image data of the driver, and the image data of the periphery of the vehicle 3 as the wakefulness state of the driver.

[0150] The detection unit 19 detects the speed of the vehicle 3, the on / off state of the brake operation, and the on / off state of the accelerator operation from the operation data D5, D8, and D9 that are the specified operation data. The detection unit 19 performs image analysis of the image data of the driver to detect the state of the driver's eyelids, the movement of the driver's eyes, and the movement and inclination of the driver's body. The detection unit 19 performs image analysis of the image data of the surroundings of the vehicle 3 to detect whether the vehicle 3 has departed from its lane and the number of times the vehicle 3 has changed lanes.

[0151] The specified operation data is not limited to the operation data D5, D8, and D9, and may be any data capable of detecting the driving operation of the driver that is characteristically manifested in the low awareness driving state and the dangerous driving state. The information detected from the image data of the driver is not limited to the state of the driver's eyelids, the movement of the driver's eyes, and the movement and inclination of the driver's body, and may be any information capable of detecting the state of the driver that is characteristically manifested in the low awareness driving state and the dangerous driving state. The information detected from the image data of the surroundings of the vehicle 3 is not limited to the presence or absence of the vehicle 3's lane departure and the number of lane changes of the vehicle 3, and may be any information capable of detecting the state of the vehicle 3 that is characteristically manifested in the low awareness driving state and the dangerous driving state.

[0152] The determination unit 21 determines whether or not the awakening state and the road conditions detected by the detection unit 19 satisfy the awakening execution conditions.

[0153] Fig. 8 is a diagram showing an example of the awakening execution conditions. Conditions B1 to B9 shown in Fig. 8 are the awakening execution conditions used for determining whether the driver's awakening state is the low-awakening driving state or not.

[0154] When the wakefulness state detected by the detection unit 19 satisfies the conditions B1 to B6 and the road condition detected by the detection unit 19 satisfies the conditions B7 to B9, the determination unit 21 determines that the driver's wakefulness state is a low wakefulness driving state. Note that, when the vehicle 3 does not have an auto-cruise function, the conditions B2 and B3 are excluded.

[0155] When the wakefulness state detected by the detection unit 19 satisfies the conditions A1 to A4 or the conditions A1 to A3 and A5 shown in FIG. 3, the determination unit 21 determines that the wakefulness state of the driver is a dangerous driving state.

[0156] If the awakening state detected by the detection unit 19 does not satisfy the conditions A1 to A5 and the conditions B1 to B6, and the road conditions detected by the detection unit 19 do not satisfy the conditions B7 to B9, the judgment unit 21 judges that the driver's awakening state does not satisfy the awakening execution conditions.

[0157] When the judgment unit 21 judges that the driver's wakefulness state and road conditions satisfy the awakening execution conditions, the execution unit 23 uses at least one of the awakening means 25 and the terminal device 200 to continuously generate an awakening stimulus within the vehicle 3.

[0158] After an awakening stimulus occurs, if the judgment unit 21 judges that the driver's awakening state and road conditions do not satisfy the awakening execution conditions, the execution unit 23 instructs the office PC 300 via the transmission unit 13 to check whether the driver is awakened or not.

[0159] According to this embodiment, the detection unit 19 detects the road condition on which the vehicle 3 is traveling in order to complement the detection of the awakening state. The determination unit 21 determines whether or not a combination of the awakening state and the road condition detected by the detection unit 19 satisfies the awakening execution condition. When the determination unit 21 determines that the combination of the detected awakening state and the road condition satisfies the awakening execution condition, the execution unit 23 uses the awakening means 25 to generate an awakening stimulus.

[0160] With this configuration, the detection unit 19 can detect that the driver's wakefulness state is the low alertness driving state. Therefore, the detection unit 19 can distinguish between different wakefulness states in which the driver's attention is reduced.

[0161] According to this embodiment, when an awakening stimulus occurs, the detection unit 19 redetects the road condition. The determination unit 21 determines whether or not a combination of the awakening state and the road condition redetected by the detection unit 19 satisfies the awakening execution condition. When the determination unit 21 determines that the combination of the awakening state and the road condition redetected does not satisfy the awakening execution condition, the execution unit 23 instructs the outside of the vehicle 3 to check whether the driver is awakened.

[0162] With this configuration, the awakening device 10 can distinguishably detect different awakening states in which attention is reduced, and can instruct the outside of the vehicle 3 to check whether the driver is awakened or not.

[0163] [Other embodiments] In the above-described embodiment, the detection unit 19 performs image analysis on the image data of the periphery of the vehicle 3 to detect whether the vehicle 3 has deviated from the lane and the number of lane changes of the vehicle 3, but is not limited to this. For example, the operation recorder 100 may perform image analysis on the image data of the periphery of the vehicle 3 from the exterior camera 220 as new operation data to detect whether the vehicle 3 has deviated from the lane and the number of lane changes of the vehicle 3.

[0164] In the above-described embodiment, when the office PC 300 does not receive a response from the driver to the response request from the vehicle 3 even after a predetermined time has elapsed, the office PC 300 repeatedly transmits the response request, but is not limited to this. For example, when the office PC 300 does not receive a response from the driver to the response request from the vehicle 3 even after a predetermined time has elapsed, the office PC 300 may issue an alarm outside the vehicle 3 to notify vehicles, pedestrians, etc. outside the vehicle 3 of an abnormality. Examples of the alarm include sounding the horn of the vehicle 3 and flashing the hazard lights of the vehicle 3.

[0165] Although the present embodiment has been described above, the present embodiment is not limited to this, and various modifications are possible within the scope of the gist of the present embodiment. [Explanation of symbols]

[0166] 1 Awakening System 3. Vehicle 10 Awakening Device 19 Detection section 21 Judgment section 23 Executive Department 25 Awakening Method 300 Office PC

Claims

1. A detection unit that detects an alertness state of a driver of the vehicle; a determination unit that determines whether the awakening state detected by the detection unit satisfies an awakening execution condition; an execution unit that generates an awakening stimulus in the vehicle using an awakening means when the determination unit determines that the detected awakening state satisfies the awakening execution condition; Equipped with The detection unit detects the wakefulness state of the driver again when the wakefulness stimulus occurs, The determination unit determines whether or not the awakening state redetected by the detection unit satisfies the awakening execution condition, When the determination unit determines that the re-detected wakefulness state does not satisfy the wakefulness execution condition, the execution unit instructs an external device to check whether the driver is wakeful; The awakening device wherein the execution unit stops generation of the awakening stimulus using the awakening means when the execution unit is notified by the external device that it has been confirmed that the driver is awakened.

2. The awakening device according to claim 1 , wherein the execution unit transmits a real-time video signal of the driver to the external device when instructing the external device to check whether the driver is awake.

3. The awakening device according to claim 1 or 2, wherein the execution unit generates, as the awakening stimulus, at least one of an auditory stimulus, a visual stimulus, an olfactory stimulus, and a somatosensory stimulus.

4. The awakening device according to claim 1 , wherein the detection unit detects the awakening state based on a state of the driver, a running state of the vehicle, and a driving operation of the driver.

5. The detection unit detects a road condition on which the vehicle is traveling in order to complement the detection of the wakefulness state, The determination unit determines whether or not a combination of the awakening state and the road condition detected by the detection unit satisfies the awakening execution condition; 5. The awakening device according to claim 4, wherein when the determination unit determines that a combination of the detected awakening state and the road condition satisfies the awakening execution condition, the execution unit generates the awakening stimulus using the awakening means.

6. An awakening device; an external device connected to the wake-up device via wireless communication; Equipped with The awakening device comprises: A detection unit that detects an alertness state of a driver of the vehicle; a determination unit that determines whether the awakening state detected by the detection unit satisfies an awakening execution condition; an execution unit that generates an awakening stimulus in the vehicle using an awakening means when the determination unit determines that the detected awakening state satisfies the awakening execution condition; Equipped with The detection unit detects the wakefulness state of the driver again when the wakefulness stimulus occurs, The determination unit determines whether or not the awakening state redetected by the detection unit satisfies the awakening execution condition, When the determination unit determines that the re-detected wakefulness state does not satisfy the wakefulness execution condition, the execution unit instructs the external device to check whether the driver is wakeful; When the execution unit is notified by the external device that it has been confirmed that the driver is awake, the execution unit stops generation of the awakening stimulus using the awakening means, The external device receives instruction information instructing the external device to check whether the driver is awake, The external device transmits a response request to the vehicle in response to receiving the instruction information; When the external device receives a response from the driver to the response request from the vehicle, the external device notifies the awakening device that it has confirmed that the driver is awakened.

7. The awakening system according to claim 6, wherein the external device receives, as a response from the driver, at least one of a voice signal of the driver, an operation signal of the awakening device by the driver, and a video signal of the driver including a response action of the driver.

8. A first detection step of detecting an alertness state of a driver of the vehicle; a first determination step of determining whether or not the awakening state detected by the first detection step satisfies an awakening execution condition; an execution step of generating an awakening stimulus in the vehicle using an awakening means when the first determination step determines that the detected awakening state satisfies an awakening execution condition; a second detection step of re-detecting the driver's wakefulness when the wakefulness stimulus occurs; a second determination step of determining whether or not the awakening state re-detected by the second detection step satisfies the awakening execution condition; an instruction step of instructing an external device to check whether the driver is awake or not when the second determination step determines that the re-detected awake state does not satisfy the awake execution condition; a stop step of stopping generation of the awakening stimulus using the awakening means when the external device notifies the driver that the driver is awakened; An awakening program that causes a computer to execute the above.

Images