Portable terminal device, information processing method, program, and recording media

The mobile terminal device addresses the issue of inconsistent arousal timings by using biological data to set personalized thresholds, ensuring timely and effective arousal interventions for drivers.

JP2025108643APending Publication Date: 2025-07-23PIONEER IP +1
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2025068868
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-04-18
Publication Date
2025-07-23

AI Technical Summary

Technical Problem

Existing wake-up support devices for drivers fail to stimulate at appropriate timings due to variations in driver response times based on their drowsiness levels, leading to inconsistent and ineffective arousal interventions.

Method used

A mobile terminal device equipped with biological information acquisition means, stimulus control device, and storage means that adjusts stimulation based on personalized threshold values derived from biological data, ensuring timely and appropriate arousal interventions.

Benefits of technology

The device provides timely and effective arousal stimuli by setting personalized threshold values based on driver-specific biological data, optimizing the awakening process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025108643000001_ABST
    Figure 2025108643000001_ABST
Patent Text Reader

Abstract

To provide a portable terminal device capable of stimulating a user at the appropriate time for his / her arousal.SOLUTION: A portable terminal device includes means for acquiring biometric information of a user, means for transmitting the biometric information and a first threshold value to a stimulus controller that starts supporting the user's arousal when a numerical value generated based on the biometric information of the user exceeds the first threshold value, and means for storing the first threshold value.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a mobile terminal device, an information processing method, a program, and a recording medium.

Background Art

[0002] In order to prevent a driver of an automobile from dozing off, a wake-up support device that supports the awakening of the driver by emitting a warning sound or the like is known.

[0003] As such a wake-up support device, there is a wake-up support device that asks the driver whether he / she wishes to receive wake-up support when the driver's drowsiness level reaches a standard, and performs wake-up support when an answer indicating a wish for wake-up support is obtained, which is disclosed in Patent Document 1.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the wake-up support device of Patent Document 1, it is disclosed that the lower the standard of the drowsiness level for asking the driver is set, the shorter the time from when the driver is asked whether he / she wishes to start wake-up support until an answer is obtained. However, the time until the driver answers the question varies depending on various circumstances.

[0006] For example, when the driver's drowsiness level is strong, the driver may not notice the question of the wake-up support device. For this reason, a problem that the driver cannot be stimulated at an appropriate timing is cited as an example of the problems.

[0007] The present invention has been made in view of the above points, and one of its objectives is to provide a portable terminal device that can give a stimulus at an appropriate timing for the arousal of the user.

Means for Solving the Problems

[0008] The portable terminal device according to claim 1 of the present application includes a biological information acquisition means for acquiring the biological information of the user, and a stimulus control device that starts assisting the arousal of the user when a numerical value generated based on the biological information of the user exceeds a first threshold value. It is characterized by having a transmission means for transmitting the biological information and the first threshold value, and a storage means for storing the first threshold value.

[0009] The information processing method according to claim 8 of the present application is an information processing method executed by a portable terminal device. When a numerical value generated based on the biological information of the user exceeds a first threshold value, it includes a step of storing the first threshold value of the stimulus control device that starts assisting the arousal of the user, a step of acquiring the biological information of the user, and a step of transmitting the biological information and the first threshold value to the stimulus control device.

[0010] The program according to claim 9 of the present application causes a computer to execute a step of storing the first threshold value of a stimulus control device that starts assisting the arousal of the user when a numerical value generated based on the biological information of the user exceeds the first threshold value, a step of acquiring the biological information of the user, and a step of transmitting the biological information and the first threshold value to the stimulus control device.

[0011] The recording medium according to claim 10 of the present application is a recording medium in which a program for causing a computer to execute a step of storing the first threshold value of a stimulus control device that starts assisting the arousal of the user when a numerical value generated based on the biological information of the user exceeds the first threshold value, a step of acquiring the biological information of the user, and a step of transmitting the biological information and the first threshold value to the stimulus control device is recorded.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3A

Figure 3B

Figure 3C

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Modes for Carrying Out the Invention

Examples

[0013] The following describes the stimulus control device 10 of Example 1. The stimulus control device 10 is mounted on a moving body such as an automobile. The moving body may be a moving body other than an automobile, such as a bicycle, a motorcycle, or an airplane. In this example, the case where the stimulus control device is mounted on an automobile, which is an example of the moving body, will be described.

[0014] FIG. 1 shows the functional blocks of the stimulus control device 10 according to Example 1. As shown in FIG. 1, the input unit 20 is an interface unit that is connected so as to be able to acquire data from the biological sensor BS and the display input device DS. The stimulus control device 10 receives data from the biological sensor BS and the display input device DS via the input unit 20.

[0015] The biological sensor BS is a sensor that acquires the biological information of the driver who drives the automobile, that is, the user. The biological sensor BS is communicably connected to the stimulus control device 10 by wire or wirelessly. Examples of the biological information include the driver's body temperature, pulse per predetermined time, blood pressure, respiration rate per predetermined time, blink rate per predetermined time, yawn rate per predetermined time, and the like.

[0016] The biological sensor BS is any device that measures this biological information. For example, when measuring the driver's pulse, the biological sensor BS is a pulse meter having a pulse measurement function. When measuring the driver's blood pressure, the biological sensor BS is a sphygmomanometer having a blood pressure measurement function. When measuring the driver's respiration rate, the biological sensor BS is a measuring device that measures the vertical movement of the driver's chest wall photographed by a camera. When measuring the driver's blink rate, the biological sensor BS is a measuring device that measures the vertical movement of the driver's eyelids photographed by a camera. These devices may be devices provided in the automobile or wearable computers worn by the driver.

[0017] The display input device DS is a touch panel display through which the driver can input arbitrary information to the stimulation control device 10. Specifically, for example, it is a touch panel monitor in which a display such as a liquid crystal display capable of displaying video and a touch pad are combined. The display input device DS only needs to be visible to the driver and arranged within reach of the driver's hand. The display input device DS may be provided, for example, on the center console of the vehicle.

[0018] The vibration generating device VB is a vibrator that gives vibrations, which are stimuli for arousing the driver, in response to an instruction from the stimulation control device 10. That is, the vibration generating device VB functions as a stimulating means for arousing the driver. The vibration generating device VB only needs to be arranged at a location where it can give vibrations to the driver. The display input device DS may be built into the seat of the driver's seat of the vehicle and give vibrations to the seat surface of the driver's seat. Also, the display input device DS may be built into the steering wheel of the vehicle and give vibrations to the steering wheel.

[0019] The output unit 22 is an interface unit connected to the vibration generating device VB. The stimulation control device 10 can control the start and stop of the vibration of the vibration generating device VB via the output unit 22.

[0020] The storage device 23 is composed of, for example, a hard disk device, an SSD (Solid State Drive), a flash memory, etc. The storage device 23 stores various programs such as BIOS (Basic Input Output System) and software.

[0021] Also, it is possible to store information for generating information on the degree of driver drowsiness from biological information and a first threshold value (hereinafter referred to as the first threshold value), which is a threshold value of the degree of driver drowsiness for notifying and promoting the use of the vibration generating device VB. Specifically, the storage device 23 can store a threshold value DB (Data Base) in which the first threshold value is recorded for each driver.

[0022] The control unit 24 is realized by a computer having a CPU (Central Processing Unit) 24a as an arithmetic processing unit, a ROM (Read Only Memory) 24b as a main storage device, and a RAM (Random Access Memory) 24c. The CPU 24a reads a program corresponding to the processing content from the ROM 24b or the storage device 23 and expands it in the RAM 24c, and realizes various functions in cooperation with the expanded program.

[0023] Each of the input unit 20, the output unit 22, the storage device 23, and the control unit 24 is connected to each other via a system bus 25.

[0024] The control unit 24 can acquire the biometric information of the driver received via the input unit 20. The control unit 24 can acquire a stop instruction for the stimulus from the driver to the vibration generator VB. Specifically, the control unit 24 can acquire the stop instruction input from the display input device DS via the input unit 20.

[0025] The control unit 24 can generate a value such as a numerical value based on the biometric information received via the input unit 20. Specifically, the control unit 24 can generate a numerical value related to the degree of drowsiness of the driver based on the biometric information of the driver. Hereinafter, the numerical value generated by the control unit 24 is simply referred to as a drowsiness degree value.

[0026] The control unit 24 can notify the driver when the drowsiness degree value exceeds a first threshold value. The control unit 24 performs, for example, a display prompting the use of the vibration generator VB on the display input device DS. The notification by the control unit 24 is not limited to the display on the display input device DS. For example, the control unit 24 may output a voice prompting the use of the vibration generator VB from a speaker (not shown) mounted on the vehicle.

[0027] The control unit 24 can instruct the start of stimulation to the vibration generator VB. Specifically, the control unit 24 transmits a signal instructing the start of stimulation to the vibration generator VB via the output unit 22 in response to an input operation of the display input device DS by the driver.

[0028] The control unit 24 can set a first threshold value based on the drowsiness level value of the driver when a stop instruction is acquired. Specifically, the control unit 24 updates and sets the first threshold value stored in the threshold value DB stored in the storage device 23 based on the drowsiness level value when acquiring stop instruction information for stopping the vibration of the vibration generator VB input by the display input device DS.

[0029] The control unit 24 can identify one driver from a plurality of drivers. That is, the control unit 24 sets a first threshold value for each driver based on the drowsiness level value when a stop instruction is acquired.

[0030] FIG. 2 shows an example of a table of the threshold value DB stored in the storage device 23. When the drowsiness level value of the driver of the automobile exceeds the first threshold value, the control unit 24 gives a notification prompting the use of the vibration generator VB. As shown in FIG. 2, the first threshold value of the initial setting (initial value) has the drowsiness level value of the driver set to "6". In this embodiment and subsequent embodiments, the drowsiness level value is a numerical value in 10 levels. The closer the drowsiness level value is to "10", the lower the waking state of the driver. Also, the closer the drowsiness level value is to "1", the higher the waking state of the driver.

[0031] When an operation to stop the vibration of the vibration generator VB is performed by the driver, the control unit 24 receives a stop instruction. The control unit 24 sets the first threshold value based on the drowsiness level value when the stop instruction is received.

[0032] For example, when the first threshold value is set to "6" and the assumed drowsiness level value at the time of acquiring the stop instruction is "3", the control unit 24 makes a setting to maintain the setting state when the expected result is obtained.

[0033] Also, when the driver's drowsiness level value at the time of obtaining the stop instruction is "5" or "4", the driver is considered to be more awake than the assumed state. That is, the drowsiness level value generated based on the biological information is generated with a higher numerical value than the actual state of the driver. In this case, the control unit 24 sets the first threshold value to be higher. Specifically, when the drowsiness level value at the time of obtaining the stop instruction is "5", the control unit 24 sets the first threshold value to "8". Also, when the drowsiness level value at the time of obtaining the stop instruction is "4", the control unit 24 sets the first threshold value to "7".

[0034] Furthermore, when the driver's drowsiness level value at the time of obtaining the stop instruction is "1" or "2", the driver is considered to be in a state of stronger drowsiness than the assumed state. That is, the drowsiness level value generated based on the biological information is generated with a lower numerical value than the actual state of the driver. In this case, the control unit 24 sets the first threshold value to be lower. Specifically, when the drowsiness level value at the time of obtaining the stop instruction is "1", the control unit 24 sets the first threshold value to "4". Also, when the drowsiness level value at the time of obtaining the stop instruction is "2", the control unit 24 sets the first threshold value to "5".

[0035] Note that the control unit 24 sets the first threshold value for generating the vibration of the vibration generator VB for each driver. The identification of the driver is not particularly limited, and for example, it may be performed by biometric authentication that identifies an individual by reading a fingerprint, a vein pattern, or the like. Also, the identification of the driver may be performed, for example, by reading a storage medium storing the driver's information. Specifically, the driver's information may be read from an IC (integrated circuit) chip embedded in a card. Also, one or more drivers may be stored in the storage device 23 in advance, and the information of the registered driver may be read from the storage device 23 by the user operating the display input device DS.

[0036] FIG. 3 shows the display modes of the display input device DS. FIG. 3A shows the display mode of the display input device DS when the vehicle starts running, that is, when the driver's drowsiness value does not exceed the first threshold value.

[0037] As shown in FIG. 3A, the display input device DS is shown with a state display area VR indicating the vibration state of the vibration generator VB, a switching area SR for operating the switching between the generation and stop of the vibration of the vibration generator VB, an adjustment area AR for adjusting the intensity of the vibration of the vibration generator VB, and a biological information area BR for displaying the driver's drowsiness value and heart rate.

[0038] In FIG. 3A, the switching area SR is, for example, displayed with an operation button "Refresh" that starts the vibration of the vibration generator VB with a blue background color and a white text color. Also, the state display area VR is displayed with "Vibration" indicating the vibration state of the vibration generator VB with a blue background color and a white text color. The adjustment area AR is displayed with an operation button "down" that weakens the vibration of the vibration generator VB and an operation button "up" that strengthens the vibration of the vibration generator VB with a blue background color and a white text color.

[0039] FIG. 3B shows the display mode of the display input device DS when the driver's drowsiness value exceeds the first threshold value. As shown in FIG. 3B, when the driver's drowsiness value exceeds the first threshold value, the control unit 24 performs a display prompting the driver to use the vibration generator VB. For example, the switching area SR is, for example, displayed with "Refresh" with an orange background color and a black text color. Also, the state display area VR and the adjustment area AR are displayed in the same manner as in the case of FIG. 3A, that is, with a blue background color and a white text color. In this way, the switching area SR is displayed in an emphasized manner so as to be more prominent than the state display area VR and the adjustment area AR.

[0040] FIG. 3C shows the display mode of the display input device DS when the vibration generator VB generates vibration. As shown in FIG. 3C, when the vibration generator VB is vibrating, the switching area SR is displayed, for example, in the same manner as in FIG. 3B, that is, with an orange background color and black character color. Also, the status display area VR is displayed, for example, with the character "Vibration" in black character color on a green background color to indicate that the vibration generator VB is vibrating. The adjustment area AR is displayed, for example, in the same manner as in FIG. 3A, that is, with a blue background color and white character color.

[0041] FIG. 4 shows the processing flow of the control unit 24. The control unit 24 starts processing, for example, triggered by the engine start of an automobile. As shown in FIG. 4, the control unit 24 acquires biological information from the biological sensor BS (step S101). In step S101, the control unit 24 functions as biological information acquisition means.

[0042] In addition, the control unit 24 may acquire biological information at predetermined time intervals and sequentially store the acquired biological information in the storage device 23.

[0043] The control unit 24 generates a drowsiness degree value based on the biological information acquired in step S101 (step S102). In step S102, the control unit 24 functions as numerical value generation means for generating a numerical value based on the biological information.

[0044] The control unit 24 determines whether the drowsiness degree value generated in step S102 exceeds a first threshold value (step S103). If the control unit 24 determines in the determination of step S103 that the drowsiness degree value does not exceed the first threshold value (step S103: N), it acquires biological information again (step S101), generates a drowsiness degree value (step S102), and determines whether the generated drowsiness degree value exceeds the first threshold value (step S103).

[0045] In the determination of step S103, when the control unit 24 determines that the drowsiness level value exceeds the first threshold (step S103: Y), it performs a notification prompting the use of the vibration generator VB (step S104). In step S104, the control unit 24 functions as a notification means for notifying the driver when the drowsiness level value exceeds the first threshold. Specifically, the control unit 24 causes the display input device DS to display a prompt for the driver to use the vibration generator VB. For example, the control unit 24 highlights "Refresh" in orange background color with black text color in the switching area SR of the display input device DS.

[0046] When a start instruction to start the vibration of the vibration generator VB is input from the display input device DS by the driver, the start instruction is transmitted from the display input device DS.

[0047] The control unit 24 determines whether there is a start instruction transmitted from the display input device DS within a predetermined time (step S105). In the determination of step S105, when the control unit 24 determines that there is no start instruction (step S105: N), it determines whether the predetermined time has elapsed (step S106).

[0048] If the control unit 24 determines in step 106 that the predetermined time has not elapsed (step S106: N), it returns to the process of step S104. If the control unit 24 determines in step 106 that the predetermined time has elapsed (step S106: Y), it ends the process.

[0049] When a stop instruction to stop the vibration of the vibration generator VB is input from the display input device DS by the driver, the stop instruction is transmitted from the display input device DS.

[0050] In the determination of step S105, when the control unit 24 determines that there is a start instruction (step S105: Y), it determines whether it has acquired the stop instruction transmitted from the display input device DS (step S107). In step S107, the control unit 24 functions as a stop instruction acquisition means for acquiring a stop instruction for the vibration generator VB.

[0051] When the control unit 24 determines in the determination of step S107 that a stop instruction has been acquired (step S107: Y), it acquires the biometric information of the driver when the stop instruction was acquired (step S108), and generates a drowsiness level value based on the biometric information acquired in step S108 (step S109).

[0052] The control unit 24 sets a first threshold value based on the drowsiness level value generated in step S109 (step S110). In step S110, the control unit 24 functions as setting means for setting the first threshold value based on the drowsiness level value when the stop instruction was acquired.

[0053] Note that the determination in step S107 is repeated until a stop instruction is acquired (step S107: N). The above processing of the control unit 24 is repeated, for example, until the engine of the vehicle stops.

[0054] The drowsiness level value generated in step S109 may be stored in the storage device 23 every time the drowsiness level value generation process of step S109 is performed. In this case, the control unit 24 may acquire the drowsiness level values when the stop instruction is acquired a plurality of times, and set the first threshold value based on the drowsiness level values acquired over the plurality of times.

[0055] Specifically, for example, the control unit 24 may calculate the average value of the drowsiness level values generated by the drowsiness level value generation process in the most recent four times of step S109, and set the first threshold value based on the calculated average value. Also, for example, the control unit 24 may calculate the average value of all the drowsiness level values generated in step S109, and set the first threshold value based on the calculated average value. Further, for example, the control unit 24 may extract an arbitrary plurality of drowsiness level values from the drowsiness level values generated in step S109, calculate the average value, and set the first threshold value based on the calculated average value. Furthermore, for example, the control unit 24 may set the first threshold value based on the moving average of the drowsiness level values generated in step S109.

[0056] Also, in this embodiment, a vibration generator VB is used as the stimulation means. However, the stimulation means is not limited to the vibration generator, and for example, it may be a speaker that outputs sound. Further, as other stimulation means, an air conditioner mounted on the moving body may be used. For example, the driver may be stimulated by lowering the temperature inside the moving body. Also, the driver may be stimulated by directing the cold air of the air conditioner at the driver's face. Furthermore, the driver may be stimulated by outputting a scent with a high awakening effect such as mint.

[0057] Furthermore, in this embodiment, the control unit 24 generates a sleepiness degree value based on the driver's biological information. When the generated sleepiness degree value exceeds the first threshold value, the control unit 24 gives a notification prompting the driver to use the vibration generator VB. However, the control unit 24 may give a notification prompting the driver to use the vibration generator VB based on the driver's biological information without generating the sleepiness degree value. For example, when numerical values such as the driver's heart rate, respiratory rate, and blood pressure exceed the threshold value, the control unit 24 may be configured to give a notification prompting the driver to use the vibration generator VB.

[0058] In addition, when the driver adjusts the intensity of the vibration of the vibration generator VB during the journey, the first threshold value may be set according to the increase or decrease in the intensity of the vibration. Specifically, when the driver increases the vibration, the first threshold value may be set to be higher. Also, when the driver weakens the vibration, the first threshold value may be set to be lower.

[0059] As described above, according to the stimulation control device 10 according to this embodiment, when the driver performs a stop operation of the vibration generator VB, that is, when a stop instruction is acquired, a threshold value of the sleepiness degree value for giving a notification prompting the driver to use the vibration generator VB is set based on the sleepiness degree value. Therefore, it is possible to prompt the generation of stimulation in an appropriate state for the user. Accordingly, it is possible to give stimulation at an appropriate timing for awakening the user.

[0060] That is, the drowsiness level value when the vibration generator VB is stopped is in a state where the driver is surely awake. The drowsiness level value of the driver at this time is estimated to have little variation and a certain value can be obtained. By setting the first threshold value based on such a certain drowsiness level value, it becomes possible to generate a stimulus in an appropriate state for the user.

Embodiment

[0061] The stimulus control device 10 of Embodiment 2 will be described. The stimulus control device 10 of Embodiment 1 sets the threshold value of the drowsiness level value to be notified to the driver, that is, the first threshold value, based on the drowsiness level value when a stop instruction is acquired. The stimulus control device 10 of Embodiment 2 is different from the stimulus control device 10 of Embodiment 1 in that the first threshold value is set based on the drowsiness level value when the driver performs an operation to start the vibration of the vibration generator VB. For the same configuration as in Embodiment 1, the description will be omitted by assigning the same reference numerals. The same applies to the following embodiments.

[0062] The control unit 24 can acquire an instruction to start vibration from the driver for the vibration generator VB. Specifically, the control unit 24 can acquire the start instruction input from the display input device DS via the input unit 20.

[0063] The control unit 24 sets the threshold value of the drowsiness level value that prompts the use of the vibration generator VB based on the drowsiness level value when the driver performs an operation to start the vibration generator VB, that is, when the start instruction is acquired.

[0064] FIG. 5 shows the processing flow of the control unit 24. As shown in FIG. 5, the control unit 24 acquires biological information from the biological sensor BS (step S201), and generates a drowsiness level value based on the biological information acquired in step S201 (step S202).

[0065] The control unit 24 determines whether it has acquired a start instruction (step S203). In step S203, the control unit 24 functions as start instruction acquisition means for acquiring a vibration start instruction from the driver for the vibration generator VB.

[0066] When the control unit 24 determines in the determination of step S203 that it has acquired a start instruction (step S203: Y), it sets a first threshold value based on the biological information at the time of acquiring the start instruction (step S204).

[0067] When the control unit 24 determines in the determination of step S203 that it has not acquired a start instruction (step S203: N), it determines whether the drowsiness level value generated in step S202 exceeds the first threshold value (step S205). The processing of subsequent steps S206 to S212 corresponds to steps S104 to S110 in FIG. 4, so the description thereof is omitted.

[0068] As described above, according to the stimulation control device 10 according to the present embodiment, when the driver performs a stop operation of the vibration generator VB, that is, based on the drowsiness level value at the time of acquiring the stop instruction, a threshold value of the drowsiness level value for notifying the driver to promote the use of the vibration generator VB, that is, the first threshold value, is set. Therefore, it is possible to promote the generation of stimulation in an appropriate state for the user. Therefore, it is possible to give stimulation at an appropriate timing for the awakening of the user.

[0069] Further, when the driver performs a vibration start operation of the vibration generator VB, that is, based on the drowsiness level value at the time of acquiring the start instruction, a threshold value of the drowsiness level value to be notified to the driver is set. That is, according to the stimulation control device 10 according to the present embodiment, the drowsiness level value when the driver needs awakening support can be set as the first threshold value. Therefore, it is possible to generate stimulation in an appropriate state for the user.

Embodiment

[0070] The stimulation control device of Example 3 will be described. The stimulation control device 10 of Example 1 sets a threshold value of the drowsiness level value, that is, a first threshold value, for notifying the driver to encourage the use of the vibration generator VB based on the drowsiness level value when a stop instruction is acquired. The stimulation control device 10 of Example 3 is different from the stimulation control device 10 of Example 1 in that it sets the first threshold value taking into account the intensity of the stimulation of the vibration generator VB.

[0071] The control unit 24 can set the first threshold value according to the intensity of the vibration of the vibration generator VB.

[0072] FIG. 6 shows an example of a table of the threshold value DB stored in the storage device 23. When an operation to stop the vibration of the vibration generator VB is performed by the driver, the control unit 24 acquires a stop instruction. The control unit 24 sets the first threshold value based on the drowsiness level value when the stop instruction is acquired.

[0073] As shown in FIG. 6, for example, the case where the first threshold value is set to "6" will be described. When the stimulation intensity is "medium", the control unit 24 makes a setting to maintain the setting state when the expected result is obtained, that is, when the drowsiness level value at the time of receiving the stop instruction is "3".

[0074] When the stimulation intensity is "medium" and the drowsiness level value of the driver at the time of acquiring the stop instruction is "5" or "4", the driver is considered to be more awake than the assumed state. That is, the drowsiness level value generated based on the biological information is generated as a higher numerical value than the actual state of the driver. In this case, the control unit 24 sets the first threshold value to be higher. Specifically, when the drowsiness level value at the time of acquiring the stop instruction is "5", the control unit 24 sets the first threshold value to "8". Also, when the drowsiness level value at the time of acquiring the stop instruction is "4", the control unit 24 sets the first threshold value to "7".

[0075] Furthermore, when the stimulation intensity is "medium" and the driver's drowsiness level value at the time of obtaining the stop instruction is "1" or "2", it is considered that the driver is in a more drowsy state than the assumed state. That is, the drowsiness level value generated based on the biological information is generated with a lower numerical value than the actual state of the driver. In this case, the control unit 24 sets the first threshold value to be lower. Specifically, when the drowsiness level value at the time of obtaining the stop instruction is "1", the control unit 24 sets the first threshold value to "4". Also, when the drowsiness level value at the time of obtaining the stop instruction is "2", the control unit 24 sets the first threshold value to "5".

[0076] When the stimulation intensity is "weak", if the control unit 24 obtains the expected result, that is, when the drowsiness level value at the time of receiving the stop instruction is "2", the control unit 24 performs a setting to maintain the current setting state.

[0077] When the stimulation intensity is "weak" and the driver's drowsiness level value at the time of obtaining the stop instruction is from "5" to "3", it is considered that the driver is more awake than the assumed state. That is, the drowsiness level value generated based on the biological information is generated with a higher numerical value than the actual state of the driver. In this case, the control unit 24 sets the first threshold value to be higher. Specifically, when the drowsiness level value at the time of obtaining the stop instruction is "5", the control unit 24 sets the first threshold value to "9". Also, when the drowsiness level value at the time of obtaining the stop instruction is "4", the control unit 24 sets the first threshold value to "8". Furthermore, when the drowsiness level value at the time of obtaining the stop instruction is "3", the control unit 24 sets the first threshold value to "7".

[0078] When the stimulation intensity is "weak" and the driver's drowsiness level value at the time of obtaining the stop instruction is "1", it is considered that the driver is in a more drowsy state than the assumed state. That is, the drowsiness level value generated based on the biological information is generated with a lower numerical value than the actual state of the driver. In this case, the control unit 24 sets the first threshold value to be lower. Specifically, when the drowsiness level value at the time of obtaining the stop instruction is "1", the control unit 24 sets the first threshold value to "5".

[0079] When the stimulation intensity is "strong", if the expected result is obtained, that is, when the sleepiness value at the time of receiving the stop instruction is "4", the control unit 24 performs a setting to maintain the current setting state.

[0080] When the stimulation intensity is "strong", if the sleepiness value of the driver at the time of obtaining the stop instruction is "5", it is considered that the driver is more awake than the assumed state. That is, the sleepiness value generated based on the biological information is generated as a higher value than the actual state of the driver. In this case, the control unit 24 sets the first threshold value to be higher. Specifically, when the sleepiness value at the time of obtaining the stop instruction is "5", the control unit 24 sets the first threshold value to "7".

[0081] When the stimulation intensity is "strong", if the sleepiness value of the driver at the time of obtaining the stop instruction is "1" to "3", it is considered that the driver is in a state of stronger sleepiness than the assumed state. That is, the sleepiness value generated based on the biological information is generated as a lower value than the actual state of the driver. In this case, the control unit 24 sets the first threshold value to be lower. Specifically, when the sleepiness value at the time of obtaining the stop instruction is "1", the control unit 24 sets the first threshold value to "3". Also, when the sleepiness value at the time of obtaining the stop instruction is "2", the control unit 24 sets the first threshold value to "4". Further, when the sleepiness value at the time of obtaining the stop instruction is "3", the control unit 24 sets the first threshold value to "5".

[0082] As described above, according to the stimulation control device 10 according to the present embodiment, when the driver performs a stop operation of the vibration generator VB, that is, based on the sleepiness value at the time of obtaining the stop instruction, the threshold value of the sleepiness value to be notified to the driver is set. Therefore, it is possible to promote the generation of stimulation in an appropriate state for the user. Accordingly, it is possible to give stimulation at an appropriate timing for the awakening of the user.

[0083] Further, the control unit 24 sets a threshold value of the drowsiness level value to be notified to the driver based on the intensity of the vibration of the vibration generator VB. For this reason, the control unit 24 can set a first threshold value according to the intensity of the vibration. Therefore, it becomes possible to prompt the generation of stimulation in an appropriate state for the user. Accordingly, it becomes possible to give stimulation at an appropriate timing for the awakening of the user.

Embodiment

[0084] The stimulation control device 10 of the fourth embodiment will be described. The stimulation control device 10 of the first embodiment sets a threshold value of the drowsiness level value, that is, a first threshold value, for notifying the driver to promote the use of the vibration generator VB based on the drowsiness level value when a stop instruction is acquired. The stimulation control device 10 of the fourth embodiment is different from the stimulation control device 10 of the first embodiment in that it sets a threshold value of the drowsiness level value for stopping the stimulation of the vibration generator VB, that is, a second threshold value, based on the drowsiness level value when the driver performs a stop operation of the vibration generator VB.

[0085] The control unit 24 can instruct the vibration generator VB to stop vibrating when the driver's drowsiness level value exceeds a second threshold value (hereinafter referred to as the second threshold value). That is, the second threshold value is the driver's drowsiness level value for stopping the stimulation of the vibration generator VB. The control unit 24 sets the second threshold value according to the driver's drowsiness level value when a stop instruction is acquired.

[0086] FIG. 7 shows an example of a table of the threshold value DB stored in the storage device 23. When an operation to stop the vibration of the vibration generator VB is performed by the driver, the control unit 24 receives a stop instruction. The control unit 24 sets the first threshold value and the second threshold value based on the drowsiness level value when the stop instruction is received.

[0087] As shown in FIG. 7, for example, the case where the first threshold value is set to "6" and the second threshold value is set to "3" will be described. When the control unit 24 obtains the expected result, that is, when the drowsiness level value when the stop instruction is received is "3", the control unit 24 performs a setting to maintain the setting state.

[0088] Also, when the driver's drowsiness level value at the time of obtaining the stop instruction is "5" or "4", the driver is considered to be more awake than the assumed state. That is, the drowsiness level value generated based on the biological information is generated with a higher numerical value than the actual state of the driver. In this case, the control unit 24 sets the first threshold value and the second threshold value to be higher. Specifically, when the drowsiness level value at the time of obtaining the stop instruction is "5", the control unit 24 sets the first threshold value to "8" and the second threshold value to "5". Also, when the drowsiness level value at the time of obtaining the stop instruction is "4", the control unit 24 sets the first threshold value to "7" and the second threshold value to "4".

[0089] Furthermore, when the driver's drowsiness level value at the time of obtaining the stop instruction is "1" or "2", the driver is considered to be in a state of stronger drowsiness than the assumed state. That is, the drowsiness level value generated based on the biological information is generated with a lower numerical value than the actual state of the driver. In this case, the control unit 24 sets the first threshold value and the second threshold value to be lower. Specifically, when the drowsiness level value at the time of obtaining the stop instruction is "1", the control unit 24 sets the first threshold value to "4" and the second threshold value to "1". Also, when the drowsiness level value at the time of obtaining the stop instruction is "2", the control unit 24 sets the first threshold value to "5" and the second threshold value to "2".

[0090] Figures 8 and 9 show the processing flow of the control unit 24. Note that the processing of steps S301 to S306 is the same as the processing of steps S101 to S106 described in FIG. 3, so the description is omitted.

[0091] As shown in FIGS. 8 and 9, the control unit 24 acquires biological information (step S307) and generates a drowsiness level value based on the biological information acquired in step S307 (step S308).

[0092] The control unit 24 determines whether the drowsiness level value generated in step S308 is less than the second threshold value (step S309). In the determination in step S309, when the control unit 24 determines that the drowsiness level value generated in step S308 is not less than the second threshold value (step S309: N), it determines whether a stop instruction has been acquired (step S310).

[0093] In the determination in step S310, when the control unit 24 determines that a stop instruction has been acquired (step S310: Y), it acquires the biological information at the time when the stop instruction was acquired (step S311). Based on the biological information acquired in step S311, the control unit 24 generates a drowsiness level value (step S312), and sets the first threshold value and the second threshold value based on the drowsiness level value (step S313).

[0094] In the determination in step S310, when the control unit 24 determines that a stop instruction has not been acquired (step S310: N), it returns to the process of acquiring the biological information in step S307.

[0095] In the determination in step S309, when the control unit 24 determines that the drowsiness level value generated in step S308 is less than and exceeds the second threshold value (step S309: Y), it transmits a stop instruction for vibration to the vibration generator VB (step S314). After the process in step S314, the control unit 24 stops the process.

[0096] As described above, according to the stimulation control device according to the present embodiment, when the driver performs a stop operation of the vibration generator VB, that is, based on the drowsiness level value at the time when the control unit 24 acquires the stop instruction, the threshold value of the drowsiness level value that promotes the use of the vibration generator VB is set. Therefore, it is possible to promote the generation of stimulation in an appropriate state for the user. Therefore, it is possible to give stimulation at an appropriate timing for the awakening of the user.

[0097] Also, according to the stimulation control device of this embodiment, based on the drowsiness level value when the driver performs the stop operation of the vibration generator VB, the control unit 24 sets the threshold value of the drowsiness level at which the stimulation of the vibration generator VB is stopped. Therefore, the vibration of the vibration generator VB can be stopped when the driver's wakefulness state is optimal. Therefore, it is possible to optimize the user experience of the driver.

[0098] In this way, when the drowsiness level value of the driver falls below the second threshold value, the control unit 24 sends a stop instruction to the vibration generator VB. Therefore, since the vibration of the vibration generator VB can be stopped without the driver performing a stop operation, it is possible to improve the convenience for the user.

[0099] Note that, based on the drowsiness level value when the control unit 24 acquires the start instruction, the second threshold value for stopping the vibration of the vibration generator VB may be set. In this case, when the drowsiness level value of the driver falls below the second threshold value, the control unit 24 sends a stop instruction to the vibration generator VB. Therefore, since the vibration of the vibration generator VB can be stopped without the driver performing a stop operation, it is possible to improve the convenience for the user.

Embodiment

[0100] The stimulation control device 10 of Embodiment 5 will be described. The stimulation control device 10 of the above-described embodiment stored the threshold value of the drowsiness level value to be notified to the driver, that is, the first threshold value, in the storage device 23. The stimulation control device 10 according to Embodiment 5 is different from the stimulation control device 10 of the above-described embodiment in that it acquires the first threshold value from an external device.

[0101] In this embodiment, a case where the first threshold value is acquired from the mobile terminal device 30 connected to the stimulation control device 10 will be described.

[0102] Figure 10 shows the configuration of the stimulation control device 10 according to Example 5. As shown in Figure 10, the communication unit 26 of the stimulation control device 10 is an interface unit that is communicably connected to the portable terminal device 30 by wireless means such as Bluetooth (registered trademark). Note that the communication with the stimulation control device 10 may be performed by wire instead.

[0103] The stimulation control device 10 is capable of communicating with the portable terminal device 30. Specifically, the control unit 24 can receive biometric information, a first threshold value, and a second threshold value transmitted from the portable terminal device 30. Further, the control unit 24 can transmit the first threshold value and the second threshold value set by the control unit 24 to the portable terminal device 30.

[0104] Figure 11 shows the configuration of the portable terminal device 30 connected to the stimulation control device 10 according to Example 5. The portable terminal device 30 is, for example, a wearable computer that can be worn on the driver's arm. The portable terminal device 30 may be any portable communication device capable of communicating with the stimulation control device 10 other than a wearable computer, and may be, for example, a smartphone. Further, the portable terminal device 30 may be a combination of a wearable computer and a portable communication device.

[0105] As shown in Figure 11, the input unit 40 is an interface unit that is connected to be able to acquire data from the biological sensor BS. The portable terminal device 30 receives data from the biological sensor BS via the input unit 40.

[0106] The biological sensor BS is a sensor that acquires the biological information of a driver who drives an automobile. The biological sensor BS is, for example, incorporated in a wearable computer. The biological sensor BS is a pulse meter that measures the driver's pulse per a predetermined time.

[0107] In addition to the driver's pulse, the biological sensor BS may measure biological information such as the driver's body temperature, blood pressure, respiration rate per a predetermined time, blink rate per a predetermined time, and yawn rate per a predetermined time.

[0108] Furthermore, the biological sensor BS does not necessarily have to be a device incorporated into the wearable computer. For example, the biological sensor BS may analyze information obtained from an image of a camera mounted on an automobile to generate biological information. For example, when the biological sensor BS measures the respiration rate of the driver, the biological sensor BS is a measuring instrument that measures the vertical movement of the driver's chest wall photographed by the camera. When measuring the number of blinks of the driver, the biological sensor BS is a measuring instrument that measures the vertical movement of the driver's eyelids photographed by the camera.

[0109] The communication unit 42 is an interface unit that is communicably connected to the stimulation control device 10 by wire or wirelessly. The mobile terminal device 30 can communicate with the stimulation control device 10.

[0110] The storage device 43 is constituted by, for example, a hard disk device, an SSD (Solid State Drive), a flash memory, etc. The storage device 23 stores various programs such as BIOS (Basic Input Output System) and software.

[0111] In addition, the storage device 43 can store information for generating information on the degree of drowsiness of the driver from the biological information and a first threshold value that is a threshold value of the degree of drowsiness of the driver for giving a notification to prompt the use of the vibration generator VB. Further, the storage device 43 can store a threshold value of the degree of drowsiness for stopping the stimulation of the vibration generator VB, that is, a second threshold value. Specifically, the storage device 43 stores the first threshold value and the second threshold value, which are initial setting values, in the threshold value DB. Note that the threshold value DB is not limited to the first threshold value and the second threshold value that are initial setting values, and may store, for example, the first threshold value and the second threshold value transmitted from the stimulation control device 10.

[0112] The control unit 44 is implemented by a computer having a CPU (Central Processing Unit) 44a as an arithmetic processing unit, a ROM (Read Only Memory) 44b as a main storage device, and a RAM (Random Access Memory) 44c. The CPU 44a reads a program corresponding to the processing content from the ROM 44b or the storage device 43 and expands it in the RAM 44c, and realizes various functions in cooperation with the expanded program.

[0113] Each of the input unit 40, the communication unit 42, the storage device 43, and the control unit 44 is connected to each other via a system bus 45.

[0114] The control unit 44 can acquire the biometric information of the driver received via the input unit 40.

[0115] The control unit 44 can transmit the biometric information and the first threshold value to the stimulation control device 10. Further, the control unit 44 can transmit to the stimulation control device 10 the threshold value of the drowsiness level for stopping the stimulation of the vibration generator VB, that is, the second threshold value. Furthermore, the control unit 44 can transmit the identification information of the portable terminal device 30 to the stimulation control device 10.

[0116] The control unit 44 can receive from the stimulation control device 10 the first threshold value and the second threshold value updated by the stimulation control device 10. Further, the control unit 44 can store the received first threshold value and second threshold value in the storage device 43.

[0117] FIG. 12 is a flowchart showing the processing of the portable terminal device 30. As shown in FIG. 12, the control unit 44 determines whether communication with the stimulation control device 10 has been established (step S401). In the determination of step 401, if the control unit 44 determines that communication with the stimulation control device 10 has not been established, the process ends.

[0118] When the control unit 44 determines that communication has been established with the stimulation control device 10 (step S401: Y), it reads the first threshold value from the threshold value database of the storage device 43 and transmits it to the mobile terminal device 30 (step S402). In step S403, the control unit 44 functions as a transmission means for transmitting the biological information and the first threshold value to the stimulation control device 10. In addition, in the process of step S403, the control unit 44 transmits the second threshold value and the identification information of the mobile terminal device 30.

[0119] The control unit 44 starts to sequentially transmit the driver biological information acquired by the stimulation control device 10 to the mobile terminal device 30 (step S403). In step S403, the control unit 44 functions as a biological information acquisition means for acquiring the biological information of the driver.

[0120] The control unit 44 determines whether it has received a transmission stop instruction, which is an instruction to stop the transmission of the biological information, from the mobile terminal device 30 (step S404). In step S404, the control unit 44 functions as a reception means for receiving the first threshold value updated by the stimulation control device 10 from the stimulation control device 10. The determination in step S404 is repeated until a transmission stop instruction is received (step S404: N).

[0121] When the control unit 44 receives a transmission stop instruction (step S404: Y), it stops the transmission of the biological information (step S405).

[0122] The control unit 44 determines whether it has received the first threshold value from the mobile terminal device 30 (step S406). The determination in step S406 is repeated until the first threshold value is received (step S406: N).

[0123] When the control unit 44 receives the first threshold value (step S406: Y), it sets the received first threshold value (step S407). In step S407, the control unit 44 functions as a storage means for storing the first threshold value.

[0124] Figures 13 and 14 show the processing of the stimulation control device 10. As shown in FIGS. 12 and 13, the control unit 24 acquires the first threshold value and the second threshold value transmitted from the mobile terminal device 30 (step S501). At this time, the control unit 24 receives the identification information of the mobile terminal device 30. Thereby, the control unit 24 can set the first threshold value and the second threshold value for each identification information of the mobile terminal device 30.

[0125] The control unit 24 starts receiving biometric information (step S502). The processing from the subsequent step S503 to step S512 is the same as the processing of steps S302 to 312 in FIG. 8, so the description thereof is omitted.

[0126] The control unit 24 transmits a transmission stop instruction for stopping the transmission of biometric information to the mobile terminal device 30 (step S513).

[0127] The control unit 24 sets the first threshold value and the second threshold value based on the drowsiness degree value generated in step S512 (step S514).

[0128] The control unit 24 transmits the first threshold value and the second threshold value set in step S514 to the mobile terminal device 30 (step S515).

[0129] As described above, according to the stimulation control device 10 and the mobile terminal device 30 of this embodiment, the stimulation control device 10 acquires the first threshold value and the second threshold value stored in the mobile terminal device 30. That is, the mobile terminal device 30 stores the first threshold value and the second threshold value of its owner. Therefore, even when the owner of the mobile terminal device 30 changes the vehicle, it is possible to prompt the driver to use the vibration generator VB using the unique first threshold value of the owner of the mobile terminal device 30. That is, regardless of the moving body on which the driver rides, the use of the vibration generator VB can be prompted based on the unique first threshold value. For example, even when the owner of the mobile terminal device 30 uses a rental car, it is possible to prompt the driver to use the vibration generator VB using the unique first threshold value of the owner of the mobile terminal device 30. Therefore, it is possible to give a stimulus at an appropriate timing for the user's awakening.

[0130] In addition, in this embodiment, the stimulation control device 10 generates a drowsiness degree value of the driver based on the biological information. However, the generation of the drowsiness degree value of the driver may be performed by the mobile terminal device 30. When the mobile terminal device 30 is configured in this way, the mobile terminal device 30 may transmit a drowsiness degree value generated by the mobile terminal device 30 to the stimulation control device 10 instead of the biological information. Further, the stimulation control device 10 may perform the processing shown in FIG. 11 based on the received drowsiness degree value, the first threshold value, and the second threshold value.

[0131] Also, in this embodiment, the first threshold value is stored in the storage device 43 of the mobile terminal device 30. However, the first threshold value and the second threshold value may be stored in cloud computing such as online storage.

[0132] When the first threshold value and the second threshold value are stored in cloud computing, the mobile terminal device 30 downloads the first threshold value and the second threshold value uploaded to cloud computing in advance, and temporarily stores the first threshold value and the second threshold value in the storage device 43. The mobile terminal device 30 reads the first threshold value and the second threshold value from the storage device 43 and transmits them to the stimulation control device 10. When the mobile terminal device 30 receives the first threshold value and the second threshold value from the stimulation control device 10, it temporarily stores the received first threshold value and second threshold value in the storage device 43 and uploads them to cloud computing. Cloud computing resets the uploaded first threshold value and second threshold value.

Explanation of Signs

[0133] 10 Stimulation control device 24 Control unit 30 Mobile terminal device 44 Control unit VB Vibration generator

Claims

1. A biological information acquisition means for acquiring the biological information of the user, A transmission means for transmitting the biological information and the first threshold value to a stimulation control device that starts assisting the awakening of the user when a numerical value generated based on the biological information of the user exceeds the first threshold value, A storage means for storing the first threshold value, A mobile terminal device characterized by comprising the above.

2. The mobile terminal device according to claim 1, wherein the numerical value is a numerical value related to the degree of drowsiness of the user.

3. Having a receiving means for receiving the first threshold value updated by the stimulation control device from the stimulation control device, The mobile terminal device according to claim 1 or 2, wherein when the storage means receives the updated first threshold value received by the receiving means, the storage means stores the updated first threshold value.

4. When the numerical value exceeds a second threshold value, the transmission means transmits the second threshold value to the stimulation control device that stops assisting awakening, The mobile terminal device according to any one of claims 1 to 3, wherein the storage means stores the second threshold value.

5. Having a receiving means for receiving the second threshold value updated by the stimulation control device from the stimulation control device, The mobile terminal device according to claim 4, wherein when the storage means receives the updated second threshold value received by the receiving means, the storage means stores the updated second threshold value.

6. The mobile terminal device according to any one of claims 1 to 5, wherein the transmission means transmits identification information of the mobile terminal device to the stimulation control device.

7. The transmission means transmits the biological information and the first threshold value to the in-vehicle stimulation control device, The mobile terminal device according to claim 3 or 5, wherein the receiving means receives the first threshold value updated by the in-vehicle stimulation control device from the stimulation control device.

8. An information processing method executed by a mobile terminal device, A step of storing the first threshold value of a stimulation control device that starts assisting the awakening of the user when a numerical value generated based on the biological information of the user exceeds the first threshold value, A step of acquiring the biological information of the user, A step of transmitting the biological information and the first threshold value to the stimulation control device, An information processing method characterized by comprising the above.

9. To a computer, A step of storing the first threshold value of the stimulation control device that starts assisting the arousal of the user when a numerical value generated based on the user's biological information exceeds the first threshold value; A step of acquiring the biological information of the user; A step of transmitting the biological information and the first threshold value to the stimulation control device; A program for causing the above to be executed.

10. On a computer, A step of storing the first threshold value of the stimulation control device that starts assisting the arousal of the user when a numerical value generated based on the user's biological information exceeds the first threshold value; A step of acquiring the biological information of the user; A step of transmitting the biological information and the first threshold value to the stimulation control device; A recording medium storing a program for causing the above to be executed.

Citation Information

Patent Citations

  • breathalyzer

    JP2009020683A

  • Awakening support device

    JP2011159108A

  • Detection device for vehicle obstacle or the like

    JP2012064080A

  • Mobile terminal, method for transmitting position information, and program

    JP2015109580A

  • Search device, search method, search program and record medium, and navigation device

    JP2017157070A