Driver drowsiness prevention system, computer, terminal, driver drowsiness prevention method and program
The driver drowsiness prevention system addresses the inadequacy of existing systems by analyzing biometric data to determine sleep likelihood and dynamically applying preventive measures, effectively reducing the risk of accidents.
Patent Information
- Application Number
- JP2021550929
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2019-10-04
- Publication Date
- 2024-11-27
- Estimated Expiration
- 2039-10-04
AI Technical Summary
Existing systems fail to effectively prevent drivers from falling asleep while driving by merely determining dozing off and do not implement preventive measures to address the risk of traffic accidents.
A driver drowsiness prevention system that acquires biometric information, analyzes the likelihood of falling asleep, and selects and executes preventive measures from a variety of options based on the determined level, rotating measures to ensure effectiveness.
The system effectively prevents drivers from falling asleep by dynamically selecting and applying appropriate preventive measures, enhancing safety by reducing the risk of traffic accidents.
Smart Images

Figure 0007590976000001 
Figure 0007590976000002 
Figure 0007590976000003
Abstract
Description
[Technical field]
[0001] The present invention provides a method for selecting a preventive measure to prevent a driver from falling asleep while driving. Run The present invention relates to a driver drowsiness prevention system, a computer, a terminal, a driver drowsiness prevention method, and a program. [Background technology]
[0002] In recent years, the harsh working conditions of drivers have become a social issue, and there have been an increasing number of news reports of drivers falling asleep while driving and causing traffic accidents. For this reason, technology to prevent drivers from falling asleep while driving has attracted attention.
[0003] As an example of such technology, there is disclosed a technology that detects the pulse rate of a driver while driving and determines whether the driver is drowsy (see Patent Document 1). [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2011-248850 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, in order to prevent traffic accidents caused by the driver falling asleep while driving, it is not enough to simply determine the driver's drowsy state. Also, the configuration of Patent Document 1 merely determines the driver's drowsy state and is not intended to prevent the driver from falling asleep, so it is difficult to prevent the driver from falling asleep.
[0006] The present invention acquires biometric information of a driver while driving, determines the level to which the driver is likely to fall asleep while driving, and selects a prevention measure according to this level from among a plurality of prevention measures for preventing the driver from falling asleep. RunThe present invention aims to provide a system, a computer, a terminal, a method and a program for preventing a driver from falling asleep while driving, which are capable of preventing a driver from falling asleep while driving. [Means for solving the problem]
[0007] The present invention provides the following solutions.
[0008] The present invention provides a method for selecting a preventive measure to prevent a driver from falling asleep while driving. Run A driver drowsiness prevention system comprising: An acquisition means for acquiring biometric information of the driver; A determination means for determining a level at which the driver is likely to fall asleep while driving by analyzing the acquired biological information; Among the multiple prevention measures to prevent drowsiness, according to the determined level , Complex according to level number Prevention Identify preventative measures , randomly, before Level-specific complex Select one of the plurality of preventive measures, determine whether the selected one of the preventive measures has already been selected within a predetermined interval, and if so, exclude the selected one of the preventive measures. The above-mentioned level-specific complex One of the prevention measures is selected again according to the level. Multiple prevention All of the measures If selected , randomly, Depending on the level Multiple Select one of the preventive measures and load the preventive measure for preventing drowsiness at a predetermined interval. Teshi A selection means for selecting the an execution means for executing the selected one of the prevention measures; The present invention provides a driver drowsiness prevention system comprising:
[0009] According to the present invention, a driver drowsiness prevention system that selects and executes preventive measures to prevent a driver from falling asleep while driving acquires biometric information of the driver, analyzes the acquired biometric information, determines a level at which the driver is likely to fall asleep while driving, and selects one of a plurality of preventive measures to prevent the driver from falling asleep depending on the determined level. , Complex according to level number Prevention Identify preventative measures , randomly, before Level-specific complex Select one of the plurality of preventive measures, determine whether the selected one of the preventive measures has already been selected within a predetermined interval, and if so, exclude the selected one of the preventive measures. The above-mentioned level-specific complex A prevention measure is selected again from among the plurality of prevention measures, and a plurality of prevention measures corresponding to the level are selected. All of the measures If selected , randomly, Depending on the level Multiple Select one of the preventive measures and load the preventive measure for preventing drowsiness at a predetermined interval. Teshi The selected one of the prevention measures is then executed.
[0010] Although the present invention is in the category of a system, similar functions and effects according to other categories such as a method and a program are also exhibited.
[0011] The present invention also provides a computer for selecting and executing a preventive measure for preventing a driver from falling asleep while driving, comprising: An acquisition means for acquiring biometric information of the driver; A determination means for determining a level at which the driver is likely to fall asleep while driving by analyzing the acquired biological information; Among the multiple prevention measures to prevent drowsiness, according to the determined level , Complex according to level number Prevention Identify preventative measures , randomly, before Level-specific complex Select one of the plurality of preventive measures, determine whether the selected one of the preventive measures has already been selected within a predetermined interval, and if so, exclude the selected one of the preventive measures. The above-mentioned level-specific complexOne of the prevention measures is selected again according to the level. Multiple prevention All of the measures If selected , randomly, Depending on the level Multiple Select one of the preventive measures and load the preventive measure for preventing drowsiness at a predetermined interval. Teshi A selection means for selecting the an execution means for executing the selected one of the prevention measures; The present invention provides a computer comprising:
[0012] The present invention also provides a terminal for selecting and executing a preventive measure for preventing a driver from falling asleep while driving, comprising: The driver's biological information is analyzed, and among a plurality of preventive measures for preventing drowsiness, a measure is specified according to a result of determining a level at which the driver is likely to fall asleep while driving. Complex according to the level Among the number of prevention measures , randomly selected Implementing the selected one of the preventive measures, and excluding the selected one of the preventive measures if it is determined that the selected one of the preventive measures has already been selected within a predetermined interval. The above-mentioned level-specific complex One of the measures is then selected according to the level. Multiple prevention All of the measures If selected , randomly, One preventive measure selected from a plurality of preventive measures corresponding to the level is executed, and the preventive measure for preventing drowsiness is loaded at a predetermined interval. Teshi An execution means for executing the program; The present invention provides a terminal comprising: Effect of the Invention
[0013] According to the present invention, biometric information of a driver while driving is acquired, the level to which the driver is likely to fall asleep while driving is determined, and a preventive measure corresponding to this level is selected from among a plurality of preventive measures for preventing the driver from falling asleep. Run It is therefore possible to provide a driver drowsiness prevention system, a computer, a terminal, a driver drowsiness prevention method, and a program that can prevent the driver from drowsing. [Brief description of the drawings]
[0014] [Figure 1] FIG. 1 is a diagram showing an overview of a driver drowsiness prevention system 1. As shown in FIG. [Diagram 2] FIG. 2 is a diagram showing the overall configuration of the driver drowsiness prevention system 1. As shown in FIG. [Diagram 3] FIG. 3 is a flowchart showing a process for executing measures to prevent drowsiness, which is executed by the computer 10. As shown in FIG. [Figure 4] FIG. 4 is a flowchart showing the process of executing measures to prevent drowsiness, which is executed by the computer 10. As shown in FIG. [Diagram 5] FIG. 5 is a diagram showing an example of the prevention measures database recorded by the computer 10. As shown in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0015] Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings. Note that this is merely an example, and the technical scope of the present invention is not limited to this example.
[0016] [Outline of Driver Drowsiness Prevention System 1] An outline of a preferred embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 is a diagram for explaining an outline of a driver drowsiness prevention system 1 according to a preferred embodiment of the present invention. The driver drowsiness prevention system 1 is composed of a computer 10, and selects preventive measures to prevent a driver from falling asleep while driving. Run It is a computer system.
[0017] The driver dozing prevention system 1 may include a driver terminal carried or worn by the driver (for example, a mobile terminal such as a smartphone or tablet terminal, or a wearable terminal such as a head-mounted display such as smart glasses), sensors for detecting various information, a photographing device for photographing images such as video or still images of the vehicle driven by the driver and the driver's face and body, a measuring device for measuring the driver's biological information (for example, heart rate, body temperature, pulse rate), an output device for outputting messages and images on the windshield of the vehicle, a stimulus generating device for giving some kind of stimulus (for example, vibration, odor, sound) to the driver, and other terminals and devices. In this case, the driver dozing prevention system 1 executes each process described below by using the computer 10 and any one or a combination of the included terminals and devices.
[0018] Furthermore, the driver drowsiness prevention system 1 may be realized by a single computer such as the computer 10, or may be realized by a plurality of computers such as cloud computers.
[0019] The computer 10 is connected to a driver's terminal, sensors, a vehicle, a photographing device, a measuring device, an output device, a stimulus generating device, and other terminals and devices, etc., via a public line network, etc., so as to be able to communicate data with them, and transmits and receives the necessary data and information.
[0020] The computer 10 acquires biometric information of the driver while driving. The biometric information includes, for example, heart rate, body temperature, and pulse rate.
[0021] For example, sensors provided in the vehicle (on the steering wheel or seat) or a driver terminal worn by the driver measure the driver's biological information while driving. The sensors and the driver terminal transmit the measured biological information to the computer 10. The computer 10 receives this biological information to obtain the biological information of the driver while driving.
[0022] Also, for example, a photographing device provided inside the vehicle photographs an image of the face and body of the driver while driving. The photographing device transmits the image to the computer 10. The computer 10 receives the image and performs image analysis. The computer 10 estimates biometric information of the driver while driving based on the result of the image analysis. The computer 10 acquires the estimated biometric information as the biometric information of the driver.
[0023] The computer 10 analyzes the acquired biological information to determine the level at which the driver is likely to fall asleep while driving. The level at which the driver is likely to fall asleep is a numerical representation of the driver's degree of drowsiness, and the higher the numerical value, the higher the degree of drowsiness.
[0024] For example, the computer 10 analyzes the values of heart rate, body temperature, and pulse rate in the biometric information. The computer 10 determines the level based on the values in the biometric information. The computer 10 determines the level that corresponds to the current analysis result by referring to a level determination database that previously records the contents and values of the biometric information in association with the levels.
[0025] The computer 10 selects a preventive measure from among a plurality of preventive measures for preventing drowsiness according to the determined level. The preventive measures include, for example, measures that stimulate the driver's five senses or measures that control the vehicle itself.
[0026] For example, the computer 10 refers to a preventive measures database in which levels and preventive measures are recorded in advance in association with each other, and selects a preventive measure according to the currently determined level.
[0027] The computer 10 may be configured to select preventive measures by rotating them at predetermined intervals.
[0028] For example, when the computer 10 selects a preventive measure next time or later, if the period between the current time and the next time is a predetermined interval, the computer 10 will select a preventive measure that is different from the preventive measure selected this time.
[0029] The computer 10 causes the selected prevention measures to be implemented.
[0030] For example, the computer 10 transmits a command to execute the selected preventive measure to a terminal or device corresponding to the selected preventive measure. The terminal or device receives the command and executes the preventive measure selected by the computer 10 according to the command. As a result, the computer 10 executes the selected preventive measure, and the driver drowsiness prevention system 1 executes the selected preventive measure.
[0031] The computer 10 may be configured to learn which of the implemented preventive measures prevented the driver from falling asleep and which of the implemented preventive measures caused the driver to fall asleep.
[0032] For example, the computer 10 learns whether or not the driver was prevented from falling asleep as a result of executing the preventive measures, by associating this result with whether or not the driver was prevented from falling asleep. When selecting preventive measures from the next time onwards, the computer 10 selects the preventive measures according to the determined level and the result of this learning.
[0033] Next, an overview of the processing executed by the driver drowsiness prevention system 1 will be described.
[0034] The computer 10 acquires biometric information of the driver while driving (step S01). The biometric information is as described above.
[0035] A sensor provided in the vehicle or a driver terminal worn by the driver measures the driver's biological information while driving. The sensor or the driver terminal transmits the measured biological information to the computer 10. The computer 10 receives the biological information and thereby acquires the biological information of the driver while driving.
[0036] An image capturing device provided inside the vehicle captures images of the face and body of the driver while driving. The image capturing device transmits the images to the computer 10. The computer 10 receives the images and performs image analysis. As part of the image analysis, the computer 10 extracts feature points (e.g., shape, contour, hue) and feature amounts (e.g., statistical values such as average, variance, histogram, etc. of pixel values). The computer 10 estimates biometric information of the driver while driving based on the extracted feature points and feature amounts. The computer 10 acquires the estimated biometric information as the biometric information of the driver.
[0037] The computer 10 analyzes the acquired biological information (step S02). For example, the computer 10 analyzes the values of the heart rate, body temperature, and pulse rate in the biological information.
[0038] The computer 10 determines the level at which the driver is likely to fall asleep while driving based on the analysis result of the biological information (step S03). This level is as described above.
[0039] The computer 10 refers to the level determination database described above to determine this level. The computer 10 determines the level that corresponds to the value in the currently acquired biological information.
[0040] The computer 10 selects a preventive measure from among a plurality of preventive measures for preventing drowsiness, depending on the determined level (step S04). The preventive measures are as described above.
[0041] The computer 10 refers to the above-mentioned prevention countermeasure database and selects this prevention countermeasure. The computer 10 selects the prevention countermeasure according to the currently determined level.
[0042] The computer 10 executes the selected preventive measure (step S05).
[0043] The computer 10 creates a command for a terminal or device corresponding to the selected preventive measure to execute the preventive measure. The computer 10 transmits the created command to the terminal or device. The terminal or device receives the command. The terminal or device executes the preventive measure according to the command. As a result, the computer 10 executes the selected preventive measure, and the driver drowsiness prevention system 1 executes the selected preventive measure.
[0044] The above is an outline of the process executed by the driver drowsiness prevention system 1.
[0045] [System configuration of driver drowsiness prevention system 1] A system configuration of a driver drowsiness prevention system 1 according to a preferred embodiment of the present invention will be described with reference to Fig. 2. Fig. 2 is a diagram showing the system configuration of a driver drowsiness prevention system 1 according to a preferred embodiment of the present invention. In Fig. 2, the driver drowsiness prevention system 1 is composed of a computer 10, and selects preventive measures to prevent the driver from falling asleep while driving. Run It is a computer system.
[0046] The computer 10 is connected to a driver's terminal, sensors, a vehicle, a photographing device, a measuring device, an output device, a stimulus generating device, and other terminals and devices, etc., via a public line network, etc., so as to be able to communicate data with them, and transmits and receives the necessary data and information.
[0047] The driver doze prevention system 1 may include a driver terminal, sensors, a vehicle, a photographing device, a measuring device, an output device, a stimulus generating device, and other terminals and devices, which are not shown in the figure. In this case, the driver doze prevention system 1 executes each process described below by using the computer 10 and one or a combination of the included terminals and devices.
[0048] Furthermore, the driver drowsiness prevention system 1 may be realized by a single computer such as the computer 10, or may be realized by a plurality of computers such as cloud computers.
[0049] Furthermore, the driver drowsiness prevention system 1 may be realized by a single computer such as the computer 10, or may be realized by a plurality of computers such as cloud computers.
[0050] The computer 10 includes a central processing unit (CPU), a graphics processing unit (GPU), a random access memory (RAM), a read only memory (ROM), and a communication unit including a device for enabling communication with other terminals and devices, such as a wireless fidelity (Wi-Fi) device conforming to IEEE802.11. The computer 10 also includes a data storage unit such as a hard disk, semiconductor memory, recording medium, memory card, and the like, as a recording unit. The computer 10 also includes a processing unit including various devices for executing various processes.
[0051] In computer 10, the control unit reads a predetermined program, thereby working in cooperation with the communication unit to realize a biometric information acquisition module 20 and a prevention measure execution module 21. In addition, in computer 10, the control unit reads a predetermined program, thereby working in cooperation with the recording unit to realize a recording module 30. In computer 10, the control unit reads a predetermined program, thereby working in cooperation with the processing unit to realize an analysis module 40, a judgment module 41, a selection module 42, a command creation module 43, a prevention judgment module 44, and a learning module 45.
[0052] [Execution process of measures to prevent drowsiness] The process of executing measures to prevent dozing at the wheel, which is executed by the driver dozing at the wheel prevention system 1, will be described with reference to Fig. 3 and Fig. 4. Fig. 3 and Fig. 4 are diagrams showing flowcharts of the process of executing measures to prevent dozing at the wheel, which is executed by the computer 10. The processes executed by each of the above-mentioned modules will be described together with this process.
[0053] First, the biometric information acquisition module 20 acquires biometric information of the driver while driving (step S10). In step S10, the biometric information is the driver's heart rate, body temperature, pulse rate, etc., as described above. The biometric information acquisition module 20 acquires biometric information measured by a terminal or device, or acquires an estimated result based on an image captured by an imaging device as the biometric information. In the following description, the biometric information acquisition module 20 will be described as acquiring the heart rate as the biometric information. It goes without saying that the present invention can be applied to information other than the heart rate.
[0054] A case where the biometric information acquisition module 20 acquires biometric information measured by a terminal or device will be described.
[0055] Sensors provided on the steering wheel or seat, or a driver terminal or measuring device worn by the driver, measure the driver's heart rate while driving. These terminals and devices transmit the measured heart rate as biometric information to the computer 10. The biometric information acquisition module 20 receives the heart rate and thereby acquires the biometric information.
[0056] A case where the biometric information acquisition module 20 acquires biometric information based on an image captured by an image capture device will be described.
[0057] The photographing device photographs the face and body of the driver while driving. The photographing device transmits the photographed image to the computer 10 as image information. The biometric information acquisition module 20 receives the image information. The biometric information acquisition module 20 performs image analysis on the image of the driver while driving based on the image information, and extracts feature points and feature amounts of the image. The biometric information acquisition module 20 identifies pulse wave information based on the extracted feature points and feature amounts. The biometric information acquisition module 20 estimates the driver's heart rate based on the identified pulse wave information. The biometric information acquisition module 20 acquires the estimated heart rate as biometric information.
[0058] The biometric information acquisition module 20 may acquire biometric information by a method other than the above-mentioned example.
[0059] The analysis module 40 analyzes the acquired biological information (step S11). In step S11, the analysis module 40 analyzes the heart rate, which is the acquired numerical value of the heart rate. The analysis module 40 analyzes the heart rate per unit time.
[0060] The analysis module 40 may analyze the biological information by a method other than the above-mentioned example.
[0061] The determination module 41 determines the level at which the driver is likely to fall asleep while driving based on the analysis result of the acquired biological information (step S12). In step S12, the level at which the driver is likely to fall asleep while driving is a numerical representation of the driver's degree of drowsiness, with a higher numerical value indicating a higher degree of drowsiness and a lower numerical value indicating a lower degree of drowsiness.
[0062] The determination module 41 refers to a level determination database recorded in advance by the recording module 30 and determines this level. The level determination database is a database in which the contents and values of biometric information are registered in association with this level. The determination module 41 compares the heart rate, which is the biometric information determined this time, with the heart rates registered in the level determination database, and identifies those that match or are close to each other. In this case, if there are similar levels, the determination module 41 identifies the higher level as the close one. The determination module 41 determines this identified level as the level at which the driver is likely to fall asleep while driving.
[0063] If the value of the analyzed biological information does not match or approximate any of the values registered in the level determination database, the determination module 41 determines that the level is 0. If the determination module 41 determines that the level is 0, the computer 10 determines that the driver is not drowsy, and ends this process.
[0064] The selection module 42 selects a preventive measure from among a plurality of preventive measures for preventing drowsiness, according to the level determined this time (step S13). In step S13, the selection module 42 refers to a preventive measure database recorded in advance by the recording module 30, and selects this preventive measure. The preventive measure database is a database in which the level at which the driver is likely to fall asleep and preventive measures for preventing the driver from falling asleep are registered in association with each other. This preventive measure is to give some kind of stimulation to the driver's five senses or to control the vehicle itself. The preventive measures include generating a sound similar to a heartbeat for the driver, giving some kind of stimulation to the driver (e.g., seat vibration, odor generation, explosion sound, unpleasant sound), projecting a message (e.g., support from family, warning of risks or traffic accidents caused by falling asleep, notification that the driver is about to fall asleep) on the windshield, projecting an image (e.g., family, the driver's state when the driver was about to fall asleep in the past, victims of traffic accidents and vehicles) on the windshield, and slowing down or stopping the vehicle.
[0065] The preventive measures are not limited to the above-mentioned examples, and can be modified as appropriate.
[0066] [Preventive Measures Database] Based on FIG. 5, the prevention measures database recorded by the recording module 30 will be described. FIG. 5 is a diagram showing an example of the prevention measures database. In FIG. 5, the prevention measures database is registered with a level and a prevention measure associated with each other. In the prevention measures database, a plurality of prevention measures are registered with each level associated with each other. In level 1, "emitting a sound similar to a heart sound" is registered as the first prevention measure, and "vibrating the seat" is registered as the second prevention measure. In level 2, "projecting a message on the windshield" is registered as the first prevention measure, and "issuing an alert from a smartphone" is registered as the second prevention measure. In level 3, "projecting an image on the windshield" is registered as the first prevention measure, and "generating an unpleasant sound" is registered as the second prevention measure. In level 4, "generating an explosion sound" is registered as the first prevention measure, and "generating an odor" is registered as the second prevention measure. In level 5, "stopping the vehicle" is registered as the first prevention measure. In the preventive measures database, the higher the level, the more the preventive measures that are more effective in waking up the driver from drowsiness are associated with the higher the level. That is, the preventive measures database registers preventive measures according to the degree of drowsiness of the driver.
[0067] In addition, each prevention measure is linked to a terminal or device that executes the prevention measure, although not shown. "Emitting a sound similar to a heartbeat" is linked to a driver terminal or a speaker of the vehicle driven by the driver. "Vibrating the seat" is linked to a stimulus generating device provided on the seat of the vehicle driven by the driver. "Projecting a message on the windshield" is linked to the windshield of the vehicle driven by the driver and an output device that outputs a message on the windshield. "Giving an alert from a smartphone" is linked to a driver terminal. "Projecting an image on the windshield" is linked to the windshield of the vehicle driven by the driver and an output device that outputs an image on the windshield. "Generating an unpleasant sound" is linked to a driver terminal or a speaker of the vehicle driven by the driver. "Generating an explosion sound" is linked to a driver terminal or a speaker of the vehicle driven by the driver. "Generating an odor" is linked to a stimulus generating device provided on the vehicle driven by the driver. "Stop vehicle" is linked to the vehicle that the driver is driving.
[0068] The levels and the contents of the preventive measures registered in the preventive measures database are not limited to the above-mentioned examples and can be changed as appropriate. The number of levels and preventive measures is also not limited to the above-mentioned examples and can be changed as appropriate.
[0069] The selection module 42 compares the currently determined level with the levels registered in the prevention countermeasure database, and identifies a match. The selection module 42 identifies a plurality of prevention countermeasures associated with the identified level. The selection module 42 selects one prevention countermeasure from among the plurality of prevention countermeasures based on a predetermined condition (e.g., random, a preset order).
[0070] An example in which the selection module 42 selects one prevention measure will be specifically described.
[0071] When the currently determined level is 2, the selection module 42 refers to the prevention measures database and identifies a prevention measure associated with the currently determined level, level 2. As a result, the selection module 42 identifies "projecting a message on the windshield" and "issuing an alert from a smartphone" as the prevention measures. The selection module 42 randomly selects one of these two prevention measures.
[0072] The selection module 42 judges whether the currently selected preventive measure has been selected within a predetermined interval (step S14). In step S14, the selection module 42 judges whether the currently selected preventive measure has already been selected within a predetermined interval, such as within one hour, within several hours, within one day, within several days, etc. When the selection module 42 judges that the currently selected preventive measure has been selected within the predetermined interval (step S14 YES), the selection module 42 reselects a preventive measure from among the preventive measures corresponding to the currently determined level among a plurality of preventive measures for preventing dozing off, excluding the preventive measure selected by the above-mentioned processing of step S13 (step S15). The processing of step S15 is substantially similar to the processing of step S13, but differs in that a preventive measure corresponding to the level is selected from among preventive measures other than the preventive measure selected by the above-mentioned processing of step S13. That is, the processing of step S15 selects one preventive measure from among the preventive measures not selected by the selection module 42.
[0073] After executing the process of step S15, the computer 10 executes the process of step S14 again. Here, if the selection module 42 determines that the currently selected preventive measure has not been selected within a predetermined interval, it executes the process of step S16 described later.
[0074] On the other hand, when the selection module 42 determines that the preventive measures selected this time were selected within a predetermined interval, it executes the process of step S15 described above again. When the computer 10 determines that all preventive measures corresponding to the determined level have been selected within a predetermined interval as a result of repeating these processes, it selects one preventive measure from among the multiple preventive measures based on a predetermined condition (e.g., random, a preset order) and executes the process of step S16 described below according to the selected one preventive measure. In other words, when all preventive measures corresponding to the determined level have been selected within a predetermined period, the computer 10 selects one preventive measure according to the above-mentioned predetermined condition, regardless of whether it has been selected in the past or not.
[0075] As a result, the computer 10 selects preventive measures by rotating them at predetermined intervals.
[0076] On the other hand, if it is determined in step S14 that the currently selected preventive measure has not been selected within a predetermined interval (step S14 NO), the command creation module 43 creates a command for causing the terminal, device, or vehicle to execute the selected preventive measure (step S16). In step S16, the command creation module 43 creates a command required for the terminal, device, or vehicle linked to the selected preventive measure to execute this preventive measure.
[0077] Based on the above example, the process executed by the command creation module 43 will be described.
[0078] When "emit a sound similar to a heart sound" is selected as a preventive measure, the command creation module 43 creates a command required for the driver terminal or the vehicle to output a sound similar to a heart sound that has been recorded in advance. When "vibrate the seat" is selected as a preventive measure, the command creation module 43 creates a command required for the stimulus generating device to generate vibration. When "project a message on the windshield" is selected as a preventive measure, the command creation module 43 creates a command required for the output device or the vehicle to project a message that has been recorded in advance on the windshield. When "issue an alert from a smartphone" is selected as a preventive measure, the command creation module 43 creates a command required for the driver terminal to output a pre-recorded alert. When "project an image on the windshield" is selected as a preventive measure, the command creation module 43 creates a command required for the output device or the vehicle to project an image that has been recorded in advance on the windshield. When "generate an unpleasant sound" is selected as a preventive measure, the command creation module 43 creates a command required for the driver terminal or the vehicle to output a pre-recorded unpleasant sound. When "generate an explosion sound" is selected as a preventive measure, the command creation module 43 creates a command required for the driver terminal or the vehicle to output a pre-recorded explosion sound. The command creation module 43 creates a command required for the stimulus generator to generate an odor if "generate an odor" is selected as a preventive measure. The command creation module 43 creates a command required for the vehicle to stop if "stop the vehicle" is selected as a preventive measure.
[0079] The prevention measure execution module 21 transmits the created command to the corresponding terminal, device, or vehicle, and executes the selected prevention measure (step S17). In step S17, the terminal, device, or vehicle receives the created command. These execute the prevention measure according to this command. As a result, the computer 10 executes the selected prevention measure, and the driver drowsiness prevention system 1 executes the selected prevention measure.
[0080] Based on the above examples, the preventive measures implemented by the terminals, devices, and vehicles will be described.
[0081] When the driver terminal or the vehicle receives a command to "emit a sound similar to a heart sound", the driver terminal or the vehicle outputs a sound similar to a heart sound that has been recorded in advance from the speaker. When the stimulus generating device receives a command to "vibrate the seat", the stimulus generating device vibrates the seat. When the output device or the vehicle receives a command to "project a message onto the windshield", the output device or the vehicle projects a message that has been recorded in advance onto the windshield. When the driver terminal receives a command to "issue an alert from a smartphone", the output device or the vehicle outputs an alert that has been recorded in advance. When the output device or the vehicle receives a command to "project an image onto the windshield", the output device or the vehicle projects an image that has been recorded in advance onto the windshield. When the driver terminal or the vehicle receives a command to "generate an unpleasant sound", the output device or the vehicle outputs an unpleasant sound that has been recorded in advance from the speaker. When the driver terminal or the vehicle receives a command to "generate an explosion sound", the output device or the vehicle outputs an explosion sound that has been recorded in advance from the speaker. When the stimulus generating device receives a command to "generate an odor", the device generates an odor. When the vehicle receives a command to "stop the vehicle", the vehicle stops the vehicle.
[0082] The biometric information acquisition module 20 again acquires biometric information of the driver while driving after the preventive measures are implemented (step S18). The process of step S18 is similar to the process of step S10 described above.
[0083] The analysis module 40 analyzes the acquired biological information again (step S19). The process of step S19 is similar to the process of step S11 described above.
[0084] The determination module 41 determines the level at which the driver is likely to fall asleep while driving based on the analysis result of the reacquired biological information (step S20). The process of step S20 is similar to the process of step S12 described above.
[0085] The prevention determination module 44 determines whether or not the driver has been prevented from falling asleep while driving as a result of the currently executed prevention measure based on the analysis result of the biological information (step S21). In step S21, the prevention determination module 44 determines whether or not the level value based on the analysis result of the biological information is 0. This is because if the level is 0, it can be determined that the driver has woken up.
[0086] When the prevention determination module 44 determines that the driver has been prevented from falling asleep (step S21: YES), that is, when the determined level is 0, it determines that the driver has been prevented from falling asleep, and the recording module 30 records the currently executed prevention measure and the fact that the driver has been prevented from falling asleep (the driver has woken up) in association with each other as awakening information (step S22). After executing this process, the computer 10 executes the process of step S29 described later.
[0087] On the other hand, in step S21, if the prevention judgment module 44 judges that the driver's dozing off could not be prevented (step S21 NO), that is, if the judged level is 1 or more, it judges whether or not the level is equal to or higher than the level judged in the process of step S12 described above (step S23). In step S23, the prevention judgment module 44 judges whether or not the degree of dozing off has changed before and after the implementation of the prevention measures. If the prevention judgment module 44 judges that the level is less than the level judged previously (step S23 NO), it judges that although the driver's dozing off could not be prevented, a certain degree of effect was achieved, and the recording module 30 records the current Run The computer 10 associates the preventive measures taken with a certain degree of effectiveness and records them as partial awakening information (step S24). After performing this process, the computer 10 determines that the driver's dozing off has not been prevented, and performs the process of step S26 described later.
[0088] On the other hand, in step S23, when the prevention determination module 44 determines that the level is equal to or higher than the level determined previously (step S23 YES), it determines that the driver's drowsiness has not been prevented, and the recording module 30 Run The preventive measures taken and the fact that they were ineffective are associated with each other and recorded as non-awakening information (step S25).
[0089] The selection module 42 selects a prevention measure corresponding to a level higher than the level determined by the process of step S12 described above (step S26). In step S26, the selection module 42 selects a prevention measure corresponding to a level higher than the level previously determined. The selection module 42 selects a prevention measure corresponding to a level that is one or more steps higher than the previous level.
[0090] When selecting a preventive measure corresponding to the determined level, the computer 10 executes the processes of steps S14 and S15 described above, and selects a preventive measure according to the currently determined level.
[0091] If the level is higher than the level determined by the process of step S12 described above by a predetermined range or more, the selection module 42 can select a prevention measure corresponding to the highest level in the prevention measure database or the next highest level. Specifically, when the level determined previously is level 1 and the level determined this time is level 3, the selection module 42 selects a prevention measure corresponding to the highest level 5 or the next highest level 4 among the levels registered in the prevention measure database in FIG. 5 described above.
[0092] The command creation module 43 creates a command for causing the terminal, the device, or the vehicle to execute the selected preventive measure (step S27). The process of step S27 is similar to the process of step S16 described above.
[0093] The prevention measure execution module 21 transmits the created command to the corresponding terminal, device, or vehicle, and executes the selected prevention measure (step S28). The process of step S28 is the same as the process of step S17 described above.
[0094] After executing the selected preventive measure, the computer 10 executes the above-mentioned processes from step S18 onwards again until the driver stops falling asleep while driving.
[0095] In addition, even if the computer 10 has executed the preventive measures a predetermined number of times or all of the preventive measures, if the driver does not stop falling asleep while driving, the computer 10 may be configured to execute a combination of multiple preventive measures registered in the preventive measures database or all of the preventive measures at once.
[0096] In this embodiment, for the sake of simplicity, it will be described that the process of step S29, which will be described later, is executed after the process of step S28 described above.
[0097] The learning module 45 learns the awakening information, partial awakening information, and non-awakening information (step S29). In step S29, the learning module 45 learns the implemented preventive measures and their results (woke up, did not wake up but had a certain effect, or did not wake up at all) in association with each other. That is, the learning module 45 learns which preventive measures for the driver while driving woke up the driver from drowsiness and which preventive measures did not wake up the driver from drowsiness. At this time, the learning module 45 also learns the identifier of the target driver, etc., and learns effective preventive measures for a specific driver.
[0098] The learning module 45 may be configured to learn effective preventive measures against unspecified drivers, without learning the identifiers of the target drivers.
[0099] The recording module 30 records the learning result (step S30).
[0100] From the next time onwards, when the computer 10 executes the processes of steps S13 and S26 described above, it will select a preventive measure taking into account the learning results.
[0101] This example will now be described in detail.
[0102] In the above-mentioned processing of steps S13 and S26, the selection module 42 selects a prevention measure according to the determined level and the learning result. The selection module 42 selects a prevention measure from among the prevention measures registered in the prevention measure database, which correspond to the determined level, excluding prevention measures corresponding to partial awakening information and / or non-awakening information. At this time, when all prevention measures corresponding to the determined level are excluded, the selection module 42 selects a prevention measure corresponding to a level higher than the determined level. Furthermore, when all prevention measures corresponding to this higher level are excluded, the selection module 42 can also select a prevention measure corresponding to a higher level or a prevention measure that combines multiple prevention measures corresponding to the determined level or a higher level.
[0103] The selection module 42 may be configured to give a lower priority to the partial awakening information and / or the non-awakening information when selecting the partial awakening information and / or the non-awakening information.
[0104] The above is the process of executing measures to prevent drowsiness.
[0105] The above-mentioned means and functions are realized by a computer (including a CPU, an information processing device, and various terminals) reading and executing a predetermined program. The program is provided, for example, in the form of software as a service (SaaS) provided from the computer via a network. The program is also provided in the form of a computer-readable recording medium, such as a flexible disk, a CD (e.g., CD-ROM), or a DVD (e.g., DVD-ROM, DVD-RAM). In this case, the computer reads the program from the recording medium, transfers it to an internal recording device or an external recording device, records it, and executes it. The program may also be recorded in advance in a recording device (recording medium), such as a magnetic disk, optical disk, or magneto-optical disk, and provided to the computer from the recording device via a communication line.
[0106] Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. Furthermore, the effects described in the embodiments of the present invention are merely a list of the most preferable effects resulting from the present invention, and the effects of the present invention are not limited to those described in the embodiments of the present invention. [Explanation of symbols]
[0107] 1 Driver drowsiness prevention system, 10 Computer
Claims
1. A driver drowsiness prevention system that selects and executes a preventive measure to prevent a driver from falling asleep while driving, the preventive measure comprising: An acquisition means for acquiring biometric information of the driver; A determination means for determining a level at which the driver is likely to fall asleep while driving by analyzing the acquired biological information; a selection means for identifying a plurality of preventive measures corresponding to the determined level among a plurality of preventive measures for preventing dozing at the wheel, randomly selecting one preventive measure from among the plurality of preventive measures corresponding to the level, determining whether the selected preventive measure has already been selected within a predetermined interval, and if so, selecting again one preventive measure from among the plurality of preventive measures corresponding to the level excluding the selected one preventive measure, and randomly selecting one preventive measure from among the plurality of preventive measures corresponding to the level if all of the plurality of preventive measures corresponding to the level have been selected, and rotating and selecting the preventive measures for preventing dozing at a predetermined interval; An execution means for executing the selected one of the prevention measures; A driver drowsiness prevention system comprising:
2. A learning means for learning which of the implemented preventive measures did not cause the driver to fall asleep and which of the implemented preventive measures did cause the driver to fall asleep; Further equipped with the selection means selects the one of the prevention measures according to the determined level and a learning result.
2. The driver drowsiness prevention system according to claim 1.
3. The selection means selects the preventive measures for preventing drowsiness at predetermined intervals in a rotating manner according to the determined level.
2. The driver drowsiness prevention system according to claim 1.
4. A computer that selects and executes a preventive measure to prevent a driver from falling asleep while driving, the computer comprising: An acquisition means for acquiring biometric information of the driver; A determination means for determining a level at which the driver is likely to fall asleep while driving by analyzing the acquired biological information; a selection means for identifying a plurality of preventive measures corresponding to the determined level among a plurality of preventive measures for preventing dozing at the wheel, randomly selecting one preventive measure from among the plurality of preventive measures corresponding to the level, determining whether the selected preventive measure has already been selected within a predetermined interval, and if so, selecting again one preventive measure from among the plurality of preventive measures corresponding to the level excluding the selected one preventive measure, and randomly selecting one preventive measure from among the plurality of preventive measures corresponding to the level if all of the plurality of preventive measures corresponding to the level have been selected, and rotating and selecting the preventive measures for preventing dozing at a predetermined interval; an execution means for executing the selected one of the prevention measures; A computer comprising:
5. A terminal that selects and executes a preventive measure to prevent a driver from falling asleep while driving, an execution means for analyzing the driver's biological information, and executing one of a plurality of preventive measures for preventing dozing off at the wheel, which is determined based on a result of determining a level at which the driver is likely to doze off while driving, randomly selecting one of the preventive measures from among the plurality of preventive measures for preventing dozing off at the wheel, and if it is determined that the one selected preventive measure has already been selected within a predetermined interval, executing one preventive measure again from the plurality of preventive measures for the level excluding the one selected preventive measure, and if all of the plurality of preventive measures for the level have been selected, randomly selecting one of the preventive measures from among the plurality of preventive measures for the level, and rotating and executing the preventive measures for preventing dozing off at a predetermined interval; A terminal comprising:
6. 1. A method for preventing a driver from falling asleep while driving, the method being executed by a computer to select and execute a preventive measure for preventing a driver from falling asleep while driving, the method comprising: acquiring biometric information of the driver; analyzing the acquired biological information to determine a level at which the driver is likely to fall asleep while driving; a step of: identifying a plurality of preventive measures corresponding to the determined level among a plurality of preventive measures for preventing dozing at the wheel; randomly selecting one preventive measure from among the plurality of preventive measures corresponding to the level; determining whether the selected one preventive measure has already been selected within a predetermined interval; if the one preventive measure has already been selected, reselecting one preventive measure from among the plurality of preventive measures corresponding to the level excluding the selected one preventive measure; if all of the plurality of preventive measures corresponding to the level have been selected, randomly selecting one preventive measure from among the plurality of preventive measures corresponding to the level; and rotating and selecting the preventive measures for preventing dozing at a predetermined interval; executing the selected one of the prevention measures; 1. A computer-implemented method for preventing driver drowsiness, comprising:
7. A computer that selects and executes a preventive measure to prevent a driver from falling asleep while driving, acquiring biometric information of the driver; analyzing the acquired biological information to determine a level at which the driver is likely to fall asleep while driving; a step of identifying a plurality of preventive measures corresponding to the determined level among a plurality of preventive measures for preventing dozing at the wheel, randomly selecting one preventive measure from among the plurality of preventive measures corresponding to the level, determining whether the selected one preventive measure has already been selected within a predetermined interval, and if so, selecting again one preventive measure from among the plurality of preventive measures corresponding to the level excluding the selected one preventive measure, and if all of the plurality of preventive measures corresponding to the level have been selected, randomly selecting one preventive measure from among the plurality of preventive measures corresponding to the level, and rotating and selecting the preventive measures for preventing dozing at a predetermined interval; executing the selected one of the prevention measures; A computer readable program for executing the program.
Citation Information
Patent Citations
Awakening decrease alarm device
JP1997091569A
Vehicle controller
JP2005062911A
Doze prevention device
JP2011248850A
Sleepiness-estimating device and sleepiness-estimating method
JP2012245091A
Awakening control system for vehicle
JP2017059043A
