Systems and methods for limiting driver distraction

The system uses sensors and an interface module to detect and redirect driver distractions, enhancing attention on the driving path through verbal, visual, or physical interactions, thereby reducing unsafe driving behaviors.

JP7767829B2Active Publication Date: 2025-11-12TOYOTA JIDOSHA KK
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2021174369
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-11-10
Filing Date
2021-10-26
Publication Date
2025-11-12
Estimated Expiration
2041-10-26

AI Technical Summary

Technical Problem

Driver distractions, such as external events or internal activities, divert attention from the driving path, leading to unsafe driving behaviors and potential accidents.

Method used

A system comprising sensors and an interface module to detect distractions and redirect the driver's attention using verbal, visual, or physical interactions, including a head-up display to maintain focus on the driving path.

Benefits of technology

The system effectively maintains or improves a driver's attention on the road by detecting and addressing distractions, reducing the likelihood of unsafe driving behaviors and potential accidents.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007767829000001
    Figure 0007767829000001
  • Figure 0007767829000002
    Figure 0007767829000002
  • Figure 0007767829000003
    Figure 0007767829000003
Patent Text Reader

Abstract

To provide a system and a method for limiting driver distraction, such as improving (e.g., maintaining) driver attention to driving when driving distractions are detected.SOLUTION: A system may include at least one sensor for determining an attention of a driver on a travel path and an interface module configured to re-engage attention of the driver on the travel path. An image capturing device may detect an environment surrounding a vehicle. A logic device may determine whether the environment surrounding the vehicle includes an external distraction or whether the driver is distracted by an internal distraction. The at least one sensor may monitor the driver for a distracted behavior. The driver may be required to take an action when a distraction is determined. For example, the driver may interact with a driver monitoring system to verify re-engagement to driving (e.g., by identifying a second vehicle on the roadway).SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates generally to vehicle safety features, and more particularly to systems and methods for limiting driver distraction, such as improving (e.g., maintaining) a driver's attention to driving when a driving distraction is detected. [Background technology]

[0002] When driving, distracting events and objects can distract a driver while driving. Driver distraction can lead to undesirable driving behaviors, such as erratic and unsafe driving, among other things. Additionally, distracted driving can result in property damage or injury, such as damage to one or more vehicles or other property, and / or injury to the driver, passengers, or bystanders who happen to be nearby.

[0003] Thus, there is a need in the art for systems and methods that address the above-described deficiencies in the art or at least provide improvements. For example, there is a need for systems and methods that maintain or improve a driver's attention on the road during a distraction event. Summary of the Invention

[0004] The present disclosure provides systems and methods for maintaining or improving a driver's attention on the road during a distraction event. For example, systems and methods are provided that proactively identify or detect distracting events or objects and refocus or redirect the driver's attention to driving (e.g., the driving path). In some embodiments, the systems and methods can detect when a driver is approaching an external distraction (e.g., an advertising billboard, road construction, a traffic accident, etc.) or can detect when the driver is distracted while driving (e.g., using a cell phone, not looking at the road, driver inattention). When an external distraction and / or driver inattention is detected, the driver can be required to maintain or redirect their attention to the road and driving by interacting with the vehicle or the system in some way. For example, the driver can be required to "tag" other vehicles on the road by verbally, through eye contact, or by interacting in some physical way within the vehicle, among other ways of interaction.

[0005] Various embodiments of the present disclosure include a system for limiting driver distraction of a vehicle. The system can include at least one sensor and an interface module. The at least one sensor can determine the driver's attention on a driving path, such as a road or highway. The interface module can be configured to redirect the driver's attention to the driving path.

[0006] Various embodiments of the present disclosure include a system including an image capture device, a logic device, and at least one sensor for determining the attention of a driver of a vehicle. The image capture device can be configured to detect an environment surrounding the vehicle. The logic device can be configured to determine whether the environment surrounding the vehicle includes an external distraction. Once the external distraction is determined, the logic device can be configured to request an action from the driver. The at least one sensor can monitor the driver for distracted behavior.

[0007] Various embodiments of the present disclosure include a method for limiting driver distraction. The method can include determining the attention of a driver of a vehicle, such as determining that the driver's attention is diverted from a driving path. The method can include redirecting the driver's attention to the driving path through interaction with the driver by an interface module of the vehicle.

[0008] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory in nature and are intended to provide an understanding of the present disclosure without limiting the scope thereof. In that regard, additional aspects, features, and advantages of the present disclosure will become apparent to those skilled in the art from the following detailed description. [Brief explanation of the drawings]

[0009] Aspects of the present disclosure are best understood from the following detailed description when read in conjunction with the accompanying drawings.

[0010] [Figure 1] 1 is an illustration of a vehicle driving environment in which there are one or more external distractions that may cause the driver to become inattentive while driving. [Figure 2] FIG. 1 is a diagram of a system for limiting driver inattention while driving, according to one or more embodiments of the disclosure. [Figure 3] 1 is an illustration of an operational monitoring system according to one or more embodiments of the disclosure. [Figure 4] 1 is an illustration of a head-up display for a vehicle, according to one or more embodiments of the disclosure. [Figure 5] 1 is a flowchart of a method for limiting driver inattention during a distraction event, according to one or more embodiments of the disclosure. [Figure 6] FIG. 1 illustrates an example computing or processing system, according to one or more embodiments of the disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0011] The present disclosure provides systems and methods for limiting driver distraction, such as improving (e.g., maintaining) a driver's attention to the road or other driving path during the presence of external or internal driving distractions. The system may include at least one sensor for determining the driver's attention on the driving path and an interface module configured to redirect the driver's attention to the driving path. An image capture device may detect the environment surrounding the vehicle. A logic device may determine whether the environment surrounding the vehicle includes external distractions or whether the driver is distracted by internal distractions. The sensor may monitor the driver for distracting behavior. Once the distractions are determined, the driver may be prompted to take an action. For example, the driver may interact with the interface module to verify that they have redirected their attention to driving (e.g., by identifying a second vehicle on the road).

[0012] 1 is an illustration of a vehicle driving environment 100 with one or more external distractions that may distract a driver while driving. Referring to FIG. 1, the vehicle driving environment 100 may include one or more, e.g., multiple, external distractions 102 that divert the driver's attention from a driving path 110 (e.g., a highway, roadway, street, lane, etc.). For example, the environment surrounding the vehicle 112 may include any number and extent of advertising signs 120, road construction 122, traffic accidents 124, road congestion 126, recreational / entertainment / sports attractions 128, and other distracting events and objects near the driving path 110.

[0013] These and other external distractions 102 can distract a driver while driving, drawing the driver's attention away from the driving path 110. For example, instead of focusing on driving and the driving path 110 ahead, the driver of the vehicle 112 may focus their attention on a billboard 120, a traffic accident 124, road construction 122, or other roadside object or event. For example, a billboard 120 may include attention-grabbing images, words, and other features (e.g., lights, movement, etc.) that distract the driver for an extended period of time. Similarly, a traffic accident 124, road construction 122, and other roadside events or objects may undue the driver's attention while driving, such as out of curiosity or for entertainment, and may lead to spectating or other distracted behavior. Inattention to driving and / or the driving path 110 may lead to undesirable driving behavior, property damage, or injury.

[0014] 1 , the driving environment 100 may change over time, creating new and / or different external distractions 102 for the driver. For example, one segment of the driving route 110 may present a first set of external distractions, while another segment of the driving route 110, such as a different segment of the driving route 110 that includes a different amount of advertising billboards 120, traffic accidents 124, road construction 122, traffic jams 126, or other distractions, may present a second set of external distractions that differ from the first set of external distractions. Similarly, the same segment of the driving route 110 may have different external distractions 102 at different times (e.g., depending on the time of day, day of week, time of year, etc.). For example, a driver driving the same section of the driving route 110 may be presented with different sets of external distractions 102 on different days (e.g., weekdays and weekends, Mondays and Wednesdays, etc.), different times of the day (e.g., mornings and afternoons), or different seasons of the year (e.g., summer and winter).

[0015] 2 is a diagram of a system 200 for limiting driver distraction, such as inattention to driving, according to one or more embodiments of the disclosure. With reference to FIG. 2, the system 200 may include one or more functions or components configured to identify or detect a distracting event or object (e.g., an external distractor 102 or other distractor) and refocus or reengage the attention of the driver of the vehicle 112 on driving (e.g., the driving path 110). As shown, the system 200 includes, among other components, at least one sensor ( FIG. 2 , “attention sensor 202”) for determining the driver's attention on the driving path 110 and an interface module 204.

[0016] The attention sensor 202 can be configured to monitor the driver for distracted behavior, such as by being configured to detect one or more characteristics indicative of distracted driving behavior. In an embodiment, the attention sensor 202 can sense whether the driver's attention is diverted from the travel path 110, such as by being directed at an external distraction 102. In an embodiment, the attention sensor 202 can include a camera for detecting one or more characteristics indicative of distracted driving. The camera can detect at least one of a facial feature of the driver indicative of distracted behavior or a driving characteristic of the vehicle 112 indicative of distracted behavior. For example, the camera can include at least one of a driver monitoring camera 202A or a lane tracking camera 202B, among others.

[0017] The driver monitoring camera 202A can detect one or more facial characteristics of the driver that are indicative of distracted driving or inattention to driving. For example, the driver monitoring camera 202A can detect eye position, facial orientation, pupil dilation, and eye movement, among other things, to determine the driver's attention on the driving path 110. The driver monitoring camera 202A can be used alone to determine driver distraction or in combination with other cameras or sensors (e.g., lane tracking camera 202B). The lane tracking camera 202B can detect the position and orientation of the vehicle 112 within a lane of the driving path 110. For example, the lane tracking camera 202B can monitor lane departure, lane following, and other driving characteristics of the vehicle 112 that are indicative of driver distraction. In an embodiment, the lane tracking camera 202B can be used alone to determine the driver's attention or inattention on the driving path 110 or in combination with the driver monitoring camera 202A, among other cameras or sensors.

[0018] The interface module 204 can be configured to redirect the driver's attention to the driving path 110. As described herein, the attention sensor 202 can be configured to detect a driver's verbal, visual, or physical interaction to redirect the driver's attention to the driving path 110. For example, the driver can verbally, visually, or physically interact with the vehicle 112 (e.g., with the attention sensor 202) to redirect the driver's attention to the driving path 110. When distracted driving behavior is detected by the attention sensor 202, the interface module 204 can request a verbal, visual, or physical driver action to limit the driver's distraction and redirect the driver's attention to driving and the driving path 110. For example, the interface module 204 can prompt the driver to take action when or after distracted driving behavior is detected. In such an embodiment, the attention sensor 202 can monitor the driver for the requested driver action. For example, attention sensor 202 may be configured to detect the driver's identification of a second vehicle 130 (see FIG. 1 ) on travel path 110 in order to redirect the driver's attention to travel path 110, as described below. Second vehicle 130 may be traveling in the same or opposite direction as vehicle 112 along travel path 110.

[0019] The driver may identify the second vehicle 130 verbally, visually, or physically. For example, the driver may verbally identify the second vehicle 130 by vocalizing a desired characteristic of the second vehicle 130 (e.g., the color of the second vehicle 130, the type of the second vehicle 130, etc.). In such an embodiment, the attention sensor 202 may include a microphone configured to detect the driver's vocalization of the desired characteristic. In an embodiment, the driver may visually identify the second vehicle 130 by looking at it. For example, the driver monitoring camera 202A may detect whether the driver is looking at the second vehicle 130, whether the driver is visually following the second vehicle 130, etc. In an embodiment, the driver may interact with the vehicle 112 in some physical way to identify the second vehicle 130. For example, the driver may engage one or more buttons, dials, or other tactile interfaces to identify the second vehicle 130 and confirm attention to the travel path 110. As a result, the system 200 can allow the driver to "identify" the second vehicle 130 in a number of ways.

[0020] 2 , system 200 may include other components or modules. For example, system 200 may include a second sensor ( FIG. 2 , “position sensor 210”) for determining the position of second vehicle 130 near vehicle 112, such as on travel path 110. Position sensor 210 may be a camera, laser, radar, or any combination thereof for detecting the position of second vehicle 130 on or near travel path 110. In an embodiment, position sensor 210 may detect one or more characteristics (e.g., color, type, etc.) of second vehicle 130. System 200 may also include one or more vehicle systems 212. For example, system 200 may include a GPS system, a vehicle dynamics system, an audio system, a display system, a communication system, and / or a user interface system of vehicle 112, among others.

[0021] In some embodiments, the system 200 may include an image capture device 216 configured to detect the environment surrounding the vehicle 112. The image capture device 216 may include one or more cameras or sensors that detect one or more external distractions 102 near the vehicle 112. For example, the image capture device 216 may monitor the travel path 110 for identifiable external distractions 102 (e.g., billboards 120, traffic accidents 124, road construction 122, etc.). The image capture device 216 may associate each external distraction 102 with its degree or severity (e.g., minor traffic accidents vs. major traffic accidents, limited area road construction 122 vs. extensive road construction 122, etc.) and may be used to classify the external distractions 102, such as distinguishing between billboards 120, traffic accidents 124, or road construction 122, among other external distractions 102. In embodiments, the image capture device 216 can be used to verify data received from an external source (e.g., a map, a traffic service, or a network) to identify the external distraction element 102. In some embodiments, the image capture device 216 can be omitted, and the external distraction element 102 can be identified using only the external source (e.g., a map, a traffic service, or a network).

[0022] In some embodiments, multiple vehicles can be linked together in a network, or data from multiple vehicles can be uploaded to a network for access by other vehicles. As a result, one or more vehicles can build a map of distracting events / objects and their locations along the traveled route 110. For example, the driver can identify distracting events / objects while driving, or the system 200 can determine distracting events / objects automatically, such as as the system 200 monitors the driver for distracting behavior. In this manner, the map of external distractors 102 can be adaptively created and modified for the traveled route 110. In some embodiments, the map of external distractors 102 can be adaptively created and modified for the driver based on the driver's personal distraction characteristics (e.g., being easily distracted by certain types of signs 120 but not easily distracted by road construction 122 or traffic accidents 124, etc.). For example, the driver's response can be compared to the responses of other drivers to modify the map of external distractors 102 and / or define the driver's personal distraction profile.

[0023] 2, system 200 may include logic device 220. Logic device 220 may be any controller, processor, module, circuit, or device configured to perform one or more operations. Logic device 220 may be implemented as any suitable controller (e.g., a processing unit, microcontroller, electronic control unit, processor, application specific integrated circuit (ASIC), field programmable gate array (FPGA), memory storage device, memory reader, or other device or combination of devices) that can be adapted to execute, store, and / or receive suitable instructions, such as, for example, software instructions for controlling various operations of attention sensor 202, position sensor 210, interface module 204, image capture device 216, vehicle system 212, and / or other elements of system 200. Such software instructions may also implement methods for processing images and / or other sensor signals or data, determining sensor information, providing user feedback (e.g., through a user interface), querying a device for operating parameters, selecting operating parameters for a device, or performing any of the various operations described herein (e.g., operations performed by logic devices of the various devices of system 200).

[0024] Logic device 220 can be communicatively connected to attention sensor 202, interface module 204, position sensor 210, vehicle system 212, and image capture device 216. Logic device 220 can be configured to receive data from at least one sensor of system 200. For example, logic device 220 can receive data or other sensor signals from image capture device 216, attention sensor 202, position sensor 210, interface module 204, vehicle system 212, or any combination thereof. In an embodiment, logic device 220 can receive data from a map, a traffic service, or a network, among other external sources, that identifies the type and location of one or more external distractors 102. Depending on the application, logic device 220 can receive and transmit data via wired or wireless communication.

[0025] Based on the received data, the logic device 220 can be configured to determine distractions, such as whether the environment surrounding the vehicle 112 includes external distractions 102. For example, the logic device 220 can determine the presence of one or more external distractions 102 based on data received from an attention sensor 202 monitoring the driver and / or an image capture device 216 monitoring the environment surrounding the vehicle 112. For example, the logic device 220 can monitor, through the attention sensor 202, whether the driver's attention has deviated from the travel path 110 for more than a threshold time, such as exceeding a preset deviation time. In an embodiment, the logic device 220 can monitor, through the attention sensor 202, whether the driver's attention has deviated from the travel path 110 for more than a threshold magnitude, such as exceeding a preset deviation magnitude or the degree to which the driver's eyes or head are redirected in response to the external distractions 102. Additionally or alternatively, logic device 220 can monitor the environment surrounding vehicle 112 by continuously or near-continuously analyzing data received from image capture device 216 to identify one or more external distractions 102. In some embodiments, logic device 220 can determine whether an internal distraction is present, as described in more detail below. For example, logic device 220 can determine whether the driver is engaging in an activity that diverts attention from driving (e.g., texting (e.g., on a smartphone), adjusting a vehicle system 212, etc.).

[0026] In some embodiments, the logic device 220 can intelligently determine whether a distraction is present or whether the distraction requires driver action to verify the driver's attention on the travel path 110. For example, the logic device 220 can determine whether the driver has already seen the external distraction 102 (e.g., already seen an advertising billboard 120, road construction 122, or traffic accident 124). In embodiments, the logic device 220 can determine whether the driver has previously seen the external distraction 102 within a period of time (e.g., the same day, within an hour, within a range of days, etc.), such as by seeing the same external distraction 102 in the same location along the same travel path, or by seeing a similar external distraction 102 along a different travel path. If the driver has already seen the same or similar external distraction element 102, the logic device 220 can determine that the external distraction element 102 is not present for that driver, that the external distraction element 102 does not require driver action, that the external distraction element 102 requires a different driver action than the previously requested driver action, or that the external distraction element 102 requires the same driver action.

[0027] In some embodiments, logic device 220 can determine the driver's previous response or distracting behavior to the same or similar distractors. For example, an analysis of the driver's previous response or distracting behavior can be stored in memory, and logic device 220 can retrieve the stored response or analysis. Based on the driver's previous response or behavior, logic device 220 can determine that a distraction is not present for the driver (e.g., the driver does not exhibit, or rarely exhibits, distracting driving behavior in response to the same or similar distractors), that the distraction does not require driver action, or that the distraction requires driver action.

[0028] The logic device 220 can intelligently determine the presence of a distraction or required driver action based on one or more factors. For example, the logic device 220 can apply weighting factors when determining a distraction. The factors weighted by the logic device 220 can include, without limitation, the severity or intensity of the distraction, the driver's attention to the distraction, the time during which the same or similar distraction has been present, the most recent distraction to the driver, the time since the last attention requirement, the distraction's normality, previous driver responses to the distraction, and the visibility of the distraction to the driver, or any combination thereof. In some embodiments, the logic device 220 can apply one or more machine learning algorithms, such as supervised learning, unsupervised learning, or reinforcement learning algorithms, when determining whether a distraction is present. Non-limiting examples of machine learning algorithms that can be applied to facilitate determining whether an external distraction 102 is present include logistic regression, decision trees, support vector machines, naive Bayesian models, random forests, or other algorithms. As a result, the system 200 can include one or more intelligent features for adapting the system 200 to the driver or the driving route 110.

[0029] Once a distraction is determined, logic device 220 can be configured to request an action from the driver through interface module 204. For example, logic device 220 can request, through interface module 204, the driver to "tag" an object on travel path 110, such as second vehicle 130 in FIG. 1 , either verbally, visually, as described herein, or by physically interacting with vehicle 112. Logic device 220 can monitor the driver for the requested action through attention sensor 202. For example, logic device 220 can monitor the driver's verbal, visual, and / or physical movements or interactions to redirect the driver's attention to travel path 110. As a result, the driver's attention to travel path 110 can be reinforced or maintained when a distraction is detected. The driver can be prompted to take action in one or more ways. For example, to prompt the driver to take action, an audible sound and / or message may be emitted, a visual cue may be displayed (e.g., on the dashboard, in a head-up display, etc.), or physical feedback may be initiated (e.g., steering wheel vibration, seat vibration, etc.), or any combination thereof.

[0030] FIG. 3 illustrates a driver monitoring system 300 according to one or more embodiments of the disclosure. The driver monitoring system 300 can be used to monitor driver behavior. For example, the driver monitoring system 300 can include the attention sensor 202 described above to sense one or more facial features of the driver that are indicative of distracted behavior. Specifically, the driver monitoring system 300 can monitor the driver's attention along the travel path 110. For example, the driver monitoring system 300 can track eye position and eye movement, among other facial features, to determine driver distraction. Similar to the embodiments described above, the driver monitoring system 300 can determine driver distraction due to external distractions 102 (e.g., billboards 120, road signs, traffic accidents 124, road construction 122, or other external distracting objects or activities).

[0031] In embodiments, the driver monitoring system 300 can determine that the driver is distracted by other distracting factors. For example, without limitation, the driver monitoring system 300 can determine that the driver is distracted by any activity that takes attention away from driving, such as talking or texting on the phone, eating or drinking, operating one or more vehicle systems 212 (e.g., the stereo, HVAC, or navigation system), talking to a passenger in the vehicle 112, etc. These and other internal distracting factors can draw the driver's attention away from driving, similar to the external distracting factors 102 discussed above. Once an internal distracting factor is determined, the driver can be prompted or required to take action to limit the driver's distraction and redirect the driver's attention to driving and the travel path 110, similar to the driver actions described above when an external distracting factor 102 is determined.

[0032] FIG. 4 is an illustration of a head-up display (HUD) 400 for a vehicle 112, according to one or more embodiments of the disclosure. Referring to FIG. 4, the HUD 400 can present images, information, commands, prompts, or other data to the driver and within the driver's field of view. For example, the HUD 400 can present a speedometer, tachometer, navigation, and night vision system display, or any combination thereof, among other system displays. The HUD 400 can allow the driver to view data without requiring the driver to take their eyes off the travel path 110. For example, the HUD 400 can allow the driver to view information while keeping their head or eyes up and looking ahead, rather than looking downward at one or more lower-mounted instruments or gauges. The HUD 400 can be included within the dashboard of the vehicle 112, such that the displayed information is projected onto the windshield for the driver to view, although other configurations for presenting information to the driver within the driver's field of view are also contemplated.

[0033] In an embodiment, the interface module 204 of the system 200 may include a HUD 400. The HUD 400 may include one or more features configured to redirect the driver's attention to the travel path 110 when a distraction is detected. In one embodiment, the HUD 400 may highlight the second vehicle 130 in one or more ways (e.g., by an outline 402 around the second vehicle 130, by a marker adjacent to the second vehicle 130, etc.). Once the second vehicle 130 is highlighted in the HUD 400, the system 200 may prompt the driver to identify the second vehicle 130. For example, the driver monitoring camera 202A may detect whether the driver is looking at the second vehicle 130 highlighted in the HUD 400. Additionally or alternatively, a microphone may detect the driver vocalizing the color (or other desired characteristic) of the second vehicle 130 highlighted in the HUD 400.

[0034] 5 is a flowchart of a method 500 for limiting driver inattention during a distraction event, according to one or more embodiments of the disclosure. Method 500 can be implemented using a variety of systems, such as system 200 described above. Although method 500 is illustrated as a set of acts or steps and described with reference to FIGS. 1-4, method 500 may be applied to other embodiments not illustrated in FIGS. 1-4. One or more steps not explicitly illustrated in FIG. 5 may be included before, after, between, or as part of the steps illustrated.

[0035] At block 502, method 500 may include determining whether the environment surrounding the vehicle includes external distractions, such as signs, traffic accidents, road construction, or other roadside objects or events that tend to distract the driver while driving. For example, an image capture device may detect the environment surrounding the vehicle, such as through one or more cameras or sensors. In embodiments, data from a network, a traffic service, a map, or other external source may be analyzed to determine external distractions near the vehicle. For example, the location of the vehicle may be checked against external distractions identified on a map, by a traffic service or network, by other drivers, or previously by the driver.

[0036] At block 504, the method 500 includes determining the attention of a driver of the vehicle. The driver attention can be determined using facial recognition. For example, a driver monitoring camera (or other facial recognition system) can detect facial features of the driver, such as eye position, eye movement, facial orientation, head movement, etc. The detected facial features can be used to verify the presence of external distractions against a map of external distractions, or the detected facial features can be used to determine driver distraction. For example, detection of driver distraction can indicate an external distraction near the vehicle. In an embodiment, the driver monitoring camera can monitor for driver distraction due to objects or other distractions inside the vehicle, including, for example, talking or texting on the phone, eating, drinking, adjusting one or more vehicle systems (e.g., stereo, HVAC, navigation, etc.), being distracted by a person or object in the passenger compartment of the vehicle, etc.

[0037] In an embodiment, block 504 may include detecting one or more characteristics indicative of distracted driving behavior. In one example, a lane tracking camera may monitor lane departure, lane following, and other vehicle driving characteristics indicative of driver distraction. In an embodiment, driver attention may be determined using other sensors and systems. For example, driver attention may be determined by monitoring speed, braking, or other driving parameters or characteristics. For example, erratic speed or excessive braking may indicate a driver is driving distracted.

[0038] In block 506, method 500 includes redirecting the driver's attention to the travel path, such as through the driver's interaction with the vehicle's interface module. Block 506 may include receiving verbal, visual, or physical interaction from the driver to maintain the driver's attention on the travel path. For example, block 506 may include detecting the driver's identification of the second vehicle. The driver may identify a desired characteristic of the second vehicle, such as the color, type, or other characteristic of the second vehicle. In an embodiment, the driver may identify the second vehicle through visual recognition, such as by viewing the second vehicle for a set period of time, as detected by a driver monitoring camera. The driver may also identify the second vehicle in other ways (e.g., buttons, dials, etc.). As a result, an action by the driver may be required when an external or internal distraction is determined by one or more sensors that monitor the driver for distracting behavior and verify that action is taken by the driver.

[0039] While identification of the second vehicle is discussed, block 506 may include redirecting the driver's attention to the travel path through identification of other objects on or adjacent to the travel path in a manner that increases or encourages attention to the travel path and driving. Non-limiting examples include traffic signs (e.g., speed limit, information, warning, or regulatory signs), road medians, and road markings. In an embodiment, the interface module may include a HUD, which identifies the second vehicle or other object for identification. For example, the HUD may outline or mark the second vehicle or object to be identified by the driver.

[0040] FIG. 6 illustrates an example computing or processing system 600 upon which embodiments of the present disclosure may be implemented. For example, system 200 of FIGS. 2-4 may be implemented using system 600, as described above. In some embodiments, method 500 of FIG. 5 may be implemented using system 600, as described above. Computing or processing system 600 may be or include a computer, phone, PDA (personal digital assistant), tablet, server, controller, or any other type of electronic device. Such electronic devices may include various types of computer-readable media and interfaces to various other types of computer-readable media. As shown in FIG. 6, system 600 includes a controller 602, a memory 604, an input interface 606, an output interface 608, and a communication module 610.

[0041] The controller 602, according to various embodiments, includes one or more of a processor, microprocessor, central processing unit (CPU), electronic control unit, graphics processing unit (GPU), single-core processor, multi-core processor, microcontroller, programmable logic device (PLD) (e.g., field-programmable gate array (FPGA)), application-specific integrated circuit (ASIC), digital signal processing (DSP) device, or other logic device that can be configured, either hardwired, by executing software instructions, or a combination of both, to perform various operations discussed herein for the disclosed embodiments. The controller 602 can be configured to interface with and communicate with various other components of the processing system 600 to perform such operations. For example, the controller 602 can be configured to receive and process map, location, distraction, face monitoring, and vehicle dynamics data received from a network and / or one or more processors (e.g., driver monitoring camera 202A, position sensor 210, etc.), among other things, and store and / or retrieve stored data in memory 604.

[0042] Controller 602 may include a combination of hardware and software processing capabilities, and other components may provide, include, and / or be communicatively attached to, controller 602 to execute appropriate instructions, such as software instructions and / or processing parameters stored in memory 604. In various embodiments, controller 602 may be configured to execute software instructions stored in memory 604 to perform various methods, processes, or operations in the manner described herein.

[0043] The memory 604, in one embodiment, includes one or more memory devices configured to store data and information, including magnetic flux data and position information. The memory 604 can include one or more various types of memory devices, including volatile and non-volatile memory devices, such as random access memory (RAM), dynamic RAM (DRAM), static RAM (SRAM), non-volatile random access memory (NVRAM), read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, hard disk drives, and / or other types of memory. As discussed above, the controller 602 can be configured to execute software instructions stored in the memory 604 to perform the method 500 and process steps and / or operations. The controller 602 can be configured to store data in the memory 604.

[0044] The input interface 606, in one embodiment, includes user input and / or interface devices, such as one or more knobs, buttons, slide bars, keyboards, sensors, cameras, and / or other devices adapted to generate input control signals. The controller 602 can be configured to sense input control signals from the input interface 606 and respond to any sensed input control signals received therefrom. The controller 602 can be configured to interpret such input control signals as values, as commonly understood by those skilled in the art. In one embodiment, the input interface 606 can include a control unit (e.g., a wired or wireless handheld control unit) having pushbuttons adapted to interface with a user and receive user input control values. In one implementation, the pushbuttons of the control unit can be used to control various system functions.

[0045] The output interface 608 may, for example, enable the output of data or other information. The output interface 608 may include, for example, one or more display devices, such as a monitor or other visual display (e.g., a light-emitting diode (LED) display, a liquid crystal display (LCD), a head-up display (HUD), or other types of displays). Some implementations include devices, such as a touchscreen, that function as both input and output components. The controller 602 may be configured to render data and information on the output interface 608. For example, the controller 602 may be configured to render data, such as data stored in the memory 604, on the output interface 608.

[0046] In some embodiments, various components of system 600 may be distributed over a network so that they can communicate with one another. In this regard, system 600 may include a communications module 410 configured to facilitate wired and / or wireless communications between various system components over the network. Such a network may include, for example, a local area network ("LAN"), such as an intranet, or a wide area network ("WAN"), such as the Internet.

[0047] As shown, system 600 may include a driver attention system 612. Driver attention system 612 may be similar to system 200 of Figures 2-4 above. For example, driver attention system 612 may include one or more sensors or cameras configured to sense, acquire, monitor, or determine the attention of a driver of a vehicle, such as the driver's attention to external or internal distractions.

[0048] In some embodiments, the various components of system 600 may be communicatively coupled via a system communication bus 614. Bus 614 collectively represents all system, peripheral, and chipset buses that communicatively connect the numerous devices of system 600. For example, bus 614 may communicatively couple controller 602, memory 604, input interface 606, and output interface 608 to one another.

[0049] Where applicable, various embodiments provided by the present disclosure may be implemented using hardware, software, or a combination of hardware and software. Also, where applicable, various hardware and / or software components described herein may be combined into composite components comprising software, hardware, and / or both without departing from the spirit of the present disclosure. Where applicable, various hardware and / or software components described herein may be separated into subcomponents comprising software, hardware, or both without departing from the spirit of the present disclosure. Additionally, where applicable, it is contemplated that software components may be implemented as hardware components, and vice versa.

[0050] Software according to the present disclosure, such as non-transitory instructions, program code, and / or data, can be stored on one or more non-transitory machine-readable media. It is also contemplated that the software identified herein can be implemented using one or more general-purpose or special-purpose computers and / or computer systems, networked and / or otherwise. Where applicable, the order of the various steps described herein can be changed, combined into composite steps, and / or separated into sub-steps to provide the functions described herein.

[0051] While certain example embodiments of the invention have been described and illustrated in the accompanying drawings, various other modifications will occur to those of ordinary skill in the art, and it is to be understood that such embodiments are merely examples of the invention in its broadest sense and are not limiting, and that embodiments of the invention are not limited to the specific constructions and arrangements shown and described. All modifications, equivalents, and variations within the spirit and scope of the disclosure, as defined by the claims, are intended to be covered.

[0052] For example, elements and teachings of various embodiments can be combined in whole or in part in some or all of the embodiments. Additionally, one or more of the elements and teachings of various embodiments can be omitted, at least in part, and / or combined, at least in part, with one or more of the other elements and teachings of various embodiments. Additionally, although different steps, processes, and procedures are described as separate operations, one or more of the steps, one or more of the processes, and / or one or more of the procedures can also be performed in a different order, simultaneously, and / or sequentially. In some embodiments, steps, processes, and / or procedures can be combined into one or more steps, processes, and / or procedures. In some embodiments, one or more of the operational steps in each embodiment can be omitted. The invention disclosed in this specification includes the following aspects. [Aspect 1] 1. A system for limiting driver distraction of a vehicle, comprising: at least one sensor for determining the driver's attention on a travel route; an interface module configured to redirect the driver's attention to the driving path; A system comprising: [Aspect 2] The system of aspect 1, wherein the at least one sensor is configured to detect verbal, visual, or physical interaction of the driver to redirect the driver's attention to the driving path. Aspect 3 2. The system of claim 1, wherein the interface module comprises a head-up display of the vehicle. Aspect 4 a second sensor for determining a position of a second vehicle on the travel path; 2. The system of claim 1, wherein the at least one sensor detects the driver's identification of the second vehicle to redirect the driver's attention to the driving path. Aspect 5 10. The system of claim 1, wherein the at least one sensor comprises a camera for detecting one or more characteristics indicative of distracted driving behavior. Aspect 6 The system of aspect 5, wherein the camera detects at least one of facial features of the driver indicative of the distracted behavior or driving characteristics indicative of the distracted behavior. Aspect 7 10. The system of claim 1, further comprising an image capture device configured to detect an environment surrounding the vehicle. Aspect 8 receiving data from at least one of an image capture device, a map, a traffic service, or a network; The system of aspect 1, further comprising a logic device configured to determine, based on the data, whether an environment surrounding the vehicle has external distractions. Aspect 9 A system as described in aspect 8, wherein the logic device is configured to request an action from the driver through the interface module when the external distraction factor is determined. Aspect 10 1. A system comprising: an image capture device configured to sense an environment surrounding the vehicle; a logic device configured to determine whether the environment surrounding the vehicle includes external distractions; at least one sensor for determining the attention of a driver of the vehicle; Equipped with The system, wherein the logic device is configured to request an action from the driver when the external distraction factor is determined, and the at least one sensor monitors the driver for distracting behavior. Aspect 11 a second sensor for determining a position of a second vehicle near the vehicle; 11. The system of claim 10, wherein the logic device is configured to determine an identification of the second vehicle by the driver. Aspect 12 12. The system of claim 11, wherein the driver's identification of the second vehicle comprises a verbal or visual identification of the second vehicle. Aspect 13 The system of aspect 10, wherein the at least one sensor comprises one or more cameras for detecting one or more facial features of the driver that are indicative of the distracted behavior. Aspect 14 14. The system of claim 13, wherein the one or more cameras verify that the action is taken by the driver. Aspect 15 1. A method for limiting driver distraction, comprising: Determining the attention of a driver of a vehicle; redirecting the driver's attention to a travel route through the driver's interaction with an interface module of the vehicle; The method has the following features. Aspect 16 16. The method of claim 15, further comprising determining whether an environment surrounding the vehicle has external distractions. Aspect 17 The method of claim 16, wherein determining whether the environment surrounding the vehicle has the external distraction elements comprises determining whether the environment has signs, traffic accidents, or road construction. Aspect 18 16. The method of embodiment 15, wherein determining the driver's attention comprises detecting one or more characteristics of the driver indicative of distracted behavior. Aspect 19 16. The method of claim 15, wherein redirecting the driver's attention to the driving path comprises receiving verbal, visual, or physical interaction from the driver to maintain the driver's attention on the driving path. Aspect 20 20. The method of embodiment 18, wherein receiving the driver's verbal, visual, or physical interaction comprises detecting an identification of a second vehicle by the driver.

Claims

1. 1. A system for limiting driver distraction of a vehicle, comprising: at least one sensor for determining the driver's attention on a travel route; an interface module configured to redirect the driver's attention to the driving path; a logic device configured to receive data from at least one of an image capture device, a map, a traffic service, or a network configured to detect an environment surrounding the vehicle, and to determine, based on the data, whether the environment surrounding the vehicle has external distractions; Equipped with The logic device is determining whether the external distraction has been seen by the driver within a previous predetermined time period; determining that external distractions that have been determined to have been seen by the driver within a previous predetermined time period are not present to the driver; It is configured as follows: system.

2. 2. The system of claim 1, wherein the at least one sensor is configured to detect a verbal, visual, or physical interaction of the driver to redirect the driver's attention to the travel path.

3. The system of claim 1 , wherein the interface module comprises a head-up display of the vehicle.

4. a second sensor for determining a position of a second vehicle on the travel path; The system of claim 1 , wherein the at least one sensor detects the driver's identification of the second vehicle to redirect the driver's attention to the travel path.

5. The system of claim 1 , wherein the at least one sensor comprises a camera for detecting one or more characteristics indicative of distracted driving behavior.

6. The system of claim 5 , wherein the camera detects at least one of facial features of the driver indicative of the distracted behavior or driving characteristics indicative of the distracted behavior.

7. The system of claim 1 , wherein the logic device is configured to request an action from the driver through the interface module once the external distraction is determined.

8. The logic device according to claim 1, determining a previous response or distracting behavior of the driver to the same or similar distraction, and determining whether the distraction is present for the driver based on the previous response or behavior of the driver; The system of claim 1 configured to:

9. 1. A system comprising: an image capture device configured to sense an environment surrounding the vehicle; a logic device configured to receive data from at least one of the image capture device, a map, a traffic service, or a network, and determine, based on the data, whether the environment surrounding the vehicle includes external distractions; and at least one sensor for determining the attention of a driver of the vehicle; Equipped with The logic device is requiring the driver to take an action once the external distraction has been determined; determining whether the external distraction has been seen by the driver within a previous predetermined time period; determining that external distractions that have been determined to have been seen by the driver within a previous predetermined time period are not present to the driver; It is configured as follows: the at least one sensor monitors the driver for distracted behavior. system.

10. a second sensor for determining the location of a second vehicle near the vehicle; The system of claim 9 , wherein the logic device is configured to determine an identification of the second vehicle by the driver.

11. The system of claim 10 , wherein the driver's identification of the second vehicle comprises a verbal or visual identification of the second vehicle.

12. The system of claim 9 , wherein the at least one sensor comprises one or more cameras for detecting one or more facial features of the driver indicative of the distracted behavior.

13. The system of claim 12 , wherein the one or more cameras verify that the action is taken by the driver.

14. The logic device: determining a previous response or distracting behavior of the driver to the same or similar distraction, and determining whether the distraction is present for the driver based on the previous response or behavior of the driver; The system of claim 9 , configured to:

15. 1. A method for limiting driver distraction, comprising: Determining the attention of a driver of a vehicle; redirecting the driver's attention to a travel route through the driver's interaction with an interface module of the vehicle; receiving data from at least one of an image capture device, a map, a traffic service, or a network configured to detect an environment surrounding the vehicle, and determining, based on the data, whether the environment surrounding the vehicle has external distractions; determining whether the external distraction has been seen by the driver within a previous predetermined time period, and determining that an external distraction determined to have been seen by the driver within a previous predetermined time period is not present for the driver; The method has the following features.

16. 16. The method of claim 15, wherein determining whether an environment surrounding the vehicle has the external distractions comprises determining whether the environment has signs, traffic accidents, or road construction.

17. The method of claim 15 , wherein determining the driver's attention comprises detecting one or more characteristics of the driver that are indicative of distracted behavior.

18. 16. The method of claim 15, wherein redirecting the driver's attention to the driving path comprises receiving verbal, visual, or physical interaction from the driver to maintain the driver's attention on the driving path.

19. 20. The method of claim 17, wherein receiving the driver's verbal, visual, or physical interaction comprises detecting an identification of a second vehicle by the driver.

20. A method as described in claim 15, comprising determining the driver's previous response or distracting behavior to the same or similar distracting element, and determining whether the distracting element is not present for the driver based on the driver's previous response or behavior.

Citation Information

Patent Citations

  • Driver state detection apparatus

    JP2019087143A

  • Information presentation method and information presentation device

    JP2019215620A

  • Automatic drive control device and vehicle

    JP2020097415A

  • Driver distraction detection system

    US20160267335A1