Vehicle Driver Focus Detection via Speech-Object Comparison

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Drivers may focus on distracting objects, leading to neglect of more critical environmental situations, such as pedestrians, due to the lack of technologies that can accurately determine and respond to their focus in real-time.

Innovation Solution

A vehicle system incorporating object detection sensors, sound detection sensors, and an electronic control unit that compares driver speech with detected objects to determine the focus and produce control signals for warnings or autonomous actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the driver focuses on a particular object in the environment, then the driver's attention is concentrated on that object, but the driver may become unaware of other objects or situations that pose more risk

Engineering Contradiction:
Improvedriver focus detection accuracyVSAvoidsafety monitoring reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system continuously monitors driver focus through speech detection and object recognition, providing real-time feedback by comparing the driver's stated focus with actual environmental hazards. When a mismatch is detected (e.g., driver focuses on billboard while pedestrian is present), the system issues alerts to redirect attention, creating a closed-loop feedback mechanism that improves safety monitoring reliability

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The electronic control unit acts as an intermediary between the driver's speech input and the object detection sensors. It processes the driver's spoken focus object, cross-references it with sensor data about actual environmental objects, and determines whether the driver's focus is appropriate. This intermediary function resolves the contradiction by objectively verifying driver attention against actual hazards

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If the vehicle system monitors driver focus through multiple sensors and processing, then the safety response accuracy is improved, but the system complexity increases

Engineering Contradiction:
Improvefocus determination accuracyVSAvoidsensor and processing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The electronic control unit performs multiple functions using a single integrated system: it detects driver speech, processes speech-to-text conversion, performs object recognition on environmental sensors, compares driver focus with actual hazards, and generates safety alerts. This multi-functional approach improves focus determination accuracy while minimizing the need for separate dedicated components for each function

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system merges the driver speech detection function with the environmental object detection function into a unified safety monitoring process. Both the driver's stated focus and the actual environmental objects are processed through the same electronic control unit, which combines these data streams to determine safety status. This merging reduces overall system complexity by eliminating redundant processing channels

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11021147B2Vehicles and methods for determining objects of driver focus
Publication Date: 2021.06.01 TOYOTA JIDOSHA KK
  • US11021147B2 patent drawing
  • US11021147B2 patent drawing
  • US11021147B2 patent drawing

AI summary

Vehicles and methods for determining an object of a driver's focus are disclosed. In one embodiment, a vehicle includes an object detection sensor configured to output an output signal, a sound detection sensor configure to output a sound signal, and an electronic control unit. The electronic control unit is configured to detect one or more objects based at least in part on the output signal of the object detection sensor, and detect speech based on the sound signal of the sound detection sensor. The electronic control unit is further configured to determine an object of focus based at least in part on a comparison of the speech and the one or more objects, and produce a control signal based at least in part on the object of focus.