Vehicle Gaze-Based Object Identification for Distracted-Free Driving
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Occupants of vehicles face difficulties in accurately identifying objects of interest due to movement and obstructions, making it challenging to capture images or use maps for identification, and there is a need to minimize distractions and maintain safe driving by reducing the use of external devices.
Innovation Solution
A method and system that utilizes gaze data combined with vehicle sensors and map data to identify objects of interest, allowing occupants to request and receive information about those objects without handling external devices, using an integrated vehicle system to process and transmit relevant data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If occupants use mobile devices to capture images for object identification, then object identification capability is improved, but driving safety deteriorates due to distraction and hands-off-steering
Solution Approach 1:
The vehicle system automatically performs object identification and information retrieval without requiring occupant intervention. The system detects objects of interest, captures images using vehicle-mounted cameras, and retrieves information automatically, allowing occupants to maintain focus on driving while still accessing object information through the vehicle's display system.
Solution Approach 2:
The vehicle's integrated system acts as an intermediary between the occupant and the object identification process. Instead of the occupant directly using a mobile device, the vehicle system mediates by receiving requests from the occupant, performing the identification and information retrieval, and presenting results through the vehicle's interface, thereby eliminating the need for hands-off-steering.
2Loss of time
If occupants use maps to identify objects, then object location estimation is improved, but identification accuracy deteriorates due to reliance on best estimate rather than direct observation
Solution Approach 1:
The system replaces the manual mechanical process of estimating object location on a map with an automated computer vision and sensor-based system. The vehicle's cameras and sensors automatically detect, track, and identify objects in the real environment, providing precise location and identification information without requiring the occupant to manually estimate positions on a map.
Solution Approach 2:
The system continuously monitors the vehicle's environment using sensors and cameras, providing real-time feedback about detected objects. This feedback loop allows the system to automatically update object locations and identities, comparing detected objects with map data to verify accuracy and provide corrections, thereby improving identification precision beyond manual estimation.
3Productivity
If vehicle movement continues during object observation, then driving efficiency is improved, but image capture quality deteriorates due to motion blur and difficulty in steady aiming
Solution Approach 1:
The system performs preliminary actions by pre-positioning and pre-focusing vehicle-mounted cameras on detected objects of interest before the occupant makes a request. The system continuously tracks and maintains optimal imaging conditions, so when an occupant expresses interest in an object, high-quality images are already captured and ready for immediate display and analysis, eliminating the need for manual image capture during vehicle movement.
4Adaptability or versatility
If external devices like mobile devices are used for object identification, then identification functionality is improved, but system complexity and distraction increase
Solution Approach 1:
The patent merges the object identification functionality directly into the vehicle's existing system architecture. The vehicle's cameras, sensors, processors, and display systems are integrated to work together for automatic object detection, tracking, and identification. This consolidation eliminates the need for separate mobile devices while reducing overall system complexity by utilizing components already present in the vehicle.
Solution Approach 2:
The vehicle's integrated system performs multiple functions: it serves as the camera system for capturing images, the processor for analyzing and identifying objects, the database for storing and retrieving information, and the display system for presenting results to occupants. This multi-functional approach replaces the need for separate specialized devices, reducing complexity while maintaining versatile identification capabilities.
Data Source
AI summary
A method of obtaining object information includes receiving a request initiation from an occupant of a vehicle. The method includes receiving a request from the occupant. The method includes determining a content of the request from the occupant. The method further includes detecting a gaze location of the occupant. The method includes receiving information related to an environment surrounding the vehicle based on data collected by a sensor attached to the vehicle. The method includes identifying a region of interest (ROI) outside of the vehicle based on the detected gaze location and the information related to the environment surrounding the vehicle. The method includes generating log data based on the ROI and the content of the request. The method includes transmitting the log data to an external device. The method includes receiving information related to an object within the ROI, wherein the information satisfies the content of the request.