Obstructed Object Viewing in Vehicles Using Gaze and Camera Mediation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users, especially in vehicles or augmented/virtual reality environments, often miss viewing objects of interest due to obstruction or limited time, and existing solutions require manual identification and search for information, which can be cumbersome and inefficient.
Innovation Solution
A system that identifies and displays objects of interest using a combination of user movement, voice signals, and gaze direction, providing an unobstructed view and relevant information automatically, tailored to individual user profiles and interests.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If users manually identify and search for information about objects, then information can be retrieved, but the process is cumbersome and time-consuming
Solution Approach 1:
The system enables automatic identification of objects of interest and automatic retrieval of relevant information without requiring manual user intervention. The system monitors user gaze, movement, and vehicle context to autonomously identify objects and fetch information, making the information retrieval process self-service rather than manual
Solution Approach 2:
The system performs preliminary actions by proactively identifying objects of interest before the user explicitly requests information. By monitoring user attention and vehicle context in advance, the system prepares and retrieves information automatically, eliminating the need for subsequent manual search
2Measurement precision
If users rely on visual observation of external objects, then they can identify objects of interest, but their view may be obstructed by vehicle structure or other passengers
Solution Approach 1:
The system uses an intermediary approach by deploying multiple external cameras to capture views of objects that are obstructed from the user's direct line of sight. These cameras act as intermediaries, capturing images from different angles and positions around the vehicle to provide complete views of obscured objects
Solution Approach 2:
The system transitions from a single-dimension direct visual observation to a multi-dimensional approach by using cameras positioned at various locations around the vehicle. This provides views from multiple spatial dimensions, allowing the system to capture objects that are blocked from any single viewpoint
3Speed
If the vehicle is moving, then users can travel to destinations, but the time window to identify and view external objects is limited
Solution Approach 1:
The system performs preliminary identification of objects of interest using multiple external cameras and sensors before the vehicle passes them. By detecting and identifying objects in advance during the approach, the system prepares information retrieval and presentation, maximizing the use of limited viewing time
Solution Approach 2:
The system maintains continuous monitoring and identification of objects throughout the vehicle's journey. Rather than relying on brief momentary views, the system continuously tracks objects of interest, maintaining identification and information retrieval processes throughout the limited time window as the vehicle moves
4Ease of operation
If a first occupant points out an interesting object, then that occupant can draw attention to it, but other occupants cannot see what is being referred to due to obstructions
Solution Approach 1:
The system creates visual copies of the object view through multiple external cameras positioned around the vehicle. These camera copies capture images and video feeds that are then displayed on internal screens, allowing all occupants to view the same object simultaneously without being limited by their individual lines of sight
Solution Approach 2:
The system uses display screens inside the vehicle as intermediaries to transmit the view of external objects to all occupants. Rather than relying on direct visual contact with the object, the screens act as intermediaries that reproduce and distribute the visual information to everyone in the vehicle
Data Source
AI summary
Systems and methods are presented for enhancing media or information consumption. An example method includes identifying a movement of a first user, identifying an object referenced by the movement of the first user external to the first user, and in response to determining that the object is at least partially obstructed from a field of view of a second user, generating, for display on a display that is within the field of view of the second user, a view of the object.