3D Heads-Up Display for Voice Command Context
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current vehicle systems lack the ability to provide visual context for voice commands, making it difficult for drivers to know which commands are available and relevant to their current environment, leading to confusion and reduced usage of voice command systems.
Innovation Solution
A 3D heads-up display (HUD) system that captures images of the vehicle environment, uses GPS and directory data to identify relevant objects, and displays 3D overlays near those objects, indicating available voice commands, thereby enhancing driver awareness and reducing ambiguity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a voice command system is implemented in a vehicle, then the system can control navigation and other vehicle functions through voice, but the driver cannot easily know which commands are available or relevant to their current environment
Solution Approach 1:
The patent transitions from traditional 2D display interfaces to a 3D heads-up display that projects visual context directly into the driver's field of view. The 3D overlays are positioned in spatial relationship to real-world objects, creating a multi-dimensional interface that provides command information without requiring the driver to shift attention to separate displays or menus.
Solution Approach 2:
The system introduces 3D visual overlays as an intermediary between the driver and the voice command system. These overlays act as a visual mediator that translates abstract command options into concrete, context-relevant suggestions displayed near corresponding objects in the driver's environment, making the available commands immediately apparent.
2Loss of information
If the driver looks at traditional displays to see available commands, then they can access information, but their attention is diverted from the road reducing safety
Solution Approach 1:
By projecting the heads-up display in three dimensions within the driver's existing field of view, the system eliminates the need for the driver to redirect their gaze to separate displays. The visual context appears to float in the driver's line of sight, maintaining visual attention on the road while providing command information.
Solution Approach 2:
The system automatically detects the driver's current environment using cameras and GPS, then dynamically generates and positions relevant command overlays without requiring the driver to actively search for or navigate to command information. The interface serves itself by anticipating the driver's needs based on contextual awareness.
3Loss of information
If the system displays all available voice commands, then complete information is provided, but the driver is overwhelmed by irrelevant options
Solution Approach 1:
The system applies local quality by providing different information at different locations in the driver's field of view. Each 3D overlay is positioned near the specific object it relates to and contains only the command information relevant to that object, rather than presenting a uniform list of all possible commands. This creates a distributed, context-specific information architecture.
Solution Approach 2:
The system performs preliminary action by pre-filtering and pre-positioning command information based on the driver's current environment, detected objects, and contextual data from GPS and cameras. Before the driver even considers what commands might be available, the system has already identified relevant options and presented them in appropriate spatial context.
Data Source
AI summary
The disclosure includes a system and method for wireless data sharing between a mobile client device and a three-dimensional heads-up display unit. A system may include a three-dimensional heads-up display unit (“3D HUD”) installed in a vehicle. The system may include a memory storing instructions that, when executed, cause the system to: establish a peer-to-peer video stream between a mobile client device and the vehicle; generate live video data for providing a video stream for causing a screen of the mobile client device to display visual content of the 3D HUD that includes substantially live images depicting what the driver of the vehicle sees when looking at the 3D HUD; and stream the live video data to the mobile client device to cause the screen of the mobile client device to display the video stream that depicts what the driver of the vehicle sees when looking at the 3D HUD.