Head-Mounted AR Vehicle Control With 3D Coordinate Matching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle assistance systems present information and receive user instructions in a two-dimensional manner, which is complex and requires time to learn, hindering convenience and safety.
Innovation Solution
A vehicle control system integrating a head-mounted display device that provides and matches first and second coordinate information to generate intuitive three-dimensional augmented images, allowing users to input control instructions through gestures or voice for vehicle actions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If information is presented through traditional 2D screens or HUDs, then the system structure is simple, but the user interface complexity increases and ease of operation deteriorates
Solution Approach 1:
The patent transitions from 2D display interfaces (dashboard screens, HUDs) to 3D spatial augmented reality displays. By projecting virtual information elements into the user's visual field in three-dimensional space, the system maintains simplicity while dramatically improving operational intuitiveness. Users can interact with spatially-located virtual elements that correspond to real-world positions, eliminating the need to interpret complex 2D representations.
2Loss of time
If traditional 2D display methods are used, then device complexity is low, but information comprehension time increases
Solution Approach 1:
By displaying information in 3D augmented reality space rather than 2D screens, the patent enables users to comprehend spatial relationships and vehicle states immediately through intuitive visual positioning. Virtual information elements are placed in correspondence with their real-world sources, eliminating the cognitive load of translating 2D representations to 3D understanding.
Solution Approach 2:
The system creates virtual copies of real-world objects and information at their corresponding spatial positions. Instead of abstract 2D representations, users see direct visual copies of vehicle components, road conditions, and sensor data overlaid on the actual physical environment, enabling immediate comprehension without learning curves.
3Ease of operation
If 3D augmented reality display is implemented, then ease of operation improves, but device complexity increases
Solution Approach 1:
The patent introduces a coordinate conversion module as an intermediary between the vehicle's sensor coordinate system and the augmented reality display coordinate system. This mediator automatically performs the complex task of matching and transforming coordinates, allowing the system to leverage existing vehicle sensors while achieving precise 3D spatial registration without requiring complex hardware modifications.
Solution Approach 2:
The coordinate matching system is designed to work with multiple types of vehicle sensors (cameras, radar, LIDAR) and multiple display configurations simultaneously. The universal coordinate transformation framework enables the same system to support various augmented reality display arrangements without requiring sensor-specific or display-specific customization, reducing overall system complexity.
Data Source
AI summary
The disclosure provides a vehicle control system. The vehicle control system includes a vehicle and a head-mounted display device. The vehicle is used to provide first coordinate information. The head-mounted display device is used to provide and display second coordinate information. In response to the head-mounted display device receiving the first coordinate information, the head-mounted display device matches the first coordinate information with the second coordinate information to provide third coordinate information and display an augmented image based on the third coordinate information. In response to the head-mounted display device receiving a control instruction input by a user based on the augmented image, the head-mounted display device outputs a control command to the vehicle, so that the vehicle performs a control action.