See-Through Helmet AR With Predictive Aircraft Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented reality systems struggle to accurately lock geospatially located content in environments lacking real objects or with limited objects, particularly in fast-moving vehicles where precision tracking and alignment of virtual content with the user's perspective are challenging.
Innovation Solution
A system using a head-mounted see-through optic with a non-visual tracking system to identify and track objects, a training simulation system to present virtual content, and a virtual content presentation system that aligns content with the user's perspective based on vehicle sensors and predictive geometric understanding, enabling accurate presentation of virtual content in fast-moving environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If inside-out or outside-in tracking systems use objects in the environment as markers to assist in tracking and spatially locate content, then the tracking accuracy is improved, but the system becomes inapplicable in environments where markers are difficult or not possible to use
Solution Approach 1:
The patent replaces visual marker-based tracking systems with non-visual sensing systems (such as LIDAR, radar, or other electromagnetic sensing) that can operate without requiring physical markers in the environment. This substitution allows the system to maintain tracking accuracy while becoming applicable in environments where visual markers are not available or difficult to place.
2Productivity
If augmented reality systems present virtual content in fast-moving vehicles, then the training simulation capability is improved, but the precision tracking and alignment of virtual content with the user's perspective becomes challenging
Solution Approach 1:
The system performs preliminary calculations and predictions of the user's future position and orientation based on current motion data before presenting virtual content. This predictive approach allows the system to pre-compute the correct spatial alignment of virtual content, ensuring precise tracking and alignment even in fast-moving vehicles where conditions change rapidly.
Solution Approach 2:
The patent implements a feedback loop that continuously monitors the user's position, orientation, and motion, then adjusts the presentation of virtual content in real-time. This closed-loop control system ensures that virtual content remains precisely aligned with the user's perspective despite the dynamic conditions in fast-moving vehicles.
Data Source
AI summary
Systems, methods, and computer products according to the principles of the present inventions may involve a training system for a pilot of an aircraft. The training system may include an aircraft sensor system affixed to the aircraft adapted to provide a location of the aircraft, including an altitude of the aircraft, speed of the aircraft, and directional attitude of the aircraft. It may further include a helmet position sensor system adapted to determine a location of a helmet within a cockpit of the aircraft and a viewing direction of a pilot wearing the helmet. The helmet may include a see-through computer display through which the pilot sees an environment outside of the aircraft with computer content overlaying the environment to create an augmented reality view of the environment for the pilot. A computer content presentation system may be adapted to present computer content to the see-through computer display at a virtual marker, generated by the computer content presentation system, representing a geospatial position of a training asset moving within a visual range of the pilot, such that the pilot sees the computer content from a perspective consistent with the aircraft's position, altitude, attitude, and the pilot's helmet position when the pilot's viewing direction is aligned with the virtual marker.