See-through HMD Augmented Reality Video Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current head-mounted display (HMD) devices fail to provide an immersive and personalized augmented reality experience that seamlessly integrates with real-world environments and video content, lacking the ability to offer context-specific, interactive, and spatially synchronized information.
Innovation Solution
A user display apparatus featuring a HMD device with a see-through lens, inertial measurement units, and optional depth cameras, which tracks the user's head orientation and location to provide personalized, interactive, and context-specific augmented reality content that can be synchronized with video content, extending it spatially and temporally to create an immersive experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If augmented reality content is displayed in a region of space adjacent to the video display screen, then the immersive visual experience is improved, but the device complexity increases due to additional sensors and control circuits
Solution Approach 1:
The patent combines multiple functions into the HMD device: the see-through lens integrates real-world viewing with virtual content display, while the inertial measurement unit and depth camera work together to track head orientation and location. The control circuit merges sensor data processing with augmented reality content generation and synchronization, creating a unified system that delivers immersive experience without requiring separate standalone components for each function.
Solution Approach 2:
The HMD device serves multiple functions simultaneously: it acts as a video display interface, a head tracking system, a depth sensing device, and an augmented reality content generator. The see-through lens provides both real-world visibility and virtual image projection, while the control circuit handles both sensor data processing and content synchronization, making the device highly versatile and reducing the need for separate specialized components.
2Loss of information
If the augmented reality content is synchronized with video monitor content, then the contextual relevance is improved, but the loss of information increases due to the constraints of video display screen
Solution Approach 1:
The patent transitions content from the two-dimensional video display screen to three-dimensional space by projecting augmented reality images into the user's field of view. The control circuit receives video content and spatializes it by determining the user's head orientation and location, then renders the content in 3D space adjacent to where the video screen would be visible, preserving contextual information while adding spatial depth and perspective.
Solution Approach 2:
The system provides personalized augmented reality content tailored to each user's specific viewpoint, location, and head orientation. The control circuit adjusts the rendered content based on individual user characteristics and real-time tracking data, ensuring that each user receives contextually relevant information optimized for their specific viewing conditions rather than a generic display.
3Ease of operation
If sensors track head orientation and location in real-time, then the interactive experience is improved, but the use of energy increases due to continuous sensor operation
Solution Approach 1:
The inertial measurement unit and depth camera operate by capturing head orientation and location data at periodic intervals rather than continuously streaming data. The control circuit processes these periodic sensor readings to update the augmented reality content rendering, reducing energy consumption compared to continuous real-time tracking while maintaining sufficient interactivity for the user experience.
Data Source
AI summary
A see-through head-mounted display (HMD) device, e.g., in the form of augmented reality glasses, allows a user to view a video display device and an associated augmented reality image. In one approach, the augmented reality image is aligned with edges of the video display device to provide a larger, augmented viewing region. The HMD can include a camera which identifies the edges. The augmented reality image can be synchronized in time with content of the video display device. In another approach, the augmented reality image video provides a virtual audience which accompanies a user in watching the video display device. In another approach, the augmented reality image includes a 3-D which appears to emerge from the video display device, and which is rendered from a perspective of a user's location. In another approach, the augmented reality image can be rendered on a vertical or horizontal surface in a static location.