Augmented Image Generation via Virtual Content Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional wearable heads-up displays (WHUDs) lack the ability to share augmented reality experiences between multiple users, limiting their adoption and functionality in social interactions.
Innovation Solution
A method and system that allows users to capture and generate augmented images by registering virtual content from a WHUD with a captured image, using image recognition and neural networks to spatially and temporally align the virtual content with the scene, enabling sharing of these images between users.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If wearable heads-up displays present virtual content in field-of-view, then user can see displayed content, but user cannot share augmented reality experiences with other users
Solution Approach 1:
The system captures an image of the scene and creates a copy of the virtual content being displayed in the field-of-view, then overlays the copied virtual content onto the captured image to generate an augmented image that can be shared with other users
Solution Approach 2:
The system uses an intermediary device (such as a smartphone or camera) to capture the scene and virtual content, then processes and transmits the augmented image to other users, enabling sharing without requiring direct connection between WHUD devices
2Manufacturing precision
If virtual content is overlaid on captured image, then augmented reality experience is created, but alignment precision between virtual content and scene features is challenging
Solution Approach 1:
The system employs image recognition technology to automatically identify features in the captured scene, then uses this feedback information to precisely align and position the virtual content overlay, ensuring accurate spatial correspondence between virtual and real elements
Solution Approach 2:
The system performs preliminary image recognition and feature detection on the captured scene before overlaying the virtual content, pre-calculating the optimal position and orientation of virtual elements to ensure precise alignment when the augmented image is generated
Data Source
AI summary
Systems, devices, and methods relate to generation of augmented images using virtual content that is part of an augmented reality presentation and images of a scene captured via an image sensor. A wearable heads-up display (WHUD) may present an augmented reality presentation with virtual content projected into a field of view of a scene, while an image sensor captures images of the scene. The image sensor may be part of the WHUD or part of a separate device, for instance part of a smartphone. A wearer may view a scene via the WHUD and capture an image of all or a portion of the scene, for instance via a camera of either the WHUD or a separate device. An application monitors the virtual content and can generate an augmented image, which can be transmitted/printed, replicating the augmented reality experience and/or adding customized messages to the resulting augmented image.