Wide-Angle Camera AR Capture Beyond Display Field-of-View
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Wearable electronic devices, such as smart glasses, have limited field-of-view displays for augmented reality experiences, restricting users' ability to see all virtual content and requiring them to move their head to view the entire captured scene.
Innovation Solution
Incorporating a wide-angle camera to capture the real-world environment from the user's perspective, allowing the recording of augmented reality features beyond the display's field-of-view, which can then be re-composited for a larger field-of-view experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If a wide-angle camera is used to capture the real-world environment, then the field-of-view for capturing augmented reality experiences is improved, but the device complexity increases
Solution Approach 1:
The system divides the field-of-view capture into two segments: a wide-angle camera captures the entire scene, while a smaller display presents a portion of this captured content to the user. This segmentation allows the wide FOV to be achieved without requiring the entire system to be complex, as the capture and display functions are separated.
2Adaptability or versatility
If augmented reality features are applied to the entire captured scene, then the immersion experience is improved, but the processing requirements and device complexity increase
Solution Approach 1:
The system creates a copy of the captured scene content and applies augmented reality features to this copy rather than modifying the original capture pipeline. This allows AR features to be applied to the entire scene for improved immersion while keeping the core capture device relatively simple, as the complex processing is applied to a digital copy rather than requiring hardware modifications.
3Volume of moving object
If the display shows only a portion of the captured content, then the device can remain compact, but the user cannot see all virtual content without moving their head
Solution Approach 1:
The system transitions from a traditional single-dimension display approach to a multi-dimensional solution by capturing in wide-angle (spatial dimension) and selectively presenting content (temporal dimension through user interaction). Users can view different portions of the captured content by moving their head or interacting with the device, effectively adding the dimension of user movement as a way to access different parts of the scene.
Data Source
AI summary
Augmented reality experiences of a user wearing an electronic eyewear device are captured by at least one camera on a frame of the electronic eyewear device, the at least one camera having a field of view that is larger than a field of view of a display of the electronic eyewear device. An augmented reality feature or object is applied to the captured scene. A photo or video of the augmented reality scene is captured and a first portion of the captured photo or video is displayed in the display. The display is adjusted to display a second portion of the captured photo or video with the augmented reality features as the user moves the user's head to view the second portion of the captured photo or video. The captured photo or video may be transferred to another device for viewing the larger field of view augmented reality image.