Augmenting Images with Context Data for Panoramic Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Consumer image capture devices have limited viewing angles, making it difficult to determine the location and immersive experience of captured images, and existing devices with wider angles are costly and complex.
Innovation Solution
Augmenting image data with 3D or 360° context data to create panoramic images, using a system that receives image data with known position and orientation, identifies matching or nearby context data, and combines it to generate a more immersive viewing experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a standard consumer digital camera is used to capture images, then the device is inexpensive and simple, but the viewing angle is limited making it difficult to determine location and create immersive experience
Solution Approach 1:
The patent uses 3D model data and 360° image data as copies or representations of the real-world scene. Instead of requiring a complex camera system to capture everything directly, the system uses simplified 3D models and pre-captured 360° images to represent the environment, allowing the original simple camera to achieve enhanced immersive experience through these representational copies.
Solution Approach 2:
The patent introduces 3D model data and 360° image data as intermediary elements between the simple camera and the user's immersive experience. These intermediaries bridge the gap between the limited viewing angle of the original camera and the desired expansive immersive view, allowing the system to enhance the camera's capabilities without changing the camera itself.
2Adaptability or versatility
If image capture devices with wider viewing angle are used, then the viewing angle and immersive experience are improved, but the devices become more costly and complex
Solution Approach 1:
The patent segments the imaging task into multiple components: the original simple camera captures basic image data, while separate 3D model data and 360° image data provide the expansive environmental context. This segmentation allows each component to remain simple and inexpensive while the combination achieves the desired wide viewing angle and immersive experience.
Solution Approach 2:
The patent makes the system multi-functional by using the same simple camera for multiple purposes: capturing the main subject image, and combining it with 3D model data and 360° image data to create panoramic views. The simple camera serves both as the primary capture device and as part of a composite system that achieves enhanced viewing capabilities through software processing.
3Adaptability or versatility
If 3D model data and 360° image data are combined with original image data, then immersive experience is enhanced, but the processing complexity and data handling requirements increase
Solution Approach 1:
The patent uses 3D model data and 360° image data as pre-computed representations that simplify the processing task. Instead of requiring complex real-time rendering from scratch, the system uses these pre-prepared copies to enhance the original image, reducing the computational burden while achieving immersive effects.
Solution Approach 2:
The patent performs preliminary actions by pre-capturing and pre-processing 360° image data and 3D model data before they are needed. This allows the system to retrieve and combine these pre-prepared elements with the original image data more efficiently, reducing real-time processing complexity while maintaining high immersive quality.
Data Source
AI summary
Methods and systems are provided methods and systems for augmenting image data (e.g., still image data or video image data) utilizing image context data to generate panoramic images. In accordance with embodiments hereof, a position and orientation of received image data is utilized to identify image context data (e.g., three-dimensional model data, two-dimensional image data, and/or 360° image data from another source) rendered based upon the same position or a nearby position relative to the image data and the image data is augmented utilizing the identified context data to create a panoramic image. The panoramic image may then be displayed (e.g., shown on a LCD/CRT screen or projected) to create a user experience that is more immersive than the original image data could create.