Panoramic Image Latitude Span Extension via 3D Model Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Panoramic images have limited vertical field of view due to the small vertical field of view (VFOV) of panoramic image-taking devices, resulting in unsatisfactory depth estimation and restricted visual angle when presenting panoramic images to users.
Innovation Solution
A method that involves receiving a three-dimensional model and an initial panoramic image with a limited latitude span, determining camera coordinate parameters, mapping data points to a camera coordinate system, and merging the initial image with an intermediate image to generate a final panoramic image with an extended latitude span, thereby enhancing the visual angle.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Length of moving object
If panoramic images are taken using conventional devices, then the image capture process is simple, but the vertical field of view is limited
Solution Approach 1:
The patent transitions from two-dimensional panoramic images with limited vertical field of view to three-dimensional spatial data representation. By incorporating depth information and spatial coordinates, the system creates a multi-dimensional representation that naturally extends the vertical viewing angle without requiring complex multi-camera setups.
Solution Approach 2:
The patent introduces a three-dimensional model as an intermediary between the initial panoramic image and the final extended view. This 3D model serves as a mediator that fills in the vertical field of view gaps, allowing the system to achieve full vertical coverage without directly capturing it through additional hardware.
2Adaptability or versatility
If the vertical field of view is extended using multiple devices, then the viewing angle increases, but the system complexity increases
Solution Approach 1:
The patent makes the initial panoramic image serving device multi-functional by enabling it to not only capture images but also to generate and integrate three-dimensional spatial models. This universal approach allows a single device to achieve extended vertical field of view without requiring additional specialized equipment.
Solution Approach 2:
The patent changes the parameter representation from standard 2D image coordinates to 3D spatial coordinates. By transforming the data representation rather than adding hardware, the system achieves extended adaptability and viewing angle while maintaining simple device configuration.
3Measurement precision
If conventional panoramic image processing is used, then the processing speed is fast, but the depth estimation quality is poor
Solution Approach 1:
The patent performs preliminary action by pre-establishing three-dimensional spatial models and depth maps before final image rendering. This pre-computation of depth information allows for high-quality depth estimation while maintaining fast processing speeds during actual image generation, as the computationally intensive 3D modeling is done in advance.
Data Source
AI summary
A method for generating a panoramic image is disclosed. The method includes receiving a three-dimensional model of a target space and an initial panoramic image of the target space, the initial panoramic image having a latitude span less than a preset latitude span; determining a first set of coordinate parameters of a camera associated with the initial panoramic image and with respect to a reference frame associated with the three-dimensional model; mapping, based on the first set of coordinate parameters of the camera, data points of the three-dimensional model to a camera coordinate system associated with the camera to obtain an intermediate panoramic image; and obtaining a final panoramic image by merging the initial panoramic image and the intermediate panoramic image, the final panoramic image having a latitude span greater than or equal to the preset latitude span.