Panoramic Image Straightening via Cylindrical Projection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for forming composite images, such as panoramas, often result in distorted images when projected directly onto a plane, limiting the ability to capture and align large views without significant distortion.
Innovation Solution
The method involves defining a first projection for a set of component images using a rotation matrix, identifying a plane corresponding to the viewing direction, and then defining a second projection using a rotation from the first reference frame to a global reference frame, allowing the images to be rendered onto a cylindrical surface with reduced distortion, which can be easily unrolled into a straightened panoramic image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Shape
If component images are projected directly onto a plane, then the composite image can be formed, but significant distortion occurs in the panoramic image
Solution Approach 1:
The patent applies cylindrical projection to map component images onto a cylindrical surface rather than a flat plane. This curved surface approach allows the panoramic image to be formed with minimal distortion, as the cylinder naturally accommodates the circular arrangement of component images. The cylinder is then unwrapped to produce a straight panoramic image, resolving the contradiction between maintaining image shape and reducing distortion.
Solution Approach 2:
The patent transforms the projection parameters from a planar reference frame to a cylindrical reference frame. By changing the projection surface from flat to curved, and adjusting the mapping parameters accordingly, the system achieves reduced distortion while maintaining the ability to form a composite image. This parameter transformation enables the panoramic image to be both straight and accurate.
2Area of stationary object
If multiple overlapping images are taken to capture larger views, then the field of view is expanded, but image alignment and projection become more complex
Solution Approach 1:
The patent uses a unified cylindrical projection model that can accommodate multiple component images regardless of their specific positions or orientations. This universal approach allows the same projection method to handle various numbers and arrangements of overlapping images, simplifying the overall system complexity while expanding the field of view coverage.
Solution Approach 2:
The cylindrical surface acts as an intermediary between the multiple component images and the final panoramic output. This intermediate representation provides a common reference framework that simplifies the alignment and integration of multiple images, reducing the complexity of directly projecting and aligning multiple images onto a flat plane.
3Manufacturing precision
If cylindrical projection is used to reduce distortion, then image quality improves, but the projection reference frame becomes more complex
Solution Approach 1:
The patent creates a virtual cylindrical reference frame that copies the geometric properties of a physical cylinder. This virtual model allows the system to perform projections and transformations without physically constructing a cylindrical apparatus. The reference frame is mathematically defined and can be manipulated through standard computational operations, reducing the practical complexity while maintaining the distortion-reduction benefits.
Data Source
AI summary
Systems, methods, and apparatus, including computer program products, are provided for forming composite images. In some implementations, a method is provided. The method includes receiving a set of component images for forming a composite image and defining a first projection for the set of component images corresponding to a first reference frame. The method also includes identifying a plane corresponding to a point of view of the set of component images, where a normal to the plane corresponds to a second reference frame, defining a second projection for the set of component images corresponding to the second reference frame, the second reference frame corresponding to a rotation from the first reference frame defined using the normal of the identified plane, and rendering the composite image according to the second projection.