Curved Texture Joining for Seamless Panoramic Image Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing techniques for creating panoramic still images from moving images captured along a free two-dimensional camera trajectory often result in noticeable distortions and seams due to differences in brightness or color, especially when the camera trajectory is two-dimensionally changed.
Innovation Solution
An image processing apparatus and method that derive and utilize motion vectors between images to join circular or elliptical textures, which are written into a frame memory based on these vectors, allowing for the generation of a joined image with reduced distortions and seams, regardless of the camera's direction of movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If rectangular textures are used for joining images along a free two-dimensional camera trajectory, then the joined image can be generated efficiently, but distortions and seams become noticeable due to brightness or color differences
Solution Approach 1:
The patent applies curvature by using circular textures instead of rectangular textures for joining images. The circular shape allows for smooth blending at the boundaries of adjacent textures, eliminating the sharp edges that cause visible seams and distortions in rectangular textures. This curved approach maintains efficiency while significantly improving the visual quality of the panoramic image.
2Manufacturing precision
If textures are spaced out in time to reduce distortions and seams, then the quality of the joined image improves, but the complexity of motion vector derivation increases
Solution Approach 1:
The patent segments the texture selection process by deriving motion vectors for multiple textures at different spatial resolutions (first texture at full resolution, second texture at reduced resolution). This segmentation allows the system to efficiently derive motion vectors at coarse levels first, then refine at finer levels, reducing the overall computational complexity while maintaining high image quality through proper temporal spacing of textures.
3Manufacturing precision
If circular or elliptical textures are used instead of rectangular textures, then distortions and seams are reduced, but the device complexity increases due to additional processing requirements
Solution Approach 1:
The patent implements a dynamic texture writing process where the system adaptively selects and writes circular or elliptical textures based on motion vector calculations. The texture writing unit dynamically adjusts which textures to write and where, based on real-time motion analysis. This dynamic approach allows the system to achieve high-quality seamless images while managing processing complexity through intelligent, adaptive behavior rather than static complex processing for all textures.
Data Source
AI summary
Provided are an image processing apparatus, an image processing method, a program, and a camera which are cable of generating a joined image in which distortions and seams are less likely to occur. An image processing apparatus according to an exemplary embodiment generates a joined image by joining a plurality of textures based on a plurality of images, and includes a second derivation unit that derives a motion between images of the plurality of images, and a texture writing unit that writes, into a frame memory, the plurality of textures that form the joined image, based on the motion between the images. The plurality of textures include a texture having such a shape that at least a part of an outline thereof is curved.