Curved Focus Surface Generation in Multi-View Image Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing imaging techniques fail to generate images with a shallow depth of field that maintain focus on multiple objects not aligned on the same plane, and existing methods for refocusing or changing the depth of field often result in deepening the depth of field or using pan-focus, which prevents the creation of images with a shallow depth of field.
Innovation Solution
An image processing method that composites multi-view image data from a plurality of viewpoints to generate synthetic image data focused on a curved focus surface, using a multi-view camera with multiple image capturing units to capture images from different positions and process them to create a virtual focus surface, allowing for focus on arbitrary objects not on a plane.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If refocus process is performed based on plurality of images from different viewpoints, then focus on multiple objects is achieved, but depth of field is deepened
Solution Approach 1:
The patent applies curvature by modeling the focus surface as a curved surface rather than a flat plane. This allows the focus surface to conform to the three-dimensional arrangement of multiple objects at different depths, enabling sharp focus on objects throughout the curved surface while maintaining a shallow depth of field effect. The curved focus surface matches the spatial distribution of in-focus objects, resolving the contradiction between focusing on multiple objects and maintaining shallow depth of field.
2Adaptability or versatility
If pan-focus is used to focus on multiple objects, then all objects fall in focus, but shallow depth of field cannot be obtained
Solution Approach 1:
The patent applies local quality by allowing different regions of the image to have different focus characteristics. Instead of uniform focus across the entire image (pan-focus), the focus is selectively applied to specific local regions corresponding to objects on the curved focus surface. This enables sharp focus on targeted objects while maintaining blur in other regions, achieving both focus flexibility and shallow depth of field simultaneously.
3Adaptability or versatility
If image compositing is performed for objects not on the same plane, then focus on arbitrary surface is achieved, but technical complexity increases
Solution Approach 1:
The patent applies preliminary action by pre-calculating and storing depth information and focus surface geometry before the actual image compositing process. The system determines the curved focus surface and depth data in advance based on the spatial arrangement of objects, then uses this pre-computed information during image synthesis. This preliminary preparation simplifies the main compositing operation and reduces overall processing complexity while achieving flexible focus on arbitrary surfaces.
Data Source
AI summary
An image processing apparatus and method relate to an imaging process which is applied to image data captured by an image capturing apparatus such as a multi-eye camera, multi-view camera, and the like. The image processing apparatus and method generates synthetic image data which focused on a curved focus surface by compositing multi-view image data captured from multi-viewpoints.