All-in-focus Image Generation via Multi-focal Depth Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image capturing technologies often result in some objects in a scene appearing out of focus due to varying distances from the camera, limiting the ability to view all objects clearly in a static image.
Innovation Solution
A method and apparatus for generating an all-in-focus image by obtaining multiple images at different focal lengths, creating depth maps using various neighborhood sizes, and combining these images to produce a composite image with extended depth-of-field and refocusing capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a single image is captured at a fixed focal length, then the camera structure remains simple and operation is straightforward, but only objects at the focal length appear in focus while other objects appear blurry
Solution Approach 1:
The image capture process is segmented into multiple shots, each focused on a different depth plane. The system divides the scene into multiple focal layers and captures them separately, then combines them computationally to achieve all-in-focus results without requiring complex optical hardware
Solution Approach 2:
The system transitions from capturing a single 2D image at one focal length to capturing multiple 2D images at different focal lengths, effectively adding a third dimension (focal depth) to the capture process. This enables depth discrimination and all-in-focus composite generation
2Reliability
If multiple images at different focal lengths are captured to achieve all-in-focus, then all objects can appear in focus, but the image processing complexity increases due to depth map generation and composite image creation
Solution Approach 1:
The system performs preliminary actions by capturing multiple focused images and generating depth maps in advance. This pre-processing enables later refocusing operations and all-in-focus composite generation without requiring complex real-time processing during image display
Solution Approach 2:
Depth maps serve as intermediary data structures that bridge the captured images and the final all-in-focus composite. These intermediate representations enable efficient computation of focus regions and facilitate refocusing operations without requiring direct manipulation of the original multi-focal images
3Adaptability or versatility
If a static image with fixed focus is displayed, then the display system remains simple, but users cannot refocus on different portions of the scene
Solution Approach 1:
The system transforms the static, fixed-focus image into a dynamic, interactively refocusable display. Users can dynamically adjust the focal plane by selecting different regions of interest, and the system dynamically generates refocused images based on the selected region and stored depth information
Solution Approach 2:
The captured multi-focal images and depth maps serve multiple functions: they enable generation of all-in-focus composites, support interactive refocusing on any region, and provide depth information for various post-processing operations. This multi-functionality is achieved without requiring separate hardware systems for each function
Data Source
AI summary
Techniques are described for generating an all-in focus image with a capability to refocus. One example includes obtaining a first depth map associated with a plurality of captured images of a scene. The plurality of captured images may include images having different focal lengths. The method further includes obtaining a second depth map associated with the plurality of captured images, generating a composite image showing different portions of the scene in focus (based on the plurality of captured images and the first depth map), and generating a refocused image showing a selected portion of the scene in focus (based on the composite image and the second depth map).