Light Field Image Editing via Depth Map Region Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional imaging devices struggle with manipulating depth of field in captured images, limiting post-processing capabilities such as refocusing and bokeh modification, especially with small image sensors like those in cellular telephones, which result in a large depth of field and reduced creative control.
Innovation Solution
A system and method for manipulating captured light field image data using a processor, display, and user input device, which includes a depth map to identify regions, perform image processing operations, and synthesize images with adjustable focal planes and blur modification, enabling refocusing and bokeh manipulation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Volume of moving object
If a small image sensor is used in cellular telephones, then the device size is reduced and portability is improved, but the depth of field becomes excessively large and creative control is reduced
Solution Approach 1:
The system performs preliminary action by capturing light field data with multiple focal planes during image acquisition. This pre-captured multi-depth information enables post-processing refocusing operations, allowing creative depth of field control to be applied after the image is taken, thus resolving the limitation of fixed depth of field in small sensor devices.
Solution Approach 2:
The invention changes the parameter of focal plane position dynamically through software processing. By adjusting the focal plane parameter in post-processing, users can shift focus between different depth planes captured in the light field data, enabling creative control over depth of field without physical hardware changes.
2Ease of manufacture
If conventional imaging devices are used, then the device complexity is low and ease of manufacture is high, but post-processing capabilities for depth manipulation are limited
Solution Approach 1:
The system adds another dimension to traditional 2D imaging by capturing light field data that includes depth information across multiple focal planes. This dimensional enhancement allows post-processing manipulation of depth of field and refocusing operations without complicating the physical device structure, resolving the contradiction between simplicity and capability.
3Adaptability or versatility
If light field image data with depth maps is processed, then refocusing and bokeh modification capabilities are improved, but the computational complexity and processing time increase
Solution Approach 1:
The system performs preliminary action by pre-processing light field data into structured formats with associated depth maps during capture. This pre-organization of depth information enables efficient subsequent refocusing operations, reducing computational complexity during post-processing while maintaining advanced refocusing capabilities.
Data Source
AI summary
Systems and methods for the manipulation of captured light fields and captured light field image data in accordance with embodiments of the invention are disclosed. In one embodiment of the invention, a system for manipulating captured light field image data includes a processor, a display, a user input device, and a memory, wherein a depth map includes depth information for one or more pixels in the image data, and wherein an image manipulation application configures the processor to display a first synthesized image, receive user input data identifying a region within the first synthesized image, determine boundary data for the identified region using the depth map, receive user input data identifying at least one action, and perform the received action using the boundary data and the captured light field image data.