Light Field Video Refocusing via Depth Plane Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video processing technologies lack the ability to efficiently refocus and adjust focus depth in video data after initial capture, limiting post-production flexibility and creative control, especially in cinematography and photography applications.
Innovation Solution
A system and method for acquiring, generating, and editing refocusable video data using light field technology, which allows for the capture and manipulation of video frames with adjustable focus depth, enabling refocusing and depth of field adjustments post-acquisition through key frame selection, focus tracking, and live refocusing indicators.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional video capture methods are used, then the video data is simple and easy to process, but the ability to refocus and adjust focus depth after capture is lost
Solution Approach 1:
The system captures light field data that contains preliminary information about the scene at multiple focus depths, enabling refocusing capability to be prepared in advance during capture rather than requiring complex post-processing hardware
Solution Approach 2:
Light field data serves as an intermediary representation that bridges the gap between captured video and desired refocused output, allowing focus adjustment without direct manipulation of the original video pixels
2Adaptability or versatility
If light field technology is used to enable refocusing, then post-production flexibility is improved, but the data processing complexity increases
Solution Approach 1:
The light field data is segmented into multiple focus depth layers, allowing the system to process and manipulate specific depth planes independently, reducing overall processing complexity while maintaining flexibility
Solution Approach 2:
The system adds a focus depth dimension to the traditional 2D video data, transforming it into 5D light field data that enables refocusing while managing complexity through structured data organization
3Adaptability or versatility
If focus depth adjustment is enabled after capture, then creative control is improved, but the processing time and computational resources increase
Solution Approach 1:
Multiple focus depth information is captured preliminarily during the recording process, so that when processing is needed, the data is already prepared and only requires recombination rather than complete recalculation, reducing processing time
Solution Approach 2:
The system captures more focus depth information than a single traditional video frame would contain, storing redundant data that can be selectively used during processing to achieve creative effects without requiring extensive computational resources
Data Source
AI summary
The present invention operates in connection with refocusable video data, information, images and/or frames, which may be light field video data, information, images and/or frames, that may be focused and/or refocused after acquisition or recording. A video acquisition device acquires first refocusable light field video data of a scene, stores first refocusable video data representative of the first refocusable light field video data, acquires second refocusable light field video data of the scene after acquiring the first refocusable light field video data, determines a first virtual focus parameter (such as a virtual focus depth) using the second refocusable light field video data, generates first video data using the stored first refocusable video data and the first virtual focus parameter, wherein the first video data includes a focus depth that is different from an optical focus depth of the first refocusable light field video data, and outputs the first video data.