Real-Time Depth of Field Control via Gesture and Depth Sensor
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Most cameras, including embedded devices like cell phone cameras and Google Glass, lack the ability to create depth of field focus effects in real-time due to their pinhole aperture, which restricts their ability to control image focus.
Innovation Solution
A digital imaging system that pairs a depth-scene image sensor with a scene sensor, using depth sensor data to generate focus effects in real-time by detecting user gestures and applying blur based on depth information, allowing for dynamic control of image focus.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If a pinhole aperture is used in embedded cameras, then the device cost is reduced and structure is simplified, but the ability to create depth of field focus effects is lost
Solution Approach 1:
The patent introduces depth sensor data as an intermediary element that enables focus control without requiring a variable aperture mechanism. The depth information acts as a mediator between the fixed pinhole aperture and the desired focus effect, allowing the system to achieve depth of field effects through computational processing rather than optical hardware changes.
Solution Approach 2:
The patent replaces the mechanical aperture system with a computational approach. Instead of using a variable aperture to control focus, the system uses depth sensor data and image processing algorithms to achieve focus effects, substituting mechanical components with software-based solutions.
2Adaptability or versatility
If a variable aperture lens is used to achieve depth of field effects, then focus control capability is improved, but device complexity and cost increase
Solution Approach 1:
The patent replaces complex mechanical aperture systems with a simpler configuration consisting of a fixed pinhole aperture combined with depth sensors and computational processing. This substitution reduces mechanical complexity while achieving the same functional outcome through software-based focus control.
Solution Approach 2:
The patent creates a computational model of the optical focusing process by using depth sensor data to simulate what a variable aperture would achieve. The system copies the effect of a variable aperture through image processing algorithms that apply blur based on depth information, avoiding the need for actual mechanical aperture components.
3Adaptability or versatility
If real-time focus effects are implemented using traditional methods, then focus control is achieved, but processing time and computational load increase
Solution Approach 1:
The patent performs preliminary action by capturing depth sensor data simultaneously with the scene image, rather than calculating depth from the image itself. This pre-captured depth information is ready for immediate use in focus processing, eliminating the need for computationally intensive post-processing depth estimation and enabling real-time focus effects.
Solution Approach 2:
The patent segments the imaging system into independent components: a fixed aperture camera for capturing the scene, a separate depth sensor for capturing depth information, and a processing unit that combines both. This segmentation allows each component to operate independently and efficiently, with the depth data already prepared for focus processing without requiring additional computational overhead.
Data Source
AI summary
A method of controlling image focus in a digital imaging system is provided that includes receiving a depth-scene image pair generated by a depth-scene image sensor pair comprised in the digital imaging system, aligning the depth image with the scene image wherein each pixel in the scene image has a corresponding depth in the aligned depth image, detecting a user gesture associated with a focus effect, and blurring, responsive to the user gesture, at least a portion of the scene image according to the focus effect, wherein the blurring is based on depths in the depth image.