Camera Motion Blur Correction Using Photogrammetric Range Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High-quality large aperture lenses are expensive, difficult to manufacture, and prone to focus errors, while smaller apertures result in unnatural, flat images with excessive depth of field, limiting the ability to achieve desired depth of field and bokeh effects.
Innovation Solution
A camera system that captures photogrammetric range data simultaneously with image data, allowing for post-processing to simulate a larger aperture, enabling the selection of depth of field and bokeh effects, even with fixed aperture lenses, by using additional sensors and light sources to measure distance and intensity, and adjusting focus points.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If a large aperture lens is used, then the depth of field is reduced and bokeh effects are improved, but the lens becomes more expensive, heavier, and more prone to focus errors
Solution Approach 1:
The system performs preliminary capture of multiple images at different focus distances before final processing. By capturing a series of images focusing on different planes (near, mid, far) and storing the focus distance information, the system prepares all necessary data in advance to later simulate any desired depth of field effect without requiring actual large aperture optics, thereby avoiding focus precision issues while achieving the same aesthetic effect
Solution Approach 2:
The system creates a digital copy of the optical effect by using depth mapping and image processing to simulate the appearance of large aperture photography. Instead of physically capturing with a large aperture lens, the system copies the visual characteristics (shallow depth of field, bokeh) through computational methods applied to images taken with smaller aperture lenses, eliminating manufacturing complexity and focus error concerns
2Reliability
If a small aperture lens is used, then the depth of field increases and all objects appear sharp, but the images appear unnatural and flat without bokeh effects
Solution Approach 1:
The system dynamically adjusts the simulated depth of field based on distance information from active stereo vision sensors. By calculating which objects are in the foreground versus background using photogrammetric data, the system dynamically applies blur effects to appropriate regions, enabling adaptability in depth of field control while maintaining reliable image quality across different scenes and subjects
Solution Approach 2:
The system changes the depth of field parameter selectively across different regions of the image based on distance data. By using the measured distance to objects from stereo vision to control the amount of blur applied to different portions of the image, the system achieves versatile depth of field control that adapts to scene content while maintaining overall image quality consistency
3Adaptability or versatility
If multiple images at different focus distances are captured, then post-processing flexibility is improved, but the capture time and processing complexity increase
Solution Approach 1:
The system uses periodic action by capturing images in rapid succession at different focus distances, then processes them periodically to extract depth information. The active stereo vision system periodically measures distance to objects, and this depth data is then periodically applied to enhance or adjust the depth of field in post-processing, maintaining flexibility while minimizing time loss through efficient periodic measurement and processing cycles
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the creation of images with desired depth of field and bokeh effects without the need for high-cost, large aperture lenses, reducing manufacturing complexity and focus errors, while maintaining high image quality and flexibility in post-processing.
Implementation Method 1
capturing photogrammetric range data pertaining to depth of objects in a field of view of the camera
Data Source
AI summary
A camera apparatus includes a photogrammetric range sensor, small aperture lens and a processor configured to carry out a method for simulating a large aperture lens. The method includes capturing a photographic image data of a scene using the camera with the lens set to a small aperture size. Simultaneously or near-simultaneously with capturing the image, the camera captures photogrammetric range data pertaining to depth of objects in a field of view of the camera, using the range sensor. The processor then processes the photographic image data using the photogrammetric range data to obtain second photographic data simulating an image captured using a lens set to an aperture size larger than the small aperture size.