Single Lens Auto Focus Stereo 3D Image Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing stereo image generation systems face challenges in achieving accurate 3D video display using two lenses, as they are complex, costly, and prone to errors due to intensity variations, especially when using laser or infrared methods, and require extensive algorithm development for segmentation-based approaches.
Innovation Solution
A single lens auto focus system that captures multi-focus 2D images, uses depth estimation and depth image-based rendering (DIBR) to generate stereo 3D images, simplifying the process and eliminating the need for multiple lenses, with a computation device producing all-in-focus images and depth maps to create left and right eye images for 3D display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If two lenses are used for stereo image generation, then depth information can be captured, but device complexity and cost increase significantly
Solution Approach 1:
The patent segments the depth information capture process into multiple 2D images taken at different focal lengths, then processes these segmented images computationally to reconstruct depth maps and generate stereo pairs, replacing the need for physical segmentation into multiple lenses
Solution Approach 2:
The patent replaces the mechanical/optical system of multiple lenses with a computational system that uses image processing algorithms to extract depth information from multi-focus 2D images, substituting physical depth capture with computational depth reconstruction
2Measurement precision
If laser or infrared methods are used for depth detection, then depth information can be obtained, but errors increase due to intensity variations
Solution Approach 1:
The patent creates multiple copies of the same scene at different focal lengths rather than using active illumination copies, then processes these copies to derive depth information, avoiding the intensity variation problems of laser/infrared methods
Solution Approach 2:
The patent changes the focal length parameter of the lens to capture multiple images at different focus planes, then uses these parameter-varied images to compute depth maps through computational methods, avoiding intensity-based measurement errors
3Measurement precision
If segmentation-based algorithms are used for stereo image generation, then depth information can be extracted, but extensive algorithm development and processing time are required
Solution Approach 1:
The patent performs preliminary capture of multi-focus 2D images that contain embedded depth information, then uses pre-established computational algorithms to extract depth maps and generate stereo pairs, reducing the need for extensive real-time algorithm development and processing
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for efficient and automatic generation of stereo 3D videos without altering the camera, reducing costs and errors, and providing consistent depth information for enhanced user experience.
Implementation Method 1
a capturing device with an auto focus module for taking plural multi-focus 2D images
Implementation Method 2
uses depth estimation and depth image-based rendering (DIBR) to generate stereo 3D images, simplifying the process
Implementation Method 3
a 3D display device with depth image based rendering (DIBR) module connected with the computation device to receive the all-in-focus image and the depth map and then produce a left image for left eye of user and a right image for right eye of user
Data Source
AI summary
The invention presents a single lens auto focus system of stereo image generation and a method thereof. The stereo three-dimensional (3D) image capturing method of a single lens auto focus camera, includes the steps of a) taking plural multi-focus images; b) estimating the plural multi-focus images to obtain a depth map and an all-in-focus image; c) mixing the depth map with plural background depth maps to obtain a mixed depth map; d) obtaining respectively a left image for left eye of user and a right image for right eye of user by means of depth image based rendering (DIBR); and e) outputting the left image and the right image, thereby displaying a stereo image onto a 3D display.