Stereo Camera Wobulation Complementing for High Frame Rate
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional wobulation-based pixel-shifting technology in stereo cameras requires capturing and processing four or more images to generate a single high-resolution image, leading to reduced frame rates, high computational intensity, and inability to meet visual quality requirements such as high resolution, small pixel size, large field of view, and high frame rate in applications like XR devices.
Innovation Solution
The proposed imaging system and method incorporate complementing wobulation in stereo cameras, reducing the number of wobulation steps by capturing and processing only two or three consecutive pairs of sub-images, which are then processed to generate highly accurate and realistic stereo images at an acceptably high frame rate.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If conventional wobulation-based pixel-shifting technology captures four or more images to generate a single high-resolution image, then image resolution is improved, but frame rate deteriorates to one-fourth or less
Solution Approach 1:
The patent divides the image capture task into two independent stereo pairs instead of requiring four images. Each stereo pair captures complementary sub-pixel shifted images, and the system processes these two pairs to generate high-resolution stereo images. This segmentation reduces the number of required images from four or more to just two, directly improving frame rate while maintaining resolution quality.
2Manufacturing precision
If conventional wobulation-based pixel-shifting technology processes four or more images, then high-resolution images are generated, but computational intensity and processing time increase significantly
Solution Approach 1:
The patent applies partial action by processing only two stereo pairs of sub-pixel shifted images instead of four or more images required by conventional methods. The complementing wobulation technique ensures that these two pairs contain sufficient complementary information to generate high-resolution images through efficient processing, reducing computational intensity and processing time while maintaining image quality.
3Manufacturing precision
If conventional wobulation-based pixel-shifting technology is used, then apparent spatial super-resolution is achieved, but the system cannot meet visual quality requirements for high frame rate (90 FPS or higher) in XR devices
Solution Approach 1:
The patent merges the capture of two stereo pairs of sub-pixel shifted images with complementing wobulation to achieve both high spatial resolution and high frame rate. By combining the complementary information from these two pairs and processing them efficiently, the system generates high-resolution stereo images at frame rates of 90 FPS or higher, meeting XR device visual quality requirements that conventional methods cannot satisfy.
Data Source
AI summary
An imaging system is disclosed. In a cycle, two or three consecutive pairs of first sub-images and second sub-images are captured using a first image sensor and a second image sensor respectively, while wobulators are controlled to perform, during the cycle, one or two first sub-pixel shifts and one or two second sub-pixel shifts, respectively. A given first sub-pixel shift is performed in first direction, while a given second sub-pixel shift is performed in a second direction different from the first direction The first sub-images and the second sub-images of the cycle are processed, to generate a first image and a second image, respectively.