Multimode Hybrid Image Sensor Shutters for Distortion Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image sensors face challenges in capturing undistorted images for virtual reality (VR), augmented reality (AR), and mixed reality (MR) applications due to the introduction of distortions by rolling shutters, while global shutters are larger and more expensive, and employing multiple sensors increases cost and complexity.
Innovation Solution
A hybrid image sensor with multimode shutters that includes both global and rolling shutter functionality, utilizing a pixel array with a charge storage device and correlated double sampling (CDS) components, allowing for high-resolution rolling-shutter mode and low-resolution global-shutter mode operations, enabling simultaneous integration of all pixels for undistorted images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a rolling shutter is used, then the device complexity is reduced, but image distortion occurs
Solution Approach 1:
The patent implements a multimode shutter that can dynamically switch between rolling shutter mode and global shutter mode based on application requirements. The shutter is not fixed in one configuration but can adapt its operation mode, allowing the system to use rolling shutter for normal operation (low complexity) and global shutter when undistorted images are needed (high quality mode).
Solution Approach 2:
The shutter's operational parameters are changed by switching between different modes. The patent modifies the shutter's behavior from a single fixed mode to multiple configurable modes, where the global shutter mode captures all pixels simultaneously to eliminate distortion, while the rolling shutter mode provides simpler operation for standard applications.
2Object-affected harmful factors
If a global shutter is used, then image distortion is eliminated, but the device complexity and cost increase
Solution Approach 1:
The patent creates a universal shutter system that performs multiple functions: it can operate as a rolling shutter for standard applications and as a global shutter for applications requiring undistorted images. This multi-functionality eliminates the need for separate sensors or fixed global shutter designs, reducing overall system complexity while maintaining the ability to eliminate distortion when needed.
Solution Approach 2:
The shutter dynamically adapts its operation mode based on the application requirements. Rather than being a fixed global shutter that always captures all pixels simultaneously, the system can switch to rolling shutter mode when distortion is not an issue, thereby reducing complexity and power consumption while maintaining the option to eliminate distortion when required.
3Adaptability or versatility
If multiple sensors are used, then both rolling-shutter and global-shutter functionality are achieved, but the device complexity and cost increase
Solution Approach 1:
The patent implements a single sensor with a multimode shutter that provides both rolling-shutter and global-shutter functionality. This universal approach eliminates the need for multiple separate sensors, reducing device complexity, cost, and power consumption while maintaining the versatility to switch between different shutter modes based on application needs.
Solution Approach 2:
The patent merges the functionality of multiple sensors into a single sensor by implementing a multimode shutter that can operate in both rolling and global modes. This combining approach reduces the overall system complexity by integrating what would otherwise require separate sensor components into one unified device.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The hybrid sensor captures high-quality images suitable for both user presentation and computer vision processes, reducing distortion and complexity by enabling both rolling-shutter and global-shutter modes within a single sensor, thus enhancing VR/AR/MR experiences without the need for multiple sensors.
Implementation Method 1
each pixel comprising a light-sensing element configured to generate and store a charge in response to incoming light
Data Source
Figure 1A
Figure 1B
Figure 2
AI summary
Hybrid image sensor with multimode shutters includes a plurality of pixel arrays each comprising: a charge storage device to receive charge from each of the light sensing elements of the pixel array; a first plurality of switches, each switch of the first plurality of switches connected between a respective pixel of the pixel array and the charge storage device; a second plurality of switches, the second plurality of switches comprising a rolling shutter selection switch and a global shutter selection switch, each of the rolling shutter selection switch and the global shutter selection switch connected in parallel to an output of the charge storage device; a plurality of pixel output lines, each pixel output line configured to output signals representative of pixel values corresponding to one or more pixel arrays coupled to the respective pixel output line.