Dual Sensor Stereo Imaging with Diversity Combine and Mismatch Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mobile devices with dual sensors face challenges in efficiently capturing and processing high-quality stereo images and videos due to increased computational complexity, power consumption, and location mismatches between sensors, which affect the cost and performance of these devices.

Innovation Solution

A mobile device architecture with dual digital sensors, a diversity combine module, and an image processing module that combines and processes image data from both sensors to generate anaglyph images, while maintaining a fixed horizontal distance between sensors and optimizing power consumption by selectively turning off the secondary sensor in non-stereo mode.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If dual digital sensors are used to capture stereo images and videos, then stereo image and video quality is improved, but computational complexity and power consumption increase

Engineering Contradiction:
Improvestereo image and video qualityVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the image processing task into distinct segments: the first digital sensor captures the left eye view, the second digital sensor captures the right eye view, and these are then combined through diversity combining techniques. This segmentation allows independent optimization of each sensor's processing while reducing overall computational complexity through specialized processing paths for stereo imaging.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent merges image data from two separate digital sensors through diversity combining, where the left and right eye views are combined to create a single stereo image or video output. This merging process is optimized to reduce computational complexity by leveraging the spatial relationship between sensors and applying efficient combination algorithms that minimize processing requirements.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If dual digital sensors are spaced apart to achieve proper stereo baseline, then stereo depth perception is improved, but location mismatches between sensors increase

Engineering Contradiction:
Improvestereo depth perceptionVSAvoidlocation mismatches between sensors
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent employs feedback mechanisms where the system continuously monitors and adjusts for location mismatches between the two digital sensors. By measuring the actual positions of the sensors and compensating for deviations from the ideal stereo baseline configuration, the system maintains accurate depth perception despite manufacturing tolerances and assembly variations.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent dynamically adjusts processing parameters based on the actual spatial relationship between sensors. By changing parameters such as horizontal shift amounts, scaling factors, and convergence points based on measured sensor positions, the system compensates for location mismatches and maintains optimal stereo depth perception across different device configurations.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If the secondary sensor is always on to capture stereo images, then stereo image quality is maintained, but power consumption increases

Engineering Contradiction:
Improvestereo image qualityVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements dynamic sensor activation where the secondary digital sensor is turned on only when stereo imaging is required and turned off when single-view imaging suffices. This dynamic operation allows the system to adapt power consumption to actual usage requirements while maintaining stereo image quality when needed, creating a flexible power management strategy that responds to real-time operational demands.

Inventive Principle:
Principle #15Dynamics

4Adaptability or versatility

If dual digital sensors are used, then stereo functionality is added, but device cost increases

Engineering Contradiction:
Improvestereo functionalityVSAvoiddevice cost
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent designs the dual sensor system to perform multiple functions: capturing stereo images, capturing single-view images, and adapting to different operational modes. By making each sensor versatile and capable of operating independently or in combination, the system achieves stereo functionality without requiring dedicated hardware for each mode, thereby reducing overall device cost while maintaining adaptability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP2055111B1Stereo image and video capturing device with dual digital sensors and methods of using the same
Publication Date: 2016.05.04 QUALCOMM INC
  • EP2055111B1 patent drawingFigure 1
  • EP2055111B1 patent drawingFigure 2A~2B
  • EP2055111B1 patent drawingFigure 3

AI summary

An apparatus comprising a first image sensor, a second image sensor spaced apart from the first image sensor, a diversity combine module to combine image data from the first and second image sensorsinto an anaglyph, and an image processing module configured to process combined image data from the diversity combine module and to perform a vertical mismatch compensation.