Image Processing Device Correcting Distortion Across Camera Modules

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image systems with multiple camera modules experience image distortion when combining images corrected by image stabilizers with those not corrected by them, due to differences in tilt ranges and calibration data.

Innovation Solution

An image processing device with first and second image distortion correction circuits, and an image processing unit that receives corrected images from these circuits, performs image processing, and adjusts images based on calibration data and tilt ranges to minimize distortion and motion blur, even when one camera module lacks an image stabilizer.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If image stabilizer is applied to all camera modules, then image quality is improved, but device complexity and cost increase

Engineering Contradiction:
Improveimage qualityVSAvoiddevice complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent introduces an image processing device as an intermediary that receives images from camera modules with different image stabilizer configurations. This device performs distortion correction using calibration data and generates corrected images that can be seamlessly combined, allowing the system to achieve high image quality without requiring all camera modules to have image stabilizers.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the approach from hardware-based uniformity (all modules having image stabilizers) to software-based parameter adjustment. By using calibration data to adjust distortion parameters and applying correction algorithms, the system achieves consistent image quality across modules with different hardware configurations, thereby reducing overall device complexity.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If images from camera modules with different image stabilizer configurations are combined, then versatility is improved, but image distortion occurs

Engineering Contradiction:
ImproveversatilityVSAvoidimage distortion
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent performs preliminary distortion correction on images from camera modules before combining them. The image processing device applies correction operations using calibration data specific to each module's configuration, ensuring that images from modules with different image stabilizer setups are pre-adjusted to a common reference, thereby preventing distortion in the final combined image.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses calibration data as feedback information that characterizes the specific distortion properties of each camera module. This feedback is used to adjust the correction parameters dynamically, allowing the system to accommodate different image stabilizer configurations while maintaining consistent image quality across all modules.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If tilt range correction is applied to accommodate camera module differences, then adaptability is improved, but processing complexity increases

Engineering Contradiction:
ImproveadaptabilityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The image processing device serves multiple functions: it receives images from various camera module configurations, performs distortion correction using calibration data, applies tilt range adjustments, and generates corrected images ready for combination. This universal processing approach handles different module types through a single integrated solution, improving adaptability while consolidating processing complexity into one dedicated device rather than requiring complex handling in each camera module.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10225474B2Image processing device and system
Publication Date: 2019.03.05 SAMSUNG ELECTRONICS CO LTD
  • US10225474B2 patent drawing
  • US10225474B2 patent drawing
  • US10225474B2 patent drawing

AI summary

An image processing device includes a first image distortion correction circuit configured to receive a first image and first calibration data from a first camera module, and perform correction on the first image based on the first calibration data; a second image distortion correction circuit configured to receive a second image and second calibration data from a second camera module, receive a first tilt range from the first camera module, and perform correction on the second image based on the second calibration data and the first tilt range; and an image processing unit (IPU) configured to receive corrected first and second images from the first and second image distortion correction circuits, and perform image processing on the corrected first and second images, wherein the first image is obtained by correcting an image acquired from an image sensor of the first camera module based on the first tilt range.