Multi-Camera Image Correction for Omnidirectional FOV Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Apparatuses used for generating images, such as panoramic and omnidirectional images, often encounter issues due to cameras having different fields of view (FOV) than the designated FOV, requiring a method to adjust the scene to match the designated FOV.

Innovation Solution

An electronic device equipped with multiple cameras, including one with a first optical axis, a second with a second optical axis, and a third perpendicular to both, along with a processor that acquires images from these cameras, identifies correction values for the optical axes and transmits corrected images or correction information to enable the generation of omnidirectional images based on the designated FOV.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple cameras with different fields of view are used to generate omnidirectional images, then the coverage area is improved, but the image processing complexity increases due to FOV mismatch

Engineering Contradiction:
Improvecoverage areaVSAvoidimage processing complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by calculating correction values for the optical axes of cameras based on their actual fields of view versus the designated field of view. These correction values are then used to transform and reposition image data, adjusting the geometric parameters of the captured images to match the expected FOV configuration for omnidirectional image generation.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If cameras with different fields of view are used, then the versatility of the system is improved, but the manufacturing precision requirements increase

Engineering Contradiction:
ImproveversatilityVSAvoidoptical axis alignment precision
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent implements feedback by measuring the actual field of view of each camera and using this information to calculate correction values. These correction values are fed back into the image processing system to adjust the optical axis parameters, creating a closed-loop system that adapts to actual camera characteristics and compensates for manufacturing variations.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system changes the optical axis parameters of the camera data by applying calculated correction values. This allows the system to accommodate variations in actual camera FOV while maintaining the desired omnidirectional image geometry, reducing the stringency of manufacturing precision requirements.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If the field of view is corrected to match designated FOV, then the image quality is improved, but the processing time increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-calculating correction values for camera optical axes based on their actual versus designated fields of view. These correction parameters are prepared in advance and applied during image processing, allowing the system to account for FOV discrepancies before the main image generation process, thereby improving image quality while managing processing time through efficient pre-computation.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11172135B2Apparatus and method for processing image
Publication Date: 2021.11.09 SAMSUNG ELECTRONICS CO LTD
  • US11172135B2 patent drawing
  • US11172135B2 patent drawing
  • US11172135B2 patent drawing

AI summary

An apparatus according to various embodiments can include: a plurality of cameras including at least one camera having a field of view (FOV) different from the designated FOV; a communication interface; and at least one processor, wherein the at least one processor can be configured to acquire a plurality of images, including at least one image including a scene from the FOV different from the designated FOV, through the plurality of cameras, and transmit information about the plurality of images and information for changing the scene from the FOV included in the at least one image to a scene for the designated FOV to another device through the communication interface so that the other device generates another image on the basis of the plurality of images.