Application Processor Zoom Control via Multi-Camera ROI Scaling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional multi-camera systems face difficulties in adjusting the zoom function effectively, as digital zoom is based on the center point of the frame, leading to rapid changes in field of view and making it challenging for users to adjust the system when the object of interest is not centered, especially at high zoom ratios.

Innovation Solution

The implementation of application processors that scale image data from multiple camera modules with different fields of view, allowing users to input a zoom ratio and region of interest, enabling the system to generate and display converted image data while controlling the camera modules to adjust their field of view accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If digital zoom is performed based on the center point of the frame, then the zoom function can be implemented, but the field of view changes rapidly and it becomes difficult for users to adjust when the object is not centered

Engineering Contradiction:
Improvezoom function performanceVSAvoiduser adjustment difficulty
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The system pre-processes image data from multiple camera modules with different fields of view, preparing scaled versions of images before user interaction. When a user selects a zoom ratio, the system can immediately display the corresponding region from the pre-processed data without requiring real-time processing or manual camera adjustment, thus resolving the adjustment difficulty while maintaining zoom performance

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces an intermediate processing layer that receives data from multiple camera modules and generates converted image data based on zoom ratios and regions of interest. This intermediary process allows the system to present a stable, user-friendly interface while coordinating the complex multi-camera data in the background, eliminating the need for users to manually adjust camera angles

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If the field of view is considerably decreased for high ratio zoom, then zoom magnification is achieved, but even slight movement of the camera system causes rapid FoV changes

Engineering Contradiction:
Improvezoom magnificationVSAvoidfield of view stability
Core Design Contradiction:
Measurement precisionVSStability of the object's composition

Solution Approach 1:

The system merges data from multiple camera modules with different fields of view into a unified image processing stream. By combining the wide-angle view from one camera with the telephoto view from another, the system achieves high zoom magnification while maintaining stability, as the region of interest can be extracted from the appropriate camera's data without requiring precise mechanical stabilization

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system segments the image processing task by dividing the full image into regions of interest based on the selected zoom ratio. For high zoom ratios, the system extracts and scales only the relevant region from the appropriate camera module's data, achieving magnification without the instability that would result from mechanically adjusting a single camera's field of view

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11683466B2Application processor, electronic device including the same and operation method of the electronic device
Publication Date: 2023.06.20 SAMSUNG ELECTRONICS CO LTD
  • US11683466B2 patent drawing
  • US11683466B2 patent drawing
  • US11683466B2 patent drawing

AI summary

An electronic device includes: a display; a first camera module having a first field of view (FoV) and generating first image data; a second camera module having a second FoV that is less than the first FoV and generating second image data; and an application processor configured to obtain zoom information including a zoom ratio and a region of interest (ROI) determined based on a user's input, to generate converted image data by scaling an image area corresponding to the ROI with respect to image data corresponding to the zoom ratio from among the first image data and the second image data, and to control the display to display the converted image data.