Thumbnail Generation Using Separate Processor to Reduce ISP Load

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Electronic devices face processing speed delays when handling image data from multiple image sensors due to the reliance on a single Image Signal Processor (ISP) for various image processing tasks.

Innovation Solution

Implementing a separate processor for generating thumbnail data and interlocking it with capture image data using metadata, allowing for efficient processing and storage of image data without overburdening the ISP.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single Image Signal Processor (ISP) is used to process image data from multiple image sensors, then device complexity is reduced, but processing speed decreases

Engineering Contradiction:
Improvenumber of image processing unitsVSAvoidprocessing speed
Core Design Contradiction:
Device complexityVSSpeed

Solution Approach 1:

The patent divides the image processing workload into two separate processing paths: a first image processing unit that processes first image data from a first image sensor, and a second image processing unit that processes second image data from a second image sensor. This segmentation allows parallel processing of multiple image streams simultaneously, thereby improving processing speed while maintaining manageable device complexity through functional separation.

Inventive Principle:
Principle #1Segmentation

2Device complexity

If a single Image Signal Processor (ISP) handles all image processing tasks, then device structure is simplified, but processing delay increases

Engineering Contradiction:
Improvestructure complexityVSAvoidprocessing delay
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The patent segments the image processing function into multiple dedicated processing units, each handling specific image data streams from different sensors. This segmentation enables concurrent processing of multiple images, significantly reducing processing delay and wait times while maintaining a structured and organized device architecture through clear functional separation.

Inventive Principle:
Principle #1Segmentation

3Device complexity

If one processor generates both preview images and thumbnail data, then device complexity is minimized, but processing efficiency decreases

Engineering Contradiction:
Improvenumber of processorsVSAvoidprocessing efficiency
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent creates a dedicated thumbnail generation unit that operates independently from the main image processing units. This thumbnail generation unit receives processed image data and generates thumbnail versions specifically optimized for display purposes. By separating thumbnail generation from main image processing, the system achieves parallel execution of different processing tasks, thereby improving overall processing efficiency while maintaining a reasonable number of processing components.

Inventive Principle:
Principle #1Segmentation

4Device complexity

If the ISP processes all image data, then data flow is simplified, but the ISP becomes overloaded and processing speed decreases

Engineering Contradiction:
Improvedata flow complexityVSAvoidimage data processing speed
Core Design Contradiction:
Device complexityVSSpeed

Solution Approach 1:

The patent implements multiple image processing units that each handle specific image data streams from different sensors independently. This segmentation distributes the processing load across multiple units, preventing any single unit from becoming overloaded. The data flow remains organized and manageable through dedicated processing paths, while processing speed improves significantly due to parallel processing capabilities.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11509807B2Electronic device and method for generating thumbnails based on captured images
Publication Date: 2022.11.22 SAMSUNG ELECTRONICS CO LTD
  • US11509807B2 patent drawing
  • US11509807B2 patent drawing
  • US11509807B2 patent drawing

AI summary

An electronic device includes a first image sensor, a second image sensor, one or more image processing modules, and a display. The first image sensor generates first image data. The second image sensor generates second image data. The one or more image processing modules process one or more image data among the first image and the second image data. The display displays the one or more image data among the first image data or second image data processed by the one or more image processing modules. The thumbnail generation module generates thumbnail data using the one or more image data among the first image data and second image data processed by the one or more image processing modules. A method includes converting the plurality of image data into a format displayable on a display, and generating thumbnail data using the image data of the displayable format.