Image Processing Offloading via Cloud Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image processing electronic devices face challenges with high chip costs and overheating due to integrated image signal processors (ISPs), and existing cloud-based image processing services struggle with complex algorithms and hardware requirements for image correction.

Innovation Solution

An electronic device that communicates with a cloud server to obtain image correction information, processes images using this information, and performs corrections using a state-of-the-art algorithm, reducing the need for high-performance ISPs and enabling efficient image processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image signal processors (ISPs) are integrated inside application processors of electronic devices, then image processing capability is improved, but chip cost increases and overheating issues occur

Engineering Contradiction:
Improveimage processing capabilityVSAvoidchip cost
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the complex image processing algorithms from the integrated ISP hardware and implements them as separate software modules that can be executed by general-purpose processors. This allows the device to achieve advanced image processing capabilities without integrating expensive and heat-generating dedicated ISP hardware into the application processor.

Inventive Principle:
Principle #2Taking out (Extraction)

2Manufacturing precision

If advanced image correction algorithms are implemented in cloud servers, then image quality is improved, but processing time and data transmission requirements increase

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent implements a hybrid approach where basic image processing is performed locally on the device, and only specific correction tasks requiring advanced algorithms are offloaded to the cloud server. This partial offloading strategy achieves high image quality through sophisticated algorithms while minimizing processing time by handling routine tasks locally.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent introduces a selective task distribution mechanism that acts as an intermediary between local processing and cloud-based processing. This mediator determines which image correction tasks should be executed locally and which should be transmitted to the cloud server, optimizing the balance between image quality and processing time.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3590092B1Electronic device for processing image acquired by using camera and method for operating the same
Publication Date: 2023.09.06 SAMSUNG ELECTRONICS CO LTD
  • EP3590092B1 patent drawingFigure 1
  • EP3590092B1 patent drawingFigure 2
  • EP3590092B1 patent drawingFigure 3

AI summary

An electronic device is disclosed. The electronic device includes a camera, a communication module, and a processor. The processor is operably coupled with the camera and the communication module. The processor is configured to obtain a first image corresponding to an external object using the camera. The processor is also configured to generate a second image smaller in data size than the first image using the first image. The processor is further configured to transmit the second image to an external electronic device through the communication module. The processor is also configured to receive correction area information from the external electronic device through the communication module. The correction area information is based on information associated with an image area identified from the second image. The processor is further configured to perform correction using the first image based on at least part of the correction area information.