Dynamic RAW Image Processing Allocation Across Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current imaging devices, such as smartphones and digital cameras, face inefficiencies in processing RAW image data due to the high computational demands of development processing, which can be time-consuming on general PCs or smartphones, and even cloud servers are not optimized for fine adjustments, leading to inefficiencies for users with high-performance PCs.

Innovation Solution

A communication apparatus system that includes a PC, smartphone, and server, where the control unit determines the performance of each device and optimally allocates image processing tasks, with the server handling RAW development and the device handling RGB adjustments, allowing efficient distribution of processing loads based on performance and communication speed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If development processing is executed on a general PC or smartphone, then the device can process RAW image data, but the processing time becomes excessively long

Engineering Contradiction:
Improvedevelopment processing speedVSAvoidprocessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The development processing is divided into two distinct stages: RAW development processing (computational intensive) and RGB adjustment processing (fine tuning). The patent assigns different execution locations to these stages based on device performance, allowing the heavy computation to be offloaded to a server while preserving the ability to perform local optimizations on devices with sufficient computational power.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a server as an intermediary processing node between the imaging apparatus and the final output. The server performs the computationally intensive RAW development processing, acting as a mediator that handles the heavy lifting while allowing client devices to focus on user interaction and fine adjustments.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of time

If cloud server is used for development processing, then processing time is reduced, but the server executes all processing including fine adjustments even when not needed

Engineering Contradiction:
Improveprocessing timeVSAvoidprocessing efficiency
Core Design Contradiction:
Loss of timeVSProductivity

Solution Approach 1:

The patent implements a dynamic processing architecture where the execution location of RGB adjustment processing varies based on the client device's performance characteristics. The system dynamically determines whether to execute fine adjustments on the server or locally, optimizing the balance between processing speed and computational resource utilization.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies different processing quality levels to different stages: RAW development processing is executed with high computational precision on the server, while RGB adjustment processing is selectively executed with varying precision depending on the client device's capabilities. This allows the system to maintain high quality where needed while reducing unnecessary computational overhead.

Inventive Principle:
Principle #3Local quality

3Productivity

If high-performance PC is used for development processing, then processing speed is fast, but the user feels inefficient when the server executes even small calculation amount processing

Engineering Contradiction:
Improveprocessing speedVSAvoiduser efficiency perception
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent enables client devices to autonomously determine their own processing role based on their performance characteristics. High-performance devices can self-assign the task of executing RGB adjustment processing locally, eliminating the need to rely on server processing for even minor calculations and thereby improving perceived user efficiency.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11283938B2Communication apparatus communicating with another communication apparatus based on performance, control method, and storage medium
Publication Date: 2022.03.22 CANON KK
  • US11283938B2 patent drawing
  • US11283938B2 patent drawing
  • US11283938B2 patent drawing

AI summary

A first communication apparatus includes a communication unit configured to communicate with a second communication apparatus, an image processing unit, and a control unit. The control unit generates the first image data from the RAW image data received from the second communication apparatus. In a case where the control unit determines that a performance of the second communication apparatus is equal to or higher than a predetermined performance, the control unit transmits the first image data to the second communication apparatus. In a case where the control unit determines that a performance of the second communication apparatus is lower than the predetermined performance, the control unit generates the second image data from the first image data, and transmits the generated second image data to the second communication apparatus.