Image Data Processing Path Switching for Power and Performance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing electronic devices face challenges in efficiently processing image data from multiple sensors while minimizing power consumption and providing an improved user interface, particularly in switching between single and dual mode operations.

Innovation Solution

The system employs a control unit that establishes a single mode processing path using a system processing unit for data from one image sensor and a dual mode processing path using a graphic processing unit for data from multiple sensors, incorporating a camera driver, composer, media recorder, and buffers to merge and process image data, thereby reducing power consumption and enhancing user interface performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a dual mode processing path using a graphic processing unit is established for processing image data from multiple sensors, then image processing capability and user interface performance are improved, but power consumption increases

Engineering Contradiction:
Improveimage processing capabilityVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system dynamically switches between single mode (using system processing unit) and dual mode (using graphic processing unit) based on the number of active image sensors. When one sensor is active, the system uses the more power-efficient system processing unit. When multiple sensors are active, the system transitions to the graphic processing unit to handle the increased processing load, thus optimizing the balance between processing capability and power consumption.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the processing mode parameter based on the number of active image sensors. This parameter change allows the system to select the appropriate processing path (single mode or dual mode) and corresponding processor (system processing unit or graphic processing unit), enabling adaptive optimization of power consumption versus processing performance.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If image data from multiple sensors is processed simultaneously, then user interface performance and image quality are improved, but system complexity increases

Engineering Contradiction:
Improveuser interface performanceVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system segments the processing path into two distinct modes: single mode for single-sensor operation and dual mode for multi-sensor operation. Each mode has its own dedicated processing path and processor allocation. This segmentation allows the system to manage complexity by providing clear, separate processing routes rather than attempting to handle all scenarios through a single complex path.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system design provides multi-functionality by enabling the same image processing system to efficiently handle both single-sensor and multi-sensor operations. The control unit universally manages both processing modes, and the system can adaptively select the appropriate mode based on operational requirements, thus achieving universality without requiring completely separate systems for each scenario.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If switching between single mode and dual mode is implemented, then adaptability to different sensing scenarios is improved, but processing time during mode transitions increases

Engineering Contradiction:
Improveadaptability to sensing scenariosVSAvoidprocessing time during mode transitions
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system prepares for mode transitions by maintaining the capability to quickly switch between processing modes. The control unit is designed to initiate mode switching based on the number of active sensors, and buffers are pre-configured to handle the transition smoothly. This preliminary preparation minimizes the time penalty associated with mode switching by having the switching logic and buffer structures ready in advance.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system ensures continuous image processing operation during mode transitions by using buffers to maintain the data flow. The capture buffer and other buffering mechanisms allow the system to seamlessly transition between single and dual modes without interrupting the overall processing pipeline, thus minimizing the effective time loss during mode changes.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS9491367B2Image data processing method and electronic device supporting the same
Publication Date: 2016.11.08 SAMSUNG ELECTRONICS CO LTD
  • US9491367B2 patent drawing
  • US9491367B2 patent drawing
  • US9491367B2 patent drawing

AI summary

An electronic device processes image data using a plurality of image sensors and a control unit. The control unit, in response to receiving image data from one image sensor of the plurality of image sensors, establishes a single mode processing path for processing the received image data using a first processor corresponding to system processing unit via the single mode processing path. The control unit, in response to receiving the image data from two or more sensors of the plurality of image sensors, establishes a dual mode processing path for processing the image data using a second processor corresponding to a graphic processing unit, and processing the image data via the dual mode processing path.