Video Pipeline Interface Unit for Image Processing Resource Optimization

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In multifunctional electronic devices, the photographic function often experiences performance degradation and resource consumption due to waiting for responses from the application processor, leading to a suboptimal user experience.

Innovation Solution

An image processing device and video pipeline are introduced, where an application processor outputs parameters and instructions to a video pipeline interface unit, enabling independent processing of image raw data with a shared memory and inter-processor communication, allowing the video pipeline to access and process data without relying heavily on the application processor, thus reducing the need for interrupts and optimizing resource usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the photographic function uses the application processor for all processing tasks, then the application processor can handle various functions through software control, but the photographic function experiences performance degradation and high resource consumption due to waiting for responses from the application processor

Engineering Contradiction:

Improvesoftware control capabilityVSAvoidphotographic function performance

Core Design Contradiction:

Adaptability or versatilityVSProductivity

Solution Approach 1:

The system is divided into two independent processing paths: the application processor handles high-level control and settings, while the video pipeline processor handles actual image processing tasks. This segmentation allows the photographic function to operate independently without waiting for the application processor, resolving the performance degradation issue while maintaining software control capability.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

A video pipeline interface unit is introduced as an intermediary between the application processor and the video pipeline. This interface unit receives instructions from the application processor and translates them into commands for the video pipeline, enabling efficient communication and task delegation without requiring the application processor to handle all processing tasks directly.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If the application processor handles all photographic processing, then centralized control is maintained, but resources of the application processor are consumed excessively

Engineering Contradiction:

Improvecentralized controlVSAvoidapplication processor resource consumption

Core Design Contradiction:

Ease of operationVSUse of energy by moving object

Solution Approach 1:

Processing tasks are segmented between the application processor (control functions) and the video pipeline processor (execution functions). This division reduces the computational burden on the application processor, lowering resource consumption and energy usage while maintaining centralized control through the interface unit.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The video pipeline processor is designed to autonomously execute processing tasks once receiving instructions from the application processor. It independently manages image processing operations without requiring continuous intervention from the application processor, thereby reducing resource consumption while maintaining operational control.

Inventive Principle:

Principle #25Self-service

3Adaptability or versatility

If interrupts are sent to the application processor for processing tasks, then the application processor can respond to requests, but the response time delays degrade user experience

Engineering Contradiction:

Improveresponse capabilityVSAvoidresponse time

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The video pipeline interface unit acts as an intermediary that receives instructions from the application processor and immediately translates them into executable commands for the video pipeline. This eliminates the need for time-consuming interrupt-response cycles, as the interface unit can directly initiate processing tasks without waiting for application processor responses.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system is pre-configured with the video pipeline interface unit that has the capability to directly communicate with and control the video pipeline. This preliminary setup allows instructions to be executed immediately without requiring real-time intervention or response from the application processor, significantly reducing response time.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS9996894B2Image processing device, video subsystem and video pipeline

Publication Date: 2018.06.12 REALTEK SINGAPORE PTE LTD

AI summary

The present disclosure discloses a video pipeline comprising: a video processor operable to output at least an image processing parameter and at least an encoding parameter according to one or both of at least one parameter and at least one instruction from a domain outside the video pipeline; an image signal processor operable to turn image raw data into lower resolution video data and video data according to the at least one image processing parameter; a streaming conversion circuit operable to convert the video data into converted data; and an encoder operable to encode video data and encode the converted data according to the at least one encoding parameter.