Auxiliary Engine Virtualization for Shared Image Frontend Processing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image processing systems face challenges in efficiently processing images from multiple image sensors due to redundant frontend modules that are not used by all sensors, leading to increased area penalties and design costs.

Innovation Solution

Implementing an auxiliary processing engine to virtualize frontend modules that are used by less than all image sensors, allowing these modules to be shared across multiple frontend engines, thereby reducing redundant hardware and optimizing space usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If redundant frontend modules are included in each symmetrical processing engine to handle all image sensors, then all sensors can be processed independently, but the area and design cost increase significantly

Engineering Contradiction:

Improveprocessing capability for all image sensorsVSAvoidarea of image processing system

Core Design Contradiction:

Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

The patent merges the frontend modules into a shared auxiliary processing engine that serves multiple symmetrical processing engines. Instead of duplicating frontend modules in each processing engine, a single auxiliary engine with frontend modules is shared across all symmetrical engines, reducing redundant hardware while maintaining the ability to process images from all sensors.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The auxiliary processing engine is designed as a universal resource that can handle frontend processing for any of the multiple image sensors. The frontend modules in the auxiliary engine are configured to work with different sensor types, providing multi-functional capability without requiring dedicated modules for each sensor in every processing engine.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Productivity

If redundant frontend modules are included in each symmetrical processing engine, then processing can be performed locally, but design cost and hardware complexity increase

Engineering Contradiction:

Improveprocessing efficiencyVSAvoidhardware complexity of image processing system

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent combines the frontend processing functionality into a shared auxiliary engine, eliminating redundant hardware across multiple processing engines. This merging reduces hardware complexity while maintaining processing efficiency through the shared resource architecture.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The auxiliary processing engine acts as an intermediary between the image sensors and the symmetrical processing engines. It handles the frontend processing as an intermediate step before data is passed to the appropriate symmetrical engine, simplifying the overall system architecture while maintaining processing capabilities.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS12439172B2Auxiliary engine for hardware virtualization

Publication Date: 2025.10.07 QUALCOMM INC

AI summary

Techniques are described herein for processing data. For instance, a process can include receiving input data by a symmetrical processing engine of two or more symmetrical processing engines coupled to an auxiliary processing engine. The process can further include receiving an indication to process the input data using a module of the auxiliary processing engine, transmitting output data to the auxiliary processing engine, receiving processed data from the auxiliary processing engine, further processing the processed data in one or more portions of a pipeline of modules of the symmetrical processing engine, and outputting the further processed data.