Image Processing Pipeline Extensibility via Dynamic Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems lack extensibility, as software incorporated in subsequent stages of the image processing pipeline may not fully exhibit performance due to processing based on characteristics of image data output from the pipeline.
Innovation Solution
An image processing device with an image sensor, pipeline processing unit, storage unit, and switching unit that allows for extended image processing by bypassing specific image processing stages and executing alternative processing on intermediate data, enabling extensibility and improved performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If software is incorporated in the subsequent stage of the image processing pipeline, then the image processing functionality is extended, but the performance of the software cannot be fully exhibited because it processes data with fixed characteristics from the pipeline
Solution Approach 1:
The patent implements dynamic switching capability that allows the image processing system to change its processing pipeline configuration based on different processing needs. The switching unit can dynamically select between standard pipeline processing and extended processing paths, enabling the system to adapt to different performance requirements and processing scenarios.
Solution Approach 2:
The patent segments the image processing pipeline into distinct modules with clear interfaces. By defining specific input and output data formats between modules, the system allows independent extended processing units to be inserted at designated points without disrupting the overall pipeline structure, thereby enabling performance optimization while maintaining system integrity.
2Device complexity
If a fixed image processing pipeline is used, then the system structure is simple, but the system lacks extensibility for additional processing functions
Solution Approach 1:
The patent creates a universal extended processing unit that can handle multiple types of image processing tasks. This unit is designed with generic interfaces that allow it to work with different input data formats and produce various output types, enabling a single added component to provide multiple processing functions rather than requiring separate dedicated units for each function.
Solution Approach 2:
The patent introduces an intermediary switching unit that mediates between the fixed pipeline and extended processing functions. This switching unit acts as a bridge, routing data appropriately between standard pipeline stages and extended processing units, thereby enabling extensibility without requiring fundamental changes to the original simple pipeline structure.
3Reliability
If extended processing is added to the pipeline, then processing performance is improved, but the system complexity increases
Solution Approach 1:
The patent implements optional extended processing that can be selectively activated based on performance requirements. The system allows users to enable or disable specific extended processing functions as needed, meaning that the full complexity of extended processing is only instantiated when actually required, rather than being permanently present in all operating conditions.
Data Source
AI summary
An image processing device includes: an image sensor generating raw image data; a pipeline processing unit executing, on the raw image data, an image processing group such that image data which is a result of image processing in a preceding stage becomes a target of image processing in a subsequent stage; an extended image processing unit executing extended image processing different from each image processing included in the image processing group; a storage unit storing a definition for identifying target image processing to be bypassed and a definition indicating that image processing to be executed before and/or after bypassing is the extended image processing; and a switching unit switching, on the basis of the definitions stored upon satisfaction of a switching condition, a processing flow in the image processing group such that intermediate image data becomes the target of the extended image processing.