Decoupling Image Algorithms from HAL via APP and APS
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image processing systems face difficulties in design due to the coupling of image processing algorithms with Hardware Abstract Layer (HAL) architectures, requiring truncating processes and complex pipeline construction, which complicates the implementation of image post-processing tasks.
Innovation Solution
An image processing apparatus comprising a Hardware Abstract Layer (HAL), an Application (APP), and an Algorithm Process Service (APS), where the HAL converts RAW images to YUV images and transmits them to the APP, which then processes them using stored image processing algorithms, eliminating the need for HAL-based algorithm truncation and reducing design complexity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If image processing algorithms are integrated with HAL architectures, then image post-processing can be implemented, but design complexity increases due to coupling and truncating operations
Solution Approach 1:
The patent segments the image processing system into three independent modules: HAL (hardware interface), APP (application layer), and APS (algorithm processing service). This segmentation allows algorithms to be developed independently from HAL architecture, eliminating the need for complex truncating operations and reducing design complexity while maintaining full image post-processing functionality.
Solution Approach 2:
The patent introduces APP as an intermediary layer between HAL and APS. APP receives image data from HAL, processes it through various algorithms via APS, and generates final output. This intermediary structure decouples the algorithm processing from HAL architecture, allowing algorithms to be transported and executed without direct HAL integration complexity.
2Adaptability or versatility
If algorithm truncating process is performed to adapt algorithms to HAL architectures, then compatibility is achieved, but design difficulty increases
Solution Approach 1:
The patent extracts the algorithm processing functionality from the HAL integration layer by introducing a dedicated APS module. Algorithms are stored and executed in APS independently of HAL architecture, eliminating the need for truncating operations to adapt algorithms to specific HAL structures. Compatibility is maintained through standard image data interfaces between APP and APS.
3Reliability
If image processing is conducted within HAL, then hardware integration is achieved, but memory usage and processing efficiency are reduced
Solution Approach 1:
The patent transitions image processing from a hardware-bound HAL layer to a software-service layer (APS). By moving algorithm execution to the APS service layer, the system utilizes system memory and processing resources more efficiently, reducing the memory footprint compared to dedicated HAL integration while maintaining processing reliability through the structured data flow between HAL-APP-APS.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution allows for efficient image post-processing without HAL involvement, reducing design complexity and memory usage, enabling faster camera enablement and easy transplantation and expansion of image processing algorithms, while allowing for concurrent processing by both the APP and APS.
Implementation Method 1
The HAL is configured to receive a RAW image, to convert the RAW image into a YUV image
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
An image processing apparatus, a method for image processing, and an electronic device are provided. The image processing apparatus includes a Hardware Abstract Layer (HAL), an application (APP) coupled with the HAL, and an Algo Process Service (APS). The HAL is configured to receive a RAW image, to convert the RAW image into a YUV image, and to transmit the RAW image and/or the YUV image to the APP. The APP is configured to transmit the RAW image and/or the YUV image to the APS. The APS is coupled with the HAL via the APP and stores at least one image processing algorithm for image post-processing, and the APS is configured to process, with the at least one image processing algorithm, the RAW image and/or the YUV image.