DMA Image Processing Eliminates Frame Buffer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image display engines struggle with alpha blending of images in different resolutions, orientations, and color spaces, requiring external storage buffers and not supporting YUV42x Planar format seamlessly, leading to increased memory usage and power consumption.
Innovation Solution
A DMA controlled image processing system that fetches and blends image data using Direct Memory Access (DMA) channels, eliminating the need for a display storage frame buffer by utilizing DMA channels to fetch and process image tiles in a specific order, with integrated color space transformation, scaling, and gamma correction modules, and prioritization through an arbiter.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional image display engine is used for alpha blending, then source images must be same size and color space, but this limits the system's ability to process images of different resolutions and color spaces
Solution Approach 1:
The patent segments the image processing into distinct stages: fetching image tiles via DMA channels, performing color space conversion on individual tiles, executing alpha blending operations, and managing multiple image streams independently. This segmentation allows each component to handle specific format conversions without requiring the entire system to support all format combinations simultaneously, thereby improving adaptability while managing complexity.
Solution Approach 2:
The patent introduces intermediate buffer memory and control logic as mediators between the DMA fetching module and the alpha blending unit. These intermediaries temporarily store image tiles in standardized formats, allowing the system to accept images in various formats (YUV42x Planar, RGB, etc.) and convert them to a common internal representation before blending, thus enhancing format compatibility without directly coupling all format handlers.
2Reliability
If external storage buffers are used for alpha blending, then more memory is available for intermediate data, but memory usage and power consumption increase
Solution Approach 1:
The patent employs dynamic memory allocation where buffer memory is allocated only when and where needed during the alpha blending process. The system dynamically manages the size and location of intermediate buffers based on the specific image formats and resolutions being processed, rather than allocating fixed large buffers. This dynamic approach ensures sufficient memory for reliable processing while minimizing unused memory allocations and associated power consumption.
Solution Approach 2:
The patent extracts the buffering function from a dedicated external storage frame buffer and integrates it into the alpha blending pipeline using shared buffer memory. By taking out the requirement for a separate large frame buffer and using smaller, strategically placed intermediate buffers within the processing pipeline, the system maintains processing reliability while reducing overall memory usage and power consumption.
3Adaptability or versatility
If YUV42x Planar format is supported, then more image formats can be processed, but the conventional engine does not support it seamlessly
Solution Approach 1:
The patent performs preliminary color space conversion of YUV42x Planar image tiles to a standard format during the DMA fetching stage, before the alpha blending operation. The DMA channels are configured to fetch YUV42x Planar tiles and automatically convert them to the internal working format, so that by the time the data reaches the alpha blending unit, all formats are already standardized. This preliminary action makes YUV42x Planar support as seamless as native format support.
4Adaptability or versatility
If temporary frame buffer is used to hold intermediate data, then image processing can be performed, but running time increases
Solution Approach 1:
The patent merges the color space conversion, scaling, and alpha blending operations into a unified processing pipeline that operates on image tiles in a single pass. Instead of using a temporary frame buffer to hold entire intermediate images for later processing, the system combines these operations so that tiles are converted, scaled, blended, and output in one continuous flow. This merging eliminates the time penalty associated with writing to and reading from temporary buffers.
Solution Approach 2:
The patent changes the processing dimension from whole-image operations requiring temporary storage to tile-level stream processing. By processing images as a continuous stream of tiles rather than loading entire images into temporary buffers, the system achieves frame bufferless operation. The tile-based approach in another dimension (spatial segmentation) allows progressive processing without temporal delays from buffer I/O operations.
Data Source
AI summary
A system for processing image data from a plurality of images is disclosed. The invention involves alpha blending of two images of different resolution and color space utilizing shared logic for multiple image streams and without display storage frame buffer. The invention utilizes Direct Memory Access (DMA) fetching module for fetching image data from source images or from source image memory areas and transferring the data to another memory area without having to go through a central processing unit or display storage frame buffer. The DMAs are configured with direct registers or memory mapped descriptors as to the location of the source data. The DMA channels of the DMA module will fetch a portion of the source images (tiling) utilizing a link list or series of descriptors in a certain fetching order. The DMA modules can perform the alpha blending on the fetched image data.


