DMA Image Processing Eliminates Frame Buffer

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image display engines struggle with alpha blending of images in different resolutions, orientations, and color spaces, requiring external storage buffers and not supporting YUV42x Planar format seamlessly, leading to increased memory usage and power consumption.

Innovation Solution

A DMA controlled image processing system that fetches and blends image data using Direct Memory Access (DMA) channels, eliminating the need for a display storage frame buffer by utilizing DMA channels to fetch and process image tiles in a specific order, with integrated color space transformation, scaling, and gamma correction modules, and prioritization through an arbiter.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional image display engine is used for alpha blending, then source images must be same size and color space, but this limits the system's ability to process images of different resolutions and color spaces

Engineering Contradiction:
Improveimage format compatibilityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the image processing into distinct stages: fetching image tiles via DMA channels, performing color space conversion on individual tiles, executing alpha blending operations, and managing multiple image streams independently. This segmentation allows each component to handle specific format conversions without requiring the entire system to support all format combinations simultaneously, thereby improving adaptability while managing complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediate buffer memory and control logic as mediators between the DMA fetching module and the alpha blending unit. These intermediaries temporarily store image tiles in standardized formats, allowing the system to accept images in various formats (YUV42x Planar, RGB, etc.) and convert them to a common internal representation before blending, thus enhancing format compatibility without directly coupling all format handlers.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If external storage buffers are used for alpha blending, then more memory is available for intermediate data, but memory usage and power consumption increase

Engineering Contradiction:
Improveprocessing reliabilityVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent employs dynamic memory allocation where buffer memory is allocated only when and where needed during the alpha blending process. The system dynamically manages the size and location of intermediate buffers based on the specific image formats and resolutions being processed, rather than allocating fixed large buffers. This dynamic approach ensures sufficient memory for reliable processing while minimizing unused memory allocations and associated power consumption.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent extracts the buffering function from a dedicated external storage frame buffer and integrates it into the alpha blending pipeline using shared buffer memory. By taking out the requirement for a separate large frame buffer and using smaller, strategically placed intermediate buffers within the processing pipeline, the system maintains processing reliability while reducing overall memory usage and power consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

3Adaptability or versatility

If YUV42x Planar format is supported, then more image formats can be processed, but the conventional engine does not support it seamlessly

Engineering Contradiction:
Improveformat supportVSAvoidprocessing simplicity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent performs preliminary color space conversion of YUV42x Planar image tiles to a standard format during the DMA fetching stage, before the alpha blending operation. The DMA channels are configured to fetch YUV42x Planar tiles and automatically convert them to the internal working format, so that by the time the data reaches the alpha blending unit, all formats are already standardized. This preliminary action makes YUV42x Planar support as seamless as native format support.

Inventive Principle:
Principle #10Preliminary action

4Adaptability or versatility

If temporary frame buffer is used to hold intermediate data, then image processing can be performed, but running time increases

Engineering Contradiction:
Improveprocessing capabilityVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent merges the color space conversion, scaling, and alpha blending operations into a unified processing pipeline that operates on image tiles in a single pass. Instead of using a temporary frame buffer to hold entire intermediate images for later processing, the system combines these operations so that tiles are converted, scaled, blended, and output in one continuous flow. This merging eliminates the time penalty associated with writing to and reading from temporary buffers.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent changes the processing dimension from whole-image operations requiring temporary storage to tile-level stream processing. By processing images as a continuous stream of tiles rather than loading entire images into temporary buffers, the system achieves frame bufferless operation. The tile-based approach in another dimension (spatial segmentation) allows progressive processing without temporal delays from buffer I/O operations.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS7924296B2System and method for DMA controlled image processing
Publication Date: 2011.04.12 MILA US INC
  • US7924296B2 patent drawing
  • US7924296B2 patent drawing
  • US7924296B2 patent drawing

AI summary

A system for processing image data from a plurality of images is disclosed. The invention involves alpha blending of two images of different resolution and color space utilizing shared logic for multiple image streams and without display storage frame buffer. The invention utilizes Direct Memory Access (DMA) fetching module for fetching image data from source images or from source image memory areas and transferring the data to another memory area without having to go through a central processing unit or display storage frame buffer. The DMAs are configured with direct registers or memory mapped descriptors as to the location of the source data. The DMA channels of the DMA module will fetch a portion of the source images (tiling) utilizing a link list or series of descriptors in a certain fetching order. The DMA modules can perform the alpha blending on the fetched image data.