Image Processing Device Asynchronous Frame Data Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing methods with double-buffer structures in display memory increase latency and require significant storage capacity, limiting asynchronous drawing and output processes due to restricted Vertical Blank Interval (VBI) timing.

Innovation Solution

An image processing device that divides frame data into partial data units and stores them in a display memory with multiple buffer areas, allowing for asynchronous saving, transformation, and output processes outside the VBI interval, while minimizing the increase in display memory storage capacity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a double-buffer structure is used in the display memory, then it becomes possible to carry out saving and transformation processes outside the VBI interval and enable asynchronous drawing and output, but the storage capacity of the display memory needs to be at least twice the capacity of the frame buffer

Engineering Contradiction:
Improveasynchronous drawing and output capabilityVSAvoidstorage capacity of display memory
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The frame data is divided into multiple partial data units (e.g., first partial data, second partial data, third partial data) that can be saved and output independently. This segmentation allows the display memory to store only a fraction of the complete frame data at any given time, enabling asynchronous operations without requiring full double-buffer capacity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system outputs partial data units before the entire frame data is saved to the display memory. For example, the first partial data can be output while the second and third partial data are still being saved. This partial action approach reduces the memory capacity requirement while maintaining productivity.

Inventive Principle:
Principle #16Partial or excessive action

2Productivity

If a double-buffer structure is used in the display memory, then it becomes possible to carry out saving and transformation processes outside the VBI interval, but latency increases

Engineering Contradiction:
Improvesaving and transformation process timingVSAvoidlatency
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The frame data is divided into multiple partial data units that can be saved to the display memory in advance of when they are needed for output. This preliminary action allows the system to prepare data for future output operations without waiting for complete frame saving, thereby reducing latency while enabling processes outside the VBI interval.

Inventive Principle:
Principle #10Preliminary action

3Quantity of substance

If saving and transformation processes are limited to the VBI interval, then storage capacity requirements are reduced, but the size and definition of displayable image are limited

Engineering Contradiction:
Improvestorage capacity of display memoryVSAvoiddisplayable image size and definition
Core Design Contradiction:
Quantity of substanceVSAdaptability or versatility

Solution Approach 1:

By segmenting frame data into multiple partial data units, the system can progressively save and transform data during both VBI and active display intervals. This enables larger and higher-definition images to be processed and displayed without requiring the entire frame to be saved within the limited VBI window, thus expanding display capabilities while maintaining reasonable memory requirements.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS7864184B2Image processing device, image processing system, image processing method, computer program, and semiconductor device
Publication Date: 2011.01.04 SONY INTERACTIVE ENTERTAINMENT LLC
  • US7864184B2 patent drawing
  • US7864184B2 patent drawing
  • US7864184B2 patent drawing

AI summary

Provided is an image processing device for outputting a graphic image drawn into a frame memory after saving the image in a display memory. The image processing device is provided with a save processing section for saving frame data representing a predetermined image from a graphic memory in which the frame data is stored to a display memory, and an output interface for outputting the frame data saved in the display memory by transforming the frame data into a video output signal. The save processing section saves the frame data from the graphic memory to the display memory in equally divided units (partial data units). The partial data units of the frame data are outputted from the display memory.