Subpicture Frame Line Filtering for Memory Access Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies face inefficiencies when combining image frames with subpicture frames, particularly in terms of resource usage and filtering requirements, as they often retrieve and filter unnecessary data, leading to increased memory accesses and processing overhead.

Innovation Solution

The solution involves generating line information to identify specific lines of the subpicture frame with display data, allowing only those lines to be retrieved and combined with image frames, thereby reducing memory accesses and filtering requirements, especially in interlace television displays like NTSC and PAL.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the entire subpicture frame is retrieved and processed for each image frame combination, then complete display information is ensured, but memory accesses and processing resources are significantly increased

Engineering Contradiction:
Improvedisplay information completenessVSAvoidmemory access resources
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The subpicture frame is segmented into individual lines, and line information is generated to identify which lines contain display information. Only those specific lines are retrieved and processed instead of the entire frame, reducing memory accesses while maintaining complete display information for the relevant portions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The invention extracts only the necessary lines from the subpicture frame that contain display information, separating them from the unnecessary lines. This extraction is guided by the line information data structure that indicates which lines need to be processed, thereby reducing processing resources and memory accesses.

Inventive Principle:
Principle #2Taking out (Extraction)

2Manufacturing precision

If filtering is applied to all portions of combined images, then image quality is maintained, but processing time and computational resources are increased

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing speed
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

Filtering is applied locally only to the portions of combined images that correspond to lines containing subpicture display information. The line information data structure enables the system to identify which regions require filtering to maintain image quality, while skipping filtering for regions without subpicture content, thus improving processing speed.

Inventive Principle:
Principle #3Local quality

3Use of energy by moving object

If line information is generated and used to select specific lines, then memory accesses and filtering requirements are reduced, but additional processing steps are introduced

Engineering Contradiction:
Improveprocessing resourcesVSAvoidprocessing steps
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

Line information is generated in advance as a data structure that pre-identifies which lines of the subpicture frame contain display information. This preliminary action is performed once, and the resulting line information is then reused across multiple image frame combinations, reducing the need for repeated processing and minimizing the introduction of additional processing steps.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8194188B2Displaying image frames in combination with a subpicture frame
Publication Date: 2012.06.05 TEXAS INSTRUMENTS INC
  • US8194188B2 patent drawing
  • US8194188B2 patent drawing
  • US8194188B2 patent drawing

AI summary

An aspect of the present invention reduces memory accesses while forming combined images of a subpicture frame with each of a sequence of image frames. In an embodiment, line information indicating the specific lines (e.g., rows) of the subpicture frame having display information is first generated. The line information is then used to retrieve only those lines of the subpicture frame that have display information while forming combined frames. According to another aspect, the portions of the combined images having sharp edges due to the inclusion of the subpicture frame are identified based on the line information, and such portions are then filtered. The sequence of combined frames may be displayed on a video output device.