Video Data Caching with Type-Specific Prefetching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video data processors in chips suffer from inefficient data caching and prefetching mechanisms, leading to low storage efficiency, inflexible data arrangement, and high power consumption due to the lack of consideration for different data types and characteristics.

Innovation Solution

Implement a chip with a multi-level storage structure comprising video data sub-processors and a data prefetcher, utilizing identification information to determine data types and apply specific caching and prefetching strategies for different data types, including a chip system-level cache and video system-level cache.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a unified caching mechanism is used for all video data, then the device complexity is reduced, but the data caching efficiency and storage efficiency deteriorate due to lack of differentiation among data types

Engineering Contradiction:
Improvecaching mechanism complexityVSAvoiddata caching efficiency
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent segments the caching mechanism into multiple video data sub-processors, where each sub-processor is dedicated to handling specific data types (e.g., I-frames, P-frames, B-frames). This segmentation allows each sub-processor to optimize its caching strategy for its specific data type, thereby improving overall caching efficiency without requiring a single complex unified mechanism.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by allowing different caching policies and strategies to be applied to different data types based on their specific characteristics. Each video data sub-processor implements caching policies tailored to its data type's access patterns and requirements, rather than applying a uniform policy across all video data.

Inventive Principle:
Principle #3Local quality

2Productivity

If data prefetching is implemented without considering data types, then the implementation simplicity is maintained, but the computational efficiency and data access performance deteriorate

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidprefetching mechanism complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The prefetching mechanism is segmented into multiple video data sub-processors, each responsible for prefetching specific data types. This segmentation enables targeted prefetching strategies optimized for each data type's characteristics, improving computational efficiency without requiring a single complex prefetching system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes parameters such as prefetching distance, prefetching amount, and prefetching timing based on the specific data type being processed. Each video data sub-processor adjusts these parameters according to its data type's access patterns and processing requirements, optimizing computational efficiency.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If video data is cached without differentiation by data type, then the storage space utilization is simplified, but the storage efficiency and data access performance worsen

Engineering Contradiction:
Improvestorage efficiencyVSAvoidstorage management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The storage system is segmented into multiple video data sub-processors, each with dedicated storage space for specific data types. This segmentation improves storage efficiency by preventing different data types from competing for the same storage resources and allowing each sub-processor to optimize its storage usage according to its specific needs.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Each video data sub-processor implements local quality by applying storage management policies tailored to its specific data type. This includes optimizing cache size, eviction policies, and data organization based on the characteristics of the data type handled by each sub-processor.

Inventive Principle:
Principle #3Local quality

4Productivity

If a general-purpose video data processor is used, then the adaptability to different video formats is improved, but the data access performance and power consumption worsen due to lack of specialization

Engineering Contradiction:
Improvedata access performanceVSAvoiddata type coverage
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The video data processor is segmented into multiple specialized video data sub-processors, each dedicated to handling specific data types. This segmentation improves data access performance by allowing each sub-processor to be optimized for its specific data type, while the collection of sub-processors maintains adaptability to handle various video formats through their combined capabilities.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20250260862A1Data caching
Publication Date: 2025.08.14 MOORE THREADS TECH CO LTD
  • US20250260862A1 patent drawing
  • US20250260862A1 patent drawing
  • US20250260862A1 patent drawing

AI summary

The present application provides a data caching method and a chip. The chip includes a plurality of video data sub-processors for caching different data types of video data respectively and a data prefetcher. The method includes: determining target video data according to identification information of a video data sub-processor of to-be-cached video data; determining a data storage address of the target video data in an external memory; and obtaining, by the data prefetcher, corresponding target video data from the external memory according to the data storage address. The present application may improve the data caching efficiency, reduce the data access, improve the computational efficiency of video data processing, and reduce the power consumption.