Data Encoder Bypassing Internal Memory Cache

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current data processing systems, such as graphics processing systems, face inefficiencies in memory transcoding and copying operations due to the need to fetch and process data through slower memory stores, which can lead to increased processing time and energy consumption.

Innovation Solution

Implementing a data encoder that can read and write data directly to and from external memory systems without using internal memory, allowing for streamlined data handling and processing operations that free up processor resources for more intensive tasks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If data is fetched from external memory through internal memory cache for processing, then data processing can be performed, but processing time increases and energy consumption rises due to slower memory access

Engineering Contradiction:
Improvedata processing efficiencyVSAvoidprocessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent extracts the data encoder functionality from the traditional processor-cache-memory pipeline and positions it directly at the memory interface. This allows data to be encoded/decoded directly during memory transactions without requiring fetch operations through the internal memory cache, thereby reducing processing time and improving efficiency

Inventive Principle:
Principle #2Taking out (Extraction)

2Productivity

If data is fetched from external memory through internal memory cache for processing, then data processing can be performed, but energy consumption increases due to repeated memory access operations

Engineering Contradiction:
Improvedata processing efficiencyVSAvoidenergy consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The data encoder is extracted from the processor core and positioned at the memory interface to handle encoding/decoding operations directly during memory transactions. This eliminates the need for repeated fetch operations through the internal memory cache, significantly reducing energy consumption while maintaining processing efficiency

Inventive Principle:
Principle #2Taking out (Extraction)

3Speed

If data is stored in internal memory cache for processing, then data can be accessed quickly, but cache pollution occurs reducing overall system performance

Engineering Contradiction:
Improvedata access speedVSAvoidcache performance
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The patent extracts data encoding/decoding operations from the processor-cache system and places them at the memory interface. This allows data to be directly encoded/decoded during memory transactions without being loaded into the internal memory cache, preventing cache pollution while maintaining fast data access speeds

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS12086454B2Data processing systems including a data encoder that reads in data from and returns data to an external memory system
Publication Date: 2024.09.10 ARM LTD
  • US12086454B2 patent drawing
  • US12086454B2 patent drawing
  • US12086454B2 patent drawing

AI summary

A data processing system includes an external memory system, a processor and an internal memory system. The internal memory system includes an internal memory that stores data for use by the processor when performing data processing operations. The internal memory system also includes a data encoder associated with the internal memory. The data encoder reads data from the external memory system to the data encoder and returns the data to the external memory system from the data encoder, without storing the data in the internal memory.