Directly Addressable FIFO Instruction Memory for Data Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

General purpose processors are complex and power-intensive, with significant CPU time spent on data movement operations between various components in computing systems, necessitating a more efficient solution for managing data movement.

Innovation Solution

A data management processor is implemented using an integrated circuit, featuring an instruction memory that operates as a FIFO while being directly addressable, allowing for flexible programming and reduced management overhead, offloading data movement operations from the primary processor.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a general purpose processor is used to manage data movement operations, then the system has high flexibility and capability, but the CPU time consumption and power requirements increase significantly

Engineering Contradiction:
Improveprocessing capabilityVSAvoidpower requirements
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent divides the processor functionality into two separate components: a data management processor (DMP) for handling data movement operations and a general purpose processor for executing application programs. This segmentation allows the DMP to offload power-intensive data movement tasks from the general purpose processor, reducing overall power consumption while maintaining processing capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The data management processor acts as an intermediary between the general purpose processor and the memory system. It handles data movement operations independently, preventing the general purpose processor from being burdened with these tasks, thus reducing CPU time consumption and power requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If a data management processor is implemented to offload data movement operations, then CPU load and power requirements are reduced, but the device complexity increases

Engineering Contradiction:
ImproveCPU efficiencyVSAvoidprocessor architecture
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The data management processor is designed with a universal instruction memory that can operate in multiple modes (FIFO and direct addressing) and handle various data movement operations. This multi-functionality allows a single specialized component to handle diverse tasks, reducing the need for multiple separate components and thereby limiting the increase in device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The data management processor is designed to be self-sufficient, with its own instruction memory and control logic, allowing it to independently manage data movement operations without requiring complex control mechanisms from the general purpose processor. This self-service capability simplifies the overall system architecture.

Inventive Principle:
Principle #25Self-service

3Productivity

If the instruction memory operates as a FIFO, then data movement efficiency is improved, but the addressing flexibility is reduced

Engineering Contradiction:
Improvedata movement speedVSAvoidaddressing flexibility
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The instruction memory is designed to be dynamic, switching between FIFO operation mode and direct addressing mode based on the specific task requirements. This dynamic flexibility allows the system to optimize for speed when using FIFO mode and for addressing flexibility when using direct addressing, resolving the contradiction between productivity and adaptability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the operational parameters of the instruction memory based on the task at hand. When high-speed data movement is required, the memory operates in FIFO mode with sequential addressing. When specific memory locations need to be accessed, the system switches to direct addressing mode, thereby adapting the memory behavior to match the operational requirements.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10802828B1Instruction memory
Publication Date: 2020.10.13 AMAZON TECH INC
  • US10802828B1 patent drawing
  • US10802828B1 patent drawing
  • US10802828B1 patent drawing

AI summary

Provided are systems and methods for implementing a memory for an integrated circuit device. In various examples, the integrated circuit can operate the memory as a FIFO, where each address in the FIFO is directly addressable. The integrated circuit can include a first register for storing a head pointer and a second register for storing a tail pointer. When new data is written to the memory, the data cat be written starting at the tail pointer location, without the tail pointer being modified. The tail pointer can be incremented using write transactions received from external to the integrated circuit.