Balanced Throughput Data-Path Architecture for FIR MAC Operations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing digital signal processing systems face inefficiencies due to memory misalignment, leading to bubble cycles and limiting the rate of multiply-accumulate (MAC) operations in FIR filtering, which are crucial for fast signal processing applications.

Innovation Solution

A balanced throughput data-path architecture with a hierarchical Grouped Register File (GRF) system and a modified Address Generation (AG) Unit using misaligned address placement (MAP) enables simultaneous loading and processing of multiple pairs of data, allowing for more than one MAC operation per cycle without requiring additional memory ports.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If data is loaded from memory into the register file for MAC operations, then the MAC operation can be performed, but memory misalignment causes bubble cycles that reduce the MAC operation rate

Engineering Contradiction:
ImproveMAC operation rateVSAvoidbubble cycles
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The address generator performs preliminary actions by pre-calculating and loading multiple data values into the register file before the MAC operation is needed. This ensures that data is ready in advance and eliminates the need to wait for memory access during the MAC operation, thereby preventing bubble cycles and increasing the MAC operation rate.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The register file is segmented into multiple locations that can be independently loaded with data. The address generator can selectively load data into specific register locations, allowing for efficient data management and avoiding memory misalignment issues that would cause bubble cycles.

Inventive Principle:
Principle #1Segmentation

2Productivity

If a balanced throughput data-path architecture is used, then data throughput is optimized, but memory misalignment still occurs limiting MAC operation rate

Engineering Contradiction:
ImproveMAC operation rateVSAvoiddata alignment
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The address generator incorporates feedback mechanisms to monitor and adjust data loading operations. By detecting potential misalignment conditions and adjusting the loading process accordingly, the system maintains reliable data alignment while achieving high MAC operation rates through optimized data path architecture.

Inventive Principle:
Principle #23Feedback

3Productivity

If multiple MAC operations are performed per cycle, then productivity increases, but data throughput balance becomes difficult to maintain

Engineering Contradiction:
ImproveMAC operations per cycleVSAvoiddata path architecture
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system introduces an additional dimension to the data path architecture by using a hierarchical register file structure with multiple access ports. This allows multiple MAC operations to be performed in parallel per cycle while maintaining balanced data throughput, as each port can independently load data without interfering with others.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

Multiple data values are loaded into the register file in advance through the address generator before the MAC operations begin. This preliminary loading enables multiple MAC operations to execute in parallel within a single cycle without creating throughput imbalances, as all necessary data is already prepared in the register file.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9082476B2Data accessing method to boost performance of FIR operation on balanced throughput data-path architecture
Publication Date: 2015.07.14 STMICROELECTRONICS BEIJING R& D
  • US9082476B2 patent drawing
  • US9082476B2 patent drawing
  • US9082476B2 patent drawing

AI summary

An apparatus and method are disclosed to implement digital signal processing operations involving multiply-accumulate (MAC) operations, by using a modified balanced data structure and accessing architecture. This architecture maintains a data-path connecting one address generation unit, one register file and one MAC execution unit. The register file has a hierarchical grouping organization of individual registers, which reduces bubble cycles caused by memory misalignments. This architecture uses parallel execution and can achieve two or more MAC operations per cycle.