Scatter Gather Engine Parallel Processing Power Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

As integrated circuit fabrication advances, the increasing number of components on a single chip leads to higher heat generation and power consumption, posing challenges for efficient power management and limiting device usage, especially in battery-powered devices, and current graphics processing systems face inefficiencies in parallel data processing.

Innovation Solution

A scatter gather engine is implemented in graphics processing units (GPUs) to optimize parallel processing by efficiently managing data operations across multiple processing clusters, utilizing a scatter gather engine that supports interrupt generation and flexible register operations to enhance data collection and processing efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the number of components on a single IC chip is increased to improve functionality, then the functional capability is improved, but heat generation and power consumption increase

Engineering Contradiction:
Improvefunctional capabilityVSAvoidpower consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The system is divided into multiple processing clusters (first processing cluster, second processing cluster, etc.) that can operate independently and in parallel. Each cluster handles specific data processing tasks, allowing the system to distribute computational workload across multiple units rather than concentrating all functions in a single high-power component, thereby reducing overall power consumption while maintaining functional capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from sequential single-cluster processing to parallel multi-cluster processing by adding a temporal and spatial dimension to data operations. Multiple clusters process different data sets simultaneously, and the scatter gather engine coordinates operations across these clusters, effectively distributing power consumption across multiple units operating in parallel rather than one unit operating sequentially.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If more components are integrated on a single chip to improve functionality, then the functional capability is improved, but heat generation increases which may damage components

Engineering Contradiction:
Improvefunctional capabilityVSAvoidheat generation
Core Design Contradiction:
Adaptability or versatilityVSTemperature

Solution Approach 1:

By segmenting the processing function into multiple independent clusters, each cluster generates less heat than a single monolithic processor would. The heat generation is distributed across multiple physical locations on the chip, preventing localized thermal hotspots that could damage components, while the system maintains enhanced functional capability through the combined processing power of all clusters.

Inventive Principle:
Principle #1Segmentation

3Productivity

If traditional graphics processing systems are used for parallel data processing, then the system structure is simple, but processing efficiency is insufficient

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidsystem structure
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The scatter gather engine serves multiple functions: it manages data collection from multiple sources, coordinates operations across different processing clusters, handles data distribution, and supports interrupt generation. This multi-functional component enables efficient parallel processing across clusters without requiring separate specialized hardware for each function, thereby improving processing efficiency while limiting the increase in system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The scatter gather engine acts as an intermediary component that mediates between multiple processing clusters and the rest of the graphics processing system. It manages data flow, coordinates operations, and handles communication between clusters, enabling efficient parallel processing without requiring direct complex interconnections between all clusters, thus improving productivity while managing device complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11494967B2Scatter gather engine
Publication Date: 2022.11.08 INTEL CORP
  • US11494967B2 patent drawing
  • US11494967B2 patent drawing
  • US11494967B2 patent drawing

AI summary

In an example, an apparatus comprises a plurality of execution units, and logic, at least partially including hardware logic, to create a scatter gather list in memory and collect a plurality of operating statistics for the plurality of execution units using the scatter gather list. Other embodiments are also disclosed and claimed.