Processing Pipeline Dynamic Storage Mode Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

There is a trade-off between performance and energy consumption in processing pipelines, as features like out-of-order execution and parallel processing require more complex circuits that consume more energy, necessitating a balance between throughput and energy efficiency.

Innovation Solution

A processing pipeline with two modes, one supporting higher throughput and the other with lower energy consumption, where the storage structure's size is dynamically adjusted by placing a subset of entries in a power-saving state based on the selected mode, allowing for more frequent mode switching and improved performance or energy savings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a processing pipeline uses features like out-of-order execution, speculative execution, or parallel issue/execution to increase throughput, then performance is improved, but energy consumption increases due to more complex circuits

Engineering Contradiction:
ImprovethroughputVSAvoidenergy consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent implements dynamic adjustment of storage structure size by selectively placing entries in power-saving states based on pipeline configuration. The storage structure dynamically adapts its operational size to match the active pipeline mode, reducing energy consumption when complex features are disabled while maintaining full performance when they are enabled. This resolves the contradiction by making the system's resource allocation dynamic rather than static.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the operational parameters of the storage structure by adjusting the number of active entries based on the selected processing mode. When a simplified pipeline configuration is chosen, fewer storage entries remain active, reducing capacitance and dynamic power consumption. This parameter adjustment allows the system to optimize energy consumption according to performance requirements without duplicating hardware structures.

Inventive Principle:
Principle #35Parameter changes

2Use of energy by moving object

If a processing pipeline uses simplified circuits to reduce energy consumption, then energy efficiency is improved, but throughput decreases

Engineering Contradiction:
Improveenergy efficiencyVSAvoidthroughput
Core Design Contradiction:
Use of energy by moving objectVSProductivity

Solution Approach 1:

The system dynamically switches between different operational configurations, adjusting the storage structure size to match the active processing mode. When high performance is needed, the full storage structure is activated; when energy efficiency is prioritized, a reduced subset remains active. This dynamic adaptation allows the system to achieve both high performance and energy efficiency at different times without hardware duplication.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

A single storage structure serves multiple functions by operating at different sizes depending on the processing mode. The same physical storage structure can support both complex high-throughput operations and simplified low-power operations, eliminating the need for separate storage structures for different performance levels. This multi-functionality resolves the contradiction by making one structure adaptable to different performance requirements.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If duplicate storage structures are created to support different processing modes, then adaptability is improved, but device complexity and energy consumption increase

Engineering Contradiction:
Improvemode switching capabilityVSAvoidstorage structure overhead
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Instead of maintaining multiple static storage structures, the patent implements a single dynamic storage structure that adjusts its active size based on the processing mode. This dynamic approach provides the same adaptability as multiple structures would offer, but without the added complexity and overhead of duplicating hardware. The system achieves mode-specific optimization through dynamic reconfiguration rather than static duplication.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent merges the functionality of multiple mode-specific storage structures into a single unified structure. By combining what would otherwise require separate hardware resources into one shared structure with dynamic sizing, the system achieves full adaptability across different processing modes while reducing overall device complexity and eliminating redundant overhead.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11579879B2Processing pipeline with first and second processing modes having different performance or energy consumption characteristics
Publication Date: 2023.02.14 ARM LTD
  • US11579879B2 patent drawing
  • US11579879B2 patent drawing
  • US11579879B2 patent drawing

AI summary

An apparatus 2 has a processing pipeline 4 supporting at least a first processing mode and a second processing mode with different energy consumption or performance characteristics. A storage structure 22, 30, 36, 50, 40, 64, 44 is accessible in both the first and second processing modes. When the second processing mode is selected, control circuitry 70 triggers a subset 102 of the entries of the storage structure to be placed in a power saving state.