Data Placement Destination Determination for Multi-Memory Bandwidth

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In computer systems with multiple memories of varying bandwidths, existing methods fail to efficiently determine data placement destinations, leading to inconsistent total execution times for simultaneously executed programs, as they do not consider the required bandwidth of each program when allocating memory resources.

Innovation Solution

A device and method that acquire required bandwidth and size for each target program, along with memory bandwidth and size for candidate memories, to set priorities for both programs and memories, determining optimal placement destinations within memory size and bandwidth constraints, and further adjust for undetermined programs to minimize total execution time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If data placement is determined without considering required bandwidth, then memory allocation is simple, but total execution time increases due to bandwidth mismatch

Engineering Contradiction:
Improveprogram execution efficiencyVSAvoiddata placement determination complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent changes the parameter basis for data placement from simple metrics (access frequency, execution time) to include bandwidth requirements. By considering the bandwidth parameter that data actually requires during execution, the system can match data to memory bandwidth characteristics, improving execution efficiency without excessive complexity

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent performs preliminary determination of bandwidth requirements for each data item before actual memory allocation. By calculating and storing the bandwidth requirements in advance, the system prepares the necessary information for efficient memory matching during program execution, avoiding complex real-time calculations

Inventive Principle:
Principle #10Preliminary action

2Speed

If high-performance memory is used for all data, then data access speed improves, but memory cost and resource waste increase

Engineering Contradiction:
Improvedata access speedVSAvoidmemory resource consumption
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The patent applies local quality by matching different memory bandwidth characteristics to different data bandwidth requirements. Instead of uniformly using high-performance memory for all data, the system identifies which specific data items require high bandwidth and allocates them to high-performance memory, while placing lower-bandwidth data in standard memory, thus optimizing both speed and resource utilization

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the memory allocation decision by evaluating each data item's bandwidth requirements independently. By dividing the memory allocation problem into individual data-level decisions based on bandwidth characteristics, the system can selectively assign high-performance memory only where necessary, avoiding unnecessary resource consumption

Inventive Principle:
Principle #1Segmentation

3Quantity of substance

If memory bandwidth is exceeded, then more data can be processed, but total execution time increases due to bandwidth bottleneck

Engineering Contradiction:
Improvedata processing capacityVSAvoidtotal execution time
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The patent incorporates feedback by comparing the required bandwidth of data against the available memory bandwidth capacity. This feedback mechanism allows the system to identify when bandwidth limits would be exceeded and adjust data placement decisions accordingly, preventing execution time increases due to bandwidth bottlenecks while maintaining optimal data processing capacity

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10120602B2Device and method for determining data placement destination, and program recording medium
Publication Date: 2018.11.06 NEC CORP
  • US10120602B2 patent drawing
  • US10120602B2 patent drawing
  • US10120602B2 patent drawing

AI summary

A data placement destination determination device enables efficiency improvement of the execution time of a program that is executed in a system mounted with a plurality of memories having differing memory bandwidth. This device includes: a program information acquisition unit acquiring required bandwidth and memory size; a system information acquisition unit acquiring the memory bandwidth and size of a candidate memory at a placement destination; a priority setting unit setting priority based on required bandwidth and priority; a first placement destination determination unit determining a placement destination for the data of the program concerned within a range that does not exceed memory size and bandwidth based on the set priorities; and a second placement destination determination unit determining a placement destination within a range that does not exceed memory size based on the set priorities, the required bandwidth of the program concerned, and the memory bandwidth of the candidate memory.