Unlock instant, AI-driven research and patent intelligence for your innovation.

A data migration control method, data migration method and device

A data and data transmission technology, applied in the field of data transmission, can solve the problems of hotspot transmission path and data congestion, reduce the performance of CC-NUMA system, and take a long time.

Active Publication Date: 2016-11-23
HUAWEI TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] Although using DMA to migrate data can realize the migration of a large amount of data in one data migration process, however, because it takes a long time to use DMA to migrate data, the data migration process according to DMA is likely to be different from some The data migration process corresponding to the NC data access works together, so it is easy to form hotspot transmission paths and data congestion, reducing the performance of the CC-NUMA system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data migration control method, data migration method and device
  • A data migration control method, data migration method and device
  • A data migration control method, data migration method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0082] The implementation scenario of Example 1 is a CC-NUMA system including S0-S7 with 8 CPUs, such as Figure 4 shown. The system includes 4 NCs, namely NC0-NC3, and each NC is connected to 2 CPUs through Quick Path Interconnect (QPI, Quick Path Interconnect) or other buses. The percentage marked next to the transmission link between two NCs is used to identify the usage percentage of the transmission link (that is, the bandwidth utilization rate), that is, the bandwidth occupied by the packets transmitted on the transmission link exceeds the rated bandwidth of the transmission link. percentage of the bandwidth. The higher the percentage marked next to the transmission link, the busier the transmission link and the smaller the idle bandwidth; otherwise, the idler the transmission link is and the larger the idle bandwidth is. also, Figure 4 The thicker dashed line with an arrow is used to indicate the migration path of data from the source to the destination; and the thi...

Embodiment 2

[0135] Embodiment 2 is mainly to apply the data migration control method provided by the embodiment of the present invention to a large-scale database, so as to improve the system-wide performance of the large-scale database.

[0136] Such as Figure 9 As shown in , it is a schematic diagram of realizing the data migration control method provided by the embodiment of the present invention in a large database. here, for Figure 9 in and previously introduced figure 1 and Figure 4 The numbers and characters corresponding to the numbers and characters with the same meaning are omitted, and the emphasis is on Figure 9 different from figure 1 and Figure 4 part. These parts include: Orig Shared Data indicates the original data to be migrated by DMA; Shared Data Copy1~3 indicates the Orig Shared Data migrated from the source NC to other NCs and stored; the solid line with the arrow indicates the CPU Prevent access to the data migrated through DAM in the NC connected to itse...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data migration control method in a CC-NUMA (cache coherent-non-uniform memory access) system. Bandwidth occupancy rates of transmission links contained in data transmission paths between a source end NC (node controller) and a destination end NC are led in to serve as a to-be-utilized selection basis of the data transmission paths when a DMA (direct memory access) mode is adopted to migrate data, so that when the DMA mode is adopted for data migration, the data transmission paths are no longer selected blindly, proper data transmission paths are selected according to the selection basis for data migration, and the problem of easiness in formation of hot transmission paths and data congestion when the DMA mode is adopted for data migration is avoided. An embodiment of the invention further provides a data migration control device, a data migration method and the data migration device in the CC-NUMA system.

Description

technical field [0001] The invention relates to the technical field of data transmission, in particular to a data migration control method, a data migration method and a device in a cache asymmetric consistent memory access system. Background technique [0002] In the cache asymmetric consistent memory access (CC-NUMA, Cache Coherent-Non Uniform Memory Access) system based on the node controller (NC, Node Controller), direct memory access (DMA, Direct Memory Access) is a large data volume An efficient way of data migration. The following example illustrates the DMA process in the existing NC-based CC-NUMA system. [0003] Such as figure 1 As shown, taking the CC-NUMA system including 8 central processing units (CPU, Central Processing Unit) S0~S7 as an example, each NC is connected to 2 CPUs through QPI or other buses. For example, NC0 connects S0 and S1, NC1 connects S2 and S3, and so on. The percentage marked next to the transmission link between two NCs is used to ide...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F13/28
Inventor 陈昊杨宝川陆斌
Owner HUAWEI TECH CO LTD