Large-page memory dynamic migration method and device based on DPDK

A technology of dynamic migration and memory, which is applied in the field of data communication, can solve the problems of poor system stability and low effective utilization of large page memory, and achieve the effect of ensuring normal operation, flexible use, and constant characteristics

Active Publication Date: 2021-07-09
FENGHUO COMM SCI & TECH CO LTD +1
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Aiming at the above defects or improvement needs of the prior art, the present invention provides a method and device for dynamically migrating large page memory based on DPDK. Seconded to realize the successful application of large page memory, thereby solving the technical problems of low effective utilization of large page memory and poor system stability in traditional solutions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Large-page memory dynamic migration method and device based on DPDK
  • Large-page memory dynamic migration method and device based on DPDK
  • Large-page memory dynamic migration method and device based on DPDK

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0053] In order to solve the technical problems of low effective utilization of large page memory and poor system stability in the traditional solution, the embodiment of the present invention provides a method for dynamic migration of large page memory based on DPDK. The large page memory migration framework can refer to figure 2 .

[0054] combine figure 2 It can be seen that there are often multiple types of buffer pools in the system. For example, the Jumbo buffer pool is a large message buffer pool used to send and receive large messages, and the software buffer pool is a software buffer pool used when the device actively sends messages. The protocol buffer pool is a protocol buffer pool for sending and receiving protocol messages, and the pktbuffer pool is a message buffer pool for sending and receiving ordinary messages. user means huge page memory users other than the buffer pool. User and buffer pool are in equal status and can apply for huge page memory usage from...

Embodiment 2

[0066] On the basis of the above-mentioned embodiment 1, the embodiment of the present invention further provides a specific implementation manner of large page memory dynamic migration based on DPDK by taking the buffer pool as an example for management by dividing it into buffers. In this embodiment, the preparation steps before memory migration are as follows:

[0067] 1) Reversely define the secondment priority of each buffer pool according to the usage scenarios and importance of the buffer pool, and set the secondment weight of each buffer pool according to the corresponding secondment priority.

[0068] The definition principle of secondment priority is to try not to affect the memory usage requirements of the seconded buffer pool itself, which can be reversely defined according to the usage scenarios and importance of the buffer pool: the wider the usage scenarios and the higher the importance of the buffer pool, the more important it is Prioritize the memory usage req...

Embodiment 3

[0107] On the basis of the above-mentioned embodiments 1 and 2, the embodiment of the present invention further provides a specific implementation manner of large page memory dynamic migration based on DPDK by taking the memory part of the buffer pool divided into buffers for management as an example. In this embodiment, the preparation steps before memory migration are as follows:

[0108] 1) Reversely define the secondment priority of each buffer pool according to the usage scenarios and importance of the buffer pool, and set the secondment weight of each buffer pool according to the corresponding secondment priority. Wherein, the specific setting principles of secondment priority and secondment weight can refer to Embodiment 2, which will not be repeated here.

[0109] 2) Calculate the pre-allocated memory space of each buffer pool according to the corresponding secondment weight, divide this part of memory space into multiple buffers, and use the remaining continuous large...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a large-page memory dynamic migration method and device based on a DPDK (Data Platform Development Kit), and the method comprises the steps: when application for a large-page memory from a large-page memory pool fails, loaning a required large-page memory space from a buffer pool which has enough idle large-page memory; registering attribution information of the loaned large-page memory space to a recovery thread, and synchronizing the attribution information to corresponding control information; dynamically monitoring the memory change in the large-page memory pool, and when the large-page memory is redundant, applying for a new large-page memory space according to the attribution information registered in the recovery thread and filling the new large-page memory space into the corresponding buffer pool; and when the large-page memory user actively releases the applied large-page memory space, releasing the loaned large-page memory space back to the corresponding buffer pool. According to the method and device, secondary flexible use of the large-page memory can be realized, the problems of service interruption, equipment abnormity and the like caused by memory application failure are avoided, and the utilization rate of the large-page memory is improved.

Description

technical field [0001] The invention belongs to the technical field of data communication, and more specifically relates to a method and a device for dynamic migration of large page memory based on DPDK. Background technique [0002] The forwarding platform of traditional network equipment is based on a dedicated network chip, such as cavium's cn78xx network processor. The technical solution based on a dedicated network chip leads to a high degree of hardware dependence, and the flexibility of business development is limited by the hardware, which further causes the business development cycle to become longer, the market delivery cycle to be delayed, and the product development cost to be further increased. DPDK (Intel Data Plane Development Kit, Intel Data Plane Development Kit) technology is based on a general-purpose processor (such as x86 and arm) for the construction of a multi-core soft forwarding platform. This technical solution not only guarantees data processing p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5016G06F9/5022
Inventor 孙琳洋王小营
Owner FENGHUO COMM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products