Unlock instant, AI-driven research and patent intelligence for your innovation.

Safety container placement method and system based on deep reinforcement learning

A reinforcement learning and security technology, applied in the field of cloud computing and machine learning, can solve the problems of placement strategy to enhance container security, and does not consider the scenario where containers are deployed on virtual machine nodes, so as to solve the threat of co-resident and reduce container The probability of staying together and the effect of mitigating attacks

Pending Publication Date: 2022-05-13
INST OF INFORMATION ENG CAS
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] CN106897110B proposes a container scheduling method and a management node scheduler, but this method only considers performance issues such as resource allocation and system consumption, and does not enhance the security of containers through placement strategies
CN105938437B provides a virtual machine deployment method that is resistant to co-location in a cloud environment, but this invention only considers the deployment of virtual machines on physical machines, and does not consider the scenario where containers are deployed on virtual machine nodes in cloud services

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Safety container placement method and system based on deep reinforcement learning
  • Safety container placement method and system based on deep reinforcement learning
  • Safety container placement method and system based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0032] Such as figure 1 As shown, a security container placement method based on deep reinforcement learning provided by an embodiment of the present invention includes the following steps:

[0033] Step S1: Receive the allocation request sequence of the container to be allocated, and initialize the placement strategy of the container to be allocated;

[0034] Step S2: Input the state of the current data center into the policy neural network, output the current placement strategy, execute the action, place a container in the request sequence on a working node, and update the state of the data center;

[0035] Step S3: Repeat step S2 to place the next container in the allocation request sequence in turn. After all the containers in the allocation request sequence are placed, calculate the container co-resident ratio, user load balancing index value and reward; obtain the action sequence of this round {a 1 ,...,a T}, where T is the number of containers to be allocated; the re...

Embodiment 2

[0067] Such as Figure 4 As shown, the embodiment of the present invention provides a security container placement system based on deep reinforcement learning, including the following modules:

[0068] The initialization placement strategy module 51 is used to receive the allocation request sequence of the container to be allocated, and initialize the placement strategy of the container to be allocated;

[0069] Calculate and execute the placement strategy module 52, which is used to input the state of the current data center into the strategy neural network, output the current placement strategy, execute an action, place a container in the request sequence on a working node, and update the state of the data center;

[0070] Calculation reward module 53, used for repeated calculation and execution of the placement strategy module, sequentially place the next container in the allocation request sequence, after all the containers in the allocation request sequence are placed, ca...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a security container placement method and system based on deep reinforcement learning, and the method comprises the steps: S1, receiving a distribution request sequence of a to-be-distributed container, and initializing a placement strategy of the to-be-distributed container; s2, inputting the state of the current data center into a strategy neural network, outputting a current placement strategy, executing action, and updating the state of the data center after placing one container in the request sequence at one working node; s3, the step S2 is repeated, the next container in the distribution request sequence is sequentially placed, and after all the containers in the distribution request sequence are placed, the container co-residence rate, the user load balancing index value and the reward are calculated; taking the rewards as feedback to guide the next round of training and updating network parameters; and S4, repeating the steps S1 to S3 according to a preset round, and obtaining an action sequence with the highest reward in each round as a placement strategy. According to the method provided by the invention, the probability of container co-residence among different users can be reduced while the load balance of the users is ensured, and the security threat among the containers is relieved.

Description

technical field [0001] The present invention relates to the fields of cloud computing and machine learning, in particular to a method and system for placing secure containers based on deep reinforcement learning. Background technique [0002] In the field of cloud computing, lightweight virtualization technology represented by container technology has risen strongly in recent years. Container is a lightweight operating system layer virtualization technology in the kernel. In the Linux kernel, it is mainly implemented by two mechanisms: Namespace and Cgroup. Compared with traditional virtualization technology, which uses a closed Guest OS to isolate the processes of different users, containers, a lightweight virtualization technology that only relies on the underlying operating system kernel software isolation mechanism, start faster and have higher resource utilization. However, while container technology triggers a new information technology revolution, it also introduces ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/455G06N3/04G06N3/08
CPCG06F9/45558G06N3/08G06F2009/4557G06N3/045
Inventor 王利明郑超王宇翔高海华王建凯邓启晴
Owner INST OF INFORMATION ENG CAS
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More