Collector communication system, method and device in supercomputing environment

A communication method and collector technology, applied in the field of communication, can solve problems such as the influence of the collector cluster on mutual communication and service anomalies, and achieve the effects of enhancing data processing capability and security, reducing the frequency of recycling, and highlighting substantive features.

Pending Publication Date: 2021-11-09
济南浪潮数据技术有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

And each node is also secret-free, which will have a great impact on the communication between our collector clusters
[0003] In the traditional field, each node is restricted by a firewall, so there are not many network packets that need to be processed. However, in the field of supercomputing, due to the massive data after running jobs between nodes, if the collector communicates with the infrastructure management platform If the traditional interface method is also used for data transmission, the interface may receive other data between the clusters, making JAVA continue to create objects, increasing the recycling frequency of GC, and causing service exceptions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Collector communication system, method and device in supercomputing environment
  • Collector communication system, method and device in supercomputing environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0047] Such as figure 1 As shown, this embodiment provides a collector communication system in a supercomputing environment, including: a network card 1 , a data filter 2 , a data collector 3 , an authentication module 4 and a data analyzer 5 . The data collector 3 is respectively connected to the data filter 2 , the authentication module 4 and the data analyzer 5 , the network card 1 is connected to the data filter 2 , and the authentication module 4 is connected to the data analyzer 5 .

[0048]Network card 1 is used to receive data and send it directly to data filter 2; data filter 3 is used to read preset filtering rules, use filtering rules to filter data, and send the filtered data to data collector 3; data acquisition The device 3 judges whether the received data is sensitive data, if it is sensitive data, sends the received data to the authentication module 4 for authentication and sends it to the data analyzer 5, if it is non-sensitive data, then directly sends the re...

Embodiment 2

[0051] Based on Example 1, such as figure 2 As shown, the present invention also discloses a collector communication method in a supercomputing environment, comprising the following steps:

[0052] S1: Receive data through the network card and send it directly to the data filter.

[0053] S2: The data filter reads the preset filtering rules every preset interval, and refreshes the buffer storing the preset filtering rules, starts the filtering process according to the preset filtering rules for data filtering, and sends the filtered data to the data collector.

[0054] Wherein, the preset interval time is five minutes. The filtering process includes:

[0055] First, check whether the first delimiter exists in the data received by the data filter through the first instruction; if it does not exist, the received data is directly discarded; if it exists, the string with the first delimiter in the data is split, Store the string before the first delimiter in variable A, and s...

Embodiment 3

[0066] Based on the above embodiments, this embodiment also discloses a collector communication method in a supercomputing environment, including:

[0067] 1. The network card directly enters the data filter after receiving massive data;

[0068] 2. The data filter reads the filtering rules every 5 minutes and refreshes the cache area of ​​the rules; the filtering process is as follows:

[0069] A. Search first by command 2d(-) to search for the separator "-", if not, discard it directly.

[0070] B. If there is a separator "-", split the string with the separator "-", store the string before the separator "-" in the array [0], and store the string after the separator "-" The string is stored in the array [1]; the array [0] is matched with the rule base, and the matched data enters the data collector.

[0071] Current rulebase:

[0072] 42 4d 43 (BMC) represents the data sent by BMC to the ISPIM infrastructure management platform;

[0073] 54 45 59 45 (TEYE) represents the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a collector communication system, method and device in a supercomputing environment. The method comprises the following steps: receiving data through a network card and directly sending the data to a data filter; enabling the data filter to read a preset filtering rule once every preset interval time, starting a filtering process according to the preset filtering rule for data filtering, and sending the filtered data to the data collector; judging whether the filtered data is sensitive data or not through a data collector, and if the filtered data is sensitive data, sending the filtered data to an authentication module; if the filtered data are non-sensitive data, sending the filtered data to a data analyzer; enabling the authentication module to encrypt the filtered data by adopting a preset encryption mode, generate encrypted data after encryption and send the encrypted data to the data analyzer; and enabling the data analyzer to carry out data persistence on the received data. According to the invention, the data processing capability and security of the infrastructure management platform in the cluster of the supercomputing scene are greatly enhanced.

Description

technical field [0001] The present invention relates to the field of communication technology, and more specifically relates to a collector communication system, method and device in a supercomputing environment. Background technique [0002] In the supercomputing environment, through the mutual communication between the collector clusters of the infrastructure management platform, avoid other network packets in the supercomputing from affecting the collection, and analyze the performance of the cluster. In order to ensure the best performance between nodes, secret-free login is configured between nodes and the firewall is turned off, so their management nodes such as Slurm can freely execute commands and schedule between nodes. And each node is also secret-free, which will have a great impact on the communication between our collector clusters. [0003] In the traditional field, each node is restricted by a firewall, so there are not many network packets that need to be pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/30G06F21/60G06F16/25
CPCG06F11/3093G06F21/602G06F16/25
Inventor 张典马骏峰
Owner 济南浪潮数据技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap