Data hierarchical transmission method and device, equipment, storage medium and product

By grading data flows according to network card information in the database system and adjusting priority, the problem of control commands being unable to be sent or received when the database pressure is too high, and the high availability of distributed database systems is achieved.

CN119561908AActive Publication Date: 2025-03-04CHINA MOBILE INFORMATION TECHNOLOGY CO LTD +1
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202411668435.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-20
Publication Date
2025-03-04
Estimated Expiration
2044-11-20

AI Technical Summary

Technical Problem

When the database pressure is too high, service-side messages occupy network resources, resulting in the control commands on the control surface being unable to be sent and received normally, affecting the availability of the system.

Method used

By determining the transmission network card corresponding to the service plane data flow and the control plane data flow based on the server's network card information, and calling the hierarchical control component to adjust the priority of the control plane data flow, the data is classified and transmitted through different data flow queues.

Benefits of technology

Ensure that when the database pressure is too high, the commands on the control plane can be sent and received first, ensuring high availability of the distributed database system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119561908A_ABST
    Figure CN119561908A_ABST
Patent Text Reader

Abstract

The invention discloses a data hierarchical transmission method and device, equipment, a storage medium and a product, relates to the technical field of distributed databases, and discloses a data hierarchical transmission method which comprises the following steps: determining a transmission network card corresponding to a service plane data stream and a transmission network card corresponding to a control plane data stream according to network card information of a server; calling a hierarchical control component to adjust the priority of the control plane data stream to obtain the priority of the control plane data stream; determining a first data flow queue corresponding to the control plane data flow and a second data flow queue corresponding to the service plane data flow according to the priority of the control plane data flow; and the queues are transmitted through the corresponding transmission network cards. Through the mode, the network interaction data of the distributed database system is graded, and the data with high priority is forwarded preferentially, so that the command of a control plane can be transmitted and received preferentially when the pressure of the database is too high, and the high availability of the distributed database system is ensured.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of distributed database technology, and in particular to data hierarchical transmission methods, devices, equipment, storage media and products. Background Art

[0002] In the database field, the business plane and the control plane are two core concepts of database management systems. The task of the business plane is to handle the actual data transmission and storage, and to execute data operation requests initiated by users and applications. The control plane is responsible for managing and coordinating database operations. It processes the control information of the database and maintains the overall structure and status of the database. In a distributed database, the business plane can be distributed on multiple nodes, while the control plane is responsible for global control and coordination of the database. In actual scenarios, when the database is under too much pressure, this situation may occur: the business plane messages occupy all network resources, causing the control plane control commands to be unable to be sent and received normally, affecting the availability of the system.

[0003] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0004] The main purpose of this application is to provide a data hierarchical transmission method, device, equipment, storage medium and product, aiming to solve the technical problem in the prior art that when the database pressure is too high, the control plane control commands cannot be guaranteed to be sent and received normally, affecting the system availability.

[0005] To achieve the above objectives, the present application proposes a data hierarchical transmission method, the method comprising:

[0006] Determine the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow according to the network card information of the server;

[0007] calling a hierarchical control component, and adjusting the priority of the control plane data flow through the hierarchical control component to obtain the priority of the control plane data flow;

[0008] Determine, according to the priority of the control plane data flow, a first data flow queue corresponding to the control plane data flow and a second data flow queue corresponding to the service plane data flow;

[0009] The first data flow queue is transmitted through the transmission network card corresponding to the control plane data flow, and the second data flow queue is transmitted through the transmission network card corresponding to the service plane data flow.

[0010] In one embodiment, the step of determining the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow according to the network card information of the server includes:

[0011] calling a hierarchical identification component, and obtaining server configuration information of the server through the hierarchical identification component;

[0012] Parsing the server configuration information to determine the network card information of the server;

[0013] Determine the number of network cards supported by the server according to the network card information;

[0014] When the number of network cards supported by the server is not a preset number, a transmission network card corresponding to the service plane data flow and a transmission network card corresponding to the control plane data flow are determined according to address information of a plurality of supported network cards.

[0015] In one embodiment, the step of determining the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow according to the address information of the plurality of supporting network cards comprises:

[0016] Calling the hierarchical control component;

[0017] Modifying the control plane configuration information based on the hierarchical control component, the address information of the plurality of supporting network cards, and the service plane configuration information to obtain modified control plane configuration information;

[0018] Determine the transmission network card corresponding to the control plane data flow according to the modified control plane configuration information;

[0019] Determine the transmission network card corresponding to the service plane data flow according to the service plane configuration information.

[0020] In one embodiment, before the step of modifying the control plane configuration information based on the hierarchical control component, the address information of the plurality of supporting network cards and the service plane configuration information to obtain the modified control plane configuration information, the step further includes:

[0021] Calling a hierarchical identification component, and obtaining instance configuration information of each database instance and component configuration information of a high-availability component through the hierarchical identification component;

[0022] Determine business plane configuration information according to instance configuration information of each database instance;

[0023] Control plane configuration information is determined according to the component configuration information of the high-availability component.

[0024] In one embodiment, after the step of determining the number of network cards supported by the server according to the network card information, the method further includes:

[0025] When the number of network cards supported by the server is a preset number, it is determined that the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow are both the target transmission network cards corresponding to the server.

[0026] In one embodiment, the step of calling the hierarchical control component and adjusting the priority of the control plane data flow through the hierarchical control component to obtain the priority of the control plane data flow includes:

[0027] calling the hierarchical control component so that the first high availability component and the second high availability component respectively modify the differential service code field according to the hierarchical control component;

[0028] The priority of the control plane data flow is determined according to the differentiated services code field.

[0029] In addition, to achieve the above purpose, the present application also proposes a data hierarchical transmission device, the data hierarchical transmission device comprising: a processing module, used to determine the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow according to the network card information of the server;

[0030] A calling module, used for calling a hierarchical control component, adjusting the priority of the control plane data flow through the hierarchical control component, and obtaining the priority of the control plane data flow;

[0031] The processing module is further used to determine a first data flow queue corresponding to the control plane data flow and a second data flow queue corresponding to the service plane data flow according to the priority of the control plane data flow;

[0032] The transmission module is used to transmit the first data flow queue through the transmission network card corresponding to the control plane data flow, and transmit the second data flow queue through the transmission network card corresponding to the business plane data flow.

[0033] In addition, to achieve the above-mentioned purpose, the present application also proposes a data hierarchical transmission device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, and the computer program is configured to implement the steps of the data hierarchical transmission method described above.

[0034] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the data hierarchical transmission method described above are implemented.

[0035] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps of the data hierarchical transmission method described above are implemented.

[0036] The present application provides a data hierarchical transmission method, which determines the transmission network card corresponding to the business plane data flow and the transmission network card corresponding to the control plane data flow according to the network card information of the server; calls the hierarchical control component, and adjusts the priority of the control plane data flow through the hierarchical control component to obtain the priority of the control plane data flow; determines the first data flow queue corresponding to the control plane data flow and the second data flow queue corresponding to the business plane data flow according to the priority of the control plane data flow; transmits the first data flow queue through the transmission network card corresponding to the control plane data flow, and transmits the second data flow queue through the transmission network card corresponding to the business plane data flow. Through the above method, the network interaction data of the distributed database system is hierarchical, and the data with high priority is forwarded first, so as to ensure that when the database pressure is too large, the control plane commands can be sent and received first, thereby ensuring the high availability of the distributed database system. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0038] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0039] Figure 1 A schematic diagram of a process flow provided for the first embodiment of the method for hierarchical data transmission of the present application;

[0040] Figure 2 A schematic diagram of system data flow provided in Example 1 of the present application;

[0041] Figure 3 A schematic diagram of the control plane data flow provided in Example 1 of the present application;

[0042] Figure 4 A schematic diagram of the service plane data flow provided in Example 1 of the present application;

[0043] Figure 5 A flowchart of the second embodiment of the data transmission method of the present application is provided;

[0044] Figure 6 A schematic diagram of a single network card scenario provided in Embodiment 2 of the present application;

[0045] Figure 7 A schematic diagram of a multi-network card scenario provided in Embodiment 2 of the present application;

[0046] Figure 8 This is a schematic diagram of the module structure of the data hierarchical transmission device according to an embodiment of the present application;

[0047] Fig. 9 It is a schematic diagram of the device structure of the hardware operating environment involved in the data hierarchical transmission method in the embodiment of the present application.

[0048] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0049] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0050] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0051] The main solution of the embodiment of the present application is: determine the transmission network card corresponding to the business plane data flow and the transmission network card corresponding to the control plane data flow according to the network card information of the server; call the hierarchical control component, and adjust the priority of the control plane data flow through the hierarchical control component to obtain the priority of the control plane data flow; determine the first data flow queue corresponding to the control plane data flow and the second data flow queue corresponding to the business plane data flow according to the priority of the control plane data flow; transmit the first data flow queue through the transmission network card corresponding to the control plane data flow, and transmit the second data flow queue through the transmission network card corresponding to the business plane data flow.

[0052] Currently, there are technologies for marking network packets of corresponding application services and setting network sending priorities of corresponding applications through net_cls and net_prio subsystems in Control Groups of Linux kernel layer for Android applications. There are also technologies for implementing network classification by modifying Linux kernel for container applications on existing high-performance computing systems (such as Shenwei platform). There are also technologies for implementing priority adaptive adjustment through programmable switches and adaptive adjustment of global parameters based on the satisfaction of packet transmission delay. In the field of distributed databases, there is no network data classification scheme. CGroups is a feature of Linux kernel that allows users to organize processes into groups and allocate resources (such as CPU time, memory, network bandwidth, etc.) to these groups. CGroups is used to limit, isolate, manage and account for physical resources used by process groups. net_cls is a module in CGroups subsystem that is used to classify traffic on network devices. net_prio is also a module in CGroups that allows users to set the priority of network traffic.

[0053] In the database field, the business plane and the control plane are two core concepts of database management systems. The task of the business plane is to handle the actual data transmission and storage, and to execute data operation requests initiated by users and applications. The control plane is responsible for managing and coordinating database operations. It processes the control information of the database and maintains the overall structure and status of the database. In a distributed database, the business plane can be distributed on multiple nodes, while the control plane is responsible for global control and coordination of the database. In actual scenarios, when the database is under too much pressure, this situation may occur: the business plane messages occupy all network resources, causing the control plane control commands to be unable to be sent and received normally, affecting the availability of the system.

[0054] The present application implements grading of network interaction data of a distributed database system, and forwarding data with high priority first, so as to ensure that when the database pressure is too high, the commands of the control plane can be sent and received first, thereby ensuring the high availability of the distributed database system.

[0055] It should be noted that the execution subject of this embodiment may be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device capable of realizing the above functions, a data hierarchical transmission device, etc. The following takes the data hierarchical transmission device as an example to illustrate this embodiment and the following embodiments.

[0056] Based on this, the embodiment of the present application provides a data hierarchical transmission method, referring to Figure 1 , Figure 1 This is a flow chart of the first embodiment of the data hierarchical transmission method of the present application.

[0057] In this embodiment, the data hierarchical transmission method includes steps S10 to S40:

[0058] Step S10, determining the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow according to the network card information of the server.

[0059] It should be noted that the data hierarchical transmission device of this embodiment is equipped with a data hierarchical transmission device, which is composed of a high-availability device, a data hierarchical identification component, and a data hierarchical control component. The ha_ctl uses the functions of the data hierarchical identification component and the data hierarchical control component to control the priority of the network data flow between ha_ctl, ha_server, and ha_agent. Figure 2 As shown, red represents control plane data and blue represents business plane data.

[0060] It can be understood that the high availability device of this embodiment is a database cluster management module, which is divided into three components: ha server (High Available Control Tool), ha_agent (High Available Agent), and ha_ctl (High Available Control Tool). Haserver provides automatic failover services and a management service interface for ha_ctl; ha_ctl provides installation and deployment, expansion / reduction, manual switching, monitoring status and other functions; ha_agent has one ha_agent for each database instance, and ha_agent provides status information for the high availability service ha server and executes instructions from the ha server. The network interaction data between high availability components can be classified as control plane data, and data flows such as Figure 3 shown.

[0061] In the specific implementation, in the distributed database, the nodes mainly include CN (Coordinator Node), DN (Data Node) and GTM (Global Transaction Manager). GTM is responsible for global transaction consistency. DN and GTM have multiple copies, which are master and backup for each other. The master and backup need data synchronization. The data interaction between nodes belongs to business data. The data flow is as follows: Figure 4 shown.

[0062] It should be noted that the data hierarchical identification component in the data hierarchical transmission device is used to parse the configuration of the database cluster and obtain the configuration information of the database instance and the high-availability component. The database instance configuration information is classified as the business plane configuration information, and the high-availability component configuration information is classified as the control plane configuration information. At the same time, the data hierarchical identification component is also used to parse the configuration information of the database installation server and obtain the network card information.

[0063] It can be understood that the data hierarchical control component in the data hierarchical transmission device is used to receive the business plane, control plane and server network card information output by the data hierarchical transmission device. If the server supports multiple network cards and the user allows the use of multiple network cards, the component will modify the control plane component IP to achieve IP separation of the control plane component and the business plane component, so that the control plane and the business plane use different network cards to send and receive network interaction data. At the same time, the data hierarchical control component configures a higher priority for the control plane data by setting the DSCP (Differentiated Services Code Point) field, so that it enters the high priority queue of the protocol stack kernel. In this embodiment, the DSCP field is located in the header of the IP data packet, which is used to identify the service level to which the data packet belongs, so that the network equipment can distinguish and provide corresponding levels of services according to different DSCP values, such as priority, delay tolerance, etc.

[0064] In a specific implementation, the network card information is obtained by calling the data hierarchical identification component and parsing the configuration information of the database installation server through the hierarchical identification component. When the number of network cards supported by the server is determined based on the network card information, when the server supports multiple network cards, the hierarchical control component is called to modify the IP of the high-availability components ha_agent and ha_server, determine the network card corresponding to the high-availability component, and determine the network card corresponding to the business plane component based on the configuration information of the business plane component, so that the high-availability component and the business plane component use different network cards for network interaction. In this embodiment, the transmission network card corresponding to the control plane data flow refers to the network card for the high-availability component to interact with the network; the transmission network card corresponding to the business plane data flow refers to the network card for the business plane component to interact with the network.

[0065] It should be noted that when the server does not support multiple network cards, the transmission network card corresponding to the service plane data flow and the network card corresponding to the control plane data flow are the only network cards supported by the server.

[0066] Step S20: calling a hierarchical control component, and adjusting the priority of the control plane data flow through the hierarchical control component to obtain the priority of the control plane data flow.

[0067] It should be noted that by calling the hierarchical control component and configuring a higher priority for the control plane data flow, the control plane data flow and the business plane data flow enter different priority queues of the kernel protocol stack, the control plane data flow enters the high priority queue, and the business plane data flow enters the relatively low priority queue.

[0068] In a feasible implementation, step S20 may include steps A11 to A12:

[0069] Step A11, calling the hierarchical control component so that the first high availability component and the second high availability component modify the differential service code field according to the hierarchical control component respectively.

[0070] Step A12: determining the priority of the control plane data flow according to the differential service code field.

[0071] It should be noted that in this embodiment, the gRPC framework used for network communication between high-availability devices can adjust the priority of network packets by setting the value of grpc.DSCP. In gRPC, DSCP can be set when the client and server communicate to assign specific network priorities to gRPC requests and responses. In this way, network devices can provide different processing based on these priorities. This command will modify the value of grpc.DSCP of the ha_server component and the ha_agent component. In this embodiment, the gRPC framework is a high-performance, open source Remote Procedure Call (RPC) framework. It allows client applications to execute functions on remote servers as if it were a local call. The above process does not modify the priority of the business plane data flow, but only modifies the priority of the control plane data flow. By increasing the priority of the control plane data flow, the control plane commands can be sent and received first.

[0072] It can be understood that the first high availability component is the ha_server component, and the second high availability component is the ha_agent component; the first high availability component may also be the ha_agent component, and the second high availability component may be the ha_server component, which is not limited in this embodiment.

[0073] In this embodiment, the hierarchical control component is called to modify the DSCP value in the socket option of the first high-availability component and the second high-availability component, so as to determine the priority of the control plane data flow based on the DSCP value. For example, the hierarchical control component is: ha_ctl net-control DSCP 0x2e-lhttp: / / xxx:2379, which modifies the DSCP value in the socket option of the first high-availability component and the second high-availability component to 0x2e.

[0074] Step S30: determining a first data flow queue corresponding to the control plane data flow and a second data flow queue corresponding to the service plane data flow according to the priority of the control plane data flow.

[0075] It should be noted that based on the priority of the control plane data flow, the network plane data flow is controlled to enter the first data flow queue with a higher priority in the kernel protocol stack, and the service plane data flow is controlled to enter the second data flow queue with a relatively lower priority in the kernel protocol stack.

[0076] Step S40: transmitting the first data flow queue through the transmission network card corresponding to the control plane data flow, and transmitting the second data flow queue through the transmission network card corresponding to the service plane data flow.

[0077] It should be noted that the first data flow queue is transmitted through the transmission network card corresponding to the control plane data flow, and the second data flow queue is transmitted through the transmission network card corresponding to the service plane data flow.

[0078] This embodiment provides a data hierarchical transmission method, which determines the transmission network card corresponding to the business plane data flow and the transmission network card corresponding to the control plane data flow according to the network card information of the server; calls the hierarchical control component, and adjusts the priority of the control plane data flow through the hierarchical control component to obtain the priority of the control plane data flow; determines the first data flow queue corresponding to the control plane data flow and the second data flow queue corresponding to the business plane data flow according to the priority of the control plane data flow; transmits the first data flow queue through the transmission network card corresponding to the control plane data flow, and transmits the second data flow queue through the transmission network card corresponding to the business plane data flow. Through the above method, the network interaction data of the distributed database system is hierarchical, and the data with high priority is forwarded first, so as to ensure that when the database pressure is too large, the control plane commands can be sent and received first, thereby ensuring the high availability of the distributed database system.

[0079] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated in the following. Figure 5 , step S10, the data hierarchical transmission method further includes steps S11 to S14:

[0080] Step S11, calling the hierarchical identification component, and obtaining the server configuration information of the server through the hierarchical identification component.

[0081] Step S12, parsing the server configuration information to determine the network card information of the server.

[0082] Step S13, determining the number of network cards supported by the server according to the network card information.

[0083] It should be noted that the hierarchical identification component is called to collect the server configuration information of the database installation server. The server configuration information is then parsed to extract information related to the network card. In this embodiment, the network card information includes but is not limited to the model, MAC address, IP address, subnet mask, and gateway of the network card. Based on the network card information, all detected network cards are traversed, and the number of valid network cards is counted, excluding virtual network cards, unconfigured network cards, or other non-physical network interfaces, so as to obtain the number of network cards supported by the server.

[0084] In a feasible implementation manner, after step S13, it also includes: when the number of network cards supported by the server is a preset number, determining that the transmission network card corresponding to the business plane data flow and the transmission network card corresponding to the control plane data flow are both the target transmission network cards corresponding to the server.

[0085] It should be noted that in this embodiment, the preset number is 1, and the target transmission network card refers to the only network card supported by the server. When the number of network cards supported by the server is the preset number, the target transmission network card is used as the transmission network card corresponding to the business plane data flow and the transmission network card corresponding to the control plane data flow. Figure 6 As shown, at this time, the hierarchical control component configures a higher priority for the control plane data flow, so that the control plane network data flow and the business plane network data flow enter different priority queues of the kernel protocol stack, the control plane data enters the high priority queue, and the business plane data enters the relatively low priority queue.

[0086] Step S14, when the number of network cards supported by the server is not a preset number, determining a transmission network card corresponding to the service plane data flow and a transmission network card corresponding to the control plane data flow according to address information of multiple supported network cards.

[0087] It should be noted that when the server supports network card data that is not the preset number, it means that the database installation server supports multiple network cards. At this time, based on the address information of multiple supported network cards, the hierarchical control component is called to modify the IP of the high-availability components ha_agent and ha_server, determine the network card corresponding to the high-availability component, and determine the network card corresponding to the business plane component based on the configuration information of the business plane component, so that the high-availability component and the business plane component use different network cards for network interaction. In this embodiment, the address information of multiple supported network cards refers to the IP information of each network card.

[0088] In a feasible implementation, step S14 may include steps B11 to B14:

[0089] Step B11, calling the hierarchical control component.

[0090] Step B12: modify the control plane configuration information based on the hierarchical control component, the address information of the plurality of supporting network cards, and the service plane configuration information to obtain modified control plane configuration information.

[0091] Step B13: determining the transmission network card corresponding to the control plane data flow according to the modified control plane configuration information.

[0092] Step B14: determining the transmission network card corresponding to the service plane data flow according to the service plane configuration information.

[0093] It should be noted that the hierarchical control component is called to modify the IP address of the first high-availability component and the IP address of the second high-availability component through the hierarchical control component, so that the IP address of the first high-availability component and the IP component of the second high-availability component are consistent with the address information of one of the supporting network cards, and the IP address of the first high-availability component and the IP component of the second high-availability component are inconsistent with the IP address in the business plane configuration information. In this embodiment, the control plane configuration information includes but is not limited to the configuration information of the first high-availability component and the configuration information of the second high-availability component. After completing the modification of the IP address of the first high-availability component and the IP component of the second high-availability component, the modified control plane configuration information can be obtained.

[0094] It can be understood that the transmission network card corresponding to the control plane data flow can be determined by the IP address in the modified control plane configuration information, and the transmission network card corresponding to the service plane data flow can be determined by the IP address in the service plane configuration information.

[0095] In the specific implementation, Figure 7 As shown, when the server supports multiple network cards, the hierarchical control component in the data hierarchical transmission device modifies the control plane component fIP so that the control plane data flow and the business plane data flow use different network cards for network interaction. For example, calling the hierarchical control component: ha_ctl net-control IP-p <path to file>-lhttp: / / xxx:2379 command to uniformly modify the IP addresses of high-availability components.

[0096] In a feasible implementation manner, before step B12, steps C11 to C13 may also be included:

[0097] Step C11, calling the hierarchical identification component, and obtaining instance configuration information of each database instance and component configuration information of the high-availability component through the hierarchical identification component.

[0098] Step C12: determining the business plane configuration information according to the instance configuration information of each database instance.

[0099] Step C13: Determine control plane configuration information according to the component configuration information of the high-availability component.

[0100] It should be noted that calling the hierarchical identification component (for example: ha_ctl get net-config -p <path to file>-l http: / / xxx:2379), obtain the component configuration information of each database instance, the component configuration information of the high-availability component and the server configuration information of the server from the database cluster, divide the instance configuration information of each database instance into business plane configuration information, divide the component configuration information of the high-availability component into control plane configuration information, and save the above-mentioned configuration information in a specific file format (such as YAML) on the specified path. In this embodiment, in the distributed database, each database instance has a corresponding ha_agent, which is used to execute the control commands sent by ha_server to the database. The ha_server stores the configuration information of each database instance, among which host and port store the network information of the database, which is divided into the business plane, and agent_host and agent_port store the network information of ha_agent, which is divided into the control plane.

[0101] This embodiment provides a data hierarchical transmission method, which calls a hierarchical identification component to obtain the server configuration information of the server through the hierarchical identification component; parses the server configuration information to determine the network card information of the server; determines the number of network cards supported by the server according to the network card information; and when the number of network cards supported by the server is not a preset number, determines the transmission network card corresponding to the business plane data flow and the transmission network card corresponding to the control plane data flow according to the address information of multiple supported network cards. Through the above method, it is realized that in a multi-network card scenario, the business plane data flow and the control plane data flow can interact with each other through different network cards.

[0102] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the data hierarchical transmission method of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0103] This application also provides a data hierarchical transmission device, please refer to Figure 8 , the data hierarchical transmission device comprises:

[0104] The processing module 10 is used to determine the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow according to the network card information of the server.

[0105] The calling module 20 is used to call the hierarchical control component, and adjust the priority of the control plane data flow through the hierarchical control component to obtain the priority of the control plane data flow.

[0106] The processing module 10 is further configured to determine a first data flow queue corresponding to the control plane data flow and a second data flow queue corresponding to the service plane data flow according to the priority of the control plane data flow.

[0107] The transmission module 30 is used to transmit the first data flow queue through the transmission network card corresponding to the control plane data flow, and transmit the second data flow queue through the transmission network card corresponding to the service plane data flow.

[0108] Optionally, the processing module 10 is further used for:

[0109] Calling a hierarchical identification component, and obtaining server configuration information of the server through the hierarchical identification component; parsing the server configuration information to determine the network card information of the server; determining the number of network cards supported by the server according to the network card information; when the number of network cards supported by the server is not a preset number, determining the transmission network card corresponding to the business plane data flow and the transmission network card corresponding to the control plane data flow according to the address information of multiple supported network cards.

[0110] Optionally, the processing module 10 is further used for:

[0111] Calling a hierarchical control component; modifying the control plane configuration information based on the hierarchical control component, address information of multiple supporting network cards, and business plane configuration information to obtain modified control plane configuration information; determining a transmission network card corresponding to a control plane data flow according to the modified control plane configuration information; determining a transmission network card corresponding to a business plane data flow according to the business plane configuration information.

[0112] Optionally, the processing module 10 is further used for:

[0113] Call the hierarchical identification component, and obtain the instance configuration information of each database instance and the component configuration information of the high-availability component through the hierarchical identification component; determine the business plane configuration information according to the instance configuration information of each database instance; determine the control plane configuration information according to the component configuration information of the high-availability component.

[0114] Optionally, the processing module 10 is further used for:

[0115] When the number of network cards supported by the server is a preset number, it is determined that the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow are both the target transmission network cards corresponding to the server.

[0116] Optionally, the processing module 20 is further used for:

[0117] The hierarchical control component is called to enable the first high-availability component and the second high-availability component to modify the differential service code field according to the hierarchical control component respectively; and the priority of the control plane data flow is determined according to the differential service code field.

[0118] The data hierarchical transmission device provided by the present application adopts the data hierarchical transmission method in the above embodiment, which can solve the technical problem in the prior art that when the database pressure is too large, the control plane control commands cannot be guaranteed to be sent and received normally, affecting the availability of the system. Compared with the prior art, the beneficial effects of the data hierarchical transmission device provided by the present application are the same as the beneficial effects of the data hierarchical transmission method provided by the above embodiment, and the other technical features in the data hierarchical transmission device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0119] The present application provides a data hierarchical transmission device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the data hierarchical transmission method in the above-mentioned embodiment one.

[0120] Reference below Fig. 9 , which shows a schematic diagram of the structure of a data hierarchical transmission device suitable for implementing the embodiment of the present application. The data hierarchical transmission device in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions: tablet computers), PMPs (Portable Media Players: portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig. 9 The data hierarchical transmission device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0121] like Fig. 9 As shown, the data hierarchical transmission device may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the data hierarchical transmission device are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the data hierarchical transmission device to communicate with other devices wirelessly or by wire to exchange data. Although the data hierarchical transmission device with various systems is shown in the figure, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0122] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0123] The data hierarchical transmission device provided by the present application adopts the data hierarchical transmission method in the above embodiment, which can solve the technical problem in the prior art that when the database pressure is too large, the control plane control commands cannot be guaranteed to be sent and received normally, affecting the availability of the system. Compared with the prior art, the beneficial effects of the data hierarchical transmission device provided by the present application are the same as the beneficial effects of the data hierarchical transmission method provided by the above embodiment, and the other technical features in the data hierarchical transmission device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0124] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0125] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0126] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, wherein the computer-readable program instructions are used to execute the data hierarchical transmission method in the above-mentioned embodiment.

[0127] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0128] The computer-readable storage medium may be included in the data hierarchical transmission device; or may exist independently without being assembled into the data hierarchical transmission device.

[0129] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the data hierarchical transmission device, the data hierarchical transmission device: determines the transmission network card corresponding to the business plane data flow and the transmission network card corresponding to the control plane data flow according to the network card information of the server; calls the hierarchical control component, and adjusts the priority of the control plane data flow through the hierarchical control component to obtain the priority of the control plane data flow; determines the first data flow queue corresponding to the control plane data flow and the second data flow queue corresponding to the business plane data flow according to the priority of the control plane data flow; transmits the first data flow queue through the transmission network card corresponding to the control plane data flow, and transmits the second data flow queue through the transmission network card corresponding to the business plane data flow.

[0130] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0131] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0132] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0133] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned data hierarchical transmission method, and can solve the technical problem in the prior art that when the database pressure is too large, the control plane control commands cannot be guaranteed to be sent and received normally, which affects the availability of the system. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the data hierarchical transmission method provided by the above-mentioned embodiment, and will not be repeated here.

[0134] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned data hierarchical transmission method when executed by a processor.

[0135] The computer program product provided by the present application can solve the technical problem in the prior art that when the database pressure is too high, the control plane control commands cannot be sent and received normally, which affects the availability of the system. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as the beneficial effects of the data hierarchical transmission method provided by the above embodiment, which will not be repeated here.

[0136] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.< / path> < / path>

Claims

1. A data hierarchical transmission method, characterized in that: The data hierarchical transmission method comprises: Determine the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow according to the network card information of the server; calling a hierarchical control component, and adjusting the priority of the control plane data flow through the hierarchical control component to obtain the priority of the control plane data flow; Determine, according to the priority of the control plane data flow, a first data flow queue corresponding to the control plane data flow and a second data flow queue corresponding to the service plane data flow; The first data flow queue is transmitted through the transmission network card corresponding to the control plane data flow, and the second data flow queue is transmitted through the transmission network card corresponding to the service plane data flow.

2. The method according to claim 1, characterized in that The step of determining the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow according to the network card information of the server includes: calling a hierarchical identification component, and obtaining server configuration information of the server through the hierarchical identification component; Parsing the server configuration information to determine the network card information of the server; Determine the number of network cards supported by the server according to the network card information; When the number of network cards supported by the server is not a preset number, a transmission network card corresponding to the service plane data flow and a transmission network card corresponding to the control plane data flow are determined according to address information of a plurality of supported network cards.

3. The method according to claim 2, characterized in that The step of determining the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow according to the address information of the plurality of supporting network cards comprises: Calling the hierarchical control component; Modifying the control plane configuration information based on the hierarchical control component, the address information of the plurality of supporting network cards, and the service plane configuration information to obtain modified control plane configuration information; Determine the transmission network card corresponding to the control plane data flow according to the modified control plane configuration information; Determine the transmission network card corresponding to the service plane data flow according to the service plane configuration information.

4. The method according to claim 3, characterized in that Before the step of modifying the control plane configuration information based on the hierarchical control component, the address information of the plurality of supporting network cards and the service plane configuration information to obtain the modified control plane configuration information, the step further includes: Calling a hierarchical identification component, and obtaining instance configuration information of each database instance and component configuration information of a high-availability component through the hierarchical identification component; Determine business plane configuration information according to instance configuration information of each database instance; Control plane configuration information is determined according to the component configuration information of the high-availability component.

5. The method according to claim 2, characterized in that After the step of determining the number of network cards supported by the server according to the network card information, the method further includes: When the number of network cards supported by the server is a preset number, it is determined that the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow are both the target transmission network cards corresponding to the server.

6. The method according to any one of claims 1 to 5, characterized in that The step of calling the hierarchical control component and adjusting the priority of the control plane data flow through the hierarchical control component to obtain the priority of the control plane data flow includes: calling the hierarchical control component so that the first high availability component and the second high availability component respectively modify the differential service code field according to the hierarchical control component; The priority of the control plane data flow is determined according to the differentiated services code field.

7. A data hierarchical transmission device, characterized in that: The data hierarchical transmission device comprises: A processing module, used to determine the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow according to the network card information of the server; A calling module, used for calling a hierarchical control component, adjusting the priority of the control plane data flow through the hierarchical control component, and obtaining the priority of the control plane data flow; The processing module is further used to determine a first data flow queue corresponding to the control plane data flow and a second data flow queue corresponding to the service plane data flow according to the priority of the control plane data flow; The transmission module is used to transmit the first data flow queue through the transmission network card corresponding to the control plane data flow, and transmit the second data flow queue through the transmission network card corresponding to the business plane data flow.

8. A data hierarchical transmission device, characterized in that: The device comprises: a memory, a processor, and a data hierarchical transmission program stored in the memory and executable on the processor, wherein the data hierarchical transmission program is configured to implement the steps of the data hierarchical transmission method according to any one of claims 1 to 6.

9. A storage medium, characterized in that: The storage medium stores a data hierarchical transmission program, which, when executed by a processor, implements the steps of the data hierarchical transmission method according to any one of claims 1 to 6.

10. A computer program product, characterized in that The computer program product comprises a hierarchical data transmission program, and when the hierarchical data transmission program is executed by a processor, the steps of the hierarchical data transmission method according to any one of claims 1 to 6 are implemented.

Citation Information

Patent Citations

  • Data transmission method and device

    CN104994590A

  • Control surface and business surface separating method and system, server and cloud calculating platform

    CN106571945A

  • Data packet transmitting method and system, data packet receiving method and system, equipment and medium

    CN111490947A

  • Message processing method for data processing unit, computer equipment and medium

    CN117909031A

  • Flexible message forwarding control method and system of cloud platform virtual server

    CN118945120A