Data hierarchical transmission method, device, equipment, storage medium and product
By allocating network interface cards (NICs) for service plane and control plane data streams according to NIC information in a distributed database system, and adjusting the priority of control plane data streams, the problem of control commands failing to be sent and received normally under excessive database pressure is solved, ensuring high availability of the system.
Patent Information
- Application Number
- CN202411668435.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-20
- Publication Date
- 2026-02-03
- Estimated Expiration
- 2044-11-20
AI Technical Summary
When the database is under excessive pressure, existing technologies cannot guarantee the normal sending and receiving of control commands on the control plane, affecting the availability of the system.
By determining the transmission network cards corresponding to the service plane and control plane data streams based on the server's network card information, and calling the hierarchical control component to adjust the priority of the control plane data streams, different data stream queues are established to ensure that the control plane data streams are transmitted in the high-priority queues.
This ensures that control plane commands are prioritized for sending and receiving when the database is under excessive pressure, thus guaranteeing the high availability of the distributed database system.
Smart Images

Figure CN119561908B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of distributed database technology, and in particular to data hierarchical transmission methods, apparatus, devices, storage media and products. Background Technology
[0002] In the database domain, the business plane and the control plane are two core concepts of a database management system. The business plane handles actual data transmission and storage, as well as executing data operation requests initiated by users and applications. The control plane, on the other hand, manages and coordinates database operations; it handles database control information and maintains the overall structure and state of the database. In distributed databases, the business plane can be distributed across multiple nodes, while the control plane is responsible for global database control and coordination. In real-world scenarios, under excessive database pressure, the following situation may occur: business plane messages consume all network resources, preventing the control plane from sending and receiving control commands normally, thus affecting system availability.
[0003] The above content is only used to help understand the technical solution of this application and does not represent an admission that the above content is prior art. Summary of the Invention
[0004] The main purpose of this application is to provide a data hierarchical transmission method, apparatus, device, storage medium and product, which aims to solve the technical problem in the prior art that the normal sending and receiving of control commands on the control plane cannot be guaranteed when the database pressure is too high, thus affecting the availability of the system.
[0005] To achieve the above objectives, this application proposes a data hierarchical transmission method, the method comprising:
[0006] Determine the transmission network card corresponding to the service plane data stream and the transmission network card corresponding to the control plane data stream based on the server's network card information.
[0007] The hierarchical control component is invoked, and the priority of the control plane data stream is adjusted through the hierarchical control component to obtain the priority of the control plane data stream;
[0008] The first data stream queue corresponding to the control plane data stream and the second data stream queue corresponding to the service plane data stream are determined according to the priority of the control plane data stream.
[0009] The first data stream queue is transmitted through the transmission network card corresponding to the control plane data stream, and the second data stream queue is transmitted through the transmission network card corresponding to the service plane data stream.
[0010] In one embodiment, the step of determining the transmission network interface card (NIC) corresponding to the service plane data stream and the transmission NIC corresponding to the control plane data stream based on the server's NIC information includes:
[0011] Invoke the hierarchical identification component to obtain the server configuration information of the server;
[0012] The server configuration information is parsed to determine the server's network interface card (NIC) information;
[0013] The number of network cards supported by the server is determined based on the network card information;
[0014] When the number of network interface cards (NICs) supported by the server is not a preset number, the transmission NICs corresponding to the service plane data stream and the transmission NICs corresponding to the control plane data stream are determined based on the address information of multiple supported NICs.
[0015] In one embodiment, the step of determining the transport network interface card (NIC) corresponding to the service plane data stream and the transport NIC corresponding to the control plane data stream based on the address information of multiple supported NICs includes:
[0016] Invoke the hierarchical control component;
[0017] Based on the address information of the hierarchical control component, multiple supported network cards, and service plane configuration information, the control plane configuration information is modified to obtain the modified control plane configuration information;
[0018] The transmission network card corresponding to the control plane data stream is determined based on the modified control plane configuration information.
[0019] The network interface card (NIC) corresponding to the service plane data stream is determined based on the service plane configuration information.
[0020] In one embodiment, before the step of modifying the control plane configuration information based on the address information of the hierarchical control component, multiple supporting network interface cards, and service plane configuration information to obtain the modified control plane configuration information, the method further includes:
[0021] The hierarchical identification component is invoked to obtain the instance configuration information of each database instance and the component configuration information of the high availability component.
[0022] The business plane configuration information is determined based on the instance configuration information of each database instance;
[0023] The control plane configuration information is determined based on the component configuration information of the high availability component.
[0024] In one embodiment, after the step of determining the number of network cards supported by the server based on the network card information, the method further includes:
[0025] When the number of network interface cards (NICs) supported by the server is a preset number, it is determined that the transmission NICs corresponding to the service plane data flow and the transmission NICs corresponding to the control plane data flow are both the target transmission NICs corresponding to the server.
[0026] In one embodiment, the step of invoking a hierarchical control component to adjust the priority of the control plane data stream to obtain the priority of the control plane data stream includes:
[0027] Invoke the hierarchical control component so that the first high availability component and the second high availability component modify the difference service code field according to the hierarchical control component;
[0028] The priority of the control plane data stream is determined based on the difference service code field.
[0029] In addition, to achieve the above objectives, this application also proposes a data hierarchical transmission device, which includes: a processing module, used to determine the transmission network card corresponding to the service plane data stream and the transmission network card corresponding to the control plane data stream based on the network card information of the server;
[0030] The calling module is used to call the hierarchical control component, and adjust the priority of the control plane data stream through the hierarchical control component to obtain the priority of the control plane data stream;
[0031] The processing module is further configured to determine the first data stream queue corresponding to the control plane data stream and the second data stream queue corresponding to the service plane data stream based on the priority of the control plane data stream.
[0032] The transmission module is used to transmit the first data stream queue through the transmission network card corresponding to the control plane data stream, and to transmit the second data stream queue through the transmission network card corresponding to the service plane data stream.
[0033] In addition, to achieve the above objectives, this application also proposes a data hierarchical transmission device, the device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the data hierarchical transmission method as described above.
[0034] In addition, to achieve the above objectives, this application also proposes a storage medium, which is a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it implements the steps of the data hierarchical transmission method described above.
[0035] In addition, to achieve the above objectives, this application also provides a computer program product, which includes a computer program that, when executed by a processor, implements the steps of the data hierarchical transmission method described above.
[0036] This application provides a hierarchical data transmission method. The method involves determining the transmission network interface cards (NICs) corresponding to the service plane data stream and the control plane data stream based on the server's NIC information; invoking a hierarchical control component to adjust the priority of the control plane data stream; determining a first data stream queue corresponding to the control plane data stream and a second data stream queue corresponding to the service plane data stream based on the control plane data stream priority; transmitting the first data stream queue through the NIC corresponding to the control plane data stream and the second data stream queue through the NIC corresponding to the service plane data stream. This method hierarchically classifies network interaction data in a distributed database system, prioritizing the forwarding of higher-priority data to ensure that control plane commands can be sent and received preferentially when the database is under heavy load, thereby guaranteeing the high availability of the distributed database system. Attached Figure Description
[0037] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.
[0038] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0039] Figure 1 This is a flowchart illustrating an embodiment of the data hierarchical transmission method of this application.
[0040] Figure 2 This is a schematic diagram of the system data flow provided in Embodiment 1 of this application;
[0041] Figure 3 This is a schematic diagram of the control plane data flow provided in Embodiment 1 of this application;
[0042] Figure 4 This is a schematic diagram of the business plane data flow provided in Embodiment 1 of this application;
[0043] Figure 5 This is a flowchart illustrating Embodiment 2 of the data hierarchical transmission method of this application;
[0044] Figure 6 This is a schematic diagram of a single network card scenario provided in Embodiment 2 of this application;
[0045] Figure 7 This is a schematic diagram of a multi-NIC scenario provided in Embodiment 2 of this application;
[0046] Figure 8 This is a schematic diagram of the module structure of the data hierarchical transmission device according to an embodiment of this application;
[0047] Figure 9 This is a schematic diagram of the device structure of the hardware operating environment involved in the data hierarchical transmission method in the embodiments of this application.
[0048] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation
[0049] It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit this application.
[0050] To better understand the technical solution of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific implementation methods.
[0051] The main solution of this application embodiment is as follows: First, determine the transmission network interface card (NIC) corresponding to the service plane data stream and the transmission NIC corresponding to the control plane data stream based on the server's NIC information. Second, invoke a hierarchical control component to adjust the priority of the control plane data stream, thereby obtaining the priority of the control plane data stream. Third, determine a first data stream queue corresponding to the control plane data stream and a second data stream queue corresponding to the service plane data stream based on the priority of the control plane data stream. Fourth, transmit the first data stream queue through the transmission NIC corresponding to the control plane data stream and transmit the second data stream queue through the transmission NIC corresponding to the service plane data stream.
[0052] Currently, there are technologies for Android applications that use the net_cls and net_prio subsystems in the Linux kernel's Control Groups to mark network packets for corresponding application services and set network transmission priorities for those applications. There are also technologies for container applications on existing high-performance computing systems (such as the Shenwei platform) that implement network hierarchy by modifying the Linux kernel. There are also technologies that use programmable switches to achieve adaptive priority adjustment and global parameter adaptive adjustment based on packet transmission latency. In the field of distributed databases, there is currently no network data hierarchy scheme. CGroups is a feature of the Linux kernel that allows users to organize processes into groups and allocate resources (such as CPU time, memory, network bandwidth, etc.) to these groups. CGroups is used to limit, isolate, manage, and account for the physical resources used by process groups. net_cls is a module in the CGroups subsystem used to classify traffic on network devices. net_prio is also a module in CGroups that allows users to set the priority of network traffic.
[0053] In the database domain, the business plane and the control plane are two core concepts of a database management system. The business plane handles actual data transmission and storage, as well as executing data operation requests initiated by users and applications. The control plane, on the other hand, manages and coordinates database operations; it handles database control information and maintains the overall structure and state of the database. In distributed databases, the business plane can be distributed across multiple nodes, while the control plane is responsible for global database control and coordination. In real-world scenarios, under excessive database pressure, the following situation may occur: business plane messages consume all network resources, preventing the control plane from sending and receiving control commands normally, thus affecting system availability.
[0054] This application implements a hierarchical classification of network interaction data in a distributed database system, prioritizing the forwarding of higher-priority data. This ensures that control plane commands can be sent and received preferentially when the database is under excessive pressure, thereby guaranteeing the high availability of the distributed database system.
[0055] It should be noted that the executing entity in this embodiment can be a computing service device with data processing, network communication, and program execution functions, such as a tablet computer, personal computer, or mobile phone, or an electronic device or data hierarchical transmission device capable of performing the above functions. The following description uses a data hierarchical transmission device as an example to illustrate this embodiment and the subsequent embodiments.
[0056] Based on this, embodiments of this application provide a hierarchical data transmission method, referring to... Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of the data hierarchical transmission method of this application.
[0057] In this embodiment, the data hierarchical transmission method includes steps S10 to S40:
[0058] Step S10: Determine the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow based on the server's network card information.
[0059] It should be noted that the data classification transmission device in this embodiment is equipped with a data classification transmission apparatus, which consists of a high-availability device, a data classification identification component, and a data classification control component. The `ha_ctl` component performs the functions of the data classification identification component and the data classification control component to control the priority of network data flows between `ha_ctl`, `ha_server`, and `ha_agent`. Figure 2 As shown, red represents control plane data and blue represents business plane data.
[0060] It is understood that the high availability device in this embodiment is a database cluster management module, which consists of three components: ha server (High Available Control Tool), ha_agent (High Available Agent), and ha_ctl (High Available Control Tool). ha server provides automatic failover services and a management service interface for ha_ctl; ha_ctl provides functions such as installation and deployment, scaling up / down, manual switching, and status monitoring; each database instance has one ha_agent, which provides status information to the high availability service ha server and executes commands from the ha server. Network interaction data between high availability components can be categorized as control plane data, and the data flow is as follows: Figure 3 As shown.
[0061] In practical implementation, in a distributed database, nodes mainly include a Coordinator Node (CN), Data Nodes (DN), and a Global Transaction Manager (GTM). The GTM is responsible for global transaction consistency. DN and GTM have multiple replicas, acting as primary and backup nodes to each other, requiring data synchronization. Data interaction between nodes pertains to business plane data, and the data flow is as follows: Figure 4 As shown.
[0062] It should be noted that the data classification identification component in the data classification transmission device is used to parse the configuration of the database cluster and obtain the configuration information of the database instance and high availability component. The database instance configuration information is classified as business plane configuration information, and the high availability component configuration information is classified as control plane configuration information. At the same time, the data classification identification component is also used to parse the configuration information of the database installation server and obtain the network card information.
[0063] Understandably, the data classification control component in the data classification transmission device receives service plane, control plane, and server network interface card (NIC) information output by the data classification transmission device. If the server supports multiple NICs and the user allows the use of multiple NICs, this component will modify the IP address of the control plane component, achieving IP separation between the control plane component and the service plane component, allowing the control plane and service plane to use different NICs to send and receive network interaction data. Simultaneously, the data classification control component configures higher priority for control plane data by setting the DSCP (Differentiated Services Code Point) field, causing it to enter the high-priority queue of the protocol stack kernel. In this embodiment, the DSCP field is located in the header of the IP packet and is used to identify the service level to which the packet belongs, so that network devices can distinguish and provide corresponding levels of service based on different DSCP values, such as priority and latency tolerance.
[0064] In the specific implementation, network interface card (NIC) information is obtained by calling the data hierarchical identification component, which parses the configuration information of the database installation server. When the number of NICs supported by the server is determined based on the NIC information, and the server supports multiple NICs, the hierarchical control component is called to modify the IP addresses of the high availability components ha_agent and ha_server, determining the NIC corresponding to the high availability component. Furthermore, based on the configuration information of the service plane component, the NIC corresponding to the service plane component is determined, thus enabling the high availability component and the service plane component to use different NICs for network interaction. In this embodiment, the transmission NIC corresponding to the control plane data stream refers to the NIC used by the high availability component for network interaction; the transmission NIC corresponding to the service plane data stream refers to the NIC used by the service plane component for network interaction.
[0065] It should be noted that when the server does not support multiple network cards, the network card corresponding to the service plane data flow and the network card corresponding to the control plane data flow will be the only network cards supported by the server.
[0066] Step S20: Invoke the hierarchical control component and adjust the priority of the control plane data stream through the hierarchical control component to obtain the priority of the control plane data stream.
[0067] It should be noted that by calling the hierarchical control component, a higher priority is configured for the control plane data stream, which causes the control plane data stream and the service plane data stream to enter different priority queues in the kernel protocol stack. The control plane data stream enters the high-priority queue, while the service plane data stream enters the relatively low-priority queue.
[0068] In one feasible implementation, step S20 may include steps A11 to A12:
[0069] Step A11: Invoke the hierarchical control component so that the first high availability component and the second high availability component modify the difference service code field according to the hierarchical control component.
[0070] Step A12: Determine the priority of the control plane data stream based on the difference service code field.
[0071] It should be noted that in this embodiment, the network communication between high-availability devices uses the gRPC framework, which can adjust the priority of network packets by setting the value of grpc.DSCP. In gRPC, DSCP can be set during client-server communication to assign specific network priorities to gRPC requests and responses. This allows network devices to provide different processing based on these priorities. This command will modify the grpc.DSCP values of the ha_server and ha_agent components. In this embodiment, the gRPC framework is a high-performance, open-source Remote Procedure Call (RPC) framework. It allows client applications to execute functions on remote servers as if they were local calls. The above process does not modify the priority of the business plane data flow, only the priority of the control plane data flow. By increasing the priority of the control plane data flow, commands on the control plane can be sent and received with priority.
[0072] It is understood that the first high-availability component is the ha_server component and the second high-availability component is the ha_agent component; the first high-availability component can also be the ha_agent component and the second high-availability component can be the ha_server component, and this embodiment does not limit this.
[0073] In this embodiment, by invoking the hierarchical control component, the value of DSCP in the socket option of the first and second high-availability components is modified, thereby determining the priority of the control plane data flow based on the DSCP value. For example, the hierarchical control component is: ha_ctl net-control DSCP 0x2e-lhttp: / / xxx:2379, which modifies the value of DSCP in the socket option of the first and second high-availability components to 0x2e.
[0074] Step S30: Determine the first data stream queue corresponding to the control plane data stream and the second data stream queue corresponding to the service plane data stream based on the priority of the control plane data stream.
[0075] It should be noted that, based on the priority of the control plane data flow, the network plane data flow is controlled to enter the first data flow queue with higher priority in the kernel protocol stack, while the service plane data flow is controlled to enter the second data flow queue with relatively lower priority in the kernel protocol stack.
[0076] Step S40: Transmit the first data stream queue through the transmission network card corresponding to the control plane data stream, and transmit the second data stream queue through the transmission network card corresponding to the service plane data stream.
[0077] It should be noted that the first data stream queue is transmitted through the transmission network card corresponding to the control plane data stream, and the second data stream queue is transmitted through the transmission network card corresponding to the service plane data stream.
[0078] This embodiment provides a hierarchical data transmission method. It determines the transmission network interface card (NIC) corresponding to the service plane data stream and the control plane data stream based on the server's NIC information; it then invokes a hierarchical control component to adjust the priority of the control plane data stream, thus obtaining the control plane data stream priority; based on the control plane data stream priority, it determines a first data stream queue corresponding to the control plane data stream and a second data stream queue corresponding to the service plane data stream; the first data stream queue is transmitted through the NIC corresponding to the control plane data stream, and the second data stream queue is transmitted through the NIC corresponding to the service plane data stream. Through this method, network interaction data in a distributed database system is hierarchically classified, with higher-priority data being forwarded first. This ensures that when the database pressure is too high, control plane commands can be sent and received preferentially, thereby guaranteeing the high availability of the distributed database system.
[0079] Based on the first embodiment of this application, in the second embodiment of this application, the content that is the same as or similar to that in Embodiment 1 above can be referred to the above description, and will not be repeated hereafter. Based on this, please refer to... Figure 5 Step S10, the data hierarchical transmission method further includes steps S11 to S14:
[0080] Step S11: Invoke the hierarchical identification component and obtain the server configuration information of the server through the hierarchical identification component.
[0081] Step S12: Parse the server configuration information to determine the server's network card information.
[0082] Step S13: Determine the number of network cards supported by the server based on the network card information.
[0083] It should be noted that the hierarchical identification component is invoked, which collects the server configuration information of the database installation server. This server configuration information is then parsed to extract network interface card (NIC) related information. In this embodiment, NIC information includes, but is not limited to, the NIC model, MAC address, IP address, subnet mask, and gateway. Based on the NIC information, all detected NICs are traversed, and the number of valid NICs is counted, excluding virtual NICs, unconfigured NICs, or other non-physical network interfaces, thereby obtaining the number of NICs supported by the server.
[0084] In one feasible implementation, after step S13, the method further includes: when the number of network cards supported by the server is a preset number, determining that the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow are both the target transmission network card corresponding to the server.
[0085] It should be noted that in this embodiment, the preset quantity is 1, and the target transmission network card refers to the only network card supported by the server. When the number of network cards supported by the server is the preset quantity, the target transmission network card is used as the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow. For example... Figure 6 As shown, at this time, the hierarchical control component configures a higher priority for the control plane data stream, so that the control plane network data stream and the service plane network data stream enter different priority queues in the kernel protocol stack. The control plane data enters the high-priority queue, while the service plane data enters the relatively low-priority queue.
[0086] Step S14: When the number of network cards supported by the server is not a preset number, determine the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow based on the address information of multiple supported network cards.
[0087] It should be noted that when the number of network interface cards (NICs) supported by the server is not the preset number, it indicates that the database server supports multiple NICs. In this case, based on the address information of multiple supported NICs, the hierarchical control component is invoked to modify the IP addresses of the high availability components ha_agent and ha_server, determining the NIC corresponding to the high availability component. Furthermore, based on the configuration information of the service plane component, the NIC corresponding to the service plane component is determined, thus enabling the high availability component and the service plane component to use different NICs for network interaction. In this embodiment, the address information of multiple supported NICs refers to the IP address information of each NIC.
[0088] In one feasible implementation, step S14 may include steps B11 to B14:
[0089] Step B11: Invoke the hierarchical control component.
[0090] Step B12: Modify the control plane configuration information based on the address information of the hierarchical control component, multiple supporting network cards, and service plane configuration information to obtain the modified control plane configuration information.
[0091] Step B13: Determine the transmission network card corresponding to the control plane data stream based on the modified control plane configuration information.
[0092] Step B14: Determine the transmission network card corresponding to the service plane data stream based on the service plane configuration information.
[0093] It should be noted that the hierarchical control component is invoked to modify the IP addresses of the first and second high-availability components. This ensures that the IP addresses and IP components of the first and second high-availability components are consistent with the address information of one of the supporting network interface cards (NICs), but are inconsistent with the IP addresses in the service plane configuration information. In this embodiment, the control plane configuration information includes, but is not limited to, the configuration information of the first and second high-availability components. After modifying the IP addresses and IP components of the first and second high-availability components, the modified control plane configuration information is obtained.
[0094] It is understandable that the IP address in the modified control plane configuration information can be used to determine the transmission network card corresponding to the control plane data flow, and the IP address in the service plane configuration information can be used to determine the transmission network card corresponding to the service plane data flow.
[0095] In specific implementations, such as Figure 7 As shown, when the server supports multiple network interface cards (NICs), the control plane component fIP is modified by the hierarchical control component in the data hierarchical transmission device, so that the control plane data stream and the service plane data stream use different NICs for network interaction. For example, calling the hierarchical control component: ha_ctl net-control IP-p <path to file>The command `-lhttp: / / xxx:2379` uniformly modifies the IP address of high-availability components.
[0096] In one feasible implementation, steps C11 to C13 may be included before step B12:
[0097] Step C11: Invoke the hierarchical identification component to obtain the instance configuration information of each database instance and the component configuration information of the high availability component.
[0098] Step C12: Determine the business plane configuration information based on the instance configuration information of each database instance.
[0099] Step C13: Determine the control plane configuration information based on the component configuration information of the high availability component.
[0100] It should be noted that calling the hierarchical recognition component (e.g., ha_ctl get net-config-p) <path to file>The `-l http: / / xxx:2379` directive retrieves component configuration information for each database instance, high-availability component, and server configuration information from the database cluster. It then divides the instance configuration information of each database instance into business plane configuration information and the component configuration information of the high-availability component into control plane configuration information. This configuration information is stored in a specific file format (e.g., YAML) on a specified path. In this embodiment, each database instance in the distributed database has a corresponding `ha_agent`, used to execute control commands sent to the database by the `ha_server`. The `ha_server` stores the configuration information for each database instance. The `host` and `port` fields store the database's network information, which is classified as the business plane. The `agent_host` and `agent_port` fields store the network information of the `ha_agent`, which is classified as the control plane.
[0101] This embodiment provides a hierarchical data transmission method. This embodiment calls a hierarchical identification component to obtain server configuration information; parses the server configuration information to determine the server's network interface card (NIC) information; determines the number of NICs supported by the server based on the NIC information; when the number of supported NICs is not a preset number, determines the transmission NICs corresponding to the service plane data stream and the control plane data stream based on the address information of multiple supported NICs. Through this method, in a multi-NIC scenario, service plane data streams and control plane data streams can interact via different NICs.
[0102] It should be noted that the above examples are only for understanding this application and do not constitute a limitation on the data hierarchical transmission method of this application. Any simple modifications based on this technical concept are within the protection scope of this application.
[0103] This application also provides a data hierarchical transmission device; please refer to... Figure 8 The data hierarchical transmission device includes:
[0104] The processing module 10 is used to determine the transmission network card corresponding to the service plane data flow and the transmission network card corresponding to the control plane data flow based on the network card information of the server.
[0105] Module 20 is invoked to invoke the hierarchical control component, which adjusts the priority of the control plane data stream to obtain the priority of the control plane data stream.
[0106] The processing module 10 is further configured to determine the first data stream queue corresponding to the control plane data stream and the second data stream queue corresponding to the service plane data stream based on the priority of the control plane data stream.
[0107] The transmission module 30 is used to transmit the first data stream queue through the transmission network card corresponding to the control plane data stream, and to transmit the second data stream queue through the transmission network card corresponding to the service plane data stream.
[0108] Optionally, the processing module 10 is further configured to:
[0109] The hierarchical identification component is invoked to obtain the server configuration information of the server; the server configuration information is parsed to determine the network interface card (NIC) information of the server; the number of NICs supported by the server is determined based on the NIC information; when the number of NICs supported by the server is not a preset number, the transmission NICs corresponding to the service plane data flow and the transmission NICs corresponding to the control plane data flow are determined based on the address information of multiple supported NICs.
[0110] Optionally, the processing module 10 is further configured to:
[0111] Invoke the hierarchical control component; modify the control plane configuration information based on the hierarchical control component, the address information of multiple supported network cards, and the service plane configuration information to obtain the modified control plane configuration information; determine the transmission network card corresponding to the control plane data stream based on the modified control plane configuration information; determine the transmission network card corresponding to the service plane data stream based on the service plane configuration information.
[0112] Optionally, the processing module 10 is further configured to:
[0113] The hierarchical identification component is invoked to obtain the instance configuration information of each database instance and the component configuration information of the high availability component; the business plane configuration information is determined based on the instance configuration information of each database instance; and the control plane configuration information is determined based on the component configuration information of the high availability component.
[0114] Optionally, the processing module 10 is further configured to:
[0115] When the number of network interface cards (NICs) supported by the server is a preset number, it is determined that the transmission NICs corresponding to the service plane data flow and the transmission NICs corresponding to the control plane data flow are both the target transmission NICs corresponding to the server.
[0116] Optionally, the processing module 20 is further configured to:
[0117] The hierarchical control component is invoked so that the first high-availability component and the second high-availability component modify the differential service code field according to the hierarchical control component; the priority of the control plane data stream is determined according to the differential service code field.
[0118] The data hierarchical transmission device provided in this application, employing the data hierarchical transmission method described in the above embodiments, can solve the technical problem in the prior art where the normal transmission and reception of control commands on the control plane cannot be guaranteed under excessive database pressure, thus affecting system availability. Compared with the prior art, the beneficial effects of the data hierarchical transmission device provided in this application are the same as those of the data hierarchical transmission method provided in the above embodiments, and other technical features in the data hierarchical transmission device are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.
[0119] This application provides a data hierarchical transmission device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the data hierarchical transmission method in the first embodiment described above.
[0120] The following is for reference. Figure 9 This document illustrates a structural diagram of a data hierarchical transmission device suitable for implementing embodiments of this application. The data hierarchical transmission device in the embodiments of this application may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptors), PMPs (Portable Media Players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 9 The data hierarchical transmission device shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this application.
[0121] like Figure 9 As shown, the data hierarchical transmission device may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 into a random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for the operation of the data hierarchical transmission device. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 1008 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1009. Communication device 1009 allows the data hierarchy transmission device to communicate wirelessly or wiredly with other devices to exchange data. Although the figure shows data hierarchy transmission devices with various systems, it should be understood that it is not required to implement or have all of the systems shown. More or fewer systems may be implemented alternatively.
[0122] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.
[0123] The data hierarchical transmission device provided in this application, employing the data hierarchical transmission method described in the above embodiments, can solve the technical problem in the prior art where, under excessive database pressure, the normal transmission and reception of control commands on the control plane cannot be guaranteed, thus affecting system availability. Compared with the prior art, the beneficial effects of the data hierarchical transmission device provided in this application are the same as those of the data hierarchical transmission method provided in the above embodiments, and other technical features of this data hierarchical transmission device are the same as those disclosed in the previous embodiment method, and will not be repeated here.
[0124] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.
[0125] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
[0126] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the data hierarchical transmission method described in the above embodiments.
[0127] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.
[0128] The aforementioned computer-readable storage medium may be included in a data classification transmission device; or it may exist independently and not be assembled into a data classification transmission device.
[0129] The aforementioned computer-readable storage medium carries one or more programs. When these programs are executed by the data hierarchical transmission device, the data hierarchical transmission device: determines the transmission network interface card (NIC) corresponding to the service plane data stream and the transmission NIC corresponding to the control plane data stream based on the server's NIC information; invokes a hierarchical control component to adjust the priority of the control plane data stream, thereby obtaining the priority of the control plane data stream; determines a first data stream queue corresponding to the control plane data stream and a second data stream queue corresponding to the service plane data stream based on the priority of the control plane data stream; transmits the first data stream queue through the transmission NIC corresponding to the control plane data stream, and transmits the second data stream queue through the transmission NIC corresponding to the service plane data stream.
[0130] Computer program code for performing the operations of this application can be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, and C++, as well as conventional procedural programming languages such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0131] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.
[0132] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.
[0133] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the above-described hierarchical data transmission method. This solves the technical problem in the prior art where, under excessive database pressure, the normal transmission and reception of control commands on the control plane cannot be guaranteed, affecting system availability. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as those of the hierarchical data transmission method provided in the above embodiments, and will not be elaborated upon here.
[0134] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the data hierarchical transmission method described above.
[0135] The computer program product provided in this application can solve the technical problem in the prior art where the normal sending and receiving of control commands on the control plane cannot be guaranteed when the database pressure is too high, thus affecting the availability of the system. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as those of the data hierarchical transmission method provided in the above embodiments, and will not be repeated here.
[0136] The above description is only a part of the embodiments of this application and does not limit the patent scope of this application. All equivalent structural transformations made under the technical concept of this application and using the contents of the specification and drawings of this application, or direct / indirect applications in other related technical fields, are included in the patent protection scope of this application.< / path> < / path>
Claims
1. A data hierarchical transmission method, characterized in that, The data hierarchical transmission method includes: Determine the transmission network card corresponding to the service plane data stream and the transmission network card corresponding to the control plane data stream based on the server's network card information. The hierarchical control component is invoked, and the priority of the control plane data stream is adjusted through the hierarchical control component to obtain the priority of the control plane data stream; The first data stream queue corresponding to the control plane data stream and the second data stream queue corresponding to the service plane data stream are determined according to the priority of the control plane data stream. The first data stream queue is transmitted through the transmission network card corresponding to the control plane data stream, and the second data stream queue is transmitted through the transmission network card corresponding to the service plane data stream. The steps of determining the transmission network interface card (NIC) corresponding to the service plane data stream and the control plane data stream based on the server's NIC information include: Invoke the hierarchical identification component to obtain the server configuration information of the server; The server configuration information is parsed to determine the server's network interface card (NIC) information; The number of network cards supported by the server is determined based on the network card information; When the number of network cards supported by the server is not the preset number, the hierarchical control component is invoked. Based on the address information of the hierarchical control component, multiple supported network cards, and service plane configuration information, the control plane configuration information is modified to obtain the modified control plane configuration information; The transmission network card corresponding to the control plane data stream is determined based on the modified control plane configuration information. The network interface card (NIC) corresponding to the service plane data stream is determined based on the service plane configuration information.
2. The method as described in claim 1, characterized in that, Before the step of modifying the control plane configuration information based on the address information of the hierarchical control component, multiple supporting network cards, and service plane configuration information to obtain the modified control plane configuration information, the method further includes: The hierarchical identification component is invoked to obtain the instance configuration information of each database instance and the component configuration information of the high availability component. The business plane configuration information is determined based on the instance configuration information of each database instance; The control plane configuration information is determined based on the component configuration information of the high availability component.
3. The method as described in claim 1, characterized in that, After the step of determining the number of network cards supported by the server based on the network card information, the method further includes: When the number of network interface cards (NICs) supported by the server is a preset number, it is determined that the transmission NICs corresponding to the service plane data flow and the transmission NICs corresponding to the control plane data flow are both the target transmission NICs corresponding to the server.
4. The method according to any one of claims 1 to 3, characterized in that, The step of invoking the hierarchical control component and adjusting the priority of the control plane data stream to obtain the priority of the control plane data stream includes: Invoke the hierarchical control component so that the first high availability component and the second high availability component modify the difference service code field according to the hierarchical control component; The priority of the control plane data stream is determined based on the difference service code field.
5. A data hierarchical transmission device, characterized in that, The data hierarchical transmission device includes: The processing module is used to determine the transmission network card corresponding to the service plane data stream and the transmission network card corresponding to the control plane data stream based on the server's network card information. The calling module is used to call the hierarchical control component, and adjust the priority of the control plane data stream through the hierarchical control component to obtain the priority of the control plane data stream; The processing module is further configured to determine the first data stream queue corresponding to the control plane data stream and the second data stream queue corresponding to the service plane data stream based on the priority of the control plane data stream. The transmission module is used to transmit the first data stream queue through the transmission network card corresponding to the control plane data stream, and to transmit the second data stream queue through the transmission network card corresponding to the service plane data stream. The processing module is also used to call the hierarchical identification component to obtain the server configuration information of the server through the hierarchical identification component; The server configuration information is parsed to determine the server's network interface card (NIC) information; The number of network cards supported by the server is determined based on the network card information; When the number of network cards supported by the server is not the preset number, the hierarchical control component is invoked. Based on the address information of the hierarchical control component, multiple supported network cards, and service plane configuration information, the control plane configuration information is modified to obtain the modified control plane configuration information; The transmission network card corresponding to the control plane data stream is determined based on the modified control plane configuration information. The network interface card (NIC) corresponding to the service plane data stream is determined based on the service plane configuration information.
6. A data hierarchical transmission device, characterized in that, The device includes: a memory, a processor, and a data hierarchical transfer program stored in the memory and executable on the processor, the data hierarchical transfer program being configured to implement the steps of the data hierarchical transfer method as described in any one of claims 1 to 4.
7. A storage medium, characterized in that, The storage medium stores a data hierarchical transmission program, which, when executed by a processor, implements the steps of the data hierarchical transmission method as described in any one of claims 1 to 4.
8. A computer program product, characterized in that, The computer program product includes a data hierarchical transmission program, which, when executed by a processor, implements the steps of the data hierarchical transmission method as described in any one of claims 1 to 4.
Citation Information
Patent Citations
Control surface and business surface separating method and system, server and cloud calculating platform
CN106571945A
Data packet transmitting method and system, data packet receiving method and system, equipment and medium
CN111490947A
Flexible message forwarding control method and system of cloud platform virtual server
CN118945120A
Method for raising performance of data transmission according to transmission control protocol in mobile communication network
CN1728680A
TCP control packet differential service
US20020064128A1