Data transmission method, device, system, storage medium and program product

Abstract

The present application provides a data transmission method, device, system, storage medium and program product, which relate to the field of data processing. The method includes: the business system can obtain a pending request sent externally. The business system can randomly distribute the pending request to an available distribution node. The business system can use the preset classification rule to classify the pending request to obtain a multi-level classification. After determining the multi-level classification, the business system can determine the corresponding business node and routing channel according to the classification results of each level in the multi-level classification. The business system can distribute the pending request step by step according to the multi-level routing channel so that the pending request reaches the final business node. The method of the present application improves the transmission efficiency of data within the business system.

Description

Technical Field

[0001] The present application relates to the field of data processing, and in particular to a data transmission method, device, system, storage medium and program product. Background Art

[0002] With the development of technology, more and more businesses are shifting from offline to online. In order to meet business processing needs, enterprises can distribute the core business systems to improve business processing efficiency and business concurrency.

[0003] A distributed business system usually includes an entry node. The entry node can be used to uniformly obtain external business requests. The entry node can generate a target route based on key information in the business request. The entry node can send the business request to the corresponding business node based on the target route. The business node can process the business request.

[0004] However, the routing configuration and distribution method of the entry node in the prior art are relatively simple, and there is a problem of low data transmission efficiency. Summary of the invention

[0005] The present application provides a data transmission method, device, system, storage medium and program product to solve the problem of low data transmission efficiency.

[0006] In a first aspect, the present application provides a data transmission method, comprising:

[0007] Get pending requests;

[0008] Randomly distribute the pending requests to available distribution nodes;

[0009] Determine the multi-level classification of the pending request according to the preset classification rules;

[0010] Determine, according to the multi-level classification, a multi-level routing channel for sending the request to be processed;

[0011] The pending request is sent using the multi-stage routing channel.

[0012] Optionally, the multi-level classification includes a first business category and a second business category, wherein the second business category is a subcategory of the first business category;

[0013] Accordingly, determining the multi-level classification of the requests to be processed according to the requests to be processed specifically includes:

[0014] Determining a first business category of the request to be processed according to request path information in the request to be processed;

[0015] A second business category of the request to be processed is determined according to the first business category and the multi-dimensional request information in the request to be processed.

[0016] Optionally, the multi-dimensional request information in the request to be processed includes at least one of node information, customer information, and instruction encoding information.

[0017] Optionally, each of the first service categories corresponds to at least one first service node, and each of the second service categories corresponds to at least one second service node; the multi-level routing channel includes a first routing channel corresponding to the first service node, and a second routing channel corresponding to the second service node;

[0018] Accordingly, determining the multi-level routing channel for sending the request to be processed according to the multi-level classification specifically includes:

[0019] According to the load balancing strategy, select a first service node from at least one first service node corresponding to the first service category to generate a first routing channel;

[0020] According to the load balancing strategy, a second service node is selected from at least one second service node corresponding to the second service category to generate a second routing channel.

[0021] Optionally, the method further includes:

[0022] The number of the first service nodes and / or the second service nodes is expanded or reduced according to the concurrent volume of the requests to be processed.

[0023] Optionally, the method further includes:

[0024] The number of the distribution nodes is expanded or reduced according to the concurrent volume of the requests to be processed.

[0025] In a second aspect, the present application provides a data transmission device, including:

[0026] The acquisition module is used to obtain pending requests;

[0027] A distribution module is used to randomly distribute the pending requests to available distribution nodes; determine the multi-level classification of the pending requests according to preset classification rules; determine the multi-level routing channel for sending the pending requests according to the multi-level classification; and send the pending requests using the multi-level routing channel.

[0028] Optionally, the multi-level classification includes a first business category and a second business category, wherein the second business category is a subcategory of the first business category;

[0029] Accordingly, the distribution module is specifically used to:

[0030] Determining a first business category of the request to be processed according to request path information in the request to be processed;

[0031] A second business category of the request to be processed is determined according to the first business category and the multi-dimensional request information in the request to be processed.

[0032] Optionally, the multi-dimensional request information in the request to be processed includes at least one of node information, customer information, and instruction encoding information.

[0033] Optionally, each of the first service categories corresponds to at least one first service node, and each of the second service categories corresponds to at least one second service node; the multi-level routing channel includes a first routing channel corresponding to the first service node, and a second routing channel corresponding to the second service node;

[0034] Accordingly, the distribution module is specifically used to:

[0035] According to the load balancing strategy, select a first service node from at least one first service node corresponding to the first service category to generate a first routing channel;

[0036] According to the load balancing strategy, a second service node is selected from at least one second service node corresponding to the second service category to generate a second routing channel.

[0037] Optionally, the distribution module is further configured to:

[0038] The number of the first service nodes and / or the second service nodes is expanded or reduced according to the concurrent volume of the requests to be processed.

[0039] Optionally, the distribution module is further configured to:

[0040] The number of the distribution nodes is expanded or reduced according to the concurrent volume of the requests to be processed.

[0041] In a third aspect, the present application provides a system, including: a memory and a processor;

[0042] The memory is used to store computer programs; the processor is used to execute the method in the first aspect and any possible design of the first aspect according to the computer program stored in the memory.

[0043] In a fourth aspect, the present application provides a computer-readable storage medium, in which a computer program is stored. When at least one processor of the system executes the computer program, the system executes the method in the first aspect and any possible design of the first aspect.

[0044] In a fifth aspect, the present application provides a computer program product, comprising a computer program. When at least one processor of the system executes the computer program, the system executes the method in the first aspect and any possible design of the first aspect.

[0045] The data transmission method, device, system, storage medium and program product provided by the present application obtain a pending request sent from an external source; randomly distribute the pending request to an available distribution node; use the preset classification rule to classify the pending request to obtain a multi-level classification; after determining the multi-level classification, determine the corresponding business node and routing channel according to the classification result of each level in the multi-level classification; according to the multi-level routing channel, distribute the pending request step by step so that the pending request reaches the final business node, thereby improving the scalability of the business system, improving the stability of the business system, and improving the transmission efficiency and processing efficiency of data in the business system. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the technical solutions in the present application or the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0047] Figure 1 A schematic diagram of a scenario of a business system provided in one embodiment of the present application;

[0048] Figure 2 A flowchart of a data transmission method provided in one embodiment of the present application;

[0049] Figure 3 A flowchart of a data transmission method provided in one embodiment of the present application;

[0050] Figure 4 A schematic diagram of the module structure of a business system provided in one embodiment of the present application;

[0051] Figure 5 A schematic diagram of the structure of a data transmission device provided in one embodiment of the present application;

[0052] Figure 6 A schematic diagram of the hardware structure of a system provided in one embodiment of the present application. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions in this application will be clearly and completely described below in conjunction with the drawings in this application. Obviously, the described embodiments are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0054] The terms "first", "second", "third", "fourth", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0055] With the development of technology, more and more businesses are shifting from offline to online. In order to solve the problem of access limitations of the monolithic architecture and meet business processing needs, enterprises can distribute the core business systems to improve business processing efficiency and business concurrency. The distributed business system usually includes an entry node. The entry node can be used to uniformly obtain external business requests. The entry node can generate a target route based on the key information in the business request. The entry node can send the business request to the corresponding business node based on the target route. The business node can process the business request.

[0056] However, this method has the problem of single routing configuration and distribution mode. Among them, the method of determining the target route is relatively simple and cannot solve the diverse routing request requirements. In addition, with the continuous expansion of business, business requests will continue to increase. The existing technology has the problem of poor flexibility in rule configuration and routing path configuration.

[0057] In response to the above problems, the present application proposes a data transmission method for more complex multi-level routing scenarios. The data transmission method implements a flexibly configurable routing distribution mechanism. With the diversification and complexity of business development, the present application can realize the flexible deployment and horizontal expansion of distributed nodes. At the same time, the present application can also realize the automatic distribution of access requests according to the configuration policy. In addition, the present application can also ensure load balancing based on the flexible expansion of business nodes, thereby improving the stability of the business system. In addition, based on the flexible expansion of business nodes, the present application can also reduce the impact of internal node failures in the system on the business. When a node fails, other redundant nodes are used in time to replace the failed node, thereby further ensuring the stability of the business system.

[0058] The following is an introduction to exemplary application scenarios of the embodiments of the present application.

[0059] Figure 1 A schematic diagram of a scenario of a business system provided by an embodiment of the present application is shown. As shown in the figure, each server may correspond to a node in the business system. The arrows between the nodes may be routing relationships between multiple servers in the business system.

[0060] The first layer may be an entry node of the business system. The entry node is used to obtain pending requests sent from the outside. Optionally, the pending requests may be transaction requests, query requests, etc.

[0061] Among them, the second layer may include multiple distribution nodes. The distribution node is used to determine the first business category corresponding to the pending request based on the pending request. The setting of the distribution node is used to increase the concurrency of the business system. When the distribution node is set in the business system, the entry node can randomly forward the pending request to a distribution node when receiving the pending request, and the distribution node sends the pending request to the corresponding business node. Otherwise, if the business system does not include the distribution node of the second layer, the entry node needs to directly implement the forwarding of the pending request to the business node. As the number of requests received by the business system increases, the direct allocation of these pending requests to business nodes by the entry node may result in the inability to allocate the pending requests in time, thereby causing the problem of low response efficiency of the business system.

[0062] Among them, the third layer may include multiple first business nodes. Optionally, each first business node may correspond to a major business category. For example, the business system may include multiple major business categories such as transaction services, query services, parameter configuration services, etc. Optionally, each major business category may correspond to at least one first business node. For example, a transaction service may correspond to 1 first business node. As transaction services increase, the number of first business nodes corresponding to the transaction service may be increased to multiple to meet business needs. Optionally, when a new major business category is added to the business system, a new first business node may be added accordingly. For example, when the business system adds a customer service service, a new first business node may be added for the customer service service. Optionally, the business system may directly process the pending request through the first business node of the third layer.

[0063] Among them, the fourth layer may include multiple second service nodes. Optionally, as the number of pending requests increases, in order to further improve the service processing efficiency, the service may be divided more finely. That is, each major category may be divided into multiple subcategories. At least one second service node may be set for each subcategory in the service system. The reduction of the service scope may reduce the number of codes in the second service node, and improve the processing efficiency of the second service node by increasing the specificity of the second service node. When the second service node exists, the first service node may be a forwarding node. The second service node is the processing node of the pending service. Similar to the first service node, when the pending service of a subclass increases, the number of second service nodes of the subclass may be increased accordingly. When a subclass is added, the second service node of the subclass may be increased accordingly.

[0064] Optionally, in the service system, the distribution node and the first service node are used to forward the request to be processed, and may be forwarding devices such as routers.

[0065] The technical solution of the present application is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0066] Figure 2 A flow chart of a data transmission method provided by an embodiment of the present application is shown. Figure 1 Based on the embodiment shown, Figure 2 As shown, with the business system as the execution subject, the method of this embodiment may include the following steps:

[0067] S101. Obtain pending requests.

[0068] In this embodiment, the business system can obtain a pending request sent from the outside. Optionally, the pending request can be a business request, a query request, a parameter setting request, etc. Optionally, the pending request can be a request generated by a user when using a function of the business system. Alternatively, the pending request can also be a request generated by a business person when using a function of the business system.

[0069] S102: Randomly distribute the pending requests to available distribution nodes.

[0070] In this embodiment, when the business system receives the pending request, it can randomly distribute the pending request to an available distribution node.

[0071] Optionally, the number of the distribution nodes may be determined according to the maximum concurrency and throughput of the business system within a preset time period.

[0072] Optionally, the business system may set an adjustment cycle according to the preset duration. And dynamically adjust the number of the distribution nodes according to the maximum concurrency and throughput in each cycle, thereby improving the utilization of the distribution nodes and ensuring the operating efficiency of the business system. The specific process may include:

[0073] Step 1: The business system can periodically count the maximum concurrency and throughput of the business system within the period.

[0074] Step 2: The business system may determine the target number of distribution nodes required based on the maximum concurrency and throughput.

[0075] Step 3: When the target number of distribution nodes is greater than the actual number of distribution nodes currently existing in the business system, multiple nodes can be obtained from idle nodes in the business system as distribution nodes to make the number of distribution nodes reach the target number.

[0076] Step 4: When the target number of distribution nodes is less than the actual number of distribution nodes currently existing in the business system, the business system may release multiple nodes from the currently existing distribution nodes so that the number of distribution nodes reaches the target number.

[0077] S103: Determine the multi-level classification of the requests to be processed according to preset classification rules.

[0078] In this embodiment, the business system can set the same preset classification rule in each distribution node, and the preset classification rule can be used to achieve the effect of classifying the pending request according to the information in the pending request. The business system can use the preset classification rule to classify the pending request to obtain a multi-level classification.

[0079] Optionally, the preset classification rule can be used to classify the pending request into a certain business category. Optionally, the business category can be a transaction category, an inquiry category, a setting category, etc.

[0080] Optionally, the preset classification rule may further classify the pending request based on the business category to obtain a subcategory corresponding to the pending request. For example, when the business category is a transaction category, the subcategory may include category A commodity transactions, category B commodity transactions, etc. Alternatively, the subcategory may include transactions of category A users, transactions of category B users, etc.

[0081] Optionally, the preset classification rule can also classify the pending request in more detail based on the subclass according to actual needs.

[0082] In one example, when the multi-level classification is a two-level classification, the two-level categories can be named as a first business category and a second business category, respectively, wherein the second business category is a subcategory of the first business category.

[0083] In one example, the specific process of implementing the two-level classification in the business system may include the following steps:

[0084] Step 1: Determine the first business category of the request to be processed according to the request path information in the request to be processed.

[0085] In this step, the distribution node can obtain the request path information from the pending request. The distribution node can be preset with a first comparison table of the request path and the first service category. The server can determine the first service category corresponding to the pending request based on the comparison table.

[0086] Optionally, when the first service category or the request path needs to be updated, the service system may ensure the validity of the classification result by updating the first comparison table in each distribution node.

[0087] Optionally, the business system may periodically send the first comparison table to each distribution node to ensure the timeliness of the first comparison table. Alternatively, the business system may synchronize the first comparison table to each distribution node when the first comparison table is updated.

[0088] Optionally, after determining the first service category, the distribution node may determine a first service node corresponding to the first service category. The distribution node may determine a routing path according to the first service node. The distribution node may send the pending request to the first service node according to the routing path.

[0089] Step 2: Determine a second business category of the request to be processed based on the first business category and the multi-dimensional request information in the request to be processed.

[0090] In this step, the first service node may store a second comparison table of the second service category and the multi-dimensional request information in the pending request. When obtaining the pending request, the first service node may determine the second service category corresponding to the pending request according to the second comparison table.

[0091] Optionally, screening the second service category in the first service node can avoid the need to store the second comparison table of each first service category in the distribution node, thereby reducing unnecessary memory usage in the distribution node and improving the processing efficiency of the distribution node.

[0092] Optionally, the service system may periodically send the corresponding second comparison table to each first service node to ensure the timeliness of the second comparison table. Alternatively, the service system may synchronize with each first service node corresponding to a first service category when the second comparison table of the first service category is updated.

[0093] Optionally, the multi-dimensional request information in the request to be processed includes at least one of node information, customer information, and instruction encoding information.

[0094] Optionally, after determining the second service category, the first service node may determine a corresponding second service node. The first service node may determine a routing path according to the second service node. The first service node may send the pending request to the second service node according to the routing path.

[0095] S104. Determine a multi-level routing channel for sending the request to be processed according to the multi-level classification.

[0096] In this embodiment, after determining the multi-level classification, the business system can determine the corresponding business node and routing channel according to the classification results of each level in the multi-level classification. The business system can determine the business node that the pending request needs to reach in the end according to the multi-level routing channel corresponding to the multi-level classification.

[0097] In one example, each first service category corresponds to at least one first service node, and each second service category corresponds to at least one second service node. The multi-level routing channel includes a first routing channel corresponding to the first service node, and a second routing channel corresponding to the second service node.

[0098] In one example, the specific process of the business system determining the multi-level routing channel may include:

[0099] Step 1: According to a load balancing strategy, a first service node is selected from at least one first service node corresponding to a first service category, and a first routing channel is generated.

[0100] In this step, after the distribution node determines the first service category, the distribution node may determine at least one first service node corresponding to the first service category. The distribution node may select a first service node from the at least one first service node according to a load balancing strategy. The distribution node may determine a first routing channel in the multi-level routing channel according to the route of the selected first service node.

[0101] Optionally, the distribution node may send the pending request to the first service node according to the first routing channel.

[0102] Step 2: According to the load balancing strategy, select a second service node from at least one second service node corresponding to the second service category, and generate a second routing channel.

[0103] In this step, after the first service node determines the second service category, the first service node may determine at least one second service node corresponding to the second service category. The first service node may select a second service node from the at least one second service node according to a load balancing strategy. The first service node may determine a second routing channel in the multi-level routing channel according to the route of the selected second service node.

[0104] Optionally, the first service node may send the pending request to the second service node according to the second routing channel.

[0105] In an example, the number of the first service nodes may be determined according to the maximum concurrency and throughput of pending requests of the first service category received by the service system within a preset time period.

[0106] Optionally, the business system can set an adjustment cycle according to the preset duration. And dynamically adjust the number of the first business nodes according to the maximum concurrent volume and throughput of pending requests of the first business category in each cycle, thereby improving the utilization rate of the first business node and ensuring the operating efficiency of the business system. The specific process is similar to the dynamic adjustment strategy of the distribution node, and will not be repeated here.

[0107] In an example, the number of the second service nodes may be determined according to the maximum concurrency and throughput of pending requests of the second service category received by the service system within a preset time period.

[0108] Optionally, the business system can set an adjustment cycle according to the preset duration. And dynamically adjust the number of the second business nodes according to the maximum concurrent volume and throughput of the pending requests of the second business category in each cycle, so as to improve the utilization rate of the second business node and ensure the operation efficiency of the business system. The specific process is similar to the dynamic adjustment strategy of the distribution node, and will not be repeated here.

[0109] S105. Use a multi-level routing channel to send pending requests.

[0110] In this embodiment, the business system can distribute the pending request level by level according to the multi-level routing channel, so that the pending request reaches the final business node.

[0111] The data transmission method provided in the present application can enable the business system to obtain the pending request sent from the outside. The business system can randomly distribute the pending request to an available distribution node. The business system can use the preset classification rule to classify the pending request to obtain a multi-level classification. After determining the multi-level classification, the business system can determine the corresponding business node and routing channel according to the classification results of each level in the multi-level classification. The business system can distribute the pending request step by step according to the multi-level routing channel so that the pending request reaches the final business node. In the present application, the scalability of the business system is improved, the stability of the business system is improved, and the transmission efficiency and processing efficiency of data in the business system are improved through the setting of multi-level routing.

[0112] Based on the above embodiment, in one implementation, Figure 3 As shown, the route distribution mechanism may include the following steps:

[0113] S201. Obtain pending requests.

[0114] S202: Configure multiple distribution nodes to distribute pending requests to different distribution nodes to achieve load balancing.

[0115] In this step, users send transaction or query requests through a unified portal. In order to improve the concurrent processing capability of the business system and solve the problem of the system processing a large number of requests in a unified time period, the first random distribution will be performed. Business requests can send pending requests to available distribution nodes. Distribution nodes can be horizontally expanded according to traffic demand.

[0116] S203: Determine the first service category of the request to be processed according to key information in the request to be processed, and determine the first service node for distribution.

[0117] In this step, after receiving the pending request, the distribution node determines the first service category according to the path information in the pending request. The first service category can be transaction pre-positioning, customer query service, parameter setting, etc. The division of the first service category realizes a preliminary classification of the pending request.

[0118] S204: Based on the first service node, further subdivide the request to be processed.

[0119] In this step, after determining the classification of the first business category of the business system, the business system can further divide some of the first business categories into subcategories based on multi-dimensional information such as node information, customer information, and instruction encoding information. This subcategorization achieves the process of segmenting its routes and ultimately determining the channel for sending. The setting of this subcategory simplifies the functions of the core business module and focuses on the effect of business logic processing.

[0120] Based on the above embodiments, Figure 4 As shown, the business system can be divided into multiple modules. Specifically, the business system can include a business request module, a rule configuration management and channel management module, a rule processing module, a security verification fault processing module, and a routing distribution module.

[0121] Optionally, based on the above embodiment, the hierarchical routing structure can also analyze the characteristics of the requests to be processed through a multi-level routing structure and divide the requests to be processed into layers. Each layer is responsible for a specific type or level of data transmission, such as a transaction data layer, a customer information layer, etc. Through preliminary stratification, the routing efficiency is improved, and it is convenient to further subdivide the rules of different layers.

[0122] The business system can dynamically adjust the routing strategy at each level based on factors such as data characteristics and transaction requirements to achieve the optimal data transmission path.

[0123] Optionally, after receiving the pending request, the business system can also determine whether the information in the pending request is empty. If it is empty, the business system can distribute it according to the configured default route to ensure system reliability and improve user experience. Otherwise, if the information in the pending request is complete, the business system can match and analyze the information in the pending request and the configuration rules to decide the final routing channel.

[0124] On the basis of the above embodiment, the business system can also introduce a security mechanism at each node. The security mechanism may include encryption, authentication, access control, etc. Specifically, the nodes of the business system can first perform unified authentication for all requests. The introduction of this security mechanism can improve efficiency by caching some authentication information locally while strictly controlling the cache timeliness to ensure the integrity and security of data during transmission. In addition, the present application can also improve the fault tolerance effect of the business system and improve the service reliability in the face of network anomalies through redundant routing and load balancing.

[0125] Figure 5 A schematic diagram of the structure of a data transmission device provided by an embodiment of the present application is shown. Figure 5 As shown, the data transmission device 10 of this embodiment is used to implement the operation corresponding to the system in any of the above method embodiments. The data transmission device 10 of this embodiment includes:

[0126] An acquisition module 11 is used to acquire requests to be processed;

[0127] The distribution module 12 is used to randomly distribute the pending requests to available distribution nodes; determine the multi-level classification of the pending requests according to the preset classification rules; determine the multi-level routing channel for sending the pending requests according to the multi-level classification; and send the pending requests using the multi-level routing channel.

[0128] Optionally, the multi-level classification includes a first business category and a second business category, wherein the second business category is a subcategory of the first business category;

[0129] Accordingly, the distribution module 12 is specifically used for:

[0130] Determining a first business category of the request to be processed according to request path information in the request to be processed;

[0131] A second business category of the request to be processed is determined according to the first business category and the multi-dimensional request information in the request to be processed.

[0132] Optionally, the multi-dimensional request information in the request to be processed includes at least one of node information, customer information, and instruction encoding information.

[0133] Optionally, each first service category corresponds to at least one first service node, and each second service category corresponds to at least one second service node; the multi-level routing channel includes a first routing channel corresponding to the first service node, and a second routing channel corresponding to the second service node;

[0134] Accordingly, the distribution module 12 is specifically used for:

[0135] According to the load balancing strategy, select a first service node from at least one first service node corresponding to the first service category to generate a first routing channel;

[0136] According to the load balancing strategy, a second service node is selected from at least one second service node corresponding to the second service category to generate a second routing channel.

[0137] Optionally, the distribution module 12 is further configured to:

[0138] The number of the first service nodes and / or the second service nodes is expanded or reduced according to the concurrent volume of requests to be processed.

[0139] Optionally, the distribution module 12 is further configured to:

[0140] Expand or reduce the number of distribution nodes based on the concurrent volume of pending requests.

[0141] The data transmission device 10 provided in the embodiment of the present application can execute the above method embodiment. Its specific implementation principle and technical effects can be found in the above method embodiment, and this embodiment will not be repeated here.

[0142] Figure 6 FIG. 1 is a schematic diagram showing the hardware structure of a system provided in an embodiment of the present application. Figure 6 As shown, the system 20 is used to implement the operations corresponding to the system in any of the above method embodiments. The system 20 of this embodiment may include: a memory 21, a processor 22 and a communication interface 24.

[0143] The memory 21 is used to store computer programs. The memory 21 may include a high-speed random access memory (RAM), and may also include a non-volatile memory (NVM), such as at least one disk memory, and may also be a USB flash drive, a mobile hard disk, a read-only memory, a disk or an optical disk.

[0144] The processor 22 is used to execute the computer program stored in the memory to implement the data transmission method in the above embodiment. For details, please refer to the relevant description in the above method embodiment. The processor 22 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the invention can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor.

[0145] Optionally, the memory 21 may be independent or integrated with the processor 22 .

[0146] When the memory 21 is a device independent of the processor 22, the system 20 may further include a bus 23. The bus 23 is used to connect the memory 21 and the processor 22. The bus 23 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.

[0147] The communication interface 24 may be connected to the processor 21 via the bus 23. The processor 22 may control the communication interface 24 to obtain the request to be processed.

[0148] The system provided in this embodiment can be used to execute the above-mentioned data transmission method, and its implementation method and technical effect are similar, which will not be described in detail in this embodiment.

[0149] The present application also provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, it is used to implement the methods provided in the various embodiments described above.

[0150] Among them, the computer-readable storage medium can be a computer storage medium or a communication medium. The communication medium includes any medium that facilitates the transmission of a computer program from one place to another. The computer storage medium can be any available medium that can be accessed by a general-purpose or special-purpose computer. For example, a computer-readable storage medium is coupled to a processor so that the processor can read information from the computer-readable storage medium and write information to the computer-readable storage medium. Of course, the computer-readable storage medium can also be a component of the processor. The processor and the computer-readable storage medium can be located in an application-specific integrated circuit (ASIC). In addition, the ASIC can be located in a user device. Of course, the processor and the computer-readable storage medium can also exist in a communication device as discrete components.

[0151] Specifically, the computer-readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The storage medium can be any available medium that can be accessed by a general or special-purpose computer.

[0152] The present application also provides a computer program product, which includes a computer program stored in a computer-readable storage medium. At least one processor of a device can read the computer program from the computer-readable storage medium, and at least one processor executes the computer program so that the device implements the methods provided in the various embodiments described above.

[0153] An embodiment of the present application also provides a chip, which includes a memory and a processor, the memory is used to store computer programs, and the processor is used to call and run the computer programs from the memory, so that a device equipped with the chip executes the methods in various possible implementation modes as described above.

[0154] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of modules is only a logical function division. There may be other division methods in actual implementation. For example, multiple modules can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0155] Among them, each module can be physically separated, for example, installed in different locations of a device, or installed on different devices, or distributed on multiple network units, or distributed on multiple processors. Each module can also be integrated together, for example, installed in the same device, or integrated in a set of codes. Each module can exist in the form of hardware, or can also exist in the form of software, or can also be implemented in the form of software plus hardware. The present application can select some or all of the modules according to actual needs to achieve the purpose of the present embodiment.

[0156] When each module is implemented as an integrated module in the form of a software function module, it can be stored in a computer-readable storage medium. The above-mentioned software function module is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform some steps of the methods of each embodiment of the present application.

[0157] It should be understood that, although the various steps in the flowcharts in the above-described embodiments are sequentially displayed according to the indications of the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless there is a clear description in this article, the execution of these steps is not strictly limited in order, and they can be executed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily to be carried out sequentially, but can be executed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0158] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0159] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, a person of ordinary skill in the art should understand that the technical solutions described in the above embodiments can still be modified, or some or all of the technical features can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A data transmission method, characterized in that: Applied to a business system, the method comprises: The entry node obtains the pending request and determines whether the information in the pending request is empty; the entry node is the first layer of the business system; If it is empty, the pending requests are distributed according to the configured default route; If it is not empty, the pending request is randomly forwarded to an available distribution node in the second layer of the business system; wherein the second layer of the business system includes multiple distribution nodes; Determine the first service category of the request to be processed according to the request path information in the request to be processed and a preset first comparison table; wherein the first comparison table presets a correspondence between the request path and the first service category; the first service category is determined by the distribution node that receives the request to be processed; According to the first service category and the multi-dimensional request information in the pending request, the second service category of the pending request is determined based on a preset second comparison table; wherein the corresponding relationship between the multi-dimensional request information and the second service category is preset in the second comparison table; the second service category is determined by a first service node in the third layer of the service system for receiving the pending request; wherein the first service node is used to forward the pending request to a second service node in the fourth layer of the service system for receiving the pending request; the third layer of the service system includes a plurality of first service nodes, and the fourth layer of the service system includes a plurality of second service nodes; According to the load balancing strategy, a first routing channel for sending the pending request is determined based on the first service category, and a second routing channel for the pending request is determined based on the second service category; the first routing channel corresponds to a first service node for receiving the pending request, the second routing channel corresponds to a second service node for receiving the pending request, the first service node for receiving the pending request and the first routing channel are determined by the distribution node that receives the pending request, and the second service node for receiving the pending request and the second routing channel are determined by the first service node for receiving the pending request; Sending the pending request to the second service node for receiving the pending request using the first routing channel and the second routing channel, so that the second service node processes the pending request; The business system also includes: the business system periodically counting the maximum concurrency and throughput of the business system within the adjustment period; Determine a target number of required distribution nodes according to the maximum concurrency and the throughput; When the target number is greater than the actual number of distribution nodes currently existing in the business system, multiple nodes are acquired from idle nodes as distribution nodes, so that the number of currently existing distribution nodes reaches the target number; When the target number is less than the actual number of distribution nodes currently existing in the service system, a plurality of nodes are released from the currently existing distribution nodes so that the number of the currently existing distribution nodes reaches the target number.

2. The method according to claim 1, characterized in that The second service category is a subcategory of the first service category.

3. The method according to claim 2, characterized in that The multi-dimensional request information in the pending request includes at least one of node information, customer information, and instruction encoding information.

4. The method according to claim 2 or 3, characterized in that: Each of the first service categories corresponds to at least one first service node, and each of the second service categories corresponds to at least one second service node; Accordingly, the determining, according to the load balancing strategy, a first routing channel for sending the pending request based on the first service category, and determining a second routing channel for sending the pending request based on the second service category specifically includes: According to the load balancing strategy, select a first service node from at least one first service node corresponding to the first service category to generate a first routing channel; According to the load balancing strategy, a second service node is selected from at least one second service node corresponding to the second service category to generate a second routing channel.

5. The method according to claim 4, characterized in that The method further comprises: The number of the first service nodes and / or the second service nodes is expanded or reduced according to the concurrent volume of the requests to be processed.

6. A data transmission device, characterized in that: Applied to a business system, the device comprises: An acquisition module, used to acquire a pending request and determine whether the information in the pending request is empty; the acquisition module is an entry node, and the entry node is the first layer of the business system; A distribution module, used for distributing the pending requests according to the configured default route if it is empty; If it is not empty, the pending request is randomly forwarded to an available distribution node in the second layer of the business system; wherein the second layer of the business system includes multiple distribution nodes; Determine the first service category of the request to be processed according to the request path information in the request to be processed and a preset first comparison table; wherein the first comparison table presets a correspondence between the request path and the first service category; the first service category is determined by the distribution node that receives the request to be processed; According to the first service category and the multi-dimensional request information in the pending request, the second service category of the pending request is determined based on a preset second comparison table; wherein the corresponding relationship between the multi-dimensional request information and the second service category is preset in the second comparison table; the second service category is determined by a first service node in the third layer of the service system for receiving the pending request; wherein the first service node is used to forward the pending request to a second service node in the fourth layer of the service system for receiving the pending request; the third layer of the service system includes a plurality of first service nodes, and the fourth layer of the service system includes a plurality of second service nodes; According to the load balancing strategy, a first routing channel for sending the pending request is determined based on the first service category, and a second routing channel for the pending request is determined based on the second service category; the first routing channel corresponds to a first service node for receiving the pending request, the second routing channel corresponds to a second service node for receiving the pending request, the first service node for receiving the pending request and the first routing channel are determined by the distribution node that receives the pending request, and the second service node for receiving the pending request and the second routing channel are determined by the first service node for receiving the pending request; Sending the pending request to the second service node for receiving the pending request using the first routing channel and the second routing channel, so that the second service node processes the pending request; The device is also used to periodically count the maximum concurrency and throughput of the business system within the adjustment period; determine the target number of required distribution nodes based on the maximum concurrency and the throughput; when the target number is greater than the actual number of distribution nodes currently existing in the business system, obtain multiple nodes from idle nodes as distribution nodes so that the number of currently existing distribution nodes reaches the target number; when the target number is less than the actual number of distribution nodes currently existing in the business system, release multiple nodes from the currently existing distribution nodes so that the number of currently existing distribution nodes reaches the target number.

7. A business system, characterized in that: The system includes: a memory and a processor; The memory is used to store a computer program; the processor is used to implement the method according to any one of claims 1 to 5 according to the computer program stored in the memory.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it is used to implement the method according to any one of claims 1 to 5.

9. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.

Images