Business processing method, electronic device, electronic equipment and medium

CN114510440BActive Publication Date: 2024-12-27BEIJING ACAD OF ARTIFICIAL INTELLLIGENCE
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210380882.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-11-29
Filing Date
2022-04-12
Publication Date
2024-12-27
Estimated Expiration
2042-04-12

AI Technical Summary

Technical Problem

In the intelligent computing service platform, the storage cluster transmits service data for a long time, resulting in low service processing efficiency of computing nodes.

Method used

When the computing node processes the current service, determines the data type and size of the service to be processed, obtains cache storage space, and pre-retrieves the service data from the storage cluster and stores it in a temporary storage space, and uses a specific cache algorithm to improve data transmission efficiency.

Benefits of technology

Without affecting the current task, the service data reading efficiency of subsequent tasks when using the computing node is improved, and the overall service processing efficiency is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114510440B_ABST
    Figure CN114510440B_ABST
Patent Text Reader

Abstract

The present application discloses a method, an electronic device, an electronic device and a medium for business processing. By applying the technical solution of the present application, the business data required for subsequent business processing can be retrieved from the storage cluster in advance and stored in a temporary storage space through a specific cache algorithm when the computing node is processing the current business. Thus, the efficiency of reading business data will be higher when the computing node is used for calculation without affecting the currently running tasks, thereby improving the efficiency of overall business processing.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to data processing technology, and in particular to a business processing method, electronic device, electronic equipment and medium.

[0002] This application is the research result funded by the National Key R&D Program of China (2020AAA0105200). Background Art

[0003] In the related art, for an intelligent computing service platform, the massive data that needs to be calculated is usually stored in a storage cluster, so that when the computing nodes perform calculations later, the business data used for calculations can be transferred to the computing nodes in batches.

[0004] However, this approach has a problem in that it takes a long time for the storage cluster to transmit business data, which results in low business processing efficiency of the computing nodes. Summary of the invention

[0005] The embodiments of the present application provide a method, electronic device, electronic device and medium for business processing. The technical solution of the present application can solve the problem in the related art that the business processing efficiency of the computing node is low due to the long time it takes for the storage cluster to transmit business data.

[0006] According to one aspect of an embodiment of the present application, a service processing method is provided, which is applied to a target computing node, including:

[0007] When processing the current business, determining the business data parameters of the next business to be processed, wherein the business data parameters are used to characterize the data type and data size of the business data required to process the business to be processed;

[0008] Acquire the cache storage space allocated for the target computing node, and transfer the to-be-processed business data corresponding to the business data parameter to the cache storage space;

[0009] When it is detected that the current business processing is completed, the to-be-processed business data is retrieved from the cache storage space;

[0010] Based on the data of the business to be processed, the business to be processed is processed.

[0011] Optionally, in another embodiment of the method of the present application, determining the service data parameters of the next service to be processed includes:

[0012] Obtaining the priority level corresponding to at least one currently existing unprocessed business;

[0013] The unprocessed business with the highest priority level is used as the to-be-processed business;

[0014] The data type and data size of the to-be-processed business data are determined, wherein the data type corresponds to at least one of image data, code data, and a business data set.

[0015] Optionally, in another embodiment of the method of the present application, the acquiring the cache storage space allocated to the target computing node includes:

[0016] Dividing the cache storage space into a first number of sub-storage spaces, where the first number is the same as the number of data types included in the service data to be processed;

[0017] The business data to be processed of the same data type is correspondingly transferred to a sub-storage space allocated thereto.

[0018] Optionally, in another embodiment of the method of the present application, the transmitting of the to-be-processed service data of the same data type to a sub-storage space allocated thereto includes:

[0019] If it is detected that the size of the to-be-processed business data of the same data type exceeds the capacity of the sub-storage space corresponding thereto;

[0020] According to the reading order of the to-be-processed business data, part of the to-be-processed business data of the same data type is sequentially transmitted to a sub-storage space allocated thereto.

[0021] Optionally, in another embodiment of the method of the present application, the transferring of the to-be-processed service data corresponding to the service data parameter to the cache storage space includes:

[0022] Retrieving the to-be-processed service data from the storage cluster, and acquiring at least one cache algorithm supported by the cache storage space;

[0023] hierarchically calculating the cache hit rate achieved by transferring the to-be-processed service data to the cache storage space under each cache algorithm;

[0024] The cache algorithm corresponding to the highest cache hit rate is used as the first cache algorithm;

[0025] The first cache algorithm is used to transfer the to-be-processed service data to the cache storage space.

[0026] Optionally, in another embodiment of the method of the present application, after retrieving the service data to be processed from the storage cluster and acquiring at least one cache algorithm supported by the cache storage space, the method further includes:

[0027] Determine a second cache algorithm with the highest corresponding cache hit rate for each data type of the to-be-processed business data respectively;

[0028] The to-be-processed service data of the corresponding data type is transferred to the cache storage space by using each second cache algorithm.

[0029] Optionally, in another embodiment of the method of the present application, the transferring of the to-be-processed service data corresponding to the service data parameter to the cache storage space includes:

[0030] Detecting whether the current storage data of the cache storage space includes at least part of the service data to be processed;

[0031] If so, the storage data including at least part of the to-be-processed business data in the current storage data is retained, and the rest of the current storage data is cleared.

[0032] Optionally, in another embodiment of the method of the present application, the transferring of the to-be-processed service data corresponding to the service data parameter to the cache storage space includes:

[0033] Detecting a congestion state of a link channel between a storage cluster storing the service data to be processed and the target computing node;

[0034] If it is determined that the congestion state is lower than a preset threshold, the to-be-processed service data is transferred to the cache storage space.

[0035] According to another aspect of the embodiment of the present application, an electronic device for business processing is provided, which is applied to a target computing node, including:

[0036] A determination module, configured to determine a service data parameter of a next service to be processed when processing the current service, wherein the service data parameter is used to characterize a data type and a data size of the service data required for processing the service to be processed;

[0037] A transmission module, configured to obtain a cache storage space allocated to the target computing node, and transmit the to-be-processed business data corresponding to the business data parameter to the cache storage space;

[0038] A detection module, configured to retrieve the to-be-processed business data from the cache storage space when detecting that the current business processing is completed;

[0039] The processing module is configured to process the service to be processed based on the service data to be processed.

[0040] According to another aspect of the embodiments of the present application, an electronic device is provided, including:

[0041] A memory for storing executable instructions; and

[0042] A display is used to display with the memory to execute the executable instructions to complete the operation of any of the above-mentioned business processing methods.

[0043] According to another aspect of an embodiment of the present application, a computer-readable storage medium is provided for storing computer-readable instructions, wherein the instructions, when executed, perform the operations of any of the above-mentioned business processing methods.

[0044] In this application, when processing the current business, determine the business data parameters of the next business to be processed, and the business data parameters are used to characterize the data type and data size of the business data required to process the business to be processed; obtain the cache storage space allocated for the target computing node, and transfer the business data to be processed corresponding to the business data parameters to the cache storage space; when it is detected that the current business processing is completed, retrieve the business data to be processed from the cache storage space; based on the business data to be processed, process the business to be processed. By applying the technical solution of this application, the business data required for subsequent business processing can be retrieved from the storage cluster in advance and stored in the temporary storage space through a specific cache algorithm when the computing node is processing the current business. Thereby, without affecting the currently running tasks, the efficiency of reading business data will be higher when the computing nodes are used for calculation, thereby improving the efficiency of overall business processing.

[0045] The technical solution of the present application is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The accompanying drawings, which constitute a part of the specification, illustrate embodiments of the present application and, together with the description, serve to explain the principles of the present application.

[0047] The present application can be more clearly understood from the following detailed description with reference to the accompanying drawings, in which:

[0048] Figure 1 A schematic diagram of an exemplary system architecture for the business processing proposed in this application;

[0049] Figure 2 A schematic diagram of a business processing method proposed in this application;

[0050] Figure 3-Figure 4 A flowchart of a business processing method proposed in this application;

[0051] Figure 5 A schematic diagram of an electronic device for business processing proposed in this application;

[0052] Figure 6 A schematic diagram of an electronic device for business processing proposed in this application. DETAILED DESCRIPTION

[0053] Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that unless otherwise specifically stated, the relative arrangement of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present application.

[0054] At the same time, it should be understood that for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0055] The following description of at least one exemplary embodiment is merely illustrative in nature and is not intended to limit the present application, its application, or uses.

[0056] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered as part of the specification.

[0057] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0058] In addition, the technical solutions between the various embodiments of the present application can be combined with each other, but it must be based on the fact that ordinary technicians in the field can implement it. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0059] It should be noted that all directional indications in the embodiments of the present application (such as up, down, left, right, front, back, etc.) are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0060] Combine the following Figure 1-Figure 4 To describe the method for performing business processing according to the exemplary embodiment of the present application. It should be noted that the following application scenarios are only shown to facilitate understanding of the spirit and principle of the present application, and the embodiments of the present application are not limited in this respect. On the contrary, the embodiments of the present application can be applied to any applicable scenario.

[0061] in, Figure 1 A schematic diagram showing an exemplary system architecture of the working principle of the intelligent computing service platform to which the embodiments of the present application can be applied.

[0062] In related technologies, the intelligent computing business platform can perform tasks such as ultra-large-scale pre-trained model training, brain simulation, brain simulation, and neuron simulation experiments.

[0063] Furthermore, for an intelligent computing business platform with a storage-computing separation architecture, the massive data that needs to be calculated is usually stored in a storage cluster so that the business data used for calculation can be transferred to the computing nodes in batches when the computing nodes perform calculations later.

[0064] Among them, the intelligent computing business platform is a kind of computer that uses binary logic, program storage and execution, and consists of five parts (arithmetic unit, controller, memory, input device, output device). In addition, an important feature of the intelligent computing business platform of this architecture is that its storage part and computing part are separated, that is, the storage cluster and computing cluster are separated.

[0065] Depend on Figure 1 It can be seen that, generally speaking, users can implement the calculation of tasks on the intelligent computing business platform by accessing the PAAS service provided by the intelligent computing business platform, that is, the intelligent computing business platform Web provides users with reliable computing services to implement all the logic required for user computing. The main function of the scheduling node in the computing process is to implement the scheduling of tasks, including: 1) controlling the computing operations of the computing cluster through the network; 2) controlling the transmission, reading, writing, and deletion of data in the storage cluster through the network. There is generally a high-speed network connection between the storage cluster and the computing cluster to ensure the two-way flow of data between the storage cluster and the computing cluster, such as: 1) The storage cluster transmits the data that needs to be calculated or trained to the computing cluster for the computing cluster to perform related logical calculations; 2) The computing cluster stores the log files, process files, intermediate results, and final calculation results in the computing cluster.

[0066] At the same time, in a computing cluster, generally speaking, each computing node will have a certain amount of temporary storage space for computing data caching and other functions. It has the following characteristics: 1) A single temporary storage space is directly connected to a single computing node, and the communication speed between the two is extremely fast, generally much faster than the communication speed between the storage cluster and the computing cluster, and basically equivalent to the communication speed between computing nodes; 2) The read and write efficiency of this temporary storage is generally very high, and much higher than the efficiency of the storage nodes in the storage cluster; 3) Due to the current level of technological development and the need for cost control, the storage capacity of this part is much smaller than that of the storage nodes in the storage cluster, that is, the storage capacity is very limited. Traditional intelligent computing business platforms cannot make good use of this part of the cache, which will result in a part of the data transmission time required between task executions.

[0067] In one implementation, the present application also proposes a business processing method. Figure 2 The flowchart of a method for business processing according to an embodiment of the present application is schematically shown. Figure 2 As shown, the method is applied to a target computing node, comprising:

[0068] S101, when processing the current business, determining business data parameters of the next business to be processed, where the business data parameters are used to characterize the data type and data size of the business data required to process the business to be processed.

[0069] In order to reduce the waiting time of the business processing of the computing node, the present application can choose to pre-retrieve and store the business data required for subsequent business processing in a temporary storage space through a specific cache algorithm during the process of the computing node processing the current business.

[0070] In one approach, data types generally include image data, code data, and business data sets, etc. It is understandable that the present application may first determine all business data required for a business to be processed by a computing node (i.e., business data to be processed), and then further determine each data type contained in the business data to be processed, as well as the total data size of the business data to be processed, and / or the data size corresponding to each data type.

[0071] In one embodiment, the present application does not specifically limit the number of the next pending business, for example, it can be one or more. Taking multiple examples, it means that the target computing node can determine the business data parameters corresponding to multiple pending sub-businesses (i.e., multiple pending sub-businesses constitute one pending business) to be processed subsequently during the process of processing the current business. The multiple pending businesses can be processed in parallel or serially by the computing node.

[0072] S102, obtaining a cache storage space allocated to the target computing node, and transferring the to-be-processed business data corresponding to the business data parameters to the cache storage space.

[0073] Furthermore, each computing node in the computing cluster is allocated a certain temporary storage space for realizing functions such as computing data cache, etc. Therefore, based on this, the present application can store the business data stored in the storage cluster in advance in the cache storage space of the computing node.

[0074] It should be noted that the temporary storage space of the computing node is much smaller than that of the storage node in the storage cluster, that is, the storage capacity is very limited. Therefore, when the size of the pending business data corresponding to the business data parameter is too large compared to the capacity of the temporary storage space, you can choose to transfer part of the pending business data to the cache storage space. For example, according to the preset priority strategy, you can cache half of the pending business data and transfer it to the cache storage space.

[0075] In one embodiment, in the process of transferring the business data to be processed to the cache storage space, the present application can select different cache algorithms according to different data types to achieve the cache acceleration effect, that is, the data to be cached is cached into a temporary storage space using an adaptive classification cache acceleration algorithm through the scheduling node. When the caching is completed, the information of the successful caching is fed back to the scheduling node.

[0076] S103, when it is detected that the current business processing is completed, the business data to be processed is retrieved from the cache storage space.

[0077] S104: Process the business to be processed based on the business data to be processed.

[0078] Furthermore, in the present application, when the computing node is processing the current business, the business data required for subsequent business processing can be pre-retrieved and stored in a temporary storage space through a specific cache algorithm. Thereby, when it is detected that the current business processing is completed, the business data to be processed is retrieved from the cache storage space and then the business to be processed is processed. Then, when the subsequent tasks use the computing node for calculation, the reading efficiency of the business data will be higher, thereby improving the efficiency of business processing.

[0079] In this application, when processing the current business, determine the business data parameters of the next business to be processed, and the business data parameters are used to characterize the data type and data size of the business data required to process the business to be processed; obtain the cache storage space allocated for the target computing node, and transfer the business data to be processed corresponding to the business data parameters to the cache storage space; when it is detected that the current business processing is completed, retrieve the business data to be processed from the cache storage space; based on the business data to be processed, process the business to be processed. By applying the technical solution of this application, the business data required for subsequent business processing can be pre-retrieved and stored in a temporary storage space through a specific cache algorithm when the computing node is processing the current business. Thereby, the reading efficiency of business data will be higher when the computing node is used for calculation without affecting the currently running tasks, thereby improving the efficiency of business processing. Problems such as the node being too loaded to serve, the request being unable to return to the source smoothly, and the loss of CDN system performance.

[0080] Optionally, in another embodiment of the above method of the present application, in S102 (determining the service data parameters of the next service to be processed), the following steps may be implemented:

[0081] Obtaining the priority level corresponding to at least one currently existing unprocessed business;

[0082] The unprocessed business with the highest priority level is regarded as the business to be processed;

[0083] Determine the data type and data size of the service data to be processed, wherein the data type corresponds to at least one of image data, code data, and a service data set.

[0084] Furthermore, in the method of determining the next service to be processed by the computing node, the present application can select the service with the highest priority as the service to be processed next according to the priority index of each service to be processed.

[0085] In one approach, the application can pre-generate a structured list J=<D, C, P> , where J represents each unprocessed business in the remaining task flow, D represents the relevant business data parameters required by the task, C represents the computing resources required by the unprocessed business, and P represents the priority of the unprocessed business. This allows the computing node to select the next business with the highest priority to be processed after processing the current business according to the structured list each time.

[0086] In an optional method, the data type generally includes image data, code data, business data set, and the like.

[0087] Optionally, in determining the data type and data size contained in the business data to be processed, the present application can selectively determine the data size corresponding to each data type contained in the business data to be processed, or determine the total data size of the business data to be processed.

[0088] Optionally, in another embodiment of the above method of the present application, in S102 (obtaining the cache storage space allocated to the target computing node), the following steps may be implemented:

[0089] Dividing the cache storage space into a first number of sub-storage spaces, where the first number is the same as the number of data types included in the service data to be processed;

[0090] The business data to be processed of the same data type is correspondingly transferred to a sub-storage space allocated thereto.

[0091] Furthermore, in this implementation, the corresponding stored business data to be processed may be allocated to the temporary storage space in the target computing node.

[0092] It is understandable that, since the temporary storage space in the computing node is very limited, in one approach, it is necessary to predefine the space that can be occupied by each type of business data in the temporary storage space, that is, it is necessary to classify and identify the temporary storage space. In other words, it is to identify how much space each type of data can occupy.

[0093] In one embodiment, the embodiment of the present application can divide the cache storage space into sub-storage spaces of the same number (i.e., the first number) as the data type of the data to be processed, so that the business data to be processed of the same data type can be subsequently transmitted to a sub-storage space allocated to it.

[0094] For example, it can be determined that the data types of the business data to be processed are 2 categories, namely, business data of the mirror data type and business data of the code data type. Further, in order to realize that data of each data type can be stored in the temporary storage space, the present application can divide the cache storage space into sub-storage space A and sub-storage space B. So that the business data of the mirror data type can be stored in storage space A (or storage space B) and the business data of the code data type can be stored in storage space B (or storage space A) later.

[0095] It should also be noted that, in the process of dividing the cache storage space into sub-storage spaces of the same number (i.e., the first number) as the data type of the data to be processed, the application may divide the storage space evenly, or divide the storage space into sub-storage spaces of different sizes according to different data types or other strategies. The application does not make any specific limitation on this.

[0096] Optionally, in another embodiment of the method of the present application, the to-be-processed service data of the same data type are correspondingly transmitted to a sub-storage space allocated thereto, including:

[0097] If it is detected that the size of the to-be-processed business data of the same data type exceeds the capacity of the corresponding sub-storage space;

[0098] According to the reading order of the to-be-processed business data, part of the to-be-processed business data of the same data type is sequentially transmitted to a sub-storage space allocated thereto.

[0099] It should be noted that the temporary storage space of the computing node is much smaller than that of the storage node in the storage cluster, that is, the storage capacity is very limited. Therefore, when the size of the pending business data corresponding to the business data parameter is too large compared to the capacity of the temporary storage space, you can choose to transfer part of the pending business data to the cache storage space. For example, you can cache half of the pending business data and transfer it to the cache storage space according to the order of reading data when processing the business.

[0100] Optionally, in another embodiment of the method of the present application, transferring the to-be-processed service data corresponding to the service data parameter to the cache storage space includes:

[0101] Retrieving the service data to be processed from the storage cluster, and obtaining at least one cache algorithm supported by the cache storage space;

[0102] Hierarchically calculate the cache hit rate achieved by transferring the pending service data to the cache storage space under each cache algorithm;

[0103] The cache algorithm corresponding to the highest cache hit rate is used as the first cache algorithm;

[0104] The service data to be processed is transferred to the cache storage space by using the first cache algorithm.

[0105] Among them, the present application can select different cache algorithms to transfer the pending business data to the cache storage space. Specifically, it can cache the data types and sizes that need to be cached according to different data types and cache acceleration effects of different algorithms. That is, the data that needs to be cached is cached into the temporary storage space using the corresponding classified cache acceleration algorithm through the scheduling node. When the cache is completed, the information of the successful cache is fed back to the scheduling node.

[0106] Optionally, in another embodiment of the method of the present application, after retrieving the service data to be processed from the storage cluster and acquiring at least one cache algorithm supported by the cache storage space, the method further includes:

[0107] Determine a second cache algorithm with the highest corresponding cache hit rate for each data type of the to-be-processed business data respectively;

[0108] The to-be-processed service data of the corresponding data type is transferred to the cache storage space by using each second cache algorithm.

[0109] Specifically, you can Figure 3As shown, the present application can read the historical cache list information of the cache task according to the data type of the cached data, and calculate the cache hit rate of the data to be processed (or each data type) under different algorithms respectively, so as to adopt different cache algorithms to calculate the cache hit rate of the data to be processed (or a certain data type), so as to compare the multiple cache hit rates subsequently.

[0110] It can be understood that when comparing the hit rates of these caches, if the best one is found, the file of the data type adopts this cache algorithm. Among them, commonly used cache algorithms include FIFO (First in First out) algorithm and LRU-K algorithm.

[0111] Optionally, in another embodiment of the method of the present application, in S102 (transferring the to-be-processed service data corresponding to the service data parameter to the cache storage space), the following steps may be implemented:

[0112] Detecting whether the currently stored data in the cache storage space includes at least part of the business data to be processed;

[0113] If so, the stored data including at least a portion of the to-be-processed business data in the current stored data is retained, and the rest of the current stored data is cleared.

[0114] In one method, the present application can first clear part of the data in the cache storage space before transferring the pending business data to the cache storage space. That is, it is necessary to first confirm which data can be overwritten and which needs to be retained to guide the transmission of cache data in the temporary storage space of the computing node.

[0115] In one method, it is possible to identify by storing related scripts, thereby determining whether the current stored data in the cache storage space includes at least part of the pending business data. It is understandable that if it exists, there is no need to clear it, that is, only the business data that does not belong to the next call in the current stored data needs to be cleared. If all the data in the current stored data does not include the pending business data that needs to be transmitted later, all the stored data in the temporary storage space can be cleared. Thereby making room for subsequent data transmission.

[0116] Optionally, in another embodiment of the method of the present application, in S102 (transferring the to-be-processed service data corresponding to the service data parameter to the cache storage space), the following steps may be implemented:

[0117] Detecting the congestion status of the link channel between the storage cluster storing the business data to be processed and the target computing node;

[0118] If it is determined that the congestion state is lower than a preset threshold, the service data to be processed is transferred to the cache storage space.

[0119] Further, such as Figure 4 As shown, before transmitting the pending business data, the application first needs to calculate the congestion status of the link channel between the storage cluster and the target computing node. And only when the network is unobstructed will the pending business data be transmitted. It can be understood that its main function is to make full use of the network load to achieve the transmission of the data that needs to be cached without affecting the current computing task.

[0120] It is understandable that since the current task's use of the network is constantly changing, in the process of transmitting cached data, in order not to affect the current task, the network status will be regularly identified to avoid network congestion. In one case, the identification of the link channel congestion status is generally carried out through network scripts or related network monitoring tools to understand the current network load status.

[0121] In one method, a preset threshold of current network congestion is set as α, and when the network congestion threshold is greater than α, the network status is identified, and data transmission is performed only when the congestion threshold is less than α. After the data transmission is completed, a signal indicating that the cached data transmission is completed is output to the scheduling node.

[0122] By applying the technical solution of the present application, the business data required for subsequent business processing can be pre-retrieved and stored in a temporary storage space through a specific cache algorithm when the computing node is processing the current business. Thus, the efficiency of reading business data will be higher when the computing node is used for calculation of subsequent tasks without affecting the currently running tasks, thereby improving the efficiency of business processing.

[0123] In another embodiment of the present application, Figure 5 As shown, the present application also provides an electronic device for business processing. It includes a determination module 201, a transmission module 202, a detection module 203, and a processing module 204, which are applied to a target computing node, wherein:

[0124] The determination module 201 is configured to determine the service data parameters of the next service to be processed when processing the current service, wherein the service data parameters are used to characterize the data type and data size of the service data required for processing the service to be processed;

[0125] The transmission module 202 is configured to obtain the cache storage space allocated to the target computing node, and transmit the to-be-processed business data corresponding to the business data parameter to the cache storage space;

[0126] The detection module 203 is configured to retrieve the to-be-processed service data from the cache storage space when detecting that the current service processing is completed;

[0127] The processing module 204 is configured to process the service to be processed based on the service data to be processed.

[0128] In this application, when processing the current business, determine the business data parameters of the next business to be processed, and the business data parameters are used to characterize the data type and data size of the business data required to process the business to be processed; obtain the cache storage space allocated for the target computing node, and transfer the business data to be processed corresponding to the business data parameters to the cache storage space; when it is detected that the current business processing is completed, retrieve the business data to be processed from the cache storage space; based on the business data to be processed, process the business to be processed. By applying the technical solution of this application, the business data required for subsequent processing of the business can be pre-retrieved and stored in a temporary storage space through a specific cache algorithm during the process of processing the current business on the computing node. Thereby, without affecting the currently running tasks, the efficiency of reading business data will be higher when the computing nodes are used for calculation, thereby improving the efficiency of business processing.

[0129] In another embodiment of the present application, the determination module 201 is configured to:

[0130] Obtaining the priority level corresponding to at least one currently existing unprocessed business;

[0131] The unprocessed business with the highest priority level is used as the to-be-processed business;

[0132] The data type and data size of the to-be-processed business data are determined, wherein the data type corresponds to at least one of image data, code data, and a business data set.

[0133] In another embodiment of the present application, the transmission module 202 is configured as follows:

[0134] Dividing the cache storage space into a first number of sub-storage spaces, where the first number is the same as the number of data types included in the service data to be processed;

[0135] The business data to be processed of the same data type is correspondingly transferred to a sub-storage space allocated thereto.

[0136] In another embodiment of the present application, the transmission module 202 is configured as follows:

[0137] If it is detected that the size of the to-be-processed business data of the same data type exceeds the capacity of the sub-storage space corresponding thereto;

[0138] According to the reading order of the to-be-processed business data, part of the to-be-processed business data of the same data type is sequentially transmitted to a sub-storage space allocated thereto.

[0139] In another embodiment of the present application, the transmission module 202 is configured as follows:

[0140] Retrieving the to-be-processed service data from the storage cluster, and acquiring at least one cache algorithm supported by the cache storage space;

[0141] hierarchically calculating the cache hit rate achieved by transferring the to-be-processed service data to the cache storage space under each cache algorithm;

[0142] The cache algorithm corresponding to the highest cache hit rate is used as the first cache algorithm;

[0143] The first cache algorithm is used to transfer the to-be-processed service data to the cache storage space.

[0144] In another embodiment of the present application, the transmission module 202 is configured as follows:

[0145] Determine a second cache algorithm with the highest corresponding cache hit rate for each data type of the to-be-processed business data respectively;

[0146] The to-be-processed service data of the corresponding data type is transferred to the cache storage space by using each second cache algorithm.

[0147] In another embodiment of the present application, the transmission module 202 is configured as follows:

[0148] Detecting whether the current storage data of the cache storage space includes at least part of the service data to be processed;

[0149] If so, the storage data including at least part of the to-be-processed business data in the current storage data is retained, and the rest of the current storage data is cleared.

[0150] In another embodiment of the present application, the transmission module 202 is configured as follows:

[0151] Detecting a congestion state of a link channel between a storage cluster storing the service data to be processed and the target computing node;

[0152] If it is determined that the congestion state is lower than a preset threshold, the to-be-processed service data is transferred to the cache storage space.

[0153] Figure 63 is a logical structure block diagram of an electronic device according to an exemplary embodiment. For example, the electronic device 300 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0154] Reference Figure 6 , the electronic device 300 may include one or more of the following components: a processor 301 and a memory 302 .

[0155] The processor 301 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 301 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 301 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 301 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 301 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0156] The memory 302 may include one or more computer-readable storage media, which may be non-transitory. The memory 302 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 302 is used to store at least one instruction, which is used to be executed by the processor 301 to implement the interactive special effects calibration method provided in the method embodiment of the present application.

[0157] In some embodiments, the electronic device 300 may further optionally include: a peripheral device interface 303 and at least one peripheral device. The processor 301, the memory 302 and the peripheral device interface 303 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 303 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 304, a touch display screen 305, a camera 306, an audio circuit 307, a positioning component 308 and a power supply 309.

[0158] The peripheral device interface 303 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 301 and the memory 302. In some embodiments, the processor 301, the memory 302, and the peripheral device interface 303 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 301, the memory 302, and the peripheral device interface 303 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0159] The radio frequency circuit 304 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 304 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 304 converts the electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 304 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 304 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: a metropolitan area network, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 304 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

[0160] The display screen 305 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 305 is a touch display screen, the display screen 305 also has the ability to collect touch signals on the surface or above the surface of the display screen 305. The touch signal can be input to the processor 301 as a control signal for processing. At this time, the display screen 305 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 305 can be one, and the front panel of the electronic device 300 is set; in other embodiments, the display screen 305 can be at least two, which are respectively set on different surfaces of the electronic device 300 or are folded; in some other embodiments, the display screen 305 can be a flexible display screen, which is set on the curved surface or folded surface of the electronic device 300. Even, the display screen 305 can also be set as a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 305 can be made of materials such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode, organic light-emitting diode).

[0161] The camera assembly 306 is used to capture images or videos. Optionally, the camera assembly 306 includes a front camera and a rear camera. Typically, the front camera is disposed on the front panel of the terminal, and the rear camera is disposed on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize the panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 306 may also include a flash. The flash may be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0162] The audio circuit 307 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 301 for processing, or input them into the radio frequency circuit 304 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the electronic device 300. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 301 or the radio frequency circuit 304 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 307 may also include a headphone jack.

[0163] The positioning component 308 is used to locate the current geographic location of the electronic device 300 to implement navigation or LBS (Location Based Service). The positioning component 308 can be a positioning component based on the US GPS (Global Positioning System), China's Beidou system, Russia's Grenas system, or the European Union's Galileo system.

[0164] The power supply 309 is used to power various components in the electronic device 300. The power supply 309 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 309 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0165] In some embodiments, the electronic device 300 further includes one or more sensors 310 , including but not limited to: an acceleration sensor 311 , a gyroscope sensor 312 , a pressure sensor 313 , a fingerprint sensor 314 , an optical sensor 315 , and a proximity sensor 316 .

[0166] The acceleration sensor 311 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the electronic device 300. For example, the acceleration sensor 311 can be used to detect the components of gravity acceleration on the three coordinate axes. The processor 301 can control the touch display screen 305 to display the user interface in a horizontal view or a vertical view according to the gravity acceleration signal collected by the acceleration sensor 311. The acceleration sensor 311 can also be used for collecting game or user motion data.

[0167] The gyro sensor 312 can detect the body direction and rotation angle of the electronic device 300, and the gyro sensor 312 can cooperate with the acceleration sensor 311 to collect the user's 3D actions on the electronic device 300. The processor 301 can implement the following functions based on the data collected by the gyro sensor 312: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

[0168] The pressure sensor 313 can be set on the side frame of the electronic device 300 and / or the lower layer of the touch display screen 305. When the pressure sensor 313 is set on the side frame of the electronic device 300, it can detect the user's holding signal of the electronic device 300, and the processor 301 performs left and right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 313. When the pressure sensor 313 is set on the lower layer of the touch display screen 305, the processor 301 controls the operability controls on the UI interface according to the user's pressure operation on the touch display screen 305. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.

[0169] The fingerprint sensor 314 is used to collect the user's fingerprint, and the processor 301 identifies the user's identity based on the fingerprint collected by the fingerprint sensor 314, or the fingerprint sensor 314 identifies the user's identity based on the collected fingerprint. When the user's identity is identified as a trusted identity, the processor 301 authorizes the user to perform relevant sensitive operations, which include unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings. The fingerprint sensor 314 can be set on the front, back, or side of the electronic device 300. When a physical button or a manufacturer logo is set on the electronic device 300, the fingerprint sensor 314 can be integrated with the physical button or the manufacturer logo.

[0170] The optical sensor 315 is used to collect the ambient light intensity. In one embodiment, the processor 301 can control the display brightness of the touch display screen 305 according to the ambient light intensity collected by the optical sensor 315. Specifically, when the ambient light intensity is high, the display brightness of the touch display screen 305 is increased; when the ambient light intensity is low, the display brightness of the touch display screen 305 is reduced. In another embodiment, the processor 301 can also dynamically adjust the shooting parameters of the camera assembly 306 according to the ambient light intensity collected by the optical sensor 315.

[0171] The proximity sensor 316, also called a distance sensor, is usually arranged on the front panel of the electronic device 300. The proximity sensor 316 is used to collect the distance between the user and the front of the electronic device 300. In one embodiment, when the proximity sensor 316 detects that the distance between the user and the front of the electronic device 300 is gradually decreasing, the processor 301 controls the touch display screen 305 to switch from the screen-on state to the screen-off state; when the proximity sensor 316 detects that the distance between the user and the front of the electronic device 300 is gradually increasing, the processor 301 controls the touch display screen 305 to switch from the screen-off state to the screen-on state.

[0172] Those skilled in the art will understand that Figure 6 The structure shown in the figure does not constitute a limitation on the electronic device 300, and may include more or less components than those shown in the figure, or combine some components, or adopt a different component arrangement.

[0173] In an exemplary embodiment, a non-temporary computer-readable storage medium including instructions is also provided, such as a memory 302 including instructions, and the above instructions can be executed by the processor 301 of the electronic device 300 to complete the above-mentioned method based on business processing, the method comprising: when processing the current business, determining the business data parameters of the next business to be processed, the business data parameters are used to characterize the data type and data size of the business data required for processing the business to be processed; obtaining the cache storage space allocated to the target computing node, and transferring the business data to be processed corresponding to the business data parameters to the cache storage space; when it is detected that the current business processing is completed, retrieving the business data to be processed from the cache storage space; based on the business data to be processed, processing the business to be processed. Optionally, the above instructions can also be executed by the processor 301 of the electronic device 300 to complete the other steps involved in the above-mentioned exemplary embodiment. For example, the non-temporary computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a tape, a floppy disk, an optical data storage device, etc.

[0174] In an exemplary embodiment, an application / computer program product is also provided, including one or more instructions, which can be executed by the processor 301 of the electronic device 300 to complete the above-mentioned method based on business processing, the method comprising: when processing the current business, determining the business data parameters of the next business to be processed, the business data parameters are used to characterize the data type and data size of the business data required to process the business to be processed; obtaining the cache storage space allocated to the target computing node, and transferring the business data to be processed corresponding to the business data parameters to the cache storage space; when it is detected that the current business processing is completed, retrieving the business data to be processed from the cache storage space; based on the business data to be processed, processing the business to be processed. Optionally, the above-mentioned instructions can also be executed by the processor 301 of the electronic device 300 to complete the other steps involved in the above-mentioned exemplary embodiment.

[0175] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0176] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A business processing method, characterized in that: Applied to the target computing node, including: When processing the current business, determining the business data parameters of the next business to be processed, wherein the business data parameters are used to characterize the data type and data size of the business data required to process the business to be processed; Acquire the cache storage space allocated for the target computing node, and transfer the to-be-processed business data corresponding to the business data parameter to the cache storage space; When it is detected that the current business processing is completed, the to-be-processed business data is retrieved from the cache storage space; Based on the service data to be processed, processing the service to be processed; The transferring of the pending business data corresponding to the business data parameters to the cache storage space includes: retrieving the pending business data from the storage cluster and acquiring at least one cache algorithm supported by the cache storage space; hierarchically calculating the cache hit rate achieved by transferring the pending business data to the cache storage space under each cache algorithm; using the cache algorithm corresponding to the highest cache hit rate as the first cache algorithm; and transferring the pending business data to the cache storage space using the first cache algorithm; After retrieving the service data to be processed from the storage cluster and acquiring at least one cache algorithm supported by the cache storage space, the method further includes: A second cache algorithm with the highest corresponding cache hit rate is determined for each data type of the to-be-processed business data respectively; and each second cache algorithm is used to transfer the to-be-processed business data of the corresponding data type to the cache storage space.

2. The method according to claim 1, characterized in that The determining of the service data parameters of the next service to be processed includes: Obtaining the priority level corresponding to at least one currently existing unprocessed business; The unprocessed business with the highest priority level is used as the to-be-processed business; The data type and data size of the to-be-processed business data are determined, wherein the data type corresponds to at least one of image data, code data, and a business data set.

3. The method according to claim 1, characterized in that The acquiring of the cache storage space allocated to the target computing node includes: Dividing the cache storage space into a first number of sub-storage spaces, where the first number is the same as the number of data types included in the service data to be processed; The business data to be processed of the same data type is correspondingly transferred to a sub-storage space allocated thereto.

4. The method according to claim 3, characterized in that The method of correspondingly transmitting the to-be-processed business data of the same data type to a sub-storage space allocated thereto includes: If it is detected that the size of the to-be-processed business data of the same data type exceeds the capacity of the sub-storage space corresponding thereto; According to the reading order of the to-be-processed business data, part of the to-be-processed business data of the same data type is sequentially transmitted to a sub-storage space allocated thereto.

5. The method according to claim 1, characterized in that The transferring the to-be-processed business data corresponding to the business data parameter to the cache storage space comprises: Detecting whether the current storage data of the cache storage space includes at least part of the service data to be processed; If so, the storage data including at least part of the to-be-processed business data in the current storage data is retained, and the rest of the current storage data is cleared.

6. The method according to claim 1, characterized in that The transferring the to-be-processed business data corresponding to the business data parameter to the cache storage space comprises: Detecting a congestion state of a link channel between a storage cluster storing the service data to be processed and the target computing node; If it is determined that the congestion state is lower than a preset threshold, the to-be-processed service data is transferred to the cache storage space.

7. An electronic device for business processing, characterized in that: Applied to the target computing node, including: A determination module, configured to determine a service data parameter of a next service to be processed when processing the current service, wherein the service data parameter is used to characterize a data type and a data size of the service data required for processing the service to be processed; A transmission module, configured to obtain a cache storage space allocated to the target computing node, and transmit the to-be-processed business data corresponding to the business data parameter to the cache storage space; A detection module, configured to retrieve the to-be-processed business data from the cache storage space when detecting that the current business processing is completed; A processing module, configured to process the service to be processed based on the service data to be processed; The transmission module is configured to: retrieve the service data to be processed from the storage cluster and obtain at least one cache algorithm supported by the cache storage space; hierarchically calculate the cache hit rate achieved by transferring the service data to be processed to the cache storage space under each cache algorithm; use the cache algorithm corresponding to the highest cache hit rate as the first cache algorithm; and use the first cache algorithm to transfer the service data to be processed to the cache storage space; Among them, the transmission module is also configured to: determine the second cache algorithm with the highest corresponding cache hit rate for each data type of the pending business data; and use each second cache algorithm to transmit the pending business data of the corresponding data type to the cache storage space.

8. An electronic device, characterized in that: include: A memory for storing executable instructions; as well as, A processor is used to display with the memory to execute the executable instructions to complete the operation of the business processing method described in any one of claims 1-6.

9. A computer-readable storage medium for storing computer-readable instructions, characterized in that: When the instruction is executed, the operation of the business processing method described in any one of claims 1-6 is performed.