Data processing method and device, electronic equipment and storage medium
The process engine receives and processes the client's data processing requests, which solves the problem of low data processing efficiency caused by the terminal's processing performance, and realizes more efficient data processing, which is suitable for scenarios where the client has built-in browser.
Patent Information
- Application Number
- CN202311757381.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-19
- Publication Date
- 2025-06-20
AI Technical Summary
Terminal processing performance is limited, resulting in data processing requests in the client's built-in browser need to be sent to the server for processing, which is inefficient.
The process engine receives the client's data processing request, and creates a business process including data processing flow, which includes data storage and reading operations of the target database. The process engine executes the data processing flow to process the request.
The process engine handles data requests, which improves the efficiency of data processing and is suitable for data processing scenarios with built-in browsers on the client.
Smart Images
Figure CN120179627A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computer application technologies, and in particular, to a data processing method, apparatus, electronic device, and storage medium. Background Art
[0002] Currently, due to the limited processing performance of terminals, especially in the scenario where a browser is built into the client, most of the clients deployed on the terminal send data processing requests to the server for processing. For example, storing data in the server or reading data from the server. However, in related technologies, most directly process data processing requests through the server, resulting in the problem of low data processing efficiency. Summary of the Invention
[0003] This application aims to at least partly solve one of the technical problems of low data processing efficiency in related technologies.
[0004] To this end, an embodiment of the first aspect of this application proposes a data processing method, which receives a data processing request sent by a client and sends the data processing request to a process engine. Among them, the business process created based on the process engine includes a data processing process, and the data processing process includes at least one of a data storage operation and a data reading operation on a target database. Through the process engine, the data processing process is executed to process the data processing request. Thus, the data processing process can be executed through the process engine to perform read and write operations on the database, that is, the process engine can convert the data processing request sent by the client into read and write operations on the database. Compared with directly processing data processing requests through the server in related technologies, in this application, the data processing request can be processed through the process engine, which can flexibly control the client's access to data, improve the data processing efficiency, and is applicable to the data processing scenario when a browser is built into the client.
[0005] An embodiment of the second aspect of this application proposes a data processing apparatus.
[0006] An embodiment of the third aspect of this application proposes an electronic device.
[0007] An embodiment of the fourth aspect of this application proposes a computer-readable storage medium.
[0008] An embodiment of the first aspect of this application proposes a data processing method, including: receiving a data processing request sent by a client; sending the data processing request to a process engine, where the business process created based on the process engine includes a data processing process, and the data processing process includes at least one of a data storage operation and a data reading operation on a target database; through the process engine, executing the data processing process to process the data processing request.
[0009] According to the data processing method of the embodiments of the present application, a data processing request sent by a client is received and sent to a process engine. Among them, the business process created based on the process engine includes a data processing process, and the data processing process includes at least one of a data storage operation and a data read operation on a target database. Through the process engine, the data processing process is executed to process the data processing request. Thus, the data processing process can be executed through the process engine to perform read and write operations on the database, that is, the process engine can convert the data processing request sent by the client into read and write operations on the database. Compared with the related art in which the data processing request is directly processed by the server, in the present application, the data processing request can be processed through the process engine, which can flexibly control the client's access to the data, improve the efficiency of data processing, and is applicable to the data processing scenario when the client has a built-in browser.
[0010] In addition, the data processing method according to the above embodiments of the present application may further have the following additional technical features:
[0011] In an embodiment of the present application, during the process of executing the data processing process through the process engine, it further includes: obtaining the target resource capacity required for the data processing process and the current resource capacity allocated to the data processing process; if the current resource capacity is less than the target resource capacity, increasing the current resource capacity to the target resource capacity; if the current resource capacity is greater than the target resource capacity, reducing the current resource capacity to the target resource capacity.
[0012] In an embodiment of the present application, executing the data processing process through the process engine to process the data processing request includes: if the data processing request is a data storage request, executing a data storage process through the process engine to process the data storage request, where the data storage process includes a data storage operation on the target database; if the data processing request is a data read request, executing a data read process through the process engine to process the data read request, where the data read process includes a data read operation on the target database.
[0013] In an embodiment of the present application, executing the data storage process through the process engine to process the data storage request includes: extracting the first data to be stored and the identifier of the first data from the data storage request; generating a first key-value pair based on the identifier of the first data and the first data, and storing the first key-value pair in the target database.
[0014] In one embodiment of the present application, executing a data storage process through the process engine to process the data storage request includes: extracting the maximum storage duration of the first data from the data storage request; and if the cumulative storage duration of the first data in the target database reaches the maximum storage duration, deleting the first data from the target database.
[0015] In one embodiment of the present application, executing a data reading process through the process engine to process the data reading request includes: extracting the identifier of the second data to be read from the data reading request; determining the second key-value pair with the identifier of the second data as the key in the target database, and using the value in the second key-value pair as the second data; and sending the second data to the client.
[0016] In one embodiment of the present application, executing the data processing process through the process engine to process the data processing request includes: extracting the data identifier of the data to be processed from the data processing request; authenticating the data identifier; if the data identifier passes the authentication, continuing to execute the data processing process to process the data processing request; if the data identifier fails to pass the authentication, stopping the execution of the data processing process.
[0017] In one embodiment of the present application, authenticating the data identifier includes: identifying whether the data identifier is in the identifier library; if the data identifier is in the identifier library, determining that the data identifier passes the authentication; if the data identifier is not in the identifier library, determining that the data identifier fails to pass the authentication.
[0018] In one embodiment of the present application, the data identifier is obtained by splicing the identifier of the client and the original identifier of the data to be processed.
[0019] A second aspect embodiment of the present application provides a data processing device, including: a receiving module, configured to receive a data processing request sent by a client; a sending module, configured to send the data processing request to a process engine, where a service process created based on the process engine includes a data processing process, and the data processing process includes at least one of a data storage operation and a data reading operation on a target database; and a processing module, configured to execute the data processing process through the process engine to process the data processing request.
[0020] The data processing device according to the embodiment of the present application receives a data processing request sent by a client and sends the data processing request to a process engine. Among them, the business process created based on the process engine includes a data processing process, and the data processing process includes at least one of data storage operations and data reading operations on a target database. Through the process engine, the data processing process is executed to process the data processing request. Thus, the data processing process can be executed through the process engine to perform read and write operations on the database, that is, the process engine can convert the data processing request sent by the client into read and write operations on the database. Compared with the related art in which the data processing request is directly processed by a server, in the present application, the data processing request can be processed through the process engine, which can flexibly control the client's access to data, improve the efficiency of data processing, and is applicable to the data processing scenario when a browser is built into the client.
[0021] In addition, the data processing device according to the above embodiment of the present application may further have the following additional technical features:
[0022] In an embodiment of the present application, during the process of executing the data processing process through the process engine, the processing module is further configured to: obtain the target resource capacity required for the data processing process and the current resource capacity allocated to the data processing process; if the current resource capacity is less than the target resource capacity, increase the current resource capacity to the target resource capacity; if the current resource capacity is greater than the target resource capacity, reduce the current resource capacity to the target resource capacity.
[0023] In an embodiment of the present application, the processing module is further configured to: if the data processing request is a data storage request, execute a data storage process through the process engine to process the data storage request, where the data storage process includes a data storage operation on the target database; if the data processing request is a data reading request, execute a data reading process through the process engine to process the data reading request, where the data reading process includes a data reading operation on the target database.
[0024] In an embodiment of the present application, the processing module is further configured to: extract the first data to be stored and the identifier of the first data from the data storage request; generate a first key-value pair based on the identifier of the first data and the first data, and store the first key-value pair in the target database.
[0025] In one embodiment of the present application, the processing module is further configured to: extract the maximum storage duration of the first data from the data storage request; if the cumulative storage duration of the first data in the target database reaches the maximum storage duration, delete the first data from the target database.
[0026] In one embodiment of the present application, the processing module is further configured to: extract the identifier of the second data to be read from the data read request; determine the second key-value pair in the target database with the identifier of the second data as the key, and use the value in the second key-value pair as the second data; send the second data to the client.
[0027] In one embodiment of the present application, the processing module is further configured to: extract the data identifier of the data to be processed from the data processing request; authenticate the data identifier; if the data identifier passes the authentication, continue to execute the data processing process to process the data processing request; if the data identifier fails to pass the authentication, stop executing the data processing process.
[0028] In one embodiment of the present application, the processing module is further configured to: identify whether the data identifier is in the identifier library; if the data identifier is in the identifier library, determine that the data identifier passes the authentication; if the data identifier is not in the identifier library, determine that the data identifier fails to pass the authentication.
[0029] In one embodiment of the present application, the data identifier is obtained by splicing the identifier of the client and the original identifier of the data to be processed.
[0030] An embodiment of the third aspect of the present application provides an electronic device, including: a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the data processing method as described above is implemented.
[0031] The electronic device according to the embodiment of the present application executes a computer program stored in a memory through a processor, receives a data processing request sent by a client, and sends the data processing request to a process engine. Among them, the business process created based on the process engine includes a data processing process, and the data processing process includes at least one of a data storage operation and a data reading operation on a target database. Through the process engine, the data processing process is executed to process the data processing request. Thus, the data processing process can be executed through the process engine to perform read and write operations on the database, that is, the process engine can convert the data processing request sent by the client into read and write operations on the database. Compared with the related art in which the data processing request is directly processed by a server, in the present application, the data processing request can be processed through the process engine, the access of the client to data can be flexibly controlled, the efficiency of data processing is improved, and it is applicable to the data processing scenario when a browser is built in the client.
[0032] In the fourth aspect of the embodiments of the present application, a computer-readable storage medium is proposed, on which a computer program is stored. When the program is executed by a processor, the data processing method described above is implemented.
[0033] The computer-readable storage medium according to the embodiment of the present application receives a data processing request sent by a client by storing a computer program and being executed by a processor, and sends the data processing request to a process engine. Among them, the business process created based on the process engine includes a data processing process, and the data processing process includes at least one of a data storage operation and a data reading operation on a target database. Through the process engine, the data processing process is executed to process the data processing request. Thus, the data processing process can be executed through the process engine to perform read and write operations on the database, that is, the process engine can convert the data processing request sent by the client into read and write operations on the database. Compared with the related art in which the data processing request is directly processed by a server, in the present application, the data processing request can be processed through the process engine, the access of the client to data can be flexibly controlled, the efficiency of data processing is improved, and it is applicable to the data processing scenario when a browser is built in the client.
[0034] The additional aspects and advantages of the present application will be partially given in the following description, partially become obvious from the following description, or be understood through the practice of the present invention. Description of the Drawings
[0035] The above-mentioned and / or additional aspects and advantages of the present application will become obvious and easy to understand from the following description of the embodiments in conjunction with the drawings, where:
[0036] Figure 1 It is a schematic flowchart of a data processing method according to an embodiment of the present application;
[0037] Figure 2 Schematic diagram of the process for processing a data storage request in a data processing method according to an embodiment of the present application;
[0038] Figure 3 Schematic diagram of the process for processing a data read request in a data processing method according to an embodiment of the present application;
[0039] Figure 4 Schematic diagram of the process for processing a data processing request in a data processing method according to an embodiment of the present application;
[0040] Figure 5 Schematic diagram of the structure of a data processing device according to an embodiment of the present application;
[0041] Figure 6 Schematic diagram of the structure of an electronic device according to an embodiment of the present application. Detailed implementation manners
[0042] The embodiments of the present application will be described in detail below. Examples of the embodiments are shown in the accompanying drawings, where the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to explain the present application, and should not be construed as a limitation to the present application.
[0043] The data processing method, device, electronic device, and storage medium according to the embodiments of the present application will be described below with reference to the accompanying drawings.
[0044] Figure 1 Schematic diagram of the process of a data processing method according to an embodiment of the present application.
[0045] As Figure 1 shown, the data processing method according to the embodiment of the present application includes:
[0046] S101, receiving a data processing request sent by a client.
[0047] It should be noted that the execution subject of the data processing method according to the embodiment of the present application can be an electronic device, and the data processing device according to the embodiment of the present application can be configured in any electronic device so that the electronic device can execute the data processing method according to the embodiment of the present application. Among them, the electronic device can include workstations, servers, computers, and other intelligent devices.
[0048] It should be noted that there are no excessive restrictions on the client. For example, it can include mobile phones, computers, intelligent voice interaction devices, intelligent home appliances, vehicle terminals, etc. Taking the client as a mobile phone and the execution subject as a server as an example, the server can receive a data processing request sent by the mobile phone.
[0049] It should be noted that there are no excessive restrictions on the data processing request. For example, it may include a data storage request, a data reading request, etc.
[0050] In one implementation, the data processing request carries a data identifier of the data to be processed. It can be understood that the data identifier corresponds to the data to be processed one by one. The data to be processed includes the first data to be stored, the second data to be read, etc. For example, the data storage request carries the identifier of the first data to be stored, and the data reading request carries the identifier of the second data to be read.
[0051] It should be noted that there are no excessive restrictions on the data identifier. For example, the data identifier can be generated based on the identifier of the client and / or the original identifier of the data to be processed. Among them, the original identifier corresponds to the data to be processed one by one. The identifier of the client may include the MAC (Media Access Control) address of the client, the identifier of the user operating the client, etc. Among them, the identifier of the user may include the ID (Identity Document) of the user, the user account for logging in to the client, etc.
[0052] In one implementation, the data identifier is obtained by splicing the identifier of the client and the original identifier of the data. For example, the identifier of the first data is obtained by splicing the identifier of the client and the original identifier of the first data, and the identifier of the second data is obtained by splicing the identifier of the client and the original identifier of the second data.
[0053] S102, Send the data processing request to the process engine. Among them, the business process created based on the process engine includes a data processing process, and the data processing process includes at least one of data storage operations and data reading operations on the target database.
[0054] It should be noted that the process engine refers to a program for creating a business process, and any process engine in related technologies can be used to implement it, and there are no excessive restrictions here. Taking the execution entity as the server as an example, the process engine is deployed in the server. In addition to the data processing process, the business process created based on the process engine may also include other business processes, such as form generation processes, image processing processes, voice interaction processes, etc.
[0055] It should be noted that to create a business process based on the process engine, any method for creating a business process based on the process engine in related technologies can be used to implement it, and there are no excessive restrictions here. For example, users, RPA (Robotic Process Automation) systems can start the process engine and perform relevant operations on the business process creation page of the process engine to create a business process.
[0056] In the embodiments of the present application, the business process created based on the process engine includes a data processing process. The data processing process may include multiple process nodes, and the processing objects of different process nodes may be the same or different, which is not limited here. The data processing process includes at least one of data storage operation and data reading operation on the target database, and the data processing process is not limited here. For example, it may include a data storage process, a data reading process, a data deletion process, a data update process, etc.
[0057] S103. Through the process engine, execute the data processing process to process the data processing request.
[0058] It should be noted that executing the data processing process through the process engine can be implemented by any method of executing the business process through the process engine in the related technologies, which is not limited here.
[0059] In one implementation, executing the data processing process through the process engine to process the data processing request includes: if the data processing request is a data storage request, execute the data storage process through the process engine to process the data storage request, where the data storage process includes a data storage operation on the target database; if the data processing request is a data reading request, execute the data reading process through the process engine to process the data reading request, where the data reading process includes a data reading operation on the target database. Thus, considering the category of the data processing request, the corresponding data processing process can be executed through the process engine to process different categories of data processing requests.
[0060] In one implementation, executing the data processing process through the process engine to process the data processing request includes obtaining the processing result of the data processing request and sending the processing result to the client. It should be noted that the processing result is not limited here. For example, it may include that the data processing request fails to be processed, is processed successfully, etc. The processing result of the data reading request includes the second data.
[0061] In one implementation, during the process of executing the data processing process through the process engine, it also includes obtaining the target resource capacity required by the data processing process and the current resource capacity allocated to the data processing process. If the current resource capacity is less than the target resource capacity, increase the current resource capacity to the target resource capacity. For example, obtain the difference between the target resource capacity and the current resource capacity as the first resource capacity, and allocate available resources to the data processing process according to the first resource capacity. It should be noted that the capacity of the allocated available resources is greater than or equal to the first resource capacity, and the available resources refer to the resources that have not been allocated to business processes.
[0062] Conversely, if the current resource capacity is greater than the target resource capacity, reduce the current resource capacity to the target resource capacity. For example, obtain the difference between the current resource capacity and the target resource capacity as the first resource capacity, and update the resources with the first resource capacity in the current resource capacity to available resources.
[0063] Thus, during the process of executing the data processing flow through the process engine, if the current resource capacity allocated by the data processing flow is inconsistent with the target resource capacity required by the data processing flow, the process engine can automatically adjust the current resource capacity, that is, the process engine can automatically scale the data processing flow up or down, improving resource utilization and helping to alleviate the problems of excessive server pressure and low processing efficiency of data processing requests during peak periods of data processing requests.
[0064] It should be noted that there are no excessive restrictions on resources. For example, it can include CPU (Central Processing Unit), memory, disk, etc.
[0065] In summary, according to the data processing method of the embodiments of the present application, receive a data processing request sent by a client, and send the data processing request to the process engine. Among them, the business process created based on the process engine includes a data processing process, and the data processing process includes at least one of data storage operations and data reading operations on a target database. Through the process engine, execute the data processing process to process the data processing request. Thus, the process engine can execute the data processing process to perform read and write operations on the database, that is, the process engine can convert the data processing request sent by the client into read and write operations on the database. Compared with the related art that directly processes the data processing request through the server, in the present application, the data processing request can be processed through the process engine, which can flexibly control the client's access to the data, improve the efficiency of data processing, and is applicable to the data processing scenario when a browser is built into the client.
[0066] Based on any of the above embodiments, as Figure 2 shown, through the process engine, execute the data storage process to process the data storage request, including:
[0067] S201, extract the first data to be stored and the identifier of the first data from the data storage request.
[0068] In the embodiments of the present application, the data storage request carries the first data and the identifier of the first data. For the relevant content of the first data and the identifier of the first data, reference can be made to the above embodiments, which will not be elaborated here.
[0069] S202, generate a first key-value pair based on the identifier of the first data and the first data, and store the first key-value pair in the target database.
[0070] It can be understood that any two of the identifier of the first data, the first data, and the first key-value pair correspond one-to-one.
[0071] It should be noted that taking the execution entity as the server as an example, the target database is deployed in the server. There are no excessive restrictions on the target database. For example, it can include a key-value database, a relational database, etc. Among them, the key-value database can include a Redis (Remote Dictionary Server) database. The Redis database has advantages such as high performance, supporting efficient read and write operations, and reliable data persistence, which helps to improve data processing performance.
[0072] In one implementation, based on the identifier of the first data and the first data, a first key-value pair is generated, including using the identifier of the first data as the key and the first data as the value to generate the first key-value pair.
[0073] In one implementation, through a process engine, a data storage process is executed to process a data storage request, including extracting the maximum storage duration of the first data from the data storage request. If the cumulative storage duration of the first data in the target database reaches the maximum storage duration, the first data is deleted from the target database. Thus, the automatic deletion of data with a relatively long cumulative storage duration can be achieved through the process engine, which helps to save the storage capacity of the target database.
[0074] In the embodiments of the present application, the data storage request carries the maximum storage duration, and the maximum storage duration can be set by the user himself or pre-configured.
[0075] For example, a user or an RPA system can enter or select the first data, the identifier of the first data, and the maximum storage duration on the page of the client. Correspondingly, the client can generate a data storage request based on the first data, the identifier of the first data, and the maximum storage duration, and send the data storage request to the server.
[0076] For example, a user or an RPA system can enter or select the first data and the identifier of the first data on the page of the client. Correspondingly, the client can use a pre-configured set value (such as 2 hours) as the maximum storage duration of the first data, and generate a data storage request based on the first data, the identifier of the first data, and the maximum storage duration, and send the data storage request to the server.
[0077] It can be understood that different first data can correspond to different maximum storage durations or the same maximum storage duration, and there are no excessive restrictions here.
[0078] Thus, in this method, the first data to be stored and the identifier of the first data are extracted from the data storage request, a first key-value pair is generated based on the identifier and the first data of the first data, and the first key-value pair is stored in the target database, which is applicable to the data storage scenario when the browser is built into the client.
[0079] Based on any of the above embodiments, as Figure 3 shown, the data reading process is executed through the process engine to process the data reading request, including:
[0080] S301, Extract the identifier of the second data to be read from the data reading request.
[0081] In the embodiments of the present application, the data reading request carries the identifier of the second data. For the relevant content of the identifier of the second data, reference can be made to the above embodiments and will not be elaborated here.
[0082] S302, Determine the second key-value pair in the target database with the identifier of the second data as the key, and use the value in the second key-value pair as the second data.
[0083] S303, Send the second data to the client.
[0084] It can be understood that any two of the identifier of the second data, the second data, and the second key-value pair correspond to each other one by one.
[0085] For example, the target database includes candidate key-value pairs (Key1, Value1), (Key2, Value2), and (Key3, Value3).
[0086] If the identifier of the second data is Key2, then (Key2, Value2) can be determined as the second key-value pair, and Value2 is used as the second data and sent to the client.
[0087] If the identifier of the second data is Key3, then (Key3, Value3) can be determined as the second key-value pair, and Value3 is used as the second data and sent to the client.
[0088] In one implementation, determining the second key-value pair in the target database with the identifier of the second data as the key includes comparing the key in the candidate key-value pairs in the target database with the identifier of the second data. If the key in the candidate key-value pair is consistent with the identifier of the second data, the candidate key-value pair is used as the second key-value pair.
[0089] Thus, in this method, the identifier of the second data to be read is extracted from the data read request, the second key-value pair with the identifier of the second data as the key in the target database is determined, and the value in the second key-value pair is used as the second data, which is sent to the client. This is applicable to the data read scenario when the client has a built-in browser.
[0090] Based on any of the above embodiments, as Figure 4 shown, in step S103, the process engine is used to execute a data processing process to process the data processing request, including:
[0091] S401, Extract the data identifier of the data to be processed from the data processing request.
[0092] In the embodiments of the present application, the data processing request carries the data identifier of the data to be processed. For the relevant content of the data identifier, refer to the above embodiments, which will not be elaborated here.
[0093] S402, Authenticate the data identifier.
[0094] It should be noted that authenticating the data identifier can be implemented by using any authentication method in the related technologies, which will not be elaborated here.
[0095] In one implementation, authenticating the data identifier includes identifying whether the data identifier conforms to the set rules. If the data identifier conforms to the set rules, it is determined that the data identifier passes the authentication. If the data identifier does not conform to the set rules, it is determined that the data identifier fails the authentication. Thus, the data identifier can be authenticated by identifying whether it conforms to the set rules. It should be noted that there are no excessive limitations on the set rules. For example, it can include data format, data arrangement order, etc.
[0096] In one implementation, authenticating the data identifier includes identifying whether the data identifier is in the identifier library. If the data identifier is in the identifier library, it indicates that the data identifier has been configured in the identifier library, and it is determined that the data identifier passes the authentication. If the data identifier is not in the identifier library, it indicates that the data identifier has not been configured in the identifier library, and it is determined that the data identifier fails the authentication. Thus, the data identifier can be authenticated by identifying whether it is in the identifier library.
[0097] It should be noted that the identifier library is used to store a large number of identifiers, and the identifier library can be pre-configured or dynamically updated.
[0098] In some examples, the identifier library is the database of the configuration platform. It should be noted that the configuration platform is at least used to manage the identifier library.
[0099] S403, If the data identifier passes the authentication, continue to execute the data processing process to process the data processing request.
[0100] S404, if the data identifier fails the authentication, stop executing the data processing process.
[0101] In the embodiments of the present application, if the data identifier passes the authentication, it indicates that the client has the permission to send a data processing request, and then continue to execute the data processing process to process the data processing request. On the contrary, if the data identifier fails the authentication, it indicates that the client does not have the permission to send a data processing request, and then stop executing the data processing process, that is, do not process the data processing request.
[0102] In one implementation, if the data identifier fails the authentication, send indication information to the client, where the indication information is used to indicate that the processing of the data processing request fails.
[0103] Thus, in this method, the data identifier of the data to be processed is extracted from the data processing request, and the data identifier is authenticated. If the data identifier passes the authentication, continue to execute the data processing process to process the data processing request. If the data identifier fails the authentication, stop executing the data processing process, that is, only process the data processing request when the data identifier passes the authentication, avoiding processing the data processing request when the data identifier fails the authentication, that is, when the client does not have the permission to send a data processing request, which can avoid data leakage in the target database and improve the security of data processing.
[0104] Corresponding to the data processing method provided in the above Figures 1 to 4 embodiment, the present application also provides a data processing device. Since the data processing device provided in the embodiments of the present application corresponds to the data processing method provided in the above Figures 1 to 4 embodiment, the implementation manners of the data processing method are also applicable to the data processing device provided in the embodiments of the present application, and will not be described in detail in the embodiments of the present application.
[0105] Figure 5 It is a schematic structural diagram of a data processing device according to an embodiment of the present application.
[0106] As Figure 5 shown, the data processing device 100 in the embodiments of the present application may include: a receiving module 110, a sending module 120, and a processing module 130.
[0107] The receiving module 110 is configured to receive a data processing request sent by the client;
[0108] The sending module 120 is configured to send the data processing request to a process engine, where a business process created based on the process engine includes a data processing process, and the data processing process includes at least one of data storage operations and data reading operations on a target database;
[0109] A processing module 130 is configured to execute the data processing process through the process engine to process the data processing request.
[0110] In an embodiment of the present application, during the process of executing the data processing process through the process engine, the processing module 130 is further configured to: obtain the target resource capacity required for the data processing process and the current resource capacity allocated to the data processing process; if the current resource capacity is less than the target resource capacity, increase the current resource capacity to the target resource capacity; if the current resource capacity is greater than the target resource capacity, reduce the current resource capacity to the target resource capacity.
[0111] In an embodiment of the present application, the processing module 130 is further configured to: if the data processing request is a data storage request, execute a data storage process through the process engine to process the data storage request, where the data storage process includes performing a data storage operation on the target database; if the data processing request is a data reading request, execute a data reading process through the process engine to process the data reading request, where the data reading process includes performing a data reading operation on the target database.
[0112] In an embodiment of the present application, the processing module 130 is further configured to: extract the first data to be stored and the identifier of the first data from the data storage request; generate a first key-value pair based on the identifier and the first data of the first data, and store the first key-value pair in the target database.
[0113] In an embodiment of the present application, the processing module 130 is further configured to: extract the maximum storage duration of the first data from the data storage request; if the cumulative storage duration of the first data in the target database reaches the maximum storage duration, delete the first data from the target database.
[0114] In an embodiment of the present application, the processing module 130 is further configured to: extract the identifier of the second data to be read from the data reading request; determine the second key-value pair with the identifier of the second data as the key in the target database, and use the value in the second key-value pair as the second data; send the second data to the client.
[0115] In one embodiment of the present application, the processing module 130 is further configured to: extract the data identifier of the data to be processed from the data processing request; authenticate the data identifier; if the data identifier passes the authentication, continue to execute the data processing process to process the data processing request; if the data identifier fails to pass the authentication, stop executing the data processing process.
[0116] In one embodiment of the present application, the processing module 130 is further configured to: identify whether the data identifier is in the identifier library; if the data identifier is in the identifier library, determine that the data identifier passes the authentication; if the data identifier is not in the identifier library, determine that the data identifier fails to pass the authentication.
[0117] In one embodiment of the present application, the data identifier is obtained by splicing the identifier of the client and the original identifier of the data to be processed.
[0118] The data processing device according to the embodiment of the present application receives a data processing request sent by a client and sends the data processing request to a process engine. Among them, the business process created based on the process engine includes a data processing process, and the data processing process includes at least one of a data storage operation and a data reading operation on a target database. Through the process engine, the data processing process is executed to process the data processing request. Thus, the data processing process can be executed through the process engine to perform read and write operations on the database, that is, the process engine can convert the data processing request sent by the client into read and write operations on the database. Compared with the related art in which the data processing request is directly processed by the server, in the present application, the data processing request can be processed through the process engine, which can flexibly control the client's access to data, improve the efficiency of data processing, and is applicable to the data processing scenario when the client has a built-in browser.
[0119] To implement the above embodiment, as Figure 6 shown, the present application also proposes an electronic device 200, including: a memory 210, a processor 220, and a computer program stored on the memory 210 and executable on the processor 220. When the processor 220 executes the program, it implements the data processing method proposed in the foregoing embodiments of the present application.
[0120] The electronic device according to the embodiment of the present application receives a data processing request sent by a client by executing a computer program stored in a memory by a processor, and sends the data processing request to a process engine. Among them, the business process created based on the process engine includes a data processing process, and the data processing process includes at least one of a data storage operation and a data reading operation on a target database. Through the process engine, the data processing process is executed to process the data processing request. Thus, the data processing process can be executed by the process engine to perform read and write operations on the database, that is, the process engine can convert the data processing request sent by the client into a read and write operation on the database. Compared with the related art in which the data processing request is directly processed by a server, in the present application, the data processing request can be processed by the process engine, which can flexibly control the client's access to data, improve the efficiency of data processing, and is applicable to the data processing scenario when a browser is built in the client.
[0121] To implement the above embodiment, the present application also proposes a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, it implements the data processing method proposed in the foregoing embodiment of the present application.
[0122] The computer-readable storage medium according to the embodiment of the present application receives a data processing request sent by a client by storing a computer program and executing it by a processor, and sends the data processing request to a process engine. Among them, the business process created based on the process engine includes a data processing process, and the data processing process includes at least one of a data storage operation and a data reading operation on a target database. Through the process engine, the data processing process is executed to process the data processing request. Thus, the data processing process can be executed by the process engine to perform read and write operations on the database, that is, the process engine can convert the data processing request sent by the client into a read and write operation on the database. Compared with the related art in which the data processing request is directly processed by a server, in the present application, the data processing request can be processed by the process engine, which can flexibly control the client's access to data, improve the efficiency of data processing, and is applicable to the data processing scenario when a browser is built in the client.
[0123] In the description of this specification, the descriptions referring to terms such as "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" etc. mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of this application. In this specification, the schematic expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in any one or more embodiments or examples in a suitable manner. In addition, without contradiction, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples.
[0124] In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include at least one of such features. In the description of this application, "a plurality of" means at least two, such as two, three, etc., unless otherwise specifically and clearly defined.
[0125] Any process or method description shown in a flowchart or described in other ways herein can be understood to represent a module, segment, or portion of code including one or more executable instructions for implementing a customized logic function or process, and the scope of the preferred embodiments of this application includes additional implementations, where the functions can be executed in a manner that is not in the order shown or discussed, including in a substantially simultaneous manner according to the functions involved or in a reverse order, which should be understood by those skilled in the art to which the embodiments of this application pertain.
[0126] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a definite sequence list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other systems that can fetch and execute instructions from the instruction execution system, apparatus, or device), or in conjunction with these instruction execution systems, apparatuses, or devices. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer-readable media include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer diskette (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium can even be paper or other suitable media on which the program can be printed, because the program can be obtained electronically, for example, by optically scanning the paper or other media, followed by editing, interpretation, or other suitable processing as necessary, and then stored in a computer memory.
[0127] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware, or a combination thereof. In the above-described embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or a combination of the following techniques well known in the art can be used: discrete logic circuits having logic gate circuits for implementing logical functions on data signals, application specific integrated circuits having appropriate combinational logic gate circuits, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), and the like.
[0128] Those of ordinary skill in the art of this technology can understand that all or part of the steps carried by the method of implementing the above embodiments can be completed by a program instructing relevant hardware, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiments.
[0129] In addition, each functional unit in various embodiments of the present application may be integrated into a processing module, may exist separately as individual physical units, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. When the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
[0130] The above-mentioned storage medium may be a read-only memory, a magnetic disk, an optical disc, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present application. Those of ordinary skill in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present application.
Claims
1. A data processing method, characterized in that, Including: Receiving a data processing request sent by a client; Sending the data processing request to a process engine, wherein a business process created based on the process engine includes a data processing process, and the data processing process includes at least one of a data storage operation and a data reading operation on a target database; Executing the data processing process through the process engine to process the data processing request.
2. The method according to claim 1, characterized in that, During the process of executing the data processing process through the process engine, it further includes: Obtaining the target resource capacity required by the data processing process and the current resource capacity allocated to the data processing process; If the current resource capacity is less than the target resource capacity, increasing the current resource capacity to the target resource capacity; If the current resource capacity is greater than the target resource capacity, reducing the current resource capacity to the target resource capacity.
3. The method according to claim 1, characterized in that, Executing the data processing process through the process engine to process the data processing request includes: If the data processing request is a data storage request, executing a data storage process through the process engine to process the data storage request, wherein the data storage process includes a data storage operation on the target database; If the data processing request is a data reading request, executing a data reading process through the process engine to process the data reading request, wherein the data reading process includes a data reading operation on the target database.
4. The method according to claim 3, characterized in that, Executing the data storage process through the process engine to process the data storage request includes: Extracting the first data to be stored and the identifier of the first data from the data storage request; Generating a first key-value pair based on the identifier of the first data and the first data, and storing the first key-value pair in the target database.
5. The method according to claim 4, characterized in that, Executing the data storage process through the process engine to process the data storage request includes: Extracting the maximum storage duration of the first data from the data storage request; If the cumulative storage duration of the first data in the target database reaches the maximum storage duration, deleting the first data from the target database.
6. The method according to claim 3, characterized in that, Executing the data reading process through the process engine to process the data reading request includes: Extracting the identifier of the second data to be read from the data reading request; Determining a second key-value pair in the target database with the identifier of the second data as the key, and using the value in the second key-value pair as the second data; Sending the second data to the client.
7. The method according to any one of claims 1 - 6, characterized in that, Executing the data processing process through the process engine to process the data processing request includes: Extracting the data identifier of the data to be processed from the data processing request; Authenticating the data identifier; If the data identifier passes the authentication, continuing to execute the data processing process to process the data processing request; If the data identifier fails to pass the authentication, stopping the execution of the data processing process.
8. The method according to claim 7, characterized in that, Authenticating the data identifier includes: Identify whether the data identifier is in the identifier library; If the data identifier is in the identifier library, determine that the data identifier passes authentication; If the data identifier is not in the identifier library, determine that the data identifier fails authentication.
9. The method according to claim 7, characterized in that, The data identifier is obtained by splicing the identifier of the client and the original identifier of the data to be processed.
10. A data processing device, characterized in that, It includes: A receiving module, configured to receive a data processing request sent by a client; A sending module, configured to send the data processing request to a process engine, wherein a service process created based on the process engine includes a data processing process, and the data processing process includes at least one of a data storage operation and a data reading operation on a target database; A processing module, configured to execute the data processing process through the process engine to process the data processing request.
11. An electronic device, characterized in that, It includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the data processing method according to any one of claims 1-9 is implemented.
12. A computer-readable storage medium, on which a computer program is stored, characterized in that, When the program is executed by the processor, the data processing method according to any one of claims 1-9 is implemented.