A method and system for asynchronously implementing hierarchical proxy data management

Abstract

The present invention provides a method and system for asynchronously implementing the data management of upper and lower-level agents. The method includes: Step 1, constructing an asynchronous analysis framework; Step 2, dividing the asynchronous analysis process based on the asynchronous analysis framework; Step 3, combining the divided asynchronous analysis process to create the project files required during the analysis process; Step 4, after completing the creation of the project files, packaging the constructed asynchronous analysis framework into a runnable program and placing it in the actual application project; Step 5, creating corresponding data tables according to the database type adopted during the actual application process; Step 6, adding adjustable ports in the project files according to the database type for the deployment of the project; Step 7, running the actual project after configuration to implement data management. The synchronous update of the upper and lower-level agent data is completed through the data management system, facilitating the unification of multiple lower-level agent data and greatly reducing the process of manual data processing.

Description

Technical Field

[0001] The present invention relates to a method and system for asynchronously implementing superior-subordinate proxy data management, and particularly relates to the technical field of data management. Background Art

[0002] With the rapid development of the Internet industry, traditional enterprises are constantly transforming towards e-commerce. In the era of explosive growth of electronic information, data management has gradually become more difficult.

[0003] In the prior art, in order to better manage information-based data in an overall manner, the concept of superior and subordinate is divided and cut into from multiple levels, and the effective management of electronic data is achieved by means of a well-structured management framework. However, the programming language used, the call order of processing processes, and the processing speed of asynchronously implementing data management often lead to low data management efficiency due to problems such as running speed and process deadlock. Summary of the Invention

[0004] Object of the Invention: To propose a method and system for asynchronously implementing superior-subordinate proxy data management to solve the above problems existing in the prior art.

[0005] Technical Solution: In the first aspect, a method for asynchronously implementing superior-subordinate proxy data management is proposed, which is characterized in that it specifically includes the following steps:

[0006] Step 1, construct an asynchronous analysis framework;

[0007] Step 2, divide the asynchronous analysis process based on the asynchronous analysis framework;

[0008] Step 3, combine the divided asynchronous analysis process to create project files required in the analysis process;

[0009] Step 4, after the project files are created, package the constructed asynchronous analysis framework into a runnable program and place it in an actual application project;

[0010] Step 5, create corresponding data tables according to the database type adopted during the actual application process;

[0011] Step 6, add adjustable ports in the project files according to the database type for project deployment;

[0012] Step 7, run the actual project after configuration to achieve data management.

[0013] In some realizable ways of the first aspect, during the process of constructing the asynchronous analysis framework in Step 1, it further includes the following steps:

[0014] Step 1.1: Create a folder to store model files, main running files, and configuration files;

[0015] Step 1.2: Write the mapping relationship in the actual project in the model file; the mapping relationship refers to the mapping relationship between the database data table structure and the asynchronous analysis framework;

[0016] Step 1.3: Pre-define the connection method with the database, the identification number of the superior proxy node, and the identification number of the current-level proxy node in the configuration file;

[0017] Step 1.4: Define an initialized asynchronous route A in the main running file, and this asynchronous route A also has a method for lower-level reporting; the parameter involved in the method for lower-level reporting is the number of the current-level proxy;

[0018] Step 1.5: Define an initialized asynchronous route B in the main running file, and this asynchronous route B also has a method for lower-level update; the parameter involved in the method for lower-level update is the address number of the current-level superior proxy;

[0019] Step 1.6: Define an initialized asynchronous route C in the main running file, and this asynchronous route C also has a method for first-level proxy approval; the method for first-level proxy approval is used to receive the data reported from the lower level of the current level and perform comparison, approval, and modification;

[0020] Step 1.7: Define an initialized asynchronous route D in the main running file, and this asynchronous route D also has a method for calling update after first-level proxy approval; the method for calling update after first-level proxy approval updates the data based on the approval data result of the asynchronous route D, and after the data is updated, sends the updated data to the lower-level proxy that reported it;

[0021] Step 1.8: Complete the construction of the asynchronous analysis framework and export it in a packaged form.

[0022] In the application process of the actual project, the process of project deployment is specifically as follows:

[0023] Step 4.1: Package the written development program into a runnable program and export it;

[0024] Step 4.2: Install the database according to the requirements and import the corresponding database language;

[0025] Step 4.3: Configure the corresponding configuration file on the nodes at each proxy level according to the type and requirements of the database;

[0026] Step 4.4: Realize the deployment and operation of the project by running the packaged main program.

[0027] In some realizable ways of the first aspect, when constructing an asynchronous analysis framework in step 1, program patches are added to the program composed of the development language, and corresponding database agents are created on each level of the involved servers.

[0028] In some realizable ways of the first aspect, by calling the methods constructed in the main running file, operations such as upper-level approval synchronization, lower-level report update, and lower-level manual update are performed.

[0029] In some realizable ways of the first aspect, through a friendly interaction interface, the user can complete the process of synchronizing and updating the upper and lower level proxy data according to the information prompt; the interaction interface includes: a navigation bar, a search box, and an information prompt pop-up window.

[0030] In the second aspect, a system for asynchronously implementing upper and lower level proxy data management is proposed, and the system specifically includes:

[0031] A framework construction module for constructing an asynchronous analysis framework;

[0032] A process division module for dividing the analysis process;

[0033] A file creation module for creating project files;

[0034] A program packaging module for packaging the program;

[0035] A data table construction module for creating data tables;

[0036] A deployment module for implementing project deployment.

[0037] In some realizable ways of the second aspect, in the process of implementing asynchronous upper and lower level proxy database management, the framework construction module first constructs an asynchronous analysis framework according to the requirements; based on the asynchronous analysis framework, the process division module divides the asynchronous analysis process; during the asynchronous analysis process, the file creation module combines the divided asynchronous analysis process to create the project files required during the analysis process; after the project files are created, the program packaging module packages the constructed asynchronous analysis framework into a runnable program and places it in the actual application project; subsequently, the data table construction module creates corresponding data tables according to the adopted database type during the actual application process, and combines with the deployment module to add adjustable ports to the project files according to the adopted database type for project deployment; after the configuration is completed, the actual project is run to achieve data management.

[0038] In the third aspect, an apparatus for asynchronously implementing upper and lower level proxy data management is proposed, and the apparatus includes: a processor and a memory storing computer program instructions; the processor reads and executes the computer program instructions to implement the data management method.

[0039] In a fourth aspect, a computer-readable storage medium is proposed, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, a data management method is implemented.

[0040] Beneficial effects: The present invention proposes a method and system for asynchronously implementing the data management of upper and lower-level agents. The synchronous update of the data of upper and lower-level agents is completed through the developed data management system. It is simple to use, greatly reduces the process of manual data processing, and provides the same degree of page friendliness; for large enterprises, asynchronously processing data to better implement the data management of upper and lower-level agents is also easier to find problems in data management, and it is also convenient for the unification of multiple lower-level agent data. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 It is a data processing flow chart of the present invention.

[0042] Figure 2 It is a flow chart for constructing the fastapi asynchronous framework of the present invention.

[0043] Figure 3 It is a project deployment flow chart of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0044] In the following description, a large number of specific details are given to provide a more thorough understanding of the present invention. However, it is obvious to those skilled in the art that the present invention can be implemented without one or more of these details. In other examples, in order to avoid confusion with the present invention, some well-known technical features in the art are not described.

[0045] The applicant believes that in the process of traditional enterprises developing into e-commerce enterprises, the effective management of electronic data has become one of the technical issues that cannot be ignored in the information age. With the rise of various programming languages, the Python language has a great advantage in data analysis and data management with the help of rich and powerful third-party libraries. However, in the actual application process, due to the slow running speed of Python, the performance of effectively managing data is often reduced. In order to overcome the existing problems, this application proposes a development mode of asynchronous processing, and creates corresponding database task planners and alarm managers on each level of the server by adding program patches, and at the same time divides the data processing levels of upper and lower levels to achieve the effective management of data.

[0046] Embodiment 1

[0047] In one embodiment, a method for asynchronously implementing the data management of upper and lower-level agents is proposed, as Figure 1 shown. The method specifically includes the following steps:

[0048] Step 1: Build an asynchronous analysis framework;

[0049] Step 2: Divide the asynchronous analysis process based on the asynchronous analysis framework;

[0050] Step 3: Combine the divided asynchronous analysis process and create the project files required in the analysis process;

[0051] Step 4: After the project file is created, package the built asynchronous analysis framework into an executable program and place it in the actual application project;

[0052] Step 5: Create corresponding data tables according to the database type used in the actual application process;

[0053] Step 6. Add adjustable ports in the project file for project deployment according to the database type used;

[0054] Step 7: After the configuration is completed, run the actual project to implement data management.

[0055] Embodiment 2

[0056] In a further embodiment based on the first embodiment, in the process of building an asynchronous analysis framework, the following steps are specifically included:

[0057] Step 1.1, create a folder for storing model files, running main files and configuration files;

[0058] Step 1.2: Write the mapping relationship in the actual project in the model file; the mapping relationship refers to the mapping relationship between the database data table structure and the asynchronous analysis framework;

[0059] Step 1.3, predefine the connection method with the database, the identification number of the upper-level proxy node, and the identification number of the current-level proxy node in the configuration file;

[0060] Step 1.4, define an initialized asynchronous router A in the running main file, and the asynchronous router A also has a method for subordinate reporting; the parameter involved in the method for subordinate reporting is the number of the current level agent;

[0061] Step 1.5, define an initialized asynchronous router B in the running main file, and the asynchronous router B also has a method for subordinate update; the parameter involved in the method for subordinate update is the address number of the superior agent at the current level;

[0062] Step 1.6: define an initialized asynchronous router C in the running main file, and the asynchronous router C also has a first-level proxy approval method; the first-level proxy approval method is used to receive data reported from the current level subordinate, and compare and approve the modification;

[0063] Step 1.7: Define an initialized asynchronous route D in the running main file. This asynchronous route D also has a method to call for update after the first-level agent approval. The method to call for update after the first-level agent approval performs data update based on the approval data result of the asynchronous route D, and after the data update is completed, the updated data is sent to the subordinate agents reported up.

[0064] Step 1.8: Complete the construction of the asynchronous analysis framework and export it in a packaged form.

[0065] In the preferred embodiment, with the rise of the Python language, the application frameworks based on it are constantly updated, such as the fastapi framework, the flask framework, and the Django framework, etc. This embodiment takes the fastapi framework as the basis of the asynchronous analysis framework. As Figure 2 shown, in the process of constructing the asynchronous analysis framework, it specifically includes the following steps:

[0066] Step 1.1: Create a new folder and create model.py, main.py, and config.ini files in it.

[0067] Step 1.2: Write the mapping relationship of the database mysql table structure for fastapi in the model.py file.

[0068] Step 1.3: Define the [mysql] database connection, [ip] the upper-level agent node ip and the local agent ip in the config.ini configuration file.

[0069] Step 1.4: Define an asynchronous route / init in main.py and make it have a method for subordinate reporting. The parameter in the method is the number of the local agent. Customize and initialize the ip parameters of the upper and lower agent nodes in the config.inil file according to your own needs and use them.

[0070] Step 1.5: Then define an asynchronous route / pull in main.py and make it have a method for subordinate update. The parameter in the method is the upper-level agent ip. Customize and initialize the ip parameters of the upper and lower agent nodes in the config.inil file according to your own needs and use them.

[0071] Step 1.6: Define an asynchronous route / approve in main.py again and make it have a method for first-level agent approval. The method can receive the data reported from the subordinates and perform comparison, approval, and modification.

[0072] Step 1.7: Finally, define an asynchronous route for / update in main.py and make it have a method to call the update after the first-level proxy approval is completed. In this method, update the data approved in / approve and distribute it to the subordinate proxies reported.

[0073] Step 1.8: Complete the construction of the asynchronous analysis framework and export it in a packaged form.

[0074] Compared with the existing technology that simply uses the Python development language, the data processing method in the asynchronous mode has increased the running speed by 60%, greatly shortening the running time.

[0075] Embodiment III

[0076] In a further embodiment based on Embodiment I, after completing the construction and export of the analysis framework, in the application process of the actual project, the project deployment process is as follows:

[0077] Step 4.1: Package the written development program into a runnable program and export it;

[0078] Step 4.2: Install the database according to the requirements and import the corresponding database language;

[0079] Step 4.3: Configure the corresponding configuration files on the nodes at each proxy level according to the type and requirements of the database;

[0080] Step 4.4: Realize the deployment and operation of the project by running the packaged main program.

[0081] In the preferred embodiment, with Python as the development language and mysql as the database, after building fastapi and introducing the project, it is also necessary to create the corresponding data tables in the corresponding msql database. Since fastapi will start with the default port number 8000, the adjustable port number can be freely added in [ip] in the configuration file for project deployment. As Figure 3 shown, the corresponding project deployment process is as follows:

[0082] Step 4.1: Package the written Python program into a runnable exe program and export it;

[0083] Step 4.2: Install the lightweight mysql service and import the corresponding sql file;

[0084] Step 4.3: Configure the corresponding config.ini configuration files on the nodes at each proxy level;

[0085] Step 4.4: Run the packaged main.exe program to realize the deployment and operation of the project.

[0086] As can be seen from the project deployment process provided in this embodiment, after the system is developed, all business logics are completely shielded. Users only need to follow the prompts to complete a series of processes for synchronizing and updating the data of the upper and lower-level agents, realizing the effective management of the data of the upper-level agent over the lower-level agent, and more quickly helping the enterprise in data-level management.

[0087] Embodiment 4

[0088] In a further embodiment based on Embodiment 1, in order to better implement the asynchronous method, program patches are added to the program, and corresponding database agents are created on each level of the involved servers. By dynamically replacing the originally unsupported functions in the program, it is convenient for the program to be called and the running efficiency of the program is improved.

[0089] In addition, through a friendly interaction interface, users can complete the process of synchronizing and updating the data of the upper and lower-level agents according to the information prompts; the interaction interface includes: a navigation bar, a search box, and an information prompt pop-up window.

[0090] Embodiment 5

[0091] In one embodiment, a system for asynchronously implementing the data management of upper and lower-level agents is proposed. The system specifically includes:

[0092] A framework construction module for constructing an asynchronous analysis framework;

[0093] A process division module for dividing the analysis process;

[0094] A file creation module for creating project files;

[0095] A program packaging module for packaging the program;

[0096] A data table construction module for creating data tables;

[0097] A deployment module for implementing project deployment.

[0098] In a further embodiment, in the process of implementing asynchronous upper and lower level proxy database management, the framework construction module first constructs an asynchronous analysis framework according to requirements; based on the asynchronous analysis framework, the process division module divides the asynchronous analysis process; during the asynchronous analysis process, the file creation module combines the divided asynchronous analysis process to create project files required during the analysis process; after the project files are created, the program packaging module packages the constructed asynchronous analysis framework into a runnable program and places it in the actual application project; subsequently, the data table construction module creates corresponding data tables according to the database type adopted during the actual application process, and combines with the deployment module to add adjustable ports to the project files according to the database type adopted for project deployment; after the configuration is completed, the actual project is run to achieve data management.

[0099] Embodiment Six

[0100] In one embodiment, an asynchronous upper and lower level proxy data management device is proposed, which includes: a processor and a memory storing computer program instructions; the processor reads and executes the computer program instructions to implement the data management method.

[0101] Embodiment Seven

[0102] In one embodiment, a computer-readable storage medium is proposed, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the data management method is implemented.

[0103] In summary, the present invention flexibly optimizes the identity between proxy level data through three steps of upper-level approval synchronization, lower-level report update, and lower-level manual update. Compared with the prior art, on the basis of using the fastap framework, by modifying the Python source code and adding a patch program, a 60% speed increase in the operation management database is achieved, that is, the framework is asynchronously speeded up by 60% to improve the database mysql data update, synchronization, and management of upper and lower level data respectively.

[0104] As described above, although the present invention has been shown and described with reference to specific preferred embodiments, it should not be construed as a limitation of the present invention itself. Various changes can be made in its form and details without departing from the spirit and scope of the present invention defined by the appended claims.

Claims

1. A method for asynchronously implementing hierarchical proxy data management, characterized in that Specifically, it includes the following steps: Step 1, construct an asynchronous analysis framework; Step 1.1, create a folder for storing model files, running main files, and configuration files; Step 1.2, write the mapping relationship in the actual project in the model file; the mapping relationship refers to the mapping relationship between the database data table structure and the asynchronous analysis framework; Step 1.3, pre-define the connection method with the database, the identification number of the superior proxy node, and the identification number of the current-level proxy node in the configuration file; Step 1.4, define an initialized asynchronous route A in the running main file, and this asynchronous route A also has a method for subordinate reporting; the parameters involved in the method for subordinate reporting are the numbers of the current-level agents; Step 1.5, define an initialized asynchronous route B in the running main file, and this asynchronous route B also has a method for subordinate update; the parameters involved in the method for subordinate update are the address numbers of the current-level superior agents; Step 1.6, define an initialized asynchronous route C in the running main file, and this asynchronous route C also has a method for first-level agent approval; the method for first-level agent approval is used to receive the data reported by the subordinates at the current level and perform comparison, approval, and modification; Step 1.7, define an initialized asynchronous route D in the running main file, and this asynchronous route D also has a method for calling update after the first-level agent approval; the method for calling update after the first-level agent approval performs data update based on the approval data result of the asynchronous route D, and after the data update is completed, the updated data is sent to the subordinate agents that reported it; Step 1.8, complete the construction of the asynchronous analysis framework and export it in a packaged form; Step 2, divide the asynchronous analysis process based on the asynchronous analysis framework; Step 3, combine the divided asynchronous analysis process and create the project files required in the analysis process; Step 4, after completing the creation of the project files, package the constructed asynchronous analysis framework into a runnable program and place it in the actual application project; Step 5, create corresponding data tables according to the database type adopted during the actual application process; Step 6, add adjustable ports in the project files according to the database type for the deployment of the project; Step 7, run the actual project after configuration to achieve data management.

2. The method for asynchronously implementing the management of superior and subordinate proxy data according to claim 1, wherein, During the application process of the actual project, the process of project deployment is specifically as follows: Step 4.1, package the written development program into a runnable program and export it; Step 4.2, install the database according to the requirements and import the corresponding database language; Step 4.3, configure the corresponding configuration files on the nodes at each agent level according to the database type and requirements; Step 4.4, realize the deployment and operation of the project by running the packaged main program.

3. The method for asynchronously implementing the management of superior and subordinate proxy data according to claim 1, characterized in that When constructing the asynchronous analysis framework in Step 1, add program patches to the program composed of the development language, and create corresponding database agents on the servers involved at each level.

4. A method for asynchronously implementing data management between upper and lower-level agents according to claim 1, characterized in that By calling the methods constructed in the main file, the operations of upper-level approval synchronization, lower-level report update, and lower-level manual update are carried out.

5. The method for asynchronously implementing upper and lower level proxy data management according to claim 1, characterized in that Through a friendly interaction interface, users can complete the process of upper and lower level proxy data synchronization and update according to the information prompts; The interaction interface includes: a navigation bar, a search box, and an information prompt pop-up window.

6. A system for asynchronously implementing the management of superior-subordinate proxy data, which is used to implement the method for asynchronously implementing the management of superior-subordinate proxy data according to any one of claims 1 to 5, characterized in that, Specifically, it includes: A framework construction module for constructing an asynchronous analysis framework; A process division module for dividing the analysis process; A file creation module for creating project files; A program packaging module for packaging programs; A data table construction module for creating data tables; A deployment module for implementing project deployment.

7. The system for asynchronously implementing upper and lower level proxy data management according to claim 6, characterized in that In the process of implementing asynchronous upper and lower level proxy database management, the framework construction module first constructs an asynchronous analysis framework according to requirements; based on the asynchronous analysis framework, the process division module divides the asynchronous analysis process; during the asynchronous analysis process, the file creation module combines the divided asynchronous analysis process to create the project files required during the analysis process; After the project files are created, the program packaging module packages the constructed asynchronous analysis framework into a runnable program and places it in the actual application project; subsequently, the data table construction module creates corresponding data tables according to the database type used during the actual application process, and combines with the deployment module to add adjustable ports to the project files according to the database type used for project deployment; after the configuration is completed, the actual project is run to achieve data management.

8. An asynchronous implementation of a superior-subordinate proxy data management device, characterized in that, The device includes: A processor and a memory storing computer program instructions; The processor reads and executes the computer program instructions to implement the method for asynchronously implementing upper and lower level proxy data management according to any one of claims 1 to 5.

9. A computer-readable storage medium, characterized in that, Computer program instructions are stored on the computer-readable storage medium, and when the computer program instructions are executed by the processor, the method for asynchronously implementing upper and lower level proxy data management according to any one of claims 1 to 5 is implemented.

Images