Production data downloading method and system

By working together with the data security download platform and the process management platform, the production data download process is automated, which solves the problems of data leakage and non-standard processes caused by manual operation in the banking system, and improves the automation rate and security.

CN119449790AActive Publication Date: 2025-02-14CHINA CONSTRUCTION BANK
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202411466515.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-21
Publication Date
2025-02-14
Estimated Expiration
2044-10-21

AI Technical Summary

Technical Problem

In the bank's technical operation indicator evaluation system, the existing production data acquisition process involves a large amount of manual operation, resulting in a high risk of data leakage, non-standard processes, and low automation rate.

Method used

The data download work order and download plan compressed package are obtained through the data security download platform. The process management platform parses and checks the data, executes the script files in a preset order, and finally uploads the production data to the data distribution center, reducing manual intervention.

Benefits of technology

It automates the download of production data, reduces manual data handling, prevents data leaks, and improves the standardization and automation rate of processes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119449790A_ABST
    Figure CN119449790A_ABST
Patent Text Reader

Abstract

The invention provides a production data downloading method and system, which is applied to the technical field of data processing, and comprises the following steps: a data security downloading platform obtains a data downloading work order and a downloading scheme compression package of the data downloading work order, and sends the downloading scheme compression package to a process management platform, the process management platform checks the downloading scheme compressed package based on the configuration file in the downloading scheme compressed package to obtain a check conclusion; when the check conclusion represents that the check is passed, executing the script files in sequence based on a script execution sequence, and obtaining production data of the target host after the script files are successfully executed in sequence; and the process management platform feeds back the production data to the data security downloading platform, and the data security downloading platform uploads the production data to a data distribution place, so that business personnel corresponding to the data downloading work order download the production data from the data distribution place. Therefore, manual participation is reduced, workers are prevented from making direct contact with data, and data leakage is avoided.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a production data downloading method and system. Background Art

[0002] In the bank's technical operation indicator evaluation system, it is necessary to obtain the production data of various mainframes in the bank, conduct in-depth mining or analysis of the production data, and make corresponding evaluations.

[0003] Currently, when obtaining production data, it is usually necessary to manually extract the production data from the database. After the production data is extracted, it needs to be manually uploaded to the data distribution center. The entire process requires manual processing. The processing staff can directly access sensitive data in the production data, which poses a risk of data leakage. Summary of the invention

[0004] In view of this, an embodiment of the present application provides a production data downloading method and system. The method provided in the present application is applied to realize the automation of production data downloading, reduce manual participation, thereby avoiding data leakage and providing data security.

[0005] To achieve the above objectives, the embodiments of the present invention provide the following technical solutions:

[0006] A production data downloading method, comprising:

[0007] The data security download platform obtains the data download work order, obtains the download solution compressed package corresponding to the data download work order, and sends the download solution compressed package to the process management platform;

[0008] The process management platform sends the compressed package of the download solution to the destination host, and parses the compressed package of the download solution on the destination host to obtain the configuration file and various script files in the compressed package of the download solution;

[0009] The process management platform checks the downloaded solution compressed package based on the configuration file to obtain a check conclusion; when the check conclusion indicates that the check is passed, each of the script files is executed in sequence based on a preset script execution order, and after each of the script files is successfully executed in sequence, the production data of the destination host is obtained;

[0010] The process management platform feeds back the production data to the data security download platform, so that the data security download platform uploads the production data to a preset data distribution center, and the business personnel corresponding to the data download work order download the production data from the data distribution center.

[0011] In the above method, optionally, the data security download platform obtains the data download work order, including:

[0012] The data security download platform receives the approved data download work order sent by the operation and maintenance monitoring system through the flow interface.

[0013] In the above method, optionally, obtaining a compressed download solution package corresponding to the data download work order includes:

[0014] Obtain work information of each project team;

[0015] Analyze the work information of each project group to obtain various evaluation information of each project group;

[0016] Determine a target project group based on various evaluation information of each project group, and send the data download work order to the target project group;

[0017] Receive a download solution compression package corresponding to the data download work order fed back by the target project team.

[0018] In the above method, optionally, the process management platform sends the compressed package of the download solution to the destination host, including:

[0019] Parsing the data downloading work order to obtain host information in the data downloading work order;

[0020] A host corresponding to the host information is determined as a destination host, and the download solution compressed package is sent to the destination host.

[0021] In the above method, optionally, the process management platform checks each script file in the compressed package of the downloaded solution based on the configuration file to obtain a check conclusion, including:

[0022] The process management platform determines each inspection item from the configuration file;

[0023] Checking the downloaded solution compressed package based on each of the check items and each of the script files to obtain a check result for each of the check items;

[0024] When each of the inspection results is characterized as inspection passed, an inspection conclusion characterized as inspection passed is obtained;

[0025] When there is an inspection result characterized as inspection failure, an inspection conclusion characterized as inspection failure is obtained.

[0026] A production data downloading system, comprising:

[0027] Operation and maintenance monitoring system, data security download platform, process management platform and data distribution center;

[0028] The operation and maintenance monitoring system is used to receive data download work orders submitted by business personnel, assign the data download work orders to auditors, obtain data download work orders that have passed the auditors’ review, and send the reviewed data download work orders to the data security download platform;

[0029] The data security download platform is used to receive a data download work order sent by the operation and maintenance monitoring system through a flow interface, obtain a download solution compressed package corresponding to the data download work order, and send the download solution compressed package to the process management platform;

[0030] The process management platform is used to send the compressed package of the download solution to the destination host, and parse the compressed package of the download solution on the destination host to obtain the configuration file and each script file in the compressed package of the download solution; check the compressed package of the download solution based on the configuration file to obtain the inspection conclusion; when the inspection conclusion is characterized as inspection passed, execute each script file in sequence based on a preset script execution order, and after each script file is successfully executed in sequence, obtain the production data of the destination host, and feed back the production data to the data security download platform;

[0031] The data distribution center is used to receive the production data uploaded by the data security download platform, and send a data download reminder to the business personnel, so that the business personnel download the generated data based on the data download reminder.

[0032] In the above system, optionally, the data security download platform executes a process of obtaining a download solution compression package corresponding to the data download work order, including:

[0033] Obtain work information of each project team;

[0034] Analyze the work information of each project group to obtain various evaluation information of each project group;

[0035] Determine a target project group based on various evaluation information of each project group, and send the data download work order to the target project group;

[0036] Receive a download solution compression package corresponding to the data download work order fed back by the target project team.

[0037] In the above system, optionally, the process of the process management platform sending the compressed package of the download solution to the destination host includes:

[0038] Parsing the data downloading work order to obtain host information in the data downloading work order;

[0039] A host corresponding to the host information is determined as a destination host, and the download solution compressed package is sent to the destination host.

[0040] In the above system, optionally, the process management platform performs a process of checking the downloaded solution compressed package based on the configuration file to obtain a check conclusion, including:

[0041] The process management platform determines each inspection item from the configuration file;

[0042] Checking the downloaded solution compressed package based on each of the check items and each of the script files to obtain a check result for each of the check items;

[0043] When each of the inspection results is characterized as inspection passed, an inspection conclusion characterized as inspection passed is obtained;

[0044] When there is an inspection result characterized as inspection failure, an inspection conclusion characterized as inspection failure is obtained.

[0045] The above system may optionally further include: when the inspection conclusion indicates that the inspection has failed, the process management platform feeds back the inspection conclusion to the data security download platform, so that the data security download platform reminds the target project team to adjust the download solution compression package.

[0046] Compared with the prior art, this application has the following advantages:

[0047] The present application provides a production data download method and system, including: a data security download platform obtains a data download work order and a download solution compression package corresponding to the data download work order, sends the download solution compression package to a process management platform, so that the process management platform sends the download solution compression package to the destination host for parsing, checks the download solution compression package based on the configuration file in the download solution compression package, and obtains an inspection conclusion; when the inspection conclusion is characterized as inspection passed, executes each script file in sequence based on a preset script execution order, and obtains the production data of the destination host after each script file is successfully executed in sequence; the process management platform feeds back the production data to the data security download platform, and the data security download platform uploads the production data to a data distribution center, so that the business personnel corresponding to the data download work order download the production data from the data distribution center. Thus, the degree of manual participation is reduced, the staff is prevented from directly contacting the data, and data leakage is avoided. This application uses the configuration file in the download solution compressed package of the data download work order to check each script file in the download solution compressed package. When the check passes, each script file is executed in sequence according to the preset script execution order, so that production data can be obtained, thereby standardizing and normalizing the data acquisition process. In the process of data acquisition, there is no need for communication and confirmation among multiple parties, simplifying the data acquisition process, ensuring the security of the data acquisition process, and ensuring the security of the generated data. The entire process of obtaining production data reduces manual participation and improves the automation rate of the data acquisition process. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0049] Figure 1 A structural diagram of a production data downloading system provided in an embodiment of the present application;

[0050] Figure 2 A flowchart of obtaining a compressed download solution package corresponding to a data download work order provided in an embodiment of the present application;

[0051] Figure 3 A flowchart of checking each script file in the compressed package of the downloaded solution based on the configuration file provided in the embodiment of the present application to obtain the inspection conclusion;

[0052] Figure 4 This is an example diagram of the scenario structure of the production data download system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0053] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0054] In this application, the terms "comprises", "comprising" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element.

[0055] In the technical operation index evaluation system of the bank, when obtaining the production data in the bank, the current data extraction process has a large amount of manual data extraction. After the extracted data is generated, the operation and maintenance personnel need to manually download it and forward it to the data distribution center. During this period, the operation and maintenance personnel directly contact the sensitive information of the customer, which poses the risk of data leakage. In addition, the existing data extraction process is not standardized enough. Multiple related systems need to communicate and confirm repeatedly for one data extraction. The data extraction plan can be modified at will before it is finally executed by the front-line operation. There is a lack of auditing, and it is difficult to ensure the security of production data. In the traditional solution, the operation and maintenance personnel manually input commands during the production change process. Even with double review, there is still a risk of modifying the operation command and obtaining other production data. In addition to the above problems, in the work quality evaluation of the system, the automation rate is an important indicator for measuring the quality of the change. Because all traditional production data extraction / modification tasks are transferred to the front line in the form of work orders, OA letters, etc., and are completed in the form of manual operations through standard changes, the operation is frequent, and the number of work orders is large, resulting in a low change automation rate.

[0056] In order to solve the above problems, the present application provides a production data downloading solution, in which the data security downloading platform obtains the data downloading work order and the downloading solution compressed package corresponding to the data downloading work order, sends the downloading solution compressed package to the process management platform, so that the process management platform sends the downloading solution compressed package to the destination host for parsing, checks the downloading solution compressed package based on the configuration file in the downloading solution compressed package, and obtains the inspection conclusion; when the inspection conclusion is characterized as passing the inspection, each script file is executed in sequence based on the preset script execution order, and after each script file is successfully executed in sequence, the production data of the destination host is obtained; the process management platform feeds back the production data to the data security downloading platform, and the data security downloading platform uploads the production data to the data distribution center, so that the business personnel corresponding to the data downloading work order download the production data from the data distribution center. Thus, the degree of manual participation is reduced, the staff is prevented from directly contacting the data, and data leakage is avoided. In addition, this application uses the configuration file in the download solution compressed package of the data download work order to check each script file in the download solution compressed package. When the check is passed, each script file is executed in sequence according to the preset script execution order, so that production data can be obtained, thereby standardizing and normalizing the data acquisition process. In the process of data acquisition, there is no need for communication and confirmation between multiple parties, simplifying the data acquisition process, ensuring the security of the data acquisition process, and ensuring the security of the generated data. The entire process of obtaining production data reduces manual participation and improves the automation rate of the data acquisition process.

[0057] The production data downloading method provided in the present application can be implemented through a production data downloading system. The production data downloading system as a whole is composed of a large number of general or special computing devices during its construction.

[0058] Reference Figure 1 , is a structural diagram of a production data download system provided in an embodiment of the present application, and is specifically described as follows:

[0059] The production data download system includes an operation and maintenance monitoring system 101 , a data security download platform 102 , a process management platform 103 and a data distribution center 104 .

[0060] The operation and maintenance monitoring system 101 is used to receive data download work orders submitted by business personnel, assign the data download work orders to auditors, obtain the data download work orders that have passed the auditors' review, and send the reviewed data download work orders to the data security download platform 102 .

[0061] The business personnel can use the PC to submit a data download work order to the operation and maintenance monitoring system. The data download work order contains the work order ID, the identity information of the uploading business personnel, the production data required by the business personnel, etc. The preferred data download work order can be an Excel spreadsheet.

[0062] After receiving the data download work order, the operation and maintenance monitoring system assigns the data download work order to the auditor for review. The auditor reviews the data download work order. The review content includes but is not limited to whether the data format in the data download work order is correct and whether the data download work order lacks necessary data. By reviewing the data download work order, the subsequent processing of unqualified data download work orders can be avoided, thereby improving the effective processing of the system.

[0063] The data security download platform 102 is used to receive the data download work order sent by the operation and maintenance monitoring system 101 through the flow interface, obtain the download solution compressed package corresponding to the data download work order, and send the download solution compressed package to the process management platform 103.

[0064] This flow interface is used to specifically receive data download work orders.

[0065] Reference Figure 2 , which is a flowchart of obtaining a download solution compressed package corresponding to a data download work order provided in an embodiment of the present application, and is specifically described as follows:

[0066] S201. Obtain work information of each project team.

[0067] The project team is used to write a change plan based on the data download work order. Furthermore, the change plan is the data extraction plan corresponding to the data download work order.

[0068] Preferably, the project team includes at least one staff member, and the work information of the project team includes the various tasks for which the project team is responsible, the identification code of each task for which the project team is responsible, the progress of each task, the urgency of each task, the attendance status of each staff member in the project team, the workload saturation assessment of each staff member in the project team, and other contents.

[0069] S202: Analyze the work information of each project team to obtain various evaluation information of each project team.

[0070] Preferably, each item of evaluation information includes but is not limited to the various tasks that the project team is responsible for, the identification code of each task that the project team is responsible for, the progress of each task, the urgency of each task, the attendance status of each staff member in the project team, the workload saturation evaluation of each staff member in the project team, etc.

[0071] S203: Determine a target project group based on various evaluation information of each project group, and send a data download work order to the target project group.

[0072] Preferably, based on various evaluation information of each project group, a matching score between each project group and the data download work order is determined, and the project group with the highest matching score is determined as the target project group.

[0073] For each project group, determine the evaluation score of each evaluation information, and then sum up the evaluation scores of each evaluation information to obtain the matching score of the project group; when determining the evaluation score of each evaluation information, score can be made based on the evaluation rules of each evaluation information. The evaluation rules can be configured according to actual needs and will not be elaborated here.

[0074] For example, when there are fewer people present in the project team, the corresponding score is low; the higher the urgency of each task, the lower the corresponding score; the closer the progress of each task is to completion, the higher the corresponding score; no examples are given here.

[0075] After determining the target project group, send the data download work order to the target project group.

[0076] The purpose of using the matching score to determine the target project group is to assign the data download work order to the project group with spare capacity to handle it. In this way, work can be reasonably allocated to each project group, and the download solution compression package of the data download work order can be obtained in time, avoiding the backlog of pending work in each project group and improving the efficiency of users in obtaining production data.

[0077] S204: Receive a compressed download solution package corresponding to the data download work order fed back by the target project team.

[0078] After receiving the data download work order, the target project team compiles a download plan compression package corresponding to the data download work order. After the compilation is completed, the data download compression package is uploaded to the data security download platform.

[0079] This application allocates data download work orders to project teams, which can reasonably allocate the work to be processed to each project team, avoid the backlog of work that a certain project team needs to process, improve the work efficiency of each project team, and reduce the work pressure of each project team.

[0080] The process management platform 103 is used to send the compressed package of the downloaded solution to the destination host, and parse the compressed package of the downloaded solution on the destination host to obtain the configuration file and each script file in the compressed package of the downloaded solution; based on the configuration file, the compressed package of the downloaded solution is checked to obtain the inspection conclusion; when the inspection conclusion is characterized as passed, each script file is executed in sequence based on the preset script execution order, and after each script file is successfully executed in sequence, the production data of the destination host is obtained, and the production data is fed back to the data security download platform.

[0081] The process management platform receives the compressed package of the download solution sent by the data security download platform, parses the data download work order, obtains the host information in the data download work order, determines the host corresponding to the host information as the destination host, and sends the compressed package of the download solution to the destination host.

[0082] By parsing the data download work order, the host information provided by the business personnel is determined, and the host information includes but is not limited to the host identification code, host ID, host model, etc.

[0083] After the process management platform sends the downloaded solution compressed package to the destination host, the process management platform parses the downloaded solution compressed package to obtain the configuration file and various script files. After obtaining the configuration file, the downloaded solution compressed package needs to be checked based on the configuration file.

[0084] Preferably, the script file may be a script written in code, or a SQL statement file.

[0085] Reference Figure 3 , which is a flowchart of checking each script file in the compressed package of the downloaded solution based on the configuration file provided in the embodiment of the present application to obtain the inspection conclusion, and the specific description is as follows:

[0086] S301. Determine each inspection item from a configuration file.

[0087] Parse the configuration file to obtain each check item in the configuration file.

[0088] Exemplarily, each check item includes, but is not limited to, checking whether all files in the compressed package of the download solution are complete, whether the format is correct, whether the permissions are sufficient, etc. Preferably, it can also include: checking whether the directory to which the results are written exists, if not, create the directory; checking whether the directory space is empty, if not, delete all files under the directory; checking whether the directory space is sufficient, etc.

[0089] S302: Check the downloaded solution compressed package based on each check item and each script file to obtain a check result for each check item.

[0090] S303, judging whether there is an inspection result indicating that the inspection has not been passed, and when there is no inspection result indicating that the inspection has not been passed, executing S304; when there is an inspection result indicating that the inspection has not been passed, executing S305.

[0091] S304: Obtain an inspection conclusion indicating that the inspection has passed.

[0092] S305: Obtain an inspection conclusion indicating that the inspection has failed.

[0093] By parsing the configuration file, various check items are obtained. Based on each check item, the download solution compressed package is checked to determine whether the download solution compressed package is qualified. When the download solution compressed package is unqualified, the execution of subsequent content is stopped. This can effectively reduce the system's invalid processing operations, effectively reduce the system's processing volume, and improve the system's effective working rate.

[0094] When the downloaded solution compression package passes the inspection, each script file is executed in sequence based on the preset script execution order, so that production data can be extracted from the destination host.

[0095] Preferably, when the inspection conclusion is characterized as inspection failure, the process management platform feeds back the inspection conclusion to the data security download platform, so that the data security download platform reminds the target project team to adjust the download solution compression package, so as to correct the download solution compression package, and then feeds back the adjusted download solution compression package to the data security download platform to continue the subsequent process, thereby ensuring that the process management platform uses a problem-free download solution compression package, thereby obtaining the correct production data.

[0096] Production data includes but is not limited to bank card numbers, bank statements, bills, customer information, and many other information and data required by various departments and lines within the bank. Production data can be financial data related to financial business in the banking system.

[0097] The various script files include but are not limited to EXEC scripts, CHECK scripts, CLEAN scripts, and the like.

[0098] Exemplarily, the EXEC script is executed first, then the CHECK script is executed, and finally the CLEAN script is executed.

[0099] After obtaining the production data, upload the production data to the data distribution center.

[0100] The data distribution center 104 is used to receive the production data uploaded by the data security download platform 102 and send a data download reminder to the business personnel so that the business personnel can download the generated data based on the data download reminder.

[0101] In the solution provided by the embodiment of the present application, the data security download platform obtains the data download work order and the download solution compressed package corresponding to the data download work order, sends the download solution compressed package to the process management platform, so that the process management platform sends the download solution compressed package to the destination host for parsing, checks the download solution compressed package based on the configuration file in the download solution compressed package, and obtains the inspection conclusion; when the inspection conclusion is characterized as inspection passed, each script file is executed in sequence based on the preset script execution order, and after each script file is successfully executed in sequence, the production data of the destination host is obtained; the process management platform feeds back the production data to the data security download platform, and the data security download platform uploads the production data to the data distribution center, so that the business personnel corresponding to the data download work order download the production data from the data distribution center. In this way, the degree of manual participation is reduced, the staff is prevented from directly contacting the data, and data leakage is avoided. In addition, this application uses the configuration file in the download solution compressed package of the data download work order to check each script file in the download solution compressed package. When the check is passed, each script file is executed in sequence according to the preset script execution order, so that production data can be obtained, thereby standardizing and normalizing the data acquisition process. In the process of data acquisition, there is no need for communication and confirmation between multiple parties, simplifying the data acquisition process, ensuring the security of the data acquisition process, and ensuring the security of the generated data. The entire process of obtaining production data reduces manual participation and improves the automation rate of the data acquisition process.

[0102] Reference Figure 4 , which is an example diagram of the scenario structure of the production data downloading system provided in an embodiment of the present application, and the specific description is as follows.

[0103] As shown in the figure, the business personnel submit a data download work order to the operation and maintenance monitoring system. It should be noted that the operation and maintenance monitoring system can include the ITM system. After receiving the data download work order sent by the business personnel, the operation and maintenance monitoring system sends the data download work order to the auditor for review. After the data download work order is reviewed and approved, the data download work order is uploaded to the data security download platform.

[0104] The data security download platform determines the target project group and assigns the data download work order to the target project group, so that the target project writes a compressed package of the download solution for the data download work order. Preferably, the data security download platform parses the compressed package of the download solution to obtain the configuration file and each script file. Preferably, the data security download platform can also decompress, encode and verify, repackage and compress the script file, and then send it to the process management platform. Preferably, the data security download platform also provides a one-click solution acquisition function; automatically pushes the compressed package of the download solution to the Automation orchestration platform through NFT; calls the Automation platform interface for message notification, such as notifying the process management platform that the download solution has been sent, and receiving production data fed back by the process management platform through the Automation platform interface.

[0105] The process management platform sends the downloaded solution compressed package to the destination host, where the downloaded compressed package is parsed and checked. When the check passes, each script file is executed in sequence to extract the production data in the destination host.

[0106] Furthermore, the process management platform adds standard changes for access to automated orchestration, mainly by applying for the release of change service orchestration through the agile delivery platform, and then accessing this orchestration through service requests to generate a standard change template. The change template here is to achieve unified management of automated scripts, ensure the safety of script operation, and realize automated execution of scripts.

[0107] An automated operation and maintenance system (N-AOP) is set up in the process management platform. The automated operation and maintenance system provides an interface for the data acquisition platform to call. The compressed download package pushed by the data security download platform is stored in the designated data acquisition directory. It also provides Automation orchestration function to facilitate the 4-step orchestration of data acquisition. After the orchestration, the production data can be obtained.

[0108] The present invention optimizes and transforms the manual operation of data acquisition. The present application completes the process of automated data acquisition through an automated arrangement platform, which is specifically divided into 4 steps for arrangement, mainly including scheme acquisition, distribution and general inspection-data download-data inspection after downloading-cleaning after downloading. The first is to issue files: all kinds of files required for the automated data acquisition process are packaged and uploaded by the project team and pushed to its database by the automation platform. The purpose of this step is to issue the corresponding compressed package in the automation platform database to the specified directory of the target host. The second step is to parse the file: after the file is successfully issued in the previous step, the compressed package of the download scheme required for this data acquisition should exist in the specified directory of the target host. The purpose of this step is to parse the configuration file in the compressed package of the downloaded scheme, and check whether the files inside the compressed package of the downloaded scheme are complete, the format is correct, and the permissions are sufficient according to the configuration file; after all the inspection items are met, various scripts, sql and other script files are moved to the specified location and wait for execution according to the requirements of the configuration file. If any of the pre-checks fail, the arrangement execution is terminated and the corresponding error is output. The third step is to execute the script file: after the previous step is checked and confirmed that the script can be executed, the script is executed in sequence. The first script to be executed is the EXEC script. This script is for executing the data acquisition script. The orchestration will return the script execution result. If the return value is 0, it means the execution is successful and go to the next step. If the return value is not 0, it means the script execution fails. The execution result is output and the orchestration is terminated. After the EXEC script is successfully executed, the CHECK script is executed. This script is to check whether the data is generated normally. The orchestration will return the script execution result. If the return value is 0, it means the check is successful and go to the next step. If the return value is not 0, it means the script execution fails. The execution result is output and the orchestration is terminated. After the CHECK script is successfully executed, the CLEAN script is executed. This script is to clean up the intermediate files and logs (excluding those generated by the orchestration) generated by the project team during this data acquisition. The orchestration will return the script execution result. If the return value is 0, it means the cleanup is successful and go to the next step. If the return value is not 0, it means the script execution fails. The execution result is output and the orchestration is terminated. The fourth step is the cleaning stage: when the automated orchestration is executed, some directories and logs are established to facilitate execution and obtain execution information. These directories and logs will be cleaned up when the orchestration execution ends or fails. If the orchestration is terminated at any stage of the pre-processing, or after the orchestration is executed normally, the orchestration will trigger the automatic cleanup mechanism to delete the relevant directories and logs created by the orchestration. After the cleanup is successful, the corresponding directory will not exist on the target host, or there will be only one "cleanup successful" log in the corresponding directory.

[0109] This application provides an automated production data download solution. By automating manual changes such as production data download, replacing manual login to SOM and manual command execution, human errors can be avoided, efficiency can be improved, and the success rate of changes can be guaranteed. This application is based on an automated tool platform and orchestration function to achieve automated changes in production data extraction and improve the automation rate of data retrieval, thereby greatly reducing human errors and ensuring the success rate.

[0110] The present application provides relevant example descriptions of a production data downloading system implementing a production data downloading method. The relevant descriptions of the production data downloading method can refer to the above descriptions and will not be repeated here.

[0111] Although the present invention depicts operations in a particular order, this should not be understood as requiring that the operations be performed in the particular order shown or in a sequential order.Multitasking and parallel processing may be advantageous under certain circumstances.

[0112] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0113] An embodiment of the present invention further provides a storage medium, which includes stored instructions, wherein when the instructions are executed, the device where the storage medium is located is controlled to execute the above-mentioned production data downloading method.

[0114] It should be noted that the information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards in the relevant regions.

[0115] The specific implementation processes and derivative methods of the above-mentioned embodiments are all within the protection scope of the present invention.

[0116] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can refer to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system or system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can refer to the partial description of the method embodiment. The system and system embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without creative work.

[0117] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0118] The above description of the disclosed embodiments enables one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for downloading production data, characterized in that: include: The data security download platform obtains the data download work order, obtains the download solution compressed package corresponding to the data download work order, and sends the download solution compressed package to the process management platform; The process management platform sends the compressed package of the download solution to the destination host, and parses the compressed package of the download solution on the destination host to obtain the configuration file and various script files in the compressed package of the download solution; The process management platform checks the downloaded solution compressed package based on the configuration file to obtain a check conclusion; when the check conclusion indicates that the check is passed, each of the script files is executed in sequence based on a preset script execution order, and after each of the script files is successfully executed in sequence, the production data of the destination host is obtained; The process management platform feeds back the production data to the data security download platform, so that the data security download platform uploads the production data to a preset data distribution center, and the business personnel corresponding to the data download work order download the production data from the data distribution center.

2. The method according to claim 1, characterized in that The data security download platform obtains the data download work order, including: The data security download platform receives the approved data download work order sent by the operation and maintenance monitoring system through the flow interface.

3. The method according to claim 1, characterized in that The step of obtaining a download solution compressed package corresponding to the data download work order includes: Obtain work information of each project team; Analyze the work information of each project group to obtain various evaluation information of each project group; Determine a target project group based on various evaluation information of each project group, and send the data download work order to the target project group; Receive a download solution compression package corresponding to the data download work order fed back by the target project team.

4. The method according to claim 1, characterized in that The process management platform sends the compressed package of the download solution to the destination host, including: Parsing the data downloading work order to obtain host information in the data downloading work order; A host corresponding to the host information is determined as a destination host, and the download solution compressed package is sent to the destination host.

5. The method according to claim 1, characterized in that The process management platform checks the downloaded solution compression package based on the configuration file and obtains a check conclusion, including: The process management platform determines each inspection item from the configuration file; Checking the downloaded solution compressed package based on each of the check items and each of the script files to obtain a check result for each of the check items; When each of the inspection results is characterized as inspection passed, an inspection conclusion characterized as inspection passed is obtained; When there is an inspection result characterized as inspection failure, an inspection conclusion characterized as inspection failure is obtained.

6. A production data download system, characterized in that: include: Operation and maintenance monitoring system, data security download platform, process management platform and data distribution center; The operation and maintenance monitoring system is used to receive data download work orders submitted by business personnel, assign the data download work orders to auditors, obtain data download work orders that have passed the auditors’ review, and send the reviewed data download work orders to the data security download platform; The data security download platform is used to receive a data download work order sent by the operation and maintenance monitoring system through a flow interface, obtain a download solution compressed package corresponding to the data download work order, and send the download solution compressed package to the process management platform; The process management platform is used to send the compressed package of the download solution to the destination host, and parse the compressed package of the download solution on the destination host to obtain the configuration file and various script files in the compressed package of the download solution; The downloaded scheme compressed package is checked based on the configuration file to obtain a check conclusion; when the check conclusion indicates that the check is passed, each of the script files is executed in sequence based on a preset script execution order, and after each of the script files is successfully executed in sequence, the production data of the destination host is obtained, and the production data is fed back to the data security download platform; The data distribution center is used to receive the production data uploaded by the data security download platform, and send a data download reminder to the business personnel, so that the business personnel download the generated data based on the data download reminder.

7. The system according to claim 6, characterized in that The data security download platform executes a process of obtaining a download solution compressed package corresponding to the data download work order, including: Obtain work information of each project team; Analyze the work information of each project group to obtain various evaluation information of each project group; Determine a target project group based on various evaluation information of each project group, and send the data download work order to the target project group; Receive a download solution compression package corresponding to the data download work order fed back by the target project team.

8. The system according to claim 6, characterized in that The process of the process management platform sending the compressed package of the download solution to the destination host includes: Parsing the data downloading work order to obtain host information in the data downloading work order; A host corresponding to the host information is determined as a destination host, and the download solution compressed package is sent to the destination host.

9. The system according to claim 6, characterized in that The process management platform performs a check on the downloaded solution compression package based on the configuration file to obtain a check conclusion, including: The process management platform determines each inspection item from the configuration file; Checking the downloaded solution compressed package based on each of the check items and each of the script files to obtain a check result for each of the check items; When each of the inspection results is characterized as inspection passed, an inspection conclusion characterized as inspection passed is obtained; When there is an inspection result characterized as inspection failure, an inspection conclusion characterized as inspection failure is obtained.

10. The system according to claim 9, characterized in that Also includes: When the inspection conclusion indicates that the inspection has not passed, the process management platform feeds back the inspection conclusion to the data security download platform, so that the data security download platform reminds the target project team to adjust the download solution compression package.

Citation Information

Patent Citations

  • Networked data collaborative submission and statistical system and method based on workflow

    CN103942722A

  • Background database configuration based data downloading method and system

    CN106020944A

  • Data acquisition method and device

    CN111475505A

  • Enterprise data warehouse management method and platform

    CN111695881A

  • WEB application configuration detection method and device, storage medium and computer equipment

    CN113448640A