A method and system for production data download

Through the collaborative work of the data security download platform and the process management platform, the automated download of production data is achieved, solving the data leakage risks and process non-standardization problems caused by manual operations, and improving the security and automation rate of data acquisition.

CN119449790BActive Publication Date: 2025-10-10CHINA CONSTRUCTION BANK
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411466515.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-10-21
Publication Date
2025-10-10
Estimated Expiration
2044-10-21

AI Technical Summary

Technical Problem

In the bank's technical operation indicator evaluation system, there are a lot of manual operations in the existing production data acquisition process, which leads to data leakage risks, non-standardized data acquisition processes, and low automation rates.

Method used

The data download work order and download solution compressed package are obtained through the data security download platform. The process management platform parses and checks the compressed package and executes the script file in the preset order to realize the automated download and standardized process of production data.

Benefits of technology

It reduces manual participation, avoids data leakage, simplifies the data collection process, and improves the security and automation rate of the data collection process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119449790B_ABST
    Figure CN119449790B_ABST
Patent Text Reader

Abstract

The application provides a production data download method and system, applied to the technical field of data processing, comprising: a data security download platform acquires a data download work order and a download scheme compressed package of the data download work order, sends the download scheme compressed package to a process management platform, the process management platform checks the download scheme compressed package based on a configuration file in the download scheme compressed package, and obtains a checking conclusion; when the checking conclusion represents that the checking is passed, each script file is executed in turn based on a script execution sequence, and after the execution of each script file is successful in turn, production data of a target host is obtained; the process management platform feeds back the production data to the data security download platform, and the data security download platform uploads the production data to a data collection and distribution site, so that a business personnel corresponding to the data download work order downloads the production data from the data collection and distribution site. Thus, the manual participation degree is reduced, the staff directly contacts the data is avoided, and data leakage is avoided.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a production data downloading method and system. Background Art

[0002] In the bank's technical operation indicator evaluation system, it is necessary to obtain the production data of various mainframes in the bank, conduct in-depth mining or analysis of the production data, and make corresponding evaluations.

[0003] Currently, when obtaining production data, it is usually necessary to manually extract the production data from the database. After the production data is extracted, it needs to be manually uploaded to the data distribution center. The entire process requires manual processing. The processing staff can directly access sensitive data in the production data, which poses a risk of data leakage. Summary of the Invention

[0004] In view of this, an embodiment of the present application provides a production data downloading method and system. By applying the method provided in this application, the production data downloading can be automated, manual participation can be reduced, thereby avoiding data leakage and providing data security.

[0005] To achieve the above objectives, the embodiments of the present invention provide the following technical solutions:

[0006] A production data downloading method, comprising:

[0007] The data security download platform obtains a data download work order, obtains a download solution compressed package corresponding to the data download work order, and sends the download solution compressed package to the process management platform;

[0008] The process management platform sends the downloaded solution compressed package to the destination host, and parses the downloaded solution compressed package on the destination host to obtain the configuration file and various script files in the downloaded solution compressed package;

[0009] The process management platform checks the downloaded solution compressed package based on the configuration file to obtain a check conclusion; when the check conclusion indicates that the check has passed, each of the script files is executed in sequence based on a preset script execution order, and after each of the script files is successfully executed in sequence, the production data of the destination host is obtained;

[0010] The process management platform feeds back the production data to the data security download platform, so that the data security download platform uploads the production data to a preset data distribution center, and the business personnel corresponding to the data download work order download the production data from the data distribution center.

[0011] In the above method, optionally, the data security download platform obtains a data download work order, including:

[0012] The data security download platform receives the approved data download work order sent by the operation and maintenance monitoring system through the flow interface.

[0013] Optionally, in the above method, obtaining the compressed download solution package corresponding to the data download work order includes:

[0014] Obtain work information of each project team;

[0015] Analyze the work information of each project team to obtain various evaluation information of each project team;

[0016] Determine a target project group based on the evaluation information of each project group, and send the data download work order to the target project group;

[0017] Receive a download solution compressed package corresponding to the data download work order fed back by the target project team.

[0018] In the above method, optionally, the process management platform sends the compressed package of the download solution to the destination host, including:

[0019] Parsing the data download work order to obtain host information in the data download work order;

[0020] The host corresponding to the host information is determined as the destination host, and the download solution compressed package is sent to the destination host.

[0021] In the above method, optionally, the process management platform checks each script file in the downloaded solution compressed package based on the configuration file to obtain a check conclusion, including:

[0022] The process management platform determines each inspection item from the configuration file;

[0023] Checking the downloaded solution compressed package based on each of the check items and each of the script files to obtain a check result for each of the check items;

[0024] When each of the inspection results is characterized as inspection passed, an inspection conclusion characterized as inspection passed is obtained;

[0025] When there is an inspection result characterized as inspection failure, an inspection conclusion characterized as inspection failure is obtained.

[0026] A production data downloading system, comprising:

[0027] Operation and maintenance monitoring system, data security download platform, process management platform and data distribution center;

[0028] The operation and maintenance monitoring system is used to receive data download work orders submitted by business personnel, assign the data download work orders to auditors, obtain data download work orders that have passed the auditors' review, and send the reviewed data download work orders to the data security download platform;

[0029] The data security download platform is used to receive a data download work order sent by the operation and maintenance monitoring system through a flow interface, obtain a download solution compressed package corresponding to the data download work order, and send the download solution compressed package to the process management platform;

[0030] The process management platform is configured to send the compressed package of the downloaded solution to a destination host, parse the compressed package of the downloaded solution on the destination host, obtain the configuration file and various script files in the compressed package of the downloaded solution; inspect the compressed package of the downloaded solution based on the configuration file to obtain an inspection conclusion; and when the inspection conclusion indicates that the inspection has passed, execute each of the script files in sequence based on a preset script execution order. After each of the script files has been successfully executed in sequence, obtain the production data of the destination host, and feed the production data back to the data security download platform;

[0031] The data distribution center is used to receive the production data uploaded by the data security download platform and send a data download reminder to the business personnel, so that the business personnel download the generated data based on the data download reminder.

[0032] In the above system, optionally, the data security download platform executes a process of obtaining a compressed download solution package corresponding to the data download work order, including:

[0033] Obtain work information of each project team;

[0034] Analyze the work information of each project team to obtain various evaluation information of each project team;

[0035] Determine a target project group based on the evaluation information of each project group, and send the data download work order to the target project group;

[0036] Receive a download solution compressed package corresponding to the data download work order fed back by the target project team.

[0037] In the above system, optionally, the process of the process management platform sending the compressed package of the download solution to the destination host includes:

[0038] Parsing the data download work order to obtain host information in the data download work order;

[0039] The host corresponding to the host information is determined as the destination host, and the download solution compressed package is sent to the destination host.

[0040] In the above system, optionally, the process management platform performs a process of checking the downloaded solution compressed package based on the configuration file to obtain a check conclusion, including:

[0041] The process management platform determines each inspection item from the configuration file;

[0042] Checking the downloaded solution compressed package based on each of the check items and each of the script files to obtain a check result for each of the check items;

[0043] When each of the inspection results is characterized as inspection passed, an inspection conclusion characterized as inspection passed is obtained;

[0044] When there is an inspection result characterized as inspection failure, an inspection conclusion characterized as inspection failure is obtained.

[0045] The above system may optionally further include: when the inspection conclusion indicates that the inspection has failed, the process management platform feeds back the inspection conclusion to the data security download platform, so that the data security download platform reminds the target project team to adjust the downloaded solution compression package.

[0046] Compared with the prior art, this application has the following advantages:

[0047] The present application provides a production data download method and system, including: a data security download platform obtains a data download work order and a download solution compressed package corresponding to the data download work order, sends the download solution compressed package to a process management platform, so that the process management platform sends the download solution compressed package to a destination host for parsing, checks the download solution compressed package based on a configuration file in the download solution compressed package, and obtains an inspection conclusion; when the inspection conclusion is characterized as inspection passed, executes each script file in sequence based on a preset script execution order, and obtains the production data of the destination host after each script file is successfully executed in sequence; the process management platform feeds back the production data to the data security download platform, and the data security download platform uploads the production data to a data distribution center, so that the business personnel corresponding to the data download work order download the production data from the data distribution center. In this way, manual participation is reduced, staff are prevented from directly contacting data, and data leakage is avoided. This application uses the configuration file in the download solution compressed package of the data download work order to check each script file in the download solution compressed package. When the check passes, each script file is executed in sequence according to the preset script execution order, so that production data can be obtained. This standardizes the data acquisition process and eliminates the need for communication and confirmation between multiple parties during the data acquisition process, thus simplifying the data acquisition process, ensuring the security of the data acquisition process, and ensuring the security of the generated data. The entire process of obtaining production data reduces manual participation and improves the automation rate of the data acquisition process. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are merely embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0049] Figure 1 A schematic diagram of the structure of a production data download system provided in an embodiment of the present application;

[0050] Figure 2 A flowchart of obtaining a compressed download solution package corresponding to a data download work order provided in an embodiment of the present application;

[0051] Figure 3 A flowchart of checking each script file in the downloaded solution compressed package based on the configuration file provided in the embodiment of the present application to obtain the inspection conclusion;

[0052] Figure 4 This is an example diagram of the scenario structure of the production data download system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0053] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0054] In this application, the terms "comprises," "comprising," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.

[0055] In the bank's technical operations indicator evaluation system, the current data extraction process involves extensive manual data extraction. Once the extracted data is generated, operations personnel must manually download and forward it to a data distribution center. During this process, operations personnel come into direct contact with sensitive customer information, posing a risk of data leakage. Furthermore, the existing data extraction process is insufficiently standardized, requiring repeated communication and confirmation across multiple related systems. Data extraction plans can be modified arbitrarily before final execution by frontline operations, lacking auditing and making it difficult to ensure the security of production data. In traditional solutions, operations personnel manually input commands during production changes. Even with double-checking, there is still the risk of modifying commands and accessing other production data. In addition to these issues, automation rate is a key indicator of change quality in system work quality assessments. Traditionally, all production data extraction / modification tasks are transferred to the frontline via work orders, OA memos, and other manual processes through standard changes. This results in frequent operations and a large number of work orders, resulting in a low automation rate.

[0056] In order to solve the above-mentioned problems, the present application provides a production data download solution, in which a data security download platform obtains a data download work order and a download solution compressed package corresponding to the data download work order, and sends the download solution compressed package to a process management platform, so that the process management platform sends the download solution compressed package to the destination host for parsing, and checks the download solution compressed package based on the configuration file in the download solution compressed package to obtain an inspection conclusion; when the inspection conclusion is characterized as inspection passed, each script file is executed in sequence based on a preset script execution order, and after each script file is successfully executed in sequence, the production data of the destination host is obtained; the process management platform feeds back the production data to the data security download platform, and the data security download platform uploads the production data to a data distribution center, so that the business personnel corresponding to the data download work order download the production data from the data distribution center. In this way, manual participation is reduced, staff are prevented from directly contacting data, and data leakage is avoided. In addition, this application uses the configuration file in the download solution compressed package of the data download work order to check each script file in the download solution compressed package. When the check passes, each script file is executed in sequence according to the preset script execution order, so that production data can be obtained. This standardizes the data acquisition process, eliminates the need for communication and confirmation between multiple parties during the data acquisition process, simplifies the data acquisition process, ensures the security of the data acquisition process, and ensures the security of the generated data. The entire process of obtaining production data reduces manual participation and improves the automation rate of the data acquisition process.

[0057] The production data downloading method provided in the present application can be implemented through a production data downloading system. The production data downloading system as a whole is composed of a plurality of general or special computing devices.

[0058] Reference Figure 1 , is a structural diagram of a production data download system provided in an embodiment of the present application, and is specifically described as follows:

[0059] The production data download system includes an operation and maintenance monitoring system 101 , a data security download platform 102 , a process management platform 103 and a data distribution center 104 .

[0060] The operation and maintenance monitoring system 101 is used to receive data download work orders submitted by business personnel, assign the data download work orders to auditors, obtain data download work orders that have passed the auditors' review, and send the reviewed data download work orders to the data security download platform 102.

[0061] Business personnel can use a PC to submit a data download work order to the operation and maintenance monitoring system. The data download work order contains the work order ID, the identity information of the uploading business personnel, the production data required by the business personnel, etc. The data download work order can preferably be in an Excel spreadsheet.

[0062] After receiving the data download work order, the operation and maintenance monitoring system assigns the data download work order to an auditor for review. The auditor reviews the data download work order. The review content includes but is not limited to whether the data format in the data download work order is correct and whether the data download work order lacks necessary data. By reviewing the data download work order, the subsequent processing of unqualified data download work orders can be avoided, thereby improving the effective processing of the system.

[0063] The data security download platform 102 is used to receive the data download work order sent by the operation and maintenance monitoring system 101 through the flow interface, obtain the download solution compressed package corresponding to the data download work order, and send the download solution compressed package to the process management platform 103.

[0064] This flow interface is used to specifically receive data download work orders.

[0065] Reference Figure 2 , which is a flowchart of obtaining a compressed download solution package corresponding to a data download work order provided in an embodiment of the present application, is specifically described as follows:

[0066] S201. Obtain work information of each project team.

[0067] The project team is used to write a change plan based on the data download work order. Furthermore, the change plan is the data extraction plan corresponding to the data download work order.

[0068] Preferably, the project team includes at least one staff member, and the work information of the project team includes the various tasks for which the project team is responsible, the identification code of each task for which the project team is responsible, the progress of each task, the urgency of each task, the attendance status of each staff member in the project team, the workload saturation assessment of each staff member in the project team, and other contents.

[0069] S202: Analyze the work information of each project team to obtain various evaluation information of each project team.

[0070] Preferably, the various evaluation information includes but is not limited to the various tasks that the project team is responsible for, the identification code of each task that the project team is responsible for, the progress of each task, the urgency of each task, the attendance status of each staff member in the project team, the workload saturation evaluation of each staff member in the project team, etc.

[0071] S203: Determine a target project group based on various evaluation information of each project group, and send a data download work order to the target project group.

[0072] Preferably, based on various evaluation information of each project group, a matching score between each project group and the data download work order is determined, and the project group with the highest matching score is determined as the target project group.

[0073] For each project group, determine the evaluation score of each evaluation information, and then sum up the evaluation scores of each evaluation information to obtain the matching score of the project group; when determining the evaluation score of each evaluation system information, score can be performed based on the evaluation rules of each evaluation information. The evaluation rules can be configured according to actual needs and will not be elaborated here.

[0074] For example, when there are fewer people present in the project team, the corresponding score is low; the higher the urgency of each task, the lower the corresponding score; the closer the progress of each task is to completion, the higher the corresponding score; no examples are given here.

[0075] After determining the target project group, send the data download work order to the target project group.

[0076] The purpose of using the matching score to determine the target project group is to assign the data download work order to the project group with spare capacity to handle it. In this way, work can be reasonably allocated to each project group, and the download solution compressed package of the data download work order can be obtained in a timely manner, avoiding the backlog of pending work in each project group and improving the efficiency of users in obtaining production data.

[0077] S204: Receive the download solution compressed package corresponding to the data download work order fed back by the target project team.

[0078] After receiving the data download work order, the target project team writes a download plan compression package corresponding to the data download work order. After writing is completed, the data download compression package is uploaded to the data security download platform.

[0079] This application assigns data download work orders to project teams, which can reasonably allocate the work to be processed by each project team, avoiding backlogs of work that needs to be processed by a project team. It improves the work efficiency of each project team and reduces the work pressure of each project team.

[0080] The process management platform 103 is used to send the downloaded solution compressed package to the destination host, and parse the downloaded solution compressed package on the destination host to obtain the configuration file and various script files in the downloaded solution compressed package; based on the configuration file, the downloaded solution compressed package is checked to obtain the inspection conclusion; when the inspection conclusion is characterized as passed, each script file is executed in sequence based on the preset script execution order. After each script file is successfully executed in sequence, the production data of the destination host is obtained, and the production data is fed back to the data security download platform.

[0081] The process management platform receives the compressed package of the download solution sent by the data security download platform, parses the data download work order, obtains the host information in the data download work order, determines the host corresponding to the host information as the destination host, and sends the compressed package of the download solution to the destination host.

[0082] By parsing the data download work order, the host information provided by the business personnel is determined. The host information includes but is not limited to the host identification code, host ID, host model, etc.

[0083] After the process management platform sends the downloaded solution compressed package to the destination host, the process management platform parses the downloaded solution compressed package to obtain the configuration file and various script files. After obtaining the configuration file, the downloaded solution compressed package needs to be checked based on the configuration file.

[0084] Preferably, the script file can be a script written in code, or a SQL statement file.

[0085] Reference Figure 3 , which is a flowchart of checking each script file in the downloaded solution compressed package based on the configuration file provided in the embodiment of the present application to obtain the inspection conclusion, and is specifically described as follows:

[0086] S301: Determine each inspection item from the configuration file.

[0087] Parse the configuration file to obtain the various check items in the configuration file.

[0088] Exemplarily, each check item includes but is not limited to checking whether all files in the compressed package of the downloaded solution are complete, whether the format is correct, whether the permissions are sufficient, etc. Preferably, it can also include: checking whether the directory where the results are written exists, if not, please create the directory; check whether the directory space is empty, if not, please delete all files under the directory; check whether the directory space is sufficient, etc.

[0089] S302: Check the downloaded solution compressed package based on each check item and each script file to obtain a check result for each check item.

[0090] S303: Determine whether there is an inspection result indicating that the inspection has failed. If there is no inspection result indicating that the inspection has failed, execute S304; if there is an inspection result indicating that the inspection has failed, execute S305.

[0091] S304: Obtain an inspection conclusion indicating that the inspection has passed.

[0092] S305: Obtain an inspection conclusion indicating that the inspection has failed.

[0093] By parsing the configuration file, various check items are obtained. Based on each check item, the download solution compressed package is checked to determine whether the download solution compressed package is qualified. When the download solution compressed package is unqualified, the execution of subsequent content is stopped. This can effectively reduce the system's invalid processing operations, effectively reduce the system's processing volume, and improve the system's effective working rate.

[0094] When the downloaded solution compression package passes the inspection, each script file is executed in sequence based on the preset script execution order, so that production data can be extracted from the destination host.

[0095] Preferably, when the inspection conclusion is characterized as failure to pass the inspection, the process management platform feeds back the inspection conclusion to the data security download platform, so that the data security download platform reminds the target project team to adjust the download solution compression package so as to correct the download solution compression package, and then feeds back the adjusted download solution compression package to the data security download platform again to continue the subsequent process, thereby ensuring that the process management platform uses a problem-free download solution compression package, thereby obtaining correct production data.

[0096] Production data includes, but is not limited to, bank card numbers, bank statements, bills, customer information, and many other pieces of information required by various departments and lines within the bank. Production data can be financial data related to financial operations within the banking system.

[0097] The script files include but are not limited to EXEC scripts, CHECK scripts, CLEAN scripts, etc.

[0098] For example, the EXEC script is executed first, then the CHECK script is executed, and finally the CLEAN script is executed.

[0099] After obtaining the production data, upload the production data to the data distribution center.

[0100] The data distribution center 104 is used to receive the production data uploaded by the data security download platform 102 and send data download reminders to business personnel, so that the business personnel can download the generated data based on the data download reminders.

[0101] In the solution provided by the embodiment of the present application, the data security download platform obtains a data download work order and a compressed download solution package corresponding to the data download work order, and sends the compressed download solution package to the process management platform, so that the process management platform parses the compressed download solution package after sending it to the destination host, and checks the compressed download solution package based on the configuration file in the compressed download solution package to obtain an inspection conclusion; when the inspection conclusion is characterized as passing the inspection, each script file is executed in sequence based on a preset script execution order, and after each script file is successfully executed in sequence, the production data of the destination host is obtained; the process management platform feeds back the production data to the data security download platform, and the data security download platform uploads the production data to a data distribution center, so that the business personnel corresponding to the data download work order download the production data from the data distribution center. In this way, manual participation is reduced, staff are prevented from directly contacting data, and data leakage is avoided. In addition, this application uses the configuration file in the download solution compressed package of the data download work order to check each script file in the download solution compressed package. When the check passes, each script file is executed in sequence according to the preset script execution order, so that production data can be obtained. This standardizes the data acquisition process, eliminates the need for communication and confirmation between multiple parties during the data acquisition process, simplifies the data acquisition process, ensures the security of the data acquisition process, and ensures the security of the generated data. The entire process of obtaining production data reduces manual participation and improves the automation rate of the data acquisition process.

[0102] Reference Figure 4 , which is an example diagram of the scenario structure of the production data download system provided in an embodiment of the present application, and the specific description is as follows.

[0103] As shown in the figure, a business operator submits a data download work order to the operations and maintenance monitoring system. Note that the operations and maintenance monitoring system can include the ITM system. Upon receiving the data download work order from the business operator, the operations and maintenance monitoring system sends the work order to an auditor for review. Upon approval, the work order is uploaded to the secure data download platform.

[0104] The data security download platform determines the target project group and assigns the data download work order to the target project group, so that the target project writes a compressed package of the download solution for the data download work order. Preferably, the data security download platform parses the compressed package of the download solution to obtain the configuration file and each script file. Preferably, the data security download platform can also decompress, encode and verify the script file, and then package and compress it, and then send it to the process management platform. Preferably, the data security download platform also provides a one-click solution acquisition function; automatically pushes the compressed package of the download solution to the Automation orchestration platform through NFT; calls the Automation platform interface for message notification, such as notifying the process management platform that the download solution has been sent, and receiving production data fed back by the process management platform through the Automation platform interface.

[0105] The process management platform sends the downloaded solution compressed package to the destination host, where the downloaded compressed package is parsed and checked. When the check passes, each script file is executed in sequence to extract the production data from the destination host.

[0106] Furthermore, the process management platform has added a new standard change for accessing automated orchestration. This is mainly done by applying for the release of change service orchestration through the agile delivery platform, and then accessing this orchestration through service requests to generate a standard change template. The change template here is used to achieve unified management of automated scripts, ensure the safe operation of scripts, and realize automated execution of scripts.

[0107] An automated operation and maintenance system (N-AOP) is set up in the process management platform. The automated operation and maintenance system provides an interface for the data retrieval platform to call; the compressed download solution package pushed by the data security download platform is stored in a designated data retrieval directory; and the Automation orchestration function is provided to facilitate the four-step orchestration of data retrieval. After the orchestration, production data can be obtained.

[0108] The present invention optimizes and transforms the manual data acquisition process. This application uses an automated orchestration platform to complete the automated data acquisition process, specifically divided into four steps for orchestration, including solution acquisition, distribution, and general checks - data download - post-download data checks - and post-download cleanup. The first step is file distribution: All files required for the automated data acquisition process are packaged and uploaded by the project team and pushed to the automation platform's database. This step aims to distribute the corresponding compressed packages in the automation platform's database to a designated directory on the target host. The second step is file parsing: After the file is successfully distributed in the previous step, the target host's designated directory should contain the downloaded solution compressed package required for this data acquisition. This step aims to parse the configuration file within the downloaded solution compressed package and check, based on the configuration file, whether all files within the downloaded solution compressed package are complete, correctly formatted, and have sufficient permissions. Once all checks are met, various scripts, SQL, and other script files are moved to a designated location according to the configuration file requirements and await execution. If any of the pre-set checks fail, the orchestration execution is terminated and a corresponding error message is output. The third step is script file execution: After the previous step has completed the checks and confirmed that the script can be executed, the script is executed in sequence. The EXEC script executes first. This script executes the data acquisition script. The orchestration returns the script execution result. If the return value is 0, the execution is successful and the next step is taken. A non-zero return value indicates failure, the execution result is output, and the orchestration is terminated. After successful EXEC execution, the CHECK script begins execution. This script checks whether the data is generated correctly. The orchestration returns the script execution result. If the return value is 0, the check is successful and the next step is taken. A non-zero return value indicates failure, the execution result is output, and the orchestration is terminated. After successful CHECK execution, the CLEAN script begins execution. This script cleans up the intermediate files and logs generated by the project team during the data acquisition (excluding those generated by the orchestration). The orchestration returns the script execution result. If the return value is 0, the cleanup is successful and the next step is taken. A non-zero return value indicates failure, the execution result is output, and the orchestration is terminated. The fourth step is the cleanup phase: During the automated orchestration execution, several directories and logs are created to facilitate execution and obtain execution information. These directories and logs are cleaned up at the end of the orchestration execution or upon failure. If orchestration is aborted at any stage, or after it completes successfully, the orchestration triggers an automatic cleanup mechanism to delete the directories and logs created by the orchestration. After a successful cleanup, the corresponding directory will no longer exist on the target host, or only a "cleanup successful" log will exist.

[0109] This application provides an automated production data download solution. By automating manual changes such as production data downloads, replacing manual logins and command execution, this solution can avoid human errors, improve efficiency, and ensure the success rate of changes. Based on the automation tool platform and orchestration functions, this application realizes automated changes in production data extraction, improves the automation rate of data retrieval, thereby greatly reducing human errors and ensuring the success rate.

[0110] This application provides relevant example descriptions of a production data downloading system to implement a production data downloading method. The relevant descriptions of the production data downloading method can refer to the above descriptions and will not be repeated here.

[0111] Although the present invention depicts operations in a particular order, this should not be understood as requiring that the operations be performed in the particular order shown or in a sequential order. Multitasking and parallel processing may be advantageous under certain circumstances.

[0112] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0113] An embodiment of the present invention further provides a storage medium, which includes stored instructions, wherein when the instructions are executed, the device where the storage medium is located is controlled to execute the above-mentioned production data downloading method.

[0114] It should be noted that the information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of the relevant regions.

[0115] The specific implementation processes and derivative methods of the above embodiments are all within the protection scope of the present invention.

[0116] The various embodiments described in this specification are described in progressive order of complexity, from the simplest embodiment to more complex embodiments. Identify commonalities in the various embodiments so that the disclosure is not redundant. Each embodiment is directed to the differences between that embodiment and the other embodiments. In particular, the system or system embodiments are described more simply because they are substantially similar to the method embodiments. The system or system embodiments are described with reference to the method embodiments. The systems and system embodiments described above are merely illustrative of the principles of this application. Any feature described in relation to one example can be used in relation to another example. The system and system embodiments described above are merely illustrative of the principles of this application. The units described as separate units can or can not be physically separate and the units shown as separate units can or can not be physical units, i.e. can be located at one place or distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the embodiments. Those skilled in the art can understand and implement without creative labor.

[0117] Those skilled in the art will further appreciate that the units and algorithm steps of the examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or any combination thereof. To clearly illustrate the interchangeability of hardware and software, the elements of the examples have been described generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the particular application and design constraints imposed on the overall system. Those skilled in the art can implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

[0118] The above description of disclosed embodiments enables one of ordinary skill in the art to make and use the application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles described herein can be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A production data downloading method, characterized in that: include: The data security download platform obtains a data download work order, obtains a download solution compressed package corresponding to the data download work order, and sends the download solution compressed package to the process management platform; The process management platform sends the downloaded solution compressed package to the destination host, and parses the downloaded solution compressed package on the destination host to obtain the configuration file and various script files in the downloaded solution compressed package; The process management platform checks the downloaded solution compressed package based on the configuration file to obtain a check conclusion; when the check conclusion indicates that the check has passed, each of the script files is executed in sequence based on a preset script execution order, and after each of the script files is successfully executed in sequence, the production data of the destination host is obtained; The process management platform feeds back the production data to the data security download platform, so that the data security download platform uploads the production data to a preset data distribution center, and the business personnel corresponding to the data download work order download the production data from the data distribution center.

2. The method according to claim 1, characterized in that The data security download platform obtains a data download work order, including: The data security download platform receives the approved data download work order sent by the operation and maintenance monitoring system through the flow interface.

3. The method according to claim 1, characterized in that The obtaining of a compressed download solution package corresponding to the data download work order includes: Obtain work information of each project team; Analyze the work information of each project team to obtain various evaluation information of each project team; Determine a target project group based on the evaluation information of each project group, and send the data download work order to the target project group; Receive a download solution compressed package corresponding to the data download work order fed back by the target project team.

4. The method according to claim 1, wherein The process management platform sends the compressed package of the download solution to the destination host, including: Parsing the data download work order to obtain host information in the data download work order; The host corresponding to the host information is determined as the destination host, and the download solution compressed package is sent to the destination host.

5. The method according to claim 1, wherein The process management platform checks the downloaded solution compressed package based on the configuration file and obtains a check conclusion, including: The process management platform determines each inspection item from the configuration file; Checking the downloaded solution compressed package based on each of the check items and each of the script files to obtain a check result for each of the check items; When each of the inspection results is characterized as inspection passed, an inspection conclusion characterized as inspection passed is obtained; When there is an inspection result characterized as inspection failure, an inspection conclusion characterized as inspection failure is obtained.

6. A production data download system, characterized in that: include: Operation and maintenance monitoring system, data security download platform, process management platform and data distribution center; The operation and maintenance monitoring system is used to receive data download work orders submitted by business personnel, assign the data download work orders to auditors, obtain data download work orders that have passed the auditors' review, and send the reviewed data download work orders to the data security download platform; The data security download platform is used to receive a data download work order sent by the operation and maintenance monitoring system through a flow interface, obtain a download solution compressed package corresponding to the data download work order, and send the download solution compressed package to the process management platform; The process management platform is used to send the compressed package of the download solution to the destination host, and parse the compressed package of the download solution on the destination host to obtain the configuration file and various script files in the compressed package of the download solution; The downloaded solution compressed package is checked based on the configuration file to obtain a check conclusion; when the check conclusion indicates that the check has passed, each of the script files is executed in sequence based on a preset script execution order, and after each of the script files is successfully executed in sequence, the production data of the destination host is obtained, and the production data is fed back to the data security download platform; The data distribution center is used to receive the production data uploaded by the data security download platform and send a data download reminder to the business personnel, so that the business personnel download the production data based on the data download reminder.

7. The system according to claim 6, characterized in that The data security download platform executes a process of obtaining a download solution compressed package corresponding to the data download work order, including: Obtain work information of each project team; Analyze the work information of each project team to obtain various evaluation information of each project team; Determine a target project group based on the evaluation information of each project group, and send the data download work order to the target project group; Receive a download solution compressed package corresponding to the data download work order fed back by the target project team.

8. The system according to claim 6, wherein: The process of the process management platform sending the compressed package of the download solution to the destination host includes: Parsing the data download work order to obtain host information in the data download work order; The host corresponding to the host information is determined as the destination host, and the download solution compressed package is sent to the destination host.

9. The system according to claim 6, wherein: The process management platform performs a check on the downloaded solution compressed package based on the configuration file to obtain a check conclusion, including: The process management platform determines each inspection item from the configuration file; Checking the downloaded solution compressed package based on each of the check items and each of the script files to obtain a check result for each of the check items; When each of the inspection results is characterized as inspection passed, an inspection conclusion characterized as inspection passed is obtained; When there is an inspection result characterized as inspection failure, an inspection conclusion characterized as inspection failure is obtained.

10. The system according to claim 9, characterized in that Also includes: When the inspection conclusion indicates that the inspection has failed, the process management platform feeds back the inspection conclusion to the data security download platform, so that the data security download platform reminds the target project team to adjust the downloaded solution compression package.

Citation Information

Patent Citations

  • Networked data collaborative submission and statistical system and method based on workflow

    CN103942722A

  • Enterprise data warehouse management method and platform

    CN111695881A