Data accuracy monitoring method using RPA
By identifying business needs, designing data verification rules, and writing RPA scripts for automated monitoring, the problems of data accuracy and security in RPA technology have been solved, thereby improving the accuracy and security of data monitoring.
Patent Information
- Application Number
- CN202411263217.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-10
- Publication Date
- 2024-11-22
AI Technical Summary
Existing RPA technology has shortcomings in monitoring data accuracy and poses data security risks.
By identifying business needs, designing data validation rules, writing RPA scripts for automated monitoring, and conducting data testing and real-time collection, the accuracy and security of the data are ensured.
It improved the accuracy and completeness of data monitoring, enhanced the security controls of the RPA platform, and reduced the risk of data leakage.
Smart Images

Figure CN119004514A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of business process automation processing, and in particular to a method for monitoring data accuracy using RPA. Background Art
[0002] RPA technology realizes the automation of business processes by simulating the operations performed by humans on computers. However, the application of RPA technology in data accuracy monitoring is not mature enough and there are many challenges. For example, how to ensure the accuracy of data during RPA automation processing and how to effectively verify the data processed by RPA.
[0003] The existing technology solution is: RPA robots can automatically invite users to comment, achieve full coverage of order comments, automatically identify and distinguish the order comment invitation status; classify and automatically identify invited and non-invited orders to improve efficiency; reduce duplicate invitations, missed invitations, delayed invitations, etc., and increase product evaluation rates; after applying RPA, the timeliness of invitations is greatly improved, the accuracy and coverage are increased to 100%, and the efficiency is increased by 97.83%.
[0004] After deploying the RPA robot, monitoring indicators, thresholds, price adjustment granularity, and ranking targets can be flexibly adjusted. Real-time monitoring can also be performed to effectively improve the timeliness of advertising data and effect feedback, and assist operators in making quick decisions. The RPA robot can work 24 hours a day, freeing up manpower for monitoring work and improving efficiency by 98.04%.
[0005] The disadvantages of the prior art are:
[0006] Data security issues: Since RPA technology needs to access and process sensitive data of enterprises, there are certain data security issues. If the security control of the RPA system is not proper, it may lead to data leakage or malicious attacks. Therefore, this invention can solve the problem of data security. Summary of the invention
[0007] In view of the above problems, the present invention is proposed to provide a method for monitoring data accuracy using RPA that overcomes the above problems or at least partially solves the above problems.
[0008] According to one aspect of the present invention, a method for monitoring data accuracy using RPA is provided, the monitoring method comprising:
[0009] Identify business requirements and conduct data requirements analysis based on said business requirements;
[0010] Monitor the goals and determine monitoring indicators;
[0011] Design data validation rules;
[0012] Conduct data testing process;
[0013] Monitor the operation status and collect data in real time to obtain collected data;
[0014] The collected data are processed and verified.
[0015] Optionally, the identifying of business needs specifically includes: determining the business processes that need to be automated by RPA, and key data points that need to be monitored in the business processes.
[0016] Optionally, the performing data demand analysis according to the business demand specifically includes:
[0017] Analyze the data types, data formats and data sources generated in the business process, and clarify the scope and accuracy of the data that need to be monitored.
[0018] Optionally, the monitoring of the target and determining the monitoring indicators specifically include:
[0019] Set specific goals for data monitoring, including: timeliness, accuracy, and completeness;
[0020] Design monitoring process. According to business needs and data requirements, design specific data monitoring processes, including data collection, data cleaning, data verification and data storage;
[0021] Determine monitoring indicators and clarify the specific indicators that need to be monitored, including data accuracy, data completeness and data delay.
[0022] Optionally, the design data verification rules specifically include:
[0023] To ensure the accuracy of data, it is necessary to design corresponding data validation rules, including data format validation and data range validation;
[0024] Write RPA scripts. According to the process design, write corresponding RPA scripts to realize automated data monitoring.
[0025] Optionally, the data testing process specifically includes:
[0026] Unit testing: Perform unit testing on each module in the RPA script to ensure that each module can be executed correctly;
[0027] Integration testing: integrating various modules together for testing to verify whether the entire data monitoring process runs as expected;
[0028] System testing: Perform system testing in the actual environment to ensure that the RPA data monitoring system can run stably and meet business needs.
[0029] Optionally, the monitoring operation status and collecting real-time data to obtain the collected data specifically include:
[0030] Monitor the operating status of the system through logs, monitoring tools, etc. to ensure stable operation of the system;
[0031] Real-time data collection: the system collects data generated in business processes in real time;
[0032] Optionally, the processing and verifying the collected data specifically includes:
[0033] Clean and transform the collected data to remove invalid and abnormal data;
[0034] Verify data according to preset verification rules to ensure data accuracy and completeness;
[0035] Analyze and visualize the verified data to provide intuitive data monitoring for business personnel.
[0036] The present invention provides a method for monitoring data accuracy using RPA, the monitoring method comprising: identifying business needs and performing data needs analysis according to the business needs; monitoring targets and determining monitoring indicators; designing data verification rules; performing data testing processes; monitoring operating status, and performing real-time data collection to obtain collected data; and processing and verifying the collected data. Strengthen the security control of the RPA platform, including data encryption, access control, and identity authentication, to ensure the security of data during processing.
[0037] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.
[0039] Figure 1 A flowchart of a method for monitoring data accuracy using RPA provided by an embodiment of the present invention;
[0040] Figure 2 A schematic diagram of process development and configuration provided for an embodiment of the present invention;
[0041] Figure 3 The RPA platform provided for the embodiment of the present invention is a schematic diagram of a layered architecture. DETAILED DESCRIPTION
[0042] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.
[0043] The terms "comprises" and "having" and any variations thereof in the description embodiments, claims and drawings of the present invention are intended to cover non-exclusive inclusions, for example, including a series of steps or units.
[0044] The technical solution of the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments.
[0045] like Figure 1 As shown, a method for monitoring data accuracy using RPA includes:
[0046] Step 1: Identify business needs: Determine the business process that RPA needs to automate and the key data points that need to be monitored in the process.
[0047] Step 2: Data demand analysis: Analyze the data types, data formats, data sources, etc. generated in the business process to clarify the scope and accuracy of the data that needs to be monitored.
[0048] Step 3: Clarify monitoring objectives: Set specific goals for data monitoring, such as real-time, accuracy, completeness and other requirements.
[0049] Step 4: Design the monitoring process: Based on business needs and data requirements, design the specific process of data monitoring, including data collection, data cleaning, data verification, data storage and other steps.
[0050] Step 5: Determine monitoring indicators: Identify specific indicators that need to be monitored, such as data accuracy, data completeness, data delay, etc.
[0051] Step 6: Design data validation rules: To ensure the accuracy of the data, you need to design corresponding data validation rules, such as data format validation, data range validation, etc.
[0052] Step 7: Write RPA script: Design according to the process, such as Figure 1, write the corresponding RPA script to realize the automatic data monitoring function. RPA mainly consists of three modules: robot control center, robot designer and robot. The control center is responsible for the process arrangement and scheduling of the robot's work tasks, and the supervision, management and control of the robot's task execution process; the designer is for developers to record, configure or develop task processes, form instruction sets and publish them to the robot controller, which schedules the robot to run according to the set strategy; the robot is responsible for running specific task processes.
[0053] Step 8: Unit testing: Perform unit testing on each module in the RPA script to ensure that each module can be executed correctly.
[0054] Step 9: Integration testing: Integrate each module together for testing to verify whether the entire data monitoring process runs as expected.
[0055] Step 10: System testing: Perform system testing in the actual environment to ensure that the RPA data monitoring system can run stably and meet business needs.
[0056] Step 11: Deploy the system: Deploy the RPA script and related configuration files to the target server.
[0057] Step 12: Start operation: Start the RPA data monitoring system and start real-time data monitoring.
[0058] Step 13: Monitor the running status: Monitor the running status of the system through logs, monitoring tools, etc. to ensure stable operation of the system.
[0059] Step 14: Real-time data collection: The system collects data generated in the business process in real time.
[0060] Step 15: Data cleaning and conversion: Clean and convert the collected data to remove invalid and abnormal data to ensure data accuracy and consistency.
[0061] Step 16: Data Verification: Verify the data according to preset verification rules to ensure the accuracy and completeness of the data.
[0062] Step 17: Data analysis and visualization: Analyze and visualize the verified data to provide intuitive data monitoring for business personnel.
[0063] Real-world examples of RPA applications in the context of financial services include:
[0064] Reviewing the images in the customer's application materials requires a lot of human resources to determine whether they are complete, whether the application date is compliant, whether the articles of association are copied completely, whether important information modifications are signed by the person himself, and to record non-compliant items, confirm whether the content of the image is consistent with the electronic application content, and after the comparison is completed, manually determine whether the customer's application materials are approved to enter the account creation stage.
[0065] Step 18: Identify and extract data. RPA will first identify and extract the data that needs to be cleaned from the image. According to the preset rules, RPA will perform preliminary cleaning on the data. These rules may include removing spaces, special characters, or converting the data into a unified format.
[0066] Standardization: RPA will standardize the data to ensure that it complies with certain specifications and standards, such as the standardization of date formats and capitalization.
[0067] De-duplication of data: RPA can identify and remove duplicate data rows or records to ensure the uniqueness of the data.
[0068] Data filling: For missing data, RPA can fill it in according to preset rules, such as using default values, average values, or inferring based on other relevant data.
[0069] Step 19: Data Verification:
[0070] Range validation: RPA checks whether the data is within a reasonable range. For example, the value of an age field should not be negative or too large.
[0071] Format verification: Based on the preset format requirements, RPA will verify whether the data format is correct, such as whether the phone number, email address, etc. conform to a specific format.
[0072] Conditional validation: RPA performs conditional validation based on business rules. For example, if the value of a field depends on the value of other fields, RPA will check whether this dependency is satisfied.
[0073] Completeness verification: Ensure that all required data fields are filled and nothing is missing.
[0074] Consistency verification: RPA checks whether the data is consistent across different fields or records.
[0075] Step 20: Process development and configuration: Developers develop detailed instructions and publish them to the machine, including application configuration, data input, client file verification, test data creation, data loading, and report generation, such as Figure 2 shown.
[0076] Business users can assign tasks to robots and monitor their activities through the control center, realizing process operations as independent automated tasks and handing them over to software robots for execution. The robot execution process is supervised, managed and controlled, and the robot resource pool is managed to achieve dynamic allocation of robots and maximize the use of robot resources.
[0077] Developers use the designer to record, configure or develop task processes, form instruction sets and publish them to the robot controller, which then schedules the robot to run according to the set strategy.
[0078] The robot is located in a virtualized or physical environment and does not need to open any interface with the system. It only needs to interact with various application systems (including ERP, SAP, CRM, OA, etc.) through the user interface, completely simulating human operations and automatically performing daily labor-intensive and repetitive tasks.
[0079] Step 21: Testing:
[0080] Testing RPA scripts: User acceptance testing, system integration testing, and unit testing. The first test is the unit test conducted by the developer, followed by the system integration test to ensure that the robot is interoperable with the current system. Finally, it is time for the owner or user to test and accept the RPA script.
[0081] Functional Validation: Does the software robot function as expected? Does it flow through other systems correctly?
[0082] Additional verification: Additional verification means any other critical aspects required for the software robot to operate successfully. In addition, any additional verification should address the possible risks of data breaches and fraud - if the committee has not already done so.
[0083] Step 22: Deployment: Deploy the RPA script and related configuration files to the target server. Start the RPA data monitoring system and start real-time data monitoring. Monitor the system's operating status through logs and monitoring tools to ensure stable system operation.
[0084] Step 23: The system collects data generated in the business process in real time.
[0085] Step 24: Analyze and visualize the verified data on the large screen, browser, and mobile terminals to provide intuitive data monitoring for business personnel.
[0086] Step 25: The RPA platform is a layered architecture, such as Figure 3As shown in the figure, the display layer includes web pages, mobile terminals and large screens. The service layer provides robot management, system management and report query interfaces. The application layer completes functions such as robot and system management and report generation. Since RPA has both structured and unstructured data, it uses both SQL and NOSQL data storage.
[0087] Beneficial effects: Strengthen the security control of the RPA platform, including data encryption, access control and identity authentication, to ensure the security of data during processing. Set precise permission control to allow only people with specific roles to access and modify the RPA process, reducing the risk of human error or malicious tampering.
[0088] The above specific implementation methods further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above are only specific implementation methods of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.
Claims
1. A method for monitoring data accuracy using RPA, characterized in that: The monitoring method comprises: Identify business requirements and conduct data requirements analysis based on said business requirements; Monitor the goals and determine monitoring indicators; Design data validation rules; Conduct data testing process; Monitor the operation status and collect data in real time to obtain collected data; The collected data are processed and verified.
2. A method for monitoring data accuracy using RPA according to claim 1, characterized in that: The identification of business needs specifically includes: determining the business processes that RPA needs to automate, and the key data points that need to be monitored in the business processes.
3. The method for monitoring data accuracy using RPA according to claim 1, characterized in that: The data demand analysis according to the business demand specifically includes: Analyze the data types, data formats and data sources generated in the business process, and clarify the scope and accuracy of the data that need to be monitored.
4. The method for monitoring data accuracy using RPA according to claim 1, characterized in that: The monitoring of the target and determination of monitoring indicators specifically include: Set specific goals for data monitoring, including: timeliness, accuracy, and completeness; Design monitoring process. According to business needs and data requirements, design specific data monitoring processes, including data collection, data cleaning, data verification and data storage; Determine monitoring indicators and clarify the specific indicators that need to be monitored, including data accuracy, data completeness and data delay.
5. The method for monitoring data accuracy using RPA according to claim 1, characterized in that: The design data verification rules specifically include: To ensure the accuracy of data, it is necessary to design corresponding data validation rules, including data format validation and data range validation; Write RPA scripts. According to the process design, write corresponding RPA scripts to realize automated data monitoring.
6. The method for monitoring data accuracy using RPA according to claim 1, characterized in that: The data testing process specifically includes: Unit testing: Perform unit testing on each module in the RPA script to ensure that each module can be executed correctly; Integration testing: integrating various modules together for testing to verify whether the entire data monitoring process runs as expected; System testing: Perform system testing in the actual environment to ensure that the RPA data monitoring system can run stably and meet business needs.
7. The method for monitoring data accuracy using RPA according to claim 1, characterized in that: The monitoring operation status and real-time data collection to obtain the collected data specifically include: Monitor the operating status of the system through logs, monitoring tools, etc. to ensure stable operation of the system; Real-time data collection, the system collects data generated in the business process in real time.
8. The method for monitoring data accuracy using RPA according to claim 1, characterized in that: The processing and verification of the collected data specifically includes: Clean and transform the collected data to remove invalid and abnormal data; Verify data according to preset verification rules to ensure data accuracy and completeness; Analyze and visualize the verified data to provide intuitive data monitoring for business personnel.
