Interface control method and device, electronic equipment and storage medium

By automating the interface of dairy product testing software through RPA technology, the problems of cumbersome, time-consuming and error-prone traditional testing processes have been solved, achieving a highly efficient and accurate testing process.

CN121858005APending Publication Date: 2026-04-14MENGNIU DAIRY JINHUA CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-12
Publication Date
2026-04-14

AI Technical Summary

Technical Problem

Traditional dairy product testing procedures are cumbersome, time-consuming, and prone to errors, requiring operators to be involved throughout the process, which cannot meet the demand for rapid and efficient testing.

Method used

By employing Robotic Process Automation (RPA) technology, repetitive and standardized tasks in the inspection process are automatically executed, simulating human operation. Inspection tasks are generated by parsing inspection instructions, and the inspection software interface is automatically controlled based on the identifiers carried in the inspection tasks.

Benefits of technology

It achieves a high degree of automation in the testing process, reduces manual intervention, improves work efficiency, reduces the possibility of human error, ensures the accuracy and reliability of the testing process, and has flexibility and scalability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121858005A_ABST
    Figure CN121858005A_ABST
Patent Text Reader

Abstract

The invention provides an interface control method and device, electronic equipment and a storage medium. The method comprises the following steps: receiving a detection instruction; analyzing the detection instruction to obtain an analysis result, and generating a detection task based on the analysis result; and based on the detection item identifier, the detection method identifier and the to-be-detected sample identifier carried in the detection task, performing interface control until the detection task is completed. According to the method and device, the electronic equipment and the storage medium provided by the invention, repetitive and normative tasks in the detection process can be automatically executed, the overall working efficiency is improved, and meanwhile, the requirement of manual operation is reduced, so that the error risk and the cost are reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of automatic control technology, and in particular to an interface control method, device, electronic device, and storage medium. Background Technology

[0002] In the field of food safety, dairy product testing plays a crucial role. This testing process typically relies on specialized testing software, requiring operators to possess high levels of professional skills and meticulous attention to detail. However, in traditional testing procedures, operators must manually open the relevant testing software, select the appropriate testing method based on the testing requirements, and accurately input the sample identification number (ID). Furthermore, operators must wait for the testing process to complete before manually obtaining and generating the test report. The entire process requires the operator's full involvement, which is not only tedious and time-consuming but also prone to errors. Summary of the Invention

[0003] This invention provides an interface control method, device, electronic device, and storage medium to solve the defects of manual control of detection software in related technologies, which result in low detection efficiency and easy errors.

[0004] This invention provides an interface control method, comprising: Receive detection command; The detection command is parsed to obtain the parsing result, and a detection task is generated based on the parsing result; Based on the detection item identifier, detection method identifier, and sample identifier carried in the detection task, interface control is performed until the detection task is completed.

[0005] According to an interface control method provided by the present invention, the interface control based on the detection item identifier, detection method identifier, and sample identifier carried in the detection task includes: Based on the detection item identifier, a detection item icon is determined, and the detection item icon is clicked on the system interface to display the first interface; Based on the detection method identifier, a detection method icon is determined, and the detection method icon is clicked on the first interface to display the second interface; Locate the sample identifier input box on the second interface, and enter the identifier of the sample to be tested in the sample identifier input box; On the second interface, identify and click the start button to start the detection task.

[0006] According to an interface control method provided by the present invention, the detection task further carries identifiers of each detection step corresponding to the detection method, and the step of starting the detection task further includes: Based on the identifier of any detection step, determine the operation points corresponding to any detection step. On the second interface, a specified operation is performed on each operation point based on a preset order. The specified operation is any one of the following: click operation, input operation, or scroll operation.

[0007] According to an interface control method provided by the present invention, the step of clicking the detection item icon on the system interface includes: Locate the detection item icon on the system interface; If the detection item icon is found, click on the detection item icon; If the icon for the detection item is not found, an error message will be displayed.

[0008] According to an interface control method provided by the present invention, the step of clicking the detection method icon on the first interface includes: Locate the detection method icon on the first interface; If the detection method icon is found, click on the detection method icon; If the detection method icon is not found, the user will be prompted whether to change the detection method.

[0009] According to an interface control method provided by the present invention, after prompting the user whether to change the detection method, the method further includes: Receive user actions; In response to the user's action, a new detection method icon is determined, and the user clicks on the new detection method icon on the first interface.

[0010] According to an interface control method provided by the present invention, the detection task further includes a detection duration, and the method further includes: When the detection duration is reached, the current detection state is identified; If the current detection status is "detection complete", then export the detection report; If the current detection status is "detection incomplete", an error message will be displayed.

[0011] The present invention also provides an interface control device, comprising: The receiving unit is used to receive detection commands; The parsing unit is used to parse the detection command, obtain the parsing result, and generate a detection task based on the parsing result; The control unit is used to perform interface control based on the detection item identifier, detection method identifier, and sample identifier carried in the detection task until the detection task is completed.

[0012] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the interface control method described above.

[0013] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the interface control method as described above.

[0014] The present invention also provides a computer program product, including a computer program that, when executed by a processor, implements the interface control method described above.

[0015] The interface control method, apparatus, electronic device, and storage medium provided by this invention receive and automatically parse detection commands, generate detection tasks based on the parsing results, and then automatically control the interface based on various identifiers carried in the detection tasks (such as detection item identifiers, detection method identifiers, and sample identifiers). The entire process is highly automated, reducing manual intervention, improving work efficiency, and significantly reducing the possibility of human error, ensuring the accuracy and reliability of the detection process. Furthermore, this invention can support multiple detection items and methods; only the corresponding identifiers need to be specified in the detection command. This gives the invention excellent flexibility and scalability, enabling it to adapt to different detection needs. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in this invention or related technologies, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This is one of the flowcharts illustrating the interface control method provided by the present invention; Figure 2 This is the second flowchart of the interface control method provided by the present invention; Figure 3 This is a schematic diagram of the interface control device provided by the present invention; Figure 4 This is a schematic diagram of the structure of the electronic device provided by the present invention. Detailed Implementation

[0018] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0019] In traditional dairy product testing processes, each step requires direct operator involvement. From opening the testing software and selecting the testing method to entering the sample ID and starting the test, and finally obtaining and generating the test report, the entire process is cumbersome and time-consuming. This traditional process has significant drawbacks: First, the involvement of multiple manual steps not only increases operational complexity but also easily introduces human error, especially when handling large numbers of samples or requiring high-precision testing tasks, where the risk of error is further amplified. Second, manual operation leads to low testing efficiency, failing to meet the demands of rapid and efficient modern testing.

[0020] To address this, the present invention provides an interface control method that, by introducing RPA (Robotic Process Automation) technology, can simulate human user operations and automatically execute repetitive and standardized tasks in the detection process. This reduces the need for manual operation, improves work efficiency and accuracy, and lowers labor and time costs, thereby overcoming the aforementioned shortcomings.

[0021] Figure 1 This is one of the flowcharts illustrating the interface control method provided by the present invention, such as... Figure 1 As shown, the method includes: Step 110: Receive detection command; It should be noted that the method provided in this embodiment of the invention can be used to achieve automatic control of a controlled object, including starting the controlled object and automatically controlling the interface elements of the controlled object, realizing automatic content input, automatic button clicking, and automatic interface scrolling, etc. Here, the controlled object can be an object with repetitive operation requirements, such as sample testing software (e.g., rheometer software). The method provided in this embodiment of the invention can be applied to RPA software or systems, and is a method or tool for realizing automatic interface control. RPA software can simulate human operations, such as mouse clicks and keyboard input, to automate business processes.

[0022] Specifically, when a sample needs to be tested, the user can issue a testing command. Upon receiving the testing command, the RPA can parse it. Here, the testing command refers to the signal or command that triggers the RPA software or system to start executing an automated testing task. This command contains the specific information or requirements for the testing to be performed.

[0023] Understandably, RPA software or systems can receive testing instructions in various ways, such as through application programming interfaces (APIs), graphical user interfaces (GUIs), or by interfacing with other systems, such as laboratory information management systems (LIMS), enterprise resource planning (SAP) systems, and manufacturing execution systems (MES).

[0024] Step 120: Parse the detection command to obtain the parsing result, and generate a detection task based on the parsing result; Specifically, after receiving a detection instruction from a user or upstream system, RPA software or system will parse the instruction according to a predetermined format or protocol. In particular, the detection instruction can be a string, data structure, or message containing specific information. RPA will identify different parts of the instruction (such as header, body, and footer) and extract key information (such as the detection item name, detection method, and sample ID to be detected).

[0025] For example, the upstream system can encapsulate the basic information of the sample to be tested, as well as the testing items and methods, into a testing instruction in JSON data format and pass it to the RPA. Upon receiving the instruction, the RPA parses the JSON format to obtain the required testing items, methods, and sample ID; this information constitutes the parsing result. Furthermore, during the parsing process, the RPA can verify the extracted information to ensure it conforms to the expected format and scope. It should be understood that the parsing result refers to the key information extracted and verified by the RPA from the testing instruction after the above parsing process. This information can be organized into one or more data structures (such as dictionaries, lists, objects, etc.) for subsequent use.

[0026] After obtaining the parsing results, RPA generates a detection task based on this information. This task contains all the detailed information required for detection, such as the detection item identifier, detection method identifier, sample identifier, and other relevant information (such as detection duration, detection priority, etc.). RPA internally creates a task object based on this information and prepares to execute the task.

[0027] It is understood that a detection task refers to a set of operations or steps created by RPA software or a system to achieve a specific detection objective. These operations may include opening the detection software, selecting a detection method, entering the sample ID, and starting the detection process. The goal of a detection task is to automate the entire detection process, thereby reducing the burden of manual operation and improving detection efficiency. In this embodiment of the invention, by parsing detection instructions and generating corresponding detection tasks, RPA can accurately understand and automatically execute the user's detection needs without requiring manual operation from the user.

[0028] Step 130: Based on the detection item identifier, detection method identifier, and sample identifier carried in the detection task, perform interface control until the detection task is completed.

[0029] Specifically, the detection item identifier, detection method identifier, and sample identifier carried in the detection task are key information required for executing the automated detection process. The detection item identifier is a code or name used to uniquely identify a specific detection item, telling the RPA system which specific detection item needs to be executed. In one embodiment, the detection item identifier can be used to select the corresponding detection module or menu item in the detection software. For example, if the detection software has multiple detection items, the RPA will find and activate the correct item based on the detection item identifier. In another embodiment, the detection item identifier can be used to select and open the corresponding detection software in the desktop environment. For example, if there are multiple detection software programs on the desktop, the RPA will find and open the correct software based on the identifier.

[0030] The detection method identifier is an identifier that specifies the specific method or procedure used when performing the detection. It may include the name, version number, or other unique identification information of the detection method. In the interface control, RPA selects or configures the correct detection method in the detection software based on the detection method identifier.

[0031] The sample identifier (i.e., sample ID) is a code or name used to uniquely identify a sample to be tested. In the interface control, the RPA will input or select the correct sample information in the testing software based on the sample identifier, such as typing the sample ID in the input box, selecting the sample name from the list, or performing other sample-related operations.

[0032] Specifically, based on the various identifiers carried in the inspection task, RPA locates the corresponding elements (such as menu items, buttons, input boxes, etc.) in the inspection software interface. Then, RPA simulates human actions to perform actions on these interface elements (such as clicking, inputting, etc.), which are executed according to the order and logic specified in the inspection task. During execution, RPA also monitors changes to the interface and obtains feedback information (such as inspection results, error messages, etc.) to make adjustments or handle issues as needed. It should be understood that the various identifiers carried in the inspection task provide RPA with crucial guidance for executing the automated inspection process. By accurately parsing and utilizing this information, RPA can achieve interface control of the inspection software, thereby automating the entire inspection process.

[0033] The method provided in this invention receives and automatically parses detection commands, generates detection tasks based on the parsing results, and then automatically controls the interface based on various identifiers carried in the detection task (such as detection item identifiers, detection method identifiers, and sample identifiers). The entire process is highly automated, reducing manual intervention, improving work efficiency, and significantly reducing the possibility of human error, thus ensuring the accuracy and reliability of the detection process. Furthermore, this invention can support multiple detection items and methods; only the corresponding identifiers need to be specified in the detection command. This gives the invention excellent flexibility and scalability, enabling it to adapt to different detection needs.

[0034] Based on the above embodiments, step 130, which involves interface control based on the detection item identifier, detection method identifier, and sample identifier carried in the detection task, includes: Step 131: Based on the detection item identifier, determine the detection item icon, and click the detection item icon on the system interface to display the first interface; Specifically, in an RPA system, there is usually a pre-configuration or learning process to establish a mapping between detection item identifiers and detection item icons (or detection software icons). This mapping can be stored in the RPA system's configuration file or implemented through some form of mapping logic. When the RPA system executes a detection task, it first finds the corresponding detection item icon in the pre-established mapping based on the detection item identifier in the detection task, and then recognizes the icon on the system interface.

[0035] Here, "detection item icons" refer to graphical interface elements representing specific detection items or detection software, typically displayed on the computer monitor's desktop. These icons usually have a specific appearance and identifier. In this embodiment of the invention, detection item icons are an important target in the automation process because RPA needs to be able to recognize and click these icons to launch the corresponding detection software or module. The aforementioned system interface is the computer monitor's desktop, which refers to a part of the graphical user interface provided by the computer operating system, typically including elements such as a background, various software icons, and a taskbar.

[0036] After identifying the target icon, the RPA system can use techniques such as image recognition, coordinate localization, or API calls to recognize and click the icon on the desktop. Specifically, this can be achieved through the following steps: First, the RPA system uses an image recognition algorithm to identify the target icon on the desktop. Once the icon is identified, the RPA system determines its precise location on the desktop (usually expressed in screen coordinates). Then, the RPA system simulates a mouse click event to click the icon, opening the corresponding detection software and displaying the software's first interface. Here, the first interface refers to the graphical user interface first displayed to the user after the detection software is launched. In the RPA automation process, the first interface is usually the target that the RPA system will interact with next. The RPA system will perform further clicks, inputs, or reads on the first interface to complete the detection task.

[0037] Understandably, the purpose of clicking on the detection item icon is to launch the detection software or module corresponding to the detection item identifier. This is a key step in the RPA automation process because it allows the RPA system to automatically open and run the detection software without human intervention.

[0038] Step 132: Based on the detection method identifier, determine the detection method icon, and click the detection method icon on the first interface to display the second interface; Specifically, in an RPA system, the correspondence between detection method identifiers and detection method icons can be established through pre-configuration or learning. This correspondence can be stored in the RPA system's database, configuration files, or knowledge base as part of the automation process. When the RPA system parses a detection method identifier, it finds the corresponding detection method icon in the pre-established correspondence based on this identifier. Here, the detection method icon refers to the graphical interface element representing a specific detection method, typically displayed on the first interface of the detection software.

[0039] After identifying the detection method icon, the RPA system uses image processing algorithms to recognize it on the first interface. Once the icon is recognized, the RPA system determines its precise location on the first interface (usually expressed in screen coordinates). Finally, the RPA system simulates a mouse click event to click the icon, navigating to the second interface for display. Here, the second interface refers to the next graphical user interface displayed to the user after clicking the detection method icon. The RPA system performs further clicks, inputs, reads, or processing operations on the second interface to complete specific steps in the detection task. It should be understood that the purpose of clicking the detection method icon is to select and execute the specific detection method or step corresponding to the detection method identifier.

[0040] Step 133: Locate the sample identifier input box on the second interface and enter the sample identifier to be tested in the sample identifier input box; It should be noted that on the second interface, the RPA system can use image processing, OCR (Optical Character Recognition), or UI (User Interface) automation tools to recognize all elements on the interface. These tools can parse the interface layout and recognize various controls, such as buttons, text boxes, drop-down menus, etc.

[0041] Specifically, among the identified elements, the RPA system can use various localization strategies to locate the sample identification input box. For example, it can locate the element by its ID, class name, tag name, or other attributes; it can also locate the element by its positional relationship relative to other elements; it can also locate the element by its text or image content. This embodiment of the invention does not specifically limit the specific methods used.

[0042] The RPA system matches identified elements with the intended sample identification input box. This can be done by comparing element attributes, location, or content. Once a matching element is found, the RPA system confirms that this is the sample identification input box that needs to be entered. Here, the sample identification input box refers to the text input box on the detection software interface used to input the identifier of the sample to be detected. This input box allows the input of the sample's ID, name, or other unique identifier so that the detection software can identify and process the sample.

[0043] After locating the sample identifier input box, the RPA system retrieves the identifier value of the sample to be tested from the testing task. Then, the RPA simulates keyboard input, entering the identifier value into the sample identifier input box. It should be understood that the purpose of inputting the sample identifier is to associate the sample to be tested with the testing task. During the testing process, the testing software needs to use this identifier to identify and process specific samples. By inputting the sample identifier, the testing software can ensure that testing steps are performed on the correct samples and associate the test results with the corresponding samples.

[0044] Step 134: Identify and click the start button on the second interface to start the detection task.

[0045] Specifically, among the identified interface elements, the RPA system can also locate the start button by comparing the element's text label, icon, position, or attributes. For example, if the button is labeled with words like "Start" or "Launch," or has a clear "Play" icon, the RPA system can recognize that this is the start button to be clicked. Once the start button is located, the RPA system will simulate a mouse click event to click it. This process includes sending simulated mouse events to the operating system, such as moving the mouse pointer over the button and then pressing and releasing the left mouse button. It should be understood that the start button refers to the control on the detection software interface used to start the detection task.

[0046] Understandably, when the RPA system simulates clicking the start button, it triggers the execution mechanism within the detection software, initiating the detection task according to preset parameters and steps. During the execution of the detection task, the RPA system continuously monitors the software's running status and output results. This helps ensure the smooth progress of the detection task and allows for timely corrective measures to be taken when problems arise.

[0047] Based on any of the above embodiments, the detection task also carries identifiers for each detection step corresponding to the detection method. After step 134, the method further includes: Based on the identifier of any detection step, determine the operation points corresponding to any detection step. On the second interface, a specified operation is performed on each operation point based on a preset order. The specified operation is any one of the following: click operation, input operation, or scroll operation.

[0048] It should be noted that the identifiers for each detection step in the detection method are symbols or codes used to uniquely identify each step within the detection method. These identifiers help the system distinguish between different detection steps, ensuring that the detection task is performed accurately according to the predetermined steps.

[0049] Specifically, a mapping or correspondence table can be pre-built for each detection software, associating each detection step identifier with its corresponding operation point. When the RPA system executes a certain detection step, it can look up the table based on the identifier of that detection step to find all operation points corresponding to that identifier. These operation points can include buttons that need to be clicked, input boxes that need to be entered, page areas that need to be scrolled, etc. Here, an operation point refers to the specific location or element on the detection software interface that the RPA needs to interact with when executing a certain detection step. These operation points may be buttons, input boxes, drop-down menus, scroll bars, etc., on the interface, and the RPA needs to perform operations such as clicking, inputting, or scrolling on them.

[0050] Specifically, when performing a certain operation step, RPA performs tasks on the second interface of the detection software by simulating human user operations. It first reads the preset operation sequence and information for each operation point, and then performs the specified operations for each operation point in sequence, including recognizing interface elements (such as buttons, input boxes, etc.) and simulating user clicks, inputs, or scrolling behaviors.

[0051] As can be understood, a specified operation refers to an action explicitly defined in the RPA task that the RPA needs to perform on the detection software interface. These operations can be click operations, input operations, or scrolling operations, etc. Specifically, a click operation refers to the RPA simulating the user clicking an element (such as a button or link) on the interface. An input operation refers to the RPA entering specified data or text into an input box on the interface. A scrolling operation refers to the RPA simulating the user scrolling through a page or list to view or select more interface elements.

[0052] Based on any of the above embodiments, step 131, the clicking operation on the detection item icon on the system interface, includes: Step 1311: Locate the detection item icon on the system interface; Step 1312: If the detection item icon is found, click on the detection item icon; Step 1313: If the detection item icon is not found, an error message will be displayed.

[0053] Specifically, before RPA can click on an icon for a detection item on the system interface, it needs to identify and locate that icon first. RPA can use image processing and interface element recognition technology to find the detection item icon on the system interface. The specific steps are as follows: RPA first captures a screen image of the current monitor desktop (i.e., the system interface); then, RPA processes the captured screen image to identify the interface elements; next, RPA matches its internally stored detection item icon image (or features) with the image on the screen. Once a matching icon is found, RPA determines its precise location on the screen.

[0054] If RPA successfully locates the detection item icon on the system interface, it means the icon exists within the visible area of ​​the current screen's desktop. In this case, the RPA system can directly click the icon to open the corresponding detection software. If RPA fails to locate the detection item icon, it means the icon is not within the visible area of ​​the current screen's desktop, or the icon has been deleted, moved, or renamed, causing RPA to be unable to recognize it. In this case, RPA can display error messages through pop-up dialog boxes, log entries, sound alerts, etc. For example, RPA can pop up a dialog box on the screen to display the error message. Alternatively, RPA can log the error message to a log file for later analysis and troubleshooting. In some cases, RPA can also play specific sounds or sound effects to alert the user to an error.

[0055] Based on any of the above embodiments, step 132, the clicking operation on the detection method icon on the first interface, includes: Step 1321: Locate the detection method icon on the first interface; Step 1322: If the detection method icon is found, click on the detection method icon; Step 1323: If the detection method icon is not found, prompt the user whether to change the detection method.

[0056] Specifically, before clicking on a detection method icon on the first interface of the detection software, the RPA system needs to first identify and locate the detection method icon. Specifically, RPA first identifies the current interface of the detection software. For example, RPA can determine the structure of the current interface by analyzing information such as the layout, color, and shape of elements on the screen. Next, RPA searches for the detection method icon within the identified interface, which can be achieved by matching predefined icon images or features. RPA traverses all elements on the interface, comparing them with pre-stored detection method icons to find a matching icon. Once a matching detection method icon is found, RPA determines its precise location on the interface.

[0057] If RPA successfully finds the detection method icon on the first interface of the detection software, it means that the icon exists on the current interface of the detection software and is visible. At this time, the RPA system can directly click on the icon to jump to the second interface for display.

[0058] If RPA fails to find the detection method icon, it indicates that the icon may not be visible in the current interface, or the icon may have been changed, deleted, or moved to another location, causing RPA to be unable to accurately identify it. In this case, RPA can remind the user by displaying a dialog box. For example, RPA can display a dialog box on the detection software interface with a message such as "The specified detection method icon was not found. Do you want to select another detection method?". The dialog box will also contain option buttons such as "Yes" (indicating agreement to change the detection method) and "No" (indicating rejection of the change and possible other operations or exit). RPA will wait for the user to click a button in the dialog box to make a selection. Based on the user's response, RPA can perform the corresponding operation, such as opening the interface for selecting the detection method, exiting the current operation, or performing other processing.

[0059] Based on any of the above embodiments, after step 1323, the method further includes: Receive user actions; In response to the user's action, a new detection method icon is determined, and the user clicks on the new detection method icon on the first interface.

[0060] Specifically, when the RPA system does not find a detection method icon on the first interface of the detection software, it will display a pop-up message indicating that no corresponding detection method was found and ask the user if they want to change the detection method. If the user selects "yes" on the prompt screen, the pop-up will redirect to the interface for selecting a detection method. Subsequently, the RPA will begin monitoring the user's actions on this interface. After the user completes their selection on the detection method selection interface, the RPA system will determine a new detection method icon based on the user's selection and allow the user to click on that icon on the detection software interface to activate the selected detection method.

[0061] It is understood that user operation refers to various interactive behaviors performed by a user on a computer interface to convey their intentions or instructions. In this embodiment of the invention, user operation mainly refers to selecting a new detection method on the interface for selecting a detection method by clicking or inputting. After the user makes a selection, the RPA system will recognize the user's selection and determine the corresponding detection method. Subsequently, the system will obtain the icon associated with the selected detection method.

[0062] Based on any of the above embodiments, the detection task also includes a detection duration, and the method further includes: When the detection duration is reached, the current detection state is identified; If the current detection status is "detection complete", then export the detection report; If the current detection status is "detection incomplete", an error message will be displayed.

[0063] Specifically, the detection duration refers to the preset time limit for a detection task, specifying the maximum time span required from the start of the task to its expected completion. This duration can be determined based on the complexity of the detection task, historical data, industry standards, or user requirements. When RPA begins executing a detection task, it simultaneously starts a timer to track the task's execution time. If the timer reaches the preset detection duration, it indicates that the detection task has been executed for the predetermined time. At this point, RPA needs to make further decisions based on the current detection status.

[0064] When the detection timer reaches its duration, RPA can identify the current detection status in various ways to determine whether the detection is complete. For example, RPA can maintain one or more state variables to track the progress or status of the detection task; it can also monitor the status of the process or thread executing the detection task, such as whether it is still running or has exited. Furthermore, if the detection task is executed by calling an external system or application's API, RPA can query the status information returned by these APIs to determine the current detection status. In addition, RPA can analyze the logs or output information generated by the detection task to determine whether the task has been completed or whether any problems have occurred.

[0065] If the current detection status is detected as "Detection Complete," it indicates that the detection software has successfully completed all steps of the detection task and obtained the final detection result. In this case, the RPA system can automatically obtain and export the detection report. Here, the detection report is a document generated after the detection task is completed. It summarizes the results of the detection task, including the detected object, method, process, problems found, and suggested improvement measures. RPA can generate a detection report based on the results of the detection task and a preset format, and save the generated report to a specified location, such as a local file system, database, or cloud storage.

[0066] If the current detection status is identified as "Detection Incomplete," it indicates that all steps of the detection task have not been completed within the allotted detection time. In this case, the RPA system can display exception information to the user via a pop-up dialog box. This information may include the task status, possible reasons for the detection failure, and suggested solutions.

[0067] Based on any of the above embodiments Figure 2 This is the second flowchart illustrating the interface control method provided by the present invention, as shown below. Figure 2As shown, the method includes: When the RPA system receives a detection command, it first parses the command to obtain the parsing result and automatically generates a detection task based on the result. Then, the RPA recognizes the software icon on the desktop and opens the corresponding detection software. Next, it identifies and clicks the corresponding detection method on the software interface. If no corresponding detection method is found, the user is prompted and asked if they want to change the detection method. After successfully clicking the detection method on the software interface, the RPA locates the sample ID input box and enters the sample ID. After entering the sample ID, the user finds and clicks the start button to begin the detection. For each detection task, a corresponding detection duration is preset, and the RPA automatically waits for the specified time. When the detection duration is reached, the RPA checks whether the detection is complete. If the detection is complete, a detection report is exported; if the time expires and the detection is not complete, the RPA displays an error message.

[0068] The method provided in this invention, by introducing RPA technology, can automate repetitive and standardized tasks in the sample testing process, such as software opening, testing method selection, and sample ID input. This significantly reduces the time and effort required for manual operations, improving overall work efficiency. Simultaneously, automated processing reduces the need for manual operations, thereby lowering labor and time costs. Furthermore, RPA technology can quickly adapt to different business processes and scenarios, and can be configured and adjusted according to actual needs. When some steps change, it can be flexibly adjusted, exhibiting strong enhanced flexibility and scalability.

[0069] Based on any of the above embodiments Figure 3 This is a schematic diagram of the interface control device provided by the present invention, as shown below. Figure 3 As shown, the device includes: The receiving unit 310 is used to receive detection commands; The parsing unit 320 is used to parse the detection command, obtain the parsing result, and generate a detection task based on the parsing result; The control unit 330 is used to perform interface control based on the detection item identifier, detection method identifier, and sample identifier carried in the detection task until the detection task is completed.

[0070] The apparatus provided in this invention receives and automatically parses detection commands, generates detection tasks based on the parsing results, and then automatically controls the interface based on various identifiers carried in the detection tasks (such as detection item identifiers, detection method identifiers, and sample identifiers). The entire process is highly automated, reducing manual intervention, improving work efficiency, and significantly reducing the possibility of human error, thus ensuring the accuracy and reliability of the detection process. Furthermore, this invention can support multiple detection items and methods; only the corresponding identifiers need to be specified in the detection command. This gives the invention excellent flexibility and scalability, enabling it to adapt to different detection needs.

[0071] Based on any of the above embodiments, the control unit 330 includes: The first operation subunit is used to determine the detection item icon based on the detection item identifier, and click the detection item icon on the system interface to display the first interface; The second operation subunit is used to determine the detection method icon based on the detection method identifier, and click the detection method icon on the first interface to display the second interface; The input subunit is used to locate the sample identifier input box on the second interface and input the sample identifier to be tested in the sample identifier input box; The startup subunit is used to identify and click the start button on the second interface to start the detection task.

[0072] Based on any of the above embodiments, the detection task also carries identifiers for each detection step corresponding to the detection method, and the control unit 330 further includes a third operation subunit, which is used for: Based on the identifier of any detection step, determine the operation points corresponding to any detection step. On the second interface, a specified operation is performed on each operation point based on a preset order. The specified operation is any one of the following: click operation, input operation, or scroll operation.

[0073] Based on any of the above embodiments, the first operation subunit is specifically used for: Locate the detection item icon on the system interface; If the detection item icon is found, click on the detection item icon; If the icon for the detection item is not found, an error message will be displayed.

[0074] Based on any of the above embodiments, the second operation subunit is specifically used for: Locate the detection method icon on the first interface; If the detection method icon is found, click on the detection method icon; If the detection method icon is not found, the user will be prompted whether to change the detection method.

[0075] Based on any of the above embodiments, the second operation subunit is further configured to: Receive user actions; In response to the user's action, a new detection method icon is determined, and the user clicks on the new detection method icon on the first interface.

[0076] Based on any of the above embodiments, the detection task also includes a detection duration, and the device further includes a state recognition unit, which is used for: When the detection duration is reached, the current detection state is identified; If the current detection status is "detection complete", then export the detection report; If the current detection status is "detection incomplete", an error message will be displayed.

[0077] Figure 4 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 4 As shown, the electronic device may include a processor 410, a communication interface 420, a memory 430, and a communication bus 440, wherein the processor 410, the communication interface 420, and the memory 430 communicate with each other via the communication bus 440. The processor 410 can call logical instructions in the memory 430 to execute an interface control method, which includes: receiving a detection instruction; parsing the detection instruction to obtain a parsing result, and generating a detection task based on the parsing result; and performing interface control based on the detection item identifier, detection method identifier, and sample identifier carried in the detection task until the detection task is completed.

[0078] Furthermore, the logical instructions in the aforementioned memory 430 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to related technologies, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0079] On the other hand, the present invention also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the interface control method provided by the above methods. The method includes: receiving a detection instruction; parsing the detection instruction to obtain a parsing result, and generating a detection task based on the parsing result; and performing interface control based on the detection item identifier, detection method identifier, and sample identifier carried in the detection task until the detection task is completed.

[0080] In another aspect, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon. When executed by a processor, the computer program implements the interface control method provided by the above methods. The method includes: receiving a detection instruction; parsing the detection instruction to obtain a parsing result, and generating a detection task based on the parsing result; and performing interface control based on the detection item identifier, detection method identifier, and sample identifier carried in the detection task until the detection task is completed.

[0081] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0082] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the parts that contribute to the related technology, can be embodied in the form of software products. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0083] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An interface control method, characterized in that, include: Receive detection command; The detection command is parsed to obtain the parsing result, and a detection task is generated based on the parsing result; Based on the detection item identifier, detection method identifier, and sample identifier carried in the detection task, interface control is performed until the detection task is completed.

2. The interface control method according to claim 1, characterized in that, The interface control based on the detection item identifier, detection method identifier, and sample identifier carried in the detection task includes: Based on the detection item identifier, a detection item icon is determined, and the detection item icon is clicked on the system interface to display the first interface; Based on the detection method identifier, a detection method icon is determined, and the detection method icon is clicked on the first interface to display the second interface; Locate the sample identifier input box on the second interface, and enter the identifier of the sample to be tested in the sample identifier input box; On the second interface, identify and click the start button to start the detection task.

3. The interface control method according to claim 2, characterized in that, The detection task also carries identifiers for each detection step corresponding to the detection method. After starting the detection task, the process further includes: Based on the identifier of any detection step, determine the operation points corresponding to any detection step. On the second interface, a specified operation is performed on each operation point based on a preset order. The specified operation is any one of the following: click operation, input operation, or scroll operation.

4. The interface control method according to claim 2, characterized in that, The step of clicking the detection item icon on the system interface includes: Locate the detection item icon on the system interface; If the detection item icon is found, click on the detection item icon; If the icon for the detection item is not found, an error message will be displayed.

5. The interface control method according to claim 2, characterized in that, The step of clicking the detection method icon on the first interface includes: Locate the detection method icon on the first interface; If the detection method icon is found, click on the detection method icon; If the detection method icon is not found, the user will be prompted whether to change the detection method.

6. The interface control method according to claim 5, characterized in that, The prompting of the user to change the detection method is followed by: Receive user actions; In response to the user's action, a new detection method icon is determined, and the user clicks on the new detection method icon on the first interface.

7. The interface control method according to any one of claims 1 to 6, characterized in that, The detection task also includes a detection duration, and the method further includes: When the detection duration is reached, the current detection state is identified; If the current detection status is "detection complete", then export the detection report; If the current detection status is "detection incomplete", an error message will be displayed.

8. An interface control device, characterized in that, include: The receiving unit is used to receive detection commands; The parsing unit is used to parse the detection command, obtain the parsing result, and generate a detection task based on the parsing result; The control unit is used to perform interface control based on the detection item identifier, detection method identifier, and sample identifier carried in the detection task until the detection task is completed.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the interface control method as described in any one of claims 1 to 7.

10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the interface control method as described in any one of claims 1 to 7.