Business process automation method and related equipment

Abstract

The invention discloses a business process automation method and related equipment, and aims to solve the problem that in the prior art, when the layout of a control of an operation interface on which configured RPA configuration information is based is changed, the configured RPA configuration information is invalid, so that the automatic operation of a business process is interrupted. The method comprises the steps of starting a task arrangement process of a business process in response to a business process design instruction; in the task arrangement process, circularly executing the following operations until a task termination instruction is received, and terminating the cyclic operation: receiving a to-be-executed task instruction; according to the to-be-executed task instruction, a task triple of a to-be-executed task is obtained, and the task triple comprises a task type, an operation object and an operation instruction of the to-be-executed task; and positioning a target operation control for executing the to-be-executed task in the current operation interface according to the task triad, and executing the to-be-executed task based on the target operation control.

Description

Technical Field

[0001] The present application relates to the field of automation technology, and in particular to a business process automation method and related equipment. Background Art

[0002] Robotic Process Automation (RPA) is a lightweight application technology that can replace or assist users in completing repetitive business processes on digital devices such as computers and mobile phones by simulating user operations. For example, it can help users click buttons, fill out forms, move files, and so on by simulating the interaction between users and the operation interface.

[0003] One of the foundations for implementing RPA technology is to accurately configure the specific control positions and operation instructions of the operation interface to obtain the configuration information of the Robotic Process Automation (RPA) (referred to as RPA configuration information). Only based on such configuration information can the accurate identification and operation of the interface elements (i.e., the objects to be operated) on the operation interface be supported. This makes RPA technology face such a problem: when the control layout of the operation interface itself based on the configured RPA configuration information changes, the configured RPA configuration information will be invalid, resulting in the interruption of the automated operation of the business process executed based on the RPA configuration information. In addition, if the automated operation of the business process is to be restored, the business process needs to be reconfigured, which seriously affects the flexibility of the business process. Summary of the invention

[0004] An embodiment of the present application provides a business process automation method to solve the problem in the prior art that when the control layout of the operation interface itself based on the already configured RPA configuration information changes, the already configured RPA configuration information will be invalidated, thereby causing the business process automation operation to be interrupted.

[0005] The embodiments of the present application also provide a business process automation device, an electronic device, a computer-readable storage medium, and a computer program product.

[0006] The present application embodiment adopts the following technical solutions: In a first aspect, the present application provides a business process automation method, comprising: In response to the business process design instruction, start the task orchestration process of the business process; During the task scheduling process, the following operations are executed cyclically until the task termination instruction is received and the cyclic operation is terminated: Receive instructions for tasks to be performed; According to the task instruction to be executed, a task triplet of the task to be executed is obtained, wherein the task triplet includes a task type, an operation object and an operation instruction of the task to be executed; A target operation control for executing the task to be executed is located in the current operation interface according to the task triplet, and the task to be executed is executed based on the target operation control.

[0007] Optionally, if the task to be executed is a nested task, a task triplet of the task to be executed is obtained according to the task instruction to be executed. The task triplet includes the task type, operation object and operation instruction of the task to be executed, including: According to the task instruction to be executed, determine the task execution order of multiple nested subtasks contained in the task to be executed; According to the task execution order, a task triplet of each nested subtask in the multiple nested subtasks is obtained respectively.

[0008] Optionally, according to the task instruction to be executed, a task triplet of the task to be executed is obtained, where the task triplet includes the task type, operation object and operation instruction of the task to be executed, including: The task instructions to be executed are semantically parsed and task decomposed to obtain the task triples to be executed.

[0009] Optionally, locating a target operation control for executing the task to be executed in the current operation interface according to the task triplet, and executing the task to be executed based on the target operation control, includes: According to the task type and operation object in the task triplet, locate the target operation control in the current operation interface; According to the operation instruction in the task triplet, the operation instruction is executed on the target operation control to execute the task to be executed.

[0010] Optionally, the method further includes: If the task type in the task triplet cannot be obtained according to the task instruction to be executed, the user is prompted to resend the task instruction to be executed.

[0011] Optionally, the method further includes: When executing the task to be executed according to the task triplet, if the current operation interface does not contain the operation object in the task triplet, the user is prompted to re-specify a new operation object.

[0012] Optionally, the method further includes: Save the task triplet of the task to be executed as a reusable task script.

[0013] In a second aspect, the present application provides a business process automation device, including a startup module and a cyclic operation module, wherein: A start module, used to start the task scheduling process of the business process in response to the business process design instruction; The loop operation module is used to loop the following operations during the task scheduling process until the loop operation is terminated when a task termination instruction is received: Receive instructions for tasks to be performed; According to the task instruction to be executed, a task triplet of the task to be executed is obtained, wherein the task triplet includes a task type, an operation object and an operation instruction of the task to be executed; A target operation control for executing the task to be executed is located in the current operation interface according to the task triplet, and the task to be executed is executed based on the target operation control.

[0014] Optionally, if the task to be executed is a nested task, the loop operation module is used to: According to the task instruction to be executed, determine the task execution order of multiple nested subtasks contained in the task to be executed; According to the task execution order, a task triplet of each nested subtask in the multiple nested subtasks is obtained respectively.

[0015] Optional, loop operation module for: The task instructions to be executed are semantically parsed and task decomposed to obtain the task triples to be executed.

[0016] Optional, loop operation module for: According to the task type and operation object in the task triplet, locate the target operation control in the current operation interface; According to the operation instruction in the task triplet, the operation instruction is executed on the target operation control to execute the task to be executed.

[0017] Optionally, the device is also used for: If the task type in the task triplet cannot be obtained according to the task instruction to be executed, the user is prompted to resend the task instruction to be executed.

[0018] Optionally, the device is also used for: When executing the task to be executed according to the task triplet, if the current operation interface does not contain the operation object in the task triplet, the user is prompted to re-specify a new operation object.

[0019] Optionally, the device is also used for: Save the task triplet of the task to be executed as a reusable task script.

[0020] In a third aspect, the present application provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the business process automation method as described above.

[0021] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the business process automation method described above are implemented.

[0022] In a fifth aspect, the present application provides a computer program product, including a computer program, which implements the business process automation method as described above when executed by a processor.

[0023] At least one of the above technical solutions adopted in the embodiments of the present application can achieve the following beneficial effects: By adopting the method provided in the embodiment of the present application, when it is necessary to design a business process, the task triplet of the task to be executed can be obtained according to the received instruction of the task to be executed, and then the target operation control for executing the task to be executed can be located in the current operation interface according to the task triplet, and finally the task to be executed is executed based on the target operation control. In this way, since the target operation control for executing the task to be executed can be located by the task triplet, it is not necessary to accurately configure the specific control position of the operation interface, nor is it necessary to configure the RPA configuration information, thereby avoiding the problem in the prior art that when the control layout of the operation interface itself based on the RPA configuration information that has been configured changes, the RPA configuration information that has been configured will be invalidated, thereby causing the business process automation operation to be interrupted.

[0024] In addition, by adopting the method provided in the embodiment of the present application, even if the control layout of the operation interface itself changes, the target operation control used to execute the task to be executed can still be accurately located according to the task triplet, thereby ensuring the normal execution of the business process and improving the flexibility of business process automation. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings: Figure 1 A schematic diagram of an implementation flow of a business process automation method provided in an embodiment of the present application; Figure 2 A specific structural diagram of a business process automation device is provided for an embodiment of the present application; Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0027] The technical solutions provided by various embodiments of the present application are described in detail below in conjunction with the accompanying drawings.

[0028] Example 1 In order to solve the problem in the prior art that when the control layout of the operation interface itself based on the already configured RPA configuration information changes, the already configured RPA configuration information will be made invalid, thereby causing the business process automation operation to be interrupted, an embodiment of the present application provides a business process automation method.

[0029] The execution subject of the method may be various types of computing devices, or an application or application (Application, APP) installed on the computing device. The computing device may be, for example, a user terminal such as a mobile phone, a tablet computer, a smart wearable device, or a server.

[0030] For ease of description, the present application embodiment takes the execution subject of the method as an example of a server to introduce the method. Those skilled in the art can understand that the present application embodiment takes the server as an example to introduce the method, which is only an exemplary description and does not limit the scope of protection of the claims corresponding to the present solution.

[0031] Specifically, the implementation process of the method provided in the embodiment of the present application is as follows: Figure 1 As shown, the following steps are included: Step 11: In response to the business process design instruction, start the task scheduling process of the business process.

[0032] Among them, business process design instructions refer to instructions generated by user input, system triggering or preset logic, which are used to initiate business process design operations. The instructions may contain parameters, goals or execution conditions related to process design to guide process modeling tools or automated design systems to start specific business process design tasks.

[0033] For example, in an optional implementation, the user can initiate a business process design instruction by voice input based on a microphone device. Alternatively, the user can directly enter a text command in the system interface for business process design through a keyboard, such as entering "start process design" or filling in specific process parameters to trigger the instruction.

[0034] Alternatively, the user may initiate a business process design instruction by clicking a preset button or icon in a system interface for business process design.

[0035] It should be noted that the above-mentioned method of initiating business process design instructions is only an exemplary description of the embodiment of the present application and does not impose any limitation on the embodiment of the present application.

[0036] In an embodiment of the present application, after receiving a business process design instruction, the task scheduling process of the business process can be started in response to the business process design instruction.

[0037] Optionally, in an embodiment of the present application, after the task scheduling process of the business process is started, a prompt message can be sent to the user so that the user can send instructions for the tasks to be executed, thereby realizing task scheduling.

[0038] For example, the user may be prompted to send instructions for the task to be executed by voice, for example, voice prompt information such as "Please tell me the first task", "Please tell me the next task" and the like may be played to the user.

[0039] Step 12: During the task scheduling process, receive instructions for tasks to be executed.

[0040] Among them, the pending task instruction refers to a clear operation instruction sent to the business process system (that is, the system used to design the business process) to trigger the execution of a specific task. In the embodiment of the present application, the pending task instruction may include the specific content of the pending task, the execution target and related parameters, etc., to guide the business process system to start and execute a specific task according to the preset logic and rules.

[0041] In the embodiment of the present application, after starting the task scheduling process of the business process, the user can send a to-be-executed task instruction to the system used for business process design.

[0042] Optionally, in an embodiment of the present application, a user may send instructions for tasks to be executed to a system for business process design through voice interaction or text input.

[0043] For example, taking voice interaction as an example, the user can send to the system used for business process design, such as, "open XXX page", "click XX login button", "click the verification code", "enter XXXXX information in the input box below XX policy number" or "save the picture of the vehicle on XX page to XXX path" to wait for the execution of task instructions.

[0044] It should be noted that the above-mentioned method of sending instructions for tasks to be executed through voice interaction or text input is only an exemplary description of the embodiment of the present application and does not impose any limitation on the embodiment of the present application.

[0045] Step 13: According to the task instruction to be executed, a task triplet of the task to be executed is obtained. The task triplet includes the task type, operation object and operation instruction of the task to be executed.

[0046] The task type of the task to be executed is used to identify the functional attributes or objectives of the task to be executed. For example, the task type of the task to be executed can be used to determine whether the task to be executed is an approval task, a notification task, a data processing task, or a file operation task.

[0047] Optionally, in the embodiment of the present application, the task types of the tasks to be executed may include, for example, the following: 1) Mouse operation tasks, such as moving the mouse, clicking the mouse, dragging the mouse, etc.; 2) Keyboard operation tasks, including inputting characters, numbers, or performing operations such as space, back, enter, copy, cut, and paste.

[0048] 3) Common web page controls identification task, where common web page controls include address bar, verification code area, picture, table, drop-down menu, text input box, page turning button, login button, submit button, close button, etc.

[0049] 4) Text recognition tasks, such as using OCR and other recognition technologies to perform text recognition on all or part of the current page, and further locating the location of text containing keywords or text with similar semantics to keywords in the page based on box information.

[0050] 5) Image recognition tasks, including image classification (such as ID images, vehicle images, animal images, etc.), image element detection (such as license plates, faces, ear tags, logos, etc.), image content understanding (such as damaged vehicles, dead animals, group photos, etc.), recognition results including image area, image center position, image screenshots 6) File operation tasks, including opening files, reading files, writing files, saving files, etc. Correspondingly, file types can include text files, data tables, pictures, videos, audio, etc.

[0051] It should be noted that the task types of the tasks to be executed listed above are merely exemplary descriptions of the embodiments of the present application and do not impose any limitation on the embodiments of the present application.

[0052] The operation object of the task to be executed refers to the specific target of the task to be executed, that is, the content or entity targeted by the task to be executed. For example, the operation object of the task to be executed can be a file, database table, user, order, product, etc.

[0053] The operation instruction of the task to be executed refers to the specific task execution command used to execute the task to be executed, including information such as the actions or steps that need to be performed on the operation object, which is used to guide the business process system how to process the operation object.

[0054] It should be noted that, in an optional implementation, if the task to be executed is a nested task, then when obtaining the task triplet of the task to be executed according to the task instruction to be executed, the task execution order of the multiple nested subtasks contained in the task to be executed can be first determined according to the task instruction to be executed; then, according to the task execution order, the task triplet of each nested subtask in the multiple nested subtasks can be obtained respectively.

[0055] In the embodiment of the present application, when obtaining the task triplet of the task to be executed according to the task instruction to be executed, the task instruction to be executed can be parsed first to extract the key information in the task instruction to be executed, wherein the parsing process includes task type identification (that is, determining which type of the task to be executed described by the task instruction to be executed belongs to), operation object extraction and operation instruction analysis (that is, parsing the specific operation content required by the task to be executed). Then, the extracted key information is structured to generate the task triplet.

[0056] In an optional implementation, when obtaining the task triple of the task to be executed according to the task instruction to be executed, the task triple of the task to be executed may be obtained by semantically parsing and decomposing the task instruction to be executed.

[0057] In an optional implementation, if the task type in the task triplet cannot be obtained according to the task instruction to be executed, or it can also be understood that the task type acquisition fails, the user is prompted to resend the task instruction to be executed.

[0058] Step 14: locate a target operation control for executing the task to be executed in the current operation interface according to the task triplet, and execute the task to be executed based on the target operation control.

[0059] In an embodiment of the present application, the target operation control can be located in the current operation interface according to the task type and operation object in the task triplet; then, according to the operation instruction in the task triplet, the operation instruction is executed on the target operation control to execute the task to be executed.

[0060] In an optional implementation, when executing the to-be-executed task according to the task triplet, if the current operation interface does not contain the operation object in the task triplet, the user is prompted to re-specify a new operation object.

[0061] In an optional implementation, the task triplet of the task to be executed can also be saved as a reusable task script, so that when the same task is to be executed later, the task script can be directly specified in the task scheduling process, thereby improving the task execution efficiency.

[0062] Step 15, determine whether a task termination instruction is received; if a task termination instruction is received, the task scheduling process ends; otherwise, if a task termination instruction is not received, the above steps 12 to 14 are executed in a loop until a task termination instruction is received, and the loop operation is terminated.

[0063] By adopting the method provided in the embodiment of the present application, when it is necessary to design a business process, the task triplet of the task to be executed can be obtained according to the received instruction of the task to be executed, and then the target operation control for executing the task to be executed can be located in the current operation interface according to the task triplet, and finally the task to be executed is executed based on the target operation control. In this way, since the target operation control for executing the task to be executed can be located by the task triplet, it is not necessary to accurately configure the specific control position of the operation interface, nor is it necessary to configure the RPA configuration information, thereby avoiding the problem in the prior art that when the control layout of the operation interface itself based on the RPA configuration information that has been configured changes, the RPA configuration information that has been configured will be invalidated, thereby causing the business process automation operation to be interrupted.

[0064] In addition, by adopting the method provided in the embodiment of the present application, even if the control layout of the operation interface itself changes, the target operation control used to execute the task to be executed can still be accurately located according to the task triplet, thereby ensuring the normal execution of the business process and improving the flexibility of business process automation.

[0065] Example 2 In order to solve the problem in the prior art that when the control layout of the operation interface itself based on the already configured RPA configuration information changes, the already configured RPA configuration information will be invalidated, thereby causing the business process automation operation to be interrupted, the embodiment of the present application provides a business process automation device, the specific structural diagram of the device is as follows Figure 2 As shown, it includes a start module 21 and a cycle operation module 22. The functions of each module are as follows: A starting module 21, used to start the task scheduling process of the business process in response to the business process design instruction; The loop operation module 22 is used to loop through the following operations during the task scheduling process until the loop operation is terminated upon receiving a task termination instruction: Receive instructions for tasks to be performed; According to the task instruction to be executed, a task triplet of the task to be executed is obtained, wherein the task triplet includes a task type, an operation object and an operation instruction of the task to be executed; A target operation control for executing the task to be executed is located in the current operation interface according to the task triplet, and the task to be executed is executed based on the target operation control.

[0066] Optionally, if the task to be executed is a nested task, the loop operation module 22 is used to: According to the task instruction to be executed, determine the task execution order of multiple nested subtasks contained in the task to be executed; According to the task execution order, a task triplet of each nested subtask in the multiple nested subtasks is obtained respectively.

[0067] Optionally, the cyclic operation module 22 is used to: The task instructions to be executed are semantically parsed and task decomposed to obtain the task triples to be executed.

[0068] Optionally, the cyclic operation module 22 is used to: According to the task type and operation object in the task triplet, locate the target operation control in the current operation interface; According to the operation instruction in the task triplet, the operation instruction is executed on the target operation control to execute the task to be executed.

[0069] Optionally, the device is also used for: If the task type in the task triplet cannot be obtained according to the task instruction to be executed, the user is prompted to resend the task instruction to be executed.

[0070] Optionally, the device is also used for: When executing the task to be executed according to the task triplet, if the current operation interface does not contain the operation object in the task triplet, the user is prompted to re-specify a new operation object.

[0071] Optionally, the device is also used for: Save the task triplet of the task to be executed as a reusable task script.

[0072] By using the device provided in the embodiment of the present application, when it is necessary to design a business process, the task triplet of the task to be executed can be obtained according to the received instruction of the task to be executed, and then the target operation control for executing the task to be executed can be located in the current operation interface according to the task triplet, and finally the task to be executed is executed based on the target operation control. In this way, since the target operation control for executing the task to be executed can be located by the task triplet, it is not necessary to accurately configure the specific control position of the operation interface, nor is it necessary to configure the RPA configuration information, thereby avoiding the problem in the prior art that when the control layout of the operation interface itself based on the RPA configuration information that has been configured changes, the RPA configuration information that has been configured will be invalidated, thereby causing the business process automation operation to be interrupted.

[0073] In addition, by adopting the method provided in the embodiment of the present application, even if the control layout of the operation interface itself changes, the target operation control used to execute the task to be executed can still be accurately located according to the task triplet, thereby ensuring the normal execution of the business process and improving the flexibility of business process automation.

[0074] Example 3 Figure 3 A hardware structure diagram of an electronic device for implementing each embodiment of the present application, the electronic device 300 includes but is not limited to: a radio frequency unit 301, a network module 302, an audio output unit 303, an input unit 304, a sensor 305, a display unit 306, a user input unit 307, an interface unit 308, a memory 309, a processor 310, and a power supply 311. Those skilled in the art can understand that Figure 3 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently. In the embodiments of the present application, the electronic device includes but is not limited to a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted terminal, a wearable device, and a pedometer.

[0075] The processor 310 is used to start the task scheduling process of the business process in response to the business process design instruction; in the task scheduling process, the following operations are executed cyclically until the cyclic operation is terminated when a task termination instruction is received: Receive instructions for tasks to be performed; According to the task instruction to be executed, a task triplet of the task to be executed is obtained, wherein the task triplet includes a task type, an operation object and an operation instruction of the task to be executed; A target operation control for executing the task to be executed is located in the current operation interface according to the task triplet, and the task to be executed is executed based on the target operation control.

[0076] Optionally, if the task to be executed is a nested task, a task triplet of the task to be executed is obtained according to the task instruction to be executed. The task triplet includes the task type, operation object and operation instruction of the task to be executed, including: According to the task instruction to be executed, determine the task execution order of multiple nested subtasks contained in the task to be executed; According to the task execution order, a task triplet of each nested subtask in the multiple nested subtasks is obtained respectively.

[0077] Optionally, according to the task instruction to be executed, a task triplet of the task to be executed is obtained, where the task triplet includes the task type, operation object and operation instruction of the task to be executed, including: The task instructions to be executed are semantically parsed and task decomposed to obtain the task triples to be executed.

[0078] Optionally, locating a target operation control for executing the task to be executed in the current operation interface according to the task triplet, and executing the task to be executed based on the target operation control, includes: According to the task type and operation object in the task triplet, locate the target operation control in the current operation interface; According to the operation instruction in the task triplet, the operation instruction is executed on the target operation control to execute the task to be executed.

[0079] Optionally, the method further includes: If the task type in the task triplet cannot be obtained according to the task instruction to be executed, the user is prompted to resend the task instruction to be executed.

[0080] Optionally, the method further includes: When executing the task to be executed according to the task triplet, if the current operation interface does not contain the operation object in the task triplet, the user is prompted to re-specify a new operation object.

[0081] Optionally, the method further includes: Save the task triplet of the task to be executed as a reusable task script.

[0082] The memory 309 is used to store a computer program that can be run on the processor 310. When the computer program is executed by the processor 310, the above functions implemented by the processor 310 are realized.

[0083] It should be understood that in the embodiment of the present application, the radio frequency unit 301 can be used for receiving and sending signals during information transmission or calls. Specifically, after receiving downlink data from the base station, it is sent to the processor 310 for processing; in addition, uplink data is sent to the base station. Generally, the radio frequency unit 301 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 301 can also communicate with the network and other devices through a wireless communication system.

[0084] The electronic device provides users with wireless broadband Internet access through the network module 302, such as helping users to send and receive emails, browse web pages, and access streaming media.

[0085] The audio output unit 303 can convert the audio data received by the RF unit 301 or the network module 302 or stored in the memory 309 into an audio signal and output it as sound. Moreover, the audio output unit 303 can also provide audio output related to a specific function performed by the electronic device 300 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 303 includes a speaker, a buzzer, a receiver, etc.

[0086] The input unit 304 is used to receive audio or video signals. The input unit 304 may include a graphics processor (GPU) 3041 and a microphone 3042. The graphics processor 3041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 306. The image frame processed by the graphics processor 3041 can be stored in the memory 309 (or other storage medium) or sent via the radio frequency unit 301 or the network module 302. The microphone 3042 can receive sound and can process such sound into audio data. The processed audio data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 301 in the case of a telephone call mode.

[0087] The electronic device 300 also includes at least one sensor 305, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 3061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 3061 and / or the backlight when the electronic device 300 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary, which can be used to identify the posture of the electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; the sensor 305 can also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be repeated here.

[0088] The display unit 306 is used to display information input by the user or information provided to the user. The display unit 306 may include a display panel 3061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0089] The user input unit 307 can be used to receive input digital or character information, and generate key signal input related to user settings and function control of the electronic device. Specifically, the user input unit 307 includes a touch panel 3071 and other input devices 3072. The touch panel 3071, also known as a touch screen, can collect user touch operations on or near it (such as operations performed by users using fingers, styluses, or any other suitable objects or accessories on or near the touch panel 3071). The touch panel 3071 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact point coordinates, and then sends it to the processor 310, receives the command sent by the processor 310 and executes it. In addition, the touch panel 3071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 3071, the user input unit 307 may also include other input devices 3072. Specifically, other input devices 3072 may include but are not limited to a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail here.

[0090] Furthermore, the touch panel 3071 may be overlaid on the display panel 3061. When the touch panel 3071 detects a touch operation on or near it, it is transmitted to the processor 310 to determine the type of touch event. Then, the processor 310 provides corresponding visual output on the display panel 3061 according to the type of touch event. Figure 3 In the figure, the touch panel 3071 and the display panel 3061 are used as two independent components to realize the input and output functions of the electronic device. However, in some embodiments, the touch panel 3071 and the display panel 3061 can be integrated to realize the input and output functions of the electronic device, which is not limited here.

[0091] The interface unit 308 is an interface for connecting an external device to the electronic device 300. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 308 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic device 300 or may be used to transmit data between the electronic device 300 and an external device.

[0092] The memory 309 can be used to store software programs and various data. The memory 309 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 309 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0093] The processor 310 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing software programs and / or modules stored in the memory 309 and calling data stored in the memory 309, it performs various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole. The processor 310 may include one or more processing units; preferably, the processor 310 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 310.

[0094] The electronic device 300 may also include a power source 311 (such as a battery) for supplying power to various components. Preferably, the power source 311 may be logically connected to the processor 310 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.

[0095] In addition, the electronic device 300 includes some functional modules not shown, which will not be described in detail here.

[0096] Preferably, an embodiment of the present application also provides an electronic device, including a processor 310, a memory 309, and a computer program stored in the memory 309 and executable on the processor 310. When the computer program is executed by the processor 310, each process of the above-mentioned business process automation method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0097] The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, each process of the above-mentioned business process automation method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. The computer-readable storage medium is, for example, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0098] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0099] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0100] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0101] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0102] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0103] Memory may include non-permanent storage in a computer-readable medium, in the form of random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0104] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0105] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0106] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A business process automation method, characterized in that: include: In response to the business process design instruction, start the task orchestration process of the business process; In the task scheduling process, the following operations are executed cyclically until the cyclic operation is terminated when a task termination instruction is received: Receive instructions for tasks to be performed; According to the to-be-executed task instruction, a task triplet of the to-be-executed task is acquired, wherein the task triplet includes a task type, an operation object, and an operation instruction of the to-be-executed task; A target operation control for executing the task to be executed is located in the current operation interface according to the task triplet, and the task to be executed is executed based on the target operation control.

2. The method according to claim 1, characterized in that If the task to be executed is a nested task, a task triplet of the task to be executed is obtained according to the task instruction to be executed, wherein the task triplet includes the task type, operation object and operation instruction of the task to be executed, including: Determining, according to the to-be-executed task instruction, a task execution order of a plurality of nested subtasks included in the to-be-executed task; According to the task execution order, a task triplet of each nested subtask in the multiple nested subtasks is obtained respectively.

3. The method according to claim 1 or 2, characterized in that According to the task instruction to be executed, a task triplet of the task to be executed is obtained, wherein the task triplet includes the task type, operation object and operation instruction of the task to be executed, including: The to-be-executed task instruction is semantically parsed and task-decomposed to obtain the task triplet of the to-be-executed task.

4. The method according to claim 1, characterized in that Locating a target operation control for executing the task to be executed in the current operation interface according to the task triplet, and executing the task to be executed based on the target operation control, including: Positioning the target operation control in the current operation interface according to the task type and the operation object in the task triplet; According to the operation instruction in the task triplet, the operation instruction is executed on the target operation control to execute the task to be executed.

5. The method according to claim 1, characterized in that The method further comprises: If the task type in the task triplet cannot be obtained according to the task instruction to be executed, the user is prompted to resend the task instruction to be executed.

6. The method according to claim 1, characterized in that The method further comprises: When executing the to-be-executed task according to the task triplet, if the current operation interface does not include the operation object in the task triplet, the user is prompted to re-specify a new operation object.

7. The method according to claim 1, characterized in that The method further comprises: The task triplet of the task to be executed is saved as a reusable task script.

8. A business process automation device, characterized in that: It includes a startup module and a cycle operation module, wherein: A start module, used to start the task scheduling process of the business process in response to the business process design instruction; The loop operation module is used to loop through the following operations during the task scheduling process until the loop operation is terminated upon receiving a task termination instruction: Receive instructions for tasks to be performed; According to the to-be-executed task instruction, a task triplet of the to-be-executed task is acquired, wherein the task triplet includes a task type, an operation object, and an operation instruction of the to-be-executed task; A target operation control for executing the task to be executed is located in the current operation interface according to the task triplet, and the task to be executed is executed based on the target operation control.

9. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, the steps of the business process automation method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the business process automation method according to any one of claims 1 to 7 are implemented.

11. A computer program product, characterized in that It comprises a computer program, which, when executed by a processor, implements the business process automation method according to any one of claims 1 to 9.

Images