RPA rule generation operation panel
By designing a compact and universal RPA rule generation operation panel and using various hardware devices, the problem of automating robotic processes on workstations where software cannot be installed has been solved. It enables automatic keyboard and mouse operation without the need for software installation, improving the display effect on large screens and ease of operation.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-11-20
- Publication Date
- 2026-03-31
AI Technical Summary
Traditional RPA rule generation requires software to be installed on the host, which makes it impossible to automate robotic process operations on workstations where the software cannot be installed, and the host screens of multiple production systems cannot be operated jointly in a tightly isolated network.
Design an RPA rule generation operation panel, using compact and universal hardware devices, and achieve automatic keyboard and mouse operation without the need for software installation through multiple modes such as USB keyboard and mouse, USB serial port, and 5V serial port, supporting various working scenarios.
It enables automatic keyboard and mouse operation on workstations across multiple production systems without the need for software installation, improving the large-screen display effect and ease of operation.
Smart Images

Figure FT_1 
Figure FT_2 
Figure FT_3
Abstract
Description
Technical Field
[0001] This invention relates to the field of Robotic Process Automation (RPA), and more particularly to an RPA rule generation operation panel. Background Technology
[0002] Traditionally, RPA rule generation is performed within the RPA software installed on the host machine. However, for applications that urgently require RPA functionality but cannot install RPA software, such as in large-screen displays, multiple production system host screens are typically projected onto different areas of a large screen. These workstations are usually not allowed to have RPA software installed, and these systems are either not on the same network or are tightly isolated. To improve the display effect, it is necessary to perform RPA (Robotic Process Automation) collaborative operation on these large-screen workstations. Therefore, an RPA rule generation control panel needs to be developed to enable automatic keyboard and mouse operation on these workstations, without requiring any software installation on the target workstations or network support. Summary of the Invention
[0003] To address the aforementioned problems, this invention provides a compact, versatile, and easy-to-operate RPA rule generation control panel. This device has multiple modes and can adapt to various working environments, including USB keyboard and mouse, USB serial port, and 5V serial port.
[0004] To achieve the above objectives, the present invention provides an RPA rule generation operation panel, including: The I / O pins of the mouse touch screen IC2 and the microcontroller IC1 2 The C port is connected to I2C1, and the keyboard / touchscreen IC3 is connected to the I2C1 of the microcontroller IC1. 2 The C port is connected to I2C2, and the button array IC4 is connected to multiple I / O ports of the microcontroller IC1. Flash chip IC5 is connected to the SPI interface of microcontroller IC1; The Vcc1 pin of USB socket J1 is connected to one end of fuse F1, and the other end of fuse F1 is connected to the Vcc pin of microcontroller IC1. The D+ and D- pins of USB socket J1 are connected to the D+ and D- pins of microcontroller IC1, respectively. The ground pin Gnd of USB socket J1 is connected to the Gnd pin of microcontroller IC1. The keyboard touchscreen IC3 consists of a touchscreen controller IC6 and a mutual capacitance touchscreen IC7. The horizontal electrodes of the mutual capacitance touchscreen IC7 are connected to the Xn, Xn+1, Yn, and Yn+1 pins of the touchscreen controller IC6 in a top-to-bottom and left-to-right order, respectively. The power supply Vcc and ground Gnd pins of the touchscreen controller IC6 are connected to the Vcc and Gnd pins of the microcontroller IC1, respectively. The touchscreen controller IC6 connects via I... 2 The C port I2C2 interface is connected to the microcontroller's I... 2 The C port is connected to I2C2, and n represents the number of electrodes; The mouse touchscreen IC2 consists of a touchscreen controller IC8 and a surface capacitive touchscreen IC9. The four corner electrodes of the surface capacitive touchscreen IC9 are connected sequentially to the X+, X-, Y+, and Y- pins of the touchscreen controller IC8 in a horizontal order from left to right and a vertical order from top to bottom. The power supply Vcc and ground Gnd pins of the touchscreen controller IC8 are connected to the Vcc and Gnd pins of the microcontroller IC1, respectively. The touchscreen controller IC8 connects via I... 2 The C port I2C1 connects to the microcontroller IC1. 2 Connected to port C via I2C1; The button array IC4 consists of a microcontroller IC4 and multiple button circuits. Each button circuit consists of a current-limiting resistor Rn and a single-pole button switch Kn. One end of the current-limiting resistor Rn is connected to the Vcc pin of the button array IC4, and the other end of the current-limiting resistor Rn is connected to one end of the single-pole button switch Kn. The other end of the single-pole button switch Kn is connected to an IO pin ION of the button array IC4.
[0005] In the preferred mode, the microcontroller IC4 determines the open / closed state of Kn by sampling the high / low level of the ION pin, with a high level indicating that it is closed.
[0006] In the preferred mode, the microcontroller IC1 has four operating modes: In the keyboard and mouse combo mode, the microcontroller IC1 is automatically recognized as a keyboard and mouse combo device on the connected host, used to perform keyboard and mouse interactive operations on the host or to perform automatic keyboard and mouse operations according to the set RPA rules. In 5V serial port mode, the microcontroller IC1 and other 5V intelligent electronic devices directly use serial communication to output serial control messages according to the set RPA rules. In USB serial port mode, the microcontroller IC1 is automatically recognized as a USB serial port device on the connected host, and can interact with specific applications on the host or output serial port control messages to the host application according to the set RPA rules. In USB flash drive configuration mode, the microcontroller IC1 is automatically recognized as a USB flash drive on the connected host or smartphone. Users can redefine button functions and edit RPA rules by modifying the configuration file on the USB flash drive. The four working modes can be switched by entering a keypad password.
[0007] In the preferred mode, when the microcontroller operates in keyboard and mouse combined mode, the records of simulated operations generated by the user through the mouse touch screen, keyboard touch screen, and key array are stored in the Flash chip IC5 in the form of a token sequence. When RPA is executed, the microcontroller restores the token sequence to the simulated keyboard and mouse operation process.
[0008] In the preferred mode, when the microcontroller is operating in 5V serial port mode or USB serial port mode, the records of RPA rule generation simulation operations performed by the user through mouse touch screen, keyboard touch screen, or key array are stored in the Flash chip in the form of serial port protocol message waveform recording. When RPA is executed, the microcontroller sends the recorded serial port protocol message to the other party.
[0009] In the preferred mode, when the microcontroller is working in USB flash drive configuration mode, there is a text configuration file on the USB flash drive. The user can modify it through the host's text editor to redefine button functions, change the logical relationship of RPA rules, etc. When the microcontroller is working in keyboard and mouse combined mode and serial port mode, it will automatically read this configuration file and run according to its configuration.
[0010] In the preferred embodiment, the Flash chip IC5 stores the keyboard and mouse operation sequence records that constitute the RPA rules, including the waiting time between two adjacent operations.
[0011] The beneficial effects of the present invention are as follows: The device of the present invention implements RPA function in hardware, and has the characteristics of small size, strong versatility and convenient operation. It can adapt to most working scenarios and does not require software installation on the target host. Attached Figure Description
[0012] Figure 1 This is the overall circuit schematic diagram of the present invention; Figure 2 This is a schematic diagram of the keyboard touchscreen circuit of the present invention; Figure 3 This is a schematic diagram of the mouse touch screen circuit of the present invention; Figure 4 This is a schematic diagram of the key array circuit of the present invention. Detailed Implementation
[0013] Example 1: This invention consists of five parts: a microcontroller IC1, a mouse touch screen IC2, a keyboard touch screen IC3, a key array IC4, and a USB socket J1.
[0014] like Figure 1 As shown, the microcontroller IC1 has three operating modes: First, the keyboard and mouse combo mode, where the microcontroller IC1 is automatically recognized as a keyboard and mouse combo device on the connected host, used for keyboard and mouse interaction with the host or automatic keyboard and mouse operations according to set RPA rules; second, the 5V serial port mode, where the microcontroller IC1 can directly communicate with other 5V smart electronic devices via serial port, used to output serial control messages according to set RPA rules; third, the USB serial port mode, where the microcontroller IC1 is automatically recognized as a USB serial port device on the connected host, used to interact with specific applications on the host or output serial control messages to the host application according to set RPA rules; and fourth, the USB flash drive configuration mode, where the microcontroller IC1 is automatically recognized as a USB flash drive on the connected host or smartphone, allowing users to redefine button functions and edit RPA rules by modifying the configuration file on the USB flash drive. These four operating modes can be switched by entering a button operation password.
[0015] like Figure 2 As shown, the keyboard touchscreen IC3 consists of a touchscreen controller IC6 and a mutual capacitance touchscreen IC7. The four corner electrodes of the mutual capacitance touchscreen IC7 are connected to the Xn, Xn+1, Yn, and Yn+1 pins of the touchscreen controller IC6 in the horizontal direction (left to right) and the vertical direction (top to bottom). The power supply Vcc and ground Gnd pins of the touchscreen controller IC6 are connected to the Vcc and Gnd pins of IC1, respectively. The touchscreen controller IC6 connects to IC1 via I... 2 C port I2C2 and IC1 I 2 The C port is connected via I2C2.
[0016] like Figure 3 As shown, the mouse touchscreen IC2 consists of a touchscreen controller IC8 and a surface capacitive touchscreen IC9. The horizontal electrodes of the surface capacitive touchscreen IC9 are connected to the X+, X-, Y+, and Y- pins of the touchscreen controller IC8 in a top-to-bottom and left-to-right order, respectively. The power supply Vcc and ground Gnd pins of the touchscreen controller IC8 are connected to the Vcc and Gnd pins of the microcontroller IC1, respectively. The touchscreen controller IC8 connects to the touchscreen controller IC8 via I... 2 The C port I2C1 interface connects to the microcontroller's I / O port. 2 The C port is connected to I2C1. In this embodiment, the surface capacitive touch screen IC9 has 25 horizontal electrodes and 25 vertical electrodes.
[0017] like Figure 4As shown, the button array IC4 has 14 buttons. One end of each button is connected to one of the 14 IO ports of the microcontroller IC1, and the other end of the button is connected to one end of a current-limiting resistor. The other end of the current-limiting resistor is connected to the power supply Vcc. This is used for button operations such as password input and one-key execution of RPA rules.
[0018] The Flash chip IC5 is connected to the SPI interface of the microcontroller IC1 and is used to store the keyboard and mouse operation sequence records that constitute the RPA rules and the logical calling relationship between these records.
[0019] The USB socket J1 is used to connect to external devices using a USB cable.
[0020] When the microcontroller IC1 is working in keyboard and mouse combined mode, the records of the simulated operations generated by the user through the mouse touch screen IC2, keyboard touch screen IC3, and button array IC4 are stored in the Flash chip IC5 in the form of a token sequence. When the RPA is executed, the microcontroller IC1 restores the token sequence to the simulated keyboard and mouse operation process.
[0021] When the microcontroller IC1 operates in 5V serial port mode or USB serial port mode, the records of the simulated operations generated by the user through the mouse touch screen IC2, keyboard touch screen IC3, and key array IC4 are stored in the Flash chip IC5 in the form of serial port protocol message recording. When RPA is executed, the microcontroller IC1 sends the recorded serial port protocol message to the other party.
[0022] When the microcontroller IC1 operates in USB flash drive configuration mode, the USB flash drive contains a text configuration file named RPA.txt. Users can modify this file using the host computer's text editor to redefine button functions, change the logical relationships of RPA rules, etc. When the microcontroller IC1 operates in keyboard / mouse combined mode and serial port mode, it will automatically read this configuration file and run according to its configuration. The configuration file format is as follows: [Explanation of the symbol m] The symbol m represents command 1; command 2; ... command n; In this embodiment, the keyboard and mouse operation sequence records that constitute the RPA rules stored in IC5 include the waiting time between two adjacent operations, such as: the command dely4, which represents a delay of 4 seconds.
[0023] In this embodiment, the RPA rule generation operation panel draws power via a USB interface.
[0024] In this embodiment, the USB socket J1 is a Type A USB socket. Example
[0025] An RPA rule generation operation panel includes: a mouse touch screen IC2 and a microcontroller IC1. 2 The C port is connected via I2C1 for mouse operation; The keyboard touch screen IC3 and the microcontroller IC1's I 2 The C port is connected via I2C2 for keyboard operation; The button array IC4 is connected to multiple IO ports of the microcontroller IC1 for password input and one-key execution of RPA rule button operations; Flash chip IC5 is connected to the SPI interface of microcontroller IC1 and is used to store the keyboard and mouse operation sequence records that constitute RPA rules and the logical calling relationship between these records. USB socket J1 is used to connect to the USB port of an external device via a USB cable. The Vcc1 pin of USB socket J1 is connected to one end of fuse F1, and the other end of fuse F1 is connected to the Vcc pin of microcontroller IC1. Fuse F1 is used to protect the USB port of the external device from overcurrent damage. The D+ and D- pins of USB socket J1 are connected to the D+ and D- pins of microcontroller IC1 respectively for data transmission. The ground pin Gnd of USB socket J1 is connected to the Gnd pin of microcontroller IC1. An RPA rule generation operation panel draws power from the USB port of the external device through USB socket J1 and USB cable. The keyboard touchscreen IC3 consists of a touchscreen controller IC6 and a mutual capacitance touchscreen IC7. The horizontal electrodes of the mutual capacitance touchscreen IC7 are connected to the Xn, Xn+1, Yn, and Yn+1 pins of the touchscreen controller IC6 in a top-to-bottom and left-to-right order, respectively. The power supply Vcc and ground Gnd pins of the touchscreen controller IC6 are connected to the Vcc and Gnd pins of the microcontroller IC1, respectively. The touchscreen controller IC6 connects via I... 2 The C port I2C2 interface is connected to the microcontroller's I... 2 The C port is connected to I2C2, and n represents the number of electrodes; The mouse touchscreen IC2 consists of a touchscreen controller IC8 and a surface capacitive touchscreen IC9. The four corner electrodes of the surface capacitive touchscreen IC9 are connected sequentially to the X+, X-, Y+, and Y- pins of the touchscreen controller IC8 in a horizontal order from left to right and a vertical order from top to bottom. The power supply Vcc and ground Gnd pins of the touchscreen controller IC8 are connected to the Vcc and Gnd pins of the microcontroller IC1, respectively. The touchscreen controller IC8 connects via I... 2 The C port I2C1 connects to the microcontroller IC1. 2 Connected to port C via I2C1; The button array IC4 consists of a microcontroller IC4 and multiple button circuits. Each button circuit consists of a current-limiting resistor Rn and a single-pole button switch Kn. One end of the current-limiting resistor Rn is connected to the Vcc pin of the button array IC4, and the other end of the current-limiting resistor Rn is connected to one end of the single-pole button switch Kn. The other end of the single-pole button switch Kn is connected to an IO pin ION of the button array IC4. The microcontroller IC4 determines the open / closed state of Kn by sampling the high / low level of the ION pin. A high level indicates that the button is closed. The microcontroller IC1 has four operating modes: In the keyboard and mouse combo mode, the microcontroller IC1 is automatically recognized as a keyboard and mouse combo device on the connected host, used to perform keyboard and mouse interactive operations on the host or to perform automatic keyboard and mouse operations according to the set RPA rules. In 5V serial port mode, the microcontroller IC1 and other 5V intelligent electronic devices directly use serial communication to output serial control messages according to the set RPA rules. In USB serial port mode, the microcontroller IC1 is automatically recognized as a USB serial port device on the connected host, and can interact with specific applications on the host or output serial port control messages to the host application according to the set RPA rules. In USB flash drive configuration mode, the microcontroller IC1 is automatically recognized as a USB flash drive on the connected host or smartphone. Users can redefine button functions and edit RPA rules by modifying the configuration file on the USB flash drive. The four working modes can be switched by entering a keypad password; When the microcontroller IC1 is working in keyboard and mouse combined mode, the records of simulated operations generated by the user through the mouse touch screen, keyboard touch screen, and key array are stored in the Flash chip in the form of a token sequence. When RPA is executed, the microcontroller restores the token sequence to the simulated keyboard and mouse operation process. When the microcontroller C1 is working in 5V serial port mode or USB serial port mode, the records of the simulated operations generated by the user through the mouse touch screen, keyboard touch screen, or key array for RPA rule generation are stored in the Flash chip in the form of serial port protocol message waveform recording. When RPA is executed, the microcontroller sends the recorded serial port protocol message to the other party. When the C1 microcontroller is working in USB flash drive configuration mode, there is a text configuration file on the USB flash drive. Users can modify it through the host's text editor to redefine button functions, change the logical relationship of RPA rules, etc. When the microcontroller is working in keyboard and mouse combined mode and serial port mode, it will automatically read this configuration file and run according to its configuration. The keyboard and mouse operation sequence records that constitute the RPA rules stored in the Flash chip include the waiting time between two adjacent operations.
[0026] The above are merely preferred embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any equivalent substitutions or modifications made by those skilled in the art within the scope of the technology disclosed in the present invention, based on the technical solution and inventive concept of the present invention, should be covered within the scope of protection of the present invention.
Claims
1. An RPA rule generation operations panel, characterized by, Comprise: Mouse touch screen IC2 is connected with I 2 C port I2C1 of keyboard touch screen IC3 is connected with I 2 C port I2C2 of key array IC4 is connected with multiple IO ports of single-chip microcomputer IC1, Flash chip IC5 and single-chip microcomputer IC1 SPI interface connected; USB socket J1 Vcc1 end foot connection fuse F1 one end, the other end of the fuse F1 connection single-chip microcomputer IC1 Vcc end foot, USB socket J1 D+, D- end foot and single-chip microcomputer IC1 D+, D- end foot connected, USB socket J1 ground end foot Gnd and single-chip microcomputer IC1 Gnd end foot connected; The keyboard touch screen IC 3 is composed of a touch screen controller IC 6 and a mutual capacitance touch screen IC 7, the horizontal electrodes of the mutual capacitance touch screen IC 7 are sequentially connected with the Xn, Xn+1, Yn, Yn+1 terminals of the touch screen controller IC 6 in the order of first up and then down and first left and then right, the power supply Vcc and ground Gnd terminals of the touch screen controller IC 6 are respectively connected with the Vcc and Gnd terminals of the single-chip microcomputer IC 1, the touch screen controller IC 6 is connected with the I 2 The C port I2C2 of the single-chip microcomputer is connected with the I 2 C port I2C2 of the touch screen controller IC 6, and n represents the number of electrodes. Mouse touch screen IC2 is composed of touch screen controller IC8 and surface capacitive touch screen IC9, four corner electrodes of surface capacitive touch screen IC9 are connected with X+, X-, Y+, Y- end feet of touch screen controller IC8 in turn according to the sequence of left first and right second horizontally and upper first and lower second vertically, power supply Vcc and ground Gnd end feet of touch screen controller IC8 are connected with Vcc and Gnd end feet of single-chip microcomputer IC1 respectively, touch screen controller IC8 is connected with I 2 C port I2C1 of single-chip microcomputer IC1 through I 2 C port I2C1 of single-chip microcomputer IC1. Key array IC4 by single-chip microcomputer IC4 and multiple groups of key circuit, each group of key circuit by a current limiting resistor Rn and a single knife key switch Kn composition, current limiting resistor Rn one end connection key array IC4 Vcc end foot, current limiting resistor Rn the other end connection single knife key switch Kn one end, single knife key switch Kn the other end connection key array IC4 IO end foot IOn connected.
2. The RPA rule generation operations panel of claim 1, wherein, Single-chip microcomputer IC4 through sampling IOn end foot level high and low to determine the Kn on-off state, high level represents the on position.
3. The RPA rule generation operations panel of claim 1, wherein, Single-chip microcomputer IC1 has four kinds of working mode: Keyboard mouse integration mode, single-chip microcomputer IC1 in the connected host computer is automatically identified as a keyboard mouse composite device, used for keyboard mouse interactive operation or set RPA rules for keyboard mouse automatic operation on the host computer; 5V serial mode, single-chip microcomputer IC1 and other 5V intelligent electronic equipment directly using serial communication, used for output serial control message according to the set RPA rules; USB serial mode, single-chip microcomputer IC1 in the connected host computer is automatically identified as a USB serial device, and the specific application program on the host computer interactive or according to the set RPA rules to host application output serial control message; U disk configuration mode, single-chip microcomputer IC1 in the connected host computer or smart phone is automatically identified as a U disk, the user through the modification of the configuration file on the U disk to redefine the key function and RPA rule editing; Four kinds of working mode can be switched by input key operation password.
4. The RPA rule generation operations panel of claim 3, wherein, Single-chip microcomputer working in keyboard mouse integration mode, the user through the mouse touch screen, keyboard touch screen, key array for RPA rule generation simulation operation record in the form of mark symbol sequence storage in Flash chip IC5, RPA execution, single-chip microcomputer will mark symbol sequence restore to the keyboard mouse operation process when simulation.
5. The RPA rule generation operations panel of claim 3, wherein, Single-chip microcomputer working in 5V serial mode or USB serial mode, the user through the mouse touch screen, keyboard touch screen, key array for RPA rule generation simulation operation record in the form of serial protocol message recording wave storage in Flash chip, RPA execution, single-chip microcomputer will send the recorded serial protocol message to the other party.
6. The RPA rule generation operations panel of claim 3, wherein, Single-chip microcomputer working in U disk configuration mode, there is a configuration file in the U disk, the user can modify it through the host computer text editor, redefine the key function, change the logic relationship of RPA rules, etc., single-chip microcomputer working in keyboard mouse integration mode and serial mode will automatically read this configuration file and run according to its configuration.
7. The RPA rule generation operations panel of claim 1, wherein, The flash chip IC5 stores the waiting time between two adjacent operations in the keyboard and mouse operation sequence record constituting the RPA rule.