Script analysis device and control script generation method

Abstract

A control script generation method is applied to a script analysis device and comprises the following steps: receiving a working picture provided by a host; identifying a plurality of operation objects in the working picture; receiving a control signal corresponding to the working picture; judging one of the operation objects corresponding to the target position of the control signal; and recording the control signal and the corresponding operation object as an operation instruction. Therefore, the operation instruction can be quickly and accurately generated.

Description

Technical Field

[0001] The present disclosure relates to the control technology of a machine, and particularly to a script analysis device and a control script generation method. Background Art

[0002] With the development of automation technology, various industrial machines are designed to perform various operations set by operators, thereby improving production efficiency. However, various machines still need to be operated by personnel and cannot be fully automated. Therefore, how to improve the existing system to enhance the automated operation of the machine has become a major issue at present. Summary of the Invention

[0003] The present disclosure relates to a control script generation method applied to a script analysis device, including: receiving a working screen provided by a host; identifying a plurality of operation objects in the working screen; receiving a control signal corresponding to the working screen; determining whether a target position of the control signal corresponds to one of the operation objects; and recording the control signal and the corresponding operation object as an operation instruction.

[0004] In an embodiment, the method for determining whether a target position of the control signal corresponds to one of the operation objects includes: determining whether the target position of the control signal corresponds to one of a plurality of operation areas in the working screen.

[0005] In an embodiment, the method for recording the control signal and the corresponding operation object as an operation instruction includes: obtaining an object image of one of the operation objects; and recording the control signal and the object image as an operation instruction.

[0006] In an embodiment, the host includes a first host and a second host, the control signal includes a first control signal corresponding to a first working screen of the first host, the control signal and one of the operation objects are recorded as a first operation instruction, and the control script generation method further includes: recording a switching instruction provided by the first host for the second host in a control script including the first operation instruction; receiving a second working screen provided by the second host; and recording a second operation instruction according to a second control signal corresponding to the second working screen.

[0007] In an embodiment, the first working screen includes a plurality of first operation objects, and the method for recording the second operation instruction includes: identifying a plurality of second operation objects in the second working screen; determining whether a target position of the second control signal corresponds to one of the second operation objects; and recording the second control signal and the corresponding second operation object as a second operation instruction in the control script.

[0008] The present disclosure also relates to a script analysis device, including a communication circuit and a processing circuit. The communication circuit is communicatively connected to at least one host to receive a working screen provided by the host and to receive a control signal. The processing circuit is coupled to the communication circuit to identify a plurality of operation objects in the working screen. The processing circuit is further configured to determine that the target position of the control signal corresponds to one of the operation objects, and record the control signal and the corresponding operation object as an operation instruction.

[0009] In an embodiment, the processing circuit determines whether the target position of the control signal corresponds to one of a plurality of operation areas in the working screen to record an operation instruction.

[0010] In an embodiment, the processing circuit is configured to obtain an object image of one of the operation objects to record the control signal and the object image as an operation instruction.

[0011] In an embodiment, the at least one host includes a first host and a second host, the control signal includes a first control signal corresponding to a first working screen of the first host, and the control signal and one of the operation objects are recorded as a first operation instruction. When the communication circuit receives a switching instruction provided by the first host for the second host, the processing circuit is configured to record the switching instruction in a control script including the first operation instruction, and record a second operation instruction according to a second control signal corresponding to a second working screen of the second host.

[0012] In an embodiment, the first working screen includes a plurality of first operation objects. The processing circuit is configured to identify a plurality of second operation objects in the second working screen. The processing circuit is further configured to determine that the target position of the second control signal corresponds to one of the second operation objects to record the second control signal and the corresponding second operation object as a second operation instruction in the control script.

[0013] Accordingly, by using the target position of the control signal to obtain a specific operation object and binding the control signal to the operation object to form an operation instruction, an automation control script applied to the machine can be accurately generated with streamlined steps. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 FIG. is a schematic diagram of an automatic control system applied according to some embodiments of the present disclosure.

[0015] Figure 2 FIG. is a schematic diagram of a working screen according to some embodiments of the present disclosure.

[0016] Figure 3 FIG. is a schematic diagram of an automatic control system applied according to some embodiments of the present disclosure.

[0017] Figures 4A - 4B Flowchart of a method for generating a control script according to some embodiments of the present disclosure.

[0018] Figure 5 Schematic diagram of a control script according to some embodiments of the present disclosure.

[0019] Figure 6 Schematic diagram of a multi-computer switcher applied according to some embodiments of the present disclosure.

[0020] Description of reference numerals:

[0021] 100: Automatic control system

[0022] 110: Host computer

[0023] 111: Operation screen

[0024] 120: Script analysis device

[0025] 200: Working screen

[0026] 300: Automatic control system

[0027] 310A - 310B: Host computer

[0028] 320: Script analysis device

[0029] 321: Communication circuit

[0030] 322: Processing circuit

[0031] 323: Image recognition model

[0032] 330: Input device

[0033] 500: Control script

[0034] 600: Control script

[0035] 610A - 610B: Host computer

[0036] PX: Operation area

[0037] P1 - P5: Operation objects

[0038] KVM: Multi-computer switcher

[0039] S401 - S412: Steps Detailed implementation manners

[0040] The following will disclose multiple embodiments of the present invention with the accompanying drawings. For the sake of clarity, many practical details will be described together in the following narrative. However, it should be understood that these practical details are not used to limit the present invention. That is to say, in some embodiments of the present invention, these practical details are not necessary. In addition, for the purpose of simplifying the drawings, some conventional existing structures and elements will be shown in a simple schematic manner in the drawings.

[0041] In this document, when an element is referred to as "connected" or "coupled", it may mean "electrically connected" or "electrically coupled". "Connected" or "coupled" can also be used to indicate the mutual cooperation operation or interaction between two or more elements. In addition, although terms such as "first", "second",... are used in this document to describe different elements, these terms are only used to distinguish elements or operations described with the same technical terms. Unless the context clearly indicates, these terms do not specifically refer to or imply an order or sequence, nor are they used to limit the present invention.

[0042] Figure 1 Shown is a schematic diagram of an automatic control system 100 according to some embodiments of the present disclosure. The automatic control system 100 includes at least one host 110 and a script analysis device 120. The host 110 can be a machine that performs a specific operation (such as a machine that controls various machines on a production line). In one embodiment, a working program is installed in the host 110. When the host 110 executes the working program, the host 110 will display a corresponding working screen on the operation screen 111, so that the operator can confirm the current working state and input corresponding instructions (such as: through the input device on the host 110).

[0043] The host 110 can execute corresponding actions in the working program according to the instructions input by the operator, such as: analyzing the received data, converting the received data (such as: encoding, decoding, arithmetic operation, integration or separation), assembling one or more specific parts, detecting the performance of a specific circuit, or transporting a specific device to a specified position.

[0044] The script analysis device 120 is communicatively connected to the host 110, for example, connected to the host through a data cable, or connected to the host 110 through a wireless network. When the host 110 executes the working program to generate a working screen, the script analysis device 120 will receive the working screen from the host 110 and identify multiple operation objects in the working screen. In one embodiment, when the host 110 executes the working program, it will simultaneously record the working screen and transmit the working screen to the script analysis device 120 in real time.

[0045] Please refer to Figure 2 , Figure 2The figure shows a schematic diagram of the working screen 200 according to some embodiments of the present disclosure. The working screen 200 includes a plurality of operation objects P1 to P5. When an operator inputs corresponding instructions (such as clicking, inputting data, dragging) to the operation objects P1 to P5 through an input device (the input device can be connected to the host or connected to the script analysis device 120, which will be described in detail in the following paragraphs), the host 110 will perform corresponding actions.

[0046] The operation objects P1 to P5 can be buttons, data fields, adjustment levers (such as can be dragged to select a specific proportional value) in the working screen 200, or can also be an area. For example, the operation object P1 is a tab button corresponding to the image / text "Properties". The operation objects P2 and P4 are a selection bar corresponding to the image / text "Extender" and "RS232". When the operation objects P2 and P4 are clicked, the program attributes of the operation objects P2 and P4 will change accordingly (for example: checked or unchecked). The operation object P3 is a drop-down menu. When the operation object P3 is clicked, a plurality of options will appear for further selection (or options can also be directly input using the input device). The operation object P5 is a button corresponding to the image / text "Save". When the button is clicked, the working program will execute a preset function or open / close a sub-screen. In other embodiments, the operation object can also be an image area. When the image area is clicked or selected, the working program will perform preset actions on the image in the area (such as magnifying, enhancing the resolution, obtaining the image, etc.), or further make the image area perform corresponding moving actions corresponding to the operator's control.

[0047] In some embodiments, the script analysis device 120 uses image recognition technology to identify a plurality of operation areas in the working screen 200 and sets each operation area as an operation object. Specifically, a variety of analysis images are stored in the script analysis device 120. Therefore, after receiving the working screen 200, the script analysis device 120 can determine whether there are areas in the working screen 200 that are the same or similar to the analysis images, and the identified areas are the "operation areas".

[0048] For example, if the script analysis device 120 determines that the image "Properties" is similar to the analysis image (such as similar to the pattern of a "tab button"), then the script analysis device 120 marks the image "Properties" as the operation area PX, and this marked operation area PX will also be set as the operation object P1. In other words, the script analysis device 120 identifies the operation objects P1 to P5 according to the "image similarity".

[0049] However, the method for identifying operating objects in the present disclosure is not limited to "comparing images". In other embodiments, the script analysis device 120 may also first establish an analysis model or a neural network through a large amount of machine learning. Accordingly, after the script analysis device 120 obtains the working screen 200, it can analyze the working screen 200 through the analysis model or the neural network to identify the operating objects P1 to P5.

[0050] After identifying the operating objects P1 to P5, if the script analysis device 120 receives a control signal corresponding to the working screen 200 (working procedure), the script analysis device 120 will further determine whether the target position of this control signal corresponds to any one of the operating objects P1 to P5. For example, when the script analysis device 120 determines that it has received a control signal of "mouse click", the script analysis device 120 further determines whether the position of the "mouse click" corresponds to any one of the operating objects P1 to P5 (i.e., any one of the previously identified operating areas).

[0051] Continuing from the above, if the target position of the control signal corresponds to any one of the operating objects P1 to P5, the script analysis device 120 will record this control signal and the corresponding operating object as an operation instruction. The operation instruction will be recorded as a control script. In other words, the control script contains one or more operation instructions, and there is a sequence between the multiple operation instructions. After generating the control script, the control script can be provided to the host 110 of the same model so that the host 110 can perform the same actions as the operation instructions.

[0052] In one embodiment, the recording method of the "operating object" is to obtain the object image of the operating object and record the object image and the corresponding control signal as an operation instruction. In another embodiment, the script analysis device 120 can also "record" the operation time of the "control signal" to record the operation time together with the object image and the control signal as an operation instruction. In other words, the operation instruction will include "control signal (e.g., mouse click)", "object image (e.g., the image of operating object P1)", and "operation time (e.g., the first time point)".

[0053] In one embodiment, the "control signal" can be generated by an input device connected to the script analysis device 120 (i.e., the input device is indirectly connected to the host 110 through the script analysis device 120). When the script analysis device 120 receives an input signal generated by the input device and determines that the input signal is for the working procedure, the script analysis device 120 will identify the input signal as a control signal. In another embodiment, the "control signal" can also be generated by an input device on the host, and the script analysis device 120 is used to monitor whether the input signal generated by the input device is for the working procedure.

[0054] The present disclosure is used to establish a "control script" so that the host 110 can automatically perform corresponding actions according to the control script without manual operation by the operator one by one. In order to apply the automatic control system 100 to various types of hosts 110, it is necessary to analyze the host 110 through the script analysis device 120 and record the operation process in a special form (i.e., including object images and control signals) in order to automatically and accurately generate a control script file.

[0055] Figure 3 The figure shows a schematic diagram of an automatic control system 300 according to some embodiments of the present disclosure. The automatic control system 300 includes one or more hosts (e.g., the first host 310A, the second host 310B) and a script analysis device 320.

[0056] The script analysis device 320 includes a communication circuit 321, a processing circuit 322, and an image recognition model 323. The processing circuit 322 is coupled to the communication circuit 321 and the image recognition model 323, and is connected to the hosts 310A, 310B through the communication circuit 321 for data transmission, where the communication circuit 321 includes a physical line or a wireless method, which is not limited in the present disclosure.

[0057] In one embodiment, the processing circuit 322 can be a central processing unit (CPU), a system on chip (SoC), an application processor, a digital signal processor, or a processing chip or controller with specific functions.

[0058] In one embodiment, the image recognition model 323 is stored in the storage memory of the script analysis device 320 and can be a neural network model, or include a comparison database (e.g., including various analysis images), or include a machine learning database.

[0059] In one embodiment, the script analysis device 320 is also coupled to an input device 330 for transmitting the input signal provided by the input device 330 to the hosts 310A, 310B. At the same time, the processing circuit 322 is used to detect / monitor the input signal. If the input signal corresponds to the working program running on the hosts 310A, 310B, the processing circuit 322 will recognize the input signal as a control signal.

[0060] For ease of explanation, the engineering program running in the first host 310A is referred to as the "first working program" herein. The first working program will generate a "first working screen", and the input signal corresponding to the first working screen is referred to as the "first control signal". Similarly, the engineering program running in the second host 310B is referred to as the "second working program" herein. The second working program will generate a "second working screen", and the input signal corresponding to the second working screen is referred to as the "second control signal".

[0061] Figures 4A - 4B The figure shows a flowchart of a method for generating a control script according to some embodiments of the present disclosure. Please refer to Figures 2 - 4B In step S401, the script analysis device 320 first connects to the first host 310A through the communication circuit 321 to receive the first working screen 200 of the first host 310A when executing the first working program (as Figure 2 shown).

[0062] In step S402, the processing circuit 322 identifies a plurality of operation objects P1 to P5 in the working screen 200. As described above, the processing circuit 322 can use the image recognition model 323 to perform image recognition on the working screen 200, and respectively set the identified plurality of operation areas PX as the first operation objects P1 to P5. For example, the processing circuit 322 can determine whether there is an image in the working screen 200 that is "the same as the analysis image in the image recognition model 323", or the processing circuit 322 can use the neural network model in the image recognition model 323 to analyze the working screen 200 to identify the operation area PX.

[0063] After the first operation objects P1 to P5 are confirmed / identified through steps S402 and 403, the operator can remotely control the first host 310A through the input device 330. Since the input device 330 is connected to the first host 310A through the script analysis device 320, the script analysis device 320 can continuously monitor the input signal transmitted by the input device 330 to perform the subsequent steps S403 to S406.

[0064] In step S403, during the period when the first host 310A runs the first working program, the processing circuit 322 determines / monitors whether it receives an input signal corresponding to the first working program (or the first working screen). If there is an input signal corresponding to the first working program (that is, the input signal is used to input to the first working program), the input signal is identified as the first control signal. In addition, the processing circuit 322 will also transmit the input signal / the first control signal to the first host 310A through the communication circuit 321, so that the first host 310A can execute corresponding actions or instructions according to the input signal / the first control signal.

[0065] In step S404, the processing circuit 322 determines whether the target position of the first control signal corresponds to any of the operation areas PX (the first operation objects P1 to P5), so as to set the corresponding operation area PX as the first operation object corresponding to the first control signal.

[0066] In step S405, the processing circuit 322 acquires the object image of the identified first operation object, and binds the first control signal and the identified first operation object (object image) to each other to record it as the first operation instruction. In an embodiment, the processing circuit 322 also records the operation time of the first control signal in the first operation instruction. The "operation time" can be an absolute time value (e.g., the Xth second after executing the method), or a relative time value or an operation sequence (e.g., the first control signal).

[0067] In step S406, the processing circuit 322 uses the first operation instruction as a control script, or stores it as at least a part of the control script. In an embodiment, after executing step S406, it is possible to go back to execute step S403 to record the next control signal and the corresponding first operation object as the next first operation instruction. In other words, by repeatedly executing steps S403 to S406, a plurality of first operation instructions are stored as a control script.

[0068] Through the foregoing steps S401 to S406, the script analysis device 320 can monitor the control signals issued by the operator through the input device 330, and record the control signals together with the corresponding first operation objects as operation instructions / control scripts. Accordingly, the generated control script can be provided to other hosts (such as the second host 310B) so that other hosts can automatically execute the same actions or instructions according to the control script.

[0069] Figure 5 Shown is a schematic diagram of a control script 500 according to some embodiments of the present disclosure. Figure 5 The image shown uses the script analysis device 320 to present the screen of the control script 500 for personnel to view. In fact, the data format of the script analysis device 320 can be adjusted according to requirements. In this embodiment, the control script 500 includes six first operation instructions. These first operation instructions are arranged in order, with the leftmost being the first to execute and the rightmost being the last to execute. As Figure 5 shown, the first first operation instruction to be executed is "click the left mouse button on the 'Properties' button of the operation object P1", and the second first operation instruction to be executed is "click the left mouse button on the 'Extender' button of the operation object P1".

[0070] According to this control script 500, when the second host 310B runs the same working program, the second host 310B can interpret / recognize each first operation instruction in the control script 500 and perform the corresponding actions. For example: The second host 310B first recognizes the second working screen (such as: Figure 2 ) corresponding to the operation object P1 (the area of "Properties"), and inputs the instruction of "click the left mouse button" to this area. Then, the second host 310B recognizes the operation object P2 (the area of "Extender") corresponding to the second working screen, and inputs the instruction of "click the left mouse button" to this area.

[0071] Similarly, as Figure 5 shown, the third first operation instruction to be executed is "click the drop-down menu next to the operation object P3 'Baud Rate'". The fourth first operation instruction to be executed is "input the value '115200' for the operation object P3 (or select in the drop-down menu)". The fifth first operation instruction to be executed is "click the selection bar next to the operation object P4 'RS232'". The sixth first operation instruction to be executed is "click the left mouse button on the operation object P5 'Save' button".

[0072] Please refer to Figure 4B shown, in some embodiments, the control script can be generated by control signals corresponding to different hosts. In other words, the content recorded in the control script can be "after the first host 310A executes multiple actions, the second host 310B continues to execute other actions".

[0073] Please refer to Figure 4B shown, after generating the first operation instruction through steps S401 to S406, step S407 can be continued. In step S407, the processing circuit 322 receives the switching instruction provided by the first host 310A for the second host 310B. At the same time, the switching instruction is recorded in the control script.

[0074] The switching instruction points to the second host 310B (such as: including the identification code of the second host 310B). For example: The first host 310A is used to decode and sharpen the original image to generate an enhanced image. Then, the enhanced image will be transmitted to the second host 310B, so that the second host 310 performs other subsequent actions on the enhanced image (such as: converting to a special format, or performing data analysis). Therefore, after generating the enhanced image, the first host 310A will generate a prompt message to remind the operator to start the second host 310B, and this prompt message can be regarded as the "switching instruction".

[0075] In step S408, the script analysis device 320 will receive the second working screen of the second host 310B when executing the second working program, and perform image recognition on the second working screen to set the recognized operation area as the second operation object. The method by which the script analysis device 320 recognizes the second operation object may be the same as that in the foregoing step S402, so it will not be elaborated here.

[0076] In step S409, the processing circuit 322 determines / monitors whether an input signal corresponding to the second working program (second working screen) is received. If there is an input signal corresponding to the second working program (second working screen), the input signal is recognized as the second control signal. In addition, the processing circuit 322 will also transmit the input signal / second control signal to the second host 310B through the communication circuit 321, so that the second host 310B can execute corresponding actions or instructions according to the input signal / second control signal.

[0077] In step S410, the processing circuit 322 determines whether the target position of the second control signal corresponds to any operation area (second operation object) to recognize and set the second operation object corresponding to the second control signal.

[0078] In step S411, the processing circuit 322 obtains the object image of the recognized second operation object to record the second control signal and the corresponding second operation object (object image) as the second operation instruction. In one embodiment, the processing circuit 322 will also record the operation time of the second control signal. The method by which the script analysis device 320 recognizes the second control signal and records the second operation instruction may be the same as that in the foregoing steps S403 to S405, so it will not be elaborated here.

[0079] In step S412, the processing circuit 322 stores the second operation instruction in the control script, so that the first operation instruction, the switching instruction, and the second operation instruction recorded in the foregoing steps S401 to S412 are used as a control script. In one embodiment, after executing step S412, the processing circuit 322 executes step S403 again to record the next control signal and the corresponding second operation object as the next second operation instruction. In other words, by repeatedly executing steps S409 to S412, multiple second operation instructions are stored in the control script.

[0080] In one embodiment of the present disclosure, the control script generation method obtains an operation object by detecting the target position of a control signal to generate an operation instruction. Therefore, the script analysis device does not need to record the complete operation process of the operator (for example: does not need to record the movement trajectory of the mouse). Accordingly, the actions performed by the script analysis device can be more streamlined and accurate, and it is easier to achieve automation.

[0081] In one embodiment, the present disclosure can be applied to a multi-computer switch to perform "cross-device automatic control" between multiple hosts. Figure 6 Shown is a schematic diagram of a multi-computer switch KVM applied according to some embodiments of the present disclosure. The multi-computer switch KVM is connected to multiple hosts 610A to 610B. The control script 600 generated according to the foregoing steps S401 to S412 can be stored in the multi-computer switch KVM, so that the multi-computer switch KVM can automatically transmit different instructions to each of the hosts 610A to 610B, enabling each of the hosts 610A to 610B to perform corresponding actions respectively.

[0082] The various elements, method steps, or technical features in the foregoing embodiments can be combined with each other, regardless of the order of the textual descriptions or the order of the figures presented in the present disclosure.

[0083] Although the present disclosure has been disclosed above in the form of embodiments, it is not intended to limit the present disclosure. Any person skilled in the art can make various changes and modifications without departing from the concept and scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be determined by the scope defined by the claims.

Claims

1. A control script generation method, applied to a script analysis device, characterized in that: Include: Receiving a working picture provided by a host; Identify multiple operation objects in the working screen; receiving a control signal corresponding to the working picture; determining that a target position of the control signal corresponds to one of the plurality of operating objects; as well as The control signal and the corresponding operation object are recorded as an operation instruction.

2. The control script generation method according to claim 1, characterized in that: The method of determining whether the target position of the control signal corresponds to the one of the plurality of operation objects comprises: It is determined whether the target position of the control signal corresponds to one of a plurality of operation areas in the working picture.

3. The control script generation method according to claim 1, characterized in that: The method of recording the control signal and the corresponding operation object as the operation instruction includes: acquiring an object image of the one of the plurality of operation objects; and The control signal and the object image are recorded as the operation instruction.

4. The control script generation method according to claim 1, characterized in that: The host includes a first host and a second host, the control signal includes a first control signal corresponding to a first working screen of the first host, the control signal and the one of the plurality of operating objects are recorded as a first operating instruction, and the control script generation method further includes: Recording a switching instruction provided by the first host to the second host in a control script including the first operation instruction; receiving a second working picture provided by the second host; and A second operation instruction is recorded according to a second control signal corresponding to the second working picture.

5. The control script generation method according to claim 4, characterized in that: The first working screen includes a plurality of first operating objects, and the method for recording the second operating instruction includes: Identifying a plurality of second operation objects in the second working picture; determining whether a target position of the second control signal corresponds to one of the plurality of second operation objects; The second control signal and the corresponding second operation object are recorded as the second operation instruction in the control script.

6. A script analysis device, characterized in that: Include: a communication circuit, communicatively connected to at least one host, to receive a working picture provided by the at least one host, and to receive a control signal; and a processing circuit coupled to the communication circuit, for identifying a plurality of operation objects in the working picture; The processing circuit is further used for determining whether a target position of the control signal corresponds to one of the plurality of operating objects, and recording the control signal and the corresponding operating object as an operating instruction.

7. The script analysis device according to claim 6, characterized in that: The processing circuit determines whether the target position of the control signal corresponds to one of a plurality of operation areas in the working picture to record the operation instruction.

8. The script analysis device according to claim 6, characterized in that: The processing circuit is used for acquiring an object image of one of the plurality of operation objects to record the control signal and the object image as the operation instruction.

9. The script analysis device according to claim 6, characterized in that: The at least one host includes a first host and a second host, the control signal includes a first control signal corresponding to a first working screen of the first host, and the control signal and the one of the plurality of operating objects are recorded as a first operating instruction; as well as When the communication circuit receives a switching instruction provided by the first host to the second host, the processing circuit is used to record the switching instruction in a control script including the first operation instruction, and to record a second operation instruction according to a second control signal corresponding to a second working screen of the second host.

10. The script analysis device according to claim 9, characterized in that: The first working screen includes a plurality of first operating objects; The processing circuit is used to identify a plurality of second operation objects in the second working picture; The processing circuit is further used to determine whether a target position of the second control signal corresponds to one of the plurality of second operating objects, so as to record the second control signal and the corresponding second operating object as the second operating instruction in the control script.

Images