AE fast interaction control system and method based on computer peripherals
By combining the embedded control terminal with the AE plugin module, the complexity and adaptability issues of existing AE auxiliary control methods are solved, realizing easy-to-use and easy-to-control quick input and intelligent control, improving the operational efficiency and adaptability of film and television post-production.
Patent Information
- Application Number
- CN202511438477.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-10-10
- Publication Date
- 2026-01-23
AI Technical Summary
Existing AE auxiliary control methods rely on analog keyboard input, which is complex to configure and difficult to adapt to different production scenarios. They also lack the ability to perceive the internal state of AE, resulting in cumbersome operation, frequent misoperations, and difficulty in achieving intelligent and precise control.
By combining an embedded control terminal with an AE plugin module, and through a microcontroller, input module, output feedback module, and communication module, direct communication between physical buttons and the AE plugin is achieved. It supports custom configuration and status awareness, and combines a WebSocket communication module to achieve bidirectional data transmission.
It achieves an easy-to-use and easy-to-control quick input method, reduces learning costs and the probability of misoperation, adapts to different production scenarios, improves operating efficiency and intelligence level, and is suitable for film and television post-production.
Smart Images
Figure CN121387166A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of human-computer interaction and software quick control technology, and in particular to an AE quick interaction control system and method based on computer peripherals. Background Technology
[0002] In the current film and television post-production industry, Adobe After Effects (AE) is the mainstream video effects and compositing software, widely used in animation production, visual design, and post-production editing of commercials. To effectively improve operational efficiency, AE provides a large number of keyboard shortcuts; and around these shortcuts, AE's auxiliary control methods have gradually developed and improved. Initially, users mainly relied on complex shortcut combinations on standard universal keyboards to complete specific AE commands; especially for high-frequency and complex operations such as layer management, view switching, and effect parameter adjustment, the shortcuts often required pressing multiple keys simultaneously (e.g., 3 to 4). This multi-key combination not only required high finger dexterity and coordination but was also prone to accidental touches or operation failures. With the increasing demand for ease of operation, macro software, shortcut mapping tools, and commercially available dedicated shortcut control devices such as TourBox and Elgato Stream Deck emerged. These auxiliary control methods all aim to simplify the AE operation process and further improve work efficiency, collectively forming the current AE auxiliary control technology system.
[0003] However, existing AE-assisted control methods still have many obvious shortcomings, which seriously affect the actual user experience of both professional users and beginners. Among these methods, relying on a general-purpose keyboard for multi-key shortcut operations places extremely high demands on users' memory and proficiency, resulting in a high learning curve and a high risk of misoperation, especially for inexperienced beginners. Macro software, shortcut mapping tools, and specialized devices such as TourBox and Elgato Stream Deck all indirectly control After Effects (AE) through preset shortcuts. Essentially, they still rely on the underlying logic of simulated keyboard input, a fixed chain of simulated keyboard input, computer operating system recognition, and AE execution of shortcut commands. This not only makes configuration cumbersome but also results in relatively fixed functions, making it difficult to flexibly adapt to the operational needs of AE in different production scenarios. More importantly, all existing auxiliary control methods struggle to establish direct communication links with AE's internal plug-in systems. This means they can only trigger surface-level operations in AE and cannot achieve instruction-level control based on AE's internal state. Due to the lack of awareness of AE's internal state, these methods are severely limited in their adaptability to multi-scenario and dynamic production workflows, failing to meet users' actual needs for intelligent and precise control of AE. Summary of the Invention
[0004] The purpose of this invention is to overcome the above-mentioned problems and provide an AE quick interactive control system and method based on computer peripherals. To achieve the above objective, this invention adopts the following technical solution:
[0005] An AE (Advanced Effects) quick interactive control system based on computer peripherals mainly includes an embedded control terminal, a link communication module, and an AE plug-in module. The embedded control terminal has a microcontroller and integrates an input module, an output feedback module, a first communication module, and a storage module. The link communication module receives communication commands sent by the embedded control terminal through the first communication module, parses the communication commands, and passes them to the AE plug-in module. The AE plug-in module is a plug-in based on the AE open API. The AE plug-in module receives commands forwarded by the computer's background processing module and calls the AE underlying API to perform specific operations on AE.
[0006] When the computer background processing module parses communication commands prefixed with "cmd_", for commands starting with "cmd_hk_", it attempts to execute hotkey operations. If the execution fails, it forwards the command to the AE plugin module via the WebSocket communication module. For commands not starting with "cmd_hk_", it forwards the command to the AE plugin module via the WebSocket communication module. The execution result from the AE plugin module is then sent back to the computer background processing module via the WebSocket communication module. The computer background processing module then sends the result to the embedded control terminal via the first communication module. The embedded control terminal triggers the output feedback module to execute the corresponding feedback action. The server side of the WebSocket communication module supports a client authentication mechanism and broadcasts execution status information to authenticated clients.
[0007] Furthermore, the microcontroller of the embedded control terminal is an ESP32 series microcontroller; the input module includes physical buttons, touch sliders, knobs, touch screens, and encoders; the input module collects user operations, and the embedded control terminal generates communication commands with the prefix cmd_ based on the operations.
[0008] Furthermore, the output feedback module includes a lighting module, a vibration module, a sound module, and a screen display module. After the embedded control terminal sends a trigger signal to the output feedback module, the output feedback module executes the lighting, vibration, and sound feedback actions. The feedback actions are associated with the user's operation status and the results returned by the AE plugin module.
[0009] Furthermore, the first communication module is used to establish a communication connection between the embedded control terminal and the computer backend processing module, and communication commands and result information are transmitted through this communication connection; the first communication module preferentially selects the USB-HID channel when connecting.
[0010] Furthermore, the storage module uses the littleFs file system to store configuration files; the configuration files determine the correspondence between the input modules and AE operations, and support user-defined modifications; the storage module updates the configuration files through atomic write operations.
[0011] The modification process is as follows: the user selects the custom configuration option on the software selection page of the embedded control terminal, connects to the AP hotspot of the embedded control terminal through the computer, and enters the function customization page to complete the modification; all actions are recognized by the embedded control terminal and corresponding instructions are issued, and the computer only executes the instructions.
[0012] Furthermore, the WebSocket communication module's server automatically listens to a preset network address and port upon startup, supporting clients to initiate connection requests in the format ws: / / <server IP>:<port number> to establish a communication connection; after a client successfully connects, the server returns a connection confirmation message; the server receives instruction information sent by the client and parses instructions starting with a specific prefix to trigger the corresponding command execution logic; when a client connection is detected to be interrupted, the system automatically cleans up system resources related to that connection.
[0013] Furthermore, the embedded control terminal is powered by a single lithium battery and integrates a power management chip; the embedded control terminal is designed with a low-power standby mode; in the low power state, the system automatically enters the power saving mode; the physical dimensions of the embedded control terminal are 9cm×10cm×2cm.
[0014] Furthermore, it supports both Windows and macOS operating systems; during operation, it enables seamless connection between Windows and macOS operating systems.
[0015] Furthermore, an AE quick interactive control method based on computer peripherals includes the following steps:
[0016] Step S1: The embedded control terminal collects user operations and generates communication commands prefixed with cmd_. Before generating the communication commands, the embedded control terminal determines the corresponding function instructions through the configuration file. All actions are recognized by the embedded control terminal and corresponding instructions are issued.
[0017] Step S2: The embedded control terminal sends communication commands to the computer's backend processing module through the first communication module;
[0018] Step S3: The computer background processing module parses the communication commands. For commands starting with cmd_hk_, it attempts to execute the hotkey operation. If the execution fails, it forwards the command to the AE plugin module through the WebSocket communication module. For commands that do not start with cmd_hk_, after forwarding the command to the AE plugin module through the WebSocket communication module, it proceeds to step S4.
[0019] Step S4: The AE plugin module receives the command and calls the underlying AE API to perform the corresponding operation on AE;
[0020] Step S5: The AE plugin module sends the execution result back to the computer's backend processing module via the WebSocket communication module. During the transmission process, the server of the WebSocket communication module broadcasts the execution status information of the AE plugin module to all online clients.
[0021] Step S6: The computer background processing module sends the operation completion information or execution result to the embedded control terminal through the first communication module; the computer only executes the instructions.
[0022] Step S7: After receiving the information, the embedded control terminal triggers the output feedback module to execute at least one of the corresponding light, vibration, and sound feedback actions.
[0023] The advantages of this invention are:
[0024] 1. This invention constructs a physical control terminal with physical buttons, touch sliders, touch screen and knobs based on an embedded platform. It encapsulates the complex functions and shortcuts of After Effects into simple gesture operations. Combined with the After Effects CEP plugin, it realizes low-level interaction of commands, avoiding the problem of relying on complex shortcuts in traditional general keyboards. It realizes an easy-to-use and easy-to-control quick input method, greatly reduces the user's learning cost and the probability of misoperation, significantly improves the efficiency of After Effects operation, and adapts to the operation needs of professional and novice users in film and television post-production.
[0025] 2. This invention enables high-speed automatic connection between the embedded control terminal and the AE plugin through a computer program. It relies on the full-duplex mechanism of the WebSocket communication module to ensure structured data transmission without the need for complex drivers or system-level configuration. It is also compatible with Windows and macOS operating systems to achieve seamless connection, avoiding the defects of existing devices such as time-consuming connection and poor compatibility. It achieves efficient cross-platform connection, improves human-computer interaction efficiency, and ensures the smoothness and continuity of the film and television post-production workflow.
[0026] 3. This invention establishes a bidirectional communication link between an embedded control terminal and the AE plugin to obtain status information such as internal layers, timeline, and compositing attributes of AE. Combined with the littleFs file system storing configuration files that can be modified by the user via AP hotspot, and relying on the embedded device to calculate and monitor user actions, it realizes intelligent triggering and dynamic feedback based on the context environment. It has high customizability and scalability, meets the fine control needs of different engineering scenarios, improves the intelligence level of AE control, and helps to efficiently complete film and television post-production. Attached Figure Description
[0027] The accompanying drawings, which form part of this application, are used to provide a further understanding of the application and to make other features, objects, and advantages of the application more apparent. The illustrative embodiments and descriptions of this application are used to explain the application and do not constitute an undue limitation of the application.
[0028] In the attached diagram:
[0029] Figure 1 This is a system framework diagram of an AE quick interactive control system based on computer peripherals in Example 1.
[0030] Figure 2 This is a parameter configuration diagram of an AE quick interactive control system based on computer peripherals in Example 1.
[0031] Figure 3 This is a flowchart of an AE quick interactive control method based on computer peripherals in Example 1. Detailed Implementation
[0032] The present invention will now be described in detail and specifically through specific embodiments to enable a better understanding of the present invention. However, the following embodiments do not limit the scope of protection of the present invention.
[0033] Example 1
[0034] like Figure 1-3 As shown, an AE (Advanced Effects) quick interactive control system based on computer peripherals includes an embedded control terminal, a computer backend processing module, an AE plugin module, and a WebSocket communication module. The embedded control terminal has a microcontroller and integrates an input module, an output feedback module, a first communication module, and a storage module. The computer backend processing module receives communication commands sent by the embedded control terminal through the first communication module and parses the communication commands. The AE plugin module is a CEP (Continuous Application Programming) plugin. The AE plugin module receives commands forwarded by the computer backend processing module and calls the underlying AE API to perform specific operations on AE. The server side of the WebSocket communication module is implemented based on the Python websockets library, supporting client access in a specific format.
[0035] When the computer background processing module parses communication commands prefixed with "cmd_", for commands starting with "cmd_hk_", it attempts to execute hotkey operations. If the execution fails, it forwards the command to the AE plugin module via the WebSocket communication module. For commands not starting with "cmd_hk_", it forwards the command to the AE plugin module via the WebSocket communication module. The execution result from the AE plugin module is then sent back to the computer background processing module via the WebSocket communication module. The computer background processing module then sends the result to the embedded control terminal via the first communication module. The embedded control terminal triggers the output feedback module to execute the corresponding feedback action. The server side of the WebSocket communication module supports a client authentication mechanism and broadcasts execution status information to authenticated clients.
[0036] In a specific embodiment, the AE quick interactive control system based on computer peripherals integrates an embedded control terminal, a computer backend processing module, an AE plugin module, and a WebSocket communication module. Each module has a clear division of labor and works collaboratively. The embedded control terminal has a microcontroller and integrates an input module, an output feedback module, a first communication module, and a storage module, undertaking the functions of user operation acquisition and feedback triggering. The computer backend processing module receives communication commands sent by the embedded control terminal through the first communication module, parses commands prefixed with "cmd_", and for commands starting with "cmd_hk_", first attempts to execute hotkey operations. If execution fails, it forwards the commands to the AE plugin module via the WebSocket communication module. Other commands are forwarded via the WebSocket communication module. The AE plugin module is a CEP plugin; after receiving the forwarded commands, it calls the AE underlying API to execute specific operations. The execution result of the AE plugin module is sent back to the computer backend processing module via the WebSocket communication module, and then sent by the computer backend processing module to the embedded control terminal through the first communication module, ultimately triggering the output feedback module to execute the corresponding feedback action, forming a complete control closed loop. During this process, the WebSocket server broadcasts the execution status information of the AE plugin module to all authenticated clients.
[0037] Furthermore, the microcontroller of the embedded control terminal is an ESP32 series microcontroller; the input module includes physical buttons, touch sliders, knobs, touch screens, and encoders; the input module collects user operations, and the embedded control terminal generates communication commands with the prefix cmd_ based on the operations.
[0038] In a specific embodiment, the embedded control terminal uses an ESP32 series microcontroller, which can meet the needs of driving input / output components and processing data. Its input module includes physical buttons, touch sliders, knobs, a touch screen, and an encoder, which can comprehensively collect different forms of user operations. After the input module collects user operations, the embedded control terminal generates communication commands with "cmd_" as a prefix based on these operations, converting user operations into system-recognizable instructions and providing a unified signal source for command transmission and processing.
[0039] Furthermore, the output feedback module includes a lighting module, a vibration module, a sound module, and a screen display module. After the embedded control terminal sends a trigger signal to the output feedback module, the output feedback module executes the lighting, vibration, and sound feedback actions. The feedback actions are associated with the user's operation status and the results returned by the AE plugin module.
[0040] In a specific embodiment, the output feedback module includes a lighting module, a vibration module, a sound module, and a screen display module, providing multiple forms of feedback. When the embedded control terminal sends a trigger signal to the output feedback module, the output feedback module will execute at least one of the following feedback actions: lighting, vibration, and sound. These feedback actions are associated with the user's operation status and the results returned by the AE plugin module. The user can intuitively understand the operation execution status and AE response status through the feedback, ensuring the effectiveness of human-computer interaction.
[0041] Furthermore, the first communication module is used to establish a communication connection between the embedded control terminal and the computer backend processing module, and communication commands and result information are transmitted through this communication connection; the first communication module preferentially selects the USB-HID channel when connecting.
[0042] In a specific embodiment, the first communication module encompasses multiple communication methods, including serial port, Bluetooth, USB-HID, and WiFi, to adapt to the connection requirements of different usage scenarios. When establishing a connection, the system prioritizes the USB-HID channel to achieve plug-and-play functionality and minimal latency. Its core function is to serve as a transmission channel between the embedded control terminal and the computer's backend processing module. Communication commands sent by the embedded control terminal and result information returned by the computer's backend processing module are all transmitted through this module, ensuring stable and smooth data interaction between the two core modules and providing fundamental support for the flow of system commands.
[0043] Furthermore, the storage module uses the littleFs file system to store configuration files; the configuration files determine the correspondence between the input modules and AE operations, and support user-defined modifications; the storage module updates the configuration files through atomic write operations.
[0044] The modification process is as follows: the user selects the custom configuration option on the software selection page of the embedded control terminal, connects to the AP hotspot of the embedded control terminal through the computer, and enters the function customization page to complete the modification; all actions are recognized by the embedded control terminal and corresponding instructions are issued, and the computer only executes the instructions.
[0045] In a specific embodiment, the storage module uses the littleFS file system, specifically for storing configuration files, ensuring stable read and write operations. The configuration file defines the correspondence between the input module and the AE operation, and supports user-defined modifications. When writing a new configuration, the system employs atomic write operations, effectively preventing configuration loss or corruption due to power failures or unexpected interruptions during file writing. For modifications, the user needs to select the custom configuration option on the embedded control terminal's software selection page, connect to the embedded control terminal's AP hotspot via a computer, and access the function customization page to complete the modification. All actions are recognized by the embedded control terminal, which issues corresponding instructions; the computer only executes the instructions, clearly defining the division of responsibilities between the two and ensuring the orderly execution of configuration modifications and instructions.
[0046] Furthermore, the WebSocket communication module's server automatically listens to a preset network address and port upon startup, supporting clients to initiate connection requests in the format ws: / / <server IP>:<port number> to establish a communication connection; after a client successfully connects, the server returns a connection confirmation message; the server receives instruction information sent by the client and parses instructions starting with a specific prefix to trigger the corresponding command execution logic; when a client connection is detected to be interrupted, the system automatically cleans up system resources related to that connection.
[0047] Furthermore, the embedded control terminal is powered by a single lithium battery and integrates a power management chip; the embedded control terminal is designed with a low-power standby mode; in the low power state, the system automatically enters the power saving mode; the physical dimensions of the embedded control terminal are 9cm×10cm×2cm.
[0048] In this specific embodiment, the embedded control terminal is powered by a single lithium battery, meeting the power requirements for portable use. The integrated power management chip provides charge / discharge protection and power management functions. A low-power standby mode is also designed, allowing for all-day Bluetooth connectivity, suitable for extended post-production scenarios. When the battery is low, the system automatically enters a power-saving mode, extending usage time by reducing performance or disabling some peripherals. The embedded control terminal measures 9cm × 10cm × 2cm, its compact size facilitating placement and portability in the work environment, enhancing the device's practicality.
[0049] Furthermore, it supports both Windows and macOS operating systems; during operation, it seamlessly connects between Windows and macOS operating systems.
[0050] In a specific embodiment, the AE quick-interaction control system based on computer peripherals supports both Windows and macOS operating systems, adapting to different users' computer environments and expanding the system's applicability. In both Windows and macOS operating systems, the system achieves seamless connection without requiring complex drivers or system-level configuration, simplifying the user experience and allowing users to quickly connect the system to their computer and begin quick control of AE.
[0051] Furthermore, an AE quick interactive control method based on computer peripherals includes the following steps:
[0052] Step S1: The embedded control terminal collects user operations and generates communication commands prefixed with cmd_. Before generating the communication commands, the embedded control terminal determines the corresponding function instructions through the configuration file. All actions are recognized by the embedded control terminal and corresponding instructions are issued.
[0053] Step S2: The embedded control terminal sends communication commands to the computer's backend processing module through the first communication module;
[0054] Step S3: The computer background processing module parses the communication commands. For commands starting with cmd_hk_, it attempts to execute the hotkey operation. If the execution fails, it forwards the command to the AE plugin module through the WebSocket communication module. For commands that do not start with cmd_hk_, after forwarding the command to the AE plugin module through the WebSocket communication module, it proceeds to step S4.
[0055] Step S4: The AE plugin module receives the command and calls the underlying AE API to perform the corresponding operation on AE;
[0056] Step S5: The AE plugin module sends the execution result back to the computer's backend processing module via the WebSocket communication module. During the transmission process, the server of the WebSocket communication module broadcasts the execution status information of the AE plugin module to all online clients.
[0057] Step S6: The computer background processing module sends the operation completion information or execution result to the embedded control terminal through the first communication module; the computer only executes the instructions.
[0058] Step S7: After receiving the information, the embedded control terminal triggers the output feedback module to execute at least one of the corresponding light, vibration, and sound feedback actions.
[0059] The specific embodiments of the present invention have been described in detail above, but they are merely examples, and the present invention is not equivalent to the specific embodiments described above. For those skilled in the art, any equivalent modifications and substitutions to the present invention are also within the scope of the present invention. Therefore, all equivalent transformations and modifications made without departing from the spirit and scope of the present invention should be covered within the scope of the present invention.
Claims
1. A computer peripheral based AE quick interaction control system, characterized in that, The embedded control terminal, the computer background processing module, the AE plug-in module, and the WebSocket communication module are included; the embedded control terminal has a microcontroller, and integrates an input module, an output feedback module, a first communication module, and a storage module; the computer background processing module receives a communication command sent by the embedded control terminal through the first communication module, and analyzes the communication command; the AE plug-in module is a CEP plug-in, receives a command forwarded by the computer background processing module, and calls an AE underlying API to perform a specific operation on the AE; the server of the WebSocket communication module is implemented based on a Python websockets library, and supports a client to access in a specific format; When the computer background processing module analyzes a communication command prefixed with cmd_, the computer background processing module attempts to perform a hot key pressing operation on a command starting with cmd_hk_, and forwards the command to the AE plug-in module through the WebSocket communication module when the execution fails; the computer background processing module forwards a command not starting with cmd_hk_ to the AE plug-in module through the WebSocket communication module; after the execution result of the AE plug-in module is returned to the computer background processing module through the WebSocket communication module, the computer background processing module sends the result to the embedded control terminal through the first communication module, and the embedded control terminal triggers the output feedback module to perform a corresponding feedback action; the server of the WebSocket communication module supports a client authentication mechanism, and broadcasts execution status information to the authenticated client.
2. The AE quick interaction control system based on computer peripheral according to claim 1, wherein, The microcontroller of the embedded control terminal is an ESP32 series microcontroller; the input module includes physical keys, touch sliders, knobs, touch screens, and encoders; the input module collects user operations, and the embedded control terminal generates a communication command prefixed with cmd_ based on the operations.
3. The AE quick interaction control system based on computer peripheral according to claim 2, characterized in that, The output feedback module includes a light module, a vibration module, a sound module, and a screen display module; after the embedded control terminal sends a trigger signal to the output feedback module, the output feedback module performs feedback actions of light, vibration, and sound, and the feedback actions are associated with user operation states and AE plug-in module return results.
4. The AE quick interaction control system based on computer peripheral according to claim 3, characterized in that, The first communication module is used to establish a communication connection between the embedded control terminal and the computer background processing module, and the communication command and result information are transmitted through the communication connection; the first communication module preferentially selects a USB-HID channel when connecting.
5. The AE quick interaction control system based on computer peripheral according to claim 4, characterized in that, The storage module stores a configuration file using a littleFs file system; the configuration file determines the correspondence between the input module and the AE operation, and supports user-defined modification; the storage module updates the configuration file through an atomic write operation; The modification process is as follows: a user selects a custom configuration option in the software selection page of the embedded control terminal, connects the embedded control terminal through the AP hotspot of the computer, and enters the function customization page to complete the modification; all actions are recognized by the embedded control terminal and corresponding instructions are issued, and the computer only executes the instructions.
6. The AE quick interaction control system based on computer peripheral according to claim 5, characterized in that, The server of the WebSocket communication module automatically listens to a preset network address and port when starting, supports a client to initiate a connection request in a ws: / / <server IP>:<port number> format to establish a communication connection, and returns a connection confirmation message to the client after the client successfully accesses. The server receives instruction information sent by the client, analyzes instructions starting with a specific prefix to trigger corresponding command execution logic, and automatically cleans up system resources related to the connection when monitoring that the client connection is interrupted.
7. The AE quick interaction control system based on computer peripheral according to claim 6, wherein, The embedded control terminal is powered by a single lithium battery and integrates a power management chip. The embedded control terminal is designed with a low-power standby mode. In a low-power state, the system automatically enters a power-saving mode. The physical size of the embedded control terminal is 9cm x 10cm x 2cm.
8. The AE quick interaction control system based on computer peripheral according to claim 7, characterized in that, Windows and macOS operating systems are supported. In a working state, the Windows and macOS operating systems are connected without sensing.
9. A computer peripheral-based AE quick interaction control method, characterized in that, The method comprises the following steps: Step S1: The embedded control terminal collects user operations to generate a communication command prefixed with cmd_; Before generating the communication command, the embedded control terminal determines the corresponding function instruction through a configuration file. All actions are recognized and corresponding instructions are issued by the embedded control terminal; Step S2: The embedded control terminal sends the communication command to the computer background processing module through the first communication module; Step S3: The computer background processing module analyzes the communication command, attempts to execute the hot key operation for the command starting with cmd_hk_, and forwards it to the AE plug-in module through the WebSocket communication module when the execution fails. For the command not starting with cmd_hk_, the AE plug-in module is forwarded to the AE plug-in module through the WebSocket communication module and enters step S4; Step S4: The AE plug-in module receives the command, calls the AE underlying API to execute corresponding operations on the AE; Step S5: The AE plug-in module returns the execution result to the computer background processing module through the WebSocket communication module. In the return process, the server of the WebSocket communication module broadcasts the execution state information of the AE plug-in module to all online clients; Step S6: The computer background processing module sends operation completion information or execution results to the embedded control terminal through the first communication module. The computer only executes the instruction; Step S7: After receiving the information, the embedded control terminal triggers the output feedback module to execute at least one of the feedback actions of light, vibration, and sound.