Multiple points synchronization guiding operation system and method thereof

Abstract

A multi-point synchronous guidance and collaborative operation system is suitable for factories with multiple control elements. It includes a processing center and multiple guidance devices. The processing center has an operation flow and receives multiple real-time images of targets, generating multiple control commands based on these images and the operation flow, wherein these control commands have the same actuation time. The multiple guidance devices are communicatively connected to the processing center, and each device includes an image sensor, a display, and a wireless transceiver. The image sensor captures a real-time image of a control element. The display shows an instruction screen. The wireless transceiver is electrically connected to the image sensor and the display, and communicatively connected to the processing center, to output the real-time image of the target and receive a control command, wherein the received control command corresponds to the instruction screen.

Description

[Technical Field]

[0001] This invention relates to a remote guidance system and method, and more particularly to a multi-point synchronous guidance system and method for co-operating, which can remotely guide multiple control elements to perform synchronous actions to complete an operation process. [Previous Technology]

[0002] The existing factory area has multiple large manufacturing equipment, each equipped with numerous pipelines with control valves to receive raw materials, connect to other large manufacturing equipment, or output products. However, some special manufacturing steps require two or more large manufacturing equipment to operate simultaneously, which necessitates multiple control valves to control the raw material input, product output, and product flow of each large manufacturing equipment. Due to the large space required by the large manufacturing equipment, the distance between any two control valves is long, making it difficult for any two operators to operate the control valves synchronously, thus making it difficult to achieve simultaneous operation of multiple manufacturing equipment. [Summary of the Invention]

[0003] As described above, the present invention provides a multi-point synchronous guidance system and method for collaborative operation, which remotely guides multiple control elements to operate during the same actuation period to complete the operation process, thereby solving the problem of not being able to operate control valves or control elements simultaneously.

[0004] A multi-point synchronous guidance and collaborative operation system according to an embodiment of the present invention is applicable to a factory area with multiple control elements, comprising a processing center and multiple guidance devices. The processing center has an operation flow and receives multiple real-time images of targets. The processing center generates multiple control commands based on the multiple real-time images of targets and the operation flow, wherein the multiple control commands have the same actuation time period. The multiple guidance devices are communicatively connected to the processing center, and each guidance device includes an image sensor, a display, and a wireless transceiver. The image sensor is used to capture a target real-time image of a control element. The display is used to display an instruction screen. The wireless transceiver is electrically connected to the image sensor and the display and is used to communicatively connect to the processing center to output the target real-time image acquired by the image sensor and receive a control command, wherein the received control command corresponds to the instruction screen.

[0005] A multi-point synchronous guidance and collaborative operation method according to an embodiment of the present invention is applicable to a factory area with multiple control elements. It includes: setting up multiple guidance devices and a processing center; the multiple guidance devices are communicatively connected to the processing center; each guidance device includes an image sensor, a display, and a wireless transceiver. Each of the multiple guidance devices and the processing center performs the following: using the image sensor to capture a real-time image of one of the multiple control elements; using the wireless transceiver to transmit the real-time image of the target to the processing center; the processing center generating and transmitting control commands to the wireless transceiver according to the operation flow and the real-time image of the target; and displaying an instruction screen on the display according to the control commands, wherein the control commands have an actuation period. The actuation periods of the multiple control commands of the multiple guidance devices are the same.

[0006] In summary, the multi-point synchronous guidance and co-operation system and method of the present invention utilizes the configuration of a processing center and multiple guidance devices to enable each display to show an instruction screen to the corresponding control element so as to instruct multiple control elements to operate during the actuation period, thereby enabling multiple control elements to operate synchronously.

Implementation Method

[0007] The detailed features and advantages of the present invention are described below in the embodiments. The content is sufficient to enable anyone skilled in the art to understand the technical content of the present invention and implement it accordingly. Based on the content disclosed in this specification, the scope of the patent application, and the drawings, anyone skilled in the art can easily understand the relevant objectives and advantages of the present invention. The following embodiments further illustrate the points of the present invention in detail, but are not intended to limit the scope of the present invention in any way.

[0008] It should be understood that although the terms "first," "second," etc., may be used in this invention to describe various elements, components, regions, layers, and / or portions, these elements, components, regions, layers, and / or portions should not be limited by these terms. These terms are only used to distinguish one element, component, region, layer, and / or portion from another element, component, region, layer, and / or portion.

[0009] In addition, the terms "comprising" and / or "including" refer to the presence of the said features, areas, wholes, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, areas, wholes, steps, operations, elements, components and / or combinations thereof.

[0010] In reality, the plant area has multiple large-scale production equipment, each equipped with multiple pipelines to connect to another large-scale equipment for transporting raw materials or gases. Each large-scale production equipment has switches to control its own operation, and each pipeline is equipped with control valves to control the transmission of raw materials and the flow of gases. In the following description, the control valves and switches to be operated are considered as multiple control elements, and multiple operators control the actions of multiple control elements.

[0011] Please refer to Figure 1, which is a functional block diagram illustrating a multi-point synchronous guidance and collaborative operation system according to an embodiment of the present invention. As shown in Figure 1, the multi-point synchronous guidance and collaborative operation system 1 is suitable for a factory area IA with multiple control elements, and includes a processing center 10 and multiple guidance devices 20. The processing center 10 is communicatively connected to the multiple guidance devices 20 and has an operation flow. Each guidance device 20 can be located adjacent to a single control element or worn by the operator. Each guidance device 20 includes an image sensor 21, a display 22, and a wireless transceiver 23. The wireless transceiver 23 is communicatively connected to the processing center 10 and electrically connected to the image sensor 21 and the display 22. It should be noted that the number of multiple guidance devices 20 can be adjusted according to the number of multiple control elements, and there is no limitation on the number of multiple guidance devices 20.

[0012] For each guidance device 20, the image sensor 21 captures a real-time image of its corresponding control element to generate a target image. The wireless transceiver 23 transmits the target image to the processing center 10. The processing center 10 generates and transmits control commands to the wireless transceiver 23 based on the target image and the operation procedure. The display 22 then receives the control commands through the wireless transceiver 23 and generates corresponding instruction screens based on the control commands. In other words, for the entire multi-point synchronous guidance and collaborative operation system, multiple guidance devices 20 generate multiple target images for multiple control elements respectively, and the processing center 10 also generates multiple control commands based on these target images, so that these guidance devices 20 individually generate multiple corresponding instruction screens based on these control commands. How to use the above method to generate multiple instruction screens corresponding to multiple guidance devices 20 according to this operation procedure, so as to guide multiple operators to operate multiple control elements at the same time, will be described in detail later.

[0013] The processing center 10 may be a server located in the cloud or at the edge. The server may be a computer, mobile device, or supercomputer using a central processing unit (CPU). The image sensor 21 may be a camera or an image sensor. The display 22 may be an augmented reality (AR) display or a virtual reality (VR) display. The panel used in the display 22 may be a light-emitting diode (LED) display panel, an organic light-emitting diode (OLED) display panel, a micro LED display panel, or a micro-OLED display panel. The wireless transceiver may be a Wi-Fi transceiver, a LoRa transceiver, a 4G antenna, a 5G antenna, or other transceivers. The foregoing is merely illustrative and is not limited to the scope of the invention.

[0014] Please refer to FIG2, which illustrates a configuration diagram of the image sensor and display according to an embodiment of the present invention. As shown in FIG2, in this embodiment, a single guidance device 20 is used for illustration. The image sensor 21 is disposed on the operator's helmet H, the display 22 is an augmented reality smart glasses for the operator's convenience in wearing, and the wireless transceiver 23 can be disposed on the augmented reality smart glasses. In another embodiment, the image sensor 21, the display 22, and the wireless transceiver 23 can be integrated into a smartphone or a personal digital assistant (PDA). In yet another embodiment, the image sensor 21, the display 22, and the wireless transceiver 23 are disposed independently.

[0015] Please refer to Figure 3, which is a flowchart illustrating a multi-point synchronous guidance and collaborative operation method according to an embodiment of the present invention. As shown in Figure 3, the multi-point synchronous guidance and collaborative operation method includes steps S101 to S105. The multi-point synchronous guidance and collaborative operation method shown in Figure 3 can be applied to the multi-point synchronous guidance and collaborative operation system 1 shown in Figure 1, but is not limited thereto. Steps S101 to S105 are described below by way of example using the operation of the multi-point synchronous guidance and collaborative operation system 1 shown in Figure 1.

[0016] Step S101: Set up multiple guidance devices 20 and a processing center 10. The multiple guidance devices 20 are communicatively connected to the processing center 10. Each of the multiple guidance devices 20 includes an image sensor 21, a display 22, and a wireless transceiver 23. These multiple guidance devices 20 are used to guide multiple operators to operate multiple control elements at the same time. The configuration of the image sensor 21, the display 22, and the wireless transceiver 23 has been described in the preceding paragraphs and will not be repeated here. For example, the number of multiple control elements is two, and they are labeled MP1 and MP2 as shown in Figures 4A and 4B, respectively. Control element MP1 is a control valve, and control element MP2 is a power switch and includes a button MP21, a button MP22, and an indicator light MP23. One guidance device 20 needs to be configured near control element MP1, and another guidance device 20 needs to be configured near control element MP2. Alternatively, two operators can each wear two guidance devices 20 and go to the locations of control elements MP1 and MP2.

[0017] The following steps S102 to S105 are used to detail the execution of the operation instructions of each of the plurality of guidance devices 20 and the processing center 10 to each of the plurality of control elements.

[0018] Step S102: The image sensor 21 captures images of the control element to obtain a real-time target image. Specifically, the image sensor 21 captures images of its corresponding control element in real time to generate a real-time target image. This real-time target image can record the status of the control element at each capture time point, and preferably, this real-time target image is a moving image. For example, the real-time target image TI1 shown in Figure 4A displays the control element MP1, while the real-time target image TI2 shown in Figure 4B displays the button MP21, button MP22, and indicator light MP23 of the control element MP2.

[0019] Step S103: Transmit the real-time target image to the processing center 10 using the wireless transceiver 23. For example, the wireless transceiver 23 corresponding to the control element MP1 shown in FIG4A transmits the real-time target image TI1 to the processing center 10, while the wireless transceiver 23 corresponding to the control element MP2 shown in FIG4B transmits the real-time target image TI2 to the processing center 10.

[0020] Step S104: The processing center 10 generates and transmits control commands to the wireless transceiver 23 according to the operation flow and the target real-time image. In one embodiment, the execution content of this operation flow includes action instructions for multiple control elements. The processing center 10 may have multiple reference images corresponding to the operation flow, and these reference images respectively include different control elements, so that the processing center 10 compares the target real-time image and the corresponding reference image to identify the control element and its state. For example, the processing center 10 compares the target real-time image TI1 shown in FIG. 4A with the reference image corresponding to control element MP1 to identify control element MP1 and its state, and the processing center 10 compares the target real-time image TI2 shown in FIG. 4B with the reference image corresponding to control element MP2 to identify control element MP2 and its state. In another embodiment, the processing center 10 may pre-establish an identification model for all control elements using a neural network-like model, and then input the target real-time image into this identification model to identify the control elements and their states in the target real-time image. Similarly, the processing center 10 then generates control commands corresponding to the control elements according to the operation process and transmits the control commands to the wireless transceiver 23.

[0021] Then, the processing center 10 generates control commands corresponding to the control elements according to the operation flow, and transmits the control commands to the wireless transceiver 23. For example, the processing center 10 generates control commands corresponding to the control element MP1 according to the operation flow, and transmits these control commands to the wireless transceiver 23 of the guidance device 20 corresponding to the control element MP1; similarly, the processing center 10 generates control commands corresponding to the control element MP2 according to the operation flow, and transmits these control commands to the wireless transceiver 23 corresponding to the control element MP2.

[0022] Step S105: The display 22 displays an instruction screen according to the control command. Specifically, the wireless transceiver 23 receives control commands. Each control command is generated according to the corresponding control element. The content of the control command may include the action indication of the corresponding control element. The display 22 generates and displays an instruction screen according to the action indication of the corresponding control element. The content of the instruction screen can change according to the content of the control command. The instruction screen includes a time bar and operation instructions. The time bar includes a preparation period and an actuation period. The actuation period is adjacent to the preparation period. The preparation period is the preparatory work for the control element (for example, if the control element is a control valve, the preparatory work for the control element is preparing a wrench). The actuation period is the period during which the control element operates.

[0023] By setting multiple indicator screens corresponding to multiple control elements with the same actuation time period, it can be ensured that the operator using these indicator screens can actuate multiple control elements within the same time period. The preparation time period of each indicator screen can vary depending on the pre-operation of each control element or the time when each guidance device 20 receives the control command. Each operation indicator is used to display the indicator pattern of the corresponding control element. The indicator pattern may include the direction of the control element's action and the indicator state of the control element, such as switch position, light status, etc. The present invention is not limited thereto.

[0024] For example, as shown in Figures 5A and 5B, two indicator screens IM1 and IM2 are displayed corresponding to two control elements MP1 and MP2. The two indicator screens IM1 and IM2 have a preparation period T1 and an actuation period T2. The actuation period T2 of the two indicator screens IM1 and IM2 is the same, so that the two control elements MP1 and MP2 have the same reference start and reference end points during the period when they are acted upon. Each indicator screen IM1 and IM2 has an action indication direction L1 and an indication position L2. Specifically, as shown in Figure 5A, the indication direction L1 indicates that the control element MP1 moves from position P1 to position P2, and position P2 indicates position L2. The operator moves the control element MP1 from position P1 to position P2 during the actuation period T2. As shown in Figure 5B, the indication direction L1 indicates pressing the button MP21 of the control element MP2. The operator presses the button MP21 during the actuation period T2, causing the indicator light MP23 to light up.

[0025] Due to the complexity of the multiple large production equipment and processes in the plant area, the control process may include multiple operation steps rather than a single operation step. The following will explain how to use a multi-point synchronous guidance method for multiple operation steps.

[0026] For example, the control process includes two operation steps, namely the first operation step and the second operation step. The first and second operation steps refer to any two consecutive operation steps in the control process, and are not limited to the first two operation steps in a control process.

[0027] Please refer to Figures 6A and 6B, which are flowcharts illustrating a multi-point synchronous guided collaborative operation method according to another embodiment of the present invention. As shown in Figures 6A and 6B, the multi-point synchronous guided collaborative operation method includes steps S201 to S212, wherein steps S201 to S205 shown in Figures 6A and 6B are used to guide the operator to perform the aforementioned first operation step, steps S206 to S210 are used to determine whether all control elements have been braked to complete the first operation step, steps S211 and S212 are used to guide the operator to perform the aforementioned second operation step, and steps S213 and S214 are used to provide a remedial mechanism if the first operation step is not performed correctly. In detail, steps S201 to S205 shown in Figure 6A are substantially the same as steps S101 to S105 shown in Figure 3, and therefore will not be described again. However, to clearly illustrate that this corresponds to the first operation step in the control process, the multiple control commands, multiple indicator screens, and actuation periods included in steps S201 to S205 are further defined as multiple first control commands, multiple first indicator screens, and a first actuation period, respectively. Additionally, corresponding to the second operation step in the control process, the multi-point synchronous guidance and collaborative operation method of the present invention further includes multiple second control commands, multiple second indicator screens, and a second actuation period.

[0028] Step S206: The processing center 10 determines whether the first actuation period has ended. If the processing center 10 determines that the first actuation period has not ended, it can return to step S205 or wait for the first actuation period to end. If the processing center 10 determines that the first actuation period has ended, it proceeds to step S207. In one embodiment, the processing center 10 may set a timer that ends simultaneously with the first actuation period when transmitting the first control command in step S204.

[0029] Specifically, the processing center 10 can set the required time for the first actuation period in a timer, and the timer sends a trigger signal when the first actuation period ends. If the processing center 10 does not detect the trigger signal, the processing center 10 determines that the first actuation period has not ended, and the two operators can still perform actions on the control elements MP1 and MP2 according to the first instruction screens IM1 and IM2 shown in Figures 5A and 5B, respectively. If the processing center 10 determines that it has received the trigger signal, the processing center 10 determines that the first actuation period has ended, and the two operators complete the actions on the control elements MP1 and MP2 according to the first instruction screens IM1 and IM2 shown in Figures 5A and 5B.

[0030] Step S207: Update the target real-time image with the image sensor 21 corresponding to the control element. Specifically, after the first actuation period ends, the image sensor 21 captures the current state of the control element to update the target real-time image. If the operator completes the operation according to the first instruction screen, the content of the target real-time image generated in step S207 will be different from the content of the target real-time image generated in step S202. For example, in step S202, the target real-time image obtained by the image sensor 21 is the state of the control elements MP1 and MP2 before the start of the first actuation period, i.e., target real-time image TI1 and target real-time image TI2 as shown in Figures 4A and 4B. Referring also to Figures 5A and 5B, in step S207, if the operator has completed the operation according to the first instruction screen, the state of the control element MP1 in the updated target real-time image obtained by the image sensor 21 corresponding to control element MP1 should be at position P2, and the state of the indicator light MP23 of the control element MP2 in the updated target real-time image obtained by the image sensor 21 corresponding to control element MP2 should be lit. However, if the operator has not completed the operation according to the first instruction screen, the control element MP1 in either of these two updated target real-time images may not be at position P2 or the indicator light MP23 of the control element MP2 may not be lit, or it may even be no different from the target real-time images TI1 or TI2 shown in Figure 4A or Figure 4B.

[0031] Step S208: Transmit the updated real-time target image to the processing center 10 via the wireless transceiver 23 corresponding to the control element. For example, the wireless transceiver 23 corresponding to the control element MP1 transmits the updated real-time target image TI1 to the processing center 10, and the wireless transceiver 23 corresponding to the control element MP2 transmits the updated real-time target image TI2 to the processing center 10.

[0032] Step S209: The processing center 10 calculates the task completion degree of each updated target real-time image. For example, it calculates the degree of consistency between each updated target real-time image and the reference image of each control element corresponding to the first operation step. That is, the processing center 10 can compare the degree of consistency between the position of the control element in the updated target real-time image and the position of the control element in the reference image as the task completion degree. Therefore, each of the multiple updated target real-time images has a corresponding task completion degree. For example, the processing center 10 compares the position of the control element MP1 in the updated target real-time image TI1 with the position of the control element MP1 in the reference image to generate a first task completion degree. The processing center 10 compares the status of the indicator light MP23 of the control element MP2 in the updated target real-time image TI2 with the status of the indicator light MP23 of the control element MP2 in the reference image to generate a second task completion degree.

[0033] Step S210: The processing center 10 determines whether the completion rate of each task falls within the corresponding qualified value range. If the processing center 10 determines that the completion rate of all tasks falls within the qualified value range, proceed to step S211. If the processing center 10 determines that the completion rate of any task falls outside the qualified value range, proceed to step S213.

[0034] Specifically, if the processing center 10 determines that the completion rate of each task falls within the acceptable range (e.g., the switch position in the target real-time image overlaps with the switch position in the reference image by more than 80%, and the brightness of the light in the target real-time image reaches more than 90% of the brightness of the light in the reference image), then the processing center 10 determines that the first operation step is completed, that is, each operator completes the operation of the control element according to the first instruction screen within the first actuation period, and therefore the processing center 10 proceeds to the second operation step. If the processing center 10 determines that at least one task completion rate falls outside the acceptable range (e.g., the overlap between the switch position in the target real-time image and the switch position in the reference image is less than 80%, and the brightness of the light in the target real-time image is less than 90% of the brightness of the light in the reference image), the processing center 10 determines that the first operation step is not completed and cannot proceed to the second operation step, and a remedial mechanism needs to be executed.

[0035] Step S211: The processing center 10 transmits the second control command to the wireless transceiver 23 of the corresponding control element according to the second operation step. Specifically, the processing center 10 generates the second control command for the corresponding control element according to the second operation step and transmits the second control command to the wireless transceiver 23 of the corresponding control element. It should be noted that when this step S211 is executed, since the processing center 10 has already obtained the target real-time image of all control elements when the first operation step is completed in step S208, the content corresponding to steps S101 to S103 in FIG3 can be omitted, and this step S211 corresponding to step S104 can be executed directly. However, in order to ensure that all control elements are still in the correct state before the execution of step S211, the current target real-time image can also be used again for the processing center 10 to confirm the state.

[0036] Step S212: Display a second instruction screen on the display 22 corresponding to the control element. Specifically, the wireless transceiver 23 corresponding to the control element receives a second control command, and the display 22 corresponding to the control element generates a second instruction screen according to the second control command (similarly, the second instruction screen includes a second time bar and a second operation instruction, the time bar includes a second preparation period and a second actuation period), so that the operator can move or operate the control element according to the second operation instruction during the second actuation period.

[0037] Step S213: The processing center 10 generates and transmits a third control command to the corresponding wireless transceiver 23 according to the third operation step. Specifically, the operation flow of the processing center 10 includes not only the first operation step and the second operation step that can be executed sequentially according to the normal procedure, but also multiple remedial steps, so that when it is determined in step S210 that the normal operation step has not been executed correctly, an appropriate remedial step (i.e., the aforementioned third operation step) can be executed in a timely manner so that the controlled control element can re-execute the normal operation step. In one embodiment, the third operation step is also similar to the aforementioned second operation step, except that the third control command generated in this third operation step and transmitted to the guidance device 20 is used to instruct the operator to reset the control element in order to re-execute the aforementioned first operation step or even to re-execute an earlier operation step. Therefore, in this step S213, the processing center 10 generates a third control command according to the third operation step and transmits the third control command to the wireless transceiver 23 of the corresponding control element.

[0038] Step S214: Display a third instruction screen on the corresponding display 22. Specifically, the wireless transceiver 23 corresponding to the aforementioned control element transmits the third control command to the display 22 of the corresponding control element. The display 22 can then generate and display a third instruction screen according to the third control command. The third instruction screen includes a third actuation period and an instruction pattern, so that the operator can perform actions or move the aforementioned control element according to the instruction pattern of the third instruction screen during the third actuation period.

[0039] In summary, the multi-point synchronous guidance and co-operation system and method of the present invention utilizes the configuration of a processing center and multiple guidance devices to enable each display to show an instruction screen to the corresponding control element so as to instruct multiple control elements to operate during the actuation period, thereby enabling multiple control elements to operate synchronously.

[0040] Although the present invention has been disclosed above with reference to the foregoing embodiments, it is not intended to limit the present invention. Any modifications and refinements made without departing from the spirit and scope of the present invention are within the scope of patent protection of the present invention. For the scope of protection defined by the present invention, please refer to the appended claims. [Simplified Explanation of the Diagram]

[0041] Figure 1 is a functional block diagram illustrating a multi-point synchronous guidance and collaborative operation system according to an embodiment of the present invention. Figure 2 is a configuration diagram illustrating an image sensor and a display according to an embodiment of the present invention. Figure 3 is a flowchart illustrating a multi-point synchronous guidance and collaborative operation method according to an embodiment of the present invention. Figure 4A is a schematic diagram illustrating a real-time target image according to an embodiment of the present invention. Figure 4B is a schematic diagram illustrating a real-time target image according to another embodiment of the present invention. Figure 5A is a schematic diagram illustrating an instruction screen according to an embodiment of the present invention. Figure 5B is a schematic diagram illustrating an instruction screen according to another embodiment of the present invention. Figures 6A and 6B are flowcharts illustrating a multi-point synchronous guidance and collaborative operation method according to another embodiment of the present invention.

Claims

1. A multi-point synchronous guidance and collaborative operation system, applicable to a factory area with multiple control elements, comprising: A processing center has an operating procedure. The processing center receives multiple real-time images of targets and generates multiple control commands based on the real-time images and the operating procedure, wherein the control commands have the same activation time period. It also includes multiple guidance devices communicatively connected to the processing center. Each of the guidance devices includes: an image sensor for capturing one of the control elements to obtain one of the real-time images of the targets; a display for displaying an instruction screen; and a wireless transceiver electrically connected to the image sensor and the display, and communicatively connected to the processing center to output the real-time image of the target acquired by the image sensor to the processing center, and to receive one of the control commands, wherein the received control command corresponds to the instruction screen. The operating procedure includes a first operating step and a second operating step. The control commands are multiple first control commands, the activation time period is a first activation time period, and the instruction screen displayed by the guidance devices is... The system includes multiple first instruction screens. The processing center generates first control commands based on the target real-time images and the first operation steps. The multi-point synchronous guidance and collaborative operation system further includes: the processing center determining whether the first actuation period has ended; the image capture devices of the guidance devices updating the target real-time images when the processing center determines that the first actuation period has ended; the wireless transceivers of the guidance devices transmitting the updated target real-time images to the processing center; the processing center calculating and determining whether the task completion rate of each of the updated target real-time images falls within a corresponding qualified value range; and when the task completion rate falls within the corresponding qualified value range, the processing center generates multiple second control commands based on the second operation steps and the updated target real-time images, and transmits the second control commands to the wireless transceivers of the guidance devices, wherein the second control commands have the same second actuation period.

2. The multi-point synchronous guidance and collaborative operation system as described in claim 1, wherein the instruction screen includes a time bar and an operation instruction, the time bar includes a preparation period and an actuation period, the actuation period being adjacent to the preparation period, and the operation instruction is used to display an instruction pattern corresponding to the control element.

3. The multi-point synchronous guidance and collaborative operation system as described in claim 1, wherein the processing center calculates the degree of similarity between each of the updated real-time images of the targets and a corresponding reference image, and uses the degree of similarity as the degree of task completion.

4. The multi-point synchronous guidance and collaborative operation system as described in claim 1, wherein the operation process further includes a third operation step, wherein when the task completion degree of at least one of the target real-time images falls outside the corresponding qualified value range, the processing center generates a plurality of third control commands according to the third operation step and the updated target real-time images, and transmits the third control commands to the wireless transceiver of the guidance devices respectively, wherein the third control commands have the same third actuation period.

5. A multi-point synchronous guidance method for collaborative operation, applicable to a plant area with multiple control elements, comprising: Multiple guidance devices and a processing center are configured. These guidance devices are communicatively connected to the processing center. Each guidance device includes an image sensor, a display, and a wireless transceiver. The following actions are performed by each guidance device and the processing center: capturing a real-time image of a target using the image sensor; transmitting the real-time image of the target to the processing center using the wireless transceiver; generating and transmitting a control command to the wireless transceiver based on an operation flow and the real-time image of the target, wherein the control command has a consistent activation period; and displaying an instruction screen on the display based on the control command. The activation periods of the control commands from the guidance devices are identical, and the operation flow includes a first operation step and a second operation step. The control commands transmitted from the processing center to the guidance devices are multiple first control commands, with a single activation period. The instruction screens displayed by the guidance devices are multiple first instruction screens. The processing center generates first control commands based on the target real-time images obtained by the guidance devices and the first operation steps. The method further includes: determining whether the first actuation period has ended; when the processing center determines that the first actuation period has ended, updating the target real-time images with the image capture device of the guidance devices; transmitting the updated target real-time images to the processing center with the wireless transceiver of the guidance devices; calculating a task completion degree for each of the updated target real-time images and determining whether the task completion degree of each falls within a corresponding qualified value range; and when the processing center determines that the task completion degree of each falls within the corresponding qualified value range, generating multiple second control commands based on the second operation steps and the updated target real-time images, and transmitting the second control commands to the wireless transceiver of the guidance devices, wherein the second control commands have the same second actuation period.

6. The multi-point synchronous guided collaborative operation method as described in claim 5, wherein calculating the task completion degree of each of the updated real-time imagery of the targets at the processing center includes: The processing center calculates the degree of similarity between each of the updated real-time images of the targets and a corresponding reference image, and uses this degree of similarity as the task completion rate.

7. The multi-point synchronous guided collaborative operation method as described in claim 5, wherein the operation process further includes a third operation step, and the method further includes: When the processing center determines that the task completion rate of at least one of the target real-time images falls outside the corresponding qualified value range, the processing center generates multiple third control commands based on the third operation step and the updated target real-time images, and transmits the third control commands to the wireless transceiver of the guidance devices, wherein the third control commands have the same third actuation period.

Images