Operation arrangement method and device and terminal equipment

Abstract

The invention discloses an operation arrangement method and device and terminal equipment, and the method comprises the steps: obtaining a to-be-arranged operation which comprises at least two execution operations, determining a target execution operation of which the execution delay is greater than an execution delay threshold value in the to-be-arranged operation, and according to the at least two execution operations in the target execution operation, executing the target execution operation according to the execution delay threshold value. At least two first execution operations are determined, the first execution operations comprise at least one execution action, and the execution delay of the first execution operations is smaller than the execution delay threshold value, so that the delay between execution of each execution action can be reduced; and arranging the first execution operation and other execution operations except the target execution operation in the operations to be arranged according to the execution sequence of each execution action to obtain an operation list, so that the first execution operation and the corresponding execution operations are synchronized, and the equipment is indicated to execute the operations based on the operation list. Therefore, the equipment can be applied to a scene requiring high synchronization of each operation, and limitation is reduced.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a method, apparatus, and terminal device for operation orchestration. Background Art

[0002] With the development of communication technology and artificial intelligence technology, people's demand for intelligence is increasing, and they have put forward the need to enable smart devices to perform related operations through remote control.

[0003] Currently, smart devices are able to receive and respond to user input commands, performing one or more operations. However, due to limitations in device hardware performance and the time required for signal transmission, there is a delay between each operation when smart devices perform multiple operations, resulting in asynchronous execution of each operation. This makes it difficult to apply to scenarios that require highly synchronized operations, resulting in significant limitations. Summary of the Invention

[0004] The embodiments of the present application provide a method, apparatus, and terminal device for operation orchestration, aiming to solve the problem that when existing smart devices execute multiple operations, there is a delay between each operation, resulting in asynchronous execution of each operation.

[0005] In a first aspect, an embodiment of the present application provides a method for operation orchestration, the method comprising:

[0006] Obtaining operations to be orchestrated; wherein the operations to be orchestrated include at least two execution operations;

[0007] Determining a target execution operation whose execution delay is greater than an execution delay threshold among the operations to be orchestrated, and determining at least two first execution operations based on at least two execution actions among the target execution operations; wherein each of the first execution operations includes at least one of the execution actions, and the execution delay of the first execution operation is less than the execution delay threshold;

[0008] Arrange the first execution operation and other execution operations in the to-be-arranged operations except the target execution operation according to the execution order of each execution action to obtain an operation list;

[0009] Instructing the device to perform an operation based on the operation list.

[0010] In a possible implementation of the first aspect, determining at least two first execution operations according to the at least two execution actions of the target execution operation includes:

[0011] Decomposing the target execution operation to obtain at least two execution actions;

[0012] According to the delay duration of each of the execution actions and the execution order of the execution actions, at least two execution actions are divided into at least two execution action sets to obtain at least two first execution operations; wherein each first execution operation corresponds to one of the execution action sets, the total delay duration of each of the execution action sets is less than the execution delay threshold, and the total delay duration is the sum of the delay durations of all the execution actions in the execution action set.

[0013] In a possible implementation of the first aspect, the other execution operations include at least two second execution operations, and the first execution operations and the other execution operations in the to-be-orchestrated operations except the target execution operation are orchestrated according to the execution order of each of the execution actions to obtain an operation list, including:

[0014] Determining, from other execution operations in the to-be-orchestrated operations except the target execution operation, a second execution operation to be executed synchronously with the first execution operation;

[0015] Determining the execution time and end time of the first execution operation and the second execution operation according to the execution order of each execution action;

[0016] Each of the first execution operations and the second execution operations is arranged according to the execution time and the end time to obtain an operation list.

[0017] In a possible implementation of the first aspect, determining the execution time and end time of the first execution operation and the second execution operation according to the execution order of each execution action includes:

[0018] Determining an execution duration of the first execution operation;

[0019] According to the execution order, the execution duration and the benchmark time, the execution time and end time of the first execution operation are determined, as well as the execution time and end time of the second execution operation are determined; wherein the execution time of the first execution operation is the same as the execution time of the second execution operation.

[0020] In a possible implementation of the first aspect, determining the execution time and the end time of the first execution operation according to the execution order, the execution duration, and the reference time includes:

[0021] When the first execution operation is determined to be the first execution operation based on the execution order, determining the reference time as the execution time of the first execution operation, and determining the end time of the first execution operation based on the reference time and the execution duration;

[0022] When the first execution operation is not the first operation to be executed, determine the end time of the historical execution operation, and determine the execution time of the first execution operation based on the end time of the historical execution operation; determine the end time of the first execution operation based on the execution time of the first execution operation and the execution duration.

[0023] In a possible implementation of the first aspect, determining the end time of the first execution operation according to the execution duration and the reference time includes:

[0024] A waiting time is determined, and an end time of the first execution operation is determined according to the waiting time, the reference time, and the execution time.

[0025] In a possible implementation manner of the first aspect above, the target execution operation is a mechanical operation, and the other execution operations include digital operations.

[0026] In a second aspect, an apparatus for operation orchestration is provided, the apparatus comprising:

[0027] An acquisition module, configured to acquire operations to be orchestrated; wherein the operations to be orchestrated include at least two execution operations;

[0028] a determination module, configured to determine a target execution operation having an execution delay greater than an execution delay threshold among the operations to be orchestrated, and determine at least two first execution operations based on at least two execution actions among the target execution operations; wherein each of the first execution operations includes at least one of the execution actions, and the execution delay of the first execution operation is less than the execution delay threshold;

[0029] an orchestration module, configured to orchestrate the first execution operation and other execution operations in the to-be-orchestrated operations except the target execution operation according to the execution order of each execution action, to obtain an operation list;

[0030] An execution module is used to instruct a device to execute an operation based on the operation list.

[0031] In a third aspect, an embodiment of the present application provides a terminal device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method for operation orchestration provided in the first aspect or any possible implementation of the first aspect is implemented.

[0032] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the method of operation orchestration provided in the first aspect or any possible implementation of the first aspect.

[0033] In a fifth aspect, an embodiment of the present application provides a computer program product, comprising a computer program. When the computer program runs on a computer, the computer executes the operation orchestration method provided in the first aspect or any possible implementation of the first aspect.

[0034] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here.

[0035] Compared with the prior art, the embodiments of the present application have the following beneficial effects:

[0036] In an embodiment of the present application, by obtaining the operation to be orchestrated, the operation to be orchestrated includes at least two execution operations, determining the target execution operation whose execution delay is greater than the execution delay threshold in the operation to be orchestrated, and determining at least two first execution operations based on the at least two execution actions in the target execution operation, the first execution operation includes at least one execution action, and the execution delay of the first execution operation is less than the execution delay threshold, which can reduce the delay between executing each execution action, and orchestrate the first execution operation and other execution operations in the operation to be orchestrated except the target execution operation according to the execution order of each execution action, and obtain an operation list, so that the first execution operation and its corresponding execution operation are synchronized, so as to instruct the device to execute the operation based on the operation list, so that the device can be used in scenarios where each operation needs to be highly synchronized, reducing limitations. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 This is a flowchart of a method for operation arrangement provided by an embodiment of the present application;

[0038] Figure 2 This is a schematic diagram of an operation list provided in one embodiment of the present application;

[0039] Figure 3 This is a flowchart of another method for operation arrangement provided by an embodiment of the present application;

[0040] Figure 4 This is a schematic diagram of the structure of an operation arrangement device provided in one embodiment of the present application;

[0041] Figure 5 This is a structural block diagram of a terminal device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0042] In order to make the technical problems, technical solutions and beneficial effects to be solved by this application more clearly understood, this application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application.

[0043] With the development of communication technology and artificial intelligence technology, people's demand for intelligence is increasing, and they have put forward the need to enable smart devices to perform related operations through remote control.

[0044] Currently, smart devices are able to receive and respond to user input commands, performing one or more operations simultaneously. However, due to limitations in device hardware performance and the time required for signal transmission, there is a delay between each operation performed by the smart device, which can lead to asynchronous execution of operations. Furthermore, as smart devices continue to perform operations, the delay of each operation accumulates, causing the delay of subsequent operations to increase. This makes it difficult to apply to scenarios that require highly synchronized operations, resulting in significant limitations.

[0045] For example, the smart device needs to continuously execute operations A, B, and C, and the delay of operation A is 1 second, the delay of operation B is 2 seconds, and the delay of operation C is 3 seconds. The order in which the smart device executes the above operations is to first execute operation A, then execute operation B, and finally execute operation C. However, due to the limitations of the device hardware performance and the time required for signal transmission, the smart device executes operation A after a delay of 1 second, and after executing operation A, it delays operation B for 2 seconds, resulting in an actual delay of 3 seconds for operation B. Similarly, operation C is executed after an actual delay of 3 seconds, and the delay of operation C is 3 seconds, that is, the actual delay of operation C is 6 seconds, which makes the delays of subsequently executed operations increasingly larger.

[0046] Specifically, in the medical field, doctors can perform surgery by remotely controlling surgical equipment and obtain the current status of the surgery through the display module in the surgical equipment to perform the next surgical operation. If the image displayed by the display module is not synchronized with the surgical operation performed by the doctor, the accuracy of remote control will be reduced, thereby increasing the safety risk of performing surgery through remote control of surgical equipment. For example, in the field of intelligent robots, users can input instructions for the robot to dance, and the robot can respond to the instructions and perform dancing operations. At the same time, the robot can play audio related to the dancing operations. If the dancing operations performed by the robot are not synchronized with the played audio, the operations performed by the robot will be inconsistent with the played audio, affecting the user experience.

[0047] Based on this, the present application provides a method for operation orchestration, by obtaining the operation to be orchestrated, the operation to be orchestrated includes at least two execution operations, determining the target execution operation in the operation to be orchestrated whose execution delay is greater than the execution delay threshold, and determining at least two first execution operations based on at least two execution actions in the target execution operation, the first execution operation includes at least one execution action, and the execution delay of the first execution operation is less than the execution delay threshold, which can reduce the delay between executing each execution action, and orchestrate the first execution operation and other execution operations in the operation to be orchestrated except the target execution operation according to the execution order of each execution action, obtain an operation list, synchronize the first execution operation and its corresponding execution operation, and instruct the device to execute the operation based on the operation list, so that the device can be used in scenarios where each operation needs to be highly synchronized, reducing limitations.

[0048] See also Figure 1 , Figure 1 A flowchart of a method for orchestrating operations provided in an embodiment of the present application is shown, which may specifically include the following steps:

[0049] Step 101: Obtain the operation to be orchestrated.

[0050] Among them, the operation to be arranged can be an operation that needs to be arranged, and the operation to be arranged can include at least two execution operations. The execution operation can be an operation that needs to be executed by a smart device. The smart device can be a device that can respond to user operation instructions to execute operations, and the smart device can execute at least two different operations at the same time.

[0051] In actual applications, since smart devices can be used in different scenarios and the operations required to be performed in each application scenario are different, it is possible to pre-determine one or more application scenarios to which the smart device can be applied, and determine at least one operation to be orchestrated for the smart device in each application scenario, so as to orchestrate all the execution operations in each operation to be orchestrated, that is, different operations to be orchestrated can be defined in advance for different application scenarios.

[0052] Specifically, since in the same application scenario, the smart device can execute at least one business, each business can be completed by the simultaneous execution of at least two execution operations, that is, the operation to be orchestrated can be the operation required to complete the business, and the smart device needs to execute two different execution operations at the same time.

[0053] In a specific implementation, arranging the execution operations refers to determining the execution order, execution time, and execution duration of each execution operation.

[0054] Step 102: Determine a target execution operation whose execution delay is greater than an execution delay threshold among the operations to be orchestrated, and determine at least two first execution operations based on at least two execution actions among the target execution operations.

[0055] The target execution operation may be an execution operation whose execution delay is greater than a preset execution delay threshold. The execution delay may be the delay in executing the operation. Other execution operations may be all execution operations other than the target execution operation. The execution delay threshold may be used to identify an execution operation with a higher delay, i.e., an execution operation with a delay greater than the execution delay threshold is considered a higher delay execution operation. The execution delay threshold may be a user-defined value or a value derived from experience. Typically, the target execution operation may be a mechanical operation, such as a motion execution operation. A motion execution operation may be an operation that controls the movement of a device through a mechanical structure. Since the movement of a smart device is controlled by a mechanical structure, there may be a phenomenon in which the action is not completed due to influences such as motion inertia, resulting in execution delays. Therefore, the motion execution operation may be determined as the target execution operation. Other execution operations may be digital operations, such as a display execution operation or a playback execution operation. A display execution operation may be an operation that controls the display of an image on the smart device, and a playback execution operation may be an operation that controls the playback of audio on the smart device. The first execution operation may be an operation obtained by combining execution operations based on the delay of each action and the execution order. The first execution operation may include at least one execution action. The execution action may be an action required to execute the execution operation. The execution operation may be completed by executing one or more execution actions. The execution order may be the order in which each execution action is executed. The execution delay of the first execution operation may be less than an execution delay threshold. The execution delay of the first execution operation may be a delay in executing the first execution operation.

[0056] After obtaining the operations to be orchestrated, the delay of each execution operation in the operations to be orchestrated can be determined, as well as a preset execution delay threshold. Then, the execution operation with an execution delay greater than the execution delay threshold in the operations to be orchestrated can be determined as the target execution operation, and other execution operations except the target execution operation can be determined among all the execution operations.

[0057] Generally, the value of the execution delay threshold may be related to the application scenario of the current smart device. The application scenario may include scenarios with higher delay requirements and scenarios with lower delay requirements. When the application scenario is a scenario with higher delay requirements, the value of the execution delay threshold may be set to a smaller value, such as 50 milliseconds, and when the application scenario is a scenario with lower delay requirements, the value of the execution delay threshold may be set to a smaller value, such as 100 milliseconds. It should be understood that the above-mentioned execution delay threshold values are for exemplary purposes only.

[0058] After determining the target execution operation and other execution operations, all execution actions in the target execution operation can be determined, that is, the actions required to execute the target execution operation can be determined, and the delay of each execution action can be determined. Then, all execution actions can be divided into at least two first execution operations based on the delay of each execution action, the execution order and the preset execution delay threshold.

[0059] In an embodiment of the present application, step 102 may include steps 1021 and 1022:

[0060] Step 1021: Decompose the target execution operation to obtain at least two execution actions.

[0061] After the target execution operation is determined, the target execution operation may be decomposed into actions to obtain at least two execution actions.

[0062] In practical applications, since each execution operation includes at least one execution action, that is, the execution of the execution operation is completed by executing one or more execution actions, the execution operation can be decomposed into actions to obtain at least two execution actions.

[0063] Specifically, the executed action can be a basic action, that is, the basic movement mode of the smart device, including linear motion, circular motion, and joint motion. Linear motion can represent the movement of a component in the smart device moving along a straight motion trajectory. Circular motion can represent the movement of a component in the smart device moving along an arc motion trajectory. Joint motion can represent the movement of adjusting the posture of a component in the smart device through a joint. The joint can be the structure that connects the various components in the smart device.

[0064] Step 1022 : Divide the at least two execution actions into at least two execution action sets according to the delay duration of each execution action and the execution order of the execution actions, to obtain at least two first execution operations.

[0065] Among them, the delay duration can be the duration of the delay after executing the execution action, the first execution operation can correspond to an execution action set, the execution action set can be a set composed of execution actions, the total delay duration of each execution action set can be less than the execution delay threshold, and the total delay duration can be the sum of the delay durations of all execution actions in the execution action set.

[0066] After obtaining at least two execution actions, the delay duration of each execution action can be determined, that is, the delay in executing each execution action can be determined, and the execution order of each execution action in the target execution operation can be determined. Then, according to the delay duration of each execution action and the execution order of the execution actions, the at least two execution actions can be divided into at least two execution action sets to obtain at least two first execution operations.

[0067] In practical applications, the sum of the delay times from the first execution action to the Nth execution action can be calculated based on the execution order and the delay time of each execution action. When the sum of the delay times from the first execution action to the Nth execution action is equal to the execution delay threshold, the first execution action and the Nth execution action are divided into the same execution action set. For example, when the sum of the delay times from the first execution action to the Nth execution action is less than the execution delay threshold, the sum of the delay times from the first execution action to the N+1th execution action is calculated, until the sum of the delay times from the first execution action to the N+1th execution action is greater than the execution delay threshold, the first execution action to the Nth execution action are divided into the same execution action set, and the above steps are repeated to calculate the sum of the delay times of the N+1th execution action and the Mth (M>N+1)th execution action to obtain at least two execution action sets.

[0068] Exemplarily, the target execution operation may include execution action 1, execution action 2, execution action 3, execution action 4, and execution action 5, and the execution order may be from execution action 1 to execution action 2, then to execution action 3 to execution action 4, and finally to execution action 5. The delay time from execution action 1 to execution action 3 may be 20 milliseconds, the delay time from execution action 4 to execution action 5 may be 30 milliseconds, and the execution delay threshold may be 50 milliseconds. It can be calculated that the sum of the delay times of execution action 1 and execution action 2 is 40 milliseconds, and the sum of the delay times from execution action 1 to execution action 3 is 60 milliseconds, which is greater than the execution delay threshold. Therefore, execution action 1 and execution action 2 may be divided into the same execution action set A. The sum of the delay times of execution action 3 and execution action 4 is 50 milliseconds, which is equal to the execution delay threshold. Therefore, execution action 3 and execution action 4 may be divided into the same execution action set B, and the last execution action 5 may be divided into another execution action set C, resulting in execution action set A, execution action set B, and execution action set C.

[0069] After obtaining at least two execution action sets, a first execution operation corresponding to each execution action set may be generated according to the execution actions in the execution action set.

[0070] For example, execution action set A may include execution action 1 and execution action 2. Based on execution action 1 and execution action 2, a first execution operation corresponding to execution action set A may be generated, and the first execution operation is an operation of executing execution action 1 and execution action 2.

[0071] Step 103 : Arrange the first execution operation and other execution operations in the operations to be arranged except the target execution operation according to the execution order of each execution action to obtain an operation list.

[0072] The operation list may be a list of execution operations, which may be used to instruct the device to execute corresponding operations. Specifically, the operation list may be used to instruct the smart device to execute the corresponding execution operations according to the execution order of the execution operations in the operation list and the execution time of each execution operation. The operation list may include at least two first execution operations and other execution operations.

[0073] After obtaining the first execution operation, other execution operations except the target execution operation in the operations to be arranged can be determined. The execution order of each first execution operation can be determined according to the execution order of each execution action, and the execution time of each first execution operation can be determined according to the execution order of each first execution operation, that is, the time to execute each first execution operation can be determined. Then, the first execution operation and other execution operations can be arranged according to the execution time of each execution action to obtain an operation list.

[0074] Specifically, each first execution operation and other execution operations may be recorded in the operation list according to the execution time of each first execution operation.

[0075] In an embodiment of the present application, the other execution operations may include at least two second execution operations, and step 103 may include steps 1031 to 1033:

[0076] Step 1031 : Determine a second execution operation to be executed synchronously with the first execution operation from other execution operations in the operations to be orchestrated except the target execution operation.

[0077] After obtaining the first execution operation, for each first execution operation, a second execution operation to be executed synchronously with the first execution operation may be determined from other execution operations in the operations to be orchestrated except the target execution operation.

[0078] It should be understood that since other execution operations may include display execution operations and playback execution operations, for each first execution operation, other execution operations that need to be executed synchronously when executing the first execution operation can be determined, that is, the display execution operation and / or playback execution operation that are executed synchronously with the first execution operation can be determined, and then the second execution operation corresponding to each first execution operation can be determined.

[0079] Step 1032: Determine the execution time and end time of each first execution operation and second execution operation according to the execution order of each execution action.

[0080] The end time may be the time when the execution operation ends.

[0081] After determining the second execution operation corresponding to each first execution operation, the execution order of each first execution operation can be determined according to the execution order of each execution action, and the execution time and end time of each first execution operation can be determined according to the execution order of each first execution operation. The second execution operation corresponding to the first execution operation can be an operation executed synchronously with the first execution operation, that is, the execution time of the second execution operation can be the same as the execution time of the corresponding first execution operation, and the end time of the second execution operation can also be the same as the end time of the corresponding first execution operation.

[0082] Step 1033: Arrange the first execution operation and the second execution operation according to the execution time and the end time to obtain an operation list.

[0083] After obtaining the execution time and end time of each first execution operation, and the execution time and end time of each second execution operation, each first execution operation and second execution operation can be recorded in a blank list in order of time to obtain an operation list.

[0084] Specifically, the blank list may be pre-generated, and the blank list may be used to record execution operations.

[0085] In a specific implementation, since the smart device can be applied to one or more application scenarios, and each application scenario has at least one operation to be arranged, a corresponding operation list can be generated for each operation to be arranged.

[0086] join Figure 2 , Figure 2 A schematic diagram of an operation list provided by an embodiment of the present application is shown as follows: Figure 2As shown, the first execution operation 1 can be the first execution operation executed first, and the execution time of the first execution operation 1 can be time A1, and the end time can be time A2. The first execution operation 2 can be the first execution operation executed second, and the execution time of the first execution operation 2 can be time B1, and the end time can be time B2. The first execution operation 3 can be the first execution operation executed third, and the execution time of the first execution operation 3 can be time C1, and the end time can be time C2. Time A1<time B1<time C1. The other execution operations can include the second execution operation 1, the second execution operation 2 and the second execution operation 3. The second execution operation 1 can correspond to the first execution operation 1, the second execution operation 2 can correspond to the first execution operation 2, and the second execution operation 3 can correspond to the first execution operation 3. Then, all the first execution operations and the second execution operations can be recorded in the operation list in sequence based on the order of the execution times.

[0087] Step 104: instruct the device to perform an operation based on the operation list.

[0088] The device may be a smart device.

[0089] After obtaining the operation list, the device may be instructed to execute the corresponding execution operation according to the execution order of the execution operations in the operation list and the execution time of each execution operation based on the operation list.

[0090] In actual applications, all operation lists can be stored in the device. When the device needs to perform at least two operations, the operation list corresponding to the current application scenario of the device is determined from all pre-stored operation lists, and the corresponding operation is performed using the operation list.

[0091] It should be understood that since the operation list stores the execution order and execution time of the first execution operation, as well as the execution order and execution time of other execution operations, the execution operation that the device needs to perform at the current moment can be determined based on the execution order, and the device can be instructed to perform the execution operation at the corresponding moment based on the execution time. Even if the device is limited by the hardware performance of the device and the time required for signal transmission, the device will execute the first execution operation and other execution operations after a certain delay. However, since the execution time of the first execution operation is the same as the execution time of other execution operations, the device will also execute the first execution operation and other execution operations at the same time, that is, it can execute the first execution operation and other execution operations synchronously.

[0092] Moreover, by determining the execution time of each operation, the impact of the delay of the previous operation on the current operation can be reduced, and the accumulation of delays for each operation can be reduced, so that the device can be used in scenarios where each operation needs to be highly synchronized, reducing limitations.

[0093] In an embodiment of the present application, by obtaining the operation to be orchestrated, the operation to be orchestrated includes at least two execution operations, determining the target execution operation whose execution delay is greater than the execution delay threshold in the operation to be orchestrated, and determining at least two first execution operations based on the at least two execution actions in the target execution operation, the first execution operation includes at least one execution action, and the execution delay of the first execution operation is less than the execution delay threshold, which can reduce the delay between executing each execution action, and orchestrate the first execution operation and other execution operations in the operation to be orchestrated except the target execution operation according to the execution order of each execution action, and obtain an operation list, so that the first execution operation and its corresponding execution operation are synchronized, so as to instruct the device to execute the operation based on the operation list, so that the device can be used in scenarios where each operation needs to be highly synchronized, reducing limitations.

[0094] See also Figure 3 , Figure 3 A flowchart of another operation arrangement method provided by an embodiment of the present application is shown, which may specifically include the following steps:

[0095] Step 301: Obtain the operation to be arranged.

[0096] Step 302: Determine a target execution operation whose execution delay is greater than an execution delay threshold among the operations to be orchestrated, and determine at least two first execution operations based on at least two execution actions among the target execution operations.

[0097] Step 303: Determine a second execution operation to be executed synchronously with the first execution operation from other execution operations in the operations to be orchestrated except the target execution operation.

[0098] Step 304: Determine the execution duration of the first execution operation.

[0099] The execution duration may be the duration of executing the first execution operation.

[0100] After the first execution operation is determined, the execution duration of each first execution operation may be predetermined.

[0101] In actual applications, since the first execution operation can include at least one execution action, each execution action can be a basic action, and the execution time required for the basic action can be obtained through experiments, that is, the execution time required for each basic action can be obtained through experiments, and the execution time of the execution action can be determined based on the execution time of each basic action, and then the execution time of the first execution operation can be determined based on the execution time of each execution action, and the execution time of each first execution operation can be obtained.

[0102] Step 305 : Determine the execution time and end time of the first execution operation, and determine the execution time and end time of the second execution operation according to the execution sequence, execution duration, and reference time.

[0103] Among them, the reference time can be the zero time used to calculate the execution time of all execution operations, other execution operations can include at least two second execution operations, the second execution operation can be the operation that needs to be performed when executing other execution operations, and the execution time of the first execution operation can be the same as the execution time of the second execution operation.

[0104] After the execution duration of each first execution operation is obtained, the execution time and end time of the first execution operation may be determined according to the execution sequence, the execution duration, and the reference time.

[0105] After determining the other execution operations, at least two second execution operations of the other execution operations may be determined, and a second execution operation corresponding to each first execution operation may be determined.

[0106] It should be understood that since the other execution operation may be a display execution operation, that is, an operation of displaying an image, and the operation of displaying an image is generally an operation of displaying multiple frames of images, that is, the display execution operation may include multiple second execution operations, and each second execution operation may be an operation of displaying a different image, such as second execution operation 1 being an operation of displaying image 1, and second execution operation 2 being an operation of displaying image 2. Similarly, the other execution operation may also be a playback execution operation, that is, an operation of playing audio, and the audio playback operation may be an operation of playing multiple audio signals, that is, the playback execution operation may include multiple second execution operations, and each second execution operation may be an operation of playing a different audio, such as second execution operation 1 being an operation of playing audio 1, and second execution operation 2 being an operation of playing audio 2.

[0107] In one embodiment of the present application, the display execution operation can also be an operation of displaying a video, that is, each second execution operation can be an operation of displaying a different video, such as the second execution operation 1 is an operation of displaying video 1, and the second execution operation 2 can be an operation of displaying video 2.

[0108] After determining the execution time and end time of the first execution operation, the execution time and end time of the second execution operation corresponding to the first execution operation may be determined based on the execution time and end time of the first execution operation.

[0109] As an example, since the first execution operation and the second execution operation corresponding to the first execution operation are synchronously executed operations, the execution time and end time of the first execution operation may be the execution time and end time of the second execution operation.

[0110] As another example, when the second execution operation is an operation of displaying a video or playing audio, it can be determined that the execution time of the second execution operation is the same as the execution time of the first execution operation, and the execution duration of the second execution operation can be determined. Then, based on the execution time and execution duration of the second execution operation, the end time of the second execution operation can be determined.

[0111] In one embodiment of the present application, step 305 may include steps 3051 to 3053:

[0112] Step 3051: When the first execution operation is determined to be the first execution operation based on the execution order, the reference time is determined as the execution time of the first execution operation, and the end time of the first execution operation is determined according to the reference time and the execution duration.

[0113] After obtaining the execution duration of each first execution operation, the first execution operation to be executed can be determined based on the execution order. When the first execution operation is determined to be the first execution operation based on the execution order, the reference time can be determined as the execution time of the first execution operation, and then the end time of the first execution operation can be determined based on the reference time and the execution duration.

[0114] For example, the reference time may be 00:00:00, the execution time of the first execution operation may be 00:00:00, and the execution duration of the first execution operation may be 30 milliseconds, and the end time of the first execution operation may be 00:00:30.

[0115] Step 3052: When the first execution operation is not the first execution operation, determine the end time of the historical execution operation, and determine the execution time of the first execution operation based on the end time of the historical execution operation.

[0116] The historical execution operation may be the first execution operation of the last execution.

[0117] After obtaining the execution time and end time of the first execution operation, the Mth first execution operation can be determined. When M is not 1, that is, when the first execution operation is not the first execution operation, the end time of the M-1th first execution operation can be determined, and the end time of the M-1th first execution operation can be determined as the execution time of the Mth first execution operation.

[0118] For example, if the end time of the M-1th first execution operation is 00:01:30, the execution time of the Mth first execution operation may be 00:01:30.

[0119] Step 3053: Determine the end time of the first execution operation according to the execution time and execution duration of the first execution operation.

[0120] When the first execution operation is not the first operation to be executed and after determining the execution time of the first execution operation, the execution duration of the first execution operation can be determined, and then the end time of the first execution operation can be determined based on the execution time and execution duration of the first execution operation.

[0121] For example, the execution time of the Mth first execution operation may be 00:01:30, the execution duration of the Mth first execution operation may be 50 milliseconds, and the end time of the Mth first execution operation may be 00:02:20.

[0122] Based on this, the execution time and the end time of all first execution operations can be obtained, and the execution time and the end time of all second execution operations can be obtained.

[0123] In an embodiment of the present application, step 305 may also be performed in the following manner:

[0124] The waiting time is determined, and the end time of the first execution operation is determined according to the waiting time, the reference time, and the execution time.

[0125] The waiting time may be the time for waiting for the device to stop moving.

[0126] After obtaining the execution duration of each first execution operation, the execution time of the first execution operation can be determined according to the reference time, the waiting time for the device to stop moving can be determined, and then the end time of the first execution operation can be determined according to the waiting time and the execution duration of the first execution operation; similarly, after obtaining the end time of the first execution operation, the end time of the first execution operation can be determined as the execution time of the second execution operation, and the above method can be used to determine the end time of the second execution operation according to the waiting time and the execution duration of the second execution operation, so that the end time of each first execution operation can be obtained.

[0127] In actual applications, when a device executes a first execution operation, even if the first execution operation has been completed, the device is still moving due to inertia. If the next first execution operation is executed while the device is still moving, the next operation cannot be executed because the device is still moving, resulting in an execution error in the device and failure to meet the user's needs. Based on this, the waiting time between the time the device completes the first execution operation and the time the device stops moving can be determined, and the end time of the first execution operation can be determined based on the waiting time and the execution time of the first execution operation. This allows the device to stop executing any operation after completing the first first execution operation, and wait for a period of time until the device stops moving before executing the second first execution operation. This can reduce the situation where the next operation cannot be executed due to the device still being in motion, thereby improving the reliability of the device.

[0128] Step 306 : Arrange the first execution operation and the second execution operation according to the execution time and the end time to obtain an operation list.

[0129] Step 307: instruct the device to perform an operation based on the operation list.

[0130] In an embodiment of the present application, by obtaining operations to be orchestrated, determining a target execution operation whose execution delay is greater than an execution delay threshold in the operations to be orchestrated, and determining at least two first execution operations based on at least two execution actions in the target execution operation, the first execution operation includes at least one execution action, and the execution delay of the first execution operation is less than the execution delay threshold, which can reduce the delay between executing each execution action, and by determining a second execution operation to be executed synchronously with the first execution operation from other execution operations other than the target execution operation in the operations to be orchestrated, the execution duration of the first execution operation is determined, and the execution time and end time of the first execution operation are determined based on the execution order, the execution time and end time of the second execution operation are determined, and the first execution operation and the second execution operation are orchestrated based on the execution time and end time to obtain an operation list, and instructing a device to execute an operation based on the operation list, so that the first execution operation and its corresponding execution operation are synchronized. By instructing the device to execute an operation based on the operation list, the device can be applied in scenarios where each operation requires high synchronization, reducing limitations.

[0131] See also Figure 4 , Figure 4 The following is a schematic diagram showing the structure of an operation orchestration device provided in an embodiment of the present application, which may include the following modules:

[0132] The acquisition module 401 is used to acquire the operations to be arranged; wherein the operations to be arranged include at least two execution operations;

[0133] Determining module 402 is configured to determine a target execution operation among the operations to be orchestrated, wherein the execution delay is greater than an execution delay threshold, and determine at least two first execution operations based on the at least two execution actions of the target execution operation; wherein each first execution operation includes at least one execution action, and the execution delay of the first execution operation is less than the execution delay threshold;

[0134] The arrangement module 403 is used to arrange the first execution operation and other execution operations in the to-be-arranged operations except the target execution operation according to the execution order of each execution action to obtain an operation list;

[0135] The execution module 404 is configured to instruct the device to execute an operation based on the operation list.

[0136] In one implementation, the determining module 402 may also be configured to:

[0137] Decompose the target execution operation to obtain at least two execution actions;

[0138] According to the delay duration of each execution action and the execution order of the execution actions, at least two execution actions are divided into at least two execution action sets to obtain at least two first execution operations; wherein, each first execution operation corresponds to an execution action set, the total delay duration of each execution action set is less than the execution delay threshold, and the total delay duration is the sum of the delay durations of all execution actions in the execution action set.

[0139] In one implementation, the other execution operations include at least two second execution operations, and the above-mentioned arrangement module 403 can also be used to:

[0140] Determining, from other execution operations except the target execution operation in the operations to be orchestrated, a second execution operation to be executed synchronously with the first execution operation;

[0141] Determine the execution time and end time of the first execution operation and the second execution operation according to the execution order of each execution action;

[0142] Each first execution operation and second execution operation is arranged according to the execution time and the end time to obtain an operation list.

[0143] In one implementation, the above-mentioned arrangement module 403 may also be used to:

[0144] Determining the execution duration of the first execution operation;

[0145] According to the execution order, execution duration and reference time, the execution time and end time of the first execution operation and the execution time and end time of the second execution operation are determined; wherein the execution time of the first execution operation is the same as the execution time of the second execution operation.

[0146] In one implementation, the above-mentioned arrangement module 403 may also be used to:

[0147] When the first execution operation is determined to be the first execution operation based on the execution order, the reference time is determined to be the execution time of the first execution operation, and the end time of the first execution operation is determined according to the reference time and the execution duration;

[0148] When the first execution operation is not the first execution operation, determine the end time of the historical execution operation, and determine the execution time of the first execution operation based on the end time of the historical execution operation; determine the end time of the first execution operation according to the execution time and execution duration of the first execution operation.

[0149] In one implementation, the above-mentioned arrangement module 403 may also be used to:

[0150] The waiting time is determined, and the end time of the first execution operation is determined according to the waiting time, the reference time, and the execution time.

[0151] In one implementation, the target execution operation is a mechanical operation and the other execution operations are digital operations.

[0152] In an embodiment of the present application, by obtaining the operation to be orchestrated, the operation to be orchestrated includes at least two execution operations, determining the target execution operation whose execution delay is greater than the execution delay threshold in the operation to be orchestrated, and determining at least two first execution operations based on the at least two execution actions in the target execution operation, the first execution operation includes at least one execution action, and the execution delay of the first execution operation is less than the execution delay threshold, which can reduce the delay between executing each execution action, and orchestrate the first execution operation and other execution operations in the operation to be orchestrated except the target execution operation according to the execution order of each execution action, and obtain an operation list, so that the first execution operation and its corresponding execution operation are synchronized, so as to instruct the device to execute the operation based on the operation list, so that the device can be used in scenarios where each operation needs to be highly synchronized, reducing limitations.

[0153] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0154] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0155] See also Figure 5 , Figure 5 A block diagram of a terminal device provided by an embodiment of the present application is shown. Figure 5As shown, this embodiment provides a terminal device 51, which includes: at least one processor 511, a memory 512, and a computer program 5121 stored in the memory 512 and capable of running on at least one processor 511. When the processor 511 executes the computer program 5121, the steps in any of the above-mentioned method embodiments are implemented.

[0156] An embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps of any of the above method embodiments can be implemented.

[0157] An embodiment of the present application provides a computer program product. When the computer program product is run on a terminal device, the terminal device can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0158] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program, when executed by the processor, can implement the steps of the above-mentioned various method embodiments. Wherein, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form, etc. The computer-readable medium may include at least: any entity or device capable of carrying the computer program code to a terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal and a software distribution medium.

[0159] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. A method for operation arrangement, characterized in that: The method comprises: Obtaining operations to be orchestrated; wherein the operations to be orchestrated include at least two execution operations; Determining a target execution operation whose execution delay is greater than an execution delay threshold among the operations to be orchestrated, and determining at least two first execution operations based on at least two execution actions among the target execution operations; wherein each of the first execution operations includes at least one of the execution actions, and the execution delay of the first execution operation is less than the execution delay threshold; Arrange the first execution operation and other execution operations in the to-be-arranged operations except the target execution operation according to the execution order of each execution action to obtain an operation list; Instructing the device to perform an operation based on the operation list.

2. The method for operation arrangement according to claim 1, wherein: The determining of at least two first execution operations according to the at least two execution actions of the target execution operation includes: Decomposing the target execution operation to obtain at least two execution actions; According to the delay duration of each of the execution actions and the execution order of the execution actions, at least two execution actions are divided into at least two execution action sets to obtain at least two first execution operations; wherein each first execution operation corresponds to one of the execution action sets, the total delay duration of each of the execution action sets is less than the execution delay threshold, and the total delay duration is the sum of the delay durations of all the execution actions in the execution action set.

3. The method for operation arrangement according to claim 1 or 2, characterized in that: The other execution operations include at least two second execution operations, and the first execution operations and the other execution operations in the to-be-arranged operations except the target execution operation are arranged according to the execution order of each execution action to obtain an operation list, including: Determining, from other execution operations in the to-be-orchestrated operations except the target execution operation, a second execution operation to be executed synchronously with the first execution operation; Determining the execution time and end time of the first execution operation and the second execution operation according to the execution order of each execution action; The first execution operation and the second execution operation are arranged according to the execution time and the end time to obtain an operation list.

4. The method for operation arrangement according to claim 3, wherein: Determining the execution time and the end time of the first execution operation and the second execution operation according to the execution order of each execution action includes: Determining an execution duration of the first execution operation; According to the execution order, the execution duration and the benchmark time, the execution time and end time of the first execution operation are determined, as well as the execution time and end time of the second execution operation are determined; wherein the execution time of the first execution operation is the same as the execution time of the second execution operation.

5. The method for operation arrangement according to claim 4, characterized in that: The determining, according to the execution order, the execution duration, and the reference time, of the execution time and the end time of the first execution operation includes: When the first execution operation is determined to be the first execution operation based on the execution order, determining the reference time as the execution time of the first execution operation, and determining the end time of the first execution operation based on the reference time and the execution duration; When the first execution operation is not the first operation to be executed, determine the end time of the historical execution operation, and determine the execution time of the first execution operation based on the end time of the historical execution operation; determine the end time of the first execution operation based on the execution time of the first execution operation and the execution duration.

6. The method for operation arrangement according to claim 4, wherein: The determining, based on the execution duration and the reference time, of an end time of the first execution operation includes: A waiting time is determined, and an end time of the first execution operation is determined according to the waiting time, the reference time, and the execution time.

7. The method for operation arrangement according to claim 1, wherein: The target execution operation is a mechanical operation, and the other execution operations include digital operations.

8. An operation arrangement device, characterized in that: The device comprises: An acquisition module, configured to acquire operations to be orchestrated; wherein the operations to be orchestrated include at least two execution operations; a determination module, configured to determine a target execution operation having an execution delay greater than an execution delay threshold among the operations to be orchestrated, and determine at least two first execution operations based on at least two execution actions among the target execution operations; wherein each of the first execution operations includes at least one of the execution actions, and the execution delay of the first execution operation is less than the execution delay threshold; an orchestration module, configured to orchestrate the first execution operation and other execution operations in the to-be-orchestrated operations except the target execution operation according to the execution order of each execution action, to obtain an operation list; An execution module is used to instruct a device to execute an operation based on the operation list.

9. A terminal device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.

10. A computer program product comprising a computer program, characterized in that When the computer program is run on a computer, the computer is caused to perform the method according to any one of claims 1 to 7.

Images