Cross-device interaction method, device, electronic device, and storage medium

Abstract

The present application discloses a cross-device interaction method, apparatus, electronic device, and storage medium, and relates to the technical field of electronic devices. The method includes: receiving an interaction instruction, wherein the interaction instruction is used to instruct a first electronic device to perform an interaction operation with at least one second electronic device, and according to the interaction instruction, obtaining control operation instructions corresponding to each of the first electronic device and the at least one second electronic device, and an operation sequence corresponding to multiple control operation instructions, wherein the control operation instruction is used to trigger an operable control in the display interface of the electronic device, and control the first electronic device and the at least one second electronic device to execute their respective corresponding control operation instructions in the operation sequence. The present application converts the interaction instruction into a series of control operation instructions for the interface when performing cross-device interaction, so that the devices participating in the interaction execute the corresponding control operation instructions in the operation sequence. The application has a wide range of applicable functions, strong versatility, and improves the interaction effect across devices.

Description

Technical Field

[0001] The present application relates to the technical field of electronic devices, and more specifically, to a cross-device interaction method, apparatus, electronic device, and storage medium. Background Art

[0002] With the rise of the Internet of Things and electronic devices, users often have multiple electronic devices, such as smartphones, smart watches, smart TVs, headphones, etc. The user's intention has also changed from the previous single electronic device operation to the joint operation of multiple electronic devices. It becomes very important to organize the cross-device operation of multiple electronic devices to ultimately complete the user's intention. Summary of the invention

[0003] In view of the above problems, the present application proposes a cross-device interaction method, apparatus, electronic device and storage medium to solve the above problems.

[0004] In a first aspect, an embodiment of the present application provides a cross-device interaction method, which is applied to a first electronic device, and the method comprises: receiving an interaction instruction, wherein the interaction instruction is used to instruct the first electronic device to perform an interaction operation with at least one second electronic device; according to the interaction instruction, obtaining control operation instructions corresponding to each of the first electronic device and the at least one second electronic device, and an operation sequence corresponding to multiple control operation instructions, wherein the control operation instruction is used to trigger an operable control in a display interface of the electronic device; and controlling the first electronic device and the at least one second electronic device to execute their respective corresponding control operation instructions in the operation sequence.

[0005] In a second aspect, an embodiment of the present application provides a cross-device interaction device, which is applied to a first electronic device, and the device includes: an interaction instruction receiving module, which is used to receive interaction instructions, wherein the interaction instructions are used to instruct the first electronic device to perform interaction operations with at least one second electronic device; a control operation instruction acquisition module, which is used to acquire control operation instructions corresponding to each of the first electronic device and the at least one second electronic device according to the interaction instructions, and an operation sequence corresponding to multiple control operation instructions, wherein the control operation instructions are used to trigger operable controls in a display interface of the electronic device; a control operation instruction control module, which is used to control the first electronic device and the at least one second electronic device to execute their respective corresponding control operation instructions in the operation sequence.

[0006] In a third aspect, an embodiment of the present application provides an electronic device, comprising a memory and a processor, wherein the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the processor executes the above method.

[0007] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a program code is stored, and the program code can be called by a processor to execute the above method.

[0008] The cross-device interaction method, apparatus, electronic device and storage medium provided in the embodiments of the present application receive interaction instructions, wherein the interaction instructions are used to instruct a first electronic device to perform an interaction operation with at least one second electronic device, and according to the interaction instructions, control operation instructions corresponding to each of the first electronic device and the at least one second electronic device, as well as an operation sequence corresponding to multiple control operation instructions are obtained, wherein the control operation instructions are used to trigger operable controls in a display interface of the electronic device, and control the first electronic device and the at least one second electronic device to execute their respective corresponding control operation instructions in the operation sequence, thereby converting the interaction instructions into a series of control operation instructions for the interface during cross-device interaction, so that the devices participating in the interaction execute the corresponding control operation instructions in the operation sequence, having a wide range of applicable functions and strong versatility, thereby improving the cross-device interaction effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative work.

[0010] Figure 1 A schematic diagram of an application environment of the cross-device interaction method provided in an embodiment of the present application is shown;

[0011] Figure 2 Another application environment schematic diagram of the cross-device interaction method provided in an embodiment of the present application is shown;

[0012] Figure 3 A schematic diagram of a process flow of a cross-device interaction method provided by an embodiment of the present application is shown;

[0013] Figure 4 A schematic diagram of a process flow of a cross-device interaction method provided by an embodiment of the present application is shown;

[0014] Figure 5 This application shows Figure 4 A schematic flow chart of step S230 of the cross-device interaction method shown;

[0015] Figure 6 A schematic diagram of a process flow of a cross-device interaction method provided by an embodiment of the present application is shown;

[0016] Figure 7 A schematic diagram of a process flow of a cross-device interaction method provided by an embodiment of the present application is shown;

[0017] Figure 8 A schematic diagram of a process flow of a cross-device interaction method provided by an embodiment of the present application is shown;

[0018] Fig. 9 A module block diagram of a cross-device interaction apparatus provided by an embodiment of the present application is shown;

[0019] Fig.10 A block diagram of an electronic device according to an embodiment of the present application for executing a cross-device interaction method according to an embodiment of the present application is shown;

[0020] Fig.11 A storage unit for storing or carrying program codes for implementing a cross-device interaction method according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0021] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0022] At present, cross-device operation technologies generally adopt function customization solutions, which require developers to develop and customize corresponding functions. The functions are difficult to expand, and the development workload is large, and upgrades and maintenance are difficult. Specifically, most of the current solutions are based on developers customizing cross-device functions, identifying user cross-device operation instructions, and the device executing the cross-device functions customized by the developer to complete the operation. This solution has poor scalability, and new functions need to be completely redeveloped by developers, which requires a lot of development work.

[0023] In view of the above problems, the inventors have discovered after long-term research and proposed the cross-device interaction method, device, electronic device and storage medium provided in the embodiments of the present application. When performing cross-device interaction, the interaction instructions are converted into a series of control operation instructions for the interface, so that the devices participating in the interaction execute the corresponding control operation instructions in the order of operation. The invention has a wide range of applicable functions and strong versatility, and improves the cross-device interaction effect. Among them, the specific cross-device interaction method is described in detail in the subsequent embodiments.

[0024] The following will introduce the application environment of the cross-device interaction method provided in the embodiments of the present application.

[0025] See also Figure 1 , Figure 1 A schematic diagram of an application environment of the cross-device interaction method provided by an embodiment of the present application is shown. Figure 1As shown, the application environment includes: a first electronic device 100 and at least one second electronic device 200 (the number of second electronic devices 200 shown in the figure is 3), wherein the first electronic device 100 can be connected to at least one second electronic device 200 respectively to realize data interaction between the first electronic device 100 and at least one second electronic device 200 respectively, and the at least one second electronic device 200 can also be connected separately to realize data interaction between at least one second electronic device 200, which is not limited here. As a way, the first electronic device 100 and each second electronic device 200 can establish a connection through near field communication, and every two second electronic devices 200 can establish a connection through near field communication, wherein the near field communication method can include WIFI, Bluetooth, etc., which is not limited here.

[0026] See also Figure 2 , Figure 2 FIG. 2 shows another application environment diagram of the cross-device interaction method provided by the embodiment of the present application. Figure 2 As shown, the application environment includes: a first electronic device 100, at least one second electronic device 200 (the number of the second electronic devices 200 is 3 in the figure), and a server 300. The first electronic device 100 can be connected to at least one second electronic device 200 respectively to realize data interaction between the first electronic device 100 and at least one second electronic device 200 respectively, and the at least one second electronic device 200 can also be connected to realize data interaction between at least one second electronic device 200, and the server 300 can be connected to the first electronic device 100 and at least one second electronic device 200 respectively to realize data interaction between the server 300 and the first electronic device 100, and between the server 300 and at least one second electronic device 200, which is not limited here.

[0027] In the embodiment of the present application, the first electronic device 100 may include a smart phone, a tablet computer, a smart TV, a smart home device, a smart watch, etc., which is not limited here.

[0028] In the embodiment of the present application, the second electronic device 200 may include a smart phone, a tablet computer, a smart TV, a smart home device, a smart watch, etc., which is not limited here.

[0029] In the embodiment of the present application, the server 300 may be a traditional server or a cloud server, which is not limited here.

[0030] In some embodiments, the first electronic device 100 may include a communication module, the second electronic device 200 may include a communication module, and the first electronic device 100 may establish a connection with the communication module of the second electronic device 200 through its communication module. In some embodiments, the first electronic device 100 may include a management module, the second electronic device 200 may include a management module, and the first electronic device 100 and / or the second electronic device may receive an interaction instruction through its management module and obtain an interface operation sequence corresponding to the interaction instruction. In some embodiments, the first electronic device 100 may include an interface operation module, the second electronic device 200 may include an interface operation module, and the first electronic device 100 and / or the second electronic device 200 may identify and trigger an operation control through its interface operation module.

[0031] See also Figure 3 , Figure 3 The flowchart of the cross-device interaction method provided by an embodiment of the present application is shown. The cross-device interaction method is used to convert the interaction instructions into a series of control operation instructions for the interface during the cross-device interaction, so that the devices participating in the interaction execute the corresponding control operation instructions according to the operation sequence. It has a wide range of applicable functions and strong versatility, and improves the cross-device interaction effect. In a specific embodiment, the cross-device interaction method is applied to Fig.10 The cross-device interaction apparatus 400 and the electronic device 100 (first electronic device) equipped with the cross-device interaction apparatus 400 are shown as follows: Fig.11 ). The following will take an electronic device as an example to illustrate the specific process of this embodiment. Of course, it can be understood that the electronic device of this embodiment can include a smart phone, a tablet computer, a wearable electronic device, etc. Figure 3 The process shown is described in detail, and the cross-device interaction method may specifically include the following steps:

[0032] Step S110: receiving an interaction instruction, wherein the interaction instruction is used to instruct the first electronic device to perform an interaction operation with at least one second electronic device.

[0033] In this embodiment, a communication connection is established between each two devices in the first electronic device and the at least one second electronic device, and the devices communicate with each other based on the established communication connection. For example, the first electronic device includes a first communication module, and each second electronic device in the at least one second electronic device includes a second communication module. The first electronic device establishes a communication connection with the second communication module of each second electronic device through its first communication module to achieve a communication connection between the first electronic device and each second electronic device.

[0034] As a method, the communication connection method between the first electronic device and the at least one second electronic device may include a near field communication method. For example, the first electronic device and the at least one second electronic device are connected via WiFi; the first electronic device and the at least one second electronic device are connected via Bluetooth, etc., which are not limited here.

[0035] In some embodiments, the first electronic device may establish a connection with at least one second electronic device in advance, and based on the established connection, receive an interaction instruction for instructing the first electronic device to perform an interaction operation with at least one second electronic device; the first electronic device may establish a connection with at least one second electronic device when receiving the interaction instruction for instructing the first electronic device to perform an interaction operation with at least one second electronic device, which is not limited here.

[0036] In some embodiments, the first electronic device and / or the second electronic device may display a target interface, and the target interface may display at least one operable control. For example, the first electronic device and / or the second electronic device may be a smart TV, the target interface may be the home page of the smart TV, and the at least one operable control displayed on the target interface may include multiple navigation cards of the home page, such as a "Login" card, a "Viewing History" card, etc. The at least one operable control includes a target operable control.

[0037] In an embodiment of the present application, the electronic device can monitor whether an input interaction instruction is received during the process of displaying the target interface. As a way, the electronic device can monitor whether an input interaction instruction is received in real time during the process of displaying the target interface, the electronic device can monitor whether an input interaction instruction is received at a preset time interval during the process of displaying the target interface, the electronic device can monitor whether an input interaction instruction is received at a preset time point during the process of displaying the target interface, and the electronic device can monitor whether an input interaction instruction is received according to other preset rules (such as user trigger, environment trigger, etc.) during the process of displaying the target interface, which is not limited here.

[0038] In one embodiment of the present application, the first electronic device receiving the interaction instruction may include: the first electronic device receiving a voice instruction input by the user; the first electronic device receiving an interface operation instruction input by the user, etc., which are not limited here. For example, when the first electronic device receives the interaction instruction as the first electronic device receiving a voice instruction input by the user, the voice instruction may include "establishing a Bluetooth connection between the first electronic device and XX second electronic device", "establishing a smart linkage between the first electronic device and XX second electronic device", etc. For another example, when the first electronic device receives the interaction instruction as the first electronic device receiving an interface operation instruction input by the user, the interface operation instruction may include "touch Bluetooth connection control", "touch smart linkage control", etc.

[0039] Step S120: According to the interaction instruction, obtain the control operation instructions corresponding to each of the first electronic device and the at least one second electronic device, and the operation sequence corresponding to multiple control operation instructions, wherein the control operation instructions are used to trigger the operable controls in the display interface of the electronic device.

[0040] In this embodiment, after receiving the interaction instruction, the first electronic device can parse the interaction instruction, obtain the control operation instruction corresponding to each of the first electronic device and at least one second electronic device, and the operation sequence corresponding to the multiple control operation instructions, wherein the control operation instruction is used to trigger the operable control in the display interface of the electronic device. As one way, when the electronic device is the first electronic device, the control operation instruction is used to trigger the operable control of the display interface of the first electronic device. As another way, when the electronic device is a second electronic device among at least one second electronic device, the control operation instruction is used to trigger the operable control of the display interface of the second electronic device.

[0041] In some embodiments, after receiving the interaction instruction, the first electronic device may determine the interface operation sequence that needs to be performed by the first electronic device and the second electronic device in response to the interaction instruction. The interface operation sequence may include the control operation instructions corresponding to the first electronic device and the at least one second electronic device, and the operation order corresponding to the multiple control operation instructions.

[0042] In one embodiment of the present application, the control operation instruction may be a click operation on an operable control in the displayed interface, a press operation on an operable control in the displayed interface, a sliding operation on an operable control in the displayed interface, a touch operation on an operable control in the displayed interface, etc., which is not limited here.

[0043] In one embodiment of the present application, the operation sequence corresponding to multiple control operation instructions can be understood as that the multiple control operation instructions are performed sequentially in a certain order, that is, after the previous control operation instruction of the operation sequence is executed, the next control operation instruction of the operation sequence is triggered until the control operation instructions corresponding to the first electronic device and at least one second electronic device are respectively executed.

[0044] Step S130: controlling the first electronic device and the at least one second electronic device to execute their respective corresponding control operation instructions according to the operation sequence.

[0045] In this embodiment, when the first electronic device obtains the control operation instructions corresponding to the first electronic device and at least one second electronic device, and the operation sequence corresponding to the multiple control operation instructions, the first electronic device and at least one second electronic device can be controlled to execute the control operation instructions corresponding to each device according to the operation sequence. Based on this, cross-device operations can be transformed into a series of control operations on the interface, and cross-device operations of any system interface and any mobile application can be realized without the need for application manufacturers to adapt. At the same time, the operation is sufficiently fine-grained, and any complex function can be composed of fine-grained interface control operations, which can realize any complex function and has good versatility.

[0046] In some embodiments, it is assumed that there is only one second electronic device, the first electronic device corresponds to the first control operation instruction and the second control operation, the second electronic device corresponds to the third control operation, the fourth control operation and the fifth control operation, and the operation sequence is: the first control operation, the third control operation, the second control operation, the fifth control operation and the fourth control operation. Based on this, the first electronic device can be controlled to perform the first control operation first, and when the first electronic device completes the first control operation, the second electronic device can be controlled to perform the third control operation, when the second target electronic device completes the third control operation, the first electronic device can be controlled to perform the second control operation, when the first electronic device completes the second control operation, the second electronic device can be controlled to perform the fifth control operation, when the second electronic device completes the fifth control operation, the second electronic device can be controlled to perform the fourth control operation, until the second electronic device completes the fourth control operation, it can be determined that the operation indicated by the interaction instruction is completed.

[0047] A cross-device interaction method provided by an embodiment of the present application receives an interaction instruction, wherein the interaction instruction is used to instruct a first electronic device to perform an interaction operation with at least one second electronic device, and obtains control operation instructions corresponding to each of the first electronic device and the at least one second electronic device according to the interaction instruction, as well as an operation sequence corresponding to multiple control operation instructions, wherein the control operation instruction is used to trigger an operable control in a display interface of the electronic device, and control the first electronic device and the at least one second electronic device to execute their respective corresponding control operation instructions in the operation sequence, thereby converting the interaction instruction into a series of control operation instructions for the interface during cross-device interaction, so that the devices participating in the interaction execute the corresponding control operation instructions in the operation sequence. The method has a wide range of applicable functions, strong versatility, and improves the cross-device interaction effect.

[0048] See also Figure 4 , Figure 4 A flow chart of a cross-device interaction method provided by an embodiment of the present application is shown. The method is applied to the above-mentioned electronic device. In this embodiment, a first electronic device corresponds to a first control operation instruction. The operation sequence number corresponding to the first control operation instruction is N. The interaction instruction is received when the first electronic device displays a first interface. The first interface includes at least one operable control. Figure 4 The process shown is described in detail, and the cross-device interaction method may specifically include the following steps:

[0049] Step S210: receiving an interaction instruction, wherein the interaction instruction is used to instruct the first electronic device to perform an interaction operation with at least one second electronic device.

[0050] Step S220: According to the interaction instruction, obtain the control operation instructions corresponding to each of the first electronic device and the at least one second electronic device, and the operation sequence corresponding to multiple control operation instructions, wherein the control operation instructions are used to trigger the operable controls in the display interface of the electronic device.

[0051] For the detailed description of step S210 to step S220, please refer to step S110 to step S120, which will not be repeated here.

[0052] Step S230: acquiring, from the at least one operable control, the operable control indicated by the first control operation instruction as a target operable control.

[0053] In this embodiment, the interaction instruction is received when the first electronic device displays a first interface, wherein the first interface displays at least one operable control.

[0054] In some embodiments, when the first electronic device determines that the first electronic device corresponds to the first control operation, the first electronic device can obtain the operable control indicated by the first control operation instruction from at least one operable control displayed in the first interface as the target operable control. For example, assuming that the interaction instruction is an instruction to instruct the first electronic device and the second electronic device to establish a Bluetooth connection, the first electronic device can obtain an operable control for triggering the first electronic device to establish a Bluetooth connection with the second electronic device from at least one operable control of the first interface displayed by the first electronic device as the target operable control. For another example, assuming that the interaction instruction is an instruction to instruct the first electronic device to project the interface to the second electronic device for display, the first electronic device can obtain an operable control for triggering the first electronic device to project the interface to the second electronic device from at least one operable control of the first interface displayed by the first electronic device as the target operable control.

[0055] See also Figure 5 , Figure 5 This application shows Figure 4 The flow chart of step S230 of the cross-device interaction method shown in FIG. Figure 5 The process shown is described in detail, and the method may specifically include the following steps:

[0056] Step S231: Obtain the control identifier of the operable control indicated by the first control operation instruction.

[0057] In some implementations, when the first electronic device determines that the first electronic device corresponds to the first control operation instruction, the first electronic device may obtain the control identifier of the operable control indicated by the first control operation instruction. The control identifier may be a character identifier, a text identifier, a digital identifier, a position identifier, a function identifier, a letter identifier, or a combination of the above identifiers, etc., which is not limited here.

[0058] In one embodiment of the present application, when the first electronic device obtains the first control operation instruction, it can analyze the first control operation instruction to obtain the content carried by the first control operation instruction, and determine the control identifier of the operable control indicated by the first control operation instruction based on the content carried by the first control operation instruction. For example, if the first control operation instruction is "click to set the control", and it is determined through analysis that the content carried by the first control operation instruction is "setting", then it can be determined that the control identifier of the operable control indicated by the first control operation instruction is "setting text".

[0059] Step S232: Identify the at least one operable control and obtain a control identifier corresponding to each of the at least one operable control.

[0060] In some embodiments, the first electronic device can identify at least one operable control displayed on its interface, thereby obtaining a control identifier corresponding to each of the at least one operable control. As a method, the first electronic device can identify at least one operable control displayed on its interface, obtain content corresponding to at least one operable control displayed on the interface, and obtain a control identifier corresponding to each of the at least one operable control based on the content corresponding to the at least one operable control. For example, the interface can be the system desktop of the electronic device, and the control identifier can be a text identifier, then the control identifier corresponding to each of the at least one operable control can include: "setting text", "clock text", "photo text", "calendar text", etc., which are not limited here.

[0061] Step S233: Based on the control identifier corresponding to each of the at least one operable control, determine a target operable control from the at least one operable control, wherein the control identifier corresponding to the target operable control matches the control identifier of the operable control indicated by the first control operation instruction.

[0062] In this embodiment, after obtaining the control identifier corresponding to at least one operable control and the control identifier of the operable control indicated by the first control operation instruction, the first electronic device can obtain the control corresponding to the operable control indicated by the first control operation instruction from at least one operable control as the target operable control based on the control identifier corresponding to the at least one operable control. As an implementable manner, the first electronic device can sequentially compare the control identifier of the operable control indicated by the first control operation instruction with the control identifier corresponding to at least one operable control, and obtain the operable control corresponding to the matching control identifier as the target operable control.

[0063] For example, assuming that the control identifier of the operable control indicated by the first control operation instruction is "Set text", the control identifier corresponding to at least one operable control may include: "Set text", "Clock text", "Photo text", "Calendar text", then the operable control corresponding to "Set text" in at least one operable control can be determined as the target operable control.

[0064] Step S240: controlling the first electronic device to execute the first control operation instruction.

[0065] In some embodiments, after determining the target operable control, the first electronic device may be controlled to execute the first control operation instruction. For example, if the first control operation instruction instructs to click the target operable control, a click operation on the target operable control may be executed; if the first control operation instruction instructs to press the target operable control, a press operation on the target operable control may be executed; if the first control operation instruction instructs to slide the target operable control, a slide operation on the target operable control may be executed, etc., which are not limited here.

[0066] Step S250: When the first control operation instruction is executed successfully, the first electronic device updates from displaying the first interface to displaying the second interface.

[0067] In some embodiments, after executing the first control operation instruction, the first electronic device may monitor the execution of the first control operation instruction. When it is monitored that the first control operation instruction is executed successfully, the first electronic device may update from displaying the first interface to displaying the second interface. When it is monitored that the first control operation instruction fails to execute, the first electronic device keeps displaying the first interface.

[0068] As a method, when the first interface can be the desktop displayed by the first electronic device, and the first control operation instruction is to trigger the opening of a certain application, the second interface can be the page corresponding to the application. That is to say, based on the first control operation instruction, the first electronic device can automatically jump from displaying the desktop to displaying the page of the application.

[0069] As another way, when the first interface is the first page of an application displayed by the first electronic device, and the first control operation instruction is to trigger a control in the first page, then the second interface can be the second page of the application, that is, based on the first control operation instruction, the first electronic device can automatically jump from displaying a page of the application to displaying another page of the application.

[0070] Step S260: When the first control operation instruction is executed successfully, a message indicating that the first control operation instruction is executed successfully is sent to a first target electronic device among the at least one second electronic device to instruct the first target electronic device to execute the second control operation instruction, wherein the first target electronic device corresponds to the second control operation instruction, and the operation sequence number corresponding to the second control operation instruction is N+1, wherein N is a positive integer greater than 0.

[0071] In some embodiments, it is assumed that the interaction instruction is split into a first control operation instruction and a second control operation instruction, the operation sequence number corresponding to the first control operation is N, the operation sequence number corresponding to the second control operation instruction is N+1, and the electronic device corresponding to the first control operation instruction is the first electronic device, and the electronic device corresponding to the second control operation instruction is the first target electronic device in at least one second electronic device. Among them, when N is 1, the operation sequence number corresponding to the first control operation instruction is 1, and the operation sequence number corresponding to the second control operation instruction is 2. When N is 3, the operation sequence number corresponding to the first control operation instruction is 3, and the operation sequence number corresponding to the second control operation instruction is 4, etc., which is not limited here.

[0072] In one embodiment of the present application, when the first control operation instruction is executed successfully, the first electronic device can obtain the electronic device corresponding to the control operation instruction whose operation sequence number is arranged after the first control operation instruction, that is, it can obtain the first target electronic device corresponding to the second control operation instruction whose operation sequence number is arranged after the first control operation instruction, and send a message of successful execution of the first control operation instruction to the first target electronic device, so that the first target electronic device knows the second control operation instruction that it needs to execute.

[0073] In one embodiment of the present application, when the first control operation instruction is executed successfully, the first electronic device can send a message indicating that the first control operation instruction is executed successfully to the at least one second electronic device, so that the at least one second electronic device knows that the first control operation is executed successfully.

[0074] In one embodiment of the present application, when the execution of the first control operation instruction fails, the first electronic device can send a message indicating the execution failure of the first control operation instruction to the at least one second electronic device, so that the at least one second electronic device knows that the execution of the first control operation fails.

[0075] Compared with the cross-device interaction method provided by an embodiment of the present application, Figure 3The cross-device interaction method shown, this embodiment also controls the first electronic device to execute the first control operation instruction when the first electronic device corresponds to the first control operation instruction and the operation sequence number corresponding to the first control operation instruction is N, and when the first control operation instruction is successfully executed, a message of the successful execution of the first control operation instruction is sent to the first target electronic device in at least one second electronic device to instruct the first target electronic device to execute the second control operation instruction, wherein the first target electronic device corresponds to the second control operation instruction, and the operation sequence number corresponding to the second control operation instruction is N+1, so that the electronic device executes the control operation instruction according to the operation sequence. In addition, the interaction instruction of this embodiment is also received when the first electronic device displays the first interface, and the first interface includes at least one operable control, and the operable control indicated by the first control operation instruction can be obtained from the at least one operable control as the target operable control, thereby improving the accuracy of the determined target operable control.

[0076] See also Figure 6 , Figure 6 A schematic flow chart of a cross-device interaction method provided by an embodiment of the present application is shown. The method is applied to the above-mentioned electronic device. In this embodiment, the first electronic device corresponds to the first control operation instruction, and the operation sequence number corresponding to the first control operation instruction is N. Figure 6 The process shown is described in detail, and the cross-device interaction method may specifically include the following steps:

[0077] Step S310: receiving an interaction instruction, wherein the interaction instruction is used to instruct the first electronic device to perform an interaction operation with at least one second electronic device.

[0078] Step S320: According to the interaction instruction, obtain the control operation instructions corresponding to each of the first electronic device and the at least one second electronic device, and the operation sequence corresponding to multiple control operation instructions, wherein the control operation instructions are used to trigger the operable controls in the display interface of the electronic device.

[0079] For the detailed description of step S310 to step S320, please refer to step S110 to step S120, which will not be repeated here.

[0080] Step S330: controlling the first electronic device to execute the first control operation instruction.

[0081] For the detailed description of step S330, please refer to step S240, which will not be repeated here.

[0082] Step S340: When the first control operation instruction is executed successfully, a message indicating that the first control operation instruction is executed successfully is sent to a first target electronic device among the at least one second electronic device to instruct the first target electronic device to execute the second control operation instruction, wherein the first target electronic device corresponds to the second control operation instruction, and the operation sequence number corresponding to the second control operation instruction is N+1, wherein N is a positive integer greater than 0.

[0083] For the detailed description of step S340, please refer to step S260, which will not be repeated here.

[0084] Step S350: When the second control operation instruction is executed successfully, the execution information of the multiple control operation instructions is obtained.

[0085] In some embodiments, after the first electronic device sends the first control operation instruction to the first target electronic device and the first target electronic device starts to execute the second control operation instruction, the first electronic device can monitor the execution of the second control operation instruction. When it is monitored that the second control operation instruction is executed successfully, the first electronic device can obtain the execution information of the multiple control operation instructions.

[0086] The execution information of the plurality of control operation instructions may include: the plurality of control operation instructions are all executed, or the plurality of control operation instructions are not executed.

[0087] As a method, the multiple control operation instructions may include at least a first control operation instruction and a second control operation instruction. Wherein, when the multiple control operation instructions include other control operation instructions in addition to the first control operation instruction and the second control operation instruction, it can be determined that the multiple control operation instructions have not been executed. For example, when the multiple control operation instructions also include a third control operation instruction and a fourth control operation instruction, it can be considered that the third control operation instruction and the fourth control operation instruction have not been executed, that is, the multiple control operation instructions have not been executed. Wherein, when the multiple control operation instructions only include the first control operation instruction and the second control operation instruction, it can be determined that the multiple control operation instructions have been executed.

[0088] Step S360: When the execution information indicates that the multiple control operation instructions have not been completely executed, control the first target electronic device to send a message indicating that the second control operation instruction has been successfully executed to a second target electronic device among the at least one second electronic device, so as to instruct the second target electronic device to execute a third control operation instruction, wherein the second target electronic device corresponds to the third control operation instruction, and the operation order corresponding to the third control operation instruction is N+2.

[0089] In some embodiments, it is assumed that the interaction instruction is divided into a first control operation instruction, a second control operation instruction, and a third control operation instruction, the operation sequence number corresponding to the first control operation instruction is N, the operation sequence number corresponding to the second control operation instruction is N+1, and the operation sequence corresponding to the third control operation instruction is N+2, and the electronic device corresponding to the first control operation instruction is the first electronic device, the electronic device corresponding to the second control operation instruction is the first target electronic device in at least one second electronic device, and the electronic device corresponding to the third control operation instruction is the second target electronic device in at least one second electronic device. Wherein, when N is 1, the operation sequence number corresponding to the first control operation instruction is 1, the operation sequence number corresponding to the second control operation instruction is 2, and the operation sequence number corresponding to the third control operation instruction is 3. When N is 3, the operation sequence number corresponding to the first control operation instruction is 3, the operation sequence number corresponding to the second control operation instruction is 4, and the operation sequence corresponding to the third control operation instruction is 5, etc., which are not limited here.

[0090] In one embodiment of the present application, when the second control operation instruction is executed and multiple control operation instructions have not been executed, the first electronic device can obtain the electronic device corresponding to the control operation instruction whose operation sequence number is arranged after the second control operation instruction, that is, it can obtain the second target electronic device corresponding to the third control operation instruction whose operation sequence number is arranged after the second control operation instruction, and control the first target electronic device to send a message of successful execution of the second control operation instruction to the second target electronic device, so that the second target electronic device knows the third control operation instruction that it needs to execute.

[0091] Step S370: When the second control operation instruction is executed successfully, the first target electronic device is controlled to update from displaying the third interface to displaying the fourth interface.

[0092] In some embodiments, after the first target electronic device executes the second control operation instruction, the first electronic device may monitor the execution of the second control operation instruction. When it is monitored that the second control operation instruction is executed successfully, the first target electronic device may be controlled to update from displaying the third interface to displaying the fourth interface. When it is monitored that the second control operation instruction fails to execute, the first target electronic device may be controlled to keep displaying the third interface.

[0093] As a method, the third interface can be the desktop displayed by the first target electronic device. When the second control operation instruction triggers the opening of an application, the fourth interface can be the page corresponding to the application. That is to say, based on the second control operation instruction, the first target electronic device can automatically jump from displaying the desktop to displaying the application page.

[0094] As another way, when the third interface is the first page of an application displayed by the second target electronic device, and the second control operation instruction is to trigger a control in the first page, then the fourth interface can be the second page of the application, that is, based on the second control operation instruction, the second target electronic device can automatically jump from displaying a page of the application to displaying another page of the application.

[0095] Compared with the cross-device interaction method provided by an embodiment of the present application, Figure 3 The cross-device interaction method shown in this embodiment also controls the first electronic device to execute the first control operation instruction when the first electronic device corresponds to the first control operation instruction and the operation sequence number corresponding to the first control operation instruction is N, and when the first control operation instruction is successfully executed, the message of the successful execution of the first control operation instruction is sent to the first target electronic device in at least one second electronic device to indicate the first target electronic device to execute the second control operation instruction, wherein the first target electronic device corresponds to the second control operation instruction, and the operation sequence number corresponding to the second control operation instruction is N+1, when the second control operation instruction is successfully executed, the execution information of multiple control operation instructions is obtained, and when the execution information indicates that the execution of multiple control operations is not completed, the first target electronic device is controlled to send the message of the successful execution of the second control operation to the second target electronic device in at least one second electronic device to indicate the second target electronic device to execute the third control operation instruction, wherein the second target electronic device corresponds to the third control operation instruction, and the operation sequence corresponding to the third control operation instruction is N+2, so as to realize that the electronic device executes the control operation instruction according to the operation sequence. In addition, in this embodiment, when the second control operation instruction is successfully executed, the first target electronic device is controlled to update from displaying the third interface to displaying the fourth interface, thereby improving the user's visual experience.

[0096] See also Figure 7 , Figure 7 The schematic diagram of the process of the cross-device interaction method provided by an embodiment of the present application is shown. The method is applied to the above-mentioned electronic device (first electronic device), the first electronic device is connected to the server, and the following will be directed to Figure 7 The process shown is described in detail, and the cross-device interaction method may specifically include the following steps:

[0097] Step S410: receiving an interaction instruction, wherein the interaction instruction is used to instruct the first electronic device to perform an interaction operation with at least one second electronic device.

[0098] For the detailed description of step S410, please refer to step S110, which will not be repeated here.

[0099] Step S420: Send the interaction instruction to the server to instruct the server to obtain the control operation instructions corresponding to the first electronic device and the at least one second electronic device respectively, and the operation sequence corresponding to the multiple control operation instructions based on the interaction instruction.

[0100] In this embodiment, after receiving the interaction instruction, the first electronic device may send the interaction instruction to the server. After receiving the interaction instruction, the server may parse the interaction instruction to obtain the control operation instructions corresponding to each of the first electronic device and at least one second electronic device, as well as the operation sequence corresponding to the multiple control operation instructions. As a method, the first electronic device includes a management module, which accesses the interface operation sequence of multiple electronic devices (the first electronic device and at least one second electronic device) of corresponding functions of the server according to the interaction instruction, parses the interface operation sequence, obtains the control operation instructions corresponding to each of the first electronic device and at least one second electronic device, as well as the operation sequence corresponding to the multiple control operation instructions.

[0101] In an embodiment of the present application, the first electronic device sends an interaction instruction to a server to obtain control operation instructions corresponding to the first electronic device and at least one second electronic device, as well as an operation sequence corresponding to multiple control operation instructions, thereby achieving configurable and updatable operation sequences under multiple electronic devices. New functions can be realized by only configuring the server, and the functional extensibility is strong.

[0102] Step S430: receiving the control operation instructions corresponding to the first electronic device and the at least one second electronic device respectively, and the operation sequence corresponding to the multiple control operation instructions fed back by the server.

[0103] As a method, after obtaining the control operation instructions corresponding to the first electronic device and at least one second electronic device, and the operation sequence corresponding to the multiple control operation instructions, the server can feed back the control operation instructions corresponding to the first electronic device and at least one second electronic device, and the operation sequence corresponding to the multiple control operation instructions to the first electronic device. Accordingly, the first electronic device receives the control operation instructions corresponding to the first electronic device and at least one second electronic device, and the operation sequence corresponding to the multiple control operation instructions fed back by the server.

[0104] As another way, after obtaining the control operation instructions corresponding to the first electronic device and at least one second electronic device, and the operation sequence corresponding to the multiple control operation instructions, the server can feed back the control operation instructions corresponding to the first electronic device and at least one second electronic device, and the operation sequence corresponding to the multiple control operation instructions, to the first electronic device and at least one second electronic device, respectively. Accordingly, the first electronic device and at least one second electronic device respectively receive the control operation instructions corresponding to the first electronic device and at least one second electronic device, and the operation sequence corresponding to the multiple control operation instructions, fed back by the server.

[0105] Step S440: Control the first electronic device and the at least one second electronic device to execute their respective corresponding control operation instructions according to the operation sequence.

[0106] For the detailed description of step S440, please refer to step S130, which will not be repeated here.

[0107] Step S450: When the execution of the plurality of control operation instructions is completed, the execution results of the plurality of control operation instructions are obtained.

[0108] In some implementations, the first electronic device may monitor execution information of multiple control operation instructions, wherein the execution information of multiple control operation instructions may include: multiple control operation instructions are executed completely, or multiple control operation instructions are not executed completely.

[0109] When it is monitored that the execution of the multiple control operation instructions is completed, the execution results of the multiple control operation instructions can be obtained. As a way, the execution of the multiple control operation instructions can include: the multiple control operation instructions have been executed and successfully, the multiple control operation instructions have been executed and the last control operation instruction has failed to execute, or the failure of one of the multiple control operation instructions to execute causes the subsequent control operation instructions to stop executing.

[0110] In some implementations, the execution results of the multiple control operation instructions may include: the multiple control operation instructions are all executed successfully, or the multiple control operation instructions are not all executed successfully.

[0111] Step S460: Sending the execution result to the server to instruct the server to maintain or modify the multiple control operation instructions and the operation sequence corresponding to the multiple control operation instructions according to the execution result.

[0112] In some embodiments, after obtaining the execution result, the first electronic device can send the execution result to the server to instruct the server to maintain or modify the multiple control operation instructions and the operation sequence corresponding to the multiple control operation instructions according to the execution result. Thus, by providing real-time feedback on the execution result of the operation sequence, the failure analysis of the operation sequence can be performed in real time to guide the upgrade and maintenance of the operation sequence library.

[0113] Among them, when the execution result represents that multiple control operation instructions are executed successfully, it can be considered that the control operation instructions for the first electronic device and at least one second electronic device generated by the server based on the interaction instructions, and the operation sequence corresponding to the multiple control operation instructions are accurate, that is, the server can be instructed to maintain the multiple control operation instructions and the operation sequence corresponding to the multiple control operation instructions.

[0114] Among them, when the execution result indicates that multiple control operation instructions are not all executed successfully, it can be considered that the control operation instructions for the first electronic device and at least one second electronic device generated by the server based on the interaction instructions, as well as the operation sequence corresponding to the multiple control operation instructions are incorrect, that is, the server can be instructed to modify the multiple control operation instructions and the operation sequence corresponding to the multiple control operation instructions.

[0115] The cross-device interaction method provided by an embodiment of the present application also sends an interaction instruction to a server to instruct the server to obtain the control operation instructions corresponding to the first electronic device and at least one second electronic device, and the operation sequence corresponding to the multiple control operation instructions based on the interaction instruction, so that the cross-device control operation instructions and the operation sequence are placed on the server, which can realize the real-time update and configuration of functions, and the new functions can be added without upgrading the equipment, and only the server needs to be upgraded to improve the applicability of the solution. In addition, when the execution of multiple control operation instructions is completed, the execution results of the multiple control operation instructions are obtained, and the execution results are sent to the server to instruct the server to maintain or modify the multiple control operation instructions and the operation sequence corresponding to the multiple control operation instructions according to the execution results, so as to optimize the control operation instructions.

[0116] See also Figure 8 , Figure 8 The schematic diagram of the process flow of the cross-device interaction method provided by an embodiment of the present application is shown. The method is applied to the above electronic device. Figure 8 The process shown is described in detail, and the cross-device interaction method may specifically include the following steps:

[0117] Step S510: receiving an interaction instruction, wherein the interaction instruction is used to instruct the first electronic device to perform an interaction operation with at least one second electronic device.

[0118] For the detailed description of step S510, please refer to step S110, which will not be repeated here.

[0119] Step S520: Parse the interaction instruction to obtain the device identification included in the interaction instruction.

[0120] In some implementations, after receiving the interaction instruction, the first electronic device may parse the interaction instruction to obtain the device identification included in the interaction instruction.

[0121] For example, assuming that the interaction instruction is "establishing a Bluetooth connection between the first electronic device and the first target electronic device", after parsing the interaction instruction, the device identification contained in the interaction instruction can be obtained as the device identification of the first electronic device and the device identification of the first target electronic device. For another example, assuming that the interaction instruction is "establishing a smart linkage between the first electronic device, the first target electronic device and the second target electronic device", after parsing the interaction instruction, the device identification contained in the interaction instruction can be obtained as the device identification of the first electronic device, the device identification of the first target electronic device and the device identification of the second target electronic device.

[0122] Step S530: Based on the device identification, determine at least one second electronic device that performs the interactive operation instructed by the interactive instruction.

[0123] In some embodiments, after the first electronic device obtains the device identification, it can obtain at least one second electronic device that performs the interactive operation indicated by the interactive instruction based on the device identification. For example, the first electronic device and the first target electronic device that perform the interactive operation indicated by the interactive instruction are obtained based on the device identification as described above. For another example, the first electronic device, the first target electronic device, and the second target electronic device that perform the interactive operation indicated by the interactive instruction are obtained based on the device identification as described above.

[0124] Step S540: Establishing a connection with the at least one second electronic device.

[0125] In some embodiments, after determining at least one second electronic device that performs the interactive operation, a connection with the at least one second electronic device may be established to implement data interaction between the first electronic device and the at least one second electronic device. As a method, a connection with the at least one second electronic device may be established by means of near field communication.

[0126] Step S550: According to the interaction instruction, obtain the control operation instructions corresponding to each of the first electronic device and the at least one second electronic device, and the operation sequence corresponding to multiple control operation instructions, wherein the control operation instructions are used to trigger the operable controls in the display interface of the electronic device.

[0127] Step S560: Control the first electronic device and the at least one second electronic device to execute their respective corresponding control operation instructions according to the operation sequence.

[0128] For the detailed description of step S550 to step S560, please refer to step S120 to step S130, which will not be repeated here.

[0129] Compared with the cross-device interaction method provided by an embodiment of the present application, Figure 3 The cross-device interaction method shown in the present embodiment also parses the interaction instruction to obtain the device identification contained in the interaction instruction, and based on the device identification, obtains at least one second electronic device that performs the interaction operation indicated by the interaction instruction, and establishes a connection with the at least one second electronic device, thereby determining the device indicating parameter interaction and establishing the connection, thereby realizing cross-device interaction.

[0130] See also Fig. 9 , Fig. 9 The module block diagram of the cross-device interaction device provided by an embodiment of the present application is shown. The cross-device interaction device 400 is applied to the above electronic device. Fig. 9 The block diagram shown in FIG. 4 is used to illustrate that the cross-device interaction apparatus 400 includes: an interaction instruction receiving module 410, a control operation instruction acquiring module 420, and a control operation instruction control module 430, wherein:

[0131] The interaction instruction receiving module 410 is used to receive an interaction instruction, wherein the interaction instruction is used to instruct the first electronic device to perform an interaction operation with at least one second electronic device.

[0132] The control operation instruction acquisition module 420 is used to obtain the control operation instructions corresponding to the first electronic device and the at least one second electronic device respectively, and the operation sequence corresponding to multiple control operation instructions according to the interaction instruction, wherein the control operation instructions are used to trigger the operable controls in the display interface of the electronic device.

[0133] Furthermore, the control operation instruction acquisition module 420 includes: an interaction instruction sending submodule and a control operation instruction acquisition submodule, wherein:

[0134] An interaction instruction sending submodule is used to send the interaction instruction to the server to instruct the server to obtain the control operation instructions corresponding to the first electronic device and the at least one second electronic device respectively, and the operation sequence corresponding to the multiple control operation instructions based on the interaction instruction.

[0135] The control operation instruction acquisition submodule is used to receive the control operation instructions corresponding to the first electronic device and the at least one second electronic device respectively fed back by the server, and the operation sequence corresponding to the multiple control operation instructions.

[0136] Furthermore, the control operation instruction acquisition module 420 also includes: an execution result acquisition submodule and an execution result sending submodule, wherein:

[0137] The execution result acquisition submodule is used to acquire the execution results of the multiple control operation instructions when the execution of the multiple control operation instructions is completed.

[0138] The execution result sending submodule is used to send the execution result to the server to instruct the server to maintain or modify the multiple control operation instructions and the operation sequence corresponding to the multiple control operation instructions according to the execution result.

[0139] The control operation instruction control module 430 is used to control the first electronic device and the at least one second electronic device to execute the corresponding control operation instructions according to the operation sequence.

[0140] Further, the first electronic device corresponds to a first control operation instruction, the operation sequence number corresponding to the first control operation instruction is N, and the control operation instruction control module 330 includes: a first control operation instruction control submodule and a first message sending submodule, wherein:

[0141] The first control operation instruction control submodule is used to control the first electronic device to execute the first control operation instruction.

[0142] The first message sending submodule is used to send a message of successful execution of the first control operation instruction to a first target electronic device among the at least one second electronic device when the first control operation instruction is successfully executed, so as to instruct the first target electronic device to execute the second control operation instruction, wherein the first target electronic device corresponds to the second control operation instruction, and the operation sequence number corresponding to the second control operation instruction is N+1, wherein N is a positive integer greater than 0.

[0143] Furthermore, the control operation instruction control module 430 further includes: a target operable control acquisition submodule, wherein:

[0144] The target operable control acquisition submodule is used to acquire the operable control indicated by the first control operation instruction from the at least one operable control as a target operable control.

[0145] Furthermore, the target operable control acquisition submodule includes: a first control identification acquisition unit, a second control identification acquisition unit and a target operable control acquisition unit, wherein:

[0146] The first control identifier obtaining unit is used to obtain the control identifier of the operable control indicated by the first control operation instruction.

[0147] The second control identifier acquisition unit is used to identify the at least one operable control and acquire a control identifier corresponding to each of the at least one operable control.

[0148] A target operable control acquisition unit is used to determine a target operable control from the at least one operable control based on a control identifier corresponding to each of the at least one operable control, wherein the control identifier corresponding to the target operable control matches the control identifier of the operable control indicated by the first control operation instruction.

[0149] Furthermore, the control operation instruction control module 430 also includes:

[0150] The first interface updating submodule is used for updating the first electronic device from displaying the first interface to displaying the second interface when the first control operation instruction is executed successfully.

[0151] Furthermore, the control operation instruction control module 430 includes: an execution information acquisition submodule and a second message sending submodule, wherein:

[0152] The execution information acquisition submodule is used to acquire the execution information of the multiple control operation instructions when the second control operation instruction is executed successfully.

[0153] The second message sending submodule is used to control the first target electronic device to send a message indicating that the second control operation instruction has been successfully executed to a second target electronic device among the at least one second electronic device when the execution information indicates that the multiple control operation instructions have not been completely executed, so as to instruct the second target electronic device to execute a third control operation instruction, wherein the second target electronic device corresponds to the third control operation instruction, and the operation order corresponding to the third control operation instruction is N+2.

[0154] Further, the interaction instruction is received when the first target electronic device displays the third interface, and the control operation instruction control module 430 further includes:

[0155] The second interface updating submodule is used to control the first target electronic device to update from displaying the third interface to displaying the fourth interface when the second control operation instruction is executed successfully.

[0156] Furthermore, the cross-device interaction apparatus 400 further includes: a device identification obtaining module, a device acquisition module and a device connection module, wherein:

[0157] The device identification obtaining module is used to parse the interaction instruction and obtain the device identification contained in the interaction instruction.

[0158] The device acquisition module is used to determine at least one second electronic device that performs the interactive operation instructed by the interactive instruction based on the device identification.

[0159] The device connection module is used to establish a connection with the at least one second electronic device.

[0160] Furthermore, the device connection module includes: a device connection submodule, wherein:

[0161] The device connection submodule is used to establish a connection with the at least one second electronic device by means of near field communication.

[0162] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0163] In several embodiments provided in the present application, the coupling between modules may be electrical, mechanical or other forms of coupling.

[0164] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0165] See also Fig.10 , which shows a structural block diagram of an electronic device 100 provided in an embodiment of the present application. The electronic device 100 may be an electronic device capable of running applications, such as a smart phone, a tablet computer, an e-book, etc. The electronic device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by one or more processors 110, and the one or more programs are configured to execute the method described in the aforementioned method embodiment.

[0166] Among them, the processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes various functions and processes data of the electronic device 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 120, and calling data stored in the memory 120. Optionally, the processor 110 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 110 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 110, but may be implemented separately through a communication chip.

[0167] The memory 120 may include a random access memory (RAM) or a read-only memory (ROM). The memory 120 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The data storage area may also store data (such as a phone book, audio and video data, chat record data) created by the electronic device 100 during use.

[0168] See also Fig.11 , which shows a structural block diagram of a computer-readable storage medium provided in an embodiment of the present application. The computer-readable medium 500 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.

[0169] The computer-readable storage medium 500 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer-readable storage medium 500 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 500 has storage space for program code 510 that performs any method steps in the above method. These program codes can be read from or written to one or more computer program products. The program code 510 can be compressed, for example, in an appropriate form.

[0170] In summary, the cross-device interaction method, apparatus, electronic device and storage medium provided in the embodiments of the present application receive interaction instructions, wherein the interaction instructions are used to instruct a first electronic device to perform an interaction operation with at least one second electronic device, and according to the interaction instructions, control operation instructions corresponding to each of the first electronic device and the at least one second electronic device, as well as an operation sequence corresponding to multiple control operation instructions are obtained, wherein the control operation instructions are used to trigger the operable controls in the display interface of the electronic device, and control the first electronic device and the at least one second electronic device to execute their respective corresponding control operation instructions in the operation sequence, so that when performing cross-device interaction, the interaction instructions are converted into a series of control operation instructions for the interface, so that the devices participating in the interaction execute the corresponding control operation instructions in the operation sequence, which has a wide range of applicable functions and strong versatility, thereby improving the cross-device interaction effect.

[0171] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A cross-device interaction method, characterized in that: Applied to a first electronic device, the first electronic device is connected to a server, and the method includes: receiving an interaction instruction, wherein the interaction instruction is used to instruct the first electronic device to perform an interaction operation with at least one second electronic device; The interaction instruction is sent to the server to instruct the server to determine, based on the interaction instruction, an interface operation sequence that needs to be executed by the first electronic device and the at least one second electronic device corresponding to the interaction instruction, wherein the interface operation sequence includes a control operation instruction corresponding to each of the first electronic device and the at least one second electronic device, and an operation sequence corresponding to a plurality of control operation instructions, wherein the control operation instruction is used to trigger an operable control in a display interface of the electronic device, and the operation sequence corresponding to the plurality of control operation instructions indicates that a subsequent control operation instruction of the operation sequence is triggered after a previous control operation instruction of the operation sequence is executed, until the control operation instructions corresponding to each of the first electronic device and the at least one second electronic device are executed; receiving control operation instructions respectively corresponding to the first electronic device and the at least one second electronic device fed back by the server, and the operation sequence corresponding to the multiple control operation instructions; Controlling the first electronic device and the at least one second electronic device to execute the corresponding control operation instructions according to the operation sequence; When the execution of the multiple control operation instructions is completed, obtaining the execution results of the multiple control operation instructions; The execution result is sent to the server to instruct the server to maintain the multiple control operation instructions and the operation sequence corresponding to the multiple control operation instructions when the execution result indicates that the multiple control operation instructions are all executed successfully, or to modify the multiple control operation instructions and the operation sequence corresponding to the multiple control operation instructions when the execution result indicates that the multiple control operation instructions are not all executed successfully.

2. The method according to claim 1, characterized in that The first electronic device corresponds to a first control operation instruction, the operation sequence number corresponding to the first control operation instruction is N, and the controlling the first electronic device and the at least one second electronic device to execute the corresponding control operation instructions according to the operation sequence includes: Controlling the first electronic device to execute the first control operation instruction; When the first control operation instruction is executed successfully, a message of successful execution of the first control operation instruction is sent to a first target electronic device among the at least one second electronic device to instruct the first target electronic device to execute the second control operation instruction, wherein the first target electronic device corresponds to the second control operation instruction, and the operation sequence number corresponding to the second control operation instruction is N+1, wherein N is a positive integer greater than 0.

3. The method according to claim 2, characterized in that The interaction instruction is received when the first electronic device displays a first interface, the first interface includes at least one operable control, and the method further includes: From the at least one operable control, the operable control indicated by the first control operation instruction is obtained as a target operable control.

4. The method according to claim 3, characterized in that The acquiring, from the at least one operable control, the operable control indicated by the first control operation instruction as a target operable control, includes: Obtaining a control identifier of the operable control indicated by the first control operation instruction; Identify the at least one operable control and obtain a control identifier corresponding to each of the at least one operable control; Based on the control identifier corresponding to each of the at least one operable control, the target operable control is determined from the at least one operable control, wherein the control identifier corresponding to the target operable control matches the control identifier of the operable control indicated by the first control operation instruction.

5. The method according to claim 3, characterized in that: The method further comprises: When the first control operation instruction is executed successfully, the first electronic device updates from displaying the first interface to displaying the second interface.

6. The method according to claim 2, characterized in that After sending a message indicating that the first control operation instruction is successfully executed to a first target electronic device in the at least one second electronic device to instruct the first target electronic device to execute the second control operation instruction, the method further includes: When the second control operation instruction is executed successfully, acquiring execution information of the multiple control operation instructions; When the execution information represents that the multiple control operation instructions have not been completely executed, the first target electronic device is controlled to send a message indicating that the second control operation instruction has been successfully executed to a second target electronic device among the at least one second electronic device, so as to instruct the second target electronic device to execute a third control operation instruction, wherein the second target electronic device corresponds to the third control operation instruction, and the operation order corresponding to the third control operation instruction is N+2.

7. The method according to claim 6, characterized in that The interaction instruction is received when the first target electronic device displays a third interface, and the method further includes: When the second control operation instruction is executed successfully, the first target electronic device is controlled to update from displaying the third interface to displaying the fourth interface.

8. The method according to any one of claims 1 to 7, characterized in that: Before sending the interaction instruction to the server, the method includes: Parsing the interaction instruction to obtain a device identifier contained in the interaction instruction; Based on the device identification, determining at least one second electronic device that performs the interactive operation indicated by the interactive instruction; A connection is established with the at least one second electronic device.

9. The method according to claim 8, characterized in that The establishing a connection with the at least one second electronic device comprises: A connection is established with the at least one second electronic device by means of near field communication.

10. A cross-device interactive device, characterized in that: Applied to a first electronic device, the first electronic device is connected to a server, and the device includes: An interaction instruction receiving module, used to receive an interaction instruction, wherein the interaction instruction is used to instruct the first electronic device to perform an interaction operation with at least one second electronic device; an interaction instruction sending submodule, configured to send the interaction instruction to the server, so as to instruct the server to determine, based on the interaction instruction, an interface operation sequence to be executed by the first electronic device and the at least one second electronic device corresponding to the interaction instruction, wherein the interface operation sequence includes a control operation instruction corresponding to each of the first electronic device and the at least one second electronic device, and an operation sequence corresponding to a plurality of control operation instructions, wherein the control operation instruction is used to trigger an operable control in a display interface of the electronic device, and the operation sequence corresponding to the plurality of control operation instructions indicates that a subsequent control operation instruction of the operation sequence is triggered after a previous control operation instruction of the operation sequence is executed, until the control operation instructions corresponding to each of the first electronic device and the at least one second electronic device are executed; a control operation instruction acquisition submodule, configured to receive control operation instructions respectively corresponding to the first electronic device and the at least one second electronic device fed back by the server, and the operation sequence corresponding to the plurality of control operation instructions; A control operation instruction control module, used to control the first electronic device and the at least one second electronic device to execute the corresponding control operation instructions according to the operation sequence; An execution result acquisition submodule, used for acquiring the execution results of the multiple control operation instructions when the execution of the multiple control operation instructions is completed; An execution result sending submodule is used to send the execution result to the server to instruct the server to maintain the multiple control operation instructions and the operation sequence corresponding to the multiple control operation instructions when the execution result indicates that the multiple control operation instructions are all executed successfully, or to modify the multiple control operation instructions and the operation sequence corresponding to the multiple control operation instructions when the execution result indicates that the multiple control operation instructions are not all executed successfully.

11. An electronic device, characterized in that: The method comprises a memory and a processor, wherein the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the processor executes the method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores program codes, which can be called by a processor to execute the method according to any one of claims 1 to 9.

Images