Equipment interaction method and equipment

Abstract

The invention discloses an equipment interaction method and equipment, relates to the technical field of terminals, and aims to realize interaction and linkage of a theme dynamic effect between first equipment and second equipment, improve theme interaction among multiple electronic equipment and multiple users, improve interestingness and meet the interaction requirement of a theme pack among multiple equipment of a user. The method is applied to the interactive system, the interactive system comprises a first device and a second device, and the first device and the second device establish near-field connection. The first device is provided with a first theme pack, the second device is provided with a second theme pack, and the first theme pack and the second theme pack have an association relationship. In the method, a first device displays a first interface, and a second device displays a second interface. The first interface and the second interface belong to interfaces provided by the theme pack. And when it is determined that the triggering condition is met, the first device and the second device play corresponding animations based on the first theme pack and the second theme pack respectively.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of terminal, and particularly relates to a device interaction method and device. BACKGROUND

[0002] A theme package is a collection of integrated related resources around a specific theme, which can enable a user to quickly and conveniently change the visual and interactive interface style of a device. A theme package usually contains theme elements such as visual elements (such as wallpaper, icons, fonts, etc.), animation effects, interactive logic, sound materials and various theme elements, which provide users with fun and experience.

[0003] A user can operate a theme on a device, such as triggering a theme animation effect, to achieve an interactive effect. However, the current theme interaction mode and interaction scene are single, and cannot meet the user's interaction needs. SUMMARY

[0004] Embodiments of the present application provide a device interaction method and device, which can achieve the interactivity and linkage of theme animation effects between a first device and a second device, improve the theme interactivity between multiple electronic devices and multiple users, improve the interest, and meet the theme package interaction needs between multiple devices of a user.

[0005] To achieve the above object, embodiments of the present application adopt the following technical solutions:

[0006] In a first aspect, a device interaction method is provided, which is applied to an interaction system including a first device and a second device, and the first device and the second device establish a near field connection. The first device is installed with a first theme package, the second device is installed with a second theme package, and the first theme package and the second theme package have an associated relationship. The method includes: the first device displays a first interface, and the second device displays a second interface. The first interface and the second interface belong to interfaces provided by the theme package. In a case where it is determined that a triggering condition is met, the first device and the second device respectively play corresponding animations based on the first theme package and the second theme package.

[0007] In the device interaction method, the first device and the second device install the first theme package and the second theme package having the association relationship, and in the case that the trigger condition is met, the corresponding animation can be played based on the installed theme package respectively, the theme package interaction between the multiple devices is realized, the theme package interaction experience is improved, and the interest of the user operation is improved. Moreover, the theme package interaction between the multiple devices is realized, the interaction scene between the devices is expanded, the interaction demand of the user between different theme packages is met, and the possibility and willingness of the user to purchase the theme package are increased. Moreover, in the case that the device installs the theme package and the device is in the interface provided by the theme package, the user can trigger the theme package interaction capability between the devices, the theme package interaction can be flexibly performed in the scene meeting the actual demand of the user, the efficiency of the theme package interaction between the devices is improved, and the user experience is further improved.

[0008] In a possible implementation, the interface supported by the theme package includes a lock screen interface, a desktop, or an interface including theme elements. The theme elements include theme cards, theme icons, or theme widgets. In this implementation, the user can realize the theme package interaction of multiple devices on the interfaces supported by multiple theme packages, the individualized demand of different users for different interfaces is met, the application range of the theme package interaction is expanded, and the user experience is improved.

[0009] In a possible implementation, the first interface and the second interface are the same type of interface. In this implementation, for example, the first interface and the second interface are both lock screen interfaces. Alternatively, the first interface and the second interface are both desktops. Alternatively, the first interface and the second interface are both interfaces including theme elements.

[0010] In a possible implementation, the first interface and the second interface are different types of interfaces. In this implementation, for example, the first interface is a lock screen interface, and the second interface is a desktop. For another example, the first interface is a desktop, and the second interface is a lock screen interface. For another example, the first interface is a desktop, and the second interface is an interface including theme elements.

[0011] In a possible implementation, the device determines that the trigger condition is met, including one or more of the following: the communication signal strength between the first device and the second device is greater than or equal to a first preset threshold; or the transmission delay between the first device and the second device is less than or equal to a second preset threshold; or the distance between the first device and the second device is less than or equal to a third preset threshold. In this implementation, through the communication signal such as the signal strength, the transmission delay, or the device distance between the first device and the second device, the two devices can automatically perceive the positions of each other and establish a near field communication connection, and the smoothness of the device interaction is improved.

[0012] In a possible implementation, the near field communication connection includes a Wi-Fi connection or a Bluetooth connection.

[0013] In a possible implementation, during the process that the first device and the second device respectively play the corresponding animations based on the first theme package and the second theme package, the first device and the second device respectively play the corresponding frames in the first animation and the second animation at the same time based on the first theme package and the second theme package. The corresponding elements on the corresponding frames have the same or corresponding actions or states. In this implementation, the first device and the second device synchronously play the corresponding frames in the respective animations, which improves the interactivity of the theme packages between the devices and the user experience. Moreover, the corresponding elements on the corresponding frames have the same or corresponding actions or states, which guarantees the consistency and collaboration of the animations when played across devices, further improves the user experience, and thus increases the possibility and willingness of the user to purchase the theme packages.

[0014] In a possible implementation, when the trigger condition is met, the method further includes: the first device and the second device negotiate a synchronous playing time. The synchronous playing time is obtained based on the transmission delay between the first device and the second device. During the process that the first device and the second device respectively play the corresponding frames in the first animation and the second animation at the same time, when the synchronous playing time arrives, the first device starts to synchronously play the corresponding frames in the first animation, and the second device starts to synchronously play the corresponding frames in the second animation. In this implementation, by negotiating the synchronous playing time, the first device and the second device can play the corresponding animations at a unified time, which guarantees the synchronism and consistency of the multi-device animations, improves the interactivity of the theme packages between the devices and the user experience, and thus increases the possibility and willingness of the user to purchase the theme packages.

[0015] In a possible implementation, during the process that the first device and the second device negotiate the synchronous playing time, the first device and the second device negotiate the synchronous playing time and the frame synchronous time of the corresponding frames. In this implementation, by negotiating the synchronous playing time, the two devices can start to play the animations at the same time point. Meanwhile, by negotiating the frame synchronous time of the respective frames, the two devices can accurately align the display time of each frame during the playing process, which ensures that the corresponding frames in the animations are played at the same time on the two devices, and thus realizes consistent animation playing effect, and guarantees the interactivity and continuity of the multi-device animation playing.

[0016] In a possible implementation, in the process of negotiating the synchronous playing time and the frame synchronous time of the corresponding frame by the first device and the second device, the first device sends first broadcast information. The first broadcast information includes identification information of the first theme package, a first timestamp of the first device, and the frame playing time of the corresponding frame. The second device obtains a second timestamp of the second device to obtain a transmission delay ΔT when the first broadcast information is received. The ΔT is calculated based on the second timestamp and the first timestamp. The second device obtains a third timestamp of the second device when it is confirmed that the installed second theme package has a correlation with the first theme package in the first broadcast information. The second device sends first synchronization information to the first device. The first synchronization information includes identification information of the second theme package, the synchronous playing time, and the frame synchronous time of the corresponding frame. The synchronous playing time is the sum of the third timestamp and an offset value Δt, and the Δt is greater than or equal to 2 times the ΔT. The frame synchronous time is the sum of the corresponding frame playing time and the Δt. In this implementation, the synchronous playing time and the frame synchronous time of the corresponding frame are accurately obtained according to the process of short-range communication connection of the first device and the second device, which can effectively avoid the phenomenon of different playing of devices caused by time delay between devices, ensure that the first device and the second device can synchronously play the corresponding animation of the same frame, improve the accuracy of multi-device theme package interaction, improve the user experience, and thus increase the possibility and willingness of users to purchase theme packages.

[0017] In a possible implementation, when the synchronous playing time arrives, the first device starts to synchronously play the corresponding frame in the first animation, and the second device starts to synchronously play the corresponding frame in the second animation, and after the first device receives the first synchronization information, the first device sends first synchronization confirmation information to the second device when it is confirmed that the installed first theme package has a correlation with the second theme package in the first synchronization information. The first device starts to synchronously play the corresponding frame in the first animation in the first theme package when the synchronous playing time arrives. The second device starts to synchronously play the corresponding frame in the second animation in the second theme package when the synchronous playing time arrives after receiving the first synchronization confirmation information. In this implementation, the first device confirms the correlation between the first theme package and the second theme package after receiving the first synchronization information, and then sends the synchronization confirmation information to the second device, which guarantees the accuracy and reliability of the animation synchronization between devices. Animation synchronization is only performed when there is a correlation between theme packages, which avoids chaotic animation playing caused by mismatched theme packages and improves the user experience. In addition, the first device and the second device start to play the corresponding frame of the corresponding animation in their respective theme packages when the synchronous playing time arrives, which realizes the synchronization of animation playing between devices and thus increases the possibility and willingness of users to purchase theme packages.

[0018] In a possible implementation, in the process that the first device and the second device negotiate the synchronization playing time, the first device and the second device determine the master device and the slave device, the master device determines the synchronization playing time, and the master device sends the synchronization playing time to the slave device. In this implementation, the master device determines the synchronization playing time and conveys the synchronization playing time to the slave device, which improves the efficiency and reliability of device interaction.

[0019] In a possible implementation, in the process that the first device and the second device determine the master device and the slave device, the first device sends first broadcast information and the second device sends second broadcast information, and the device that first receives the broadcast information from the opposite device is the master device. The first broadcast information includes the identification information of the first theme package, the first timestamp of the first device, and the frame playing time of the corresponding frame. The second broadcast information includes the identification information of the second theme package, the timestamp of the second device, and the frame playing time of each frame of the corresponding frame. Alternatively, if the second device receives the first broadcast information sent by the first device, the second device no longer sends the second broadcast information, and the second device is the master device. Alternatively, if the first device receives the second broadcast information sent by the second device, the first device no longer sends the first broadcast information, and the first device is the master device. In this implementation, the master device and the slave device are determined, the synchronization playing time is determined by the master device, the first device and the second device can quickly and efficiently realize theme package animation synchronization, and the device interaction efficiency is improved. Moreover, the communication overhead and the computing resource consumption between devices are reduced, and the stability of device interaction is improved.

[0020] In a possible implementation, in the process that the first device starts to synchronously play the corresponding frame in the first animation in the first theme package when the synchronization playing time arrives, in the case that the first device has started to play the first animation in the first theme package, the first device starts to play the corresponding frame in the first animation again when the synchronization playing time arrives. Alternatively, in the case that the first device is playing other animations or displaying an interface provided by the theme package, the first device switches to synchronously play the corresponding frame in the first animation in the first theme package when the synchronization playing time arrives. In this implementation, the multiple devices can play at a unified time when synchronously playing animations, which guarantees the synchronization and consistency of multiple device animations and improves the interactivity of multiple devices and the interest of user operation. Moreover, the multiple devices can be switched from the current state to the synchronization playing state in a timely manner in real time in response to actual needs of a user, theme package animation synchronization of the multiple devices is realized, and the synchronization and consistency of multiple device animations are guaranteed. Moreover, the synchronization playing time is determined based on the transmission delay, which can effectively avoid the difference in playing time between devices caused by the transmission delay and realize synchronous playing of animations.

[0021] In a possible implementation, the method further includes: in a case where the playing time length of the first animation and the second animation is greater than or equal to the preset time length, the first device and the second device negotiate the synchronous playing time again. In this implementation, during the playing of the theme animation, due to factors such as device performance difference and network fluctuation, a slight deviation in the playing progress between devices may occur. In a case where the playing time length of the first animation and the second animation is equal to the preset time length, the first device and the second device negotiate the synchronous playing time again, thereby ensuring the synchronization of the theme animation playing between devices and improving the stability of the interaction between devices.

[0022] In a possible implementation, the interactive system further includes a third device, and the third device is installed with a third theme package, the third theme package having an association relationship with the first theme package. During the playing of the corresponding animations by the first device and the second device based on the first theme package and the second theme package respectively, the method further includes: in a case where it is determined that a trigger condition is met, based on the first theme package, the second theme package and the third theme package, the first device, the second device and the third device play corresponding frames in the first animation, the second animation and the third animation at the same time. In this implementation, during the playing of the corresponding animations by the first device and the second device, other devices (such as the third device) are allowed to join in the playing of the corresponding animations, thereby enhancing the flexibility and interest of the theme package interaction.

[0023] In a possible implementation, during the playing of the corresponding animations by the first device and the second device based on the first theme package and the second theme package respectively, the first device plays a first execution animation based on the first theme package, and the second device plays a first response animation based on the second theme package. The first response animation cooperatively interacts with the first execution animation. In this implementation, the first response animation cooperatively interacts with the first execution animation, thereby realizing the dynamic interaction of the theme package between the first device and the second device. The second device can play a corresponding animation according to the animation of the first device, thereby improving the application scenario of the multi-device interaction, enhancing the interest of the multi-device theme package interaction, meeting the interaction demand of the user, and further increasing the possibility and willingness of the user to purchase the theme package.

[0024] In a possible implementation, the trigger condition is met further includes: the first device detects a first trigger operation, or a preset animation on the first device is played to completion.

[0025] In a possible implementation, the second device receives the first dynamic effect interaction information from the first device during the process that the second device plays the first response animation based on the second theme package. In this implementation, the second device plays the first response animation based on the second theme package in response to the first dynamic effect interaction information. The second device can play an animation that cooperatively interacts with the first execution animation based on the first dynamic effect interaction information sent by the first device, thereby realizing the interactivity of theme packages between multiple devices.

[0026] In a possible implementation, the first dynamic effect interaction information includes identification information of the first response animation. The second device determines the first response animation from the second theme package according to the identification information of the first response animation during the process that the second device plays the first response animation based on the second theme package in response to the first dynamic effect interaction information. In this implementation, the second device has a response animation that cooperatively interacts with the execution animation of the first theme package, and the second device can play the response animation based on the theme package installed by itself after receiving the first dynamic effect interaction information, thereby improving the reliability of device interaction.

[0027] In a possible implementation, the first dynamic effect interaction information includes identification information of the first execution animation. The second device determines the first response animation that cooperatively interacts with the first execution animation from the second theme package according to the identification information of the first execution animation during the process that the second device plays the first response animation based on the second theme package in response to the first dynamic effect interaction information. In this implementation, the second device can automatically determine the response animation that cooperatively interacts with the first execution animation from the second theme package and play the response animation based on the identification information of the received first execution animation, thereby improving the flexibility of device interaction.

[0028] In a possible implementation, the first dynamic effect interaction information includes a dynamic effect segment of the first response animation. The second device composes the dynamic effect segment into the second theme package and plays the dynamic effect segment based on the second theme package during the process that the second device plays the first response animation based on the second theme package in response to the first dynamic effect interaction information. In this implementation, the first device sends a dynamic effect script segment or a dynamic effect script parameter to the second device. Whether the second device originally installs a related theme package or not, the second device can perform theme package interaction between devices after receiving the theme package sent by the first device, thereby realizing that the first device drives the second device to play a corresponding animation, and improving the flexibility and scalability of device interaction. When there is a new animation update, the first device only needs to install an updated theme package and send it to the second device, so that theme package interaction between multiple devices can be quickly realized, thereby improving the efficiency of device interaction.

[0029] In a possible implementation, if the first response animation is not included in the second theme package, the second device downloads the first response animation from the network and plays. In this implementation, in the case that the second device does not include the response animation, the response animation can be downloaded and played from the network, which improves the flexibility of device interaction.

[0030] In a possible implementation, the first animation interaction information is used to indicate a trigger event. The second device responds to the first animation interaction information, and the second device determines the first response animation corresponding to the trigger event from the second theme package and plays during the process that the second device plays the first response animation based on the second theme package. In this implementation, the second device can respond to the trigger event associated with the trigger operation of the first device, and play the first response animation that cooperatively interacts with the first execution animation, which improves the flexibility of device interaction.

[0031] In a possible implementation, the method further includes: in the case that the first device establishes a near field connection with the second device, the first device sends connection credential information to the server, and establishes a first long link with the server. The connection credential information includes information of the second device that has the near field connection with the first device. The server establishes a second long link with the second device based on the connection credential information. Then, the first device and the second device perform information interaction based on the first long link and the second long link. In this implementation, the first long link between the first device and the server and the second long link between the second device and the server are used to realize long-distance information interaction, which does not depend on account login, and thus expands the application scenarios of device interaction.

[0032] In a possible implementation, the first device is playing a corresponding frame in the first animation based on the first theme package, and the second device is playing a corresponding frame in the second animation based on the second theme package. In the process that the first device and the second device perform information interaction based on the first long link and the second long link, in the case that it is determined that a preset condition is met, the first device and the second device re-negotiate a synchronous playing time through the first long link and the second long link, and the synchronous playing time is obtained based on transmission delays of the first long link and the second long link. The method further includes: when the first device and the second device respectively arrive at the synchronous playing time after the re-negotiation, the first device starts to synchronously play the corresponding frame in the first animation, and the second device starts to synchronously play the corresponding frame in the second animation. In this implementation, after the near field communication connection is switched to the remote connection, the communication delay between the devices changes, if the first device and the second device are synchronously playing the corresponding animations, when the preset condition is met, the first device and the second device can re-negotiate the synchronous playing time through the first long link and the second long link, so as to ensure the theme package synchronization of multiple devices, and improve the user experience.

[0033] In a possible implementation, in the process that the first device and the second device interact information based on the first long link and the second long link, when it is determined that the preset condition is met, if the first device receives the first synchronization operation, the first device and the second device negotiate a synchronization playing time through the first long link and the second long link in response to the first synchronization operation, and the synchronization playing time is obtained based on transmission delays of the first long link and the second long link. The method further includes: when the synchronization playing time arrives, the first device starts to synchronously play a corresponding frame in the first animation, and the second device starts to synchronously play a corresponding frame in the second animation. In the implementation, when the preset condition is met, the synchronization playing time can be negotiated through the long link, so that the accurate synchronization of the animation playing between the devices under the remote connection is realized, and the synchronization of the multi-device collaborative animation and the user experience are improved.

[0034] In a possible implementation, the method further includes: when it is determined that the preset condition is met, if the first device detects the first trigger operation or the preset animation playing on the first device is completed, the first device plays a second execution animation based on a second theme package. In the process that the first device and the second device interact information based on the first long link and the second long link, the first device sends second dynamic interaction information to the server through the first long link. The second device receives the second dynamic interaction information forwarded by the server through the second long link. The second device plays a second response animation based on the second theme package according to the second dynamic interaction information. The second response animation cooperatively interacts with the second execution animation. In the implementation, when the preset condition is met, the first device plays the execution animation based on the theme package, interacts with the server through the long link, and makes the second device synchronously play the response animation cooperatively interacting, so that the animation interaction between the devices is realized, and the user experience is improved.

[0035] In a possible implementation, the device determining that the preset condition is met includes one or more of the following: a communication signal strength between the first device and the second device is less than or equal to a fourth preset threshold; or, a transmission delay between the first device and the second device is greater than or equal to a fifth preset threshold; or, a distance between the first device and the second device is greater than or equal to a sixth preset threshold.

[0036] In a possible implementation, the connection credential information is generated by the first device, and the connection credential information includes a random serial number of the first device, a random serial number of the second device, and a group identifier of a group to which the first device and the second device belong. Before the second device establishes the second long link with the server, the method further includes: receiving, by the second device, the random serial number of the second device and the group identifier from the first device, and sending, by the second device, the random serial number of the second device and the group identifier to the server. The server verifies that the random serial number of the second device and the group identifier from the second device match the connection credential information. In this implementation, in a case where the first device establishes the near-field connection with the second device, the server can verify that the random serial number of the second device and the group identifier from the second device match the connection credential information, based on receiving the random serial number of the first device, the random serial number of the second device, and the group identifier sent by the first device. In a case where the server verifies the match, the second device establishes the second long link with the first device, so that the first device and the second device implement the information interaction at a long distance based on the first long link and the second long link.

[0037] In a possible implementation, in a process in which the second device establishes the second long link with the server, the second device establishes the second long link with the server in a case where the first device establishes the near-field connection with the second device. In a process in which the first device and the second device perform the information interaction based on the first long link and the second long link, the first device and the second device perform the information interaction based on the first long link and the second long link in a case where a preset condition is met. In this implementation, because the first device establishes the near-field connection with the second device, the first device can send the connection credential information to the server, so that the second device can establish the second long link with the server based on the connection credential information, to implement the remote connection of the first device and the second device. Without relying on account login, the application scenario of device interaction is expanded. Moreover, the first device and the second device perform the information interaction based on the first long link and the second long link only in a case where the preset condition is met, thereby saving the communication resources at a long distance.

[0038] In a possible implementation, in a process in which the second device establishes the second long link with the server, the second device establishes the second long link with the server in a case where a preset condition is met. In this implementation, the second device establishes the second long link with the server only in a case where the preset condition is met, such as a distance between the first device and the second device being greater than or equal to a boundary value of the near-field communication connection, thereby saving the communication resources at a long distance.

[0039] In a possible implementation, before the first device establishes the first long connection with the server, the method further includes: the second device sends the connection credential information to the server, and the server receives the connection credential information sent by the first device first. In this implementation, the server receives the connection credential information of the first device first, and establishes the first long connection with the first device. In the case that the second device sends the credential information again, the server can establish the second long connection with the second device based on the first long connection with the first device, ensure the orderly progress of the remote connection of the devices, and improve the device access efficiency and system stability.

[0040] In a possible implementation, the first theme package and the second theme package are the same theme package or theme packages of the same category.

[0041] In a second aspect, another device interaction method is provided, which is applied to a first device, and the first device is installed with a first theme package. The method includes: the first device displays a first interface, and the first interface belongs to an interface provided by the theme package. In a case where it is determined that a trigger condition is met, the first device starts to play a corresponding frame in a first animation based on the first theme package when a synchronous playing time point arrives. The synchronous playing time point is also used for the second device to start to play a corresponding frame in a second animation based on a second theme package. The second device is installed with the second theme package, and the first theme package and the second theme package have an association relationship.

[0042] In the device interaction method, the first device and the second device are installed with the first theme package and the second theme package having an association relationship, and in a case where the trigger condition is met, the first device and the second device can play corresponding animations based on the theme packages installed by the first device and the second device respectively when the synchronous playing time point arrives, the theme package interaction between multiple devices is realized, the theme package interaction experience is improved, and the interest of user operation is improved. Moreover, the theme package interaction between multiple devices is realized, the interaction scenarios between devices are expanded, the interaction demand of a user between different theme packages is met, and the possibility and willingness of the user to purchase theme packages are increased. Moreover, in a case where the device is installed with the theme package and the device is in an interface supported by the theme package, the user can trigger the theme package interaction capability between devices, theme package interaction can be flexibly performed in a scenario meeting the actual demand of the user, the efficiency of theme package interaction between devices is improved, and the user experience is further improved.

[0043] In a third aspect, another device interaction method is provided, which is applied to a second device, and the second device installs a second theme package. The method comprises: the second device displays a second interface, and the second interface belongs to an interface provided by the theme package. In a case where it is determined that a trigger condition is met, the second device starts to play a corresponding frame in a second animation based on the second theme package when a synchronous playing time point arrives. The synchronous playing time point is also used for the first device to start to play a corresponding frame in a first animation based on a first theme package. The first device installs the first theme package, and the first theme package has an association relationship with the second theme package.

[0044] In the device interaction method, the first device and the second device install the first theme package and the second theme package having the association relationship, and in a case where the trigger condition is met, the first device and the second device can respectively play the corresponding animation based on the theme package installed by the first device and the second device respectively from when the synchronous playing time point arrives, the theme package interaction between the multiple devices is realized, the theme package interaction experience is improved, and the interest of user operation is improved. Moreover, the theme package interaction between the multiple devices is realized, the interaction scene between the devices is expanded, the interaction demand of the user between different theme packages is met, and the possibility and willingness of the user to purchase the theme package are increased. Moreover, in a case where the device installs the theme package and the device is in an interface supported by the theme package, the user can trigger the theme package interaction capability between the devices, the theme package interaction can be flexibly performed in a scene meeting the actual demand of the user, the efficiency of the theme package interaction between the devices is improved, and the user experience is further improved.

[0045] In a fourth aspect, an electronic device is provided, which comprises a display screen, a memory, and one or more processors. The display screen, the memory, and the processors are coupled. The display screen is configured to display an interface. The memory stores computer program code. The computer program code comprises computer instructions. When the computer instructions are executed by the processors, the electronic device performs the device interaction method of the first device in any one of the first aspect. Alternatively, when the computer instructions are executed by the processors, the electronic device performs the device interaction method of the second device in any one of the first aspect. Alternatively, when the computer instructions are executed by the processors, the electronic device performs the device interaction method of the server in any one of the first aspect.

[0046] In a fifth aspect, a computer readable storage medium is provided, which comprises computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the device interaction method of the first device in any one of the first aspect. Alternatively, when the computer instructions are executed on the electronic device, the electronic device performs the device interaction method of the second device in any one of the first aspect. Alternatively, when the computer instructions are executed on the electronic device, the electronic device performs the device interaction method of the server in any one of the first aspect.

[0047] In a sixth aspect, a computer program product is provided, which, when running on a computer, causes the computer to perform the device interaction method of the first device in any one of the first aspect or any possible implementation of the first aspect; or, when running on a computer, causes the computer to perform the device interaction method of the second device in any one of the first aspect or any possible implementation of the first aspect; or, when running on a computer, causes the computer to perform the device interaction method of the server in any one of the first aspect or any possible implementation of the first aspect.

[0048] It can be understood that the beneficial effects achievable by the second aspect to the sixth aspect provided above can refer to the beneficial effects in the first aspect and any possible design manner thereof, which will not be described herein again. BRIEF DESCRIPTION OF DRAWINGS

[0049] Figure 1 A schematic diagram of a theme motion effect interaction provided by an embodiment of the present application;

[0050] Figure 2 A schematic diagram of a device interaction scene provided by an embodiment of the present application;

[0051] Figure 3 A schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present application;

[0052] Figure 4 A schematic diagram of a software architecture of an electronic device provided by an embodiment of the present application;

[0053] Figure 5 A schematic diagram of a device interaction method provided by an embodiment of the present application;

[0054] Figure 6 A schematic diagram of an interface supported by a theme package provided by an embodiment of the present application;

[0055] Figure 7 A schematic diagram of a device interaction method provided by an embodiment of the present application;

[0056] Figure 8 A schematic diagram of another device interaction method provided by an embodiment of the present application;

[0057] Figure 9 A schematic diagram of another device interaction method provided by an embodiment of the present application;

[0058] Figure 10 A schematic diagram of another device interaction method provided by an embodiment of the present application;

[0059] Figure 11 A schematic diagram of another device interaction method provided by an embodiment of the present application;

[0060] Figure 12 Another device interaction method provided by an embodiment of the present application is shown in the flowchart;

[0061] Figure 13 Another device interaction method provided by an embodiment of the present application is shown in the flowchart;

[0062] Figure 14 Another device interaction method provided by an embodiment of the present application is shown in the flowchart;

[0063] Figure 15 Another device interaction method provided by an embodiment of the present application is shown in the flowchart;

[0064] Figure 16 Another device interaction method provided by an embodiment of the present application is shown in the flowchart;

[0065] Figure 17 Another device interaction method provided by an embodiment of the present application is shown in the flowchart;

[0066] Figure 18 Another device interaction method provided by an embodiment of the present application is shown in the flowchart;

[0067] Figure 19 Another device interaction method provided by an embodiment of the present application is shown in the flowchart;

[0068] Figure 20 Another device interaction method provided by an embodiment of the present application is shown in the flowchart. DETAILED DESCRIPTION

[0069] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means "or", for example, A / B can mean A or B; "and / or" in this document only describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which means that there are three cases of A alone, A and B together, and B alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0070] Hereinafter, the terms "first" and "second" are used only for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first" and "second" can explicitly or implicitly include one or more features. In the description of the embodiments, unless otherwise specified, the meaning of "multiple" is two or more than two.

[0071] In the embodiments of this application, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts in a specific manner.

[0072] A theme pack is a collection of related resources integrated around a specific theme, used to uniformly modify the visual and interactive interface style of a device to meet the user's personalized needs. Theme packs typically include visual elements (such as wallpapers, icons, fonts, lock screens, etc.), animation effects (such as lock screen animations), interactive logic (such as providing corresponding animation feedback when clicking the screen), and sound effects (such as notification sounds, ringtones, etc.). By integrating these theme elements, theme packs allow users to quickly and easily change the overall appearance and operating experience of their devices, thereby satisfying their personalized needs. For example, users can install a theme pack to switch their device interface from the default style to anime or cartoon styles, achieving personalized visual and interactive effects.

[0073] The theme package includes a variety of pre-set animated themes. Users can interact with the interface by triggering these animations, such as tapping the screen to start playing the corresponding animation, thus enhancing the fun of the user experience.

[0074] Figure 1 This diagram illustrates a themed animated interaction. See also... Figure 1 In (a) of the diagram, device A's lock screen includes an animated pig element. Users can interact with this animated theme by tapping the screen, triggering corresponding animation effects. Upon receiving the user's tap, device A's lock screen displays the following: Figure 1 The animation shown in (b) enhances the fun of user interaction.

[0075] However, the interaction methods and scenarios of the aforementioned theme packs suffer from a lack of diversity. For example, different theme packs may include similar interactive animations, but the animations between each theme pack are usually independent of each other, lacking interactivity and synergy between theme packs, making it difficult to meet users' needs for interaction between different theme packs.

[0076] For example, theme pack 1 contains an animation of a pig spraying milk, and theme pack 2 contains an animation of a pig being sprayed with milk. However, when using the device, users cannot trigger both animations simultaneously on the interface to see the interactive effect between them, such as seeing a continuous animation of the pig spraying milk and the pig being sprayed with milk at the same time. This approach fails to provide users with richer theme pack interactive scenarios, reduces the theme pack interactive experience, and makes it difficult to meet users' diverse interactive needs.

[0077] To solve the above technical problems, the embodiment of the present application provides a device interaction method, which is applied to an interaction system. The interaction system includes a first device and a second device, and the first device and the second device establish a near field connection. Wherein, the first device installs a first theme package, the second device installs a second theme package, and the first theme package and the second theme package have an association relationship. In the method, the first device displays a first interface, and the second device displays a second interface. Wherein, the first interface and the second interface belong to the interfaces provided by the theme packages. In the case of meeting the triggering condition, the first device and the second device respectively play corresponding animations based on the first theme package and the second theme package.

[0078] Wherein, the first theme package and the second theme package can be the same theme package, or can be the same type of theme package. The same type of theme package is a set of themes with similar style, theme or type, and the corresponding frames in the animations of these theme packages have the same or corresponding actions or states.

[0079] For example, the first theme package includes an animation of a pig standing, and the second theme package includes an animation of a pig jumping. For another example, the first theme package includes an animation of a pig spraying milk, and the second theme package includes an animation of a monkey being sprayed with milk.

[0080] In the above device interaction scheme, the first device and the second device install the first theme package and the second theme package with an association relationship, and in the case of meeting the triggering condition, can respectively play corresponding animations based on the theme package installed by each device, realizing the theme package interaction between multiple devices, improving the theme package interaction experience, and improving the interest of user operation.

[0081] Compared with the prior art, multiple devices can only realize the data transmission of the same application, and cannot realize the interaction of theme packages. The device interaction method provided by the embodiment of the present application can realize the interaction of theme packages between multiple devices, expand the interaction scene between devices, meet the interaction demand of users between different theme packages, and further increase the possibility and willingness of users to purchase theme packages.

[0082] Moreover, in the case that the device installs the theme package and the device is in the interface provided by the theme package, the user can trigger the theme package interaction capability between devices, can flexibly interact with the theme package in the scene meeting the actual demand of the user, improves the efficiency of the theme package interaction between devices, and further improves the user experience.

[0083] The device interaction method provided by the embodiment of the present application can be applied to the device interaction scene shown in the figure. Figure 2 Figure 2 ​As shown, the device interaction scenario can include a first device and a second device. The first device can play a theme animation, such as a first animation, based on a first theme package, and the second device can play a theme animation, such as a second animation, based on a second theme package.

[0084] For example, the first device displays a first interface, and the second device displays a second interface. In a case where it is determined that the trigger condition is met, the first device and the second device can play corresponding animations based on the first theme package and the second theme package respectively, thereby realizing theme package interaction between multiple devices.

[0085] In some embodiments, Figure 2 In the device interaction scenario in the device interaction scenario, devices other than the first device and the second device, such as a third device, can also be included. For example, referring to Figure 2 With the device interaction method provided in the embodiments of the present application, in a case where the third device installs a third theme package, displays a third interface, and the trigger condition is met, the first device, the second device, and the third device play corresponding animations based on the first theme package, the second theme package, and the third theme package respectively. The third interface belongs to the interface provided by the theme package. In this way, theme package interaction between multiple devices is realized.

[0086] It can be understood that the device interaction method provided in the embodiments of the present application includes, but is not limited to, theme package interaction between two devices, and can also be theme package interaction between multiple devices. Those skilled in the art can determine the type and number of devices according to actual needs, and these designs do not exceed the protection scope of the embodiments of the present application.

[0087] The application scenario of the device interaction method provided in the embodiments of the present application is not limited to theme interaction between devices. In addition to theme package interaction, the method can also be applied to interaction scenarios in the entertainment field such as games. The application scenario is not limited by the present application. Meanwhile, the interfaces described in the embodiments of the present application can also be extended to any interface of any application on the device.

[0088] The device interaction method provided in the embodiments of the present application can be applied to the electronic devices such as the first device and the second device described above. For example, the electronic device can include, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a watch, a smart screen, a television, a vehicle-mounted computer, a netbook, a personal digital assistant (PDA), a wearable device, an augmented reality (AR) / virtual reality (VR) device, or a personal computer, and other electronic devices that can be used for theme package interaction. In some embodiments, the specific forms of the first device and the second device can be the same or different. The specific form of the electronic device is not specially limited in the embodiments of the present application.

[0089] Figure 3 A hardware structure diagram of the electronic device 100 is shown. The electronic device 100 shown can be a first device or a second device. Figure 3 The electronic device 100 shown can be a first device or a second device.

[0090] As shown in the figure, the electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor module 180 can include a pressure sensor 180A, a touch sensor 180K, etc.; the audio module 170 can include a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, etc. Figure 3

[0091] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0092] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices, or can be integrated in one or more processors.

[0093] Among them, the controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to instruction operation codes and timing signals to complete the control of fetching instructions and executing instructions.​

[0094] The processor 110 can also include memory that stores instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The cache memory can hold instructions or data recently used or frequently used by the processor 110. If the processor 110 needs to use the instructions or data again, it can directly call them from the cache memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the system.

[0095] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation of the electronic device 100. In some other embodiments of the present application, the electronic device 100 can also use different interface connection modes or a combination of multiple interface connection modes in the above embodiments.

[0096] The charging management module 140 is configured to receive charging input from a charger. The charger can be a wireless charger or a wired charger. The power management module 141 is configured to connect the battery 142 and the charging management module 140. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to supply power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160, etc. In some other embodiments, the power management module 141 and the charging management module 140 can also be arranged in the same device.

[0097] The wireless communication function of the electronic device 100 can be realized through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc. The antenna 1 and the antenna 2 are configured to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0098] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied to the electronic device 100. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be arranged in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 can be arranged in the same device.

[0099] The wireless communication module 160 can provide a solution for wireless communication, including wireless local area networks (WLAN) (such as a wireless fidelity (Wi-Fi) network), Bluetooth (BT), a global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, and the like, which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module.

[0100] The electronic device 100 can implement a communication function and a resource acquisition function, and the like, through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, and the like.

[0101] For example, when the electronic device 100 is the first device or the first device in the foregoing embodiments, the first device and the second device can negotiate a synchronous playback time point through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, and the like, so that when the synchronous playback time point is reached, the first device starts to synchronously play a corresponding frame in the first animation, and the second device starts to synchronously play a corresponding frame in the second animation. Alternatively, the first device can send first dynamic interaction information to the second device through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, and the like, and the second device can receive the first dynamic interaction information sent by the first device through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, and the like, so that in a case where the first device plays a first execution animation based on a first theme package, the second device plays a first response animation based on a second theme package in response to the first dynamic interaction information. The first execution animation and the first response animation interact with each other.

[0102] The electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor, and the like. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs that execute program instructions to generate or change display information.

[0103] The display screen 194 is used to display text, images, videos, and the like. The display screen 194 includes a display panel. In some embodiments, the electronic device 100 can include 1 or N display screens 194, N being a positive integer greater than 1.

[0104] For example, when the electronic device 100 is the first device or the second device in the foregoing embodiments, the display screen 194 of the first device can display the first interface provided by the theme package, and the display screen 194 of the second device displays the second interface provided by the theme package, so that when the trigger condition is met, the first device and the second device can respectively play the corresponding animation on the display screen 194 based on the first theme package and the second theme package having the association relationship, thereby realizing the theme package interaction between devices.

[0105] The electronic device 100 can realize the photographing function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc. The ISP is used to process the data fed back by the camera 193, and the camera 193 is used to capture a still image or a video. In some embodiments, the electronic device 100 can include one or N cameras 193, and N is a positive integer greater than 1.

[0106] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to realize the expansion of the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, files such as music and videos are saved in the external memory card.

[0107] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The processor 110 executes various function applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121.

[0108] The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), etc.

[0109] The electronic device 100 can realize the audio function through the speaker, the receiver, the microphone, the earphone interface, and the application processor in the audio module 170, etc. For example, music playing, recording, etc.

[0110] Touch sensor 180K, also referred to as "touch panel". Touch sensor 180K can be disposed on display screen 194, and touch sensor 180K and display screen 194 form a touch screen, also referred to as "touch panel". Touch sensor 180K is configured to detect a touch operation applied to or near the touch sensor 180K. The touch sensor 180K can transmit the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K can also be disposed on the surface of electronic device 100, which is different from the position of display screen 194.

[0111] For example, when electronic device 100 is the first device in the foregoing embodiments, the first device can detect the first trigger operation through touch sensor 180K.

[0112] The following embodiments will be described by taking the first device installed with the first theme package and the second device installed with the second theme package as an example.

[0113] For example, based on the determination that the first trigger operation is detected through touch sensor 180K, the first device determines that the first trigger condition is met. Figure 3 When electronic device 100 shown in the figure implements the device interaction method in the embodiments of the present application, the first device displays a first interface through display screen 194, and the second device displays a second interface through display screen 194. The first interface and the second interface belong to the interfaces provided by the theme package. The processors 110 of the first device and the second device determine that the trigger condition is met by running the instructions stored in the internal memory 121, and then the first device and the second device respectively play corresponding animations based on the first theme package and the second theme package through display screen 194, thereby realizing the synchronization of the theme packages between the devices.

[0114] For another example, after the first device detects the first trigger operation through touch sensor 180K, the first device determines that the trigger condition is met by running the instructions stored in the internal memory 121, and then the first device plays a first execution animation based on the first theme package through display screen 194, and the second device plays a first response animation based on the second theme package through display screen 194. The first response animation and the first execution animation interact with each other. Thus, the interaction of the theme packages between the devices is realized.

[0115] For another example, in the case that the first device and the second device establish a near field connection, the first device sends connection credential information to the server through antenna 1, antenna 2, mobile communication module 150, and wireless communication module 160, and establishes a first long link with the server. The connection credential information includes information of the second device having a near field connection with the first device. Based on the connection credential information, the server establishes a second long link with the second device through antenna 1, antenna 2, mobile communication module 150, and wireless communication module 160, thereby realizing remote connection through the first long link and the second long link.

[0116] The electronic device provided in the embodiments of the present application can run an operating system (OS). The operating system can be various operating systems used in the industry, such as an operating system developed based on OpenHarmony, for example, HarmonyOS; or other operating systems, for example, Android TM , iOS TM mobile operating system; can also be various open source operating systems or derivative operating systems thereof, such as Linux OS, and other embedded operating systems; or a new operating system in the future, such as an AI operating system based on artificial intelligence. The operating system is a set of interrelated system software programs that manage and control the operation of the electronic device, utilize and run hardware and software resources, and provide common services to organize user interaction. The operating system connects the physical devices of the hardware layer downward and provides a running environment for application software upward in the electronic device.

[0117] In some embodiments, the operating system can generally include a kernel layer, a middleware layer and an application layer. The application layer includes application programs, which can include system application programs and third-party application programs. The middleware layer includes a series of software that provides various services to application developers, or is a framework for providing various services such as databases, multimedia and graphics, or provides various capabilities such as distributed scheduling and system extension. Exemplarily, the middleware layer can include a framework layer and / or a system service layer. The framework layer provides application programming interfaces (APIs) and programming frameworks for application programs in the application program layer. The system service layer includes a set of core capabilities of the system, and provides services to application programs through the framework layer. The kernel layer is between hardware and software. The kernel layer can include hardware drivers and an operating system kernel. In addition to providing hardware drivers, the kernel layer also supports memory management, system process management and other functions.

[0118] Electronic devices come in various types and forms, and are applied in a wide range of scenarios. Therefore, based on different forms and functions of electronic devices, different application scenarios and different user needs, the operating system applied to the electronic device can also be different. The basic functions implemented by the electronic device provided in the present application can be implemented through a general-purpose operating system or a dedicated operating system. To more clearly introduce the implementation of the embodiments of the present application under a specific operating system, the software structure of the electronic device 100 is shown below.

[0119] Figure 4 A software structure schematic diagram of the electronic device 100 in the embodiments of the present application is shown.

[0120] The software architecture of the electronic device 100 can be divided into several layers, which in some embodiments are, from bottom to top, a kernel layer, a system service layer, a framework layer, and an application layer. The layers communicate with each other through software interfaces. System functions can be tailored, added, or combined in sub-system granularity in different device form deployment scenarios, and each sub-system can be tailored, added, or combined in functional granularity.

[0121] The kernel abstract layer (KAL) provides basic kernel capabilities to the upper layer by shielding the differences between multiple kernels, including but not limited to process / thread management, memory management, file system, network management, and peripheral management.

[0122] The kernel subsystem supports the selection of appropriate OS kernels for different resource-constrained devices, not limited to Linux kernels, Hongmeng kernels, LiteOS (Lite Operating System), etc.

[0123] The driver subsystem driver framework is the basis for the opening of the system hardware ecosystem, providing unified peripheral access capabilities and driver development and management frameworks. The driver framework includes display drivers, camera drivers, audio drivers, Bluetooth drivers, sensor drivers, etc.

[0124] The system service layer includes a collection of core capabilities of the system, providing services to applications through the framework layer. This layer includes a subsystem set, but is not limited to the following parts:

[0125] The system basic capability subsystem set provides basic capabilities for the operation of distributed applications on multiple devices, scheduling, migration, etc. The system basic capability subsystem set can include a distributed software bus, distributed data management, distributed task scheduling, Ark multi-language runtime, and also includes multi-mode input subsystem, graphics subsystem, security subsystem, AI business subsystem, etc.

[0126] The basic software service subsystem set provides common and universal software services. The basic software service subsystem set can include an event notification subsystem, a telephone service subsystem, a multimedia subsystem, etc.

[0127] The enhanced software service subsystem set provides differentiated capability-enhanced software services for different devices. The enhanced software service subsystem set can include a smart screen exclusive business subsystem, a wearable exclusive business subsystem, an IoT exclusive business subsystem, etc.

[0128] The hardware service subsystem set provides hardware services. The hardware service subsystem set can include a location service subsystem, a user uniform identity and access management (IAM) subsystem, a wearable proprietary hardware service subsystem, a biometric feature, an IoT proprietary hardware service, and the like.

[0129] Distributed task scheduling can implement distributed service management (discovery, synchronization, registration, and invocation), and supports remote starting, remote invocation, remote connection, and migration of applications across devices.

[0130] Distributed data management can implement full-scene, cross-device data synchronization, data storage, data sharing, and data access functions.

[0131] A distributed software bus provides communication-related capabilities for seamless interconnection between multiple devices, including WLAN service capabilities, Bluetooth service capabilities, a software bus, inter-process communication RPC (Remote Procedure Call), and star flash communication capabilities.

[0132] The Ark multi-language runtime is a unified compilation runtime platform designed to support joint compilation and running of multiple programming languages and multiple chip platforms.

[0133] The framework layer provides application programming interfaces (APIs) and programming frameworks for application programs of the application layer. The framework layer includes an ArkUI framework (the ArkUI framework provides a complete infrastructure for UI development of system applications, including UI functions such as components, layouts, animations, and interaction events, and a real-time interface preview tool), a user program framework, and an Ability framework (Ability is a lightweight application, and the Ability framework schedules and manages the running and life cycle of Ability). Different devices can run different operating systems, and the APIs supported by the different operating systems can be different.

[0134] HarmonyOS APIs are a series of open capabilities provided to support development of HarmonyOS applications. The HarmonyOS APIs can be set in the framework layer or independently of the framework layer. The HarmonyOS APIs include an Audio API (an audio service), a Push API (a push service), an Account API (an account service), and the like.

[0135] Applications can include system apps and extended / third-party apps. System apps can include the desktop, control bar, settings, contacts, phone, camera, etc., while extended / third-party apps can include social apps, travel apps, etc.

[0136] For example, based on Figure 4 When the electronic device 100 shown implements the device interaction method in this application embodiment, taking the interface provided by the theme package as the desktop as an example, the first device and the second device can provide the user with the desktop provided by the theme package, such as a first desktop or a second desktop, based on the application layer. The first device displays the first desktop, and the second device displays the second desktop. Under the condition of meeting the triggering condition, the first device and the second device respectively call the theme engine of their respective desktops, drive the collaborative framework and distributed soft bus of the system service layer, establish a near-field communication connection, and negotiate the synchronization playback time. Then, based on the display driver of the kernel layer, the first device and the second device, respectively based on the first theme package and the second theme package, start playing the corresponding frame in the corresponding animation when the synchronization playback time arrives, thereby realizing the synchronization of theme packages between devices.

[0137] For another example, the first device and the second device can display desktops provided by theme packages, such as a first desktop or a second desktop, based on the application layer. The first device displays the first desktop, and the second device displays the second desktop. Under the condition of being triggered, the first device and the second device respectively call the theme engine of their respective desktops, drive the collaborative framework and distributed soft bus of the system service layer, and establish a near-field communication connection. After detecting the first trigger operation, the first device sends the first animation interaction information to the second device. After receiving the first animation interaction information, the second device responds to the first animation interaction information and plays the first response animation based on the display driver of the kernel layer and the second theme package, thereby realizing the interaction of theme packages between devices. Among them, the first execution animation and the first response animation interact collaboratively.

[0138] For another example, after the first device and the second device establish a near-field communication connection, the first device drives the collaborative framework and distributed soft bus of the system service layer to send connection credential information to the server and establish a first long connection with the server. The server, through the system service layer, establishes a second long connection with the second device based on the connection credential information, thereby realizing a remote connection through the first and second long connections.

[0139] The following description uses mobile phones with the aforementioned hardware and software structures as examples of the first and second devices, and, in conjunction with the accompanying drawings, illustrates the device interaction method provided in this application. Exemplary embodiments of the device interaction method provided in this application may include three implementations: inter-device animation synchronization, inter-device animation interaction, and establishing remote connections between multiple devices.

[0140] Figure 5A flowchart of a device interaction method is shown. The flowchart takes the first device installing a first theme package and the second device installing a second theme package as an example to illustrate the process of animation synchronization between devices. As shown in Figure 5 The method can include the following steps S501a-S502.

[0141] S501a, the first device displays a first interface. The first interface belongs to the interface provided by the theme package.

[0142] The first interface is any one of the interfaces provided by the theme package. The theme animation corresponding to the theme package (such as the first theme package) can be displayed on the first interface.

[0143] For example, the interface provided by the theme package can include but is not limited to a lock screen interface, a desktop, or an interface including theme elements. The theme elements include but are not limited to theme cards, theme icons, or theme widgets. The embodiments of the present application do not limit the interface provided by the theme package.

[0144] In this way, the user can realize the theme package interaction of multiple devices on the interface provided by the theme package, which can meet the individual needs of different users for different interfaces, expand the application range of the theme package interaction, and improve the user experience.

[0145] In some embodiments, the interface provided by the theme package can include theme elements. Taking the desktop as the interface provided by the theme package as an example, the desktop can include theme cards, theme icons, or theme widgets.

[0146] Figure 6 A schematic diagram of an interface provided by a theme package is shown. Referring to (a) and (b) in Figure 6 The interface provided by the theme package can be a lock screen interface and a desktop. Taking the interface including theme elements as the desktop as an example, referring to (c) and (d) in Figure 6 The desktop can include theme elements such as theme cards or theme icons.

[0147] In some embodiments, the first device can start the first theme package when displaying the first interface, so as to play the corresponding animation based on the first theme package.

[0148] S501b, the second device displays a second interface. The second interface belongs to the interface provided by the theme package.

[0149] The second interface is any one of the interfaces provided by the theme package, which can be a lock screen interface, a desktop, or an interface including theme elements.

[0150] In some embodiments, the second device can start the second theme package to play a corresponding animation based on the second theme package when the second device displays the second interface. The second theme package can be the same theme package as the first theme package or the same type of theme package.

[0151] It should be noted that the time when the first device starts the first theme package and the time when the second device starts the second theme package can be the same or different, and is not limited.

[0152] The specific implementation of this step can be referred to the description in the above step S501a. The "first device" can be replaced with "second device", and the "first interface" can be replaced with "second interface" for understanding.

[0153] S502, in a case where it is determined that the trigger condition is met, the first device and the second device respectively play corresponding frames in the first animation and the second animation at the same time based on the first theme package and the second theme package respectively. The first theme package and the second theme package have an association relationship.

[0154] In this way, the first device and the second device synchronously play corresponding frames in the corresponding animation, which improves the interactivity of theme packages between devices and the user experience. Moreover, the corresponding elements on the corresponding frames have the same or corresponding actions or states, which ensures the consistency and coordination of the animation when playing across devices, further improves the user experience, and thus increases the possibility and willingness of the user to purchase theme packages.

[0155] The corresponding elements on the corresponding frames are used to represent the same or corresponding actions or states, such as limb actions or expressions, in the frame animation synchronously played by the first device and the second device.

[0156] The following takes the interface provided by the theme package as the lock screen interface as an example, and the method of synchronizing the animation between devices is exemplarily introduced in combination with Figure 7 .

[0157] As shown in Figure 7 , a device interaction method is exemplarily introduced, taking the first theme package and the second theme package as the same theme package as an example, referring to (a) and (b) in Figure 7 , the first theme package installed by the first device and the second theme package installed by the second device are the same theme package, and the theme package includes an animation of a pear dancing. The first device and the second device display the lock screen interface. In a case where the trigger condition is met, the first device and the second device respectively play the animation of the pear dancing at the same time based on the first theme package and the second theme package respectively.

[0158] Exemplarily, taking the first theme package and the second theme package as the same type of theme package as an example, referring to Figure 7(c) and (d) in the first device installs a first theme package, and the second device installs a second theme package. The first theme package includes an animation of a pear dancing, and the second theme package includes an animation of an apple dancing. The first device and the second device display a lock screen interface. In a case where a trigger condition is met, the first device and the second device respectively play the animation of the pear dancing and the animation of the apple dancing at the same time based on the theme package respectively installed.

[0159] Therefore, the first interface and the second interface can play corresponding animations based on the same theme package or based on the same type of theme package.

[0160] The trigger condition is used to represent a condition for establishing a near field communication connection between devices (such as the first device and the second device).

[0161] For example, the trigger condition includes but is not limited to one or more of the following: a communication signal strength between the first device and the second device is greater than or equal to a first preset threshold. Alternatively, a transmission delay between the first device and the second device is less than or equal to a second preset threshold. Alternatively, a distance between the first device and the second device is less than or equal to a third preset threshold. The specific manner of the trigger condition is not limited in the present application.

[0162] For example, the third preset threshold is an adaptive distance for the first device and the second device to establish a near field communication connection. For example, the third preset threshold is 10 cm.

[0163] In this way, in a case where the trigger condition is met, it indicates that the distance between the two devices is close enough and within an effective range for establishing a near field communication connection, and at this time the first device and the second device can start to establish a near field communication connection. The form of the near field communication can be a Wi-Fi or Bluetooth signal.

[0164] For example, the first device and the second device can discover each other through a near field, and can determine that the distance between the first device and the second device is less than or equal to the first preset threshold. In this way, the first device and the second device discover each other through a near field communication technology, can automatically judge that the two devices are close to each other, and can automatically perceive the positions of each other and establish a near field communication connection, thereby improving the fluency of device interaction.

[0165] In a possible implementation, the first device and the second device respectively include a theme engine and a cooperative framework. The first device and the second device call the theme engine of the self device, drive the cooperative framework, discover each other through a near field, and determine that the trigger condition is met.

[0166] For example, referring to Figure 8 The first device calls the theme engine of the self device, drives the cooperative framework, receives a second device approach event in distance measurement, and establishes a near field communication connection with the second device in a case where it is determined that the trigger condition is met.

[0167] In some embodiments, the first device and the second device respectively start the first theme package and the second theme package, and respectively play corresponding frames in the first animation and the second animation at the same time based on the first theme package and the second theme package respectively.

[0168] In some embodiments, the first device and the second device both include a theme engine. For example, referring to Figure 8 The first device and the second device respectively call the theme engine of each device to start the first theme package and the second theme package.

[0169] In some embodiments, the first device sends first broadcast information, and the second device establishes a near field communication connection with the first device based on the media access control address (MAC) of the first device upon receiving the first broadcast information.

[0170] The first broadcast information includes the MAC address of the first device. The embodiments of the present application do not limit the specific way in which the second device obtains the first broadcast information of the first device.

[0171] In some embodiments of the present application, after the first device and the second device establish a near field communication connection, the first device and the second device can negotiate to determine a synchronization playing time. Then, when the synchronization playing time arrives, the first device starts to play corresponding frames in the first animation synchronously, and the second device starts to play corresponding frames in the second animation synchronously.

[0172] In this way, by negotiating the synchronization playing time, the first device and the second device can play the corresponding animations at the same time, ensuring the synchronization and consistency of the multi-device animation, improving the interactivity of the theme package between devices and the user experience, and thus increasing the possibility and willingness of users to purchase theme packages.

[0173] For example, the synchronization playing time is obtained based on the transmission delay between the first device and the second device. Determining the synchronization playing time based on the transmission delay can effectively avoid the difference in playing time between devices caused by the transmission delay, and realize synchronous playing of the animation.

[0174] Further, in the process of synchronizing the theme package animation between devices, it is also necessary to ensure that the corresponding frames in the animation are synchronized. In some embodiments, the first device and the second device negotiate the synchronization playing time and the frame synchronization time of the corresponding frames.

[0175] The corresponding frames are used to indicate that the two animations play the same number of frames at the same time and the frame contents correspond to each other, thereby realizing synchronous playing of the animation between devices. The frame synchronization time is used to indicate the time when the time values of the corresponding frames in the multi-device animation are the same.

[0176] Thus, by negotiating the synchronization play time, the two devices can start playing the animation at the same time point. Meanwhile, the frame synchronization time of each frame is negotiated, so that the two devices can accurately align the display time of each frame during the playing process, ensuring that the corresponding frames in the animation are played simultaneously on the two devices, thereby realizing consistent animation playing effect and guaranteeing the interactivity and continuity of multi-device animation playing.

[0177] In some embodiments, the process of the second device obtaining the synchronization play time can include that the first device sends first broadcast information. The first broadcast information includes the identification information of the first theme package, the first timestamp of the first device, and the frame play time of the corresponding frame. The second device obtains the second timestamp of the second device to obtain the transmission delay AT upon receiving the first broadcast information. The second device obtains the third timestamp of the second device upon confirming that the installed second theme package has a correlation with the first theme package in the first broadcast information. The second device sends first synchronization information to the first device. The first synchronization information includes the identification information of the second theme package, the synchronization play time, and the frame synchronization time of the corresponding frame.

[0178] The frame play time is the frame play time of the animation being played sent by the first device to the second device during the negotiation process to negotiate the synchronization time.

[0179] Thus, according to the short-range communication connection process of the first device and the second device, the synchronization play time and the frame synchronization time of the corresponding frame are accurately obtained, which can effectively avoid the phenomenon of different playing times between devices due to the time delay, ensure that the first device and the second device can play the corresponding animation at the same frame, improve the accuracy of multi-device theme package interaction, improve the user's experience, and thus increase the user's possibility and willingness to purchase theme packages.

[0180] In other embodiments, the first device and the second device respectively include a theme engine and a collaborative framework. Referring to Figure 8 , the process of the second device obtaining the synchronization play time can include that the first device calls the theme engine of the first theme package to drive the collaborative framework to send first broadcast information to the second device. The second device receives the first broadcast information through the collaborative framework, obtains the second timestamp of the second device to obtain the transmission delay AT. The second device notifies the theme engine that data (such as the identification information of the second theme package) can be transmitted through the collaborative framework, and obtains the third timestamp of the second device upon confirming that the installed second theme package has a correlation with the first theme package in the first broadcast information. Then, the second device sends first synchronization information to the first device through the collaborative framework. The first synchronization information includes the identification information of the second theme package, the synchronization play time, and the frame synchronization time of the corresponding frame.

[0181] The first timestamp is a time when the first device sends the first broadcast information, the second timestamp is a time when the second device receives the first broadcast information sent by the first device, and the third timestamp is a time when the second device sends the first synchronization information. The AT is calculated based on the second timestamp and the first timestamp. For example, the AT is a difference between the second timestamp and the first timestamp.

[0182] For example, the synchronization playing time is a sum of the third timestamp and the offset value At, and the At is greater than or equal to 2 times the AT. The frame synchronization time is a sum of the corresponding frame playing time and the At. The embodiment of the present application does not limit the specific calculation of the frame synchronization time.

[0183] The identification information is used to represent information uniquely identifying the identity of the theme package. For example, the identification information can be an identity document (ID) of the theme package, or a team ID of a category to which the theme package belongs. The association relationship is used to represent that the first theme package and the second theme package are the same theme package or the same category theme package. For example, the association relationship can be obtained based on the identification information of the first theme package and the identification information of the second theme package.

[0184] Correspondingly, after the second device sends the first synchronization information to the first device, the first device receives the first synchronization information. In some embodiments, the first device receives the first synchronization information through the coordination framework, and sends the first synchronization information to a theme engine of the first theme package.

[0185] In some embodiments, after receiving the first synchronization information, the first device first confirms whether the installed first theme package and the second theme package in the first synchronization information have an association relationship. In the case where the installed first theme package and the second theme package in the first synchronization information have an association relationship, the first device sends first synchronization confirmation information to the second device. Then, when the synchronization playing time arrives, the first device starts to synchronously play the corresponding frame in the first animation in the first theme package. At the same time, when the synchronization playing time arrives, the second device starts to synchronously play the corresponding frame in the second animation in the second theme package in the case where the first synchronization confirmation information is received.

[0186] In a possible implementation, referring to Figure 8 The first device and the second device respectively call the theme engines of themselves, and play the corresponding frames in the first animation and the second animation at the same time.

[0187] Thus, the first device confirms the association relationship between the first theme package and the second theme package after receiving the first synchronization information, and then sends the synchronization confirmation information to the second device, thereby ensuring the accuracy and reliability of the animation synchronization between the devices. Animation synchronization is only performed when there is an association relationship between the theme packages, thereby avoiding animation playback confusion caused by theme package mismatch and improving the user experience. In addition, the first device and the second device start playing the corresponding frames of the animations in the theme packages when the synchronization playback time arrives, thereby realizing the synchronization of the animation playback between the devices and increasing the possibility and willingness of users to purchase theme packages.

[0188] In some embodiments, the first device and the second device determine the master device and the slave device. The master device determines the synchronization playback time and sends the synchronization playback time to the slave device. Thus, the master device determines the synchronization playback time and communicates it to the slave device, thereby improving the efficiency and reliability of device interaction.

[0189] In other embodiments, the first device sends the first broadcast information and the second device sends the second broadcast information. The device that first receives the broadcast information from the opposite device is the master device. The first broadcast information includes the identification information of the first theme package, the first timestamp of the first device, and the frame playback time of the corresponding frame. The second broadcast information includes the identification information of the second theme package, the timestamp of the second device, and the frame playback time of the corresponding frame.

[0190] Thus, the master and slave devices are determined, and the synchronization playback time is determined by the master device, so that the first device and the second device can quickly and efficiently realize theme package animation synchronization, thereby improving the efficiency of device interaction.

[0191] In other embodiments, if the second device receives the first broadcast information sent by the first device, it no longer sends the second broadcast information. The second device is the master device. Alternatively, if the first device receives the second broadcast information sent by the second device, it no longer sends the first broadcast information. The first device is the master device.

[0192] In one possible implementation, the device that receives the broadcast information from the opposite side first no longer sends the broadcast information and automatically determines itself as the master device, and sends confirmation information to the opposite device to inform the opposite device that it is the slave device.

[0193] In another possible implementation, the device that receives the broadcast information from the opposite side first no longer sends the broadcast information and automatically determines itself as the master device. The opposite device automatically determines itself as the slave device if it does not receive the broadcast information sent by the device that receives the broadcast information from the opposite side within a preset time period.

[0194] Thus, the determination process of the master and slave devices is simplified, and the communication overhead and the computing resource consumption between the devices are reduced. The master device determines the synchronization playing time, so that the first device and the second device can quickly and efficiently realize the theme package animation synchronization, and the device interaction efficiency is improved.

[0195] For example, the first animation and the second animation are pre-set.

[0196] In some embodiments, the theme package includes a dynamic effect script of each frame of the theme animation. It can be understood that the dynamic effect script is configured by the developer when developing the theme package. The dynamic effect script defines the dynamic effect in the form of a tag.

[0197] For example, the tag can be used <sourcesanimation>< / sourcesanimation> The following shows an example of a dynamic effect script of each frame of the theme animation in a theme package:

[0198]

[0199]

[0200] In the <sourcesanimation>< / sourcesanimation> In the tag, the frame animation of the picture is defined by the tag, and each tag specifies the picture path (such as “1.png” and the like) and the corresponding frame playing time (or the time when each frame mark starts to play), such as “time=400”, which means that at the frame playing time of 800 ms, the picture is updated from 1.png to 2.png. The tag defines the update change of the picture from “1.png” to “5.png” at different dynamic effect time values from 0 to 5000 ms.

[0201] For example, when the synchronization playing time is reached, the first device plays the frame animation of time=“1000” in the first animation based on the first theme package, and the second device plays the frame animation of time=“1000” in the second animation based on the second theme package, so as to realize the picture synchronization between the devices. The frame synchronization time is time=“1000”.

[0202] Therefore, after the first device installs the theme package (such as the first theme package), the first device includes the dynamic effect script of each frame of the theme animation of the first theme package.

[0203] In some embodiments, in the case that the interface has started to play the animation or has not played the animation before the device plays the corresponding animation, the device restarts to play the corresponding frame in the corresponding animation based on the installed theme package.

[0204] For example, in a case where the first device has started playing the first animation in the first theme package, when the synchronized playing time arrives, the first device restarts playing the corresponding frame of the first animation. For another example, in a case where the second device has started playing the second animation in the second theme package, when the synchronized playing time arrives, the second device restarts playing the corresponding frame of the second animation.

[0205] In this way, the corresponding frames in the animations can be played at the same time when the animations are played synchronously by the multiple devices, the synchronization and consistency of the animations of the multiple devices are ensured, and the interactivity of the multiple devices and the interestingness of the user operations are improved.

[0206] For another example, in a case where the first device is playing other animations or displaying an interface provided by the theme package, when the synchronized playing time arrives, the first device is switched to synchronously play the corresponding frame in the first animation in the first theme package. For another example, in a case where the second device is playing other animations or displaying an interface provided by the theme package, when the synchronized playing time arrives, the second device is switched to synchronously play the corresponding frame in the second animation in the second theme package.

[0207] In this way, the synchronized playing state can be switched from the current state in real time in response to actual needs of the user, the theme package animation of the multiple devices is synchronized, the synchronization and consistency of the animations of the multiple devices are ensured, and the interactivity of the multiple devices and the interestingness of the user operations are improved.

[0208] The above embodiments are described with reference to the device interaction method shown in FIG. 1. Figure 5 The synchronization of the theme animations corresponding to the theme packages between the multiple devices is described. In the near field communication scenario, the first device and the second device can play the corresponding animations based on the first theme package and the second theme package installed respectively, so as to realize the theme package interaction of the multiple devices. On this basis, in some embodiments, the method further includes that the first device and the second device re-negotiate the synchronized playing time.

[0209] In some embodiments, in a case where the playing time of the first animation and the second animation is greater than or equal to a preset time length, the first device and the second device re-negotiate the synchronized playing time. During the playing of the theme animations, due to factors such as device performance difference and network fluctuation, a slight deviation in the playing progress between the devices can occur. When the playing time of the first animation and the second animation is equal to the preset time length, the first device and the second device re-negotiate the synchronized playing time, so that the synchronization of the playing of the theme animations between the devices is ensured, and the stability of the interaction between the devices is improved.

[0210] The preset time length can be preset by the user and is not limited. For example, the preset time length can be 1 s.

[0211] In addition, in the process that the first device and the second device have played the corresponding animation, other devices (such as the third device) can also discover each other through near field communication, establish a near field communication connection with the first device and the second device, and play the corresponding animation. In this way, in the process that the first device and the second device play the corresponding animation, the other devices (such as the third device) are allowed to join in the synchronous playing of the corresponding animation, thereby enhancing the flexibility and interest of the theme package interaction.

[0212] In some embodiments, the interaction system further includes a third device. The third device is installed with a third theme package, and the third theme package has an association relationship with the first theme package. In the process that the first device and the second device play the corresponding animation based on the first theme package and the second theme package respectively, in the case that the trigger condition is met, the first device, the second device and the third device play the corresponding frames in the first animation, the second animation and the third animation at the same time based on the first theme package, the second theme package and the third theme package respectively.

[0213] For example, the communication signal strength between the third device and the first device is greater than or equal to a first preset threshold. Alternatively, the transmission delay between the third device and the second device is less than or equal to a second preset threshold. Alternatively, the distance between the third device and the second device is less than or equal to a third preset threshold, which is not limited.

[0214] For example, the first theme package, the second theme package and the third theme package are the same type of theme package. Referring to (a)-(c) in FIG. 1, the first device, the second device and the third device are all installed with a dancing theme package. The theme element of the theme package of the first device is a pear, the theme element of the theme package of the second device is an apple, and the theme element of the theme package of the third device is a peach. The first device, the second device and the third device have respectively started the theme package of the pear dancing, the theme package of the apple dancing and the theme package of the peach dancing. In the process that the first device and the second device have played the corresponding animation, in the case that the trigger condition is met, the first device, the second device and the third device play the corresponding animation based on the respective theme package. Figure 9 As shown in FIG. 1, the first theme package of the first device, the second theme package of the second device and the third theme package of the third device (the theme elements are respectively a pear, an apple and a peach) belong to the same type of theme package, and therefore can play the corresponding frames with the same action in the respective corresponding animation at the same time.

[0215] Figure 9 The above embodiments exemplarily introduce the method of multi-device animation synchronization, and the following exemplarily introduces the method of multi-device animation interaction.

[0216] The above embodiments exemplarily introduce the method of multi-device animation synchronization, and the following exemplarily introduces the method of multi-device animation interaction.

[0217] Figure 10 ​A flowchart illustrating another method of device interaction is shown. The flow takes the first device installing a first theme package and the second device installing a second theme package as an example to exemplarily illustrate the process of animation interaction between devices. As shown in Figure 10 The method can include the following steps S1001a-S1002.

[0218] S1001a, the first device displays a first interface. Wherein, the first interface belongs to the interface provided by the theme package.

[0219] S1001b, the second device displays a second interface. Wherein, the second interface belongs to the interface provided by the theme package.

[0220] Exemplarily, the specific implementation of the above steps S1001a and S1001b can be respectively referred to the description in the above steps S501a and S501b, which will not be described here.

[0221] S1002, under the condition of meeting the triggering condition, the first device plays a first execution animation based on the first theme package, and the second device plays a first response animation based on the second theme package. Wherein, the first response animation cooperates with the first execution animation.

[0222] Wherein, the first execution animation is played by the first device. The first response animation is played by the second device. The first response animation cooperates with the first execution animation, which can mean that the first execution animation and the first response animation have interaction, etc. For example, the first execution animation includes the action of a pig spraying milk, and the first response animation includes the action of a monkey being sprayed with milk. For another example, the first execution animation includes the action of greeting, and the first response animation includes the action of responding to the greeting. For another example, the first execution animation includes the action of throwing a ball, and the first response animation includes the action of catching the ball.

[0223] In this way, the first response animation cooperates with the first execution animation, realizing the dynamic interaction of the theme package between the first device and the second device. The second device can play corresponding animations according to the animation playing of the first device, improving the application scenario of multi-device interaction, improving the interest of multi-device theme package interaction, meeting the user's interaction demand, and thus increasing the user's possibility and willingness to purchase theme packages.

[0224] Exemplarily, taking the first theme package and the second theme package as the same type of theme package as an example, referring to (a) and (b) in Figure 11 , the first device plays an execution animation of a monkey spraying milk based on the first theme package (first execution animation), and the second device plays a first response animation of a pig being sprayed with milk based on the second theme package.

[0225] In one possible implementation, there are multiple first response animations that cooperate with the first execution animation.

[0226] For example, referring to Figure 12 , the first theme package installed on the first device includes Figure 12 the execution animation of a monkey spraying milk (first execution animation) shown in (a). Figure 12 The second theme package installed on the second device includes Figure 12 the response animation 1 of a piglet sitting and being sprayed milk shown in (b), Figure 12 the response animation 2 of a piglet standing and being sprayed milk shown in (c), and the response animation 3 of a piglet jumping and being sprayed milk shown in (d). The animations of the piglet being sprayed milk in the response animation 1, the response animation 2 and the response animation 3 interact with the execution animation of the monkey spraying milk in the first theme package.

[0227] In some embodiments, the trigger condition is satisfied when at least one of the following conditions is met: the first device detects a first trigger operation, and a preset animation on the first device is played to completion.

[0228] For example, the first trigger operation can be in the form of a touch screen, a gesture action or a voice instruction. The specific implementation form of the first trigger operation is not limited in the embodiments of the present application.

[0229] In the embodiments of the present application, the second device receives the first dynamic effect interaction information from the first device, and plays the first response animation based on the second theme package in response to the first dynamic effect interaction information. The first dynamic effect interaction information is used to indicate the animation that interacts with the first execution animation. In this way, the second device can play the animation that interacts with the first execution animation based on the first dynamic effect interaction information sent by the first device, and the interactivity of the theme package between multiple devices is realized.

[0230] In some embodiments, the first dynamic effect interaction information includes identification information of the first response animation. The second device determines the first response animation from the second theme package based on the identification information of the first response animation and plays the first response animation. The second installation package of the second device includes the first response animation. In this way, the second device has the response animation that interacts with the execution animation of the first theme package, and the second device can play the response animation based on the installed theme package after receiving the first dynamic effect interaction information, thereby improving the reliability of device interaction.

[0231]

[0232] In some embodiments, the first dynamic effect interaction information includes identification information of the first execution animation. The second device determines the first response animation that cooperatively interacts with the first execution animation from the second theme package according to the identification information of the first execution animation and plays the first response animation. In this way, the second device can automatically determine the response animation that cooperatively interacts with the first execution animation from the second theme package according to the received identification information of the first execution animation and play the response animation, thereby improving the flexibility of device interaction.

[0233] In some embodiments, the first dynamic effect interaction information includes a dynamic effect segment of the first response animation. The second device synthesizes the dynamic effect segment into the second theme package and plays the dynamic effect segment based on the second theme package. In this way, the first device sends the dynamic effect script segment or the dynamic effect script parameter to the second device. Whether the second device originally installs the related theme package or not, the theme package interaction between devices can be performed after the second device receives the theme package sent by the first device, thereby realizing that the first device drives the second device to play the corresponding animation, and improving the flexibility and expandability of device interaction. When there is a new animation update, the first device only needs to install the updated theme package and send it to the second device, so that the theme package interaction between multiple devices can be quickly realized, and the device interaction efficiency is improved.

[0234] In a possible implementation, if the first response animation is not included in the second theme package, the first response animation is downloaded from a network and played. In this way, in the case that the second device does not include the response animation, the response animation can be downloaded from the network and played, thereby improving the flexibility of device interaction.

[0235] In some embodiments, the first dynamic effect interaction information is used to indicate a trigger event. The second device determines the first response animation corresponding to the trigger event from the second theme package and plays the first response animation. In this way, the second device can play the first response animation that cooperatively interacts with the first execution animation in response to the trigger event associated with the trigger operation of the first device, thereby improving the flexibility of device interaction.

[0236] In some embodiments, the dynamic effect script of each frame of the theme animation in the theme package includes an ID of the theme package. For example, the ID of the theme package is added in the tag <SourcesAnimation id="1">. The following shows an example of the dynamic effect script of each frame of the theme animation in another theme package:

[0237]

[0238] Or,

[0239]

[0240] In the <SourcesAnimation id=”1”> tag, the ID of the theme package is set. By setting the ID of the theme package in the frame script of the theme package animation, accurate interaction of the device animation can be realized, and the interest and efficiency of device interaction are improved.

[0241] The internal implementation process of the device animation interaction is exemplarily introduced below.

[0242] Figure 13 A flowchart of another device interaction method is shown. As shown in Figure 13 , device A (second device) and device B (first device) respectively call the theme engine of each device to start the first theme package and the second theme package. Device A calls the theme engine of itself, drives the collaboration framework, and detects the device B approaching event. When it is determined that the preset triggering condition is met, device A calls the theme engine of the first theme package, drives the collaboration framework, and sends the first broadcast information to device B. Device B establishes a near field communication connection with device A based on the MAC address of device A in the first broadcast information. Device B detects the first trigger operation, calls the driving framework, and sends the first animation interaction information to device A. Device B calls the theme engine of itself, and plays the first execution animation based on the second theme package. Device A calls the driving framework to receive the first animation interaction information and sends it to the theme engine of itself. The theme engine of device A confirms that the first theme package and the second theme package have an association relationship, calls the theme engine of itself, and plays the first response animation based on the first theme package. Thus, the theme package interaction between multiple devices is realized, the interest of theme package interaction is enhanced, and the interaction scene between devices is expanded.

[0243] In the embodiments of the present application, the above-mentioned device animation synchronization embodiment and the device animation interaction embodiment can be independently implemented or combined. Multiple devices can interact with theme packages or synchronize theme packages. The process of combining the device animation synchronization embodiment and the device animation interaction embodiment is exemplarily described below.

[0244] In addition, during the process that the first device and the second device have played the corresponding animation, other devices (such as the third device) can also discover each other through near field communication and play the corresponding animation with the first device and the second device. In this way, during the process that the first device and the second device play the corresponding animation, other devices (such as the third device) are allowed to join and play the corresponding animation, which enhances the flexibility and interest of theme package interaction.

[0245] In some embodiments, taking the example of the first device playing a first execution animation based on a first theme package, and the second device and the third device interacting with the theme package, the first device and the second device are playing the corresponding animation, and the third device discovers each other through near field communication, and confirms that the trigger condition is met. Wherein, the third device installs a third theme package, and the third theme package has an association relationship with the first theme package. At this time, the first device plays the first execution animation based on the first theme package, and the second device and the third device play the response animation 1 (the first response animation) based on the second theme package and the response animation 2 based on the third theme package respectively.

[0246] For example, taking the example of the first theme package, the second theme package and the third theme package being the same type of theme package, referring to (a)-(c) in Figure 14 In the case that the first device has played the execution animation of the monkey spraying milk based on the first theme package, and the second device has played the response animation 1 of the pig sitting and being sprayed milk based on the second theme package, if the third device meets the trigger condition with the first device or the second device, the first device plays the execution animation of the monkey spraying milk based on the first theme package, the second device plays the response animation 1 of the pig sitting and being sprayed milk based on the second theme package, and the third device plays the response animation 2 of the pig standing and being sprayed milk based on the third theme package.

[0247] The above embodiments respectively exemplarily introduce the animation synchronization between devices and the animation interaction between devices. The embodiment of the application further provides another device interaction method. Exemplarily, the first device displays a first interface, and the second device displays a second interface. Wherein, the first interface and the second interface belong to the interface provided by the theme package. In the case that the trigger condition is met, the first device and the second device respectively play the corresponding animation based on the first theme package and the second theme package.

[0248] In this scheme, the first device and the second device respectively play the corresponding animation based on the first theme package and the second theme package, including the above two embodiments of the animation synchronization between devices and the animation interaction between devices. The specific implementation process can be referred to the foregoing embodiment description, which will not be described here.

[0249] The following exemplarily introduces the method for multiple devices to establish a remote connection.

[0250] In some embodiments, in the case that the first device establishes a near field connection with the second device, the first device sends connection credential information to the server, and establishes a first long link with the server. Wherein, the connection credential information includes the information of the second device having a near field connection with the first device. Based on the connection credential information, the second device establishes a second long link with the server.

[0251] The remote connection includes a first long link and a second long link.

[0252] Furthermore, in some embodiments, after a remote connection is established, the first device and the second device exchange information based on a first long link and a second long link. This enables remote communication without relying on account login. In other words, even when devices do not support account login, remote connections can still be established between devices, expanding the application scenarios for device interaction.

[0253] In one possible implementation, when the distance between the first device and the second device is greater than or equal to a second preset threshold, the first device and the second device interact with each other based on a first long link and a second long link. Thus, when the distance between the devices is greater than or equal to the second preset threshold, using the first long link and the second long link for information interaction enables data transmission in remote communication, improves the reliability of cross-device interaction, and enhances the user experience.

[0254] It should be noted that the first device and the second device can be the same device or different devices. For example... Figure 15 As shown in (a) above, both the first and second devices are mobile phones. A mobile phone is a device capable of logging into an account. Figure 15 As shown in (b), the first device is a mobile phone, and the second device is a watch. The watch is a device that cannot be logged into with an account. This solution eliminates the need for account login, expanding the application scenarios for device interaction.

[0255] Figure 16 A schematic diagram of a remote connection between devices is shown. See also Figure 16 The first and second devices have established a near-field communication connection. The first device establishes a first long link with the server, and the second device establishes a second long link with the server. The first and second devices achieve remote connection and information exchange through the first and second long links. This method enables remote connection between devices without relying on account login, expanding the application scenarios for device interaction.

[0256] There are multiple ways for the first device and the second device to interact after establishing a remote connection.

[0257] In some embodiments, the first device is playing a corresponding frame in the first animation based on the first theme package, and the second device is playing a corresponding frame in the second animation based on the second theme package. When it is determined that the preset condition is met, the first device and the second device re-negotiate the synchronous playing time through the first long link and the second long link. The synchronous playing time is based on the transmission delay of the first long link and the second long link. When the re-negotiated synchronous playing time is reached, the first device starts to synchronously play the corresponding frame in the first animation, and the second device starts to synchronously play the corresponding frame in the second animation.

[0258] Since the communication delay between the devices changes after the near field communication connection is switched to the remote connection, if the first device and the second device are synchronously playing the corresponding animations, when the distance between the devices changes by more than or equal to the second preset threshold, the first device and the second device can re-negotiate the synchronous playing time through the first long link and the second long link, thereby ensuring the synchronization of the theme packages of the multiple devices and improving the user experience.

[0259] In some embodiments, when it is determined that the preset condition is met, if the first device receives a first synchronization operation, the second device responds to the first synchronization operation, and the first device and the second device negotiate the synchronous playing time through the first long link and the second long link. The synchronous playing time is based on the transmission delay of the first long link and the second long link. When the synchronous playing time is reached, the first device starts to synchronously play the corresponding frame in the first animation, and the second device starts to synchronously play the corresponding frame in the second animation.

[0260] In this way, when the distance between the devices is greater than or equal to the second preset threshold and the first device receives the first synchronization operation, the synchronous playing time can be negotiated through the long link, thereby realizing accurate synchronization of the animation playing between the devices under the remote connection and improving the synchronization of the collaborative animation of the multiple devices and the user experience.

[0261] Further, in the process of synchronizing the theme package animations between the multiple devices, it is also necessary to ensure the synchronization of the corresponding frames in the animations. In some embodiments, the first device and the second device negotiate the synchronous playing time and the frame synchronization time of the corresponding frames, so that when the synchronous playing time is reached, the corresponding animations are played from the frame synchronization time of the corresponding frames.

[0262] In this way, by negotiating the synchronous playing time and the frame synchronization time of the corresponding frames, the two devices can accurately align the display time of each frame during the long-distance playing process, ensuring that the corresponding frames in the animations are played simultaneously on the two devices, thereby realizing consistent animation playing effects and ensuring the interactivity and continuity of the animation playing of the multiple devices.

[0263] In some embodiments, the first device plays a second execution animation based on the first theme package if the first device detects a first trigger operation or a preset animation playing on the first device is completed. The first device sends second dynamic interaction information to the server through the first long connection. The second device receives the second dynamic interaction information forwarded by the server through the second long connection, and plays a second response animation based on a second theme package according to the second dynamic interaction information. The second response animation cooperates with the second execution animation.

[0264] In this way, when the distance between the devices is greater than or equal to the second preset threshold, the first device plays the execution animation based on the theme package, and interacts with the server through the long connection, so that the second device synchronously plays the response animation for cooperative interaction, realizing the animation interaction between the devices and improving the user experience.

[0265] In some embodiments, the device determining that the preset condition is met can include one or more of the following: the communication signal strength between the first device and the second device is less than or equal to a fourth preset threshold. Alternatively, the transmission delay between the first device and the second device is greater than or equal to a fifth preset threshold. Alternatively, the distance between the first device and the second device is greater than or equal to a sixth preset threshold. For example, the sixth preset threshold is used for the distance between the first device and the second device to be greater than a boundary value of near field communication connection. For example, the sixth preset threshold is 10 m.

[0266] In some embodiments, the connection credential information is generated by the first device, and the connection credential information includes a random serial number of the first device, a random serial number of the second device, and a group identifier of a group to which the first device and the second device belong. The second device receives the random serial number of the second device and the group identifier from the first device, and sends the random serial number of the second device and the group identifier to the server. The server verifies that the random serial number of the second device and the group identifier from the second device match the connection credential information. If the server verifies that the random serial number of the second device and the group identifier match the connection credential information, the server establishes a second long connection with the second device.

[0267] In this way, when the first device and the second device establish a near field connection, the server can verify that the random serial number of the second device and the group identifier sent from the second device match the connection credential information based on receiving the random serial number of the first device, the random serial number of the second device, and the group identifier sent from the first device. When the server verifies the match, the second device establishes a second long connection with the first device, so that the first device and the second device realize long-distance information interaction based on the first long connection and the second long connection.

[0268] For example, the generation rule of the connection credential information can be that the first device generates a random serial number of the first device, concatenates the random serial number with a group identifier with an ampersand symbol, and obtains the connection credential information. The group identifier can be calculated by jointly performing a hash calculation on the random serial number of the first device and a random value, and the calculated hash value is the group identifier. For example, the connection credential information is the random serial number of the first device + the ampersand symbol + the group identifier. The group identifier is Hash (the random serial number of the first device + a random number). The embodiments of the present application do not limit the generation rule of the connection credential information.

[0269] The first device generates a random serial number. Then, the random serial number is concatenated with a group identifier with an ampersand symbol, thereby forming complete connection credential information. The group identifier is calculated by jointly performing a hash operation on the random serial number of the first device and a random value, and the obtained hash value is the group identifier.

[0270] In some embodiments, the first device and the second device both apply to the server for establishing a long link. The server determines the device for establishing the first long link according to the time when the first device and the second device apply to establish the long link.

[0271] In a possible implementation, the second device sends the connection credential information to the server, and the server first receives the connection credential information sent by the first device. The server first receives the connection credential information of the first device and establishes the first long link with the first device. In the case that the second device sends the credential information again, the server can establish the second long link with the second device based on the first long link with the first device, ensure the orderly remote connection of the devices, and improve the device access efficiency and system stability.

[0272] In another possible implementation, in the case that the first device and the second device establish a near-field connection, the second device establishes a second long link with the server. Since the first device and the second device establish a near-field connection, the first device can send the connection credential information to the server, so that the second device can establish the second long link with the server based on the connection credential information, and realize the remote connection of the first device and the second device. Without relying on account login, the application scenarios of device interaction are expanded.

[0273] In another possible implementation, in the case that the distance between the first device and the second device is greater than or equal to a second preset threshold, the second device establishes a second long link with the server.

[0274] In some embodiments, the long link corresponds to a set of internet protocol (IP) and port information. After the server establishes the first long link with the first device, the server saves the IP and port information corresponding to the first long link, the random serial number of the first device, the random serial number of the second device, and the group identifier, so that the server can establish the second long link with the second device according to the IP and port information corresponding to the first long link in the case of verifying a match.

[0275] In this way, in the case that the first device and the second device establish the near field communication connection, the connection relationship between the devices can be determined based on the near field communication connection. The server establishes the remote connection between the multiple devices according to the connection relationship of the near field communication connection, without relying on account login, thereby expanding the application scenarios of device interaction.

[0276] In a possible implementation, the server creates a group list according to the group identifier, and saves the IP and port information corresponding to the long link, the random serial number of the first device, the random serial number of the second device, and the group identifier into the group list.

[0277] The group identifier, the random serial number of the first device, and the random serial number of the second device are all generated by the second device. The specific forms of the group identifier and the random serial number are not limited in the embodiments of the present application. The group list is valid within a preset time length. For example, the preset time length is 30 minutes. The server creating the group list can also be referred to as the server creating a virtual group.

[0278] For example, in the case that the first device and the second device have information interaction and within the preset time length, the group list is valid. In the case that the first device and the second device have no information interaction and greater than the preset time length, the group list is invalid, and the data in the group list is emptied.

[0279] Figure 17 A flowchart of another device interaction method is shown. As shown in FIG. 6, the method includes the following steps. Figure 17As shown, the server first receives the connection credential information sent by device B (the first device), and device A and device B remotely implement animation interaction, for example, device A (the first device) and device B (the second device) respectively call their own theme engines, and start the first theme package and the second theme package. Device B calls its own theme engine, and sends the connection credential information to the server. The connection credential information includes the information of device A having a near field connection with device B. The server receives the connection credential information sent by device B, and establishes a first long link with device B. Moreover, the server obtains a group list according to the group identifier in the connection credential information. Device B calls its own theme engine, and sends the random serial number of device A and the group identifier to device A. The theme engine of device A receives the random serial number of device A and the group identifier sent by device B. Device A plays a second execution animation based on the first theme package. The theme engine of device A sends the random serial number of device A and the group identifier, and the second dynamic effect interaction information to the server. The server receives the random serial number of device A and the group identifier, and the second dynamic effect interaction information from device A. The server verifies that the random serial number of device A and the group identifier match the connection credential information. In the case of matching, device A establishes a second long link with the server, so that the first device and the second device can interact information through the first long link and the second long link. Then, device B receives the second dynamic effect interaction information forwarded by the server through the first long link, so as to realize remote theme package interaction.

[0280] In the process that device A sends the random serial number of device A and the group identifier, and the second dynamic effect interaction information to the server, it can be understood that device A applies for remote connection to the server. The random serial number of device A and the group identifier, and the second dynamic effect interaction information of device A can also be called remote connection information of device A.

[0281] Figure 18 A structural schematic diagram of device interaction is shown. As shown, Figure 18 In the case that the first device and the second device display the interface provided by the theme package, the first device and the second device can call their own theme engines, drive the collaborative framework and the software bus, discover each other through near field communication, and establish a near field communication connection. Moreover, the first device and the second device can apply for remote connection to the server, so as to achieve the purpose of remote connection through the first long link established by the first device and the server and the second long link established by the second device and the server.

[0282] In addition, in the process that the first device and the second device achieve remote connection through the first long link and the second long link, other devices can also simultaneously achieve remote connection with the first device and the second device.

[0283] In some embodiments, when the third device establishes a near field communication connection with the first device or the second device, the first device sends connection credential information 1 to the server, the connection credential information 1 including information of the third device having a near field connection with the first device. The server establishes a third long link with the third server based on the connection credential information 1. Thereafter, the first device, the second device and the third device can realize long-distance information interaction based on the first long link, the second long link and the third long link.

[0284] In a possible implementation, the server saves the random serial number of the third device into a group list, thereby establishing a third long link with the third device. The random serial number of the third device is generated by the first device.

[0285] Through the foregoing Figures 5-9 , device-to-device theme package animation synchronization can be realized; through the foregoing Figures 10-14 , device-to-device theme package interaction can be realized; through the foregoing Figures 15-17 , multi-device remote connection can be realized.

[0286] In the foregoing device interaction scheme, in a near field communication scenario, the first device and the second device can respectively play corresponding animations based on the first theme package and the second theme package installed respectively, thereby realizing multi-device theme package interaction. In a case where the first theme package and the second theme package are the same, the first device and the second device display the same animation, forming a synchronized visual effect. In a case where the first theme package and the second theme package are of the same type, the first device and the second device display different animations, and dynamic interaction of multi-device theme packages can be realized.

[0287] Compared with the prior art in which multi-devices can only realize data transmission of the same application and cannot realize theme package interaction, the device interaction method provided in the embodiments of the present application expands the interaction scenario between devices, improves the interest of interaction, improves the theme interaction experience, meets the interaction needs of users, and further increases the possibility and willingness of users to purchase theme packages.

[0288] Moreover, in a case where a device installs a theme package and the device is in an interface provided by the theme package, a user can trigger the theme package interaction capability between devices, can flexibly perform theme interaction in a scenario conforming to actual needs of the user, improves the efficiency of theme interaction between devices and the flexibility of operation, and further improves the user experience.

[0289] It can be understood that the foregoing device-to-device animation synchronization, device-to-device animation interaction and multi-device remote connection can be independently used or combined, such as being combined in any manner, without limitation.

[0290] The embodiments of the present application are also applicable to another system architecture, as shown in Figure 19The system architecture includes: application scenarios, terminal software, terminal hardware, and cloud devices. Application scenarios include, but are not limited to, multi-device synchronized video, multi-device long-distance synchronized video, and other multi-device long-distance data synchronization scenarios. Terminal software includes, but is not limited to, theme engines, framework collaboration, soft buses, and other services, providing software support and functionality for the terminal hardware. Terminal hardware includes, but is not limited to, mobile phones, tablets, personal computers, and other theme package interaction devices. Cloud devices include, but are not limited to, long-distance communication servers and other servers, responsible for data processing and communication in the cloud. Utilizing this system architecture, the technical solutions provided in this application embodiment for multi-device theme package animation synchronization, theme package interaction, and establishing remote connections between multiple devices can be realized.

[0291] This application also provides another device interaction method, which is applied to a first device. The first device can be used to execute the method or steps performed by the first device in the device interaction system provided in the above embodiments.

[0292] This application also provides another device interaction method, which is applied to a second device. The second device can be used to execute the methods or steps performed by the second device in the device interaction system provided in the above embodiments.

[0293] It is understood that, in order to achieve the above functions, the electronic device includes hardware and / or software modules that perform the respective functions. Based on the algorithmic steps of the examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is implemented in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in conjunction with the embodiments, but such implementation should not be considered beyond the scope of this application.

[0294] This embodiment can divide the electronic device into functional modules according to the above method example. For example, each function can be divided into its own functional modules, or two or more functions can be integrated into one processing module. The integrated modules can be implemented in hardware. It should be noted that the module division in this embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0295] This application also provides an electronic device, such as... Figure 20 As shown, the electronic device may include one or more processors 2001, memory 2002, and communication interfaces 2003.

[0296] The memory 2002 and the communication interface 2003 are coupled with the processor 2001. For example, the memory 2002, the communication interface 2003 and the processor 2001 can be coupled together through a bus 2004.

[0297] The communication interface 2003 is configured to perform data transmission with other devices. The memory 2002 stores computer program codes. The computer program codes include computer instructions, which, when executed by the processor 2001, cause the electronic device to perform the device interaction method in the embodiments of the present application.

[0298] The processor 2001 can be a processor or a controller, for example, a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The processor can implement or execute various exemplary logical blocks, modules and circuits described in combination with the present disclosure. The processor can also be a combination of computing functions, such as one or more microprocessor combinations, combinations of DSP and microprocessor, etc.

[0299] The bus 2004 can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus 2004 can be divided into an address bus, a data bus, a control bus, etc. For the sake of convenience, Figure 20 Only one thick line is used in the above description, but it does not mean that there is only one bus or only one type of bus.

[0300] The embodiments of the present application also provide a computer readable storage medium, which stores computer program codes. When the processor executes the computer program codes, the electronic device performs the related method steps in the above method embodiments.

[0301] The embodiments of the present application also provide a computer program product, which, when running on a computer, causes the computer to perform the related method steps in the above method embodiments.

[0302] The electronic device, the computer storage medium, or the computer program product provided in the present application are used to execute the corresponding method provided above, and thus the beneficial effects achieved thereby can refer to the beneficial effects of the corresponding method provided above, which will not be repeated here.

[0303] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above functional modules is taken as an example, and in actual application, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

[0304] In several embodiments provided in the present application, it should be understood that the disclosed device and method can be implemented by other ways. For example, the device embodiments described above are merely illustrative, for example, the division of the modules or units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another device, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units or components shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0305] The units described as separate components can or can not be physically separated, and the components shown as units can be one physical unit or multiple physical units, that is, can be located in one place, or can be distributed to multiple different places. According to actual needs, part or all of the units can be selected to achieve the purpose of the present embodiment scheme.

[0306] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0307] The integrated unit, if implemented in the form of a software function unit and sold or used as an independent product, can be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of a software product in essence or in the form of a whole or part of the technical solutions that make contributions, and the software product is stored in a storage medium, including a plurality of instructions for causing an apparatus (which can be a single-chip microcomputer, a chip, etc.) or a processor to execute all or part of the steps of the method described in the embodiments of the present application. The foregoing storage medium includes a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0308] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto, and any change or replacement within the technical scope disclosed in the present application should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A device interaction method, characterized in that, The method is applied to an interactive system, which includes a first device and a second device, wherein the first device and the second device establish a near-field connection, the first device has a first theme pack installed, the second device has a second theme pack installed, and the first theme pack and the second theme pack are associated. The first device displays a first interface, and the second device displays a second interface; the first interface and the second interface are interfaces provided by the theme package; If the triggering conditions are met, the first device and the second device will play the corresponding animations based on the first theme package and the second theme package, respectively.

2. The method according to claim 1, characterized in that, The theme package provides interfaces including lock screen, desktop, or interfaces including theme elements; wherein the theme elements include theme cards, theme icons, or theme widgets.

3. The method according to claim 1 or 2, characterized in that, The determination that the triggering condition is met includes one or more of the following: The communication signal strength between the first device and the second device is greater than or equal to a first preset threshold; or, The transmission delay between the first device and the second device is less than or equal to a second preset threshold; or, The distance between the first device and the second device is less than or equal to a third preset threshold.

4. The method according to any one of claims 1-3, characterized in that, The first device and the second device play corresponding animations based on the first theme package and the second theme package, respectively, including: Based on the first theme package and the second theme package, the first device and the second device play corresponding frames in the first animation and the second animation at the same time, respectively, and the corresponding elements on the corresponding frames have the same or corresponding actions or states.

5. The method according to claim 4, characterized in that, If the triggering condition is met, the method further includes: The first device and the second device negotiate a synchronized playback time, which is obtained based on the transmission delay between the first device and the second device. The first device and the second device simultaneously play corresponding frames from the first animation and the second animation, respectively, including: When the synchronized playback time arrives, the first device begins to synchronize the playback of the corresponding frame in the first animation, and the second device begins to synchronize the playback of the corresponding frame in the second animation.

6. The method according to claim 5, characterized in that, The first device and the second device negotiate the synchronized playback time, including: The first device and the second device negotiate the synchronization time for playback and the frame synchronization time for the corresponding frames.

7. The method according to claim 6, characterized in that, The first device and the second device negotiate the synchronization playback time and the frame synchronization time of the corresponding frames, including: The first device sends a first broadcast message, which includes the identifier information of the first theme package, the first timestamp of the first device, and the frame playback time of the corresponding frame. Upon receiving the first broadcast information, the second device obtains its second timestamp and calculates the transmission delay ΔT, which is based on the second timestamp and the first timestamp. If the second device confirms that the installed second theme package is associated with the first theme package in the first broadcast information, the second device obtains the third timestamp of the second device. The second device sends first synchronization information to the first device. The first synchronization information includes the identification information of the second theme package, the synchronization playback time, and the frame synchronization time of the corresponding frame. The synchronization playback time is the sum of the third timestamp and the offset value Δt, where Δt is greater than or equal to twice the value ΔT. The frame synchronization time is the sum of the corresponding frame playback time and Δt.

8. The method according to claim 7, characterized in that, When the synchronized playback time arrives, the first device begins to synchronize playback of the corresponding frame in the first animation, and the second device begins to synchronize playback of the corresponding frame in the second animation, including: After receiving the first synchronization information, the first device sends a first synchronization confirmation message to the second device if it confirms that the installed first theme package is associated with the second theme package in the first synchronization information. When the synchronized playback time arrives, the first device begins to synchronize the playback of the corresponding frame in the first animation of the first theme package; Upon receiving the first synchronization confirmation information, the second device begins to synchronously play the corresponding frame of the second animation in the second theme package when the synchronization playback time arrives.

9. The method according to claim 5, characterized in that, The first device and the second device negotiate the synchronized playback time, including: The first and second devices determine the master device and the slave device; The master device determines the synchronized playback time; The master device sends the synchronized playback time to the slave device.

10. The method according to claim 9, characterized in that, The first and second devices determine the master and slave devices, including: The first device sends the first broadcast information and the second device sends the second broadcast information. The device that first receives the broadcast information from the other device is the master device. The first broadcast information includes the identifier information of the first topic packet, the first timestamp of the first device, and the frame playback time of the corresponding frame. The second broadcast information includes the identifier information of the second topic packet, the timestamp of the second device, and the frame playback time of the corresponding frame. Alternatively... If the second device receives the first broadcast information sent by the first device, it will not send the second broadcast information again, and the second device is the master device; or... If the first device receives the second broadcast information sent by the second device, it will no longer send the first broadcast information, and the first device is the master device.

11. The method according to claim 8, characterized in that, When the synchronized playback time arrives, the first device begins to synchronize the playback of the corresponding frame in the first animation of the first theme package, including: If the first device has already started playing the first animation in the first theme package, then when the synchronized playback time arrives, the corresponding frame in the first animation will restart playback; or... When the first device is playing other animations or displaying the interface provided by the theme package, when the synchronized playback time arrives, it switches to synchronously playing the corresponding frame of the first animation in the first theme package.

12. The method according to any one of claims 5-11, characterized in that, The method further includes: If the playback duration of the first animation and the second animation is greater than or equal to the preset duration, the first device and the second device shall re-negotiate the synchronization time.

13. The method according to any one of claims 1-12, characterized in that, The interactive system further includes a third device, which has a third theme package installed, and the third theme package is associated with the first theme package; during the process of the first device and the second device playing corresponding animations based on the first theme package and the second theme package respectively, the method further includes: If the triggering conditions are met, based on the first theme package, the second theme package, and the third theme package, the first device, the second device, and the third device simultaneously play corresponding frames from the first animation, the second animation, and the third animation.

14. The method according to any one of claims 1-3, characterized in that, The first device and the second device play corresponding animations based on the first theme package and the second theme package, respectively, including: The first device plays a first execution animation based on the first theme package, and the second device plays a first response animation based on the second theme package. The first response animation and the first execution animation interact in a coordinated manner.

15. The method according to claim 14, characterized in that, The triggering conditions also include: the first device detecting the first triggering operation, or the preset animation on the first device completing playback.

16. The method according to claim 14 or 15, characterized in that, The second device plays a first response animation based on the second theme package, including: The second device receives first motion effect interaction information from the first device; In response to the first motion effect interaction information, the second device plays the first response animation based on the second theme package.

17. The method according to claim 16, characterized in that, The first dynamic interaction information includes the identification information of the first response animation; In response to the first motion effect interaction information, the second device plays the first response animation based on the second theme package, including: The second device determines and plays the first response animation from the second theme package based on the identification information of the first response animation.

18. The method according to claim 16, characterized in that, The first motion effect interaction information includes the identification information of the first executed animation; In response to the first motion effect interaction information, the second device plays the first response animation based on the second theme package, including: The second device determines and plays the first response animation that interacts with the first execution animation from the second theme package based on the identification information of the first execution animation.

19. The method according to claim 16, characterized in that, The first motion effect interaction information includes the motion effect segment of the first response animation; In response to the first motion effect interaction information, the second device plays the first response animation based on the second theme package, including: The second device synthesizes the motion effect clip into the second theme package and plays the motion effect clip based on the second theme package.

20. The method according to claim 16, characterized in that, The first animation interaction information is used to indicate the triggering event; In response to the first motion effect interaction information, the second device plays a first response animation based on the second theme package, including: The second device determines and plays the first response animation corresponding to the triggering event from the second theme package.

21. The method according to any one of claims 1-20, characterized in that, The method further includes: When the first device establishes a near-field connection with the second device, the first device sends connection credential information to the server and establishes a first long connection with the server; the connection credential information includes information about the second device that has a near-field connection with the first device; Based on the connection credential information, the second device establishes a second long connection with the server; The first device and the second device exchange information based on the first long link and the second long link.

22. The method according to claim 21, characterized in that, The first device is playing a corresponding frame of the first animation based on the first theme pack, and the second device is playing a corresponding frame of the second animation based on the second theme pack; The first device and the second device exchange information based on the first long link and the second long link, including: If the preset conditions are met, the first device and the second device renegotiate the synchronization playback time through the first long link and the second long link. The synchronization playback time is obtained based on the transmission delay of the first long link and the second long link. The method further includes: When the renegotiationd synchronization time arrives, the first device begins to synchronously play the corresponding frame in the first animation, and the second device begins to synchronously play the corresponding frame in the second animation.

23. The method according to claim 21, characterized in that, The first device and the second device interact with each other based on the first long link and the second long link, including: If the preset conditions are met, and the first device receives a first synchronization operation, then in response to the first synchronization operation, the first device and the second device negotiate a synchronized playback time through the first long link and the second long link, and the synchronized playback time is obtained based on the transmission delay of the first long link and the second long link. The method further includes: When the synchronized playback time arrives, the first device begins to synchronize the playback of the corresponding frame in the first animation, and the second device begins to synchronize the playback of the corresponding frame in the second animation.

24. The method according to claim 21, characterized in that, The method further includes: If the preset conditions are met, and the first device detects a first trigger operation or the preset animation on the first device is completed, the first device plays a second execution animation based on the first theme package. The first device and the second device exchange information based on the first long link and the second long link, including: The first device sends the second animation interaction information to the server through the first long connection; The second device receives the second motion effect interaction information forwarded by the server through the second long connection; The second device plays a second response animation based on the second theme package according to the second motion effect interaction information, and the second response animation interacts in coordination with the second execution animation.

25. The method according to any one of claims 22-24, characterized in that, The determination that the preset conditions are met includes one or more of the following: The communication signal strength between the first device and the second device is less than or equal to a fourth preset threshold; or, The transmission delay between the first device and the second device is greater than or equal to a fifth preset threshold; or, The distance between the first device and the second device is greater than or equal to a sixth preset threshold.

26. The method according to any one of claims 21-25, characterized in that, The connection credential information is generated by the first device, and the connection credential information includes the random serial number of the first device, the random serial number of the second device, and the group identifier of the group to which the first device and the second device belong; Before the second device establishes a second long link with the server, the method further includes: The second device receives a random serial number and a group identifier from the first device. The second device sends its random serial number and group identifier to the server; The server verifies that the random serial number and group identifier of the second device from the second device match the connection credential information.

27. The method according to any one of claims 21-26, characterized in that, The second device establishes a second long link with the server, including: When the first device establishes a near-field connection with the second device, the second device establishes the second long connection with the server; The first device and the second device exchange information based on the first long link and the second long link, including: Under the condition that the preset conditions are met, the first device and the second device exchange information based on the first long link and the second long link.

28. The method according to any one of claims 21-27, characterized in that, The second device establishes a second long link with the server, including: Under the condition that the preset conditions are met, the second device establishes the second long connection with the server.

29. The method according to any one of claims 22-28, characterized in that, Before the first device establishes the first long connection with the server, the method further includes: The second device sends the connection credential information to the server, and the server first receives the connection credential information sent by the first device.

30. The method according to any one of claims 1-29, characterized in that, The first theme pack and the second theme pack are the same theme pack or theme packs of the same category.

31. A device interaction method, characterized in that, Applied to a first device, the first device having a first theme package installed, the method includes: The first interface is displayed, which is provided by the theme package. When the triggering conditions are met, the corresponding frame in the first animation is played based on the first theme package when the synchronized playback time arrives. The synchronized playback time is also used for the second device to start playing the corresponding frame in the second animation based on the second theme package. The second device has the second theme package installed, and the first theme package and the second theme package are associated.

32. A device interaction method, characterized in that, Applied to a second device, the second device having a second theme package installed, the method includes: The second interface is displayed; the second interface is provided by the theme package. When the triggering conditions are met, the corresponding frame in the second animation is played based on the second theme package when the synchronized playback time arrives. The synchronized playback time is also used for the first device to start playing the corresponding frame in the first animation based on the first theme package. The first device has the first theme package installed, and the first theme package is associated with the second theme package.

33. An electronic device, characterized in that, include: The device includes a display screen, a memory, and one or more processors; the display screen, the memory, and the processors are coupled; wherein the display screen is used to display an interface, the memory stores computer program code, the computer program code including computer instructions, which, when executed by the processor, cause the electronic device to perform the device interaction method performed by a first device as claimed in any one of claims 1-30; or, when executed by the processor, cause the electronic device to perform the device interaction method performed by a second device as claimed in any one of claims 1-30; or, when executed by the processor, cause the electronic device to perform the device interaction method performed by a server as claimed in any one of claims 1-30.

34. A computer-readable storage medium, characterized in that, The method includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the device interaction method performed by a first device as described in any one of claims 1-30; or, when executed on an electronic device, cause the electronic device to perform the device interaction method performed by a second device as described in any one of claims 1-30; or, when executed on an electronic device, cause the electronic device to perform the device interaction method performed by a server as described in any one of claims 1-30.

35. A computer program product, characterized in that, When the computer program product is run on a computer, the computer performs the device interaction method as described in any one of claims 1-30, executed by the first device; or, when the computer program product is run on a computer, the computer performs the device interaction method as described in any one of claims 1-30, executed by the second device; or, when the computer program product is run on a computer, the computer performs the device interaction method as described in any one of claims 1-30, executed by the server.

Images