Theme interaction method and electronic device

Abstract

The present application relates to the technical field of terminals, and discloses a theme interaction method and an electronic device, capable of improving visual experience and fun experience brought by a theme interface to a user. In the present application, the electronic device can support triggering sharing and interaction of theme objects on the theme interface among a plurality of devices by means of convenient operations, achieving an inter-device theme interaction effect with high interactivity and high playability, and improving the visual experience and fun experience brought by the theme interface to the user.

Description

Thematic interactive methods and electronic devices

[0001] This application claims priority to Chinese patent application filed on January 26, 2025, with application number 202510125347.7 and entitled "Interactive Method and Electronic Device", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal technology, and in particular to a topic-based interactive method and electronic device. Background Technology

[0003] Currently, in order to improve the user experience when using electronic devices, theme applications are seeing an increasing number of rich theme interfaces. For example, some theme interfaces include three-dimensional (3D) visual objects, which can be displayed in the form of animation to enhance the fun of the theme interface.

[0004] However, current theme interfaces are mainly displayed on a single device. For example, 3D visual objects in theme applications are usually displayed based on theme resources with pre-designed animations by developers, which limits the fun experience that theme applications bring to users. Summary of the Invention

[0005] This application provides a theme-based interactive method and electronic device, which can enhance the visual experience and fun of theme applications for users, thereby improving the user experience.

[0006] To achieve the above objectives, this application adopts the following technical solution:

[0007] In a first aspect, a theme interaction method is provided, which can be applied to a first electronic device. The method includes: displaying a first theme interface including a first object; and in response to a first operation by a user on the first theme interface, sending a first message to a second electronic device, the first message including data of the first object corresponding to the first operation, the data of the first object being used by the second electronic device to display the second theme interface.

[0008] The solution provided in the first aspect above enables convenient operation to trigger the sharing and interaction of theme objects on the theme interface across multiple devices, achieving highly interactive and playable theme interaction effects between devices. For example, the first object may include, but is not limited to, one or more of the following: a doll on the first theme interface, accessories for the doll on the first theme interface, a theme image on the first theme interface, and a theme background on the first theme interface. Based on this solution, users can easily share one or more objects, such as dolls, doll accessories, theme images, and theme backgrounds, from the first theme interface of a first electronic device to a second electronic device, enhancing the visual and fun experience provided by the theme interface.

[0009] As one possible implementation, before the first message reaches the second electronic device, the method further includes: determining a first parameter based on the operation type of the first operation, wherein the first message also includes the first parameter, and the first parameter is used by the second electronic device to perform a second operation to display a second theme interface. This improves the display flexibility when exchanging theme objects between devices and meets diverse user needs.

[0010] As one possible implementation, the first operation described above is a first type of operation. Determining the first parameter based on the operation type of the first operation includes: determining the first parameter as a first value. This first parameter is used by the second electronic device to display a second theme interface by replacing objects. In this way, on the one hand, the convenience of theme sharing and interaction between devices can be further improved; on the other hand, the display flexibility when exchanging theme objects between devices can be increased, meeting the diverse needs of users.

[0011] For example, the first type of operation includes a click operation.

[0012] As one possible implementation, the first operation described above is a second type of operation. Determining the first parameter based on the operation type of the first operation includes: determining the first parameter as a second value. This first parameter is used by the second electronic device to display a second theme interface by adding a first object. In this way, on the one hand, the convenience of theme sharing and interaction between devices can be further improved; on the other hand, the display flexibility when exchanging theme objects between devices can be increased, meeting the diverse needs of users.

[0013] For example, the second type of operation includes, but is not limited to, the following operations: long press operation, drag operation, or operation of the first electronic device and the second electronic device being close together.

[0014] As one possible implementation, the method further includes: receiving data from a second object from a second electronic device, the second object belonging to the same theme category as the first object; and displaying data from the second object to create a third theme interface. This allows for convenient exchange of theme objects between devices, enhancing the visual and engaging experience of the theme interface for the user.

[0015] As one possible implementation, displaying the third theme interface based on the data from the second object includes: replacing the first object on the first theme interface with the second object to display the third theme interface; or adding the second object to the first theme interface to display the third theme interface. This improves the display flexibility when exchanging theme objects between devices and meets diverse user needs.

[0016] As one possible implementation, sending the data of the first object corresponding to the first operation to the second electronic device includes: sending the data of the first object to the second electronic device when the first unlocking condition is met; wherein meeting the first unlocking condition includes one or more of the following: completing the first task, the theme application to which the first theme interface belongs reaching the first account level, the first electronic device being a first device type, the current time meeting the first time requirement, or the second electronic device having already acquired the first object through payment. This allows for more granular management of object sharing permissions.

[0017] As one possible implementation, the method further includes: verifying the user's identity in response to the user's screen unlock operation; if the verification is successful, displaying a first animation of the first object and unlocking the first electronic device; if the verification fails, displaying a second animation of the first object and not unlocking the first electronic device. In this way, the first object on the theme interface can display corresponding animations based on whether the user's screen unlock operation is successfully verified, improving the visual and entertainment experience provided by the theme interface. For example, the first object is a doll.

[0018] As one possible implementation, the method further includes: in response to a user's blowing operation on a first object, obtaining the direction and force of the blowing operation; if the blowing force is within a first force range, displaying an animation of the first object possessing a first characteristic in the aforementioned direction; if the blowing force is within a second force range, displaying an animation of the first object possessing a second characteristic in the aforementioned direction. Thus, the first object on the theme interface can change according to the force and direction of the user's blowing operation, enhancing the visual and entertainment experience provided by the theme interface. For example, the first object is a doll.

[0019] As one possible implementation, the method further includes: responding to perceived music, identifying the rhythm of the music, and displaying a thematic animation of the first object according to the rhythm. In this way, the first object on the theme interface changes rhythmically according to the perceived music, enhancing the visual and engaging experience for the user. For example, the first object is a doll.

[0020] As one possible implementation, the above-mentioned display of the first theme interface includes: displaying the first theme interface after real-time simulation and rendering based on the theme package of the first theme interface; wherein, the theme package of the first theme interface is generated based on the user's custom operations on the theme interface, and the custom operations include setting one or more of the following operations for the doll on the first theme interface: accessories, actions, and expressions. Thus, by supporting users to customize one or more of the doll's actions, expressions, accessories, etc. on the theme interface, and performing real-time simulation and rendering of the doll based on the user's customization, the visual and entertainment experience provided by the theme interface can be improved.

[0021] Secondly, a theme interaction method is provided, which can be applied to a second electronic device. The method includes: displaying a fourth theme interface; receiving a first message from a first electronic device, the first message including data of a first object; and displaying the second theme interface based on the data of the first object.

[0022] The solution provided in the second aspect above allows the second electronic device to change the displayed theme interface based on the data shared by the first electronic device, achieving highly interactive and playable inter-device theme interaction effects. For example, the first object may include, but is not limited to, one or more of the following: a doll in the first theme interface, accessories for the doll in the first theme interface, a theme image for the first theme interface, and a theme background for the first theme interface. Based on this solution, users can easily share one or more objects, such as dolls, doll accessories, theme images, and theme backgrounds, from the first theme interface of the first electronic device to the second electronic device according to their actual needs, enhancing the visual and fun experience provided by the theme interface.

[0023] As one possible implementation, the first message also includes a first parameter, and the second theme interface is displayed based on the data of the first object, including: displaying the second theme interface based on the data of the first object, referring to the first parameter and the objects included on the fourth theme interface. This allows for changes to the theme interface based on actual circumstances, improving display flexibility during theme interaction between devices and meeting diverse user needs.

[0024] As one possible implementation, the first parameter is a first value, and the data displayed based on the first object shows the second theme interface. This includes: replacing the second object on the fourth theme interface with the first object, displaying the second theme interface, where the fourth theme interface includes the second object, and the first and second objects belong to the same theme category. This improves the display flexibility during theme interaction between devices and meets diverse user needs.

[0025] As one possible implementation, the first parameter is the second value, and the data displayed based on the first object shows the second theme interface, including: adding the first object to the fourth theme interface and displaying the second theme interface. This improves the display flexibility during theme interaction between devices and meets diverse user needs.

[0026] As one possible implementation, the above-mentioned display of the second theme interface based on the first object's data includes: displaying the second theme interface based on the first object's data when the second unlocking condition is met. The second unlocking condition includes one or more of the following: completing the second task; the theme application to which the fourth theme interface belongs reaching the second account level; the second electronic device being the second device type; the current time meeting the second time requirement; or the second electronic device having already acquired the first object through payment; the fourth theme interface and the first theme interface being the same theme; or receiving a user's object change operation. This allows for more granular management of theme change permissions.

[0027] As one possible implementation, the method further includes sending data of a second object to a first electronic device, the data of which is used by the first electronic device to display a third theme interface. In this way, the visual and engaging experience of the theme interface can be improved through theme object exchange.

[0028] Thirdly, a theme interaction method is provided, the method comprising: a first electronic device displaying a first theme interface, the first theme interface including a first object; in response to a first operation by a user on the first theme interface, the first electronic device sending a first message to a second electronic device, the first message including data of the first object corresponding to the first operation; and the second electronic device displaying a second theme interface based on the data of the first object.

[0029] The solution provided in the third aspect above enables convenient operation to trigger the sharing and interaction of theme objects on the theme interface across multiple devices. The recipient can change the display of the theme interface based on the data shared by the sharer, achieving highly interactive and playable theme interaction effects between devices. For example, the first object may include, but is not limited to, one or more of the following: a doll in the first theme interface, accessories for the doll in the first theme interface, a theme image of the first theme interface, and a theme background of the first theme interface. Based on this solution, users can conveniently share one or more objects, such as dolls, doll accessories, theme images, and theme backgrounds, from the first theme interface of a first electronic device to a second electronic device, improving the visual and entertainment experience provided by the theme interface.

[0030] As one possible implementation, before the first electronic device sends the first message to the second electronic device, the method further includes: the first electronic device determining a first parameter based on the operation type of the first operation and sending the first parameter to the second electronic device; the second electronic device performing a second operation based on the data of the first object, referring to the first parameter and the objects included on the fourth theme interface, and displaying the second theme interface. This improves the display flexibility when exchanging theme objects between devices and meets diverse user needs.

[0031] As one possible implementation, the first operation described above is a first type of operation. The first electronic device determines a first parameter based on the operation type of the first operation, including: the first electronic device determines the first parameter as a first value; the second electronic device performs a second operation based on the data of the first object, referring to the first parameter and the objects included on the fourth theme interface, and displays the second theme interface, including: the second electronic device replaces the second object on the fourth theme interface with the first object based on the first value, and displays the second theme interface, where the fourth theme interface includes the second object, and the first object and the second object belong to the same theme category. In this way, on the one hand, the convenience of theme sharing and interaction between devices can be further improved, and on the other hand, the display flexibility when exchanging theme objects between devices can be increased, meeting the diverse needs of users.

[0032] For example, the first type of operation includes a click operation.

[0033] As one possible implementation, the aforementioned first operation is a second type of operation. The first electronic device determines the first parameter based on the operation type of the first operation, including: the first electronic device determines the first parameter as a second value; the second electronic device performs a second operation based on the data of the first object, referring to the first parameter and the objects included on the fourth theme interface, and displays the second theme interface, including: the second electronic device adds the first object to the fourth theme interface according to the second value, and displays the second theme interface. In this way, on the one hand, the convenience of theme sharing and interaction between devices can be further improved, and on the other hand, the display flexibility when exchanging theme objects between devices can be increased, meeting the diverse needs of users.

[0034] For example, the second type of operation includes, but is not limited to, the following operations: long press operation, drag operation, or operation of the first electronic device and the second electronic device being close together.

[0035] As one possible implementation, the method further includes: a second electronic device sending data of a second object to a first electronic device; and the first electronic device displaying the data of the second object on a third theme interface. This enables the exchange of theme objects between devices, improving the visual and engaging experience of the theme interface for the user.

[0036] Fourthly, a first electronic device is provided, the device comprising: a display screen for displaying an interface; a transceiver for communicating with other devices; a memory for storing computer program instructions; and a processor for executing the computer program instructions to support the first electronic device in implementing the methods as described in any possible implementation of the first aspect.

[0037] Fifthly, a second electronic device is provided, the device comprising: a display screen for displaying an interface; a transceiver for communicating with other devices; a memory for storing computer program instructions; and a processor for executing the computer program instructions to support the second electronic device in implementing the methods of any possible implementation of the second aspect.

[0038] Sixthly, a thematic interactive system is provided, the system comprising a first electronic device and a second electronic device, wherein the first electronic device is used to implement the method as in any possible implementation of the first aspect, and the second electronic device is used to implement the method as in any possible implementation of the second aspect.

[0039] In a seventh aspect, a readable storage medium is provided, on which program instructions are stored, which, when executed by a device, can implement the methods as in any possible implementation of the first or second aspect.

[0040] Eighthly, a program product containing instructions is provided that, when the program product is run on a device, causes the device to perform a method as in any possible implementation of the first or second aspect.

[0041] A ninth aspect provides a chip system including processing circuitry and a storage medium storing program instructions; when executed by the processing circuitry, the program instructions can implement the methods described in any possible implementation of the first or second aspect. The chip system may be composed of chips or may include chips and other discrete devices. Attached Figure Description

[0042] Figure 1 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application;

[0043] Figure 2 is a schematic diagram of several scenarios for displaying theme interfaces provided in the embodiments of this application;

[0044] Figure 3 is a schematic diagram of a system architecture for displaying a theme interface according to an embodiment of this application;

[0045] Figure 4 is a flowchart of a topic interaction method provided in an embodiment of this application;

[0046] Figure 5 is a schematic diagram of the theme object on the theme interface provided in the embodiment of this application;

[0047] Figure 6 is a schematic diagram of the data structure of a first object provided in an embodiment of this application;

[0048] Figure 7A is a schematic diagram of a theme interface in a theme interaction scenario between devices provided in an embodiment of this application;

[0049] Figure 7B is a schematic diagram of a theme interface in another scenario of theme interaction between devices provided in an embodiment of this application;

[0050] Figure 8 is a schematic diagram of the real-time rendering process of a human-computer interactive scene provided in an embodiment of this application;

[0051] Figure 9 is a flowchart of a method for displaying a theme interface based on user interaction with a doll, according to an embodiment of this application.

[0052] Figure 10 is a flowchart of a method for displaying a theme interface based on user interaction with a doll in a blowing scenario, according to an embodiment of this application.

[0053] Figure 11 is a flowchart of a method for displaying a theme interface based on user interaction with a doll in a game scene according to an embodiment of this application;

[0054] Figure 12 is a flowchart of a context-aware theme interface display method provided in an embodiment of this application;

[0055] Figure 13 is a schematic diagram of a real-time simulation, rendering and display of a user-defined theme provided in an embodiment of this application;

[0056] Figure 14 is a flowchart of a method for displaying a user-defined theme interface according to an embodiment of this application. Detailed Implementation

[0057] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in this text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0058] In the following text, the terms "first," "second," etc., are used only to distinguish different descriptive objects and do not limit the position, order, priority, quantity, or content of the described objects. For example, if the described object is an "object," then the ordinal number before "object" in "first object" and "second object" does not limit the position or order of the "objects," nor does "first" and "second" limit whether the "objects" they modify are in the same theme interface. Similarly, if the described object is a "theme interface," then the ordinal number before "theme interface" in "first theme interface" and "second theme interface" does not limit the priority of the "theme interfaces." Furthermore, the number of described objects is not limited by ordinal numbers and can be one or more; for example, in "first electronic device," the number of "electronic devices" can be one or more. In addition, objects modified by different prefixes can be the same or different. For example, if the described object is "electronic device," then "first electronic device" and "second electronic device" can be devices of the same type or different types. Similarly, if the described object is an "object," then "first object" and "second object" can be the same object or different objects. In summary, the use of ordinal numbers and other prefixes used to distinguish the described objects in the embodiments of this application does not constitute a limitation on the described objects. The description of the described objects is given in the claims or the context of the embodiments, and the use of such prefixes should not constitute an unnecessary limitation.

[0059] Furthermore, in the embodiments of this application, "connection" can be a direct connection or an indirect connection; in addition, it can refer to an electrical connection or a communication connection; for example, the connection of two electrical components A and B can refer to A and B being directly connected, or it can refer to A and B being indirectly connected through other electrical components or connection media, or it can refer to A and B being indirectly connected through other communication devices or communication media, as long as it enables communication between A and B.

[0060] Currently, to enrich the visual experience and fun that theme applications bring to users, the variety of theme elements that theme applications can provide on the theme interface is becoming increasingly diverse. For example, theme elements may include, but are not limited to, dolls, accessories, theme backgrounds, etc. Dolls may include, but are not limited to, plush toys, cartoon dolls, etc.

[0061] In some embodiments, to enhance the visual and entertainment experience of the theme interface, the theme application may provide a variety of accessories for users to decorate the dolls in the theme interface; and / or, the theme application may provide a variety of vivid and expressive skeletal animations and / or facial animations for users to customize the dolls in the theme, or for the device to display the doll's skeletal animations and / or facial animations according to specific scenarios.

[0062] To further enhance the visual experience and enjoyment of theme applications for users, this application provides a theme interaction method that supports theme interaction between devices and / or user interaction with themes on the device, thereby increasing the social fun of themes.

[0063] In some embodiments of this application, the first electronic device can support users sharing all or part of the theme objects on the theme interface to a second electronic device. For example, the first electronic device can identify the first object that the user wants to share based on the user's sharing operation, and send the data of the first object to the second electronic device for the second electronic device to modify the theme interface on the second electronic device. Based on this, highly interactive and playable inter-device theme interaction can be achieved, improving the visual and fun experience brought to users by the theme interface.

[0064] For example, the first object shared by the first electronic device to the second electronic device may include, but is not limited to, one or more of the following: dolls, accessories, theme images, theme packs, theme backgrounds, etc.

[0065] In some embodiments of this application, the electronic device can support user interaction with a doll on a themed interface. For example, the electronic device can support one or more vivid changes in the doll's actions, expressions, accessories, etc., based on the user's screen unlocking operation, eye gaze, blowing air, etc.; furthermore, the electronic device's themed application can support providing users with a game experience related to the doll, using the doll as intellectual property (IP). Based on this, a highly interactive and playable themed interface display can be achieved, improving the visual and entertainment experience provided by the themed interface to the user.

[0066] In some embodiments of this application, the electronic device can support the doll's awareness of context. For example, the electronic device can support the doll on the theme interface to make one or more vivid changes in movement, expression, accessories, theme background, etc., in sync with the rhythm of music. Based on this, a highly interactive and playable theme interface display can be achieved, improving the visual and fun experience brought to the user by the theme interface.

[0067] As an example, the electronic device described in this application may include, but is not limited to, smartphones, netbooks, tablets, smart drawing tablets, handwriting tablets, smartwatches, smart bracelets, phone watches, smart glasses, smart cameras, PDAs, in-vehicle computers, vehicle infotainment systems, personal computers (PCs), personal digital assistants (PDAs), portable multimedia players (PMPs), augmented reality (AR) / virtual reality (VR) devices, smart TVs, projection devices, or motion-sensing game consoles in human-computer interaction scenarios, etc., devices with display functions. Alternatively, the electronic device may also be other types or structures of electronic devices, which are not limited in this application.

[0068] As an example, please refer to Figure 1, which shows a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.

[0069] As shown in Figure 1, the electronic device includes a processor 110, a memory (including an external memory interface 120 and an internal memory 121), a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator light 192, a camera 193, a display screen 194, etc.

[0070] The processor 110 includes one or more processing units. For example, the processor 110 may include an application processor (AP), a microcontroller unit (MCU), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. For example, the application processor may include a graphics processor and a digital signal processor, and the microcontroller unit may include a graphics processor.

[0071] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0072] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0073] In some embodiments of this application, the processor 110 can identify one or more first objects, such as dolls, accessories, theme images, theme packs, and theme backgrounds, that the user wants to share based on the user's operation of sharing theme objects, so as to send the data of the first object to the second electronic device.

[0074] In some embodiments of this application, the processor 110 can generate a custom theme package based on the user's custom operations on the doll on the theme interface.

[0075] In some embodiments of this application, the processor 110 can make one or more vivid changes to the doll's movements, expressions, accessories, theme background, etc., based on the user's screen unlocking operation, eye gaze, blowing air, etc., thereby improving the visual and fun experience brought to the user by the theme interface.

[0076] The wireless communication function of the electronic device can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0077] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0078] The wireless communication module 160 can provide solutions for wireless communication applications in electronic devices, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), and intrabody communication (IBC). The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0079] In some embodiments of this application, antenna 1 of the electronic device is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling the electronic device to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, IR technology, and / or IBC technology, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0080] Display 194 includes a display panel. As an example, the display panel may be a low-temperature polycrystalline silicon (LTPS) display, a low-temperature polycrystalline oxide (LTPO) display, a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) display, a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc.

[0081] In this application embodiment, the electronic device may include one or more displays 194.

[0082] Electronic devices implement display functions through GPUs, displays 194, application processors, microcontrollers, etc. A GPU is a microprocessor for image processing, connected to the display 194, application processor, and microcontroller. The GPU performs mathematical and geometric calculations for drawing, rendering, or compositing graphics. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0083] In some embodiments of this application, the electronic device can implement the theme interface through AP, GPU, etc., such as the related processing of the theme interface including dolls, accessories, etc., and display the theme interface through the display screen 194.

[0084] Electronic devices can perform shooting functions through ISP, camera 193, video codec, GPU, display 194, and application processor. In this application, camera 193 may include a front-facing camera of the electronic device, which may be an optical zoom lens, etc., and this application is not limited thereto.

[0085] In some embodiments, the ISP may be set in the camera 193, but this application does not limit this.

[0086] Camera 193 is used to capture still images or videos. An object passes through the lens, generating an optical image that is projected onto a photosensitive element. This photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to the ISP (Image Signal Processor) for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP (Digital Signal Processor) for processing. The DSP converts the digital image signal into standard RGB (red, green, blue) image signals, YUV, or other formats.

[0087] In some embodiments of this application, the camera 193 can be used to detect the area of ​​the user's gaze in order to enable electronic devices to enable interaction between the doll and the user based on the area of ​​the user's gaze.

[0088] The sensor module 180 includes a touch sensor 180A and a pressure sensor 180B. In some embodiments, the sensor module 180 may also include, but is not limited to, one or more of the following: a temperature sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer, a distance sensor, a proximity sensor, a fingerprint sensor, an ambient light sensor, a bone conduction sensor, etc.

[0089] Touch sensor 180A, also known as a "touch device," can be located on display screen 194. The touch sensor 180A and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180A detects touch operations applied to or near it. Touch sensor 180A can transmit the detected touch operation to processor 110 (e.g., application processor, microcontroller unit) to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180A may also be located at a different location than display screen 194.

[0090] Pressure sensor 180B is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two electrodes; when a force is applied to the capacitive pressure sensor, the capacitance between the electrodes changes. The electronic device determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, the electronic device can detect the intensity of the touch operation through the pressure sensor. The electronic device can also calculate the touch position based on the detection signal from pressure sensor 180B. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS message is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS message is executed.

[0091] In this embodiment, the sensor module 180, such as touch sensor 180A and / or pressure sensor 180B, can be used to detect one or more of the following user operations: user screen unlocking operation, user-customized theme operation, blowing operation, triggering theme interaction between devices, etc.

[0092] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external memory interface 120 to perform data storage functions.

[0093] Internal memory 121 may include one or more random access memory (RAM) and one or more non-volatile memory (NVM). The RAM can be directly read and written by the processor 110 and can be used to store executable programs (e.g., machine instructions) of the operating system or other running programs, as well as user and application data. The NVM can also store executable programs and user and application data, and can be pre-loaded into the RAM for direct read and write operations by the processor 110.

[0094] In this embodiment, the external storage card and / or internal memory 121 can be used to store theme resources, such as theme packs.

[0095] Electronic devices can perform audio functions such as music playback and recording through audio modules 170, speakers 170A, receivers 170B, microphones 170C, and access points (APs).

[0096] In some embodiments of this application, the audio module 170, the speaker 170A, and the AP, etc., can support electronic devices to play rhythmic music and analyze music rhythm, etc.

[0097] In some embodiments of this application, the audio module 170, microphone 170C, and AP, etc., can support electronic devices in sensing and analyzing music in the environment and recognizing the rhythm of the music.

[0098] For a description of the charging management module 140, power management module 141, battery 142, motor 191, indicator light 192, etc. shown in Figure 1, please refer to conventional technology; it will not be elaborated here.

[0099] The structure illustrated in Figure 1 of this application does not constitute a specific limitation on the electronic device. In other embodiments of this application, the electronic device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0100] The solution provided in this application can be applied to, but is not limited to, the theme interface display process in scenarios such as the lock screen scene, desktop scene, and always-on display (AOD) scene shown in Figure 2. The doll shown in Figure 2 is merely an example, and this application does not limit the specific type or style of the doll.

[0101] As an example, please refer to Figure 3, which shows a schematic diagram of a system architecture for displaying a theme interface according to an embodiment of this application. As shown in Figure 3, the system architecture includes a resource management module 310, an interaction module 320, a theme engine module 330, a graphics engine module 340, and a display module 350.

[0102] Among them, the resource management module 310 is mainly responsible for the management of topic resources.

[0103] In some embodiments of this application, the theme resource may include one or more theme packages under a default scene. For example, the default scene may include a high-frequency scene, and the theme package under the default scene may include pre-rendered videos.

[0104] In some embodiments of this application, the theme resource may include one or more user-defined theme packages for custom scenarios. For example, a theme package may be a domain-specific language (DSL) package.

[0105] As an example, a theme package (such as a theme package for a default scene, a theme package for a custom scene, etc.) may include, but is not limited to, the following: the doll's image resources, accessory collection, the positional relationship and size of the accessories and the doll, skeletal node matching information, the doll's hair physical parameters, the doll's animation, and environmental physical parameters.

[0106] The doll's image resources may include, but are not limited to, one or more of the following: body mesh, body texture, body skeleton skinning, face skinning, hair geometry mesh, hair material, etc. For example, the file format of the doll's image resources may include, but is not limited to, .glb file format. For example, there may be multiple sets of the doll's image resources, such as 4×n sets (n is a positive integer). For instance, the resource management module 310 may manage multiple sets of image resources using different .glb files.

[0107] The accessory set may include, but is not limited to, one or more of the following accessories: hats (such as baseball caps, beanies, berets, etc.), glasses, earrings (studs, earrings, ear drops, etc.), headwear (such as hair clips, headbands, etc.), headphones, etc., without limitation. A certain type of accessory may include accessories of different styles / types / colors / patterns, etc. For example, hats may include hats of different styles such as sweet, cool, and cozy, or hats of different styles such as baseball caps, beanies, and berets, or hats of different styles such as red, yellow, and pink. This application embodiment does not impose any limitations. Exemplarily, the file format of the accessory set may include, but is not limited to, the .glb file format. Exemplarily, there may be multiple accessory sets, such as 4×m sets (m is a positive integer). For example, the resource management module 310 may manage multiple accessory sets using different .glb files.

[0108] The positional relationship and size of accessories and dolls may include one or more positional relationships between accessories and dolls and the corresponding accessory size.

[0109] The skeletal node pairing information may include one or more positional relationships between the skeletal nodes of the doll. For example, there may be multiple sets of skeletal node pairing information, such as 4×4×s (where s is a positive integer).

[0110] The physical parameters of the doll's fur may include, but are not limited to, one or more of the following: stiffness, damping, etc. For example, stiffness may include, but is not limited to, global stiffness, local stiffness, or one or more other parameters. For example, the file format of the fur physical parameters may include, but is not limited to, .xml file format. For example, there may be multiple sets of fur physical parameters, such as k sets (k is a positive integer greater than 1). For example, the fur physical parameters in the theme package may be in floating-point number format.

[0111] The animation of the doll may include one or more of the following: skeletal animation, facial expression animation, etc. For example, the file format of the animation may include, but is not limited to, .xml file format. For example, the doll may have one or more sets of animations, such as h sets (h is a positive integer); for cases with multiple sets of animations, the resource management module 310 may manage these multiple sets of animations using different .xml files.

[0112] Environmental physical parameters may include, but are not limited to, one or more of the following: gravity magnitude, wind direction, wind magnitude, etc. For example, the file format of environmental physical parameters may include, but is not limited to, .xml file format. For example, environmental physical parameters in a theme package may be in floating-point number (float) format.

[0113] In some embodiments of this application, the theme package under the default scenario (hereinafter referred to as "preset theme package") may be a theme package that theme developers pre-design fixed actions according to the needs of some default scenarios, pre-process (pre-bake) the theme resources according to the pre-designed fixed actions, package the theme resources into a theme package and store it in the electronic device, and the theme package is managed by the resource management module 310.

[0114] In some embodiments of this application, a custom theme package (hereinafter referred to as "custom theme package") may be a new theme package generated and stored in the electronic device by modifying one or more parameters such as image resources, accessories, hair physical parameters, animation, and environmental physical parameters in a preset theme package based on the user's custom theme operation. The theme package is managed by the resource management module 310.

[0115] In some embodiments of this application, a custom theme package may be a theme package generated and stored in the electronic device by the electronic device based on one or more parameters such as image resources, accessories, hair physical parameters, animation, and environmental physical parameters, and managed by the resource management module 310.

[0116] As an example, the theme package may be located in the resource management module 310 as multiple folder directories. Exemplarily, the theme package may include, but is not limited to, the following folders: aod folder, home folder, i18n folder, lock folder, long_take folder, personalize folder, preview folder, etc.

[0117] The folder is divided into several sections: aod folder (primarily used to store files related to the always-on display interface, such as, but not limited to, AOD images); home folder (primarily used to store main directory files, such as, but not limited to, personal documents, settings, etc.); i18n folder (primarily used to store files related to software internationalization, such as, but not limited to, multilingual support, translation files, etc.); lock folder (primarily used to store files related to screen lock, security, or encryption, etc.); long_take folder (may be used to store media files captured or recorded over a long period, such as, but not limited to, animations); personalize folder (primarily used to store files related to personalization settings, user-defined configurations, or themes, etc.); and preview folder (primarily used to store files for preview versions, temporarily generated preview images, or videos, etc.).

[0118] Optionally, the theme package may also include a description file, which records notes and / or descriptions related to the theme package. For example, the format of the description file may include, but is not limited to, a .json file.

[0119] The interaction module 320 is mainly used to support topic interaction between devices and / or support user interaction with topics on the device.

[0120] In some embodiments, the interaction module 320 may include a touchscreen for supporting user interaction between devices and / or user interaction with themes on the device through touch operations on the touchscreen. For example, the touchscreen may allow users to trigger the sharing of a first object to other electronic devices by performing touch operations on the touchscreen to share the theme object. As another example, the touchscreen may allow users to customize themes through a theme editing interface displayed on the touchscreen. Exemplarily, the theme editing interface may be provided by a theme editor, such as a unified theme editor that provides users with theme interface display and theme customization operations.

[0121] As an example, custom theme operations may include, but are not limited to, one or more of the following: theme deletion, theme modification, theme addition, etc. For example, theme modification may include, but are not limited to, modifying one or more of the theme background, theme filters, doll type, doll accessories, doll skeletal animation, doll facial animation, etc.; theme addition may involve first selecting the theme background, theme filters, doll, doll accessories, skeletal animation, facial animation, etc., and then triggering the generation of a new theme package (i.e., a custom theme package).

[0122] In some embodiments, the interaction module 320 may include a microphone for supporting user-to-device interaction and / or user-to-themes interaction on the device. For example, the microphone may allow the user to trigger the sharing of a first object to other electronic devices by inputting a voice command for sharing the theme object. Alternatively, the microphone may allow the user to interact with a doll on the theme interface through actions such as blowing air and / or support the electronic device for music sensing, etc.

[0123] In some embodiments, the interaction module 320 may include sensors for supporting topic interaction between devices and / or user interaction with topics on the device via device movement. For example, the sensor may enable a user to trigger the sharing of a topic object to other devices via device movement. Exemplarily, the sensor may include, but is not limited to, a temperature sensor, an inertial measurement unit (IMU), such as an accelerometer or a gyroscope.

[0124] In some embodiments, the interaction module 320 may include a screen unlocking module for supporting user screen unlocking. For example, the unlocking module may include, but is not limited to, one or more of a fingerprint unlocking module, a swipe unlocking module, a facial unlocking module, and a password unlocking module.

[0125] In some embodiments, the interaction module 320 may include a user gaze region detection module for supporting interaction with the doll on the theme interface based on the user's gaze region. For example, the user gaze region detection module may include, but is not limited to, a camera.

[0126] The theme engine module 330 is mainly used for system signal analysis, interactive logic implementation, and DSL analysis.

[0127] In some embodiments, the theme engine module 330 can trigger real-time simulation and rendering of the theme interface based on user-shared theme object operations, human-computer interaction operations, or interactive signals corresponding to perceived contexts.

[0128] For example, human-computer interaction operations may include, but are not limited to, one or more of the following: touch operation, breath operation, screen unlock operation, eye gaze operation, theme interface / theme element sharing operation, and the perceived context may include, but are not limited to, one or more of the following: perceived temperature, music, etc.

[0129] In some embodiments, the theme engine module 330 can trigger real-time simulation and rendering of the theme interface based on system signals corresponding to the operation of the user-defined theme.

[0130] In some embodiments, the theme engine module 330 can also be used for scene management. Scene management may include, but is not limited to, the management of theme interaction scenes between devices, human-computer theme interaction scenes (such as unlocking scenes, blowing scenes, game scenes, etc.), and custom theme scenes.

[0131] In some embodiments, the theme engine module 330 may also be used to extend the UI interface, such as embedding new interface elements or functions into the theme interface or extending existing interface capabilities, without limitation.

[0132] The graphics engine module 340 is mainly used for real-time simulation and rendering of the theme interface, including real-time simulation and rendering of the dolls in the theme interface, where the theme interface may be a preset theme interface or a custom theme interface.

[0133] In some embodiments, as shown in FIG3, the graphics engine module 340 includes a physics engine module, an AGP3D module, and a rendering module. The physics engine module is mainly responsible for the simulation of the theme interface; the AGP3D module is mainly responsible for the parsing and driving of the theme interface; and the rendering module is mainly responsible for computationally intensive tasks such as the compositing and rendering of elements on the theme interface, the generation of the display interface, and video encoding.

[0134] As an example, the AGP3D module can send the processing results to the rendering module (such as a render server) for compositing and rendering. After the rendering module completes the compositing and rendering of the theme interface, it sends the rendering results to the display module 350 for display. For example, the rendering module can send the rendering results to the display module 350 for display by calling the display driver.

[0135] Display module 350 is primarily responsible for interface display, including displaying the main interface. Display module 350 may be implemented using a combination of software and hardware; for example, it may consist of a display driver and a display screen.

[0136] The structure illustrated in Figure 3 of this application does not constitute a specific limitation on the system architecture used to implement the theme interface display. In other embodiments of this application, the system architecture may include more or fewer modules than illustrated, or combine certain gate modules, or split certain modules, or have different module arrangements. The illustrated modules may be implemented in hardware, software, or a combination of software and hardware.

[0137] For example, in some embodiments, as shown in Figure 3, the system architecture used to implement the theme interface display may also include an engine adaptation module, which provides rendering adaptation components (such as XComponent, Component3D, etc.) to meet more complex custom rendering requirements.

[0138] For example, in some embodiments, as shown in FIG3, the system architecture for implementing the theme interface display may also include a high-level graphics capability platform, such as basic advanced feature interfaces, for enabling the theme engine module 330 to supply capabilities to the graphics engine module 340.

[0139] For example, in some embodiments, the system architecture used to implement the display of the theme interface may also include one or more other modules such as an audio module, a camera module, or a sensor module.

[0140] The specific module settings for the system architecture can be adapted by taking into account the device capabilities and supported scenarios.

[0141] The following will provide a detailed description of the interactive methods provided in the embodiments of this application, using specific examples.

[0142] As an example, please refer to Figure 4, which shows a flowchart of a topic interaction method provided by an embodiment of this application. As shown in Figure 4, the topic interaction method provided by this embodiment can be implemented through S401-S404:

[0143] S401: The first electronic device displays a first theme interface, which includes a first object.

[0144] As an example, the first theme interface may be the theme interface in scenarios such as lock screen, desktop, and AOD. For example, the first theme interface may be the interface shown in Figure 2, without limitation.

[0145] In some embodiments, the first theme interface is a static theme interface.

[0146] In some embodiments, the first theme interface is a dynamic theme interface. For example, the background and / or dolls on the first theme interface are presented with animated effects.

[0147] As an example, the first theme interface is displayed by the electronic device based on a preset theme package. The preset theme package consists of fixed actions pre-designed by theme developers based on the needs of some default scenarios (such as high-frequency scenarios). The theme resources are obtained by pre-processing based on the pre-designed fixed actions, and then packaged into a theme package and stored in the electronic device.

[0148] As an example, the first theme interface is displayed by the electronic device based on a custom theme pack, such as one previously customized by the user.

[0149] For example, the theme package corresponding to the first theme interface may include, but is not limited to, the following: the doll's image resources, accessory collection, the positional relationship and size between the accessories and the doll, skeletal node matching information, the doll's hair physical parameters, the doll's animation, and environmental physical parameters in the first theme interface.

[0150] As one possible implementation, if the theme package corresponding to the first theme interface is a preset theme package, the electronic device can display the corresponding pre-rendered video (i.e., the first theme interface) according to the preset theme package.

[0151] As one possible implementation, when the theme package corresponding to the first theme interface is a custom theme package, when displaying the first theme interface, the electronic device can perform DSL parsing on the theme package corresponding to the first theme interface, load and bind the corresponding accessories and other resources according to the parsing results, dynamically update visible objects, dynamically load other additional resources in the theme, and then perform real-time simulation and rendering of the doll in the first theme interface, and display the first theme interface according to the rendering results.

[0152] S402: The first electronic device receives the user's first operation on the first theme interface.

[0153] As an example, the first operation is the operation of sharing a theme object, which is used to share a theme object on the first theme interface, such as the first object, to a second electronic device.

[0154] In some embodiments, the first object includes all theme objects on the first theme interface. For example, the first object includes theme packs and / or theme images on the first theme interface.

[0155] In some embodiments, the first object includes a portion of the theme object on the first theme interface. For example, the first object includes one or more of the following in the first theme interface: dolls, accessories, theme backgrounds, etc.

[0156] The embodiments of this application do not limit the specific intent of the first operation, and can be determined according to user needs.

[0157] As an example, the first operation may include, but is not limited to, any of the following operations: clicking on the first object (such as single-click, double-click, etc.), long-pressing the first object, dragging the first object, clicking and then dragging the first object, and long-pressing and then dragging the first object. Alternatively, the first operation may include, but is not limited to, gesture operations, body movements, etc., or the first operation may also be other forms of operation such as voice commands, facial expression commands, etc., which are not limited in the embodiments of this application.

[0158] As an example, the first operation might be the operation of a first electronic device moving close to another electronic device, such as a second electronic device; or the first operation might be the operation of another electronic device, such as a second electronic device, moving close to a first electronic device. For instance, the first operation might be the operation of the first electronic device "touching" the second electronic device.

[0159] Taking the first theme interface as shown in Figure 5 as an example, the first operation may be used to share one or more of the dolls, accessories, theme backgrounds, theme images, etc. on the interface 500, and / or, the first operation may be used to share one or more of the theme package, interface images (i.e. theme images), etc. on the interface 500.

[0160] S403: The first electronic device sends the data of the first object corresponding to the first operation to the second electronic device.

[0161] As one possible implementation, the first electronic device can send a first message to the second electronic device, the first message including data of the first object corresponding to the first operation.

[0162] As one possible implementation, the first electronic device can determine the first object corresponding to the first operation based on the operation information of the first operation, obtain the data of the first object, and send the data of the first object to the second electronic device.

[0163] The first object corresponding to the first operation may include, but is not limited to, one or more of the following: the theme package of the first theme interface, the doll in the first theme interface, the accessories of the doll in the first theme interface, the theme image of the first theme interface, and the theme background of the first theme interface.

[0164] As one possible implementation, taking a first operation as an example, such as a click operation, a long press operation, or a drag operation, the first electronic device can determine the first object corresponding to the first operation based on the position of the object operated on by the first operation.

[0165] For example, assuming the first operation is a user's click (such as a single click, double click, etc.), long press, or drag operation at the position of the doll's torso on the first theme interface, the first electronic device can determine that the first object is a doll based on the position of the object operated on by the first operation.

[0166] For example, suppose the first operation is a user's click operation (such as a single click, double click, etc.), long press operation, or drag operation on the doll's accessories on the first theme interface, the first electronic device can determine that the first object is the doll's accessories based on the position of the object operated on in the first operation.

[0167] For example, suppose the first operation is a user's click operation (such as a single click, double click, etc.), long press operation, or drag operation on the background element of the first theme interface, the first electronic device can determine that the first object is the theme background of the first theme interface based on the position of the operation object of the first operation.

[0168] For example, assuming the first operation is a click (such as a single click, double click, etc.), long press, or drag operation by the user in a blank space on the first theme interface, or at a preset position such as the top / bottom, the first electronic device can determine that the first object is the theme package and / or theme image of the first theme interface based on the position of the object of the first operation.

[0169] As one possible implementation, taking a first operation such as a body movement or facial expression command as an example, the first electronic device pre-stores a mapping relationship between different first operations and operation commands. The first electronic device can determine the operation command corresponding to the first operation from this mapping relationship, and determine the first object based on the operation command. For example, this mapping relationship may be based on the device's default settings or created based on the user's custom settings.

[0170] As an example, suppose the first operation is a first limb action. The mapping relationship includes the mapping relationship between the first limb action and the instruction to share the first object on the theme interface. The first electronic device can determine from the mapping relationship that the operation instruction corresponding to the first operation is to share the first object, such as determining that the first object is a doll on the first theme interface.

[0171] As an example, suppose the first operation is a voice command, and the first electronic device can identify the first object by analyzing the content of the voice command.

[0172] The embodiments of this application do not limit the specific operation form of the first operation, nor do they limit the specific first object corresponding to the first operation. It depends on the specific user intent, device function, theme application function, etc.

[0173] Taking the theme package of the first theme interface as an example, the data of the first object includes the DSL package of the first theme interface. For example, the DSL package of the first theme interface may be as shown in Figure 6, where the data of the first object shown in Figure 6 includes information about the first theme interface (SimScene name as shown in Figure 6), theme version information (version="1.0" as shown in Figure 6), style or color of the top area of ​​the theme interface (suitTopVal as shown in Figure 6), style or color of the middle area of ​​the theme interface (suitMiddleVal as shown in Figure 6), style or color of the bottom area of ​​the theme interface (suitBottomVal as shown in Figure 6), theme background color (backgroundColorVal as shown in Figure 6), doll information (SimUnit as shown in Figure 6), accessory data (SimNode as shown in Figure 6), animation data (SimAnimation as shown in Figure 6), etc.

[0174] For example, the data for accessories may include data for multiple hats such as Hat_1 and Hat_2 shown in Figure 6, and data for multiple glasses such as Glasses_1 and Glasses_2 shown in Figure 6.

[0175] For example, the animation data may include skeletal animation and / or facial animation of the doll in one or more scenarios such as AOD scene, lock screen scene, desktop scene, unlock scene, blowing scene, and music perception scene. For instance, the animation data may include data for animations such as animAOD2LOCK, animAOD2HOME, animLOCK2HOME, animLOCK2AOD, animLOCK2AOD, animHOME2AOD, animMusic, animMediumWind, animStrongWind, animBackFromBottom, animmLockSayHi, animmLockSayHiJump, animmLockLook, animmLockRub, animTicking, animAlarms, animAodLockHome, animmLock, and animHome as shown in Figure 6.

[0176] Figure 6 is an example. In some embodiments, the theme package of the first theme interface may also include other types of background colors, dolls, accessory data, etc., without limitation.

[0177] Taking the theme image of the first theme interface as an example, the data of the first object includes the theme image of the first theme interface.

[0178] Taking the doll with the first object as the first theme interface as an example, the data of the first object may include SimUnit and SimAnimation as shown in Figure 6.

[0179] Taking the first object as an example, the data of the first object may include one or more SimNodes as shown in Figure 6.

[0180] Taking the first object as an example, which includes a theme background, the data of the first object may include suitTopVal, suitMiddleVal, suitBottomVal and backgroundColorVal as shown in Figure 6.

[0181] In some embodiments, where the first object is an accessory for a doll, the data of the first object may include data on all the accessories worn by the doll.

[0182] In some embodiments, when the first object is an accessory, the data of the first object may include data on accessories worn by the first electronic device that meet preset conditions. For example, accessories meeting preset conditions may include one or more of the following: accessories won by the first electronic device through a game, accessories obtained by the first electronic device through completing tasks, free accessories provided by the theme application of the first electronic device, accessories worn by peripherals of the first electronic device, or accessories purchased by the first electronic device, etc. For example, the first electronic device may identify its peripherals through one or more methods such as camera recognition, environmental sensing, and communication connection determination, and based on the recognition result, wear the corresponding accessory on the doll, and support sharing the accessory with other electronic devices, such as a second electronic device.

[0183] As an example, the accessory data shared by the first electronic device to the second electronic device does not include one or more of the following accessory data: accessories obtained by the first electronic device through payment, accessories exclusive to the first electronic device's theme application account level, or accessories with non-shareable attributes. Exemplarily, the non-shareable attribute may be pre-set by the developer in the theme application. For example, the developer can set the non-shareable attribute of the accessory by adding an identifier to the accessory data. The electronic device can decide whether to share the accessory data of the corresponding accessory with other electronic devices based on this attribute. The basis for setting the non-shareable attribute is not limited in the embodiments of this application.

[0184] In some embodiments, when the first electronic device sends data of the first object to the second electronic device, the first electronic device satisfies an unlocking condition, such as a first unlocking condition. Exemplarily, satisfying the first unlocking condition includes one or more of the following: completing a first task, the theme application to which the first theme interface belongs reaching a first account level, the first electronic device being a first device type, the current time meeting a first time requirement, or the second electronic device having acquired the first object through payment. The first unlocking condition can be implemented through logic within the theme application; when the first unlocking condition is satisfied, the theme application can unlock the corresponding accessory and support sharing it with the second electronic device.

[0185] In some embodiments, the first electronic device may also send a second unlocking condition to the second electronic device to unlock the first object. For example, satisfying the second unlocking condition includes one or more of the following: completing a second task, the theme application to which the fourth theme interface belongs reaching a second account level, the second electronic device being a second device type, the current time meeting a second time requirement, or the second electronic device having already acquired the first object through payment, the fourth theme interface and the first theme interface being the same theme, or receiving an object change operation from the user. When the second electronic device satisfies the second unlocking condition, it can unlock the corresponding first object and then use the first object to display the theme interface.

[0186] In some embodiments, the first electronic device may also determine the first parameter according to the operation type of the first operation and send the first parameter to the second electronic device through a first message. The first parameter is used by the second electronic device for reference when displaying the second theme interface, for example, for the second electronic device to perform the second operation and display the second theme interface.

[0187] The first parameter includes either a first value or a second value. For example, when the first parameter is a first value, the first parameter is used by the second electronic device to display the second theme interface by replacing the second object on the fourth theme interface with the first object; when the first parameter is a second value, the first parameter is used by the second electronic device to display the second theme interface by adding the first object to the fourth theme interface.

[0188] For example, if the first operation is a first type of operation, the first electronic device can determine that the first parameter is a first value; if the first operation is a second type of operation, the first electronic device can determine that the first parameter is a second value.

[0189] For example, the first type of operation includes a click operation; the second type of operation includes, but is not limited to, the following operations: long press operation, drag operation, or operation where the first electronic device and the second electronic device are brought close together.

[0190] In this embodiment of the application, a communication connection is established between the first electronic device and the second electronic device, and the first electronic device can send the data of the first object corresponding to the first operation to the second electronic device through the communication connection.

[0191] As an example, a first electronic device can interact with a second electronic device via a communication connection based on device sharing technology (such as Huawei Share technology), such as sending data of a first object to the second electronic device. For instance, the first and second electronic devices can send data of a first object through a specific application programming interface (API) provided by Huawei. Since this API supports the rapid transfer of data such as files, pictures, and videos, it enables the rapid sharing of data of the first object between the devices.

[0192] As an example, the first electronic device and the second electronic device can discover each other and establish a communication connection based on mutual discovery, including but not limited to Bluetooth connection, near-field communication (NFC) connection, WiFi Direct connection, etc., without limitation. The first electronic device and the second electronic device can interact on specific topics through this communication connection, such as sending data to the first object.

[0193] Taking the interaction between a first electronic device and a second electronic device via Bluetooth communication technology as an example, an electronic device (such as the first or second electronic device) can discover other electronic devices by sending a broadcast message. For example, the broadcast message may carry message length, broadcast type, broadcast data, etc.; optionally, the broadcast message may also include one or more of the following: a preamble, access address, header, etc. Taking the first electronic device discovering the second electronic device by sending a broadcast message as an example, the first electronic device can send a Bluetooth connection request to the second electronic device to establish a Bluetooth connection. For example, the Bluetooth connection request may carry a preamble, access address, protocol link layer (LL) header, payload, etc. The payload may include, but is not limited to, one or more parameters such as the target logical link control (MAC) address, cyclic redundancy check (CRC) initial value, transmission window size, connection interval, etc. After establishing a Bluetooth connection with the second electronic device, the first electronic device and the second electronic device can interact via Bluetooth.

[0194] As one possible implementation, the first electronic device and the second electronic device can interact thematically through a generic attribute profile (GATT) service and / or data characteristics, such as sending data from the first object.

[0195] Taking the interaction between a first electronic device and a second electronic device via NFC as an example, the standards followed by NFC communication technology may include, but are not limited to, one or more of the following: Logical Link Control Protocol (LLCP), NFC Controller Interface (NCI) specification, or NFC tag technology specification. Among these, LLCP is a key protocol in NFC communication. Based on the ISO / IEC 18092 standard, it is used to establish a logical link control layer connection between devices. LLCP can support bidirectional communication, automatic reconnection, flow control, and session management, ensuring the reliability and order of data transmission. The NCI specification defines a standardized set of commands and protocols to support various functions such as NFC read / write modes, point-to-point communication, and simulated card operations. For example, the NCI specification may specify layer-by-layer processing of RF signal operations, data transmission synchronization and error control, as well as higher-level protocols and data formats, including physical layer, data link layer, and application layer. NFC tag technical specifications can define the technical standards followed by one or more NFC tags, such as Type 1, Type 2, Type 3, or Type 4. These technical standards may include, but are not limited to, ISO / IEC 14443A. The technical standards may specify one or more of the data transmission rates, functions, read / write permissions, access rights, and advanced keys supported by various NFC tags.

[0196] As one possible implementation, the first electronic device and the second electronic device can transmit and receive data of the first object by creating an NdefMessage object and then sending a message using the writeNdefMessage method of NfcAdapter, where the NdefMessage object includes the data of the first object.

[0197] S404: The second electronic device displays a second theme interface based on the data from the first object.

[0198] In some embodiments, the second electronic device may directly display the second theme interface based on the data of the first object and with reference to the objects included on the fourth theme interface.

[0199] As one possible implementation, the second electronic device can replace the second object on the fourth theme interface with the first object to display the second theme interface. For example, if the fourth theme interface includes a second object belonging to the same theme category as the second object, the second electronic device can replace the second object on the fourth theme interface with the first object.

[0200] As one possible implementation, the second electronic device can add the first object to the fourth theme interface and display the second theme interface.

[0201] Taking the data of the first object as the theme package of the first theme interface as an example, the second electronic device can perform theme rendering according to the theme package of the first theme interface and display the second theme interface, which is the same as the first theme interface.

[0202] Taking the data of the first object as the theme image or theme background of the first theme interface as an example, the second electronic device can display the second theme interface, which includes the theme image or theme background of the first theme interface.

[0203] Taking the data of the first object as the data of the first doll as an example, the second electronic device can replace the second doll on the currently displayed fourth theme interface with the first doll, and display the second theme interface, which includes the first doll. Alternatively, the second electronic device can add the first doll to the currently displayed fourth theme interface, and display the second theme interface, which includes both the first and second dolls.

[0204] Taking the data of the first object as the data of the accessory as an example, the second electronic device can render the accessory at the corresponding position of the second doll on the currently displayed fourth theme interface, and display the second theme interface, which includes the second doll wearing the accessory shared by the first electronic device.

[0205] In some examples, assuming that the second doll has an accessory of the same type as the accessory shared by the first electronic device at a corresponding position on the fourth theme interface, the second electronic device can replace the accessory of the same type with the accessory shared by the first electronic device. For example, assuming the first object is glasses and the second doll is wearing glasses, the second electronic device can replace the glasses worn by the second doll with the glasses shared by the first electronic device; or assuming the first object is a hat and the second doll is wearing a hat, the second electronic device can replace the hat worn by the second doll with the hat shared by the first electronic device.

[0206] In some examples, assuming the second doll on the fourth theme interface is wearing an accessory of a different type than the one shared by the first electronic device, the second electronic device can retain that type of accessory. For example, assuming the first object is glasses and the second doll is wearing a hat, the second electronic device can retain the hat worn by the second doll and render the glasses at the corresponding position on the second doll.

[0207] Taking the data of the first object as the theme background as an example, the second electronic device can replace the background of the currently displayed fourth theme interface according to the theme background data, and display the second theme interface. The theme background of the second theme interface is the theme background shared by the first electronic device.

[0208] In some embodiments, when a second electronic device meets a second unlocking condition, it can display a second theme interface based on the data of the first object and referencing the objects included on the fourth theme interface. For example, meeting the second unlocking condition includes one or more of the following: completing a second task, the theme application to which the fourth theme interface belongs reaching a second account level, the second electronic device being a second device type, the current time meeting a second time requirement, the second electronic device having acquired the first object through payment, the fourth theme interface and the first theme interface being the same theme, or receiving an object change operation from the user.

[0209] For example, object replacement operations may include, but are not limited to, theme change operations, doll change operations, accessory change operations, theme background change operations, and theme image change operations.

[0210] Taking the data of the first object as the theme package of the first theme interface as an example, the second electronic device can perform theme rendering and display the second theme interface according to the theme package of the first theme interface when one or more of the following conditions are met: the second task is completed, the theme application to which the fourth theme interface belongs reaches the second account level, the second electronic device is the second device type, the current time meets the second time requirement, or the second electronic device has obtained the first object by paying, the fourth theme interface and the first theme interface are the same theme, or the user's theme change operation is received.

[0211] Taking the data of the first object as the theme image of the first theme interface as an example, the second electronic device can display a second theme interface including the theme image of the first theme interface when one or more of the following conditions are met: the second task is completed, the theme application to which the fourth theme interface belongs reaches the second account level, the second electronic device is a second device type, the current time meets the second time requirement, the fourth theme interface and the first theme interface are the same theme, or the user's theme image change operation is received.

[0212] Taking the data of the first object as the data of the first doll as an example, the second electronic device can replace the second doll on the currently displayed fourth theme interface with the first doll or add the first doll to the currently displayed fourth theme interface and display the second theme interface when one or more of the following conditions are met: the second task is completed, the theme application to which the fourth theme interface belongs reaches the second account level, the second electronic device is the second device type, the current time meets the second time requirement, or the second electronic device has obtained the first doll by paying, the fourth theme interface and the first theme interface are the same theme, or the user's doll replacement operation is received.

[0213] Taking the data of the first object as the data of the accessory as an example, the second electronic device can render the accessory at the corresponding position of the second doll on the currently displayed fourth theme interface and display the second theme interface when one or more of the following conditions are met: the second task is completed, the theme application to which the fourth theme interface belongs reaches the second account level, the second electronic device is the second device type, the current time meets the second time requirement, or the second electronic device has acquired the accessory through payment, or has received the user's accessory change operation. The second theme interface includes a second doll wearing the accessory shared by the first electronic device.

[0214] Taking the data of the first object as the background data as an example, the second electronic device can replace the background of the currently displayed fourth theme interface and display the second theme interface based on the background data when one or more of the following conditions are met: completing the second task, the theme application to which the fourth theme interface belongs reaches the second account level, the second electronic device is the second device type, the current time meets the second time requirement, or the user's theme background change operation is received, etc. The theme background of the second theme interface is the theme background shared by the first electronic device.

[0215] In some embodiments, assuming that the first message received by the second electronic device from the first electronic device includes a first parameter, the second electronic device can perform a second operation based on the data of the first object, referring to the first parameter and the objects included on the fourth theme interface, and display the second theme interface.

[0216] The first parameter includes either a first value or a second value. For example, when the first parameter is the first value, the second electronic device can, based on the data of the first object, the first parameter, and the objects included on the fourth theme interface, replace the second object (which belongs to the same theme category as the first object) on the fourth theme interface with the first object, and then display the second theme interface. When the first parameter is the second value, the second electronic device can, based on the data of the first object, refer to the first parameter and the objects included on the fourth theme interface, and if the fourth theme interface does not include objects belonging to the same theme category as the first object, add the first object to the fourth theme interface, and then display the second theme interface.

[0217] In some embodiments, the second electronic device may also add the data of the first object into the theme resources of the theme application of the second electronic device.

[0218] Figure 4 illustrates an example of a second electronic device using data from a first object. In some embodiments, after receiving data from the first object, the second electronic device may also save the data of the first object into the theme resources of the theme application, without making interface changes based on the data of the first object. The data of the first object can be used in subsequent theme interface display scenarios, such as responding to a user's theme interface change operation by displaying data from the first object to create a second theme interface.

[0219] In some embodiments, the second electronic device can display a theme editing interface based on the data displayed by the first object, allowing the user to modify one or more theme elements, and displaying a second theme interface based on the user's modifications to the theme elements. For example, user modifications to theme elements may include, but are not limited to, deleting elements, adding elements, and modifying element parameters. Theme elements may include, but are not limited to, one or more elements such as dolls, accessories, theme backgrounds, and theme images within the theme. Element parameters may include, but are not limited to, one or more elements such as element type, element shape, element size, and element color.

[0220] Figure 4 illustrates an example of a first electronic device sharing a theme object on a first theme interface with a second electronic device based on a user's first operation. In some embodiments, the second electronic device may also share a theme object on a fourth theme interface with the first electronic device.

[0221] For example, a second electronic device can send data of a second object to a first electronic device, and the first electronic device can receive the data of the second object from the second electronic device, displaying the data of the second object on a third theme interface. The second object and the first object belong to the same theme category.

[0222] Taking the data of the second object as the data of the second doll as an example, the first electronic device can replace the first doll on the currently displayed first theme interface with the second doll and display a third theme interface, wherein the third theme interface includes the second doll. Alternatively, the first electronic device can add the second doll to the currently displayed first theme interface and display a third theme interface, wherein the third theme interface includes both the first and second dolls.

[0223] Taking the data of the second object as the data of the accessory as an example, the first electronic device can render the accessory at the corresponding position of the first doll on the currently displayed first theme interface, and display the third theme interface, which includes the first doll wearing the accessory shared by the second electronic device.

[0224] In some examples, suppose that there is an accessory of the same type as the accessory shared by the second electronic device at a corresponding position on the first theme interface of the first doll. The first electronic device can replace the accessory of the same type with the accessory shared by the second electronic device. For example, suppose the second object is glasses and the first doll is wearing glasses, the first electronic device can replace the glasses worn by the first doll with glasses shared by the second electronic device; or suppose the second object is a hat and the first doll is wearing a hat, the first electronic device can replace the hat worn by the first doll with a hat shared by the second electronic device.

[0225] As an example, please refer to Figure 7A, which shows a schematic diagram of a theme interface in a theme interaction scenario between devices provided by an embodiment of this application. As shown in Figure 7A(a), a first electronic device displays a first theme interface including a first doll, and a second electronic device displays a fourth theme interface including a second doll. When the first electronic device and the second electronic device are close to each other, as shown in Figure 7A(a), in response to the "tap" operation, the first electronic device can send the data of the first doll on the first theme interface to the second electronic device, and the second electronic device can send the data of the second doll on the currently displayed fourth theme interface to the first electronic device. Based on the data received, as shown in Figure 7A(b), the first electronic device can display an animation of the second doll "crossing over" into the first theme interface, and the second electronic device can display an animation of the first doll "crossing over" into the fourth theme interface.

[0226] For example, taking the DSL packets of the first theme interface and the fourth theme interface as shown in Figure 6, in the example shown in Figure 7A, in response to the "tap" operation between the first electronic device and the second electronic device, the first electronic device can send SimUnit and SimAnimation from the DSL packet of the first theme interface to the second electronic device, and the second electronic device can send SimUnit and SimAnimation from the DSL packet of the fourth theme interface to the first electronic device. Based on the data received by each, the first electronic device can add SimUnit and SimAnimation from the second electronic device to the DSL packet of the first theme interface to display the animation of the second doll "crossing over" into the first theme interface; the second electronic device can add SimUnit and SimAnimation from the first electronic device to the DSL packet of the fourth theme interface to display the animation of the first doll "crossing over" into the fourth theme interface.

[0227] In some embodiments, after the first doll in the theme interface of the first electronic device "travels" to the second electronic device, the second electronic device may continue to display the second doll, for example, the second electronic device displays a second theme interface including the first doll and the second doll; after the second doll in the theme interface of the second electronic device "travels" to the first electronic device, the first electronic device may continue to display the first doll, for example, the first electronic device displays a third theme interface including the first doll and the second doll.

[0228] In some embodiments, after the first doll in the theme interface of the first electronic device "crosses over" to the second electronic device, the first and second dolls displayed on the second electronic device may present interactive animations, such as a "greeting" animation; and / or, after the second doll in the theme interface of the second electronic device "crosses over" to the first electronic device, the first and second dolls displayed on the first electronic device may present interactive animations, such as a "greeting" animation. For example, the "greeting" animation displayed by the electronic device may include, but is not limited to, one or more of the following forms: display animations, sound animations, vibration animations, indicator light animations, etc. For instance, the electronic device displays the action of the first doll greeting the second doll and plays a greeting sound, and the second doll responds to the first doll's greeting action and plays a greeting sound. The greeting action may include, but is not limited to, waving, hugging, smiling, etc., and the greeting sound may include, but is not limited to, "Hello!", "Hi!", "Nice to meet you!", etc. This application embodiment does not limit the specific method of greeting between the dolls.

[0229] In some embodiments, assuming that the electronic device is in a locked screen state when displaying the first theme interface, after completing the theme interaction between the devices, for example after the dolls in the first and second electronic devices "pass through" each other, and after a preset time period without detecting new user operation, the first and second electronic devices can also stop interacting and enter the AOD state to save device power consumption.

[0230] Figure 7A is only an example of the theme interface in the scenario of theme interaction between devices. In actual application, the specific interaction method between devices is not limited (such as other interaction methods besides "tap to interact"), and one or more of the actions, expressions, accessories, etc. of the doll during the "crossing" process are not limited, depending on the device capabilities, theme application capabilities, user settings, etc.

[0231] As an example, please refer to Figure 7B, which shows a schematic diagram of a theme interface in another device-to-device theme interaction scenario provided by an embodiment of this application. As shown in Figure 7B(a), the first electronic device displays a first theme interface including a first doll wearing a hat 1 and glasses 1, and the second electronic device displays a fourth theme interface including a second doll wearing a hat 2. When the first electronic device and the second electronic device are close to each other, as shown in Figure 7B(a), in response to the "tap" operation, the first electronic device can send data of hat 1 and glasses 1 to the second electronic device, and the second electronic device can send data of hat 2 to the first electronic device. Based on the data received, as shown in Figure 7B(b), the first electronic device can replace hat 1 on the first theme interface with hat 2, and the second electronic device can replace hat 2 on the first theme interface with hat 1 and add glasses 1.

[0232] For example, taking the DSL packets of the first theme interface and the fourth theme interface as shown in Figure 6, in the example shown in Figure 7B, in response to the "tap-to-tap" operation between the first electronic device and the second electronic device, the first electronic device can send the SimNodes about Hat_1 and Glasses_1 in the DSL packet of the first theme interface to the second electronic device, and the second electronic device can send the SimNode about Hat_2 in the DSL packet of the fourth theme interface to the first electronic device. Based on the data received by each, the first electronic device can replace the SimNode about Hat_1 in the DSL packet of the first theme interface with the SimNode about Hat_2 to display a doll wearing hat 2 and glasses 1; the second electronic device can add the SimNode about Glasses_1 from the first electronic device to the DSL packet of the fourth theme interface, and replace the SimNode about Hat_2 in the DSL packet of the first theme interface with the SimNode about Hat_1 to display a doll wearing hat 1 and glasses 1. Based on the theme interaction method shown in Figure 4, electronic devices can support the interaction of one or more theme objects such as theme packs, theme pictures, dolls, accessories, and theme backgrounds between devices, realizing highly interactive and playable theme interaction between devices, and improving the visual and fun experience brought to users by the theme interface.

[0233] In some embodiments of this application, the electronic device can support users to interact with the dolls on the theme interface, thereby achieving a highly interactive and playable theme interface display and improving the visual and fun experience brought to users by the theme interface.

[0234] As an example, electronic devices can support the creation of mascots on themed interfaces that exhibit vivid and lifelike changes in one or more aspects, such as actions, expressions, and accessories, based on the user's screen unlocking, eye contact, or blowing. The simulation, rendering, and final presentation of the mascots can be performed in real time. As another example, themed applications on electronic devices can support providing users with a mascot-based gaming experience.

[0235] As an example, please refer to Figure 8, which shows a schematic diagram of the process of real-time rendering of a theme in a human-computer theme interaction scenario provided by an embodiment of this application.

[0236] As shown in Figure 8, when the user interacts with the doll in the theme through the interaction module 320, the theme engine module 330 analyzes the interaction signals corresponding to the human-computer interaction operation from the interaction module 320, combines the interaction logic, and loads one or more of the doll's shaders, animations, physical parameters, etc. based on the analysis results. Then, it starts the animation pre-simulation and instructs the graphics engine module 340 to complete the real-time simulation and rendering of the theme interface, including the real-time simulation and rendering of the doll in the theme interface.

[0237] Alternatively, the theme engine module 330 can analyze the interaction signals when perceiving the context based on the interaction signals from the interaction module 320, and then load one or more of the following based on the analysis results: the shader, animation, physical parameters, etc. of the doll in the theme. After that, it can start the animation pre-simulation and instruct the graphics engine module 340 to complete the real-time simulation and rendering of the theme interface, including the real-time simulation and rendering of the doll in the theme interface.

[0238] For example, human-computer interaction operations may include, but are not limited to, one or more of the following: touch operation, breath operation, screen unlock operation, eye gaze operation, theme interface / theme element sharing operation, and the perceived context may include, but are not limited to, one or more of the following: perceived temperature, music, etc.

[0239] As an example, please refer to Figure 9, which shows a flowchart of a display method for a theme interface based on user interaction with a doll, using an unlocking scene as an example.

[0240] As shown in Figure 9, when the first electronic device displays a first theme interface including a doll, in response to detecting a user's screen unlock operation, the first electronic device verifies the user's identity. If the verification is successful, the first electronic device simulates, renders, and displays the doll's first animation in real time and unlocks the first electronic device; if the verification fails, the first electronic device simulates, renders, and displays the doll's second animation in real time and does not unlock the first electronic device. The dolls in the first and second animations may be the same or different, and this is not limited.

[0241] As an example, a user's screen unlocking operation may include, but is not limited to, fingerprint unlocking, swipe unlocking, facial unlocking, password unlocking, gaze unlocking, etc., without limitation. Taking facial unlocking as an example, if the first electronic device detects the user's screen unlocking operation, such as the first electronic device capturing an image including a face through a camera, the user's identity verification may involve performing facial recognition (Face ID) verification on the face in the captured image.

[0242] As an example, the first animation might be a doll "greeting" the user, and the second animation might be a doll looking around. Of course, the first or second animation could be any other type of animation; there are no limitations.

[0243] In some embodiments, as shown in FIG9, assuming the initial verification fails, the first electronic device detects one or more screen unlock operations by the user, and the verification of the user's identity regarding the one or more screen unlock operations fails, the first electronic device simulates, renders, and displays a third animation of the doll in real time. For example, the third animation might be an animation of the doll issuing an angry warning.

[0244] In some embodiments, assuming the first electronic device is in a locked screen state when displaying the first theme interface, after the electronic device displays the second animation of the doll, after a preset time, the first electronic device can also stop displaying the animation and enter the AOD state to save device power consumption.

[0245] In some embodiments, assuming the first electronic device is in a locked screen state when displaying the first theme interface, after the first electronic device displays the third animation of the doll, after a preset time, the first electronic device may also stop displaying the animation and enter the AOD state to save device power consumption.

[0246] In some embodiments, assuming the first electronic device is in a locked screen state when displaying the first theme interface, after the first electronic device displays the first theme interface including the doll for a preset time, the first electronic device can also stop displaying the animation and enter the AOD state to save device power consumption.

[0247] In some embodiments, the first electronic device in AOD state may have a black screen, or the theme may be displayed in a part of the display area of ​​the first electronic device in the form of a static image, without limitation.

[0248] Based on the display method of the theme interface based on user interaction with dolls shown in Figure 9, the electronic device can support the doll on the theme interface to present corresponding animations according to whether the user's screen unlock operation is verified, and to perform real-time simulation, rendering and presentation of the doll, so as to realize a highly interactive and playable theme interface display, and improve the visual and fun experience brought to the user by the theme interface.

[0249] Figure 9 is only an illustration. As another possible implementation, in the unlocking scenario, the first electronic device can first determine whether there is a corresponding user-predefined doll animation based on the verification result; if so, the user-predefined doll animation is displayed; if not, the first electronic device generates the corresponding animation after real-time driving, simulation and rendering of the doll according to the theme package.

[0250] For example, in an unlocking scenario, the first electronic device can determine whether there is a user-defined, verified doll animation when the user's authentication is successful; if so, the verified doll animation is displayed; if not, the first animation of the doll is simulated, rendered, and displayed in real time, and the first electronic device is unlocked.

[0251] For example, in an unlocking scenario, the first electronic device can determine whether there is a user-defined doll animation indicating failed authentication when the user fails to authenticate. If so, the doll animation is displayed; otherwise, the doll's second animation is simulated, rendered, and displayed in real time.

[0252] As an example, please refer to Figure 10, which shows a flowchart of a display method for a theme interface based on user interaction with a doll, using a blowing scenario as an example.

[0253] As shown in Figure 10, when the first electronic device displays a first theme interface including a doll, in response to detecting a user blowing on the doll, the first electronic device determines the direction and force of the blowing operation. Assuming the blowing force is in a first force range, the first electronic device simulates, renders, and displays an animation of the doll with a first characteristic in the corresponding direction in real time; assuming the blowing force is in a second force range, the first electronic device simulates, renders, and displays an animation of the doll with a second characteristic in the corresponding direction in real time; assuming the blowing force is in a third force range, the first electronic device simulates, renders, and displays an animation of the doll with a third characteristic in real time.

[0254] For example, an animation with the first characteristic might be an animation of a doll slightly swaying in the corresponding direction; an animation with the second characteristic might be an animation of a doll leaning backward in the corresponding direction; and an animation with the third characteristic might be an animation of a doll being blown away.

[0255] As an example, the maximum value of the first force range is less than the minimum value of the second force range, and the maximum value of the second force range is less than the minimum value of the third force range.

[0256] In some embodiments, in the example shown in FIG10, after the first electronic device displays an animation of the doll possessing the third feature, the first electronic device can also combine the detected user gaze area to simulate, render, and display in real time an animation of the doll entering from the user gaze area. Exemplarily, the first electronic device can detect the user gaze area via a camera.

[0257] Based on the display method of the theme interface based on user interaction with the doll shown in Figure 10, the electronic device can support the doll on the theme interface to change according to the user's blowing operation, and perform real-time simulation, rendering and presentation of the doll, so as to realize the theme interface display with strong interactivity and playability, and improve the visual experience and fun experience brought to the user by the theme interface.

[0258] This application does not limit the specific dolls included on the theme interface in the blowing scene, nor does it limit the doll's actions, expressions, accessories, etc., when the blowing force / direction is different. For example, in some embodiments, if the blowing force of the user's blowing operation on the doll is within a certain force range, the first electronic device may display an animation of the hat worn by the doll being blown away, depending on the device capabilities, theme application capabilities, user settings, etc.

[0259] As an example, please refer to Figure 11, which shows a flowchart of a display method for a theme interface based on user interaction with a doll, using a game scene as an example.

[0260] As shown in Figure 11, when the first electronic device displays a first theme interface including a doll, in response to detecting an operation to trigger entering the game state, the first electronic device enters the game state, displays the game interface provided by the theme application, and performs real-time simulation and rendering of the doll according to the user's game operation on the game interface, and displays the corresponding game effects. The game interface includes a third doll, which may be the same as or different from the first doll, without limitation.

[0261] As an example, the operation used to trigger entering the game state may include, but is not limited to, clicking operations (such as single-click operation, double-click operation, etc.), long-press operation, gesture operation, body movement, etc., or the operation used to trigger entering the game state may also be other forms of operation such as voice command, facial expression command, etc., which are not limited in the embodiments of this application.

[0262] In some embodiments, when the first electronic device is in game mode, in response to detecting an operation to exit game mode, the first electronic device exits game mode and resumes displaying the first theme interface.

[0263] In some embodiments, assuming the first electronic device is in a locked screen state when displaying the game interface, if the first electronic device displays the game interface and no user game operation is detected after a preset time, the first electronic device may also stop displaying the game interface and enter an AOD state to save device power consumption.

[0264] In some embodiments, assuming the first electronic device is in a locked screen state when displaying the game interface, if the first electronic device displays the game interface (such as game effects) and no further game operation by the user is detected after a preset time, the first electronic device may also stop displaying the game interface and enter an AOD state to save device power consumption.

[0265] In some embodiments, assuming the first electronic device is in a locked screen state when displaying the first theme interface, after a preset time has elapsed, the first electronic device may also stop displaying the animation and enter an AOD state to save device power consumption.

[0266] In some embodiments, after a user finishes playing the game on the game interface, the first electronic device can also support the user to restart the game. For example, in response to an operation to restart the game, the first electronic device redisplays the game interface provided by the theme application and displays corresponding game effects based on the user's game operations on the game interface.

[0267] In some embodiments, when entering game mode, the first electronic device may also display a countdown interface to allow users time to react and / or to create a sense of tension in the game.

[0268] In some embodiments, if the game challenge is successfully completed, the first electronic device may display a challenge success interface.

[0269] In some embodiments, the first electronic device may also provide the user with one or more of the following through a challenge failure interface: an option to restart the game, an option to exit the game state, a game score, etc.

[0270] Based on the display method of the theme interface based on user interaction with dolls shown in Figure 11, the electronic device can support users to play games with dolls on the theme interface, and can simulate, render and present the dolls in real time during the game interaction, so as to realize the display of the theme interface with strong interactivity and playability, and improve the visual experience and fun experience brought to users by the theme interface.

[0271] In some embodiments of this application, the electronic device can support the doll's perception of the context, such as real-time simulation, rendering and presentation of the doll based on the perceived context, to achieve a highly interactive and playable theme interface display, thereby improving the visual and fun experience brought to the user by the theme interface.

[0272] As an example, electronic devices can support changes in one or more of a doll's movements, expressions, accessories, etc., based on the perceived rhythm of music.

[0273] As an example, please refer to Figure 12, which shows a flowchart of a context-aware topic interface display method provided in an embodiment of this application.

[0274] As shown in Figure 12, when the first electronic device displays a first theme interface including a doll, in response to the perception of music, the first electronic device identifies the rhythm of the perceived music and simulates, renders, and displays the doll's theme animation in real time according to the identified rhythm. For example, the first electronic device can make the doll's body sway rhythmically according to the identified rhythm of the music. Optionally, the first electronic device can dress the doll with headphones according to the identified rhythm of the music.

[0275] For example, the rhythm of music may include strong beats and / or weak beats. For instance, a doll can rhythmically sway its body to varying degrees according to the changes in the strong and weak beats of music, thus achieving a sense of rhythm and dynamism.

[0276] In some embodiments, the electronic device can also simulate, render, and present musical elements (such as musical notes) on the theme interface in real time according to the rhythm of the recognized music, further enhancing the visual and entertainment experience brought to the user by the theme interface.

[0277] In some embodiments, the first electronic device can simulate, render, and present one or more of the doll's movements, expressions, accessories, etc. in real time according to the rhythm of the recognized music, so as to realize a highly interactive and playable theme interface display and improve the visual and fun experience brought to the user by the theme interface.

[0278] As an example, the music perceived by the first electronic device could be music played by the first electronic device or music in the environment, without limitation.

[0279] As an example, the music sensed by the first electronic device is the music played by the first electronic device. As one possible implementation, the first electronic device can identify the rhythm of the music based on the audio data of the music being played. For example, the first electronic device can identify whether it is playing music and identify the rhythm of the music based on data obtained from an audio / video control module (such as an AVSession Kit).

[0280] As an example, the music perceived by the first electronic device is ambient music. As one possible implementation, the first electronic device can identify the rhythm of the music based on rhythm recognition methods such as metronome measurement. Exemplarily, the rhythm of the music is such as 60 beats per minute, 120 beats per minute, etc., without limitation.

[0281] In some embodiments, assuming the first electronic device is in a locked screen state when displaying the doll's theme animation, and no new music is detected within a preset time after the first electronic device finishes displaying the doll's theme animation, the first electronic device can also stop displaying the animation and enter an AOD state to save device power consumption.

[0282] Based on the context-aware theme interface display method shown in Figure 12, the first electronic device can support changes in one or more of the doll's actions, expressions, accessories, etc., based on the rhythm of the music, and can simulate, render, and present the doll in real time according to the rhythm of the music, so as to realize a highly interactive and playable theme interface display, and improve the visual and fun experience brought to the user by the theme interface.

[0283] Figures 9-12 use the interaction between the doll on the theme interface and the user as an example. In some embodiments, other types of objects on the theme interface, such as the doll's accessories, theme background, theme image, etc., can also change according to the interaction with the user. This application embodiment does not limit this.

[0284] Currently, the actions displayed by the dolls on theme interfaces are usually fixed actions pre-designed by developers according to scene requirements. These pre-designed theme resources are stored in the electronic device, and the device displays the doll's animation based on these resources when the theme application is running. The advantage of this technology is that it primarily relies on the image / video encoding and decoding capabilities of the electronic device, placing lower demands on the rendering performance of the processor, graphics processing unit (GPU), and 3D visual effects engine system. However, its disadvantages include strong dependence on the developer's pre-design, fixed and limited doll animations, and limited visual and entertainment experience for users. For example, users cannot customize actions according to their preferences, cannot interact with the doll in a fun way, the doll cannot interact with other devices, and the doll cannot perceive the context.

[0285] In some embodiments of this application, the electronic device can support users to customize one or more of the doll's actions, expressions, accessories, etc. on the theme interface, and perform real-time simulation and rendering of the doll according to the user's customization, displaying a more vivid and realistic doll, and improving the visual and fun experience brought to the user by the theme interface.

[0286] As an example, please refer to Figure 13, which shows a schematic diagram of a real-time simulation, rendering and display of a user-defined theme provided by an embodiment of this application.

[0287] As shown in Figure 13, after the user performs a custom theme operation through the interaction module 320, such as customizing the accessories of the doll in the theme, the theme engine module 330 obtains relevant theme resources from the theme resources managed by the resource management module 310 based on the interaction signal from the interaction module 320 (i.e., the interaction signal corresponding to the custom theme operation), loads the theme resources, selects the accessories, and instructs the graphics engine module 340 to dynamically update the visible objects, such as dynamically updating the visible objects through the AGP3D module. Also, as shown in Figure 13, the theme engine module 330 can also read the selected accessory ID, load the corresponding accessory resources according to the accessory ID, bind the accessory to the theme, and trigger the AGP3D module in the graphics engine module 340 to bind the accessory and dynamically load other additional resources in the theme. After completing the dynamic update of visible objects, binding of accessories, and dynamic loading of other additional resources in the theme, the theme engine module 330 renders the doll in the theme interface through the rendering module, including but not limited to off-screen rendering, and finally displays the custom theme interface through the display module 350.

[0288] In some embodiments, after binding accessories to a theme, the theme engine module 330 can also save the user-defined theme resources in the resource management module 310. For example, the theme engine module 330 can package the user-defined theme resources into a custom theme package and store it in the resource management module 310; and / or, the theme engine module 330 can generate a pre-rendered video based on the user-defined theme resources and store it in the resource management module 310; and / or, the theme engine module 330 can generate a corresponding model description file based on the user-defined theme resources and store it in the resource management module 310.

[0289] As an example, please refer to Figure 14, which shows a flowchart of a method for displaying a user-defined theme interface provided in an embodiment of this application.

[0290] As shown in Figure 14, when the first electronic device displays a theme interface including a doll, in response to receiving a user's custom operation on the doll on the theme interface, the first electronic device generates a new custom theme package for the doll, and simulates and renders the new doll according to the custom theme package, and displays the first theme interface.

[0291] As an example, user customization of a doll might include changes made to the doll's actions on the theme interface.

[0292] As an example, user customization of a doll might include changing the doll on the theme interface, and setting one or more of the following for the changed doll: accessories, actions, expressions, etc.

[0293] As an example, user customization of a doll might include modifying one or more of the following on the doll's theme interface: accessories, actions, expressions, etc.

[0294] In some embodiments, user customization of the doll may also include modifications to one or more of the theme background, theme filters, and interface elements of the first theme interface.

[0295] As one possible implementation, in response to the user's customization of the doll on the theme interface, the electronic device can obtain relevant theme resources from the theme resources managed by the electronic device, generate a custom theme package based on the relevant theme resources, and start real-time simulation to perform real-time simulation and rendering of the custom theme.

[0296] As one possible implementation, taking the custom operation as an example of changing the accessories of the doll on the theme interface, the electronic device can, after starting real-time simulation, load a custom theme package, load and bind corresponding accessories and other resources according to the custom theme package, dynamically update visible objects, dynamically load other additional resources in the theme, and then render the doll in the theme interface, including but not limited to off-screen rendering, to complete the real-time simulation and rendering of the theme interface.

[0297] For details on the process of electronic devices simulating and rendering dolls, please refer to the relevant introduction to Figure 13 above, which will not be repeated here.

[0298] Based on the user-defined theme interface display method shown in Figure 14, the electronic device can support users in customizing one or more of the doll's actions, expressions, and accessories on the theme interface, and perform real-time simulation and rendering of the doll according to the user's customization. This enhances the visual and entertainment experience provided by the theme interface.

[0299] Furthermore, the display method of the user-customizable theme interface shown in Figure 14 can adapt to devices of different types, functions, and resolutions. Compared with conventional solutions that rely on developers' early design, it can greatly save developers' early design work and related investment while improving the visual and fun experience.

[0300] Furthermore, based on the user-defined theme interface display method shown in Figure 14, users can see the customization results in real time during the theme customization process, allowing them to flexibly adjust and optimize the theme interface according to their needs. Moreover, theme packages are simple to create, small in size, and can reduce the storage space occupied on electronic devices.

[0301] It should be understood that the various solutions in the embodiments of this application can be used in a reasonable combination, and the explanations or descriptions of the various terms appearing in the embodiments can be referenced or explained to each other in the various embodiments, without limitation.

[0302] It should also be understood that, in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0303] It is understood that, in order to achieve the functions of any of the above embodiments, the electronic device includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0304] This application embodiment can divide electronic devices into functional modules. For example, each function can be divided into its own functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.

[0305] It should also be understood that the various modules in an electronic device can be implemented in software and / or hardware, without specific limitations. In other words, an electronic device is presented in the form of functional modules. Here, "module" can refer to application-specific integrated circuits (ASICs), circuits, processors and memories that execute one or more software or firmware programs, integrated logic circuits, and / or other devices that can provide the above functions.

[0306] In an alternative approach, when data transmission is implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are implemented. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., digital video disk (DVD)), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0307] The steps of the methods or algorithms described in the embodiments of this application can be implemented in hardware or by a processor executing software instructions. The software instructions can consist of corresponding software modules, which can be stored in RAM, flash memory, ROM, EPROM, EEPROM, registers, hard disk, portable hard disk, CD-ROM, or any other form of storage medium known in the art. One exemplary embodiment couples a storage medium to a processor, enabling the processor to read information from and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and storage medium can reside in an ASIC. Alternatively, the ASIC can reside in an electronic device. Of course, the processor and storage medium can also exist as discrete components.

[0308] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

Claims

1. A thematic interactive method, characterized in that, Applied to a first electronic device, the method includes: Display a first theme interface, which includes a first object; In response to a user's first operation on the first theme interface, a first message is sent to a second electronic device. The first message includes data of the first object corresponding to the first operation, and the data of the first object is used by the second electronic device to display the second theme interface.

2. The method according to claim 1, characterized in that, Before sending the first message to the second electronic device, the method further includes: The first parameter is determined based on the operation type of the first operation, and the first message further includes the first parameter. The first parameter is used by the second electronic device to perform a second operation to display the second theme interface.

3. The method according to claim 2, characterized in that, The first operation is a first type of operation, and determining the first parameter based on the operation type of the first operation includes: The first parameter is determined to be a first value, and the first parameter is used by the second electronic device to display the second theme interface by replacing objects.

4. The method according to claim 3, characterized in that, The first type of operation includes click operations.

5. The method according to claim 2, characterized in that, The first operation is a second type of operation, and determining the first parameter based on the operation type of the first operation includes: The first parameter is determined to be a second value, and the first parameter is used by the second electronic device to display the second theme interface by adding the first object.

6. The method according to claim 5, characterized in that, The second type of operation includes the following operations: long press operation, drag operation, or operation where the first electronic device and the second electronic device are brought close together.

7. The method according to any one of claims 1-6, characterized in that, The method further includes: Receive data from a second object in a second electronic device, wherein the second object belongs to the same subject category as the first object; The third theme interface is based on the data displayed by the second object.

8. The method according to claim 7, characterized in that, The third theme interface based on the data displayed by the second object includes: Replace the first object on the first theme interface with the second object, and display the third theme interface; or, Add the second object to the first theme interface, and then display the third theme interface.

9. The method according to any one of claims 1-8, characterized in that, Sending the data of the first object corresponding to the first operation to the second electronic device includes: When the first unlocking condition is met, the data of the first object is sent to the second electronic device; The first unlocking condition includes one or more of the following: completing the first task, the theme application to which the first theme interface belongs reaching the first account level, the first electronic device being a first device type, the current time meeting the first time requirement, or the second electronic device having acquired the first object through payment.

10. The method according to any one of claims 1-9, characterized in that, The method further includes: In response to the user's screen unlocking action, verify the user's identity; If the verification is successful, the first animation of the first object is displayed and the first electronic device is unlocked; If the verification fails, the second animation of the first object is displayed and the first electronic device is not unlocked.

11. The method according to any one of claims 1-10, characterized in that, The method further includes: In response to a user's blowing action on the first object, the direction and force of the blowing action are obtained; If the blowing force is within the first force range, an animation is displayed showing that the first object has a first characteristic in the direction; If the blowing force is within the second force range, an animation is displayed showing that the first object has a second characteristic in the direction.

12. The method according to any one of claims 1-11, characterized in that, The method further includes: In response to the perception of music, the rhythm of the music is identified, and a theme animation of the first object is displayed according to the rhythm.

13. The method according to any one of claims 1-12, characterized in that, The display of the first theme interface includes: The first theme interface is displayed after real-time simulation and rendering based on the theme package of the first theme interface; The theme package of the first theme interface is generated based on the user's custom operations on the theme interface. The custom operations include setting one or more of the following operations for the doll on the first theme interface: accessories, actions, and expressions.

14. A thematic interactive method, characterized in that, Applied to a second electronic device, the method includes: Display the fourth theme interface; Receive a first message from a first electronic device, the first message including data of a first object; The second theme interface is displayed based on the data from the first object.

15. The method according to claim 14, characterized in that, The first message also includes a first parameter. The second theme interface based on the data displayed by the first object includes: Based on the data of the first object, and referring to the first parameter and the objects included on the fourth theme interface, a second operation is performed to display the second theme interface.

16. The method according to claim 14 or 15, characterized in that, The first parameter is a first value, and the step of displaying the second theme interface based on the data from the first object includes: The second object on the fourth theme interface is replaced with the first object, and the second theme interface is displayed. The fourth theme interface includes the second object, and the first object and the second object belong to the same theme category.

17. The method according to claim 14 or 15, characterized in that, The first parameter is a second value, and the step of displaying the second theme interface based on the data of the first object includes: Add the first object to the fourth theme interface, and display the second theme interface.

18. The method according to any one of claims 14-17, characterized in that, The second theme interface based on the data displayed by the first object includes: When the second unlock condition is met, the second theme interface is displayed based on the data from the first object: The conditions for unlocking include one or more of the following: completing the second task, the theme application to which the fourth theme interface belongs reaching the second account level, the second electronic device being the second device type, the current time meeting the second time requirement, or the second electronic device having acquired the first object through payment, the fourth theme interface being the same theme as the first theme interface, or receiving an object change operation from the user.

19. The method according to claim 17 or 18, characterized in that, The method further includes: The data of the second object is sent to the first electronic device, and the data of the second object is used by the first electronic device to display a third theme interface.

20. A thematic interactive method, characterized in that, The method includes: A first electronic device displays a first theme interface, and the first theme interface includes a first object; In response to a user’s first operation on the first theme interface, the first electronic device sends a first message to the second electronic device, the first message including data of the first object corresponding to the first operation; The second electronic device displays a second theme interface based on the data from the first object.

21. The method according to claim 20, characterized in that, Before the first electronic device sends the first message to the second electronic device, the method further includes: The first electronic device determines the first parameter according to the operation type of the first operation, and the first message also includes the first parameter. The first parameter is used by the second electronic device to perform a second operation to display the second theme interface. The second electronic device performs a second operation based on the data of the first object, referring to the first parameters and the objects included on the fourth theme interface, and displays the second theme interface.

22. The method according to claim 21, characterized in that, The first operation is a first type of operation, and the first electronic device determines the first parameter according to the operation type of the first operation, including: The first electronic device determines that the first parameter is a first value; The second electronic device performs a second operation based on the data of the first object, referring to the first parameters and the objects included on the fourth theme interface, and displays the second theme interface, including: The second electronic device replaces the second object on the fourth theme interface with the first object according to the first value, and displays the second theme interface, wherein the fourth theme interface includes the second object, and the first object and the second object belong to the same theme category.

23. The method according to claim 22, characterized in that, The first type of operation includes click operations.

24. The method according to claim 21, characterized in that, The first operation is a second type of operation, and the first electronic device determines the first parameter according to the operation type of the first operation, including: The first electronic device determines that the first parameter is the second value; The second electronic device performs a second operation based on the data of the first object, referring to the first parameters and the objects included on the fourth theme interface, and displays the second theme interface, including: The second electronic device adds the first object to the fourth theme interface according to the second value and displays the second theme interface.

25. The method according to any one of claims 20-24, characterized in that, The method further includes: The second electronic device sends data of the second object to the first electronic device; The first electronic device displays a third theme interface based on the data from the second object.

26. An electronic device, characterized in that, The electronic device includes: A display screen is used to display the interface. A transceiver is used to communicate with other devices. Memory is used to store computer program instructions; A processor for executing the computer program instructions to support the device in implementing the method as described in any one of claims 1-13 or 14-19.

27. A themed interactive system, characterized in that, The system includes a first electronic device and a second electronic device, the first electronic device being used to implement the method as described in any one of claims 1-13, and the second electronic device being used to implement the method as described in any one of claims 14-19.

28. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer program instructions that, when executed by a processing circuit, implement the method as described in any one of claims 1-13 or 14-19.

29. A computer program product containing instructions, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in any one of claims 1-13 or 14-19.

Images