Interaction method for display object, and electronic device

Abstract

Provided in the embodiments of the present application are an interaction method for a display object, and an electronic device. The method comprises: in a scenario in which an electronic device sets a first theme, during the process of the electronic device displaying a first user interface that includes a display object of the first theme, in response to a first user operation, displaying, in the first user interface, a first animation effect of the display object executing a target interaction action, wherein the target interaction action executed by the display object in the first animation effect matches the position and / or posture of the display object on the first user interface, that is, the target interaction action can naturally link with the position and / or posture of the display object before executing the target interaction action, such that the first animation effect is displayed naturally and coherently. The method can ensure that an animation effect of a display object in an animation effect theme of an electronic device is displayed coherently and continuously, thereby ensuring the display effect of the animation effect of the display object, and thus improving the user experience.

Description

An interactive method for displaying objects and an electronic device

[0001] Cross-reference of related applications

[0002] This application claims priority to Chinese Patent Application No. 202510240382.3, filed on February 28, 2025, entitled "An Interactive Method and Electronic Device for Displaying an Object", the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of electronic device technology, and more particularly to an interactive method for displaying an object and an electronic device. Background Technology

[0004] With the development of electronic technology, users have increasingly higher demands for the display effects of electronic devices. They not only require electronic devices to display dazzling user interfaces, but also hope that they can interact with users. Currently, electronic devices can achieve simple interaction with users through themes with animation effects. Animated themes generally use the playback of sequence frames or videos to achieve the animation effects of the objects displayed in the theme. This display method has poor display effects and ultimately affects the user experience. Summary of the Invention

[0005] This application provides an interactive method and electronic device for displaying objects, which enhances the animation display effect of objects in an animation theme, thereby improving the user experience.

[0006] Firstly, embodiments of this application provide an interactive method for displaying an object, which can be applied to an electronic device. Here, "electronic device" can refer to the electronic device itself, or to a processor, module, chip, or chip system within the electronic device that implements the method. The following description uses an electronic device as an example; the method includes the following steps:

[0007] An electronic device displays a first user interface on a screen, the first user interface containing display objects; wherein the display objects are objects in a first theme set by the electronic device; the electronic device responds to a first user operation by displaying a first animation effect in the first user interface; wherein the first animation effect includes an animation effect of the display object performing a target interactive action, the target interactive action being matched with the position and / or posture of the display object before performing the target interactive action.

[0008] This method allows for the display of a first user interface containing a displayed object on an electronic device. Based on a first user interaction, a first animation effect can be displayed within the first user interface, showing the displayed object performing a target interactive action. The displayed object is an object within a first theme set by the electronic device. In the first animation effect, the target interactive action performed by the displayed object matches the position and / or posture of the displayed object before performing the target interactive action; that is, the target interactive action can be naturally connected to the position and / or posture of the displayed object before performing the target interactive action. Therefore, this method ensures the continuity of performing the target interactive action based on the position and / or posture of the displayed object within the first user interface before performing the target action, thus guaranteeing the continuity of the first animation effect of the displayed object. Through this method, the electronic device can naturally connect the display of the next animation effect of the displayed object based on its position and / or posture within the user interface, making the animation display of the displayed object within the animation theme of the electronic device coherent and continuous, thereby ensuring the animation display effect of the displayed object and improving the user experience.

[0009] In one possible design, the first user action includes at least one of the following: an interface operation performed by the user on the first user interface; a user voice input operation; a user behavioral activity; wherein the user behavioral activity includes the user's body movements and / or facial expressions.

[0010] This design allows electronic devices to display animations of objects within a theme based on various user operations, enhancing the flexibility of user interaction with the displayed objects and increasing the richness and appeal of the animations. This makes the device suitable for a variety of complex and dynamic application scenarios.

[0011] In one possible design, when the first user operation includes an interface operation performed by the user on the first user interface, the target interactive action is related to the operation type and / or operation location of the interface operation; when the first user operation includes a user voice input operation, the target interactive action is matched with the semantic information of the user's voice; wherein the user's voice is input by the user into the electronic device through the user voice input operation; when the first user operation includes user behavioral activities, the target interactive action is matched with the body movements and / or facial expressions included in the behavioral activities.

[0012] Through this design, the interactive actions of the displayed objects in the animation effects can be determined based on the principles corresponding to different types of user operations.

[0013] In one possible design, where the first user action includes user behavior, the electronic device can also determine the user behavior through steps:

[0014] The electronic device acquires sensing data collected by its sensors; and determines user behavior based on the sensing data; wherein the sensing data includes at least one of the following: scene images containing the user captured by a camera; sensing data collected by a gyroscope sensor; and sensing data collected by an accelerometer sensor.

[0015] In one possible design, after displaying the first user interface on the screen, the electronic device, in response to the first user's operation, can also play targeted interactive sounds of the displayed object. This design enables voice interaction between the displayed object in the first theme and the user.

[0016] In one possible design, the electronic device may also acquire scene information; wherein the scene information is used to indicate the scene in which the user is located; and in response to a first user operation, display a first motion effect in a first user interface based on the scene information; wherein the first motion effect includes a motion effect in which a display object performs a target interactive action within the scene indicated by the scene information.

[0017] Through this design, electronic devices can display the first animation of the display object performing the target interactive action in the user's scene, making the user feel that the display object is in the same scene as themselves, which can further enhance the rationality and realism of the display object performing the target interactive action.

[0018] In one possible design, the scene information includes at least one of the following: weather information, seasonal information, time information, temperature information of the user's environment, and the operating mode of the electronic device.

[0019] This design allows electronic devices to describe the user's scene from multiple perspectives, thereby enhancing the richness of the initial animation of the displayed object performing the target interactive action within that scene.

[0020] In one possible design, the electronic device can perform the process of displaying a first motion effect in a first user interface in response to a first user operation through the following steps:

[0021] The electronic device acquires the pose information of the displayed object; wherein the pose information is used to indicate the position and / or posture of the displayed object in the first user interface; and determines the target interactive action based on the first user operation and the pose information; the electronic device generates a first animation effect; finally, the electronic device can display the first animation effect in the first user interface.

[0022] This design allows the electronic device to determine the target interactive action in real time based on the user's operation and the position information of the displayed object. This enables the generation of a first animation effect in real time, whereby the object performs the target interactive action. The first animation effect displayed on the first user interface serves both as a response to the user's operation and matches the object's position and / or posture on the user interface before performing the target interactive action. This ensures the target interactive action seamlessly connects to the object's position and / or posture before the action, guaranteeing the continuity of the first animation effect and enhancing its display quality. Furthermore, since the first animation effect is generated in real time, there is no need to pre-save sequence frames or video within the first theme. Therefore, this method reduces the storage space occupied by the first theme, enhances the richness, realism, and engaging nature of the animation effects within the first theme, and is suitable for various complex and dynamic application scenarios.

[0023] In one possible design, the electronic device can determine the skeletal point movement data of the displayed object based on the pose information and the target's interactive actions, and generate a first motion effect based on the skeletal point movement data.

[0024] Based on this, electronic devices can generate motion effects for displayed objects using skeletal animation technology.

[0025] In one possible design, after the electronic device displays a first user interface on the screen, and while displaying a first notification message on the first user interface, a second animation effect of the displayed object is displayed on the first user interface; the second animation effect is used to indicate the existence of the first notification message.

[0026] This design also allows electronic devices to use animations of displayed objects to provide notifications and reminders, thereby enhancing the functionality and richness of the animations.

[0027] In one possible design, the second motion effect is determined based on at least one of the following: the type of the first notification message, the location of the first notification message, and the content of the first notification message.

[0028] In one possible design, the electronic device may also display a second user interface on the screen; and when the second notification message is displayed in the second user interface, a third animation effect of the displayed object is displayed in the second user interface; the third animation effect is used to indicate the existence of the second notification message.

[0029] This design also allows electronic devices to use animations of displayed objects to provide notifications and reminders, thereby enhancing the functionality and richness of the animations.

[0030] In one possible design, the third motion effect is determined based on at least one of the following:

[0031] The type of the second notification message, the location of the second notification message, and the content of the second notification message.

[0032] In one possible design, the electronic device is a foldable electronic device; the foldable electronic device includes a main screen and a secondary screen; when the electronic device is in a folded state, the primary user interface is displayed on the secondary screen.

[0033] With this design, when the electronic device is in a folded state, it can display a user interface containing the displayed object on a secondary screen, so as to display the animation effects of the displayed object interacting with the user on the secondary screen.

[0034] Secondly, embodiments of this application provide an electronic device including a display screen, one or more processors, and a memory; the one or more processors are coupled to the memory, and the one or more processors are used to read a computer program stored in the memory to execute the method provided in the first aspect. The computer program code includes computer instructions.

[0035] Thirdly, embodiments of this application provide a chip including a processor coupled to a memory. The processor is used to call computer program instructions stored in the memory during runtime to implement the method provided in the first aspect. Optionally, the chip may also include components such as a memory, a communication interface, and a power supply module. The memory is used to store computer programs; the communication interface is used to receive and send data; and the power supply unit is used to supply power to the processor.

[0036] Fourthly, embodiments of this application provide a computer storage medium storing computer program instructions that, when executed on an electronic device, cause the computer to perform the method provided in the first aspect.

[0037] Fifthly, embodiments of this application provide a computer program product, which includes computer program instructions; when the computer program instructions are run on a computer, the computer performs the method provided in the first aspect.

[0038] The technical effects that can be achieved by any of the second to fifth aspects mentioned above can be described with reference to the technical effects that can be achieved by any possible design in the first aspect mentioned above. The repetition will not be discussed. Attached Figure Description

[0039] Figure 1 is an example of a user interface for setting animation themes on an electronic device according to an embodiment of this application;

[0040] Figure 2 is a structural diagram of an electronic device provided in an embodiment of this application;

[0041] Figure 3 is a schematic diagram of the software structure of an electronic device provided in an embodiment of this application;

[0042] Figure 4 is a flowchart of an interactive method for displaying objects provided in an embodiment of this application;

[0043] Figure 5A is a flowchart of an interactive embodiment of a display object provided in this application;

[0044] Figure 5B is a schematic diagram illustrating an interactive example of a display object provided in an embodiment of this application;

[0045] Figure 5C is a schematic diagram illustrating an interactive example of a display object provided in an embodiment of this application;

[0046] Figure 6A is a flowchart of an interactive embodiment of a display object provided in this application;

[0047] Figure 6B is a schematic diagram illustrating an interactive example of a display object provided in an embodiment of this application;

[0048] Figure 7A is a flowchart of an interactive embodiment of a display object provided in this application;

[0049] Figure 7B is a schematic diagram illustrating an interactive example of a display object provided in an embodiment of this application;

[0050] Figure 8 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0051] This application provides an interactive method and electronic device for displaying objects, which enhances the animation display effect of objects in an animation theme, thereby improving the user experience.

[0052] The following explanations of some terms used in this application are provided to facilitate understanding by those skilled in the art.

[0053] 1) Electronic equipment refers to a device or apparatus that has data connectivity, data calculation and processing, and interface display functions.

[0054] For example, the electronic device in this application can be a tablet computer, personal computer (PC), laptop computer, computer, netbook, in-vehicle computer, smartphone, smart wearable device (e.g., smartwatch, smart bracelet, smart glasses, etc.). Of course, the electronic device can also be various portable devices, in-vehicle terminal devices, personal digital assistants (PDAs), smart home devices (e.g., smart TVs, etc.), and other smart devices. This application does not limit the specific form of the electronic device.

[0055] Electronic devices can perform their functions and provide services to users through the operating system they run. For example, electronic devices may, but are not limited to, running an operating system... Or other operating systems.

[0056] 2) The theme of an electronic device refers to the visual style and layout design of its user interface. An electronic device can save one or more themes. These themes may include, but are not limited to, themes preset in the operating system, themes provided by third-party applications, and themes downloaded by the user from a server. The user can choose to set one of the themes as the operating system theme for the electronic device. Typically, the default theme used when an electronic device is first turned on is the operating system's preset theme. The main interface, lock screen, and other user interfaces displayed on the electronic device conform to the visual style and layout design defined by the currently set theme.

[0057] Traditional theme schemes may include at least one of the following: wallpaper, background design, color scheme, font and text style, icon design, control style, display element layout and spacing, motion design, navigation mode, light and dark mode, etc.

[0058] The wallpaper in a theme with animation effects (hereinafter referred to as an animation theme) can be a live wallpaper. Additionally, an animation theme can also include objects that interact with the user, i.e., display objects. These display objects can be displayed in the wallpaper or in other user interfaces opened by the user. For example, as shown in Figures 1(a), (b), and (c), after setting an animation theme, the electronic device can display the display objects from that animation theme in user interfaces such as the lock screen, main screen, and settings screen.

[0059] It should be noted that this application does not limit the specific image of the displayed object in the animation theme; it can be a person or animal created through animation technology, or an abstract object, etc. In some scenarios, the displayed object can also be called a "desktop pet".

[0060] 3) User operation refers to the process by which a user interacts with an electronic device directly or indirectly through input devices to perform a specific task or achieve a certain function. For example, user operation may include interface operations performed by the user on the user interface displayed on the electronic device, user voice input operations, and user behavioral activities including user body movements and / or facial expressions.

[0061] Optionally, user actions can describe the behavioral activities of a user during the use of an electronic device.

[0062] It should be understood that in the embodiments of this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.

[0063] In the embodiments of this application, descriptions such as "when," "under the circumstances," "if," and "if" all refer to the electronic device making corresponding processing under certain objective circumstances. They are not time limits, nor do they require the electronic device to make a judgment action when implementing it, nor do they imply any other limitations.

[0064] It should be noted that in this application, "for indicating" can include both direct and indirect indication. When describing information as indicating A, it can include whether the information directly or indirectly indicates A, but does not necessarily mean that the information contains A. Taking first information indicating first content as an example, the first information can contain the first content, or a part of the first content, or an identifier or index of the first content, and can also contain algorithms or calculation parameters for determining the first content. This application does not limit the manner of "indication".

[0065] In this application, "containing / including A" may be equivalent to "containing / including information A". Information A is used to indicate A.

[0066] In addition, it should be understood that in the description of this application, the words "first" and "second" are used only for the purpose of distinguishing descriptions and should not be construed as indicating or implying relative importance or order.

[0067] In some scenarios, to meet users' interactive needs for the user interface of electronic devices, users can set the theme of the electronic device to an animation theme. Animation themes are designed with display objects that can interact with the user. However, in one embodiment, animation themes typically use the playback of sequence frames or videos to achieve the animation effects of the display objects. Because this approach relies on a single and fixed sequence of frames or videos, it leads to problems such as disjointed and inconsistent animation effects and poor display quality. Furthermore, this approach requires a balance between the storage space occupied by the animation theme and the number of animations (i.e., the number of sequence frames or videos), resulting in animation themes occupying a large amount of storage space, and these animations are relatively simple and unsuitable for complex and ever-changing application scenarios.

[0068] Based on this, in order to improve the animation display effect of displayed objects in an animation theme, this application provides an interaction method for displayed objects and an electronic device. In this method, during the process of the electronic device displaying a first user interface containing displayed objects, a first animation effect can be displayed in the first user interface based on a first user operation, showing the displayed object performing a target interactive action. The displayed object is an object in an animation theme set by the electronic device. In the first animation effect, the target interactive action performed by the displayed object matches the position and / or posture of the displayed object before performing the target interactive action; that is, the target interactive action can be naturally connected to the position and / or posture of the displayed object before performing the target interactive action. Therefore, this method can ensure the continuity of performing the target interactive action based on the position and / or posture of the displayed object in the first user interface before performing the target action, thereby ensuring the continuity of the first animation effect of the displayed object. Through this method, the electronic device can naturally connect the display of the next animation effect of the displayed object based on the position and / or posture of the displayed object in the user interface, making the animation display of the displayed objects in the animation theme of the electronic device continuous and coherent, thereby ensuring the animation display effect of the displayed objects and improving the user experience.

[0069] Since this method does not require pre-designing the sequence frames or videos supporting the motion effects within the motion effect theme, it can also reduce the storage space occupied by the motion effect theme. Furthermore, based on user operations, electronic devices can interrupt the display of the next motion effect at any time during the display process of the displayed object's motion effect. The position and / or posture of the displayed object in the user interface before the next motion effect is displayed are diverse and related to specific user operations, enabling action responses based on user actions. Therefore, this method can enhance the richness, interactivity, and fun of the motion effects of the displayed objects in the motion effect theme, and can be applied to various complex and ever-changing application scenarios.

[0070] The solutions provided in the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0071] This application provides an electronic device capable of implementing the interactive method for display objects provided in this application. The structure of the electronic device provided in this application will be described below with reference to FIG2.

[0072] As shown in Figure 2, the electronic device 200 may include: a processor 210, an external memory interface 220, an internal memory 221, a USB interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, a headphone jack 270D, a sensor module 280, buttons 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a SIM card interface 295, etc.

[0073] Processor 210 may include one or more processing units. For example, processor 210 may include a central processing unit (CPU), an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the central nervous system and command center of electronic device 200. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution.

[0074] The processor 210 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. This memory can store instructions or data that the processor 210 has just used or that are used repeatedly. If the processor 210 needs to use the instruction or data again, it can retrieve it directly from this memory. By providing a memory, the number of times the processor 210 accesses data in the internal memory 221 can be reduced, thus reducing the processor 210's waiting time and improving system efficiency.

[0075] The interactive method for display objects provided in this application embodiment can be controlled by processor 210 or invoked by other components, such as invoking the software program of this application embodiment stored in internal memory 221, rendering the animation effects of the display object, and controlling the display screen 294 to display the user interface. Processor 210 may include different devices. For example, when integrating a CPU and a GPU, the CPU and GPU can cooperate to execute the interactive method for display objects provided in this application embodiment. For example, part of the software operation in the method is executed by the CPU, and another part of the algorithm related to the display of the user interface is executed by the GPU to obtain faster processing efficiency.

[0076] Display screen 294 is used to display images, videos, etc. Display screen 294 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 200 may include one or N displays 294, where N is a positive integer greater than 1. Display screen 294 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces (GUIs). For example, display screen 294 can display windows, photos, videos, web pages, or documents, etc. Furthermore, it is understood that in some embodiments, the status bar may also include Bluetooth icons, WiFi icons, external device icons, etc. In some embodiments, when the processor 210 detects a user's finger (or stylus, etc.) touching the display screen, in response to the touch operation, the processor 210 can execute the action corresponding to the touch operation. In some embodiments, when the processor 210 detects an input event from an external input device (e.g., mouse, keyboard, etc.) of the electronic device 200, in response to the input event, the processor 210 can execute the action corresponding to the input event. In the method provided in the embodiments of this application, when the electronic device starts an animation theme, the processor 210 can control the display screen 294 to display the display objects in the animation theme in the user interface, that is, static display objects or animation effects of display objects.

[0077] In this embodiment, the electronic device 200 is a foldable electronic device. Therefore, a display screen 294 of the electronic device 200 can be a single flexible display screen, or it can be a spliced ​​display screen composed of two rigid screens and a flexible screen located between the two rigid screens. By performing a folding operation on the electronic device 200, the display screen can change its folding state. Optionally, in the method provided in this embodiment, when the electronic device 200 is in a folded state, the electronic device 200 can display the user interface and animation effects of the displayed objects on the outer screen (the display screen exposed to the outside); when the electronic device 200 is in an unfolded state, the electronic device 200 can display the user interface and animation effects of the displayed objects on the inner screen or the unfolded screen (e.g., the dual-screen or triple-screen display screen in a tri-fold phone).

[0078] In some embodiments, depending on the different functions of the multiple displays 294 in the electronic device 200, the multiple displays 294 in the electronic device 200 may include a main screen and a secondary screen. The main screen is used to run the main tasks of the electronic device 200 to complete the main functions of the electronic device 200, such as making and receiving phone calls, browsing web pages, editing documents, watching videos, etc. The secondary screen, as an extended workspace, can run the secondary tasks of the electronic device 200. Optionally, the electronic device 200 can be a foldable electronic device. When the electronic device 200 is in a folded state, the electronic device 200 can display a live wallpaper and its animation effects on the outer screen; additionally, when the electronic device 200 is in an unfolded state, the electronic device 200 can display a live wallpaper and its animation effects on the main screen.

[0079] Camera 293 is used to capture still images or videos. Optionally, electronic device 200 may include 1 to N cameras 293. For example, camera 293 may include a front-facing camera or a rear-facing camera, or a single camera 293 may function as both a front-facing and a rear-facing camera. Typically, camera 293 may include a photosensitive element such as a lens assembly and an image sensor. The lens assembly includes multiple lenses (convex or concave lenses) for collecting light signals reflected from the object to be photographed and transmitting the collected light signals to the image sensor. The image sensor generates a raw image of the object to be photographed based on the light signals.

[0080] Internal memory 221 can be used to store executable program code, which includes instructions. Processor 210 executes various functional applications and data processing of electronic device 200 by running the instructions stored in internal memory 221. Internal memory 221 may include a program storage area and a data storage area. The program storage area may store the operating system, program code for at least one application, etc. The operating system may include, but is not limited to, […]. The data storage area can store data created during the use of the electronic device 200, etc.

[0081] The internal memory 221 may also store one or more computer programs for performing the methods provided in the embodiments of this application. These one or more computer programs, stored in the internal memory 221 and configured to be executed by one or more processors 210, include instructions that can be used to perform the various steps in the embodiments of this application.

[0082] In addition, the internal memory 221 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0083] The sensor module 280 may include a fingerprint sensor, a touch sensor, a pressure sensor, a magnetic sensor, an ambient light sensor, a barometric pressure sensor, a bone conduction sensor, etc.

[0084] A touch sensor, also known as a "touch panel," can be located on the display screen 294. The touch sensor detects touch operations applied to or near it. It transmits the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided via the display screen 294. In other embodiments, the touch sensor may also be located on the surface of the electronic device 200, in a different position than the display screen 294.

[0085] The wireless communication function of electronic device 200 can be implemented through antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, modem processor, and baseband processor.

[0086] Antennas 1 and 2 are used to transmit and receive electromagnetic wave signals. Mobile communication module 250 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for use in electronic device 200. Wireless communication module 260 can provide wireless communication solutions, including wireless local area networks (WLAN) (such as Wi-Fi), Bluetooth, global navigation satellite system (GNSS), frequency modulation (FM), NFC, infrared (IR), and UWB, for use in electronic device 200.

[0087] In addition, the electronic device 200 can implement audio functions through an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, a headphone jack 270D, and an application processor. The electronic device 200 can receive key input 290, generating key signal inputs related to user settings and function control. The electronic device 200 can use a motor 291 to generate vibration alerts. The indicator 292 in the electronic device 200 can be an indicator light, used to indicate charging status, battery level changes, messages, missed calls, notifications, etc. The SIM card interface 295 in the electronic device 200 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 295 to achieve contact and separation with the electronic device 200.

[0088] In addition, in some scenarios, the electronic device 200 also has an input device interface for connecting input devices such as keyboards, mice, and gamepads. This input device interface can reuse the USB interface 230 or be a separately set up dedicated interface; this application does not limit this.

[0089] It should be understood that the electronic device 200 shown in Figure 2 is merely an example and does not constitute a limitation on the electronic device. In practical applications, the electronic device 200 may have more or fewer components than shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0090] Figure 2 illustrates the hardware structure of the electronic device. The software structure of the electronic device will be described below. The software system of the electronic device provided in this application embodiment can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses a layered architecture as an example, and the software structure of the electronic device is illustrated with reference to Figure 3.

[0091] A layered architecture divides the software within an electronic device into several layers, each with a clear role and function. Layers can communicate with each other through software interfaces. As shown in Figure 3, the software structure of an electronic device, from top to bottom, includes at least: an application layer, a system service layer, and a kernel layer. Additionally, an electronic device may include a hardware abstraction layer (HAL), which provides hardware resource support for the device.

[0092] The application layer is the top layer of the operating system, including the operating system's native applications and installed third-party applications, such as camera, gallery, calendar, Bluetooth, music, video, messaging, calculator, chat applications, video applications, music applications, electronic map applications, social applications, and so on.

[0093] The system service layer is an important part of the operating system of an electronic device, including various system services provided by the operating system. For example, the system service layer may include: window management service, operation management service, notification management service, layer management service, input management service, etc.

[0094] The window management service manages the display and configuration of windows. Based on display settings and multiple management functions, it controls the display of windows or interfaces on the screen, adjusting their transparency, position, and size. It can also lock the screen and take screenshots. The window management service can obtain parameters such as screen size and resolution, and identify display areas in the user interface, such as the status bar. Optionally, when the electronic device enters split-screen mode, the window management service can also manage the display and configuration of the window library in each split screen. When an electronic device sets a theme (such as an animation theme), the window management service can control the display of the user interface based on the display-related content defined in that theme. Optionally, when the electronic device's theme is an animation theme, the window management service can render animations of display objects in the animation theme on the user interface based on user actions through the layer management service.

[0095] The operation and management service is responsible for starting, switching, and scheduling various components in the system, as well as managing and scheduling applications.

[0096] Notification management services allow applications to display notification information in the status bar, as well as to convey informational messages. These messages can disappear automatically after a short pause, without requiring user interaction.

[0097] The input management service is used to collect, process, and distribute user operation information and input events. For example, the input management service can receive operation information reported by touch drivers or other input device drivers (such as keyboard drivers, mouse drivers, etc.), convert it into input events, and distribute the input events to other modules for processing.

[0098] Layer management service is a standalone service provided by the operating system of an electronic device. It is a resident service at the underlying level of the operating system. During device operation, this layer management service needs to run continuously, and the operating system will prioritize allocating resources to it to ensure that the service can perform image compositing at any time, thereby ensuring that the electronic device can display the user interface in real time.

[0099] Optionally, between the application layer and the system service layer, the software architecture of the electronic device may also include an application framework layer (FWK) (not shown in the figure). The application framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer may include some predefined functions. For example, the application framework layer may include a content provider, a view system, a resource manager, etc.

[0100] The kernel layer provides the core system services of the operating system, such as security, memory management, process management, network protocol stack, and driver models, all of which are implemented based on the kernel layer. The kernel layer also serves as an abstraction layer between the hardware and software stacks. This layer contains many drivers related to electronic devices, including: display drivers; keyboard drivers; mouse drivers; Flash drivers for memory-based devices; camera drivers; audio drivers; Bluetooth drivers; WiFi drivers; and touch drivers.

[0101] HAL (Hardware Abstraction Layer) is the interface layer between the operating system kernel and the hardware circuitry of an electronic device, and its purpose is to abstract the hardware. For example, HAL can include various sensors, displays, cameras, hardware composers (HWCs), and other hardware components in an electronic device. The HWC is primarily responsible for image compositing and display.

[0102] It should be noted that Figure 3 is merely an example of the software structure of an electronic device, simply listing some layers and software modules, and does not constitute any limitation on the software structure of the electronic device. In practical applications, the operating system of an electronic device may include other layers, or each layer may include other software modules for implementing one or more functions or services. Furthermore, the embodiments of this application do not limit the specific layer where each software module resides. For example, some system services in the system service layer may be deployed in the application framework layer or in the kernel layer.

[0103] Furthermore, this application does not specifically limit the names of the various software modules in the software structure. For example, in In operating systems, the window management service can be WindowManagerServer (WMS), the layer management service can be the layer management engine (SurfaceFlinger), and the input management service can be InputManagerService. operating system( In an OS, the window management service can be SceneBoard (SCB), the layer management service can be RenderService (RS), and the input management service can be multi-modal input service.

[0104] To enhance the animation display effect of objects in a motion effect theme, this application provides an interactive method for displaying objects. This method can be applied to the electronic device shown in Figure 2, and the software structure of the electronic device can be as shown in Figure 3. The method provided by the embodiments of this application will be described in detail below with reference to the flowchart shown in Figure 4.

[0105] As shown in the flowchart in Figure 4, the interactive method for displaying objects provided in this embodiment of the application includes:

[0106] S401: The electronic device displays a first user interface on a display screen, the first user interface containing display objects; the display objects are objects in a first theme set by the electronic device.

[0107] Before executing S401, the theme of the electronic device's operating system is this first theme. In one embodiment, the first theme is an animation theme. This application embodiment does not limit the type of the first user interface; as shown in FIG1, the first user interface can be a lock screen interface, a main interface, or other user interfaces.

[0108] In this application's embodiments, the display object refers to an object within the theme that can be displayed in the user interface. This application does not limit the specific image of the display object; it can be a character or animal created through animation technology, or an abstract object, etc. In some scenarios, the display object can also be called a "desktop pet." For example, as shown in Figure 1, the display object in the phone's animation theme is a desktop pet kitten.

[0109] As shown in the flowchart in Figure 4, the interactive method for displaying objects provided in this embodiment of the application further includes:

[0110] S402: In response to a first user operation, the electronic device displays a first motion effect in a first user interface. The first motion effect includes a motion effect of a displayed object performing a target interactive action, the target interactive action being matched with the position and / or posture of the displayed object in the first user interface before performing the target interactive action.

[0111] Based on the explanation of the terminology for user operation in point 3) above, in the embodiments of this application, the first user operation may include, but is not limited to:

[0112] User interface operations performed on the first user interface;

[0113] User voice input operation;

[0114] User behavior activities. These include user body movements and / or facial expressions. For example, a user's body movements can be any of the following: running, jumping, shaking, waving, walking, etc. A user's facial expressions can be any of the following: happy, laughing, smiling, surprised, angry, disgusted, afraid, sad, crying, contemptuous, etc.

[0115] In this embodiment of the application, the electronic device can detect the first user operation performed by the user through the following implementations A1-A3:

[0116] Implementation method A1: The electronic device can detect the interface operation performed by the user on the first user interface through the following steps:

[0117] When the first user operation is a touch operation performed by the user on the first user interface using a finger or stylus, the electronic device can detect the user's execution of the interface operation through the touch sensor; when the first user operation is an operation performed by the user on the first user interface using an external input device, the electronic device can detect the user's execution of the interface operation through the driver corresponding to the external input device.

[0118] Optionally, after the electronic device detects an interface operation performed by the user on the first user interface, it can also acquire operation information of that interface operation. The operation information may include at least one of the following: operation type and operation location. Optionally, the operation information may also include the operation time. Optionally, the interface operation can be any type of user operation performed by the user at any location on the display screen; this application does not limit this. For example, the operation type of the interface operation can be any of the following: single-click operation, double-click operation, drag operation, swipe operation, two-finger pinch operation, two-finger outward swipe operation, short press operation, long press operation, etc.

[0119] Implementation method A2: The electronic device can detect user voice input through a microphone. When the electronic device captures user voice through the microphone, it detects user voice input.

[0120] Implementation Method A3: The electronic device can detect user behavior through the following steps: The electronic device can acquire sensor data collected by sensors; and determine user behavior based on the sensor data. The sensor data may include at least one of the following: scene images containing the user captured by a camera (such as a front-facing or rear-facing camera), sensor data collected by a gyroscope sensor, and sensor data collected by an accelerometer sensor. Optionally, the electronic device can perform image recognition on at least one scene image containing the user to determine the user's body movements or facial expressions. The electronic device can also analyze the sensor data collected by the gyroscope sensor or accelerometer sensor to determine the user's body movements.

[0121] Optionally, in one implementation, the electronic device may activate the microphone or the aforementioned sensors during the process of displaying a user interface containing the displayed object, so that the microphone and these sensors can acquire data.

[0122] Optionally, in this embodiment, the target interactive action matches the position and / or posture of the displayed object before executing the target interactive action. This can be understood as the target interactive action being able to connect with the position and / or posture of the displayed object before executing the target interactive action. In some implementations, matching the target interactive action with the position and / or posture of the displayed object before executing the target interactive action may include the target interactive action being executed with the position and / or posture of the displayed object before executing the target interactive action as the initial state of the displayed object; or the starting state of the target interactive action being the position and / or posture of the displayed object before executing the target interactive action. For example, matching the position of the target interactive action with the position of the displayed object before executing the target interactive action means: the starting position of the displayed object executing the target interactive action in the first user interface is the position of the displayed object before executing the target interactive action. Another example is matching the posture of the target interactive action with the posture of the displayed object before executing the target interactive action means: the starting posture of the displayed object executing the target interactive action in the first user interface is the posture of the displayed object before executing the target interactive action, or the target interactive action executed by the displayed object is an action that the displayed object can perform in its posture before executing the target interactive action (i.e., an action that it is capable of performing, or an action that conforms to physical laws). Continuing with the example of the display object (desktop pet cat) in the mobile phone display animation theme in Figure 1, assuming the pet cat's position before performing the target interaction action is the first position, and its posture before performing the target interaction action is head down. In order to match the position and / or posture before performing the target interaction action, in one embodiment, the position of the pet cat performing the target interaction action can still be the first position, and the target interaction action can be from head down to head up and then performing a head shaking action, presenting a visual continuity of actions.

[0123] In one implementation, to match the target interactive action with the position and / or posture of the displayed object before performing the target interactive action, the electronic device can determine the target interactive action of the displayed object based on the pose information of the displayed object. The position information of the displayed object is used to indicate the position and / or posture of the displayed object in the first user interface before performing the target interactive action.

[0124] In this embodiment, the information upon which the target interactive action performed by the displayed object in the first animation is based varies depending on the first user operation detected by the electronic device. Optionally, this embodiment can use the following implementation methods B1-B3 to determine the target interactive action:

[0125] Implementation B1: When the first user operation includes an interface operation performed by the user on the first user interface, the target interactive action is related to the operation type and / or operation position of the interface operation. In one implementation, the relationship between the target interactive action and the operation type and / or operation position of the interface operation may include: the target interactive action may be determined by the electronic device based on the operation type and / or operation position of the interface operation. For example, the action type of the target interactive action may be determined based on at least one of the operation type and operation position of the interface operation; or information such as the start or end position of the target interactive action may be determined based on the operation position of the interface operation.

[0126] Optionally, during the execution of S402 by the electronic device, the electronic device may acquire the operation type and / or operation location of the interface operation, and determine the target interactive action of the displayed object based on the operation type and / or operation location of the interface operation.

[0127] Taking the displayed object (desktop pet cat) in the mobile phone display animation theme shown in Figure 1 as an example, when the user clicks on a blank area in the currently displayed user interface, the phone can display an animation of the cat running to the clicked location; when the user double-clicks on a blank area in the currently displayed user interface, the phone can display an animation of the cat running to the clicked location and nodding and jumping; when the user clicks on the head of the currently displayed cat, the phone can display an animation of the cat shaking its head; when the user clicks on the body of the currently displayed cat, the phone can display an animation of the cat shaking the area touched by the user.

[0128] Implementation B2: When the first user operation includes a user voice input operation, the target interactive action is matched with the semantic information of the user voice; wherein the user voice is collected when the electronic device detects the user voice input operation. In one implementation, matching the target interactive action with the semantic information of the user voice may include: the target interactive action being the same as the action in the semantic information, or the target interactive action being a response action to the semantic information.

[0129] Optionally, during the execution of S402 by the electronic device, the electronic device may collect the user's voice through a microphone when it detects that the user is performing a user voice input operation, and recognize the semantic information of the user's voice; then the electronic device may determine the target interactive action of the displayed object based on the semantic information of the user's voice.

[0130] Continuing with Figure 1 as an example, in a scenario where the mobile phone displays a user interface containing a desktop pet cat, when the user says "cat eats," the phone can display an animation of the cat eating; when the user says "cat plays the piano," the phone can display an animation of the cat playing the piano; and when the user says "full," the phone can display an animation of the cat lying down and rubbing its belly.

[0131] Implementation B3: When the first user operation includes user behavior activities, the target interactive action is matched with the user's body movements and / or facial expressions included in the user behavior activities. In one implementation, matching the target interactive action with the user's body movements included in the user behavior activities may include: the target interactive action being the same as the user's body movements, or the target interactive action being a response action to the user's body movements; matching the target interactive action with the user's facial expressions included in the user behavior activities may include: the target interactive action being the same as the user's facial expressions, or the target interactive action being a response action to the user's facial expressions.

[0132] Optionally, during the execution of S402 by the electronic device, when the electronic device detects user behavior activity, the target interactive action of the displayed object can be determined based on the user behavior activity.

[0133] Continuing with Figure 1 as an example, in a scenario where the phone displays a user interface featuring a desktop pet cat, when the user waves at the front camera, the phone can display the animation of the cat running towards the user; when the user makes an angry expression at the rear camera, the phone can display the animation of the cat wagging its tail and shaking its head; and when the user jumps while holding the phone, the phone can display the animation of the cat jumping.

[0134] It should also be noted that the above implementation methods B1-B3 can be implemented individually or in combination, and this application does not limit this.

[0135] Optionally, in this embodiment of the application, S402 can be executed internally by the electronic device through the following steps:

[0136] Step 4021: The electronic device acquires the pose information of the displayed object; wherein the pose information is used to indicate the position and / or posture of the displayed object in the first user interface before performing the target interactive action.

[0137] Optionally, in one implementation, the electronic device can record and update the posture state information of the display object in real time during the display process. Therefore, when executing step 4021, the electronic device can read the recorded posture state information of the display object. In another implementation, in a scenario where the electronic device uses skeletal animation technology to generate the motion effect of the display object, when executing step 4021, the electronic device can determine the latest skeletal point position data of the display object. This skeletal point position data can also reflect the posture of the display object. The electronic device can also obtain the physical position information of the display object in the first user interface, such as the outline of the display object or the coordinate information of key points.

[0138] Based on this, the electronic device can use at least one of the following as the pose information of the display object: the posture state information of the display object obtained through the above implementation method, the skeletal point position data, and the physical position information of the display object obtained in the first user interface:

[0139] Step 4022: The electronic device can determine the target interactive action based on the first user's operation and the pose information of the displayed object.

[0140] In this step, the electronic device can determine the target interactive action according to the first user's operation and pose information, based on a set rule. This ensures that the target interactive action can serve as a response to the first user's operation and matches the position and / or posture of the display object on the first user interface before performing the target interactive action. This fulfills the conditions met by the target interactive action in at least one of the embodiments B1 to B3 described above. Therefore, it ensures that the target interactive action performed by the display object in the first animation can be naturally connected to the position and / or posture of the display object on the first user interface before performing the action, thereby ensuring the continuity of the target interactive action performed by the display object in the first animation and its interactivity with the user. The set rule can be designed based on factors such as the smoothness of the action, conformity to physical laws, context matching, and conformity to the image characteristics of the display object, thereby ensuring the rationality and realism of the display object performing the target interactive action.

[0141] Optionally, when the first user operation includes an interface operation performed by the user on the first user interface, the electronic device can determine the target interactive action based on the operation type and / or operation position of the interface operation, as well as the pose information of the displayed object.

[0142] Optionally, when the first user operation includes a user voice input operation, the electronic device can determine the target interactive action based on the semantic information of the recognized user voice and the pose information of the displayed object, so that the target interactive action matches the semantic information of the user voice.

[0143] Optionally, when the first user operation includes user behavior activities, the electronic device determines the target interactive action based on the user behavior activities and the pose information of the displayed object, so that the target interactive action matches the body movements and / or facial expressions included in the user behavior activities, and can serve as an action response to the user's body movements and / or facial expressions.

[0144] Step 4023: The electronic device can determine the target interactive action based on step 4022 and generate the first motion effect.

[0145] Step 4024: The electronic device displays the first animation in the first user interface.

[0146] Through steps 4021-4024 above, the electronic device can determine the target interactive action in real time based on the first user's operation and the position information of the displayed object. This allows for the real-time generation of a first animation effect of the displayed object performing the target interactive action. The first animation effect displayed by the electronic device on the first user interface serves both as a response to the first user's operation and as a match for the position and / or posture of the displayed object on the first user interface before performing the target interactive action. This ensures the continuity of the first animation effect displayed by the electronic device, thereby improving the display effect of the displayed object's animation. Furthermore, since the first animation effect is generated in real time by the electronic device, there is no need to pre-save sequence frames or videos within the first theme. Therefore, this method can also reduce the storage space occupied by the first theme, enhance the richness, realism, and fun of the animation effects of the displayed objects within the first theme, and is suitable for various complex and ever-changing application scenarios.

[0147] Optionally, in step 4023, the electronic device may generate data for the first motion effect based on the target interactive action, and generate the first motion effect based on the data for the first motion effect.

[0148] In one implementation, the data for the first motion effect may include multiple image frame data within the first motion effect. After determining the target interactive action of the display object, in step 4023, the electronic device can sequentially generate multiple image frame data for the first motion effect according to the target interactive action; the electronic device can sequentially render and generate one image frame of the first motion effect based on each generated image frame data, thereby generating the first motion effect. Then, in step 4024, the electronic device can sequentially display these image frames in the first user interface, thereby realizing the display of the first motion effect in the first user interface.

[0149] In another implementation, where the electronic device supports generating motion effects for displayed objects using skeletal animation technology, the data for the first motion effect may include the skeletal point movement data of the displayed object. That is, in step 4023, the electronic device can determine the skeletal point movement data of the displayed object based on its pose information and the target interaction action. Thus, the electronic device can generate the first motion effect based on the skeletal point movement data of the displayed object. As in the previous implementation, the electronic device can generate multiple image frames of the first motion effect based on the skeletal point movement data of the displayed object.

[0150] In one embodiment of this invention, the electronic device may also respond to the first user operation by playing the target interactive sound of the displayed object, thereby realizing the voice interaction between the displayed object and the user in the first theme. Similar to the electronic device determining the target interactive action in step 4022, the electronic device may also determine the target interactive sound of the displayed object according to a set rule and based on the first user operation (optionally, it may also be based on the position information of the displayed object), so as to ensure the rationality and realism of the target interactive sound emitted by the displayed object.

[0151] In one embodiment of this invention, in step S402, the electronic device may further display a first animation effect of the displayed object by referring to scene information of the user's current scene. Specifically, this includes the following steps: the electronic device acquires scene information; wherein the scene information indicates the user's current scene. Thus, when executing step S402, the electronic device can respond to a first user operation and display a first animation effect in the first user interface based on the scene information. In this embodiment, the first animation effect is a first animation effect of the displayed object performing a target interactive action within the scene indicated by the scene information.

[0152] Through this design, the electronic device can display the first animation of the displayed object performing a target interactive action within the user's scene. This allows the user to feel that the displayed object is in the same scene as themselves, further enhancing the realism and plausibility of the displayed object performing the target interactive action. Optionally, during step 4022, the electronic device can determine the target interactive action based on the first user operation, the pose information of the displayed object, and the scene information.

[0153] Optionally, the scene information includes at least one of the following: weather information, seasonal information, time information, temperature information of the user's environment, and the operating mode of the electronic device. In this way, the electronic device can describe the user's scene from multiple perspectives, thereby enhancing the richness of the first animation of the displayed object performing target interactive actions within that scene. Continuing with Figure 1 as an example, when the weather information indicates that the user's scene is raining, the phone can display animations of a kitten performing various actions under an umbrella; when the seasonal information indicates that the user's scene is winter, the phone can display animations of a kitten wearing thick clothes performing various actions; when the time information indicates that the user's scene is nighttime, the phone can display animations of a kitten performing various actions on a bed; when the temperature information of the user's environment indicates that the user's scene is hot, the phone can display animations of a kitten sweating while performing various actions; and when the electronic device's operating mode is airplane mode, the phone can display animations of a kitten performing various actions on an airplane.

[0154] Optionally, electronic devices can obtain scene information in various ways. For example, they can access weather applications to obtain weather, seasonal, and temperature information; or they can access calendar applications to obtain seasonal information. Furthermore, they can obtain time information and operating modes based on operating system data.

[0155] Alternatively, in S401, the electronic device may also display the display object in the first user interface with reference to the scene information, as detailed above, and will not be repeated here. That is, in S401, the display object displayed by the electronic device in the initial state of the first user interface is the display object within the scene indicated by the scene information.

[0156] In this embodiment, the electronic device can also notify and remind the user through the animation effects of the displayed object, so as to improve the functionality and richness of the animation effects of the displayed object, as specifically implemented as described in the following embodiments:

[0157] In one embodiment, when the electronic device displays a first notification message in a first user interface containing a display object, the electronic device may display a second animation effect of the display object in the first user interface; the second animation effect is used to indicate the existence of the first notification message. Optionally, the electronic device may determine the second animation effect based on at least one of the type of the first notification message, the location of the first notification message, and the content of the first notification message.

[0158] For example, the second animation effect could be a display object running to the location of the first notification message and rotating at that location. Another example is that the electronic device displays this second animation effect when the type of the first notification message is a user-defined or default notification type for the first theme; for other notification messages that do not belong to this default notification type, the electronic device may not display the animation effect for the display object. Yet another example is that the action performed by the display object in the second animation effect is related to the content of the first notification message.

[0159] In another embodiment, when the electronic device displays a second notification message in a second user interface on the display screen, the electronic device may display a third animation effect for the displayed object in the second user interface; the third animation effect is used to indicate the existence of the second notification message. Optionally, the electronic device may determine the third animation effect based on at least one of the type of the second notification message, the location of the second notification message, and the content of the second notification message. The description of the electronic device displaying the third animation effect can refer to the description of displaying the second animation effect in the previous embodiment, and will not be repeated here.

[0160] Optionally, the display object may not be displayed in the initial state of the second user interface. In this way, when the electronic device displays a notification message in a user interface that does not contain a display object, the electronic device can display an animation of the pop-up display object in that user interface to alert the user to the existence of a notification message.

[0161] It should also be noted that in scenarios where the electronic device is a foldable device and includes a main screen and a secondary screen, when the electronic device is in a folded state, the user interface containing the displayed objects can be displayed on the secondary screen. That is, the aforementioned first user interface is displayed on the secondary screen of the electronic device. Optionally, when the electronic device is in an unfolded state, the electronic device can display the user interface containing the displayed objects on the main screen.

[0162] In summary, this application provides an interactive method for displaying an object. Using this method, during the process of an electronic device displaying a first user interface containing a display object, a first animation effect can be displayed in the first user interface based on a first user operation, showing the display object performing a target interactive action. The display object is an object within a first theme set by the electronic device. In the first animation effect, the target interactive action performed by the display object matches the position and / or posture of the display object before performing the target interactive action; that is, the target interactive action can be naturally connected to the position and / or posture of the display object before performing the target interactive action. Therefore, this method can ensure the continuity of performing the target interactive action based on the position and / or posture of the display object in the first user interface before performing the target action, thereby ensuring the continuity of the first animation effect of the display object. Using this method, the electronic device can naturally connect the display object's next animation effect based on its position and / or posture in the user interface, making the animation display of the display object in the animation theme of the electronic device continuous and sequential, thereby ensuring the animation display effect of the display object and improving the user experience.

[0163] Since this method does not require pre-designing the sequence frames or videos supporting the motion effects within the motion effect theme, it can also reduce the storage space occupied by the motion effect theme. Furthermore, based on user operations, electronic devices can interrupt the display of the next motion effect at any time during the display process of the displayed object's motion effect. The position and / or posture of the displayed object in the user interface before the next motion effect is displayed are diverse and related to specific user operations, enabling action responses based on user actions. Therefore, this method can enhance the richness, interactivity, and fun of the motion effects of the displayed objects in the motion effect theme, and can be applied to various complex and ever-changing application scenarios.

[0164] Based on the methods provided in the above embodiments, this application also provides the following embodiments. The methods provided in each embodiment will be described below with reference to the accompanying drawings. Before executing each embodiment, the electronic device is currently set to a first theme of animation. The first theme includes objects that interact with the user, i.e., display objects.

[0165] In one embodiment, the electronic device can display animations of display objects in the first theme based on the interface operations performed by the user on the user interface, as shown in Figure 5A.

[0166] S501: An electronic device displays a first user interface on a display screen, wherein the first user interface contains display objects.

[0167] S502: The electronic device detects a first interface operation performed by a user on a first user interface and obtains operation information of the first interface operation. The operation information of the first interface operation includes at least one of the following: operation type and operation location.

[0168] S503: The electronic device determines the target interactive action of the displayed object based on the operation information of the first interface and the pose information of the displayed object. The position information of the displayed object indicates its current position and / or pose within the first user interface.

[0169] The specific process of this step can be referred to the relevant description in the embodiment shown in Figure 4, and will not be repeated here.

[0170] S504: The electronic device renders and displays the first animation of the display object performing the target interactive action in the first user interface.

[0171] In S504, the electronic device can determine the skeletal point movement data of the displayed object based on the pose information of the displayed object and the target interactive action; and perform a skeletal animation driving process based on the skeletal point movement data to render and display the first motion effect.

[0172] It should be noted that the method provided in this embodiment does not limit the operation position and operation type of the first interface operation; it can be any operation type performed by the user at any position on the display screen. Furthermore, the animation effects of the displayed objects on the electronic device will differ depending on the operation position and the type of interface operation.

[0173] Continuing with the example of the phone in Figure 1(a) displaying a pet cat on the lock screen:

[0174] The initial state of the cat on the lock screen is shown in Figure 5B(a). When the user taps the blank space to the left of the cat on the lock screen, the phone can display an animation of the cat running to the left to the user's tapped position, as shown in Figure 5B(b). When the user taps the blank space above the cat on the lock screen, the phone can display an animation of the cat jumping upwards and running to the user's tapped position, as shown in Figure 5B(c). When the user taps the blank space to the right of the cat on the lock screen, the phone can display an animation of the cat running to the right to the user's tapped position, as shown in Figure 5B(d). When the user taps the blank space below the cat on the lock screen, the phone can display an animation of the cat jumping downwards and running to the user's tapped position, as shown in Figure 5B(e).

[0175] When the user taps the cat's ears on the lock screen, the phone displays an animation of the cat trembling with anger, as shown in Figure 5C(a); when the user taps the cat's head on the lock screen, the phone displays an animation of the cat standing up happily, as shown in Figure 5C(b); when the user taps the cat's belly on the lock screen, the phone displays an animation of the cat sitting down alertly, as shown in Figure 5C(c); and when the user taps the cat's legs on the lock screen, the phone displays an animation of the cat lying down, as shown in Figure 5C(d).

[0176] In one embodiment, the electronic device can display the animation of the display object in the first theme based on the semantics of the user's voice input, as shown in Figure 6A.

[0177] S601: An electronic device displays a first user interface on a display screen, wherein the first user interface contains display objects.

[0178] S602: When an electronic device detects a user's voice input operation, it captures the user's voice through a microphone and identifies the semantic information of the user's voice.

[0179] This allows users to interact with the displayed objects via voice input.

[0180] S603: The electronic device determines the target interactive action of the displayed object based on the identified semantic information and the pose information of the displayed object. The position information of the displayed object is used to indicate the current position and / or pose of the displayed object in the first user interface.

[0181] The specific process of this step can be referred to the relevant description in the embodiment shown in Figure 4, and will not be repeated here.

[0182] S604: The electronic device renders and displays the first animation of the display object performing the target interactive action in the first user interface. This step is the same as S504 in Embodiment 1. For a detailed description, please refer to the description of S504 in Embodiment 1, which will not be repeated here.

[0183] The method provided in this embodiment allows users to interact with the displayed objects through voice input, enhancing the fun of the animation theme.

[0184] Continuing with the example of the phone in Figure 1(a) displaying a pet cat on the lock screen:

[0185] When the phone displays a lock screen interface featuring a desktop pet cat, the user makes a "playing piano" sound to the phone, as shown in Figure 6B(a); the phone can then display a cat playing piano animation on the lock screen interface, as shown in Figure 6B(b).

[0186] When the phone displays a lock screen interface featuring a desktop pet cat, the user makes a "eat" sound to the phone, as shown in Figure 6B(a); the phone can then display an animation of the cat eating on the lock screen interface, as shown in Figure 6B(c).

[0187] In one embodiment, the electronic device can display animations of display objects in the first theme based on user behavior activities, as shown in Figure 7A.

[0188] S701: An electronic device displays a first user interface on a display screen, wherein the first user interface contains display objects.

[0189] S702: Electronic devices collect sensing data through sensors and determine user behavior based on the sensing data. User behavior includes the user's body movements and / or facial expressions.

[0190] In this step, the process of the electronic device collecting sensor data and the process of determining the user's behavior information based on the sensor data can be referred to the description in S402 of the embodiment shown in Figure 4, and will not be repeated here.

[0191] S703: The electronic device determines the target interactive action of the displayed object based on user behavior and the pose information of the displayed object. The position information of the displayed object indicates its current position and / or posture within the first user interface.

[0192] The specific process of this step can be referred to the relevant description in the embodiment shown in Figure 4, and will not be repeated here.

[0193] S704: The electronic device renders and displays the first animation of the display object performing the target interactive action in the first user interface. This step is the same as S504 in Embodiment 1. For a detailed description, please refer to the description of S504 in Embodiment 1, which will not be repeated here.

[0194] The method provided in this embodiment allows users to interact with the displayed objects through various actions, enhancing the fun of the animation theme.

[0195] Continuing with the example of the phone in Figure 1(a) displaying a pet cat on the lock screen:

[0196] When the phone displays a lock screen with a desktop pet cat, the user can wave at the phone's front-facing camera, as shown in Figure 7B(a). The phone can then display a motion effect of the cat running and jumping on the lock screen, as shown in Figure 7B(b).

[0197] It should be noted that in the above embodiments, the concepts and explanations of the same terms can be referred to each other, and the same or similar steps can also be referred to each other. The above examples do not constitute any limitation on the methods provided in the embodiments of this application. Furthermore, since the accompanying drawings cannot fully illustrate the animation effects, the above examples are all schematic representations of display animation effects. It should be noted that in the animation effects of the display object shown in each example, the actions performed by the display object can be naturally connected to the position and / or posture of the display object in the user interface.

[0198] It should also be noted that each step in the above embodiments can be executed by the corresponding device, or by components such as chips, processors, or chip systems within that device. The embodiments of this application do not limit their execution. The above embodiments are merely illustrative examples of execution by the corresponding device. Furthermore, the specific implementation methods or examples in the above embodiments do not limit the solutions provided by the embodiments of this application.

[0199] It should be noted that in the above embodiments, some steps may be selected for implementation, and the order of the steps in the figures may be adjusted. This application does not limit this. It should be understood that performing some of the steps in the figures, adjusting the order of the steps, or combining them in a specific implementation all fall within the protection scope of this application.

[0200] It is understood that, in order to achieve the functions described in the above embodiments, each device involved in the above embodiments includes a hardware structure and / or software module corresponding to perform each function. Those skilled in the art should readily recognize that, based on the units and method steps of the various examples described in conjunction with the embodiments disclosed in this application, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.

[0201] It is understood that the architecture and application scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of the present invention, and do not constitute a limitation on the technical solutions provided by the embodiments of the present invention. As those skilled in the art will know, with the evolution of network architecture and the emergence of new services, the technical solutions provided by the embodiments of the present invention are also applicable to similar technical problems.

[0202] It should be noted that the "steps" in the embodiments of this application are merely illustrative and are intended to better understand one method of presentation used in the embodiments. They do not constitute a substantial limitation on the execution of the solution of this application. For example, the "step" can also be understood as a "feature". Furthermore, the steps do not constitute any limitation on the execution order of the solution of this application. Any changes to the order of steps, or the merging or splitting of steps made on this basis without affecting the overall solution implementation, resulting in a new technical solution, are also within the scope of disclosure of this application.

[0203] Based on the same concept, this application also provides an electronic device. As shown in FIG8, the electronic device 800 includes a display screen 801, one or more processors 802, and a memory 803. Optionally, the electronic device 800 may also include a transceiver 804. For example, the above-mentioned devices can be connected via one or more communication buses. The one or more computer programs are stored in the memory 803 and configured to be executed by the one or more processors 802. The one or more computer programs include instructions that can be used to cause the electronic device 800 to perform various steps of the methods in the above embodiments.

[0204] For example, the one or more processors 802 mentioned above can specifically be processor 210 in FIG2; the memory 803 mentioned above can specifically be memory 221 in FIG2. The transceiver 804 can be mobile communication module 250 or wireless communication module 260 in FIG2; the display screen 801 mentioned above can be display screen 294 in FIG2, and the embodiments of this application do not impose any limitations on this.

[0205] Based on the same concept, embodiments of this application also provide an electronic device, which includes units for performing the various steps of the methods provided in the above embodiments.

[0206] For details on the specific functions of each module, please refer to the above embodiments; they will not be repeated here.

[0207] Based on the above embodiments, this application also provides a computer program product, which includes instructions; when the computer program is run on a computer, it causes the computer to execute the method provided in the above embodiments.

[0208] Based on the above embodiments, this application also provides a computer-readable storage medium storing computer program instructions, which, when executed by a computer, cause the computer to perform the methods provided in the above embodiments.

[0209] Optionally, the aforementioned computer may include, but is not limited to, control devices.

[0210] The storage medium can be any available medium that a computer can access. For example, but not limited to, a computer-readable medium can include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.

[0211] Based on the above embodiments, this application also provides a chip for reading a computer program stored in a memory to implement the method provided in the above embodiments. Optionally, the chip may include a processor and a memory, wherein the processor is coupled to the memory and is used to read the computer program stored in the memory to implement the method provided in the above embodiments.

[0212] Based on the above embodiments, this application provides a chip system including a processor for supporting a computer device in implementing the functions involved in the control device in the above embodiments. In one possible design, the chip system further includes a memory for storing necessary programs and data of the computer device. This chip system may be composed of chips or may include chips and other discrete components.

[0213] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0214] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in one or more blocks of the flowchart illustrations and / or one or more blocks of the block diagrams.

[0215] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means that implement the functions specified in one or more flowcharts and / or one or more block diagrams.

[0216] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams.

Claims

1. An interactive method for displaying objects, applied to electronic devices, characterized in that, include: A first user interface is displayed on the screen, and the first user interface includes display objects; wherein the display objects are objects in a first theme set by the electronic device; In response to a first user operation, a first animation effect is displayed in the first user interface; wherein, the first animation effect includes an animation effect in which the displayed object performs a target interactive action, the target interactive action being matched with the position and / or posture of the displayed object before performing the target interactive action; The target interactive action is matched with the position and / or posture of the display object before the target interactive action is performed, including at least one of the following: In the first user interface, the starting position of the display object performing the target interactive action is the position of the display object before performing the target interactive action; In the first user interface, the starting posture of the display object when performing the target interactive action is the posture of the display object before performing the target interactive action.

2. The method as described in claim 1, characterized in that, The first user operation includes at least one of the following: User interface operations performed on the first user interface; User voice input operation; User behavior activities; wherein, the user behavior activities include the user's body movements and / or facial expressions.

3. The method as described in claim 2, characterized in that, When the first user operation includes an interface operation performed by the user on the first user interface, the target interactive action is related to the operation type and / or operation location of the interface operation; When the first user operation includes a user voice input operation, the target interactive action is matched with the semantic information of the user voice; wherein, the user voice is collected when the electronic device detects the user voice input operation; When the first user action includes user behavior activities, the target interactive action is matched with the body movements and / or facial expressions included in the behavior activities.

4. The method as described in claim 2 or 3, characterized in that, When the first user operation includes user behavior activity, the method further includes: Acquire the sensor data collected by the electronic device; The user's behavioral activity is determined based on the sensor data; The sensing data includes at least one of the following: scene images containing the user captured by the camera; sensing data captured by the gyroscope sensor; and sensing data captured by the accelerometer sensor.

5. The method according to any one of claims 1-4, characterized in that, After displaying the first user interface on the display screen, the method further includes: In response to the first user action, the target interactive sound of the displayed object is played.

6. The method according to any one of claims 1-5, characterized in that, The method further includes: Obtain scene information; wherein the scene information is used to indicate the scene in which the user is located; The step of responding to a first user operation by displaying a first animation effect in the first user interface includes: In response to the first user operation, the first animation effect is displayed in the first user interface according to the scene information; wherein, the first animation effect includes the animation effect of the displayed object performing the target interactive action within the scene indicated by the scene information.

7. The method as described in claim 6, characterized in that, The scene information includes at least one of the following: weather information, season information, time information, temperature information of the user's environment, and the working mode of the electronic device.

8. The method according to any one of claims 1-7, characterized in that, The step of responding to a first user operation by displaying a first animation effect in the first user interface includes: Obtain the pose information of the display object; wherein the pose information is used to indicate the position and / or posture of the display object in the first user interface before performing the target interactive action; The target interactive action is determined based on the first user operation and the pose information; Generate the first animation effect; The first animation effect is displayed in the first user interface.

9. The method as described in claim 8, characterized in that, The generation of the first motion effect includes: Based on the pose information and the target interaction action, determine the skeletal point movement data of the display object; The first motion effect is generated based on the skeletal point movement data.

10. The method according to any one of claims 1-9, characterized in that, After displaying the first user interface on the display screen, the method further includes: When the first notification message is displayed in the first user interface, a second animation effect of the display object is displayed in the first user interface; the second animation effect is used to indicate the existence of the first notification message.

11. The method as described in claim 10, characterized in that, The second motion effect is determined based on at least one of the following: The type of the first notification message, the location of the first notification message, and the content of the first notification message.

12. The method according to any one of claims 1-11, characterized in that, The method further includes: A second user interface is displayed on the screen; When the second notification message is displayed in the second user interface, a third animation effect of the display object is displayed in the second user interface; the third animation effect is used to indicate the existence of the second notification message.

13. The method as described in claim 12, characterized in that, The third motion effect is determined according to at least one of the following: The type of the second notification message, the location of the second notification message, and the content of the second notification message.

14. The method according to any one of claims 1-13, characterized in that, The electronic device is a foldable electronic device; the foldable electronic device includes a main screen and a secondary screen; when the electronic device is in a folded state, the first user interface is displayed on the secondary screen.

15. An electronic device, characterized in that, The electronic device includes: A display screen used to show the user interface; Memory is used to store computer program instructions; A processor for executing the computer program instructions to support the electronic terminal device in implementing the method as described in any one of claims 1-14.

16. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer program instructions that, when executed by a processing circuit, implement the method as described in any one of claims 1-14.

17. A computer program product containing instructions, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in any one of claims 1-14.

Images