Interaction method of display object and electronic equipment

Abstract

The embodiment of the invention provides a display object interaction method and electronic equipment, and the method comprises the steps: in a scene where the electronic equipment is provided with a first theme, in a process that the electronic equipment displays a first user interface containing a display object in the first theme, displaying the first user interface in the first theme; and in response to the first user operation, displaying a first dynamic effect of executing the target interaction action by the display object in the first user interface. Wherein the target interaction action executed by the display object in the first dynamic effect is matched with the position and / or posture of the display object in the first user interface, that is, the target interaction action can be naturally linked with the position and / or posture of the display object before executing the target interaction action, so that the display of the first dynamic effect is natural and coherent. According to the method, the dynamic effect display of the display object in the dynamic effect theme of the electronic equipment can be ensured to be coherent and continuous, so that the dynamic effect display effect of the display object is ensured, and the user experience is improved.

Description

Technical Field

[0001] This application relates to the technical field of electronic devices, and in particular, to an interaction method for display objects and an electronic device. Background Art

[0002] With the development of electronic technology, users have higher and higher requirements for the display effect of electronic devices. They not only require electronic devices to display gorgeous user interfaces but also hope to interact with users. Currently, electronic devices can achieve simple interaction with users through themes with animation effects. The animation theme generally uses the method of playing sequence frames or videos to implement the animation effects of display objects in the theme. This display method has poor display effects and ultimately affects the user experience. Summary of the Invention

[0003] Embodiments of this application provide an interaction method for display objects and an electronic device, which are used to improve the animation display effect of display objects in the animation theme, thereby improving the user experience.

[0004] In a first aspect, embodiments of this application provide an interaction method for display objects. This method can be applied to an electronic device. Here, the electronic device can refer to both the electronic device itself and the processor, module, chip, or chip system in the electronic device that implements this method. Taking the electronic device as an example for illustration below, this method includes the following steps:

[0005] The electronic device displays a first user interface on the display screen. The first user interface includes display objects; wherein, the display objects are objects in the first theme set by the electronic device; the electronic device responds to a first user operation and displays a first animation effect in the first user interface; wherein, the first animation effect includes the animation effect of the display object performing a target interaction action, and the target interaction action matches the position and / or posture of the display object before performing the target interaction action.

[0006] Through this method, during the process of the electronic device displaying a first user interface including a display object, a first dynamic effect of the display object performing a target interaction action can be displayed in the first user interface based on a first user operation. The display object is an object in a first theme set by the electronic device. Among them, in the first dynamic effect, the target interaction action performed by the display object matches the position and / or posture of the display object before performing the target interaction action, that is, the target interaction action can naturally connect to the position and / or posture of the display object before performing the target interaction action. Therefore, this method can ensure the coherence of performing the target interaction action based on the position and / or posture of the display object in the first user interface before performing the target action, thereby ensuring the coherence of the first dynamic effect of the display object. Through this method, the electronic device can naturally connect to display the next dynamic effect of the display object based on the position and / or posture of the display object in the user interface, making the dynamic effects of the display objects in the dynamic effect theme of the electronic device coherent and continuous, thereby ensuring the dynamic effect display effect of the display object and further enhancing the user experience.

[0007] In a possible design, the first user operation includes at least one of the following: an interface operation performed by the user on the first user interface; a user voice input operation; a user behavior activity; where the user behavior activity includes the user's body movements and / or facial expressions.

[0008] Through this design, the electronic device can display the dynamic effects of the display objects in the theme according to various user operations of the user, improving the flexibility of the user's interaction with the display objects, as well as the richness and fun of the dynamic effects of the display objects, so as to be applicable to various complex and changeable application scenarios.

[0009] In a possible design, when the first user operation includes an interface operation performed by the user on the first user interface, the target interaction action is related to the operation type and / or operation position of the interface operation; when the first user operation includes a user voice input operation, the target interaction action matches the semantic information of the user voice; where the user voice is input into the electronic device by the user through the user voice input operation; when the first user operation includes a user behavior activity, the target interaction action matches the body movements and / or facial expressions included in the behavior activity.

[0010] Through this design, the interaction actions of the display object in the dynamic effect of the display object can be determined based on the principles corresponding to different types of user operations.

[0011] In a possible design, when the first user operation includes a user behavior activity, the electronic device can also determine the user behavior activity through steps:

[0012] The electronic device obtains the sensing data collected by the sensors of the electronic device; and determines the user's behavioral activities according to the sensing data; wherein, the sensing data includes at least one of the following: the scene image containing the user collected by the camera; the sensing data collected by the gyroscope sensor; the sensing data collected by the acceleration sensor.

[0013] In a possible design, after displaying the first user interface on the display screen, the electronic device, in response to the first user operation, can also play the target interaction sound of the display object. Through this design, the sound interaction between the display object and the user in the first theme can be realized.

[0014] In a possible design, the electronic device can also obtain the scene information; wherein, the scene information is used to indicate the scene where the user is located; and in response to the first user operation, display the first special effect in the first user interface according to the scene information; wherein, the first special effect includes the special effect of the display object performing the target interaction action in the scene indicated by the scene information.

[0015] Through this design, the electronic device can display the first special effect of the display object performing the target interaction action in the scene where the user is located, which can make the user feel that the display object is in the same scene as itself, and can further improve the rationality and realism of the display object performing the target interaction action.

[0016] In a possible design, the scene information includes at least one of the following: weather information, season information, time information, temperature information of the environment where the user is located, the working mode of the electronic device.

[0017] Through this design, the electronic device can describe the scene where the user is located from multiple angles, and thus can improve the richness of the first special effect of the display object performing the target interaction action in the scene.

[0018] In a possible design, the electronic device can perform the process of displaying the first special effect in the first user interface in response to the first user operation through the following steps:

[0019] The electronic device obtains the pose information of the display object; wherein, the pose information is used to indicate the position and / or pose of the display object in the first user interface; and determines the target interaction action according to the first user operation and the pose information; the electronic device generates the first special effect; finally, the electronic device can display the first special effect in the first user interface.

[0020] With this design, the electronic device can determine the target interaction action in real time based on the first user operation and the position information of the display object, and thus can generate the first dynamic effect of the display object performing the target interaction action in real time. The first dynamic effect displayed by the electronic device on the first user interface can not only be a response to the first user operation, but also match the position and / or posture of the display object on the first user interface before performing the target interaction action, that is, ensure that the target interaction action can be naturally connected to the position and / or posture of the display object before performing the target interaction action, so as to ensure the coherence of the first dynamic effect displayed by the electronic device, and further improve the display effect of the dynamic effect of the display object. In addition, since the first dynamic effect is generated by the electronic device in real time and there is no need to pre-store sequence frames or videos in the first theme, this method can also reduce the storage space occupied by the first theme, improve the richness, interactive realism and sense of fun of the dynamic effect of the display object in the first theme, and is applicable to various complex and changeable application scenarios.

[0021] In a possible design, the electronic device can determine the bone point movement data of the display object according to the pose information and the target interaction action, and generate the first dynamic effect according to the bone point movement data.

[0022] Based on this, the electronic device can generate the dynamic effect of the display object through bone animation technology.

[0023] In a possible design, after the electronic device displays the first user interface on the display screen, when displaying the first notification message in the first user interface, it displays the second dynamic effect of the display object in the first user interface; the second dynamic effect is used to prompt the existence of the first notification message.

[0024] With this design, the electronic device can also perform notification reminders through the dynamic effect of the display object, so as to improve the functionality and richness of the dynamic effect of the display object.

[0025] In a possible design, the second dynamic effect is determined according to at least one of the following: the type of the first notification message, the position of the first notification message, and the content of the first notification message.

[0026] In a possible design, the electronic device can also display the second user interface on the display screen; and when displaying the second notification message in the second user interface, it displays the third dynamic effect of the display object in the second user interface; the third dynamic effect is used to prompt the existence of the second notification message.

[0027] With this design, the electronic device can also perform notification reminders through the dynamic effect of the display object, so as to improve the functionality and richness of the dynamic effect of the display object.

[0028] In a possible design, the third dynamic effect is determined according to at least one of the following:

[0029] The type, location, and content of the second notification message.

[0030] In a possible design, the electronic device is a foldable electronic device; the foldable electronic device includes a main screen and a secondary screen; when the electronic device is in a folded state, the first user interface is displayed on the secondary screen.

[0031] With this design, when the electronic device is in a folded state, the electronic device can display a user interface containing a display object on the secondary screen to display the animation effect of the interaction between the display object and the user on the secondary screen.

[0032] In a second aspect, an embodiment of the present application provides an electronic device, which includes a display screen, one or more processors, and a memory; the one or more processors are coupled to the memory, and the one or more processors are configured to read the computer program stored in the memory to execute the method provided in the first aspect. Among them, the computer program code includes computer instructions.

[0033] In a third aspect, an embodiment of the present application provides a chip, which includes a processor, the processor is coupled to the memory, and the processor is configured to call the computer program instructions stored in the memory during operation to implement the method provided in the first aspect. Optionally, the chip may further include components such as a memory, a communication interface, and a power supply module. The memory is used to store computer programs; the communication interface is used to receive and send data; the power supply unit is used to supply power to the processor.

[0034] In a fourth aspect, an embodiment of the present application provides a computer storage medium, which stores computer program instructions, and when the computer program instructions run on an electronic device, the computer is caused to execute the method provided in the first aspect.

[0035] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes computer program instructions; when the computer program instructions run on a computer, the computer is caused to execute the method provided in the first aspect.

[0036] The technical effects that can be achieved by any one of the second to fifth aspects above can be described with reference to the technical effects that can be achieved by any one of the possible designs in the first aspect, and the repeated parts will not be elaborated. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 It is a schematic diagram of a user interface for setting an animation theme of an electronic device provided by an embodiment of the present application;

[0038] Figure 2 It is a structural diagram of an electronic device provided by an embodiment of the present application;

[0039] Figure 3 Schematic diagram of the software structure of an electronic device provided by an embodiment of the present application;

[0040] Figure 4 Flowchart of an interaction method for a display object provided by an embodiment of the present application;

[0041] Figure 5A Flowchart of an interaction embodiment for a display object provided by an embodiment of the present application;

[0042] Figure 5B Schematic diagram of an interaction example for a display object provided by an embodiment of the present application;

[0043] Figure 5C Schematic diagram of an interaction example for a display object provided by an embodiment of the present application;

[0044] Figure 6A Flowchart of an interaction embodiment for a display object provided by an embodiment of the present application;

[0045] Figure 6B Schematic diagram of an interaction example for a display object provided by an embodiment of the present application;

[0046] Figure 7A Flowchart of an interaction embodiment for a display object provided by an embodiment of the present application;

[0047] Figure 7B Schematic diagram of an interaction example for a display object provided by an embodiment of the present application;

[0048] Figure 8 Schematic diagram of the structure of an electronic device provided by an embodiment of the present application. Detailed implementation manners

[0049] The present application provides an interaction method for a display object and an electronic device, which are used to improve the animation display effect of the display object in the animation theme, thereby improving the user experience.

[0050] The following explains some terms in the present application to facilitate the understanding of those skilled in the art.

[0051] 1), The electronic device is a device or apparatus with data connection function, data calculation and processing, and interface display function.

[0052] Exemplarily, the electronic device in the present application may be a tablet computer, a personal computer (PC), a laptop computer, a computer, a netbook, a vehicle-mounted computer, a smart phone, a smart wearable device (such as a smart watch, a smart bracelet, smart glasses, etc.). Of course, the electronic device may also be various portable devices, vehicle-mounted terminal devices, personal digital assistants (PDAs), smart home devices (such as smart TVs, etc.) and other smart devices. The present application does not limit the specific form of the electronic device.

[0053] The electronic device can implement its functions through the operating system installed, providing services for users. Exemplarily, the electronic device may but is not limited to be installed with or other operating systems.

[0054] 2) The theme of the electronic device refers to the visual style and layout design of the user interface of the electronic device. The electronic device can save one or more themes. These themes may but are not limited to include the themes preset in the operating system, the themes provided by third-party applications, and the themes downloaded by the user from the server. The user can select and set one of the themes as the theme of the operating system of the electronic device. Usually, the default theme adopted when the electronic device is powered on for the first time is the theme preset in the operating system. The main interface, the lock screen interface, and other user interfaces displayed on the electronic device conform to the visual style and layout design defined by the theme currently set on the electronic device.

[0055] Traditional theme solutions may include at least one of the following: wallpaper, background design, color scheme, font and text style, icon design, control style, display element layout and spacing, animation design, navigation mode, light and dark mode, etc.

[0056] The wallpaper in a theme with animation function (hereinafter referred to as the animation theme for short) can be a dynamic wallpaper. In addition, the animation theme may also include an object that interacts with the user, that is, a display object. The display object can be displayed in the wallpaper and can also be displayed in other user interfaces opened by the user. Exemplarily, as Figure 1 shown in (a), (b), and (c) below, after setting the animation theme, the electronic device can display the display object in the animation theme in user interfaces such as the lock screen interface, the main interface, and the settings interface.

[0057] It should be noted that the present application does not limit the specific image of the display object in the animation theme. It can be a character, an animal created through animation technology, or an abstract object, etc. In some scenarios, the display object can also be called a "desktop pet".

[0058] 3) User operation, that is, the process in which a user directly or indirectly interacts with an electronic device through an input device or the like to perform a specific task or achieve a certain function. Exemplarily, the user operation may include interface operations performed by the user on the user interface displayed on the electronic device, user voice input operations, and user behavior activities including the user's body movements and / or facial expressions.

[0059] Optionally, the user operation may describe the behavior activities of the user during the process of using the electronic device.

[0060] It should be understood that in the embodiments of the present application, "at least one" means one or more, and "a plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects before and after. "At least one (item) of the following" or its similar expressions refer to any combination of these items, including any combination of single item (s) or plural item (s). For example, at least one (item) of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.

[0061] In the embodiments of the present application, descriptions such as "when...", "in the case of...", "if", and "when" all refer to the corresponding processing that the electronic device will perform under a certain objective situation, which does not limit the time, and does not require the electronic device to have a judgment action during implementation, nor does it mean that there are other limitations.

[0062] It should be noted that in the present application, "used to indicate" may include used to directly indicate and used to indirectly indicate. When describing that a certain piece of information is used to indicate A, it may include that the information directly indicates A or indirectly indicates A, and does not mean that A must be carried in the information. Taking the first piece of information used to indicate the first content as an example, the first piece of information may include the first content, or a part of the first content, or an identifier, index, etc. of the first content, and may also include an algorithm, calculation parameters, etc. for determining the first content. The present application does not limit the manner of "indicating".

[0063] In the present application, "including / comprising A" may be equivalent to "including / comprising A information". A information is used to indicate A.

[0064] In addition, it should be understood that in the description of the present application, terms such as "first" and "second" are only used for the purpose of distinguishing descriptions, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.

[0065] In some scenarios, to meet the user's interaction requirements for the user interface of an electronic device, the user can set the theme of the electronic device to an animated theme. The animated theme is designed with display objects that can interact with the user. However, in one embodiment, the animated effect of the display object in the animated theme is generally achieved by playing a sequence of frames or a video. Since the animated effect of this solution depends on a single and fixed sequence of frames or video, it will cause problems such as the discontinuous and non-sequential animated effect of the display object and poor display effect. In addition, this solution needs to balance between the storage space occupied by the animated theme and the number of animated effects (i.e., the number of sequence frames or videos), resulting in a relatively large storage space occupied by the animated theme, and these animated effects are also relatively single and not suitable for complex and changeable application scenarios.

[0066] Based on this, in order to improve the animated effect display of the display object in the animated theme, the present application provides a method for interacting with a display object and an electronic device. In this method, during the process of the electronic device displaying a first user interface including a display object, a first animated effect of the display object performing a target interaction action can be displayed in the first user interface based on a first user operation. The display object is an object in the animated theme set for the electronic device. Among them, the target interaction action performed by the display object in the first animated effect matches the position and / or posture of the display object before performing the target interaction action, that is, the target interaction action can naturally connect with the position and / or posture of the display object before performing the target interaction action. Therefore, this method can ensure the coherence of performing the target interaction action based on the position and / or posture of the display object in the first user interface before performing the target action, thereby ensuring the coherence of the first animated effect of the display object. Through this method, the electronic device can naturally connect and display the next animated effect of the display object based on the position and / or posture of the display object in the user interface, making the animated effect display of the display object in the animated theme of the electronic device coherent and sequential, thereby ensuring the animated effect display of the display object and improving the user experience.

[0067] Since this method does not require pre-designing sequence frames or videos to support the animated effect in the animated theme, this method can also reduce the storage space occupied by the animated theme. In addition, based on the user operation, the electronic device can interrupt the display of the next animated effect at any time during the display process of the animated effect of the display object, and the position and / or posture of the display object in the user interface before the display of the next animated effect are diverse and related to specific user operations, and can respond to actions according to user operations. Therefore, this method can improve the richness, interactive realism and sense of fun of the animated effect of the display object in the animated theme, and can be applied to various complex and changeable application scenarios.

[0068] The following will describe in detail the solution provided by the embodiments of the present application with reference to the accompanying drawings.

[0069] An embodiment of the present application provides an electronic device, which can implement the interaction method of the display object provided by the embodiment of the present application. The following refers to Figure 2 to introduce the structure of the electronic device provided by the embodiment of the present application.

[0070] As Figure 2 shown, the electronic device 200 may include: a processor 210, an external memory interface 220, an internal memory 221, a USB interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, a headphone interface 270D, a sensor module 280, a key 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a SIM card interface 295, etc.

[0071] The processor 210 may include one or more processing units. For example: the processor 210 may include a central processing unit (CPU), an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors. Among them, the controller may be the nerve center and command center of the electronic device 200. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0072] A memory may also be provided in the processor 210 for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. This memory may save the instructions or data that the processor 210 has just used or recycled. If the processor 210 needs to use the instruction or data again, it can be directly called from this memory. By setting the memory, the number of times the processor 210 accesses the internal memory 221 can be reduced, the waiting time of the processor 210 is reduced, and thus the efficiency of the system is improved.

[0073] The interactive method for display objects provided by the embodiments of the present application can be controlled by the processor 210 or other components can be called to complete it. For example, call the software program of the embodiments of the present application stored in the internal memory 221, render the dynamic effects of the display objects, and control the display screen 294 to display the user interface. The processor 210 can include different devices. For example, when the CPU and GPU are integrated, the CPU and GPU can cooperate to execute the interactive method for display objects provided by the embodiments of the present application. For example, part of the software operation in this method is executed by the CPU, and another part of the algorithm for user interface display is executed by the GPU to obtain a faster processing efficiency.

[0074] The display screen 294 is used to display images, videos, etc. The display screen 294 includes a display panel. The display panel can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 200 may include 1 or N display screens 294, where N is a positive integer greater than 1. The display screen 294 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces (GUIs). For example, the display screen 294 can display windows, photos, videos, web pages, or files, etc. In addition, it can be understood that in some embodiments, the status bar may also include a Bluetooth icon, a WiFi icon, an external device icon, etc. In some embodiments, when the processor 210 detects a touch operation of the user's finger (or stylus, etc.) on the display screen, in response to the touch operation, the processor 210 can execute the action corresponding to the touch operation. In some embodiments, when the processor 210 detects an input event input by an external input device (such as a mouse, a keyboard, etc.) of the electronic device 200, in response to the input event, the processor 210 can execute the action corresponding to the input event. In the method provided by the embodiments of the present application, when the electronic device starts the dynamic effect theme, the processor 210 can control the display screen 294 to display the display objects in the dynamic effect theme in the user interface, that is, the display objects in the static state or the dynamic effects of the display objects.

[0075] In the embodiments of the present application, the electronic device 200 is a foldable electronic device. Then, a certain display screen 294 of the electronic device 200 can be an integrated flexible display screen, or can be a spliced display screen composed of two rigid screens and a flexible screen located between the two rigid screens. By performing a folding operation on the electronic device 200, the display screen can change its folding state. Optionally, in the method provided in the embodiments of the present application, when the electronic device 200 is in the folded state, the electronic device 200 can display the user interface and the dynamic effect of the display object on the outer screen (the display screen exposed on the outside); when the electronic device 200 is in the unfolded state, the electronic device 200 can display the user interface and the dynamic effect of the display object on the inner screen or the unfolded screen (for example, the display screen in the double-screen state or the triple-screen state of a triple-fold mobile phone).

[0076] In some embodiments, according to the different functions of the multiple display screens 294 in the electronic device 200, the multiple display screens 294 in the electronic device 200 can include a main screen and a secondary screen. The main screen is used to run the main tasks of the electronic device 200 to complete the main functions of the electronic device 200, such as making and receiving calls, browsing the web, editing documents, watching videos, etc. The secondary screen serves as an extended working space and can run the secondary tasks of the electronic device 200. Optionally, the electronic device 200 can be a foldable electronic device. When the electronic device 200 is in the folded state, the electronic device 200 can display the dynamic wallpaper and the dynamic effect of the dynamic wallpaper on the outer screen; in addition, when the electronic device 200 is in the unfolded state, the electronic device 200 can display the dynamic wallpaper and the dynamic effect of the dynamic wallpaper on the main screen.

[0077] The camera 293 is used to capture static images or videos. Optionally, the electronic device 200 can include 1 to N cameras 293. For example, the camera 293 can include a front camera or a rear camera, or a camera 293 can be used as both a front camera and a rear camera. Generally, the camera 293 can include a photosensitive element such as a lens group and an image sensor. Among them, the lens group includes multiple lenses (convex lenses or concave lenses), which are used to collect the optical signals reflected by the object to be photographed and transmit the collected optical signals to the image sensor. The image sensor generates the original image of the object to be photographed according to the optical signals.

[0078] The internal memory 221 can be used to store computer-executable program codes, and the executable program codes include instructions. The processor 210 executes various functional applications and data processing of the electronic device 200 by running the instructions stored in the internal memory 221. The internal memory 221 can include a program storage area and a data storage area. Among them, the program storage area can store the operating system, the program codes of at least one application program, etc. The operating system can be, but is not limited to, including etc. The data storage area can store data created during the use of the electronic device 200, etc.

[0079] The internal memory 221 can also store one or more computer programs for executing the methods provided in the embodiments of the present application. The one or more computer programs are stored in the above internal memory 221 and are configured to be executed by one or more processors 210. The one or more computer programs include instructions, and the above instructions can be used to execute each step in the embodiments of the present application.

[0080] In addition, the internal memory 221 can include a high-speed random access memory and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0081] The sensor module 280 can include a fingerprint sensor, a touch sensor, a pressure sensor, a magnetic sensor, an ambient light sensor, a barometric pressure sensor, a bone conduction sensor, etc.

[0082] The touch sensor is also called a "touch panel". The touch sensor can be disposed on the display screen 294. The touch sensor is used to detect a touch operation acting thereon or nearby. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 294. In other embodiments, the touch sensor can also be disposed on the surface of the electronic device 200, at a different position from the display screen 294.

[0083] The wireless communication function of the electronic device 200 can be implemented through antenna 1, antenna 2, the mobile communication module 250, the wireless communication module 260, the modulation and demodulation processor, and the baseband processor, etc.

[0084] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. The mobile communication module 250 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc. applied to the electronic device 200. The wireless communication module 260 can provide solutions for wireless communications including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth, global navigation satellite system (GNSS), frequency modulation (FM), NFC, infrared technology (IR), UWB, etc. applied to the electronic device 200.

[0085] In addition, the electronic device 200 can implement audio functions through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, the headphone jack 270D, and the application processor. The electronic device 200 can receive inputs from the keys 290 and generate key signal inputs related to the user settings and function controls of the electronic device 200. The electronic device 200 can use the motor 291 to generate vibration alerts. The indicator 292 in the electronic device 200 can be an indicator light, which can be used to indicate the charging status, the change in battery level, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 295 in the electronic device 200 is used to connect the SIM card. The SIM card can be in contact with and separated from the electronic device 200 by being inserted into or removed from the SIM card interface 295.

[0086] In addition, in some scenarios, the electronic device 200 also has an input device interface for connecting input devices such as a keyboard, a mouse, and a gamepad. This input device interface can reuse the USB interface 230 or can be a dedicated interface set separately. This application does not make any limitations in this regard.

[0087] It should be understood that Figure 2 the illustrated electronic device 200 is merely an example and does not constitute a limitation on the electronic device. In practical applications, the electronic device 200 can have more or fewer components than those shown in the figure, can combine two or more components, or can have different component configurations. The various components shown in the figure can be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application-specific integrated circuits.

[0088] Figure 2 The hardware structure of the electronic device has been introduced. Next, the software structure of the electronic device will be described. The software system of the electronic device provided in the embodiments of this application can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiments of this application, taking the layered architecture as an example, reference is made to Figure 3 exemplarily illustrate the software structure of the electronic device.

[0089] The layered architecture divides the software in the electronic device into several layers, and each layer has a clear role and division of labor. Communication can be carried out between layers through software interfaces. As Figure 3 shown, the software structure of the electronic device includes at least, from top to bottom: an application layer, a system service layer, and a kernel layer. In addition, the electronic device can also include a hardware abstraction layer (HAL), and the HAL can also be referred to as the hardware layer, which is used to provide hardware resource support for the electronic device.

[0090] The application layer is the topmost layer of the operating system, including the native applications of the operating system and the installed third-party applications, such as the camera, gallery, calendar, Bluetooth, music, video, messages, calculator, chat applications, video applications, music applications, electronic map applications, social applications, and so on.

[0091] The system service layer is an important part of the operating system of an electronic device, including multiple system services provided by the operating system. For example, the system service layer may include: window management service, running management service, notification management service, layer management service, input management service, etc.

[0092] The window management service is used to manage the display and configuration of windows. Based on the display screen configuration and multiple management functions, the window management service can control the display of windows or interfaces on the display screen, adjust the transparency, position, and size of windows or interfaces, etc., and can also have functions such as locking the screen and taking screenshots. The window management service can obtain parameter configurations such as the size and resolution of the display screen, and can also identify display areas such as the status bar in the user interface. Optionally, when the electronic device enters the split-screen mode, the window management service can also be used to manage the display and configuration of the window library in each split screen. When a certain theme (such as an animation theme) is set on the electronic device, the window management service can control the display of the user interface according to the display-related content defined in the theme. Optionally, in the case where the theme of the electronic device is an animation theme, the window management service can, based on user operations, render and display the animations of the display objects in the animation theme in the user interface through the layer management service.

[0093] The running management service is responsible for the startup switching, scheduling of various components in the system, and the management and scheduling of applications, etc.

[0094] The notification management service can enable applications to display notification information in the status bar and can be used to convey message types of notifications. These messages can automatically disappear after a short stay without user interaction.

[0095] The input management service is used to collect, process user operation information, and distribute input events. For example, after receiving the operation information reported by the touch drive or other input device drives (such as keyboard drive, mouse drive, etc.), the input management service can convert it into an input event and distribute the input event to other modules for processing.

[0096] The layer management service provides an independent service for the operating system of the electronic device and is a service that resides at the bottom layer of the operating system of the electronic device. During the operation of the device, the layer management service needs to run continuously, and the operating system will give priority to allocating resources to it to ensure that the service can perform image synthesis at any time, so as to ensure that the electronic device can display the user interface in real time.

[0097] Optionally, between the application layer and the system service layer, the software structure of the electronic device may further include an application framework layer (FWK) (not shown in the figure). The application framework layer can provide application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer may include some predefined functions. Exemplarily, the application framework layer may include a content provider, a view system, a resource manager, etc.

[0098] The Kernel layer provides the core system services of the operating system. For example, security, memory management, process management, network protocol stack, and driver model are all implemented based on the Kernel layer. The Kernel layer also serves as an abstraction layer between the hardware and the software stack. There are many drivers related to the electronic device in this layer. The main drivers are: display driver; keyboard driver; mouse driver; Flash driver for memory technology devices; camera driver; audio driver; Bluetooth driver; WiFi driver; touch driver, etc.

[0099] HAL is an interface layer located between the operating system kernel of the electronic device and the hardware circuit, and its purpose is to abstract the hardware. Exemplarily, HAL may include various hardware in the electronic device, such as various sensors, display screens, cameras, hardware composer (HWC), etc. Among them, HWC is mainly responsible for image synthesis and image display, etc.

[0100] It should be noted that Figure 3 Only as an example of the software structure of an electronic device, only some levels and software modules are simply listed, and it does not impose any limitation on the software structure of the electronic device. In practical applications, the operating system of the electronic device may further include other levels, or each level may further include other software modules for implementing one or more functions or services. In addition, the embodiments of the present application do not limit the specific level where each software module is located. For example, some system services in the system service layer can be deployed in the application framework layer or in the Kernel layer.

[0101] In addition, the embodiments of the present application do not make specific limitations on the names of the software modules in this software structure. For example, in the operating system, the window management service can be WindowManagerServer (abbreviated as WMS), the layer management service can be the SurfaceFlinger, and the input management service can be InputManagerService. In the operating system ( In the (operating system), the window management service can be SceneBoard (abbreviated as SCB), the layer management service can be the rendering service (RenderService, RS), and the input management service can be the multi-mode input service.

[0102] To improve the animation display effect of display objects in the animation theme, this application provides an interaction method for display objects. This method can be applied to an electronic device as shown in Figure 2 and the software structure of the electronic device can be as shown in Figure 3 . Next, refer to the flowchart shown in Figure 4 to detail the method provided by the embodiments of this application.

[0103] As shown in the flowchart in Figure 4 , the interaction method for display objects provided by the embodiments of this application includes:

[0104] S401: The electronic device displays a first user interface on the display screen, and the first user interface includes a display object; the display object is an object in the first theme set for the electronic device.

[0105] Before executing S401, the theme of the operating system of the electronic device is the first theme. In one embodiment, the first theme is an animation theme. The embodiments of this application do not limit the type of the first user interface. As shown in Figure 1 , the first user interface can be a lock screen interface, a home screen interface, or other user interfaces.

[0106] The display object in the embodiments of this application is an object in the theme that can be displayed in the user interface. This application does not limit the specific image of the display object, which can be a character, an animal created through animation technology, or an abstract object, etc. In some scenarios, the display object can also be called a "desktop pet". Exemplarily, as shown in Figure 1 , the display object in the animation theme of the mobile phone is a desktop pet kitten.

[0107] As shown in the flowchart in Figure 4 , the interaction method for display objects provided by the embodiments of this application further includes:

[0108] S402: The electronic device displays a first animation in the first user interface in response to a first user operation. Among them, the first animation includes the animation of the display object performing a target interaction action, and the target interaction action matches the position and / or posture of the display object in the first user interface before performing the target interaction action.

[0109] Based on the above explanation of the terms of user operations in point 3), in the embodiments of this application, the first user operation can include, but is not limited to:

[0110] Interface operations performed by the user on the first user interface;

[0111] User voice input operations;

[0112] User behavior activities. Among them, user behavior activities include the user's body movements and / or facial expressions. Exemplarily, the user's body movements can be any one of the following: running, jumping, shaking, waving, walking, etc. The user's facial expressions can be any one of the following: happy, laughing, smiling, surprised, angry, disgusted, afraid, sad, crying, contemptuous, etc.

[0113] In the embodiments of the present application, the electronic device can detect the first user operation performed by the user through the following implementation manners A1 - A3:

[0114] Implementation manner A1: The electronic device can detect the interface operation performed by the user on the first user interface through the following steps:

[0115] When the first user operation is a touch operation performed by the user on the first user interface with a finger or a stylus, the electronic device can detect the interface operation performed by the user through the touch sensor; when the first user operation is an operation performed by the user on the first user interface through an external input device, the electronic device can detect the interface operation performed by the user through the driver corresponding to the external input device.

[0116] Optionally, after the electronic device detects the interface operation performed by the user on the first user interface, it can also obtain the operation information of the interface operation. Among them, the operation information can include at least one of the following: operation type, operation position. Optionally, the operation information can also include the operation time. Optionally, the interface operation can be any type of user operation performed by the user at any position on the display screen, and the present application does not limit this. Exemplarily, the operation type of the interface operation can be any one of the following: click operation, double - click operation, drag operation, slide operation, two - finger pinch operation, two - finger outward slide operation, short - press operation, long - press operation, etc.

[0117] Implementation manner A2: The electronic device can detect the user voice input operation through the microphone. When the electronic device collects the user voice through the microphone, it detects the user voice input operation.

[0118] Implementation Mode A3: The electronic device can detect the user's behavioral activities through the following steps: The electronic device can obtain the sensing data collected by the sensors; and determine the user's behavioral activities based on the sensing data. Among them, the sensing data may include at least one of the following: the scene image containing the user collected by the camera (such as the front camera or the rear camera), the sensing data collected by the gyroscope sensor, and the sensing data collected by the acceleration sensor. Optionally, the electronic device can perform image recognition on at least one scene image containing the user to determine the user's body movements or facial expressions. The electronic device can also analyze the sensing data collected by the gyroscope sensor or the acceleration sensor to determine the user's body movements.

[0119] Optionally, in one implementation, the electronic device can activate the microphone or the above sensors during the process of displaying the user interface containing the display object, so that the microphone and these sensors can collect data.

[0120] Optionally, in the embodiments of the present application, the target interaction action matches the position and / or posture of the display object before performing the target interaction action, which can be understood as that the target interaction action can connect the position and / or posture of the display object before performing the target interaction action. In some implementations, the target interaction action matching the position and / or posture of the display object before performing the target interaction action may include that the target interaction action is performed with the position and / or posture of the display object before performing the target interaction action as the initial state of the display object; or the starting state of the target interaction action is the position and / or posture of the display object before performing the target interaction action. For example, the target interaction action matching the position of the display object before performing the target interaction action is: the starting position of the display object performing the target interaction action in the first user interface is the position of the display object before performing the target interaction action. Another example is that the target interaction action matching the posture of the display object before performing the target interaction action is: the starting posture of the display object performing the target interaction action in the first user interface is the posture of the display object before performing the target interaction action, or the target interaction action performed by the display object is an action that the display object can make in the posture before performing the target interaction action (that is, an action that it is capable of making, or an action that conforms to the physical laws). Continuing with Figure 1 the display object (desktop pet kitten) in the mobile phone display animation theme in as an example, assuming that the position of the pet kitten before performing the target interaction action is the first position and the posture before performing the target interaction action is to lower its head. In order to match the position and / or posture before performing the target interaction action, in one embodiment, the position of the target interaction action performed by the pet kitten can still be the first position, and the target interaction action can be to raise its head from lowering its head and then perform a head-shaking action, presenting a seamless connection of actions from a visual perspective.

[0121] In one implementation, in order to make the target interaction action match the position and / or pose of the display object before performing the target interaction action, the electronic device may determine the target interaction action of the display object according to the pose information of the display object. The position information of the display object is used to indicate the position and / or pose of the display object in the first user interface before performing the target interaction action.

[0122] In the embodiments of the present application, according to different first user operations detected by the electronic device, the information on which the target interaction action performed by the display object in the first dynamic effect is based is also different. Optionally, the following implementation manners B1 - B3 may be adopted in this embodiment to determine the target interaction action:

[0123] Implementation manner B1: When the first user operation includes an interface operation performed by the user on the first user interface, the target interaction action is related to the operation type and / or operation position of the interface operation. In one implementation, that the target interaction action is related to the operation type and / or operation position of the interface operation may include: The target interaction action may be determined by the electronic device according to the operation type and / or operation position of the interface operation. For example, the action type of the target interaction action may be determined based on at least one of the operation type and operation position of the interface operation; or information such as the starting position or ending position of the target interaction action may be determined based on the operation position of the interface operation.

[0124] Optionally, during the execution of S402 by the electronic device, the electronic device may obtain the operation type and / or operation position of the interface operation, and determine the target interaction action of the display object according to the operation type and / or operation position of the interface operation.

[0125] Take Figure 1 the display object (desktop pet kitten) in the mobile phone display dynamic effect theme shown as an example. When the user clicks on the blank position in the user interface currently displayed on the mobile phone, the mobile phone may display the dynamic effect of the kitten running to the clicked position; when the user double - clicks on the blank position in the user interface currently displayed on the mobile phone, the mobile phone may display the dynamic effect of the kitten running to the clicked position and nodding and jumping; when the user clicks on the head position of the kitten currently displayed on the mobile phone, the mobile phone may display the dynamic effect of the kitten shaking its head; when the user clicks on the body of the kitten currently displayed on the mobile phone, the mobile phone may display the dynamic effect of the kitten shaking the touched part by the user.

[0126] Implementation manner B2: When the first user operation includes a user voice input operation, the target interaction action matches the semantic information of the user voice; where the user voice is collected when the electronic device detects the user voice input operation. In one implementation, that the target interaction action matches the semantic information of the user voice may include: The target interaction action is the same as the action in the semantic information, or the target interaction action is a response action to the semantic information.

[0127] Optionally, during the execution of S402 by the electronic device, when the electronic device detects that the user performs a user voice input operation, it can collect the user's voice through the microphone and recognize the semantic information of the user's voice; then the electronic device can determine the target interaction action of the display object according to the semantic information of the user's voice.

[0128] Continuing with Figure 1 as an example, in the scenario where the mobile phone displays a user interface containing a desktop pet kitten, when the user says "The kitten eats", the mobile phone can display the animation effect of the kitten eating; when the user says "The kitten plays the piano", the mobile phone can display the animation effect of the kitten playing the piano; when the user says "Full", the mobile phone can display the animation effect of the kitten lying down and rubbing its belly.

[0129] Embodiment B3: When the first user operation includes the user's behavioral activities, the target interaction action matches the user's body movements and / or facial expressions included in the user's behavioral activities. In one implementation, that the target interaction action matches the user's body movements included in the user's behavioral activities may include: the target interaction action is the same as the user's body movements, or the target interaction action is a response action to the user's body movements; that the target interaction action matches the user's facial expressions included in the user's behavioral activities may include: the target interaction action is the same as the user's facial expressions, or the target interaction action is a response action to the user's facial expressions.

[0130] Optionally, during the execution of S402 by the electronic device, when the electronic device detects the user's behavioral activities, it can determine the target interaction action of the display object according to the user's behavioral activities.

[0131] Continuing with Figure 1 as an example, in the scenario where the mobile phone displays a user interface containing a desktop pet kitten, when the user waves at the front camera, the mobile phone can display the animation effect of the kitten running towards the user; when the user shows an angry expression at the rear camera, the mobile phone can display the animation effect of the kitten wagging its tail and shaking its head; when the user jumps with the mobile phone in hand, the mobile phone can display the animation effect of the kitten jumping.

[0132] It should also be noted that the above Embodiments B1 - B3 can be implemented independently or in combination with each other, and the present application does not make any limitations in this regard.

[0133] Optionally, in the embodiments of the present application, the electronic device can execute S402 through the following steps internally:

[0134] Step 4021: The electronic device obtains the pose information of the display object; wherein, the pose information is used to indicate the position and / or posture of the display object on the first user interface before performing the target interaction action.

[0135] Optionally, in one implementation, during the process of the electronic device displaying the display object, it can record and update the pose state information of the display object in real time. Therefore, when performing step 4021, the electronic device can read the recorded pose state information of the display object. In another implementation, in a scenario where the electronic device uses skeletal animation technology to generate the dynamic effect of the display object, when performing step 4021, the electronic device can determine the latest skeletal point position data of the display object, and these skeletal point position data can also reflect the pose of the display object. The electronic device can also obtain the physical position information of the display object on the first user interface, such as the coordinates of the outline or key points of the display object.

[0136] Based on this, the electronic device can use at least one of the pose state information of the display object, the skeletal point position data, and the physical position information of the display object on the first user interface obtained through the above implementation methods as the pose information of the display object.

[0137] Step 4022: The electronic device can determine the target interaction action according to the first user operation and the obtained pose information of the display object.

[0138] In this step, the electronic device can determine the target interaction action according to the first user operation and the pose information according to the set rules, so as to ensure that the target interaction action can be used as a response to the first user operation and match the position and / or pose of the display object on the first user interface before performing the target interaction action, and implement the conditions met by the target interaction action in at least one of the above implementation methods B1 to B3. Thus, it can be ensured that the target interaction action performed by the display object in the first dynamic effect can be naturally connected to the position and / or pose of the display object on the first user interface before performing this action, and further ensure the coherence of the target interaction action performed by the display object in the first dynamic effect and the interactivity with the user. The set rules can be designed based on factors such as the fluency of the action, compliance with physical laws, context matching, and compliance with the image characteristics of the display object, so as to ensure the rationality and realism of the display object performing the target interaction action.

[0139] Optionally, when the first user operation includes an interface operation performed by the user on the first user interface, the electronic device can determine the target interaction action according to the operation type and / or operation position of the interface operation, and the pose information of the display object.

[0140] Optionally, when the first user operation includes a user voice input operation, the electronic device can determine the target interaction action according to the semantic information of the recognized user voice and the pose information of the display object, so that the target interaction action matches the semantic information of the user voice.

[0141] Optionally, when the first user operation includes user behavior activities, the electronic device determines a target interaction action according to the user behavior activities and the pose information of the display object, so that the target interaction action matches the body movements and / or facial expressions included in the user behavior activities, and can be used as an action response to the user's body movements and / or expressions.

[0142] Step 4023: The electronic device can determine the target interaction action based on Step 4022 and generate the first dynamic effect.

[0143] Step 4024: The electronic device displays the first dynamic effect in the first user interface.

[0144] Through the above steps 4021-4024, the electronic device can determine the target interaction action in real time according to the first user operation and the position information of the display object, so as to generate the first dynamic effect of the display object performing the target interaction action in real time. The first dynamic effect displayed by the electronic device in the first user interface can not only be used as a response to the first user operation, but also match the position and / or posture of the display object in the first user interface before performing the target interaction action, so as to ensure the coherence of the first dynamic effect displayed by the electronic device, and further improve the display effect of the dynamic effect of the display object. In addition, since the first dynamic effect is generated by the electronic device in real time and there is no need to pre-store sequence frames or videos in the first theme, this method can also reduce the storage space occupied by the first theme, improve the richness, interaction realism and sense of fun of the dynamic effect of the display object in the first theme, and is applicable to various complex and changeable application scenarios.

[0145] Optionally, in Step 4023, the electronic device can generate data of the first dynamic effect based on the target interaction action and generate the first dynamic effect according to the data of the first dynamic effect.

[0146] In one implementation, the data of the first dynamic effect may include data of multiple image frames in the first dynamic effect. After determining the target interaction action of the display object, in Step 4023, the electronic device can sequentially generate data of multiple image frames of the first dynamic effect according to the target interaction action; the electronic device can sequentially render and generate an image frame of the first dynamic effect according to each generated image frame data, so as to generate the first dynamic effect. Then in Step 4024, the electronic device can sequentially display these image frames in the first user interface, so as to display the first dynamic effect in the first user interface.

[0147] In another implementation, in a scenario where the electronic device supports generating the dynamic effect of the display object through skeletal animation technology, the data of the first dynamic effect may include the moving data of the skeletal points of the display object. That is, in step 4023, the electronic device may determine the moving data of the skeletal points of the display object according to the pose information of the display object and the target interaction action. In this way, the electronic device may generate the first dynamic effect according to the moving data of the skeletal points of the display object. As in the previous implementation, the electronic device may generate multiple image frame data of the first dynamic effect according to the moving data of the skeletal points of the display object.

[0148] In an implementation of this embodiment, the electronic device may also play the target interaction sound of the display object in response to the first user operation, so as to implement the sound interaction between the display object and the user in the first theme. Similar to the electronic device determining the target interaction action in step 4022, the electronic device may also determine the target interaction sound of the display object according to the first user operation (optionally, according to the position information of the display object) according to the set rules, so as to ensure the rationality and realism of the display object emitting the target interaction sound.

[0149] In an implementation of this embodiment, in S402, the electronic device may also display the first dynamic effect of the display object with reference to the scene information of the scene where the user is located, which specifically includes the following steps: The electronic device obtains the scene information; wherein, the scene information is used to indicate the scene where the user is located. In this way, when the electronic device executes S402, it may display the first dynamic effect in the first user interface according to the scene information in response to the first user operation. In this implementation, the first dynamic effect is the first dynamic effect of the display object performing the target interaction action in the scene indicated by the scene information.

[0150] Through this design, the electronic device may display the first dynamic effect of the display object performing the target interaction action in the scene where the user is located, which may make the user feel that the display object and itself are in the same scene, and may further improve the rationality and realism of the display object performing the target interaction action. Additionally, optionally, during the process of the electronic device executing 4022, it may determine the target interaction action according to the first user operation, the pose information of the display object, and the scene information.

[0151] Optionally, the scene information includes at least one of the following: weather information, season information, time information, temperature information of the environment where the user is located, and the working mode of the electronic device. In this way, the electronic device may describe the scene where the user is located from multiple angles, and thus may improve the richness of the first dynamic effect of the display object performing the target interaction action in the scene. Continuing with Figure 1For example, when the weather information indicates that it is raining in the scene where the user is located, the mobile phone can display the animation effects of the kitten performing various actions under the umbrella; when the season information indicates that the scene where the user is located is in winter, the mobile phone can display the animation effects of the kitten wearing thick clothes performing various actions; when the time information indicates that the scene where the user is located is at night, the mobile phone can display the animation effects of the kitten performing various actions in bed; when the temperature information of the user's environment indicates that the scene where the user is located is in a high temperature, the mobile phone can display the animation effects of the kitten sweating while performing various actions; when the working mode of the electronic device is the flight mode, the mobile phone can display the animation effects of the kitten performing various actions on the plane.

[0152] Optionally, the electronic device can obtain the scene information in various ways. For example, the electronic device can access the weather application to obtain weather information, season information, and temperature information; for another example, the electronic device can access the calendar application to obtain season information. For another example, the electronic device can obtain time information, working mode, etc. according to the data of the operating system.

[0153] In addition, optionally, in S401, the electronic device can also display the display object in the first user interface with reference to the scene information. Specifically, it can refer to the above content and will not be elaborated here. That is, in S401, the display object in the initial state displayed by the electronic device in the first user interface is the display object in the scene indicated by the scene information.

[0154] In the embodiments of the present application, the electronic device can also notify and remind the user through the animation effects of the display object, so as to improve the functionality and richness of the animation effects of the display object. The specific implementation is as described in the following embodiments:

[0155] In one embodiment, when the electronic device displays the first notification message in the first user interface including the display object, the electronic device can display the second animation effect of the display object in the first user interface; the second animation effect is used to prompt the existence of the first notification message. Optionally, the electronic device can determine the second animation effect according to at least one of the type of the first notification message, the position of the first notification message, and the content of the first notification message.

[0156] For example, the second animation effect is the animation effect that the display object runs to the position of the first notification message and rotates at that position. For another example, when the type of the first notification message is the set notification type set by the user or default of the first theme, the electronic device displays the second animation effect; for other notification messages that do not belong to the set notification type, the electronic device may not display the animation effect of the display object. For another example, the actions performed by the display object in the second animation effect are related to the content of the first notification message.

[0157] In another embodiment, when the electronic device displays a second notification message in the second user interface displayed on the display screen, the electronic device may display a third animation effect of the display object in the second user interface; the third animation effect is used to prompt the existence of the second notification message. Optionally, the electronic device may determine the third animation effect according to at least one of the type of the second notification message, the position of the second notification message, and the content of the second notification message. The description of the electronic device displaying the third animation effect may refer to the description of displaying the second animation effect in the previous embodiment, which will not be elaborated here.

[0158] Optionally, the display object may not be displayed in the initial state of the second user interface. In this way, when the electronic device displays a notification message in a user interface that does not include the display object, the electronic device may display an animation effect of the popping-up display object in the user interface, thereby reminding the user of the existence of the notification message.

[0159] It should also be noted that in a scenario where the electronic device is a foldable electronic device and the electronic device includes a main screen and a secondary screen, when the electronic device is in a folded state, the electronic device may display a user interface including the display object on the secondary screen. That is, the above-mentioned first user interface is displayed on the secondary screen of the electronic device. Optionally, when the electronic device is in an unfolded state, the electronic device may display a user interface including the display object on the main screen.

[0160] In summary, the present application provides a method for interacting with a display object. Through this method, during the process of the electronic device displaying a first user interface including the display object, a first animation effect of the display object performing a target interaction action may be displayed in the first user interface based on a first user operation. The display object is an object in the first theme set by the electronic device. Among them, the target interaction action performed by the display object in the first animation effect matches the position and / or posture of the display object before performing the target interaction action, that is, the target interaction action can naturally connect with the position and / or posture of the display object before performing the target interaction action. Therefore, this method can ensure the coherence of performing the target interaction action based on the position and / or posture of the display object in the first user interface before performing the target action, thereby ensuring the coherence of the first animation effect of the display object. Through this method, the electronic device can naturally connect and display the next animation effect of the display object based on the position and / or posture of the display object in the user interface, making the animation effects of the display objects in the animation effect theme of the electronic device display coherently and continuously, thereby ensuring the display effect of the animation effect of the display object and further improving the user experience.

[0161] Since this method does not require pre - designing the sequence frames or videos that support the animation within the animation theme, this method can also reduce the storage space occupied by the animation theme. Additionally, based on user operations, the electronic device can interrupt the display of the next animation at any moment during the display process of the animation of the display object, and the position and / or pose of the display object in the user interface before the display of the next animation are diverse and related to specific user operations, and can respond to actions according to user operations. Therefore, this method can enhance the richness of the animation, the sense of interactive reality, and the sense of fun of the display object in the animation theme, and can be applied to various complex and changeable application scenarios.

[0162] Based on the method provided in the above embodiments, the present application also provides the following several embodiments. The methods provided by each embodiment are described below with reference to the accompanying drawings. Before executing each embodiment, the first theme currently set by the electronic device is an animation theme. And the first theme contains an object that interacts with the user, that is, the display object.

[0163] In one embodiment, the electronic device can display the animation of the display object in the first theme based on the interface operation performed by the user on the user interface. The specific process can be referred to Figure 5A as shown.

[0164] S501: The electronic device displays a first user interface on the display screen, where the first user interface contains a display object.

[0165] S502: The electronic device detects a first interface operation performed by the user on the first user interface and obtains the operation information of the first interface operation. The operation information of the first interface operation includes at least one of the following: operation type, operation position.

[0166] S503: The electronic device determines the target interaction action of the display object according to the operation information of the first interface operation and the pose information of the display object. The position information of the display object is used to indicate the current position and / or pose of the display object in the first user interface.

[0167] The specific process of this step can refer to the relevant description in the embodiment shown in Figure 4 as shown, and will not be elaborated here.

[0168] S504: The electronic device renders and displays the first animation of the display object performing the target interaction action in the first user interface.

[0169] In S504, the electronic device can determine the bone point movement data of the display object according to the pose information and the target interaction action of the display object; and perform a bone animation driving process according to the bone point movement data, and render and display the first animation.

[0170] It should be noted that the method provided in this embodiment does not limit the operation position and operation type of the first interface operation, and it can be an operation of any operation type performed by the user at any position on the display screen. For interface operations with different operation positions and different operation types, the dynamic effects of the display objects displayed by the electronic device are also different.

[0171] Continuing with Figure 1 the example of the (a) mobile phone displaying a desktop pet kitten on the lock screen interface for illustration:

[0172] The initial state of the kitten on the lock screen interface is as shown in Figure 5B (a) of; when the user clicks on the blank space to the left of the kitten on the lock screen interface, the mobile phone can display the dynamic effect of the kitten running leftward to the user's click position on the lock screen interface, as shown in Figure 5B (b) of; when the user clicks on the blank space above the kitten on the lock screen interface, the mobile phone can display the dynamic effect of the kitten jumping upward and running to the user's click position on the lock screen interface, as shown in Figure 5B (c) of; when the user clicks on the blank space to the right of the kitten on the lock screen interface, the mobile phone can display the dynamic effect of the kitten running rightward to the user's click position on the lock screen interface, as shown in Figure 5B (d) of; when the user clicks on the blank space below the kitten on the lock screen interface, the mobile phone can display the dynamic effect of the kitten jumping downward and running to the user's click position on the lock screen interface, as shown in Figure 5B (e) of.

[0173] When the user clicks on the ear of the kitten on the lock screen interface, the mobile phone can display the dynamic effect of the kitten getting angry and shivering on the lock screen interface, as shown in Figure 5C (a) of; when the user clicks on the head of the kitten on the lock screen interface, the mobile phone can display the dynamic effect of the kitten standing up happily on the lock screen interface, as shown in Figure 5C (b) of; when the user clicks on the belly of the kitten on the lock screen interface, the mobile phone can display the dynamic effect of the kitten being vigilant and sitting down on the lock screen interface, as shown in Figure 5C (c) of; when the user clicks on the leg of the kitten on the lock screen interface, the mobile phone can display the dynamic effect of the kitten lying down on the lock screen interface, as shown in Figure 5C (d) of.

[0174] In one embodiment, the electronic device can display the dynamic effect of the display object in the first theme based on the semantics of the user's voice input. The specific process can refer to Figure 6A as shown.

[0175] S601: The electronic device displays a first user interface on the display screen, where the first user interface includes a display object.

[0176] S602: When the electronic device detects a user voice input operation, it collects the user's voice through the microphone and recognizes the semantic information of the user's voice.

[0177] In this way, the user can interact with the display object by means of voice input.

[0178] S603: The electronic device determines the target interaction action of the display object according to the recognized semantic information and the pose information of the display object. Among them, the position information of the display object is used to indicate the current position and / or posture of the display object in the first user interface.

[0179] For the specific process of this step, reference can be made to Figure 4 the relevant descriptions in the embodiments shown, which will not be elaborated here.

[0180] S604: The electronic device renders and displays the first dynamic effect of the display object performing the target interaction action in the first user interface. This step is the same as S504 in the first embodiment, and the specific description can be referred to the description of S504 in the first embodiment, which will not be elaborated here.

[0181] Through the method provided in this embodiment, the user can interact with the display object through voice input operations, enhancing the interest of the dynamic effect theme.

[0182] Continuing with Figure 1 the example of the (a) mobile phone displaying a desktop pet kitten on the lock screen interface for illustration:

[0183] When the mobile phone displays the lock screen interface containing the desktop pet kitten, the user makes a "play the piano" sound to the mobile phone, as shown in Figure 6B (a) shown; the mobile phone can display the dynamic effect of the kitten playing the piano on the lock screen interface, as shown in Figure 6B (b) shown.

[0184] When the mobile phone displays the lock screen interface containing the desktop pet kitten, the user makes a "eat" sound to the mobile phone, as shown in Figure 6B (a) shown; the mobile phone can display the dynamic effect of the kitten eating on the lock screen interface, as shown in Figure 6B (c) shown.

[0185] In one embodiment, the electronic device can display the dynamic effect of the display object in the first theme based on the user's behavior activities. The specific process can be referred to Figure 7A shown.

[0186] S701: The electronic device displays the first user interface on the display screen, where the first user interface contains a display object.

[0187] S702: The electronic device collects sensing data through sensors and determines the user's behavioral activities based on the sensing data. Among them, the user's behavioral activities include the user's body movements and / or facial expressions.

[0188] In this step, the process of the electronic device collecting sensing data and the process of determining the user's behavioral information based on the sensing data can refer to Figure 4 the description in S402 of the embodiment shown, which will not be elaborated here.

[0189] S703: The electronic device determines the target interaction action of the display object based on the user's behavioral activities and the pose information of the display object. Among them, the position information of the display object is used to indicate the current position and / or pose of the display object in the first user interface.

[0190] The specific process of this step can refer to Figure 4 the relevant description in the embodiment shown, which will not be elaborated here.

[0191] S704: The electronic device renders and displays the first dynamic effect of the display object performing the target interaction action in the first user interface. This step is the same as S504 in the first embodiment, and the specific description can refer to the description of S504 in the first embodiment, which will not be elaborated here.

[0192] Through the method provided in this embodiment, the user can interact with the display object through various behavioral activities, enhancing the interest of the dynamic effect theme.

[0193] Continuing with Figure 1 the example of the (a) mobile phone displaying a desktop pet kitten on the lock screen for illustration:

[0194] When the mobile phone displays the lock screen containing the desktop pet kitten, the user waves at the front camera of the mobile phone. As shown in Figure 7B (a) below, the mobile phone can display the dynamic effect of the kitten running and jumping up and down on the lock screen, as shown in Figure 7B (b) below.

[0195] It should be noted that in the above embodiments, the concepts and explanations of the same terms can be referred to each other, and the same or similar steps can also be referred to each other. The above examples do not constitute any limitation to the method provided in the embodiments of the present application. In addition, since the drawings cannot present the complete dynamic effect, the above examples are all used to schematically display the dynamic effect of the display dynamic effect. It should be noted that in the dynamic effect of the display object shown in each example, the actions performed by the display object can all be naturally connected to the position and / or pose of the display object in the user interface.

[0196] It should also be noted that each step involved in the above embodiments can be executed by the corresponding device, or by components such as chips, processors, or chip systems within the device. The embodiments of the present application do not limit this. The above embodiments are only described by taking the execution by the corresponding device as an example. In addition, the specific implementation manners or examples in the above embodiments do not limit the solutions provided by the embodiments of the present application either.

[0197] It should be noted that in the above embodiments, some steps can be selected for implementation, and the order of the steps in the figure can also be adjusted for implementation. The present application does not limit this. It should be understood that implementing some of the steps in the figure, adjusting the order of the steps, or combining them for specific implementation all fall within the protection scope of the present application.

[0198] It can be understood that in order to implement the functions in the above embodiments, each device involved in the above embodiments includes the corresponding hardware structure and / or software module for executing each function. Those skilled in the art should easily realize that, combined with the units and method steps of the examples described in the embodiments disclosed in the present application, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the way of hardware or computer software driving the hardware depends on the specific application scenario and design constraints of the technical solution.

[0199] It can be understood that the above-described architecture and application scenarios described in the embodiments of the present application are for more clearly explaining the technical solutions of the embodiments of the present invention, and do not constitute a limitation to the technical solutions provided by the embodiments of the present invention. Those skilled in the art know that with the evolution of the network architecture and the emergence of new services, the technical solutions provided by the embodiments of the present invention are also applicable to similar technical problems.

[0200] It should be noted that the "steps" in the embodiments of the present application are only for illustration, which is a way of expression for better understanding the embodiments, and do not constitute a substantial limitation to the execution of the solutions of the present application. For example, the "steps" can also be understood as "features". In addition, the steps do not constitute any limitation to the execution order of the solutions of the present application. Any operation such as changing the order of the steps, combining the steps, or splitting the steps that does not affect the realization of the overall solution falls within the scope disclosed in the present application.

[0201] Based on the same concept, the embodiments of the present application also provide an electronic device. As Figure 8As shown, the electronic device 800 includes a display screen 801, one or more processors 802, and a memory 803. Optionally, the electronic device 800 may further include a transceiver 804. Exemplarily, the above-mentioned devices may be connected through one or more communication buses. Among them, the one or more computer programs are stored in the above-mentioned memory 803 and are configured to be executed by the one or more processors 802. The one or more computer programs include instructions, and the above instructions can be used to cause the electronic device 800 to execute each step of the methods in the above-mentioned embodiments.

[0202] Exemplarily, the above one or more processors 802 may specifically be Figure 2 the processor 210 in; the above memory 803 may specifically be Figure 2 the memory 221 in. The transceiver 804 may be Figure 2 the mobile communication module 250 or the wireless communication module 260 in; the above display screen 801 may be Figure 2 the display screen 294 in, and the embodiments of the present application do not make any restrictions on this.

[0203] Based on the same concept, the embodiments of the present application further provide an electronic device, and the electronic device includes units for executing each step in the method provided in the above embodiments.

[0204] For the specific functions of the above each module, reference may be made to the above embodiments, and details are not described herein again.

[0205] Based on the above embodiments, the embodiments of the present application further provide a computer program product, and the computer program product includes instructions; when the computer program runs on a computer, the computer is caused to execute the method provided in the above embodiments.

[0206] Based on the above embodiments, the embodiments of the present application further provide a computer-readable storage medium, and the computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by a computer, the computer is caused to execute the method provided in the above embodiments.

[0207] Optionally, the above computer may include, but is not limited to, a control device.

[0208] Among them, the storage medium may be any available medium that can be accessed by a computer. Taking this as an example but not limited to: the computer-readable medium may include RAM, ROM, EEPROM, CD-ROM or other optical disc storage, magnetic disk storage medium or other magnetic storage devices, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer.

[0209] Based on the above embodiments, an embodiment of the present application further provides a chip, which is used to read the computer program stored in the memory and implement the method provided in the above embodiments. Optionally, the chip may include a processor and a memory, and the processor is coupled to the memory for reading the computer program stored in the memory and implementing the method provided in the above embodiments.

[0210] Based on the above embodiments, an embodiment of the present application provides a chip system, which includes a processor for supporting a computer device to implement the functions involved in the control device in the above embodiments. In a possible design, the chip system further includes a memory for storing necessary programs and data of the computer device. The chip system may be composed of chips or may include chips and other discrete devices.

[0211] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk memory, CD-ROM, optical memory, etc.) containing computer-usable program code.

[0212] The present application is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the present application. It should be understood that each flow and / or block in the flowchart and / or block diagram, and the combination of flows and / or blocks in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate a device for implementing the specified functions in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0213] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory generate a manufactured product including an instruction device, and the instruction device implements the specified functions in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0214] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus, so that a series of operation steps are performed on the computer or other programmable apparatus to produce a computer-implemented process, thereby providing instructions for implementing the functions specified in one process or a plurality of processes and / or boxes Figure 1 in one or more processes and / or boxes Figure 1 steps for implementing the functions specified in one or more boxes.

Claims

1. An interactive method for displaying an object, applied to an electronic device, characterized in that Including: Display a first user interface on the display screen, where the first user interface includes display objects; wherein, the display objects are objects in a first theme set for the electronic device; In response to a first user operation, display a first special effect in the first user interface; wherein, the first special effect includes a special effect of the display object performing a target interaction action, and the target interaction action matches the position and / or posture of the display object before performing the target interaction action.

2. The method according to claim 1, characterized in that The first user operation includes at least one of the following: An interface operation performed by the user on the first user interface; A user voice input operation; User behavior activities; wherein, the user behavior activities include the user's body movements and / or facial expressions.

3. The method according to claim 2, wherein When the first user operation includes an interface operation performed by the user on the first user interface, the target interaction action is related to the operation type and / or operation position of the interface operation; When the first user operation includes a user voice input operation, the target interaction action matches the semantic information of the user voice; wherein, the user voice is collected by the electronic device when the user voice input operation is detected; When the first user operation includes user behavior activities, the target interaction action matches the body movements and / or facial expressions included in the behavior activities.

4. The method according to claim 2 or 3, characterized in that, When the first user operation includes user behavior activities, the method further includes: Obtain sensing data collected by sensors of the electronic device; Determine the user behavior activities according to the sensing data; Wherein, the sensing data includes at least one of the following: a scene image including the user collected by a camera; sensing data collected by a gyroscope sensor; sensing data collected by an acceleration sensor.

5. The method according to any one of claims 1-4, characterized in that, After displaying the first user interface on the display screen, the method further includes: In response to the first user operation, play a target interaction sound of the display object.

6. The method according to any one of claims 1-5, characterized in that, The method further includes: Obtain scene information; wherein, the scene information is used to indicate the scene where the user is located; The step of, in response to a first user operation, displaying a first special effect in the first user interface includes: In response to the first user operation, display the first special effect in the first user interface according to the scene information; wherein, the first special effect includes a special effect of the display object performing the target interaction action in the scene indicated by the scene information.

7. The method according to claim 6, wherein The scene information includes at least one of the following: weather information, season information, time information, temperature information of the environment where the user is located, the working mode of the electronic device.

8. The method according to any one of claims 1 to 7, characterized in that The step of, in response to a first user operation, displaying a first special effect in the first user interface includes: Obtain the pose information of the display object; wherein, the pose information is used to indicate the position and / or posture of the display object in the first user interface before performing the target interaction action; Determine the target interaction action according to the first user operation and the pose information; Generate the first special effect; Display the first animation effect in the first user interface.

9. The method according to claim 8, wherein Generating the first animation effect includes: Determining the bone point movement data of the display object according to the pose information and the target interaction action; Generating the first animation effect according to the bone point movement data.

10. The method according to any one of claims 1-9, characterized in that, After the first user interface is displayed on the display screen, the method further includes: When a first notification message is displayed in the first user interface, displaying a second animation effect of the display object in the first user interface; the second animation effect is used to prompt the existence of the first notification message.

11. The method according to claim 10, characterized in that, The second animation effect is determined according to at least one of the following: The type of the first notification message, the position of the first notification message, the content of the first notification message.

12. The method according to any one of claims 1 to 11, characterized in that The method further includes: Displaying a second user interface on the display screen; When a second notification message is displayed in the second user interface, displaying a third animation effect of the display object in the second user interface; the third animation effect is used to prompt the existence of the second notification message.

13. The method according to claim 12, wherein The third animation effect is determined according to at least one of the following: The type of the second notification message, the position of the second notification message, the content of the second notification message.

14. The method according to any one of claims 1-13, characterized in that, The electronic device is a foldable electronic device; the foldable electronic device includes a main screen and a secondary screen; when the electronic device is in a folded state, the first user interface is displayed on the secondary screen.

15. An electronic device, characterized in that, The electronic device includes: A display screen for displaying a user interface; A memory for storing computer program instructions; A processor for executing the computer program instructions to support the electronic device to implement the method according to any one of claims 1-14.

16. A computer-readable storage medium, characterized in that, Computer program instructions are stored on the computer-readable storage medium, and when the computer program instructions are executed by a processing circuit, the method according to any one of claims 1-14 is implemented.

17. A computer program product comprising instructions, characterized in that, When the computer program product runs on a computer, the computer is caused to execute the method according to any one of claims 1-14.

Images