Display method and electronic device

Abstract

The application provides a display method and an electronic device. The electronic device can generate an animation in real time according to a user's interactive action according to a preset rule, for example, the electronic device can generate a dynamic lock screen animation in real time, so that dynamic interaction with the user can be realized and the interest of the lock screen can be improved. The electronic device can also display multiple videos and play the video at which the user's eyes are fixed, so that the display effect of playing the video at which the user's eyes are fixed can be realized.

Description

[0001] This application is a divisional application. The original application has the application number 202411048849.6 and the original application date is July 31, 2024. The entire contents of the original application are incorporated herein by reference. Technical Field

[0002] This application relates to the field of electronic technology, and more specifically, to a display method and an electronic device. Background Technology

[0003] Users can set their own lock screen wallpaper, always-on wallpaper, and other customizable settings. For example, when setting a lock screen, users can use images, 2D animations, or 3D animations as wallpapers. However, once a user sets a wallpaper, the image, animation, or animation is generally fixed and monotonous, which can easily lead to user fatigue. Summary of the Invention

[0004] This application provides a display method and an electronic device. In this technical solution, the electronic device can generate animations in real time according to user interaction actions and pre-set rules. For example, the electronic device can generate dynamic lock screen animations in real time, thereby enabling dynamic interaction with the user and enhancing the fun of the lock screen.

[0005] In a first aspect, a display method is provided for use in an electronic device. The method includes: displaying a first display interface, the first display interface including one or more display elements; generating a first animation in response to detecting a first interaction action of a user, the first animation being associated with at least one target display element among the one or more display elements; and displaying the first animation on the first display interface.

[0006] The display element can be a two-dimensional display element or a three-dimensional display element.

[0007] Based on the embodiments of this application, the first display interface displayed by the electronic device may include one or more display elements. When a user's first interactive action is detected, the electronic device can generate an animation of the display elements in real time according to a first rule and play the animation.

[0008] In this way, electronic devices can generate animations of target display elements in real time based on user interaction. For example, if the target display element is a lock screen element, the electronic device can generate dynamic lock screen animations in real time, thereby enabling dynamic interaction with the user and enhancing the fun of the lock screen.

[0009] In addition, each time a user unlocks the device, different lock screen animations can be generated based on the user's interaction, thereby increasing the diversity of lock screen animations and improving the user's lock screen experience.

[0010] In some implementations, the at least one target display element is a plurality of target display elements, and generating the first animation includes: generating an animation associated with each of the plurality of target display elements to obtain a plurality of animations; displaying the first animation on the first display interface includes: displaying the plurality of animations respectively on the first display interface.

[0011] Based on the embodiments of this application, when the first display interface includes multiple target display elements, the electronic device can generate an animation associated with each target display element according to the user's interaction actions, and display multiple animations on the first display interface respectively. In this way, each target display element has a corresponding animation, thereby causing changes to multiple target display elements in the first display interface, thus improving the display effect of the electronic device.

[0012] In some implementations, the multiple animations have the same action, or at least two of the multiple animations have different actions.

[0013] Based on the embodiments of this application, when multiple animations have the same action, the animation effects of multiple target display elements in the first display interface can be made the same. For example, multiple target display elements can rotate in the same direction, thereby presenting a better display effect. When at least two of the multiple animations have different actions, the diversity and interest of the animations can be enhanced.

[0014] In some implementations, generating a first animation in response to detecting a user's first interactive action includes: detecting a change in the user's gaze direction as they look at the first display interface; determining rotation data of the at least one target display element based on the change in gaze direction; and generating the first animation based on the rotation data.

[0015] For example, electronic devices can detect changes in gaze direction using a camera, or they can detect changes in gaze direction using a time-of-flight (TOF) sensor.

[0016] Based on the embodiments of this application, the electronic device can detect changes in the user's gaze direction, determine the rotation data of the target display element based on the changes in gaze direction, and generate a first animation based on the rotation data.

[0017] In this way, the target display element can rotate according to the change in the user's eye gaze direction, thus achieving the effect of the user's eye controlling the rotation of the display element.

[0018] In some implementations, generating a first animation in response to detecting a user's first interactive action includes: detecting a change in the angle of the user's face relative to the display screen; determining rotation data of the at least one target display element based on the change in angle; and generating the first animation based on the rotation data.

[0019] For example, electronic devices can use cameras to capture changes in the angle of a user's face relative to the display screen.

[0020] In this way, the target display element can change according to the user's face rotation, thus achieving the effect of the user controlling the rotation of the display element with their face.

[0021] In some implementations, the rotation data includes at least a rotation angle of a first target display element in a first direction, and generating the first animation based on the rotation data includes: rotating the first target display element according to the rotation angle in the first direction to generate an animation associated with the first target display element.

[0022] It should be understood that the first target display element can be one of at least one target display elements. In this case, the first target display element has a rotation angle in a first direction. This application does not limit the rotation direction or rotation angle of other target display elements besides the first target display element. The rotation direction of the other target display elements can be the same as or different from the first direction; the rotation angle of the other target display elements can be the same as or different from the rotation angle of the first target display element.

[0023] It should also be understood that the first target display element can also be multiple target display elements among at least one target display element. In this case, multiple target display elements can have the same rotation angle in the first direction, so that multiple target display elements can have the same rotation effect.

[0024] In some cases, the first target display element may be the same as at least one target display element, in which case all display elements in the at least one target display element have the same animation effect.

[0025] For example, the first direction can be clockwise or counterclockwise, or the first direction can be the X-axis direction, Y-axis direction, or Z-axis direction in a three-dimensional coordinate system.

[0026] For example, the rotation data may also include the rotation angle of at least one target display element in a second direction, or it may also include the rotation angle of at least one target display element in a third direction. For instance, the rotation data includes rotation angles in the X-axis direction, Y-axis direction, and Z-axis direction in a three-dimensional coordinate system.

[0027] Based on the embodiments of this application, an electronic device can rotate a first target display element according to a rotation angle in a first direction to generate a corresponding animation.

[0028] In some implementations, generating a first animation in response to detecting a user's first interactive action includes: acquiring data from the inertial measurement unit of the electronic device; determining movement data of the at least one target display element based on the data from the inertial measurement unit, the movement data including movement direction and / or acceleration value; and generating the first animation based on the movement data.

[0029] For example, the electronic device can acquire data from the inertial measurement unit when the user shakes the device.

[0030] Based on the embodiments of this application, an electronic device can determine the movement data of a target display element based on the data from the inertial measurement unit, and generate a first animation of the target display element based on the movement data.

[0031] In this way, when a user shakes the electronic device, the target display element can move in the direction of the user's shaking, thereby improving the user experience.

[0032] In some implementations, the first display interface includes at least one of an always-on display interface, a lock screen display interface, or a desktop.

[0033] In a second aspect, a display method is provided for use in an electronic device. The method includes: generating a plurality of sub-videos based on the first video in response to an operation of setting a first video as the wallpaper of a second display interface; displaying the second display interface, the second display interface including a display area for displaying the plurality of sub-videos; and playing the first sub-video in response to detecting that the user's eye gaze is located within the display area where the first sub-video is located, wherein the first sub-video is a sub-video among the plurality of sub-videos.

[0034] Based on the embodiments of this application, when a user sets a selected video as wallpaper, the electronic device can generate multiple sub-videos based on the video. When the user's gaze is detected to be within the display area of ​​the first sub-video, the target sub-video can be played.

[0035] In this way, electronic devices can generate multiple videos based on the video set as wallpaper, increasing the diversity of wallpaper displays. Electronic devices can also play videos that the user is looking at, allowing the display to show whichever video the user is focusing on, thus enhancing the user experience.

[0036] In some implementations, the method further includes pausing playback of the first sub-video in response to detecting that the user's gaze point leaves the first display area where the first sub-video is located.

[0037] Based on the embodiments of this application, when the electronic device detects that the user's gaze has left the first sub-video, it can pause the playback of the first sub-video. In this way, the electronic device can conveniently implement video playback and pause.

[0038] In some implementations, the method further includes: in response to detecting that the user's eye gaze is located within the display area where the second sub-video is located, playing the second sub-video, wherein the second sub-video is a sub-video among the plurality of sub-videos.

[0039] Based on the embodiments of this application, when the electronic device detects that the user's eye gaze is located within the display area where the second sub-video is located, it can play the second sub-video. In this way, the electronic device can conveniently switch the video being played on the second display interface.

[0040] In some implementations, the second display interface includes at least one of an always-on display interface, a lock screen display interface, or a desktop.

[0041] Thirdly, an electronic device is provided, comprising: one or more processors; one or more memories; said one or more memories storing one or more programs that, when executed by said one or more processors, cause a display method as described in the first aspect and any possible implementation thereof to be executed.

[0042] Fourthly, a display device is provided, including modules for implementing the display method as described in the first aspect and any possible implementation thereof.

[0043] Fifthly, a chip is provided, the chip including a processor and a communication interface, the communication interface being used to receive signals and transmit signals to the processor, the processor processing the signals such that the display method as described in the first aspect and any possible implementation thereof is executed.

[0044] In a sixth aspect, a readable storage medium is provided, in which instructions are stored, which, when executed on a device, cause the display method as described in the first aspect and any possible implementation thereof to be performed.

[0045] In a seventh aspect, a program product is provided, the program product including program code, which, when run on a device, causes the display method as described in the first aspect and any possible implementation thereof to be executed. Attached Figure Description

[0046] Figure 1 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application.

[0047] Figure 2 This is a schematic diagram of the software structure of the electronic device provided in the embodiments of this application.

[0048] Figure 3 This is a schematic diagram of a set of graphical user interfaces (GUIs) provided in the embodiments of this application.

[0049] Figure 4 This is a schematic diagram of a set of GUIs provided in the embodiments of this application.

[0050] Figure 5 This is a schematic diagram of a set of GUIs provided in the embodiments of this application.

[0051] Figure 6 This is a schematic diagram of a set of GUIs provided in the embodiments of this application.

[0052] Figure 7 This is a schematic diagram of a set of GUIs provided in the embodiments of this application.

[0053] Figure 8 This is a schematic diagram of a set of GUIs provided in the embodiments of this application.

[0054] Figure 9 This is a schematic diagram of a set of GUIs provided in the embodiments of this application.

[0055] Figure 10 This is a schematic architecture diagram of an electronic device provided in an embodiment of this application.

[0056] Figure 11 This is a schematic flowchart of a display method provided in an embodiment of this application.

[0057] Figure 12 This is a schematic flowchart of a display method provided in an embodiment of this application.

[0058] Figure 13 This is a schematic block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0059] The technical solutions in this application will now be described with reference to the accompanying drawings.

[0060] The methods in this application embodiment can be applied to electronic devices such as smartphones, tablets, laptops, personal computers (PCs), ultra-mobile personal computers (UMPCs), netbooks, in-vehicle devices, smart TVs, wearable devices, foldable devices, and Internet of Things (IoT) devices.

[0061] Figure 1 A schematic diagram of the structure of electronic device 100 is shown. Electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0062] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0063] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0064] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0065] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0066] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus interface, etc.

[0067] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL).

[0068] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to realize communication between the processor 110 and the audio module 170.

[0069] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface.

[0070] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160.

[0071] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193.

[0072] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc.

[0073] USB interface 130 is an interface that conforms to the USB standard specification, specifically it can be a Mini USB interface, Micro USB interface, USB Type C interface, etc. USB interface 130 can be used to connect a charger to charge electronic device 100, and it can also be used for data transfer between electronic device 100 and peripheral devices.

[0074] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0075] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0076] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110.

[0077] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0078] The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for use on electronic devices 100.

[0079] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0080] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Bluetooth low energy (BLE), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies.

[0081] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with networks and other devices through wireless communication technology.

[0082] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0083] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), or a display panel made of materials selected from organic light-emitting diodes (OLEDs), active-matrix organic light-emitting diodes (AMOLEDs), flexible light-emitting diodes (FLEDs), miniled, microled, micro-oled, or quantum dot light-emitting diodes (QLEDs). In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0084] In this embodiment of the application, the display screen can be used to display animations generated in real time by the electronic device.

[0085] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0086] The ISP is used to process the data fed back by camera 193. Camera 193 is used to capture still images or videos.

[0087] A digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals.

[0088] Video codecs are used to compress or decompress digital video.

[0089] The external storage interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.

[0090] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121.

[0091] Electronic device 100 can implement audio functions through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0092] The audio module 170 is used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal.

[0093] The loudspeaker 170A, also known as a "loudspeaker", is used to convert audio electrical signals into sound signals.

[0094] The receiver 170B, also known as the "earpiece", is used to convert audio electrical signals into sound signals.

[0095] The microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals.

[0096] The 170D headphone jack is used to connect wired headphones.

[0097] The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, an accelerometer sensor 180E, a distance sensor 180F, a fingerprint sensor 180H, a touch sensor 180K, a bone conduction sensor 180M, etc.

[0098] Button 190 includes the power button, volume buttons, etc.

[0099] Motor 191 can generate vibration alerts.

[0100] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0101] The SIM card interface 195 is used to connect the SIM card.

[0102] Figure 2 This is a software structure block diagram of an electronic device 100 according to an embodiment of this application. The layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into four layers, from top to bottom: the application layer, the application framework layer, the system library layer, and the kernel layer. The application layer may include a series of application packages.

[0103] like Figure 2 As shown, the application package may include applications (Apps) such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, SMS, and wallet.

[0104] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0105] like Figure 2 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0106] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0107] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0108] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0109] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).

[0110] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0111] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0112] The core library consists of two parts: one part contains the functionalities that the Java language needs to call, and the other part is the core library itself.

[0113] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0114] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.

[0115] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0116] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0117] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0118] A 2D graphics engine is a graphics engine for 2D drawing.

[0119] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0120] Before introducing the technical solution of this application, the following is a brief introduction to some of the technical terms that may be involved in this application.

[0121] Screen-off mode can be understood as the electronic device entering a standby state when the screen is off and the device is locked after a preset period of inactivity or when the user presses the power button. In screen-off mode, the electronic device can display a background wallpaper, which can be an image, animation, or video.

[0122] It should be understood that the electronic device turns off the screen and locks the screen after displaying the always-on wallpaper. After the electronic device locks the screen, it can still display the always-on wallpaper when it detects that the user is looking at the screen, or when it detects that the user taps the screen.

[0123] The lock screen state can be understood as the electronic device entering a lock screen state when the user does not operate the electronic device within a preset time or when the user presses the power button of the electronic device.

[0124] When a user double-clicks the display screen in the off-screen state or presses the power button of the electronic device, the electronic device can display the lock screen wallpaper. For example, the lock screen wallpaper can be an image, animation, or video. In the lock screen state, the user needs to unlock the electronic device before they can use it normally.

[0125] When using electronic devices, users can set their lock screen wallpaper, always-on wallpaper, and other settings according to their preferences. For example, when setting a lock screen, users can use 2D or 3D animations as wallpapers. However, these 2D or 3D animations are fixed and relatively monotonous, which can easily lead to user fatigue.

[0126] In view of this, embodiments of this application provide a display method and an electronic device. In this technical solution, the electronic device can generate animations in real time according to user interaction actions and pre-set rules. For example, the electronic device can generate dynamic lock screen animations in real time, thereby enabling dynamic interaction with the user and enhancing the fun of the lock screen.

[0127] The following section will describe the display methods in the embodiments of this application in conjunction with several sets of graphical user interfaces (GUIs).

[0128] For example, Figure 3 This is a schematic diagram of a set of GUIs provided in an embodiment of this application. Among them, from Figure 3 (a) through (c) in the figure show the process by which electronic device 200 dynamically generates lock screen animation.

[0129] See Figure 3 In (a), the GUI can be the off-screen display interface 210 of the electronic device 200. The current date and time can be displayed on the display interface 210.

[0130] For example, when the electronic device 200 detects that a user has pressed the power button, it may display something like this: Figure 3 The GUI shown in (b) is shown in the image.

[0131] Alternatively, when the electronic device 200 detects a user's double-tap operation on the display screen, it can display something like... Figure 3 The GUI shown in (b) is shown in the image.

[0132] It is understood that the embodiments of this application do not limit the electronic device to entering the display from the display interface 210. Figure 3 The specific method of the GUI is shown in (b) above.

[0133] See Figure 3 In (b) of this document, the GUI can be the lock screen display interface 220 of the electronic device 200. This display interface 220 can be used to display the lock screen wallpaper or lock screen animation set by the user. The display interface 220 may include multiple display elements 221.

[0134] The multiple display elements 221 can be distributed in several rows and columns (such as three rows and three columns, or six rows and three columns, etc.), or in other regular or irregular shapes. In this embodiment, the multiple display elements are distributed in three rows and three columns as an example for illustration.

[0135] It should be understood that the display element 221 can also be called an element, a lock screen element, or an animated element, etc.

[0136] In this embodiment of the application, the display element 221 is described as a two-dimensional emoticon.

[0137] In other examples, the display element 221 may be a three-dimensional object model, such as a three-dimensional facial sphere, a three-dimensional animal, a three-dimensional plant, a three-dimensional building, a three-dimensional object, etc., which is not limited in this application embodiment.

[0138] In some examples, the electronic device 200 has pre-set a corresponding lock screen wallpaper, or the electronic device has applied a corresponding theme that includes the corresponding lock screen wallpaper. Unlike current lock screen wallpapers, the lock screen wallpaper in this embodiment is not fixed; the lock screen elements can change in real time according to the user's interaction, thereby improving the user's experience of using lock screen animations.

[0139] When the electronic device 200 displays the display interface 220, the electronic device 200 can detect the user's eye gaze direction, and the display element 221 in the display interface 220 can change according to the user's eye gaze. For example, the display element 221 can rotate or move according to the user's eye gaze direction.

[0140] It is understood that the embodiments of this application do not limit the specific technical means by which electronic devices determine the direction of a user's eye gaze.

[0141] For example, an electronic device can use a camera to detect the direction of a user's gaze. For instance, the electronic device can acquire facial information from the user through the camera and further determine the direction of the user's gaze.

[0142] In other examples, the display interface 210 may also include the plurality of display elements 221. For example, the plurality of display elements 221 may be displayed in the display interface 210 at low brightness. In this way, the consistency of the electronic device's screen-off display content to the lock screen display content can be maintained.

[0143] It should be understood that in this application, the electronic device obtains the user's facial information or the user's gaze point through the camera only with the user's authorization.

[0144] For example, if the user's current gaze point is located in the center of the display screen, and the electronic device detects that the user's eyes have moved from the current gaze point to the upper right of the display screen, it can display something like this. Figure 3 The GUI shown in (c) is shown in the image.

[0145] Alternatively, when the electronic device detects that the user's eyes are focused on the upper right area of ​​the display screen, it can display something like... Figure 3 The GUI shown in (c) is shown in the image.

[0146] See Figure 3 In (c), multiple display elements 221 can be rotated in the direction the user's eyes are looking at, so as to keep in line with the direction the user's eyes are looking at.

[0147] The direction of a user's gaze can also be understood as the point of focus of the user's eyes.

[0148] It is understood that the direction of the user's eye movement or gaze direction in this embodiment is merely illustrative. In other examples, if the electronic device detects that the user's eye is moving from the current gaze point to the lower right of the display screen, or if the user's gaze direction is located in the lower right area of ​​the display screen, the multiple display elements 221 may also rotate in another direction, which is not limited in this embodiment.

[0149] In other examples, multiple display elements 221 may rotate in different directions, or the multiple display elements 221 may rotate at different angles. In this case, the electronic device needs to determine the direction or angle of rotation of each display element 221 according to the response rules of each display element 221, so that the movement of each display element 221 can form a separate animation, thereby improving the diversity and fun of the lock screen animation.

[0150] In this embodiment, the developers of the lock screen animation can define the attributes and response rules of the display elements through configuration files. The response rules for multiple display elements can be the same or different. The response rules for display elements will be described below with reference to specific embodiments, and will not be detailed here.

[0151] The configuration file can be Extensible Markup Language (XML), Domain-Specific Language (DSL), JavaScript Object Notation (JSON), etc.

[0152] In other examples, when display element 221 is a three-dimensional object model, such as a three-dimensional facial expression sphere, the electronic device 200 can detect the user's eye gaze direction and control the display element 221 to rotate in that direction. It should be understood that the electronic device 200 can continuously detect the user's eye gaze direction, and when the user's eye gaze direction changes, control the display element 221 to dynamically rotate according to the user's eye gaze direction, so that the user can have the effect of controlling the display element 221 in real time with their eyes.

[0153] Based on the embodiments of this application, in the lock screen display interface of an electronic device, the electronic device can dynamically control the changes of display elements according to the user's eye gaze direction to form a lock screen animation, thereby improving the interactivity between the user and the electronic device and enhancing the user's experience of using lock screen animations.

[0154] For example, Figure 4 This is a schematic diagram of a set of GUIs provided in an embodiment of this application. Among them, from Figure 4 (a) through (c) in the figure show the process by which electronic device 200 dynamically generates lock screen animation.

[0155] It should be understood that Figure 4 (a) to (b) can be found in [reference]. Figure 3 For the sake of brevity, the relevant descriptions in (a) to (b) are not detailed here.

[0156] When the electronic device 200 detects a change in the sensor data, it can display, for example... Figure 4 The GUI shown in (c) is an example. The sensor can be a gyroscope sensor or a gravity acceleration sensor, etc.

[0157] For example, when a user holds the electronic device 200 and shakes it to the right (the side where the power button is located), the data from the sensors of the electronic device 200 will change. The electronic device 200 can determine the direction and acceleration of the movement of the displayed element based on the changes in the sensor data. Alternatively, the electronic device 200 can further determine the movement speed or movement distance based on the changes in the sensor data.

[0158] See Figure 4 In (c), multiple display elements 221 can be moved to the right, and the display elements 221 distributed in each row are close to each other. Among them, the display elements 221 in the rightmost column can be close to the right side of the display screen.

[0159] In other examples, the moving direction, acceleration value, moving distance, or moving speed of the plurality of display elements 221 may also be the same, which is not limited in this embodiment. In this case, the plurality of display elements 221 visually present a display effect of moving as a whole to one side.

[0160] In other examples, the plurality of display elements 221 may also present a display effect of mutual collision and compression, etc., which are not limited in the embodiments of this application.

[0161] It should be understood that the embodiments of this application are only illustrated by the example of a user shaking the electronic device 200 to the right. In other examples, the user may also shake the electronic device 200 in other directions, and the plurality of display elements 221 may move according to the direction of the user's shaking. The embodiments of this application do not limit this.

[0162] Based on the embodiments of this application, when an electronic device displays a lock screen interface, and the user shakes the electronic device, the electronic device can detect changes in sensor data and control the movement of display elements according to the changes in sensor data, thereby achieving a display effect where the display elements move according to the user's shaking.

[0163] The above combination Figure 4-5 This paper introduces a technical solution that allows multiple display elements to generate the same animation effect. In some embodiments, each display element can also generate different animation effects. The following will combine this with... Figure 5 This technical solution will be introduced.

[0164] For example, Figure 5 This is a schematic diagram of a set of GUIs provided in an embodiment of this application. Among them, from Figure 5(a) through (c) in the figure show the process by which electronic device 200 dynamically generates lock screen animation.

[0165] It should be understood that Figure 5 (a) to (b) can be found in [reference]. Figure 3 For the sake of brevity, the relevant descriptions in (a) to (b) are not repeated here.

[0166] For example, when the electronic device 200 detects that the user's eye gaze direction or gaze point is located in display element 2211 among a plurality of display elements 221, and the user's eye gaze direction moves downward, it can display as follows: Figure 5 The GUI shown in (c) is shown in the image.

[0167] See Figure 5 In (c), the display element 2211 can move downwards according to the user's eye gaze direction, while the other display elements remain unchanged.

[0168] In this case, the response rules for each of the multiple display elements 221 can be different, meaning each display element has its own animation effect. Taking display element 2211 as an example, its response rule can be that when the electronic device detects that the user's eye gaze direction is located on the display element 2211, and the user's eye gaze direction changes (for example, the user's eye gaze direction moves downward from its current position), then the display element 2211 can move along with the user's gaze direction, thereby achieving the display effect that the display element being gazed at moves along with the user's gaze direction.

[0169] Based on the embodiments of this application, each display element in the lock screen display interface can have an individual animation effect, so that when the user looks at a certain display element and the line of sight moves, the display element will follow the user's line of sight, thereby achieving the effect of the display element following eye movement and improving the user's experience of using lock screen animation.

[0170] In some cases, the technical solutions of the embodiments of this application can also be applied to screen-off scenarios.

[0171] For example, Figure 6 This is a schematic diagram of a set of GUIs provided in an embodiment of this application. Among them, from Figure 6 (a) to (b) show the process of dynamically generating electronic device 300 in a screen-off scenario.

[0172] See Figure 6 In (a), the GUI can be the always-on display interface 310 of the electronic device 300. The display interface 310 can display information such as date and time, and can also display multiple display elements 311.

[0173] It should be understood that the description of display element 311 can be found in the previous description of display element 211, and for the sake of brevity, it will not be repeated here.

[0174] For example, if the user's current gaze point is located in the center of the display screen, and the electronic device 300 detects that the user's eye has moved from the current gaze point to the upper right of the display screen, it can display something like this. Figure 6 The GUI shown in (b) is shown in the image.

[0175] Alternatively, when the electronic device 300 detects that the user's eyes are focused on the upper right area of ​​the display screen, it can display something like... Figure 6 The GUI shown in (b) is shown in the image.

[0176] See Figure 6 In (b), multiple display elements 311 can be rotated in the direction the user's eyes are looking at, so as to keep in line with the direction the user's eyes are looking at.

[0177] It is understood that the direction of the user's eye movement or gaze direction in this embodiment is merely illustrative. In other examples, if the electronic device detects that the user's eye is moving from the current gaze point to the lower right of the display screen, or if the user's gaze direction is located in the lower right area of ​​the display screen, the multiple display elements 311 may also rotate in another direction, which is not limited in this embodiment.

[0178] It should be understood that Figure 6 The display element 311 in (b) can also be found in [the text]. Figure 3 The relevant description of display element 221 is in (c) of the document.

[0179] Based on the embodiments of this application, in the always-on display interface of an electronic device, the electronic device can dynamically control the changes of display elements according to the user's eye gaze direction to form a always-on animation, thereby improving the interactivity between the user and the electronic device and enhancing the user's experience of using the always-on animation.

[0180] For example, Figure 7 This is a schematic diagram of a set of GUIs provided in an embodiment of this application. Among them, from Figure 7 (a) to (b) show the process of electronic device 300 dynamically generating animation in a screen-off scenario.

[0181] It should be understood that Figure 7 (a) in the text can be found in [reference 1]. Figure 6 For the sake of brevity, the relevant description of (a) in the text will not be repeated here.

[0182] When the electronic device 300 detects a change in the sensor data, it can display, for example... Figure 7The GUI is shown in (b) above. The sensor can be a gyroscope sensor or a gravity acceleration sensor, etc.

[0183] For example, when a user holds the electronic device 300 and shakes it to the right (the side where the power button is located), the data from the sensors of the electronic device 300 will change. The electronic device 300 can determine the direction of movement, speed or acceleration or distance of movement of the display element based on the changes in the sensor data.

[0184] See Figure 7 In (b), multiple display elements 311 can be moved to the right, and the display elements 311 distributed in each row are close to each other. Among them, the display elements 311 in the rightmost column can be close to the right side of the display screen.

[0185] In other examples, the moving direction, moving distance, or moving speed of the plurality of display elements 311 may also be the same, which is not limited in this embodiment. In this case, the plurality of display elements 311 visually present a display effect of moving as a whole to one side.

[0186] In other examples, the multiple display elements 311 may also present a display effect of mutual collision and compression, etc., which is not limited in the embodiments of this application.

[0187] It should be understood that the embodiments of this application are only illustrated by the example of a user shaking the electronic device 300 to the right. In other examples, the user may also shake the electronic device 300 in other directions, and the plurality of display elements 311 may move according to the direction of the user's shaking. The embodiments of this application do not limit this.

[0188] Based on the embodiments of this application, when an electronic device is displaying an always-on display interface, the electronic device can detect changes in sensor data when the user shakes the electronic device, and control the movement of display elements according to the changes in sensor data, thereby achieving a display effect in which display elements move according to the user's shaking.

[0189] In some optional examples, the display element can also be a desktop display element. For example, after an electronic device is unlocked, the wallpaper on the desktop of the electronic device can include the aforementioned display element 221, which can also generate dynamic animations in real time based on the user's interaction actions to enhance the user experience.

[0190] The above combination Figure 3-7 This article describes the process by which display elements in the always-on display or lock screen of electronic devices generate animations in real time based on user interaction. In some cases, users can also set dynamic images or videos as lock screen or always-on screen animations; this will be discussed in the following sections. Figure 8-9 This technical solution will be introduced.

[0191] For example, Figure 8 This is a schematic diagram of a set of GUIs provided in an embodiment of this application. Among them, from Figure 8 Images (a) through (c) show the process of electronic device 400 playing a lock screen video.

[0192] It should be understood that Figure 8 (a) in the text can be found in [reference 1]. Figure 3 For the sake of brevity, the relevant description of (a) in the text will not be repeated here.

[0193] When the electronic device 400 detects that the user has pressed the power button, it can display something like this: Figure 8 The GUI shown in (b) is shown in the image.

[0194] Alternatively, when the electronic device 400 detects a user's double-tap operation on the display screen, it can display something like... Figure 8 The GUI shown in (b) is shown in the image.

[0195] See Figure 8 In (b), the GUI can be the lock screen display interface 420 of an electronic device. The display interface 420 may include the date, time, and multiple videos, such as video 421 and video 422.

[0196] It should be understood that, prior to the embodiments of this application, when setting the lock screen, the electronic device 400 had already set the target video selected by the user as the lock screen wallpaper. The source of the video 421 and the video 422 can be the target video.

[0197] For example, electronic device 400 may have artificial intelligence (AI) capabilities, and electronic device 400 may use AI to analyze target video to obtain video 421 and video 422.

[0198] For example, videos 421 and 422 could be highlights from target videos determined by the electronic device using AI.

[0199] Alternatively, videos 421 and 422 can be video segments that include the largest portion of the main body of the video. For example, if the target video is a video taken by a user that includes a pet, then videos 421 and 422 can be video segments that include the largest portion of the pet.

[0200] For example, videos 421 and 422 could also be obtained by electronic devices through AI to randomly crop from the target video.

[0201] For example, videos 421 and 422 can also be created by electronic devices using AI to generate videos from the target video. For instance, electronic devices can identify the subject (such as a person, pet, or building) in the target video and generate videos 421 and 422 based on the identified subject.

[0202] It should be understood that the specific duration of videos 421 and 422 is not limited in this embodiment of the application. For example, the duration of videos 421 and 422 may be 5 seconds or 10 seconds. Furthermore, the durations of videos 421 and 422 may be the same or different.

[0203] It should be understood that the specific number of videos displayed on the display interface 420 is not limited in the embodiments of this application. In other examples, the display interface 420 may also display three or more videos.

[0204] It should also be understood that the layout of the multiple videos displayed on the display interface 420 is not limited in this embodiment. In some examples, videos 421 and 422 can be arranged vertically. In other examples, videos 421 and 422 can also be arranged horizontally.

[0205] In some alternative embodiments, videos 421 and 422 can also be selected by the user. For example, an electronic device can use both videos 421 and 422 as a lock screen wallpaper in response to a user's selection of videos 421 and 422.

[0206] In this embodiment, the electronic device 400 can acquire the user's gaze point in real time. When the electronic device 400 determines that the user's gaze point is located within the display area where the video 421 is located, it can display, as shown below... Figure 8 The GUI shown in (c) is shown in the image.

[0207] Alternatively, when electronic device 400 detects that the user clicks on video 421, it can display... Figure 8 The GUI shown in (c) is shown in the image.

[0208] See Figure 8 In (c), the electronic device can play video 421, or not play video 422.

[0209] In other examples, when electronic device 400 determines that the user's gaze is within the display area where video 422 is located, the electronic device may play video 422 but not video 421.

[0210] Alternatively, when electronic device 400 determines that the user's gaze is neither within the display area where video 421 is located nor within the display area where video 422 is located, electronic device 400 may choose not to play video 421 and video 422.

[0211] Based on the embodiments of this application, an electronic device can analyze the video selected by the user as the lock screen wallpaper to identify multiple videos, and use these multiple videos as lock screen wallpapers. Furthermore, it can determine whether to play a video based on the user's eye gaze. Thus, the lock screen display can achieve the effect of playing the video that the user is looking at.

[0212] For example, Figure 9 This is a schematic diagram of a set of GUIs provided in an embodiment of this application. Among them, from Figure 9 Images (a) to (b) show the process of electronic device 500 playing a screen-off video.

[0213] See Figure 9 In (a), the GUI can be the always-on display interface 510 of the electronic device 500. The display interface 510 can display information such as date and time, and can also display multiple videos, such as video 521 and video 522.

[0214] Understandably, these multiple videos can be found in the preceding text. Figure 8 For the sake of brevity, the description of multiple videos in (b) will not be repeated here.

[0215] In this embodiment, the electronic device 500 can acquire the user's gaze point in real time. When the electronic device 500 determines that the user's gaze point is located within the display area where the video 521 is located, it can display, as shown below... Figure 9 The GUI shown in (b) is shown in the image.

[0216] See Figure 9 In (b), electronic device 500 can play video 521, or not play video 522.

[0217] In other examples, when electronic device 500 determines that the user's gaze is within the display area where video 522 is located, the electronic device may play video 522 but not video 521.

[0218] Alternatively, when electronic device 500 determines that the user's gaze is neither within the display area where video 521 is located nor within the display area where video 522 is located, electronic device 500 may choose not to play video 521 and video 522.

[0219] Based on the embodiments of this application, an electronic device can analyze the video selected by the user as the always-on display wallpaper to identify multiple videos, and use these multiple videos as always-on display wallpapers. Furthermore, it can determine whether to play a video based on the user's eye gaze. Thus, in the always-on display interface, the video played is the one the user is looking at.

[0220] The following will combine Figure 10 This paper introduces the architecture diagram of the electronic device in the embodiments of this application, and describes how the electronic device realizes the process of dynamically generating animation.

[0221] For example, Figure 10 This is a schematic architectural diagram of an electronic device provided in an embodiment of this application. Figure 10 As shown, the electronic device may include at least a scene definition module, an input module, a theme service module, and a display module.

[0222] The scene definition module can be used to define display elements and their response rules.

[0223] See one example. Figure 3 In (b) of the diagram, each of the multiple display elements 221 can be defined by the scene definition module. For example, for one of the display elements, the developer can define the name of the display element, the specific model of the display element, the display position of the display element, etc. The developer can also define the distribution of multiple display elements in the display interface, etc.

[0224] The scene definition module can also define the response rules for each display element.

[0225] For example, let's illustrate this by defining the response rule for one of the display elements. The response rule for this display element is as follows:

[0226] <Name(ViewName) = "Name1", Type(type) = "First Type", TargetProperty(TargetProperty) = Rotation(rotation), Rotation Angle in X Direction = "sin(Camera Azimuth Angle Data in X Direction) * 50", Rotation Angle in Y Direction = "sin(Camera Azimuth Angle Data in Y Direction) * 50", Rotation Angle in X Direction = "null">.

[0227] The above types can include the two types shown in Table 1 below, and the types can be extended.

[0228] Table 1

[0229] Type 1 Camera azimuth data Type II Sensor data

[0230] The first type means that camera azimuth data needs to be acquired. The second type means that sensor data needs to be acquired.

[0231] The target attribute mentioned above can include two of the types shown in Table 2 below, and the target attribute can be extended.

[0232] Table 2

[0233] Rotation Rotate along the X, Y, and Z axes move Move according to the direction of movement and the value of gravitational acceleration.

[0234] A target attribute of "rotation" means that the displayed element needs to be rotated according to the angles of the X, Y, and Z axes. A target attribute of "movement" means that the displayed element needs to be moved according to the direction of movement and the value of gravitational acceleration.

[0235] It should be understood that the electronic device can also move the display element according to the direction of movement or the value of gravitational acceleration.

[0236] It should be understood that the scenario definition module can configure the response rules for each display element in the form of an XML file.

[0237] See another example. Figure 8 In (b), the scene definition module can define two objects, one above the other, which can be used to carry video 421 and video 422 respectively.

[0238] This input module can be used to receive data from various physical units or sensors of electronic devices and transmit the received data to the topic service module.

[0239] For example, the input module can receive azimuth data from the camera and transmit the azimuth data to the theme service module.

[0240] For example, the input module can also receive data from various sensors (such as gyroscope sensors, gravity accelerometers, etc.) and transmit the data acquired by the sensors to the theme service module.

[0241] In this embodiment, the data from the gyroscope sensor and the gravity accelerometer can be acquired through an inertial measurement unit (IMU). Alternatively, when the electronic device does not have an IMU, the data can still be acquired through the gyroscope sensor and the gravity accelerometer.

[0242] The theme service module can include at least an event conversion module and a scene management and rendering module.

[0243] The event conversion module in the topic service module can be used to receive data transmitted from the input module and convert the received data into corresponding values.

[0244] For example, the event conversion module can be used to receive the camera's angle value and convert it into an azimuth angle value between the camera and the user's face.

[0245] For example, the event conversion module can be used to receive data from gyroscope sensors and gravity accelerometers, and convert the data into the movement direction and acceleration value of the display elements.

[0246] Afterwards, the event conversion module can transmit the converted values ​​to the scene management and rendering module.

[0247] After receiving the data sent by the event conversion module, the scene management and rendering module can be used to calculate the final result according to the formula or to render the data.

[0248] For example, if the scene management and rendering module receives a display element named "Display Element A" of type 1 with camera azimuth data of [100, 100, 100], then the rotation angle in the X direction is "sin(100)*50" = 49.2 degrees, the rotation angle in the Y direction is "sin(100)*50" = 49.2 degrees, and the rotation angle in the X direction is "empty(null) = 0 degrees".

[0249] The scene management and rendering module can rotate the display element A by 49.2 degrees along the X-axis, 49.2 degrees along the Y-axis, and 0 degrees along the Z-axis (i.e., no rotation along the Z-axis), and render the result. Afterward, the scene management and rendering module can send the rendered result to the display module for display.

[0250] In one example, the display module can use the display data sent by the scene management and rendering modules in the theme service module to display rotation effects of display elements, etc.

[0251] For example, see Figure 3In (b) of the above, if the multiple display elements 221 are three-dimensional expression spheres, when the electronic device detects a change in the user's gaze direction, the input module can transmit the received camera angle value to the event conversion module in the theme service module. The event conversion module can convert the camera angle value into an azimuth angle value between the camera and the user's face, and transmit this azimuth angle value to the scene management and rendering module. For example, if the camera azimuth angle value is [100, 100, 100], the scene management and rendering module can rotate the multiple display elements 221 by 49.2 degrees towards the X-axis, 49.2 degrees towards the Y-axis, and 0 degrees towards the Z-axis to achieve a display effect where multiple display elements rotate simultaneously according to the user's gaze. In this case, the response rule of each display element 221 is the same; in other cases, the response rule of each display element 221 can be different, which is not limited in this embodiment. When the response rule of each display element 221 is different, the rotation angle of the multiple display elements 221 can be different.

[0252] For example, see Figure 8 In step (b), the input module can transmit the received camera angle value to the event conversion module in the theme service module. The event conversion module can convert the camera angle value into an azimuth angle value between the camera and the user's face, and then send this azimuth angle value to the scene management and rendering module. The scene management and rendering module can determine that the user's gaze point is located in video 421 based on this azimuth angle value, and can then render the corresponding playback effect and send the rendering result to the display module for display to play video 421.

[0253] For example, if the scene management and rendering module receives a display element named "Display Element B" of type 2 and its corresponding movement direction and acceleration value, the scene management and rendering module can move the display element B according to the movement direction and acceleration value and render the movement effect.

[0254] Alternatively, if the scene management and rendering module receives a display element named "Display Element C" of type 2 with a corresponding movement direction and acceleration value of 1, the scene management and rendering module can also recalculate the acceleration value 2 according to formula C, move display element C according to the movement direction and acceleration value of 2, and render the movement effect.

[0255] It should be understood that this application does not limit the formula C. For example, the formula C = 1 / 10 of the acceleration value, or the formula C = 1 / 5 of the acceleration value, etc.

[0256] See Figure 4In steps (b) to (c), when the electronic device detects that the user is shaking the device to the right, the input module can transmit the received sensor data to the event conversion module in the theme service module. The event conversion module calculates the movement direction and gravitational acceleration value of the display element and sends these values ​​to the scene management and rendering module. The scene management and rendering module can then render the display element based on the movement direction and gravitational acceleration value and send the rendering result to the display module for display, thus presenting the real-time movement effect of the display element.

[0257] It is understood that the names of the above modules are merely illustrative. In other examples, the above modules may be called modules with other names while having the same function. This application does not limit this.

[0258] In other examples, the scene management and rendering module can also be two modules: a scene management module and a rendering module. The scene management module can be used to calculate the results, and the rendering module can be used to render and display the data.

[0259] Figure 11 This is a schematic flowchart illustrating a display method provided in an embodiment of this application. Figure 11 As shown, the method 700 can be applied to electronic devices, and the method 700 may include steps 710 to 730.

[0260] 710, The electronic device displays a first display interface, which includes one or more display elements.

[0261] The display element can be a two-dimensional display element or a three-dimensional display element.

[0262] For example, the display element can be a two-dimensional emoticon, animal, building, etc. The three-dimensional display element can be a three-dimensional emoticon sphere, three-dimensional animals, three-dimensional plants, three-dimensional buildings, etc.

[0263] For example, see Figure 3 The first display interface can be display interface 220, that is, the first display interface can be a lock screen display interface. The display element can be display element 221.

[0264] For example, see Figure 6 The first display interface can be display interface 310, that is, the first display interface can be an always-on display interface, and the display element can be display element 311.

[0265] It should be understood that the first display interface can also be a desktop, but this application embodiment does not limit it.

[0266] 720, in response to detecting a first user interaction action, generates a first animation, the first animation being associated with at least one target display element among one or more display elements.

[0267] For example, the first interactive action could be a change in the user's gaze direction as they look at the first display interface, or it could be the user shaking the electronic device, or it could be the user tilting their hand over the electronic device. The electronic device can generate an animation in real time based on this first interactive action.

[0268] 730, the electronic device displays the first animation on the first display interface.

[0269] It should be understood that "the electronic device displays the first animation on the first display interface" can also be understood as "the electronic device plays the first animation on the first display interface".

[0270] Based on the embodiments of this application, the first display interface displayed by the electronic device may include one or more display elements. When a user's first interactive action is detected, the electronic device can generate an animation of the target display element in real time according to a first rule and play the animation.

[0271] In this way, electronic devices can generate animations of target display elements in real time based on user interaction. For example, if the target display element is a lock screen element, the electronic device can generate dynamic lock screen animations in real time, thereby enabling dynamic interaction with the user and enhancing the fun of the lock screen.

[0272] In addition, each time a user unlocks the device, different lock screen animations can be generated based on the user's interaction, thereby increasing the diversity of lock screen animations and improving the user's lock screen experience.

[0273] In some embodiments, at least one target display element is multiple target display elements, and generating a first animation includes:

[0274] Generate an animation associated with each of the multiple target display elements to obtain multiple animations;

[0275] The first animation is displayed on the first display interface, including:

[0276] Multiple animations are displayed in the first display interface.

[0277] Based on the embodiments of this application, when the first display interface includes multiple target display elements, the electronic device can generate an animation associated with each target display element according to the user's interaction actions, and display multiple animations on the first display interface respectively. In this way, each target display element has a corresponding animation, thereby causing changes to multiple target display elements in the first display interface, thus improving the display effect of the electronic device.

[0278] In some embodiments, multiple animations have the same action, or at least two of the multiple animations have different actions.

[0279] Based on the embodiments of this application, when multiple animations have the same action, the animation effects of multiple target display elements in the first display interface can be made the same. For example, multiple target display elements can rotate in the same direction, thereby presenting a better display effect. When at least two of the multiple animations have different actions, the diversity and interest of the animations can be enhanced.

[0280] In some embodiments, in response to detecting a first user interaction, a first animation is generated, including:

[0281] Detect changes in the user's gaze direction as they focus on the primary display interface;

[0282] The rotation data of one or more target display elements is determined based on the change in the gaze direction;

[0283] The first animation is generated based on the rotation data.

[0284] For example, electronic devices can detect changes in gaze direction using a camera, or they can detect changes in gaze direction using a time-of-flight (TOF) sensor.

[0285] When detecting changes in gaze direction using a camera, the changes in gaze direction can be represented by the camera's azimuth data.

[0286] Based on the embodiments of this application, the electronic device can detect changes in the user's gaze direction, determine the rotation data of the target display element based on the changes in gaze direction, and generate a first animation based on the rotation data.

[0287] In this way, the target display element can rotate according to the change in the user's eye gaze direction, thus achieving the effect of the user's eye controlling the rotation of the target display element.

[0288] In some embodiments, in response to detecting a first user interaction, a first animation is generated, including:

[0289] Detect changes in the angle of the user's face relative to the display screen;

[0290] Determine the rotation data of at least one target display element based on the change in angle;

[0291] The first animation is generated based on the rotation data.

[0292] For example, electronic devices can use a camera to capture changes in the angle of a user's face relative to the display screen.

[0293] For example, when an electronic device detects that a user's face has turned from facing the display screen to turning to one side, the target display element can follow the user's face and turn in the same direction or in a certain direction.

[0294] In this way, the target display element can change according to the user's face rotation, thus achieving the effect of the user controlling the rotation of the display element with their face.

[0295] In some embodiments, the rotation data includes at least one rotation angle of a first target display element in a first direction.

[0296] The first animation is generated based on rotation data, including:

[0297] Rotate the first target display element according to the rotation angle in the first direction to generate an animation associated with the first target display element.

[0298] It should be understood that the first target display element can be one of at least one target display elements. In this case, the first target display element has a rotation angle in a first direction. This application does not limit the rotation direction or rotation angle of other target display elements besides the first target display element. The rotation direction of the other target display elements can be the same as or different from the first direction; the rotation angle of the other target display elements can be the same as or different from the rotation angle of the first target display element.

[0299] For example, see Figure 3 The first target display element can be one of a plurality of display elements 211.

[0300] It should also be understood that the first target display element can also be multiple target display elements among at least one target display element. In this case, multiple target display elements can have the same rotation angle in the first direction, so that multiple target display elements can have the same rotation effect.

[0301] In some cases, the first target display element may be the same as at least one target display element, in which case all display elements in the at least one target display element have the same animation effect.

[0302] For example, the first direction can be clockwise or counterclockwise, or the first direction can be the X-axis direction, Y-axis direction, or Z-axis direction in a three-dimensional coordinate system.

[0303] For example, the rotation data may also include the rotation angle of the target display element in a second direction, or it may also include the rotation angle of the target display element in a third direction. For instance, the rotation data includes rotation angles in the X-axis, Y-axis, and Z-axis directions in a three-dimensional coordinate system.

[0304] Based on the embodiments of this application, an electronic device can rotate a first target display element according to a rotation angle in a first direction to generate a corresponding animation.

[0305] In some embodiments, in response to detecting a first user interaction, a first animation is generated, including:

[0306] Acquire data from the inertial measurement unit of electronic devices;

[0307] Based on data from the inertial measurement unit, motion data for at least one target display element is determined, including the direction of motion and / or acceleration value.

[0308] The first animation is generated based on the mobile data.

[0309] The inertial measurement unit may include a gyroscope sensor, a gravity acceleration sensor, etc. Alternatively, the inertial measurement unit may be replaced by a gyroscope sensor or a gravity acceleration sensor.

[0310] For example, when a user shakes the electronic device, the device can acquire data from the inertial measurement unit. It should be understood that the electronic device can acquire data from the inertial measurement unit in real time and determine the corresponding movement data in real time to generate the first animation.

[0311] In other examples, the movement data may also include the distance traveled, speed, or the relationship between speed and time, the relationship between acceleration values ​​and time, etc.

[0312] In some cases, when the movement data includes the direction of movement, the electronic device can also move the target element by a default movement distance or speed.

[0313] In some cases, when the motion data includes acceleration values, the electronic device can also move the target element in the default direction of motion.

[0314] Based on the embodiments of this application, the electronic device can determine the movement data of the target display element based on the IMU data, and generate a first animation of the display element based on the movement data.

[0315] In this way, when a user shakes the electronic device, the target display element can move in the direction of the user's shaking, thereby improving the user experience.

[0316] Figure 12 This is a schematic flowchart illustrating a display method provided in an embodiment of this application. Figure 12 As shown, the method 800 can be applied to electronic devices, and the method 800 may include steps 810 to 830.

[0317] 810, in response to the operation of setting the first video as the wallpaper of the first display interface, generates multiple sub-videos based on the first video;

[0318] It should be understood that these multiple sub-videos can be directly derived from the first video. For example, these multiple sub-videos can be edited and generated from the first video, such as multiple highlights from the first video.

[0319] Alternatively, the multiple sub-videos may be indirectly derived from the first video. For example, the multiple sub-videos may be created based on materials from the first video, and this application embodiment does not limit this.

[0320] 820, Display a second display interface, the second display interface including multiple display areas for displaying multiple sub-videos;

[0321] For example, see Figure 8 The second display interface can be display interface 420, the sub-video can be video 421 and video 422, and the multiple display areas can include the display areas where video 421 and video 422 are located. The display areas can be used to carry the sub-videos.

[0322] 830, in response to detecting that the user's eye gaze is located within the display area of ​​the first sub-video, the first sub-video is played, wherein the first sub-video is a sub-video among multiple sub-videos.

[0323] For example, see Figure 8 When the user's gaze is focused on the display area where video 421 is located, the electronic device can play video 421.

[0324] Based on the embodiments of this application, when a user sets a selected video as wallpaper, the electronic device can generate multiple sub-videos based on the video. When the user's gaze is detected to be within the display area of ​​the first sub-video, the target sub-video can be played.

[0325] In this way, electronic devices can generate multiple videos based on the video set as wallpaper, increasing the diversity of wallpaper displays. Electronic devices can also play videos that the user is looking at, allowing the display to show whichever video the user is focusing on, thus enhancing the user experience.

[0326] In some implementations, method 800 also includes:

[0327] In response to detecting that the user's gaze point leaves the first display area where the first sub-video is located, the playback of the first sub-video is paused.

[0328] Based on the embodiments of this application, when the electronic device detects that the user's gaze has left the first sub-video, it can pause the playback of the first sub-video. In this way, the electronic device can conveniently implement the playback and pause of videos on the second display interface.

[0329] In some implementations, method 800 also includes:

[0330] In response to detecting that the user's eye gaze is located within the display area of ​​the second sub-video, the second sub-video is played, which is a sub-video among multiple sub-videos.

[0331] Based on the embodiments of this application, when the electronic device detects that the user's eye gaze is located within the display area where the second sub-video is located, it can play the second sub-video. In this way, the electronic device can conveniently switch between videos played on the second display interface.

[0332] In some implementations, the first display interface includes at least one of an always-on display interface, a lock screen display interface, or a desktop.

[0333] Figure 13 This is a schematic block diagram of an electronic device provided in an embodiment of this application. Figure 13 As shown, the electronic device 900 may include one or more processors 910; one or more memories 920; the one or more memories 920 storing one or more instructions that, when executed by one or more processors 910, cause the display method as described in any of the possible implementations above to be executed.

[0334] For example, the electronic device 900 can be the electronic device 200, electronic device 300, electronic device 400, or electronic device 500 mentioned above, and the electronic device 900 can be used to perform the above-mentioned methods 700, 800, etc.

[0335] This application also provides an apparatus including a processor and a communication interface. The communication interface is used to receive signals and transmit the signals to the processor. The processor processes the signals so that the display method described in any of the possible implementations above is executed.

[0336] The device can be a chip. For example, the chip can be a chip system or a standalone chip.

[0337] This application also provides a readable storage medium storing instructions that, when executed on a device, cause the device to perform the aforementioned method steps to implement the display method described above.

[0338] This application also provides a program product that, when run on a device, causes the device to perform the aforementioned steps to implement the display method described in the above embodiments.

[0339] This application also provides an apparatus including a module for implementing the display method as described in any of the preceding embodiments.

[0340] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory; wherein the memory is used to store instructions, and when the apparatus is running, the processor may execute the instructions stored in the memory to cause the apparatus to perform the display methods in the above-described method embodiments.

[0341] In this embodiment, the device, readable storage medium, program product or apparatus are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods provided above, and will not be repeated here.

[0342] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0343] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0344] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0345] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0346] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0347] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory, random access memory, magnetic disks, or optical disks.

[0348] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A display method, characterized in that, The method is applied to an electronic device, and the method includes: In the always-on display interface, a first display interface is displayed in response to the user's operation. The first display interface includes multiple display elements and is the lock screen display interface. In response to detecting a first user interaction action, a first animation is generated, the first animation being associated with multiple target display elements among the plurality of display elements; The step of generating a first animation in response to detecting a user's first interactive action includes: Detect changes in the angle of the user's face relative to the display screen; The rotation data of each of the plurality of target display elements is determined based on the change in the angle; An animation associated with each target display element is generated based on the rotation data of each target display element to obtain multiple animations, wherein at least two of the multiple animations have different actions; The multiple animations are displayed on the lock screen.

2. The method according to claim 1, characterized in that, The generation of the first animation includes: Determine the input data corresponding to the first interactive action, wherein the input data includes data from the camera or data from the inertial measurement unit; The type of the first animation is determined based on the input data corresponding to the first interactive action, and the type of the first animation includes movement or rotation. An animation associated with each of the plurality of target display elements is generated based on the type of the first animation and the input data to obtain a plurality of animations, wherein at least two of the plurality of animations have different actions.

3. The method according to claim 2, characterized in that, The rotation data includes at least the rotation angle of the first target display element among the plurality of display elements in the first direction. The step of generating an animation associated with each target display element based on the rotation data of each target display element includes: The first target display element is rotated according to the rotation angle in the first direction to generate an animation associated with the first target display element.

4. The method according to any one of claims 1-3, characterized in that, The step of generating a first animation in response to detecting a user's first interactive action includes: Acquire data from the inertial measurement unit of the electronic device; The movement data of each target display element is determined based on the data from the inertial measurement unit, and the movement data includes the movement direction and / or acceleration value; The first animation is generated based on the movement data.

5. The method according to any one of claims 1-3, characterized in that, The plurality of target display elements are three-dimensional display elements.

6. The method according to claim 5, characterized in that, The multiple target display elements are one of the following: a three-dimensional facial expression sphere, a three-dimensional animal, a three-dimensional plant, a three-dimensional building, or a three-dimensional object.

7. A display method, characterized in that, The method is applied to an electronic device, and the method includes: In response to the operation of setting the first video as the wallpaper of the lock screen display interface, multiple sub-videos are generated based on the first video; The lock screen display interface is displayed, and the lock screen display interface includes multiple display areas for playing the multiple sub-videos; In response to detecting that the user's eye gaze is located within the display area of ​​the first sub-video, the first sub-video is played, wherein the first sub-video is a sub-video among the plurality of sub-videos.

8. The method according to claim 7, characterized in that, The method further includes: In response to detecting that the user's gaze point leaves the first display area where the first sub-video is located, the playback of the first sub-video is paused.

9. The method according to claim 8, characterized in that, The method further includes: In response to detecting that the user's eye gaze is located in the second display area where the second sub-video is located, the second sub-video is played.

10. An electronic device, characterized in that, include: One or more processors; One or more memories; the one or more memories storing one or more programs that, when executed by one or more processors, cause the display method as described in any one of claims 1-9 to be performed.

11. A chip, characterized in that, The chip includes a processor and a communication interface, the communication interface being used to receive signals and transmit the signals to the processor, the processor processing the signals such that the display method as described in any one of claims 1-9 is executed.

12. A readable storage medium, characterized in that, The readable storage medium stores instructions that, when executed on an electronic device, cause the display method as described in any one of claims 1-9 to be performed.

13. A program product, characterized in that, The program product includes program code that, when run on an electronic device, causes the display method as described in any one of claims 1-9 to be executed.

Images