Display method and electronic device

Abstract

The present application provides a display method and an electronic device. The electronic device can generate an animation in real time on the basis of an interactive action of a user and a preset rule, for example, the electronic device can generate a dynamic lock-screen animation in real time, thereby implementing dynamic interaction with the user, and improving the fun of screen locking. The electronic device can also display a plurality of videos, and play back a video at which a user gazes, thereby achieving the display effect that a video at which the user gazes is played back.

Description

Display method and electronic device

[0001] This application claims priority from the Chinese patent application No. 202411048849.6 filed on July 31, 2024, and titled "Display method and electronic device", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the field of electronic technology, and more particularly, to a display method and an electronic device. BACKGROUND

[0003] A user can set a lock screen wallpaper, an off-screen wallpaper, and the like according to his / her preference. For example, when setting a lock screen, the user can use a picture, a two-dimensional animation, or a three-dimensional animation as a lock screen wallpaper. However, after the user sets the wallpaper, the picture, the two-dimensional animation, or the three-dimensional animation is generally fixed and has a relatively single form, which can easily cause the user's aesthetic fatigue. SUMMARY

[0004] Embodiments of the present application provide a display method and an electronic device. In the technical solution, the electronic device can generate an animation in real time according to a user's interaction action according to a pre-set rule, for example, the electronic device can generate a dynamic lock screen animation in real time, so that dynamic interaction with the user can be achieved and the interest of the lock screen can be improved.

[0005] In a first aspect, a display method is provided, applied to an electronic device, and the method includes: displaying a first display interface, the first display interface including one or more display elements; in response to detecting a first interaction action of a user, generating a first animation, the first animation being associated with at least one target display element of the one or more display elements; and displaying the first animation on the first display interface.

[0006] The display element can be a two-dimensional display element or a three-dimensional display element.

[0007] Based on the embodiments of the present application, the first display interface displayed by the electronic device can include one or more display elements. When the first interaction action of the user is detected, the electronic device can generate an animation of the display element in real time according to a first rule and play the animation.

[0008] In this way, the electronic device can generate an animation of a target display element in real time according to a user's interaction action, for example, the target display element is a lock screen element, and the electronic device can generate a dynamic lock screen animation in real time, so that dynamic interaction with the user can be achieved and the interest of the lock screen can be improved.

[0009] In addition, the electronic device can generate different lock screen animations through the interaction action of the user each time the user unlocks, thereby improving the diversity of the lock screen animations and improving the user experience of using the lock screen.

[0010] In some implementations, the at least one target display element is a plurality of target display elements, and the generating the first animation includes: generating an animation associated with each target display element in the plurality of target display elements to obtain a plurality of animations; and the displaying the first animation on the first display interface includes: respectively displaying the plurality of animations on the first display interface.

[0011] Based on the embodiments of the present application, when the first display interface includes a plurality of target display elements, the electronic device can generate an animation associated with each target display element according to the interaction action of the user, and respectively display a plurality of animations on the first display interface. In this way, each target display element has a corresponding animation, so that the plurality of target display elements in the first display interface can all change, thereby improving the display effect of the electronic device.

[0012] In some implementations, the plurality of animations have the same action, or at least two animations in the plurality of animations have different actions.

[0013] Based on the embodiments of the present application, when the plurality of animations have the same action, the animation effects of the plurality of target display elements in the first display interface can be the same, for example, the plurality of target display elements rotate in the same direction, thereby presenting a better display effect. When at least two animations in the plurality of animations have different actions, the diversity and interest of the animations can be improved.

[0014] In some implementations, the generating the first animation in response to detecting the first interaction action of the user includes: detecting a change in a gaze direction of the eyes of the user gazing at the first display interface; determining rotation data of the at least one target display element according to the change in the gaze direction; and generating the first animation according to the rotation data.

[0015] For example, the electronic device can detect the change in the gaze direction through a camera, or can also detect the change in the gaze direction through a time-of-flight (TOF) sensor.

[0016] Based on the embodiments of the present application, the electronic device can detect the change in the gaze direction of the eyes of the user, and determine the rotation data of the target display element according to the change in the gaze direction, and generate the first animation according to the rotation data.

[0017] In this way, the target display element can rotate according to the change in the gaze direction of the eyes of the user, thereby realizing the effect of the user's eyes controlling the rotation of the display element.

[0018] In some implementations, the generating the first animation in response to detecting the first interaction action of the user comprises: detecting a change in an angle of the face of the user relative to the display screen; determining rotation data of the at least one target display element according to the change in the angle; and generating the first animation according to the rotation data.

[0019] For example, the electronic device can obtain the change in the angle of the face of the user relative to the display screen through a camera.

[0020] In this way, the target display element can change according to the rotation of the face of the user, so that the effect of the face of the user controlling the rotation of the display element can be achieved.

[0021] In some implementations, the rotation data at least comprises a rotation angle of a first target display element in the at least one target display element in a first direction, and the generating the first animation according to the rotation data comprises: rotating the first target display element according to the rotation angle in the first direction to generate an animation associated with the first target display element.

[0022] It should be understood that the first target display element can be one display element in the at least one target display element. In this case, the first target display element has a rotation angle in the first direction, and the present application does not limit the rotation direction and the rotation angle of other target display elements in the at least one target display element except the first target display element. The rotation direction of the other target display element can be the same as or different from the first direction, and the rotation angle of the other target display element can be the same as or different from the rotation angle of the first target display element.

[0023] It should also be understood that the first target display element can also be a plurality of target display elements in the at least one target display element. In this case, the plurality of target display elements can have the same rotation angle in the first direction, so that the plurality of target display elements can have the same rotation effect.

[0024] In some cases, the first target display element can also be the same as the at least one target display element, in which case all display elements in the at least one target display element have the same animation effect.

[0025] For example, the first direction can be in a clockwise manner or in an anticlockwise direction, or the first direction can be an X-axis direction, a Y-axis direction or a Z-axis direction in a three-dimensional coordinate system.

[0026] Exemplarily, the rotation data can further include a rotation angle of the at least one target display element in a second direction, or further include a rotation angle of the at least one target display element in a third direction. For example, the rotation data includes rotation angles in X-axis direction, Y-axis direction and Z-axis direction in a three-dimensional coordinate system.

[0027] According to the embodiments of the present application, the electronic device can rotate the first target display element according to the rotation angle in the first direction to generate an animation corresponding thereto.

[0028] In some implementations, the generating the first animation in response to detecting the first interaction action of the user includes: obtaining data of an inertial measurement unit of the electronic device; determining movement data of the at least one target display element according to the data of the inertial measurement unit, the movement data including a movement direction and / or an acceleration value; and generating the first animation according to the movement data.

[0029] For example, when the user shakes the electronic device, the electronic device can obtain the data of the inertial measurement unit.

[0030] According to the embodiments of the present application, the electronic device can determine the movement data of the target display element according to the data of the inertial measurement unit, and generate the first animation of the target display element according to the movement data.

[0031] In this way, when the user shakes the electronic device, the target display element can move along the shaking direction of the user, thereby improving the user experience.

[0032] In some implementations, the first display interface includes at least one of a screen-off display interface, a lock screen display interface or a desktop.

[0033] In a second aspect, a display method is provided, applied to an electronic device, and the method includes: in response to an operation of setting a first video as a wallpaper of a second display interface, generating a plurality of sub-videos according to the first video; displaying the second display interface, the second display interface including a display area for displaying the plurality of sub-videos; in response to detecting that a gaze point of a user's eye is located in a display area where a first sub-video is located, playing the first sub-video, wherein the first sub-video is a sub-video in the plurality of sub-videos.

[0034] According to the embodiments of the present application, when the user sets the selected video as the wallpaper, the electronic device can generate a plurality of sub-videos according to the video, and when it is detected that the gaze point of the user's eye is located in the display area where the first sub-video is located, the target sub-video can be played.

[0035] In this way, the electronic device can generate multiple videos according to the video for setting the wallpaper, and can improve the diversity of the wallpaper display. The electronic device can also play the video at which the user's eyes are fixed, so that the display effect of the video at which the user's eyes are fixed can be achieved, thereby improving the user's experience.

[0036] In some implementations, the method further includes: in response to detecting that the fixation point of the user's eyes is out of a first display area in which the first sub-video is located, pausing playing the first sub-video.

[0037] Based on the embodiments of the present application, when the electronic device detects that the fixation point of the user's eyes is out of the first sub-video, the playing of the first sub-video can be paused. In this way, the electronic device can conveniently realize the playing and pausing of the video.

[0038] In some implementations, the method further includes: in response to detecting that the fixation point of the user's eyes is located in a display area in which a second sub-video is located, playing the second sub-video, the second sub-video being a sub-video in the multiple sub-videos.

[0039] Based on the embodiments of the present application, when the electronic device detects that the fixation point of the user's eyes is located in the display area in which the second sub-video is located, the second sub-video can be played. In this way, the electronic device can conveniently switch the video played in the second display interface.

[0040] In some implementations, the second display interface includes at least one of a screen-off display interface, a lock screen display interface, or a desktop.

[0041] In a third aspect, a display method is provided. The display method includes: obtaining a video for setting a wallpaper; generating a plurality of sub-videos according to the video for setting the wallpaper; and playing a first sub-video in a first display interface.

[0042] In a fourth aspect, a display apparatus is provided. The display apparatus includes means for implementing the display method as described in the first aspect and any possible implementation thereof.

[0043] In a fifth aspect, a chip is provided. The chip includes a processor and a communication interface. The communication interface is configured to receive a signal and transmit the signal to the processor. The processor processes the signal, so that the display method as described in the first aspect and any possible implementation thereof is executed.

[0044] In a sixth aspect, a readable storage medium is provided. The readable storage medium stores instructions. When the instructions are executed on a device, the display method as described in the first aspect and any possible implementation thereof is executed.

[0045] In a seventh aspect, a program product is provided, the program product comprising program code which, when run on a device, causes a display method as described in the first aspect and any of its possible implementation forms to be performed. BRIEF DESCRIPTION OF DRAWINGS

[0046] Fig. 1 is a structural schematic diagram of an electronic device according to an embodiment of the present application.

[0047] Fig. 2 is a software structural schematic diagram of an electronic device according to an embodiment of the present application.

[0048] Fig. 3 is a schematic diagram of a set of graphical user interfaces (GUIs) according to an embodiment of the present application.

[0049] Fig. 4 is a schematic diagram of a set of GUIs according to an embodiment of the present application.

[0050] Fig. 5 is a schematic diagram of a set of GUIs according to an embodiment of the present application.

[0051] Fig. 6 is a schematic diagram of a set of GUIs according to an embodiment of the present application.

[0052] Fig. 7 is a schematic diagram of a set of GUIs according to an embodiment of the present application.

[0053] Fig. 8 is a schematic diagram of a set of GUIs according to an embodiment of the present application.

[0054] Fig. 9 is a schematic diagram of a set of GUIs according to an embodiment of the present application.

[0055] Fig. 10 is a schematic architectural diagram of an electronic device according to an embodiment of the present application.

[0056] Fig. 11 is a schematic flow diagram of a display method according to an embodiment of the present application.

[0057] Fig. 12 is a schematic flow diagram of a display method according to an embodiment of the present application.

[0058] Fig. 13 is a schematic block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0059] The technical solutions in the present application will be described below with reference to the accompanying drawings.

[0060] The method in the embodiments of the present application can be applied to electronic devices such as smart phones, tablet computers, notebook computers, personal computers (PC), ultra-mobile personal computers (UMPC), netbooks, vehicle-mounted devices, smart televisions, wearable devices, foldable devices, internet of things (Iot) devices, and the like.

[0061] FIG. 1 shows a structural schematic diagram of an electronic device 100. The electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, and the like. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0062] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0063] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices or integrated in one or more processors.

[0064] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.

[0065] The processor 110 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that the processor 110 has just used or repeatedly uses. If the processor 110 needs to use the instructions or data again, it can directly call from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the system.

[0066] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus interface, etc.

[0067] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL).

[0068] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple sets of I2S buses. The processor 110 can be coupled with the audio module 170 through the I2S buses, to realize communication between the processor 110 and the audio module 170.

[0069] The PCM interface can also be used for audio communication, to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled through a PCM bus interface.

[0070] The UART interface is a universal serial data bus, used for asynchronous communication. The bus can be a bidirectional communication bus. It converts data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 110 and the wireless communication module 160.

[0071] The MIPI interface can be used to connect the processor 110 and peripheral devices such as the display screen 194 and the camera 193.

[0072] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 and the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc.

[0073] The USB interface 130 is an interface that meets the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transmit data between the electronic device 100 and a peripheral device.

[0074] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation of the electronic device 100. In other embodiments of the present application, the electronic device 100 can also use different interface connection methods or combinations of multiple interface connection methods in the above embodiments.

[0075] The charging management module 140 is configured to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 can receive wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 can charge the battery 142 and supply power to the electronic device through the power management module 141.

[0076] The power management module 141 is configured to connect the battery 142 and the charging management module 140 and the processor 110.

[0077] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.

[0078] The mobile communication module 150 can provide a solution including 2G / 3G / 4G / 5G wireless communication applied to the electronic device 100.

[0079] The modem processor can include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A and the microphone 170B), or displays an image or a video through the display screen 194. In some embodiments, the modem processor can be a separate device. In other embodiments, the modem processor can be independent of the processor 110, and be arranged in the same device as the mobile communication module 150 or other functional modules.

[0080] The wireless communication module 160 can provide solutions for wireless communication, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Bluetooth low energy (BLE), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, and the like, which are applied to the electronic device 100.

[0081] In some embodiments, the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology.

[0082] The electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor, and the like. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.

[0083] The display screen 194 is used to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be made of liquid crystal display (LCD), or one of organic light-emitting diode (OLED), active-matrix organic light emitting diode (AMOLED), flex light-emitting diode (FLED), miniled, microled, micro-oled, or quantum dot light emitting diodes (QLED). In some embodiments, the electronic device 100 can include 1 or N display screens 194, and N is a positive integer greater than 1.

[0084] In the embodiments of the present application, the display screen can be used to display an animation generated by the electronic device in real time.

[0085] The electronic device 100 can implement a photographing function through an ISP, a camera 193, a video codec, a GPU, a display 194, and an application processor, etc.

[0086] The ISP is used to process data fed back by the camera 193. The camera 193 is used to capture a still image or a video.

[0087] The digital signal processor is used to process a digital signal, which can process not only a digital image signal but also other digital signals.

[0088] The video codec is used to compress or decompress a digital video.

[0089] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.

[0090] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various function applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121.

[0091] The electronic device 100 can implement an audio function through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor, etc.

[0092] The audio module 170 is used to convert digital audio information into an analog audio signal output, and also used to convert an analog audio input into a digital audio signal.

[0093] The speaker 170A, also called a “loudspeaker”, is used to convert an audio electrical signal into a sound signal.

[0094] The receiver 170B, also called a “earpiece”, is used to convert an audio electrical signal into a sound signal.

[0095] The microphone 170C, also called a “microphone”, “sound transducer”, is used to convert a sound signal into an electrical signal.

[0096] The earphone interface 170D is used to connect a wired earphone.

[0097] The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, an acceleration sensor 180E, a distance sensor 180F, a fingerprint sensor 180H, a touch sensor 180K, a bone conduction sensor 180M, etc.

[0098] The key 190 includes a power-on key, a volume key, etc.

[0099] The motor 191 can generate a vibration prompt.

[0100] The indicator 192 can be an indicator light, which can be used to indicate a charging status, a power change, and can also be used to indicate a message, a missed call, a notification, etc.

[0101] The SIM card interface 195 is used to connect a SIM card.

[0102] FIG. 2 is a software structure block diagram of the electronic device 100 according to an embodiment of the disclosure. A layered architecture divides software into several layers, each of which has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into four layers, from top to bottom, an application layer, an application framework layer, a system library, and a kernel layer. The application layer can include a series of application packages.

[0103] As shown in FIG. 2, the application packages can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, wallet, and other applications (application, App).

[0104] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications of the application layer. The application framework layer includes some pre-defined functions.

[0105] As shown in FIG. 2, the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc.

[0106] The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, and take a screenshot, etc.

[0107] The content provider is used to store and obtain data, and make the data accessible to applications. The data can include videos, images, audio, dialed and received calls, browsing history and bookmarks, phone books, etc.

[0108] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.

[0109] The phone manager is used to provide communication functions of the electronic device 100. For example, management of call states (including call connection, call hang-up, etc.).

[0110] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0111] The notification manager enables applications to display notification information in the status bar, which can be used to convey messages of the notification type, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of a download, a message reminder, etc. The notification manager can also be a notification in the form of a chart or a scroll bar text appearing in the system top status bar, such as a notification of an application running in the background, and can also be a notification in the form of a dialog window appearing on the screen. For example, a text information prompt in the status bar, a prompt sound, a vibration of the electronic device, a flashing of the indicator light, etc.

[0112] The core library includes two parts: one part is the function function that the java language needs to call, and the other part is the core library.

[0113] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java files of the application layer and the application framework layer into binary files. The virtual machine is used to perform the management of the object life cycle, the stack management, the thread management, the security and exception management, and the garbage collection, etc.

[0114] The system library can include multiple functional modules. For example: a surface manager, media libraries, a three-dimensional graphics processing library (for example: OpenGL ES), a 2D graphics engine (for example: SGL), etc.

[0115] The surface manager is used to manage the display subsystem, and provides the fusion of 2D and 3D layers for multiple applications.

[0116] The media library supports multiple commonly used audio, video format playback and recording, and static image files, etc. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0117] The three-dimensional graphics processing library is used to realize three-dimensional graphics drawing, image rendering, synthesis, and layer processing, etc.

[0118] The 2D graphics engine is a drawing engine for 2D drawing.

[0119] The kernel layer is the layer between hardware and software. The kernel layer at least includes display drivers, camera drivers, audio drivers, sensor drivers.

[0120] Before introducing the technical solutions of the present application, first introduce the following part of the professional terms that the present application can involve.

[0121] The screen-off state can be understood as a state in which the electronic device enters when the user does not operate the electronic device within a preset time length or the user presses the power key of the electronic device. In the screen-off state, the electronic device can display a screen-off wallpaper, which can be a picture, an animation, or a video, etc.

[0122] It should be understood that the electronic device turns off the screen and locks the screen after displaying the screen-off wallpaper. After the electronic device is locked, the electronic device can also display the screen-off wallpaper when detecting that the user gazes at the display screen of the electronic device, or the electronic device can display the screen-off wallpaper when detecting that the user clicks the display screen.

[0123] The lock screen state can be understood as a state in which the electronic device enters when the user does not operate the electronic device within a preset time length or the user presses the power key of the electronic device.

[0124] When the user double-clicks the display interface displayed in the screen-off state or presses the power key of the electronic device, the electronic device can display a lock screen wallpaper. Exemplarily, the lock screen wallpaper can be a picture, an animation, or a video, etc. In the lock screen state, the user needs to unlock the electronic device before being able to normally use the electronic device.

[0125] When using the electronic device, the user can set the lock screen wallpaper, the screen-off wallpaper, etc. of the electronic device according to his / her own preferences. For example, the user can use a two-dimensional animation or a three-dimensional animation as the lock screen wallpaper when setting the lock screen. However, the two-dimensional animation or the three-dimensional animation is fixed, the form is relatively single, and aesthetic fatigue of the user is easily caused.

[0126] Therefore, the embodiments of the present application provide a display method and an electronic device. In the technical solution, the electronic device can generate an animation in real time according to an interactive action of a user and according to a preset rule, for example, the electronic device can generate a dynamic lock screen animation in real time, so that dynamic interaction with the user can be realized and the interest of the lock screen can be improved.

[0127] In the following, the display method in the embodiments of the present application will be introduced in combination with several sets of graphical user interfaces (GUIs).

[0128] Exemplarily, FIG. 3 is a schematic diagram of a set of GUIs provided by the embodiments of the present application. In FIG. 3, (a) to (c) show a process in which the electronic device 200 dynamically generates a lock screen animation.

[0129] Referring to (a) in FIG. 3, the GUI can be a display interface 210 of the electronic device 200 in a screen-off state. The current date and time can be displayed in the display interface 210.

[0130] For example, after the electronic device 200 detects the operation of the user pressing the power key, the GUI shown in (b) of FIG. 3 can be displayed.

[0131] Alternatively, after the electronic device 200 detects the operation of the user double-clicking the display screen, the GUI shown in (b) of FIG. 3 can be displayed.

[0132] It can be understood that the embodiments of the present application do not limit the specific way in which the electronic device enters the GUI shown in (b) of FIG. 3 from the display interface 210.

[0133] Referring to (b) of FIG. 3, the GUI can be a lock screen display interface 220 of the electronic device 200. The display interface 220 can be used to display a lock screen wallpaper or a lock screen animation set by the user. The display interface 220 can include a plurality of display elements 221.

[0134] The plurality of display elements 221 can be distributed in rows and columns (such as three rows and three columns, or six rows and three columns, etc.), or in other regular or irregular shapes. In the embodiments of the present application, the plurality of display elements are taken as an example of being distributed in three rows and three columns.

[0135] It should be understood that the display element 221 can also be referred to as an element, a lock screen element, or an animation element, etc.

[0136] In the embodiments of the present application, the display element 221 is taken as an example of a two-dimensional expression.

[0137] In other examples, the display element 221 can be a three-dimensional object model, such as a three-dimensional expression sphere, a three-dimensional animal, a three-dimensional plant, a three-dimensional building, a three-dimensional article, etc., which is not limited in the embodiments of the present application.

[0138] In some examples, the electronic device 200 has pre-set a corresponding lock screen wallpaper, or the electronic device has applied a corresponding theme including the corresponding lock screen wallpaper. Unlike the current lock screen wallpaper, the lock screen wallpaper of the embodiments of the present application is not fixed, and the lock screen elements therein can change in real time according to the user's interactive action, thereby improving the user's experience of using the lock screen animation.

[0139] When the electronic device 200 displays the display interface 220, the electronic device 200 can detect the gaze direction of the user's eyes, and the display elements 221 in the display interface 220 can change following the user's eyes, for example, the display elements 221 can rotate or move according to the gaze direction of the user's eyes, etc.

[0140] It can be understood that the embodiments of the present application do not limit the specific technical means by which the electronic device determines the gaze direction of the user's eyes.

[0141] For example, the electronic device can detect the gaze direction of the user's eyes by using the camera. For example, the electronic device acquires the face information of the user by using the camera, and further determines the gaze direction of the user's eyes.

[0142] In other examples, the plurality of display elements 221 can also be included in the display interface 210, for example, the plurality of display elements 221 can be displayed in low brightness in the display interface 210. In this way, the consistency of the off-screen display content to the lock screen display content of the electronic device can be maintained.

[0143] It should be understood that in this application, the electronic device acquires the face information of the user or the gaze point of the user's eyes by using the camera is performed under the authorization of the user.

[0144] For example, the current gaze point of the user's eyes is located in the middle of the display screen, when the electronic device detects that the user's eyes move from the current gaze point to the upper right of the display screen, the GUI as shown in (c) of FIG. 3 can be displayed.

[0145] Or, when the electronic device detects that the gaze direction of the user's eyes is located in the upper right region of the display screen, the GUI as shown in (c) of FIG. 3 can be displayed.

[0146] Referring to (c) of FIG. 3, the plurality of display elements 221 can rotate in the direction of the gaze of the user's eyes to keep consistent with the direction of the gaze of the user's eyes.

[0147] The gaze direction of the user's eyes can also be understood as the gaze point of the user's eyes.

[0148] It can be understood that in the embodiments of the present application, the movement direction or the gaze direction of the user's eyes is only illustrative. In other examples, if the electronic device detects that the user's eyes move from the current gaze point to the lower right of the display screen or the gaze direction of the user is located in the lower right region of the display screen, the plurality of display elements 221 can also rotate in another direction, and the embodiments of the present application are not limited thereto.

[0149] In other examples, the plurality of display elements 221 can also rotate in different directions, or the angles of rotation of the plurality of display elements 221 are different. In this case, the electronic device needs to determine the direction or angle of rotation of each display element 221 according to the response rule of each display element 221, so that the movement of each display element 221 can form a separate animation, thereby improving the diversity and interest of the lock screen animation.

[0150] In the embodiments of the present application, the developer of the lock screen animation can define the attributes of the display element and the response rule of the display element in the form of a configuration file. The response rules of the plurality of display elements can be the same or different. The response rule of the display element will be described in conjunction with specific embodiments below, and will not be described here in detail.

[0151] The configuration file can be extensible markup language (XML), domain-specific language (DSL), javascript object notation (JSON), etc.

[0152] In some examples, when the display element 221 is a three-dimensional object model, for example, the display element 221 is a three-dimensional expression sphere. The electronic device 200 can detect the gaze direction of the user's eyes and control the display element 221 to rotate towards the direction of the user's eye gaze. It should be understood that the electronic device 200 can continuously detect the gaze direction of the user's eyes, and when the gaze direction of the user's eyes changes, control the display element 221 to dynamically rotate according to the direction of the user's eye gaze, so that the user has the display effect of using the eyes to control the display element 221 in real time.

[0153] Based on the embodiments of the present application, in the lock screen display interface of the electronic device, the electronic device can dynamically control the display element to change according to the gaze direction of the user's eyes to form a lock screen animation, thereby improving the interactivity between the user and the electronic device and improving the user's experience of using the lock screen animation.

[0154] Exemplarily, FIG. 4 is a schematic diagram of a set of GUIs provided by the embodiments of the present application. Among them, (a) to (c) in FIG. 4 show the process of dynamically generating a lock screen animation by the electronic device 200.

[0155] It should be understood that (a) to (b) in FIG. 4 can refer to the related description in (a) to (b) in FIG. 3, and will not be described here in detail for brevity.

[0156] When the electronic device 200 detects that the data of the sensor changes, a GUI as shown in (c) in FIG. 4 can be displayed. The sensor can be a gyroscope sensor or a gravity acceleration sensor, etc.

[0157] For example, when the user shakes the electronic device 200 to the right (the side where the power key is located), the data of the sensors of the electronic device 200 changes, and the electronic device 200 can determine the moving direction and acceleration of the display elements according to the data change of the sensors. Alternatively, the electronic device 200 can further determine the moving speed or moving distance, etc. according to the data change of the sensors.

[0158] Referring to (c) in FIG. 4, the plurality of display elements 221 can move to the right, and the display elements 221 in each row are distributed close to each other, and the display elements 221 in the rightmost column can be close to the right side of the display screen.

[0159] In other examples, the moving direction, acceleration value, or moving distance or moving speed of the plurality of display elements 221 can also be the same, and the embodiments of the present application are not limited thereto. In this case, the plurality of display elements 221 visually presents a display effect of moving as a whole to one side.

[0160] In other examples, the plurality of display elements 221 can also present a display effect of colliding and pressing each other, and the embodiments of the present application are not limited thereto.

[0161] It should be understood that the embodiments of the present application are only described by taking the example that the user shakes the electronic device 200 to the right, and in other examples, the user can also shake the electronic device 200 to other directions, and the plurality of display elements 221 can move according to the shaking direction of the user, and the embodiments of the present application are not limited thereto.

[0162] Based on the embodiments of the present application, when the user shakes the electronic device when the electronic device displays the lock screen display interface, the electronic device can detect the data change of the sensors, and control the movement of the display elements according to the data change of the sensors, so as to realize the display effect that the display elements move according to the shaking of the user.

[0163] The above describes the technical solution that the plurality of display elements can generate the same animation effect in combination with FIGS. 4-5, and in some embodiments, each display element in the plurality of display elements can also generate different animation effects, which will be described below in combination with FIG. 5.

[0164] For example, FIG. 5 is a schematic diagram of a group of GUIs provided by the embodiments of the present application. Wherein, (a) to (c) in FIG. 5 show the process that the electronic device 200 dynamically generates a lock screen animation.

[0165] It should be understood that (a) to (b) in FIG. 5 can refer to the related description in (a) to (b) in FIG. 3, and for brevity, the description is not repeated here.

[0166] Exemplarily, when the electronic device 200 detects that the gaze direction or gaze point of the user's eyes is located in the display element 2211 in the plurality of display elements 221, and the gaze direction of the user's eyes moves downward, a GUI as shown in (c) of FIG. 5 can be displayed.

[0167] Referring to (c) of FIG. 5, the display element 2211 can move downward according to the gaze direction of the user's eyes, while the remaining display elements do not change.

[0168] In this case, the response rule of each display element in the plurality of display elements 221 can be different, that is, each display element has a separate animation effect. Taking the display element 2211 as an example, the response rule thereof can be that when the electronic device detects that the gaze direction of the user's eyes is located on the display element 2211, and the gaze direction of the user's eyes changes, for example, the gaze direction of the user's eyes moves downward from the current position, the display element 2211 can move following the gaze direction of the user, so that the display effect that the display element followed by the user's gaze moves following the gaze direction of the user can be achieved.

[0169] Based on the embodiments of the present application, each display element in the lock screen display interface can have a separate animation effect, so that when the user gazes at a certain display element, and the line of sight moves, the display element will move following the line of sight of the user, so that the effect that the display element follows the eye movement is achieved, and the user experience of using the lock screen animation is improved.

[0170] In some cases, the technical solutions of the embodiments of the present application can also be applied to the screen-off scene.

[0171] Exemplarily, FIG. 6 is a schematic diagram of a group of GUIs provided by the embodiments of the present application. Wherein, (a) to (b) of FIG. 6 show the process of dynamically generating by the electronic device 300 in the screen-off scene.

[0172] Referring to (a) of FIG. 6, the GUI can be the screen-off display interface 310 of the electronic device 300. The display interface 310 can display information such as date and time, and the display interface 310 can also display a plurality of display elements 311.

[0173] It should be understood that the display element 311 can refer to the description of the display element 211 in the foregoing, and for the sake of brevity, it will not be described here.

[0174] Exemplarily, the current gaze point of the user's eyes is located in the middle of the display screen, when the electronic device 300 detects that the user's eyes move from the current gaze point to the upper right of the display screen, a GUI as shown in (b) of FIG. 6 can be displayed.

[0175] Alternatively, when the electronic device 300 detects that the gaze direction of the user's eyes is located in the upper right region of the display screen, a GUI as shown in (b) of FIG. 6 can be displayed.

[0176] Referring to (b) of FIG. 6, the plurality of display elements 311 can be rotated to the direction of the user's eye gaze to keep consistent with the direction of the user's eye gaze.

[0177] It can be understood that, in the embodiments of the present application, the movement direction or gaze direction of the user's eyes is only illustrative. In other examples, if the electronic device detects that the user's eyes move from the current gaze point to the lower right of the display screen or the gaze direction of the user is located in the lower right region of the display screen, the plurality of display elements 311 can also rotate in another direction, which is not limited in the embodiments of the present application.

[0178] It should be understood that the display elements 311 in (b) of FIG. 6 can also refer to the related description of the display elements 221 in (c) of FIG. 3.

[0179] Based on the embodiments of the present application, in the screen-off display interface of the electronic device, the electronic device can dynamically control the change of the display elements according to the gaze direction of the user's eyes to form a screen-off animation, so as to improve the interactivity between the user and the electronic device and improve the user's experience of using the screen-off animation.

[0180] Exemplarily, FIG. 7 is a schematic diagram of a set of GUIs provided by the embodiments of the present application. Wherein, (a) to (b) of FIG. 7 show the process of dynamically generating an animation by the electronic device 300 in a screen-off scenario.

[0181] It should be understood that (a) of FIG. 7 can refer to the related description of (a) of FIG. 6, which will not be described herein for brevity.

[0182] When the electronic device 300 detects that the data of the sensor changes, a GUI as shown in (b) of FIG. 7 can be displayed. The sensor can be a gyroscope sensor or a gravity acceleration sensor, etc.

[0183] For example, when the user holds the electronic device 300 and shakes it to the right side (the side where the power key is located), the data of the sensor of the electronic device 300 will change, and the electronic device 300 can determine the movement direction, movement speed or acceleration, or movement distance, etc. of the display elements according to the data change of the sensor.

[0184] Referring to (b) of FIG. 7, the plurality of display elements 311 can move to the right side, and the display elements 311 in each row are close to each other, wherein the display elements 311 in the rightmost column can be close to the right side of the display screen.

[0185] In other examples, the moving direction, moving distance or moving speed of the plurality of display elements 311 can also be the same, and the embodiments of the present application are not limited thereto. In this case, the plurality of display elements 311 visually presents a display effect of moving as a whole to one side.

[0186] In other examples, the plurality of display elements 311 can also present a display effect of colliding and extruding each other, and the embodiments of the present application are not limited thereto.

[0187] It should be understood that the embodiments of the present application are only described by taking the user shaking the electronic device 300 to the right side as an example. In other examples, the user can also shake the electronic device 300 to other directions, and the plurality of display elements 311 can move according to the shaking direction of the user, and the embodiments of the present application are not limited thereto.

[0188] Based on the embodiments of the present application, when the user shakes the electronic device in the case of displaying the screen-off display interface, the electronic device can detect the data change of the sensor, and control the movement of the display element according to the data change of the sensor, so as to realize the display effect that the display element moves according to the shaking of the user.

[0189] In some optional examples, the display element can also be a display element in the desktop. For example, after the electronic device is unlocked, the wallpaper in the desktop of the electronic device can include the display element 221, which can also generate a dynamic animation in real time according to the interaction action with the user, so as to improve the user experience.

[0190] The above describes the process that the display element in the screen-off display interface or the lock screen display interface of the electronic device can generate an animation in real time according to the interaction with the user in combination with FIGS. 3-7. In some cases, the user can also set a dynamic picture or video as a lock screen animation or a screen-off animation, and the technical solution will be described below in combination with FIGS. 8-9.

[0191] Exemplarily, FIG. 8 is a schematic diagram of a group of GUIs provided by the embodiments of the present application. Wherein, (a) to (c) in FIG. 8 show the process that the electronic device 400 plays a lock screen video.

[0192] It should be understood that (a) in FIG. 8 can refer to the related description of (a) in FIG. 3, and for the sake of brevity, it will not be described here again.

[0193] When the electronic device 400 detects the operation that the user clicks the power key, the GUI shown in (b) in FIG. 8 can be displayed.

[0194] Or, when the electronic device 400 detects the operation that the user double-clicks the display screen, the GUI shown in (b) in FIG. 8 can be displayed.

[0195] Referring to (b) of FIG. 8, the GUI can be a lock screen display interface 420 of the electronic device. The display interface 420 can include a date, a time, and a plurality of videos, for example, the plurality of videos are a video 421 and a video 422.

[0196] It should be understood that, before the embodiments of the present application, the electronic device 400 has set a target video selected by a user as a lock screen wallpaper when setting a lock screen.

[0197] Exemplarily, the electronic device 400 can have an artificial intelligence (AI) capability, and the electronic device 400 can analyze the target video using the AI to obtain the video 421 and the video 422.

[0198] For example, the video 421 and the video 422 can be highlight moments of the target video determined by the electronic device through the AI.

[0199] Alternatively, the video 421 and the video 422 can also be video clips that include most of the subject of the video. For example, the target video is a video shot by the user and includes a pet, and the video 421 and the video 422 can be video clips that include most of the pet.

[0200] For another example, the video 421 and the video 422 can also be randomly cropped from the target video by the electronic device through the AI.

[0201] For another example, the video 421 and the video 422 can also be created by the electronic device through the AI from the target video. For example, the electronic device can identify a subject (such as a person, a pet, a building, etc.) in the target video, and create the video 421 and the video 422 according to the identified subject.

[0202] It should be understood that the embodiments of the present application do not limit the specific duration of the video 421 and the video 422, for example, the duration of the video 421 and the video 422 is 5 seconds or 10 seconds, etc. In addition, the duration of the video 421 and the video 422 can be the same or different.

[0203] It should be understood that the embodiments of the present application do not limit the specific number of videos displayed in the display interface 420. In other examples, the display interface 420 can also display three or more videos.

[0204] It should also be understood that the embodiments of the present application do not limit the layout of the plurality of videos displayed in the display interface 420. In some examples, the video 421 and the video 422 can be distributed vertically. In other examples, the video 421 and the video 422 can also be distributed horizontally.

[0205] In some optional embodiments, the video 421 and the video 422 can also be selected by the user. For example, the electronic device can, in response to an operation of the user selecting the video 421 and the video 422, display the video 421 and the video 422 together as the lock screen wallpaper.

[0206] In embodiments of the present application, the electronic device 400 can acquire the gaze point of the user's eyes in real time. When the electronic device 400 determines that the gaze point of the user's eyes is located in the display area where the video 421 is located, the electronic device 400 can display the GUI as shown in (c) of FIG. 8.

[0207] Alternatively, when the electronic device 400 detects that the user clicks the video 421, the electronic device 400 can display the GUI as shown in (c) of FIG. 8.

[0208] Referring to (c) of FIG. 8, the electronic device can play the video 421 and not play the video 422.

[0209] In other examples, when the electronic device 400 determines that the gaze point of the user's eyes is located in the display area where the video 422 is located, the electronic device can play the video 422 and not play the video 421.

[0210] Alternatively, when the electronic device 400 determines that the gaze point of the user's eyes is neither located in the display area where the video 421 is located nor located in the display area where the video 422 is located, the electronic device 400 can not play the video 421 and the video 422.

[0211] Based on embodiments of the present application, the electronic device can analyze the video selected by the user to be set as the lock screen wallpaper to determine a plurality of videos, and display the plurality of videos as the lock screen wallpaper, and can determine whether to play the video according to the gaze point of the user's eyes. Thus, the display effect of playing the video that the user's eyes gaze at can be realized on the lock screen display interface.

[0212] Exemplarily, FIG. 9 is a schematic diagram of a set of GUIs provided by embodiments of the present application. Wherein, (a) to (b) of FIG. 9 show the process of the electronic device 500 playing the screen-off video.

[0213] Referring to (a) of FIG. 9, the GUI can be the screen-off display interface 510 of the electronic device 500. The display interface 510 can display date, time and other information, and the display interface 510 can also display a plurality of videos, such as the video 521 and the video 522.

[0214] It can be understood that the plurality of videos can refer to the description of the plurality of videos in (b) of FIG. 8 above, and for brevity, will not be described again here.

[0215] In the embodiments of this application, the electronic device 500 can acquire the fixation point of the user's eyes in real time. When the electronic device 500 determines that the fixation point of the user's eyes is located in the display area where the video 521 is located, the electronic device 500 can display the GUI as shown in (b) of FIG. 9.

[0216] Referring to (b) of FIG. 9, the electronic device 500 can play the video 521 and not play the video 522.

[0217] In other examples, when the electronic device 500 determines that the fixation point of the user's eyes is located in the display area where the video 522 is located, the electronic device can play the video 522 and not play the video 521.

[0218] Alternatively, when the electronic device 500 determines that the fixation point of the user's eyes is neither in the display area where the video 521 is located nor in the display area where the video 522 is located, the electronic device 500 can not play the video 521 and the video 522.

[0219] Based on the embodiments of this application, the electronic device can analyze the video selected by the user as the screen-off wallpaper to determine a plurality of videos, and use the plurality of videos as the screen-off wallpaper, and can determine whether to play the video according to the fixation point of the user's eyes. Thus, the display effect of playing the video that the user's eyes fixate on can be realized on the screen-off display interface.

[0220] The architecture of the electronic device in the embodiments of this application will be described below with reference to FIG. 10, and the architecture of the electronic device will be described to introduce how the electronic device generates the animation dynamically.

[0221] For example, FIG. 10 is a schematic architecture diagram of an electronic device provided in the embodiments of this application. As shown in FIG. 10, the electronic device can at least include a scene definition module, an input module, a theme service module, and a display module.

[0222] The scene definition module can be used to define display elements and response rules of the display elements.

[0223] In one example, referring to (b) of FIG. 3, each of the plurality of display elements 221 can be defined by the scene definition module. For example, for one of the display elements, the developer can define the name of the display element, the specific model of the display element, the display position of the display element, and the like. The developer can also define the distribution manner of the plurality of display elements in the display interface, and the like.

[0224] The scene definition module can also define the response rule of each display element.

[0225] For example, the response rule of one of the display elements is described as an example. The response rule of the display element is as follows:

[0226] <Name (ViewName) = "Name 1", type (type) = "first type", TargetProperty = rotation, rotation angle in X direction = "sin (camera azimuth data in X direction) * 50", rotation angle in Y direction = "sin (camera azimuth data in Y direction) * 50", rotation angle in X direction = "null">.

[0227] The above type can include two types as shown in Table 1 below, and the type can support extension.

[0228] Table 1

[0229] The meaning of the first type is that camera azimuth data needs to be obtained. The meaning of the second type is that sensor data needs to be obtained.

[0230] The above target property can include two types as shown in Table 2 below, and the target property can support extension.

[0231] Table 2

[0232] The target property "rotation" can be understood as needing to rotate the display element according to the angles of the X, Y, and Z axes. The target property "movement" can be understood as needing to move the display element according to the movement direction and the gravity acceleration value.

[0233] It should be understood that the electronic device can also move the display element according to the movement direction or the gravity acceleration value.

[0234] It should be understood that the scene definition module can configure the response rule of each display element in the form of an XML file.

[0235] In another example, referring to (b) in FIG. 8, the scene definition module can define two objects above and below, which can be used to carry video 421 and video 422, respectively.

[0236] The input module can be used to receive data of various physical units or sensors of the electronic device, and transmit the received data to the theme service module.

[0237] For example, the input module can receive camera azimuth data and transmit the camera azimuth data to the theme service module.

[0238] For another example, the input module can also receive data of various sensors (such as a gyroscope sensor, a gravity accelerometer, etc.), and transmit the data obtained by the sensors to the theme service module.

[0239] In the embodiments of the present application, the data of the gyroscope sensor and the gravity accelerometer can be acquired through an inertial measurement unit (IMU). Alternatively, when the electronic device does not have an IMU, the data of the gyroscope sensor and the gravity accelerometer can also be acquired.

[0240] The theme service module can at least include an event conversion module and a scene management and rendering module.

[0241] The event conversion module in the theme service module can be configured to receive the data transmitted by the input module and convert the received data into corresponding numerical values.

[0242] For example, the event conversion module can be configured to receive the angle value of the camera and convert the angle value of the camera into the azimuth value between the camera and the face of the user.

[0243] For another example, the event conversion module can be configured to receive the data of the gyroscope sensor and the gravity accelerometer and convert the data into the moving direction and acceleration value of the display element.

[0244] Subsequently, the event conversion module can transmit the converted numerical values to the scene management and rendering module.

[0245] After receiving the data sent by the event conversion module, the scene management and rendering module can be configured to calculate the final result according to the formula or perform rendering according to the data.

[0246] For example, the scene management and rendering module receives a display element with the name “display element A” and the type of the first type of display element corresponding to the camera azimuth data [100, 100, 100], and can obtain the rotation angle of the X direction = “sin(100)*50” = 49.2 degrees, the rotation angle of the Y direction = “sin(100)*50” = 49.2 degrees, and the rotation angle of the X direction = “null = 0 degrees”.

[0247] The scene management and rendering module can rotate the display element A by 49.2 degrees along the X axis, 49.2 degrees along the Y axis, and 0 degrees along the Z axis (i.e., the Z axis is not rotated), and render the result of the rotation. Subsequently, the scene management and rendering module can send the rendered result to the display module for display.

[0248] In one example, the display module can display the rotation effect of the display element according to the display data sent by the scene management and rendering module in the theme service module.

[0249] For example, referring to (b) of FIG. 3, if the plurality of display elements 221 are three-dimensional expression spheres, when the electronic device detects that the gaze direction of the user's eyes changes, the input module can transmit the received angle value of the camera to the event conversion module in the theme service module. The event conversion module can convert the angle value of the camera into an azimuth value between the camera and the user's face, and transmit the azimuth value to the scene management and rendering module. For example, the azimuth value of the camera is [100, 100, 100], and the scene management and rendering module can rotate the plurality of display elements 221 by 49.2 degrees along the X-axis, 49.2 degrees along the Y-axis, and 0 degrees along the Z-axis to achieve the display effect of rotating the plurality of display elements simultaneously according to the change in the user's eyes. In this case, the response rule of each display element 221 is the same, and in other cases, the response rule of each display element 221 can also be different, and the embodiments of the present application are not limited thereto. When the response rules of each display element 221 are different, the rotation angles of the plurality of display elements 221 can be different.

[0250] For another example, referring to (b) of FIG. 8, the input module can transmit the received angle value of the camera to the event conversion module in the theme service module. The event conversion module can convert the angle value of the camera into an azimuth value between the camera and the user's face, and transmit the azimuth value to the scene management and rendering module. The scene management and rendering module can determine that the gaze point of the user's eyes is located in the video 421 according to the azimuth value, and can render the corresponding playback effect and send the rendering result to the display module for display to play the video 421.

[0251] For another example, the scene management and rendering module receives a moving direction and an acceleration value corresponding to a display element with the name “display element B” and the second type, and the scene management and rendering module can move the display element B according to the moving direction and the acceleration value, and render the moving effect.

[0252] Alternatively, the scene management and rendering module receives a moving direction and an acceleration value 1 corresponding to a display element with the name “display element C” and the second type, and the scene management and rendering module can also calculate an acceleration value 2 according to the formula C, and move the display element C according to the moving direction and the acceleration value 2, and render the moving effect.

[0253] It should be understood that the present application does not limit the formula C. For example, the formula C = acceleration value 1 / 10, or the formula C = acceleration value 1 / 5, etc.

[0254] Referring to (b) to (c) in FIG. 4, when the electronic device detects that the user shakes the electronic device to the right, the input module can transmit the received sensor data to the event conversion module in the theme service module. The event conversion module calculates the moving direction of the display element and the gravity acceleration value, and sends the moving direction and the gravity acceleration value to the scene management and rendering module. The scene management and rendering module can render the display element according to the moving direction and the gravity acceleration value, and send the rendering result to the display module for display, to present the real-time moving effect of the display element.

[0255] It can be understood that the names of the above-mentioned modules are only illustrative, and in other examples, the above-mentioned modules can also be referred to as modules with other names on the basis of having the same functions, and the embodiments of the present application are not limited thereto.

[0256] In other examples, the scene management and rendering module can also be two modules, namely a scene management module and a rendering module, wherein the scene management module can be used for calculation, and the rendering module can be used for rendering display data.

[0257] FIG. 11 is a schematic flowchart of a display method provided by an embodiment of the present application. As shown in FIG. 11, the method 700 can be applied to an electronic device, and the method 700 can include steps 710 to 730.

[0258] 710, the electronic device displays a first display interface, and the first display interface includes one or more display elements.

[0259] The display element can be a two-dimensional display element or a three-dimensional display element.

[0260] For example, the display element can be a two-dimensional expression, an animal, a building, etc. The three-dimensional display element can be a three-dimensional expression sphere, a three-dimensional animal, a three-dimensional plant, a three-dimensional building, etc.

[0261] For example, referring to FIG. 3, the first display interface can be the display interface 220, that is, the first display interface can be a lock screen display interface. The display element can be the display element 221.

[0262] For example, referring to FIG. 6, the first display interface can be the display interface 310, that is, the first display interface can be an off-screen display interface, and the display element can be the display element 311.

[0263] It should be understood that the first display interface can also be a desktop, and the embodiments of the present application are not limited thereto.

[0264] 720, in response to detecting the first interaction action of the user, generating a first animation, the first animation being associated with at least one target display element of the one or more display elements.

[0265] For example, the first interaction action can be a change in a gaze direction of the user's eyes gazing at the first display interface, or the first interaction action can also be the user shaking the electronic device, or the first interaction action can also be the user tilting the electronic device held by the user, etc. The electronic device can generate the animation in real time according to the first interaction action.

[0266] 730, the electronic device displays the first animation in the first display interface.

[0267] It should be understood that the electronic device displaying the first animation in the first display interface can also be understood as the electronic device playing the first animation in the first display interface.

[0268] Based on the embodiments of the present application, the first display interface displayed by the electronic device can include one or more display elements, and when the first interaction action of the user is detected, the electronic device can generate an animation of a target display element in real time according to a first rule, and play the animation.

[0269] In this way, the electronic device can generate an animation of a target display element in real time according to the interaction action of the user, for example, the target display element is a lock screen element, and the electronic device can generate a dynamic lock screen animation in real time, so as to realize dynamic interaction with the user and improve the interest of the lock screen.

[0270] In addition, the electronic device can generate different lock screen animations through the interaction action of the user each time the user unlocks, so as to improve the diversity of the lock screen animation and improve the user experience of using the lock screen.

[0271] In some embodiments, the at least one target display element is a plurality of target display elements, and generating the first animation includes:

[0272] Generating an animation associated with each target display element of the plurality of target display elements to obtain a plurality of animations;

[0273] Displaying the first animation in the first display interface includes:

[0274] Displaying the plurality of animations in the first display interface, respectively.

[0275] According to the embodiments of the present application, when the first display interface includes a plurality of target display elements, the electronic device can generate an animation associated with each target display element according to the interaction action of the user, and display the plurality of animations in the first display interface respectively. In this way, each target display element has a corresponding animation, so that the plurality of target display elements in the first display interface can all change, thereby improving the display effect of the electronic device.

[0276] In some embodiments, the plurality of animations have the same action, or the actions of at least two animations of the plurality of animations are different.

[0277] According to the embodiments of the present application, when the plurality of animations have the same action, the animation effects of the plurality of target display elements in the first display interface can be the same, for example, the plurality of target display elements rotate in the same direction, thereby presenting a better display effect. When the actions of at least two animations of the plurality of animations are different, the diversity and interest of the animations can be improved.

[0278] In some embodiments, in response to detecting the first interaction action of the user, the first animation is generated, including:

[0279] Detecting a change in the gaze direction of the eyes of the user to the first display interface;

[0280] Determining rotation data of one or more target display elements according to the change in the gaze direction;

[0281] Generating the first animation according to the rotation data.

[0282] For example, the electronic device can detect the change in the gaze direction through a camera, or can also detect the change in the gaze direction through a time-of-flight (TOF) sensor.

[0283] When the change in the gaze direction is detected through the camera, the change in the gaze direction can be represented by the azimuth data of the camera.

[0284] According to the embodiments of the present application, the electronic device can detect the change in the gaze direction of the eyes of the user, and determine the rotation data of the target display element according to the change in the gaze direction, and generate the first animation according to the rotation data.

[0285] In this way, the target display element can rotate according to the change in the gaze direction of the eyes of the user, thereby realizing the effect that the eyes of the user control the rotation of the target display element.

[0286] In some embodiments, in response to detecting the first interaction action of the user, the first animation is generated, including:

[0287] Detecting a change in the angle of the face of the user relative to the display screen;

[0288] determining rotation data of the at least one target display element according to the change of the angle;

[0289] generating a first animation according to the rotation data.

[0290] Exemplarily, the electronic device can acquire the change of the angle of the face of the user relative to the display screen through the camera.

[0291] For example, when the electronic device detects that the face of the user turns from facing the display screen to turning to one side, the target display element can turn in the same direction or in a certain direction following the turning of the face of the user.

[0292] In this way, the target display element can change according to the turning of the face of the user, so that the effect of the face of the user controlling the rotation of the display element can be realized.

[0293] In some embodiments, the rotation data at least comprises a rotation angle of a first target display element in the at least one target display element in a first direction,

[0294] generating the first animation according to the rotation data, comprising:

[0295] rotating the first target display element according to the rotation angle in the first direction to generate an animation associated with the first target display element.

[0296] It should be understood that the first target display element can be one display element in the at least one target display element. In this case, the first target display element has a rotation angle in the first direction, and the present application does not limit the rotation direction and the rotation angle of other target display elements in the at least one target display element except the first target display element. The rotation direction of the other target display element can be the same as or different from the first direction; the rotation angle of the other target display element can be the same as or different from the rotation angle of the first target display element.

[0297] Exemplarily, referring to FIG. 3, the first target display element can be one display element in the plurality of display elements 211.

[0298] It should also be understood that the first target display element can also be a plurality of target display elements in the at least one target display element. In this case, the plurality of target display elements can have the same rotation angle in the first direction, so that the plurality of target display elements can have the same rotation effect.

[0299] In some cases, the first target display element can also be the same as the at least one target display element, in which case all the display elements in the at least one target display element have the same animation effect.

[0300] Exemplarily, the first direction can be in a clockwise manner or in an anticlockwise direction, or the first direction can be an X-axis direction, or a Y-axis direction, or a Z-axis direction in a three-dimensional coordinate system.

[0301] Exemplarily, the rotation data can further include a rotation angle of the target display element in a second direction, or can further include a rotation angle of the target display element in a third direction. For example, the rotation data includes rotation angles in the X-axis direction, the Y-axis direction, and the Z-axis direction in a three-dimensional coordinate system.

[0302] According to the embodiments of the present application, the electronic device can rotate the first target display element according to the rotation angle in the first direction to generate the corresponding animation.

[0303] In some embodiments, in response to detecting the first interaction action of the user, the first animation is generated, including:

[0304] Obtaining data of an inertial measurement unit of the electronic device;

[0305] Determining movement data of at least one target display element according to the data of the inertial measurement unit, the movement data including a movement direction and / or an acceleration value;

[0306] Generating the first animation according to the movement data.

[0307] The inertial measurement unit can include a gyroscope sensor, a gravity acceleration sensor, etc. Alternatively, the inertial measurement unit can also be replaced by a gyroscope sensor, a gravity acceleration sensor, etc.

[0308] For example, when the user shakes the electronic device, the electronic device can obtain the data of the inertial measurement unit. It should be understood that the electronic device can obtain the data of the inertial measurement unit in real time, and determine the corresponding movement data in real time to generate the first animation in real time.

[0309] In other examples, the movement data can further include a movement distance, a speed, or a corresponding relationship between the speed and time, a corresponding relationship between the acceleration value and time, etc.

[0310] In some cases, when the movement data includes the movement direction, the electronic device can further move the target element according to a default movement distance or movement speed.

[0311] In some cases, when the movement data includes the acceleration value, the electronic device can further move the target element according to a default movement direction.

[0312] According to the embodiments of the present application, the electronic device can determine the movement data of the target display element according to the data of the IMU, and generate the first animation of the display element according to the movement data.

[0313] In this way, when the user shakes the electronic device, the target display element can move along the shaking direction of the user, so that the user experience can be improved.

[0314] FIG. 12 is a schematic flowchart of a display method according to an embodiment of the present application. As shown in FIG. 12, the method 800 can be applied to an electronic device, and the method 800 can include steps 810 to 830.

[0315] 810, in response to an operation of setting the first video as the wallpaper of the first display interface, generating a plurality of sub-videos according to the first video;

[0316] It should be understood that the plurality of sub-videos can be directly derived from the first video. For example, the plurality of sub-videos can be generated by clipping from the first video, such as the plurality of sub-videos can be a plurality of highlights in the first video.

[0317] Alternatively, the plurality of sub-videos is indirectly derived from the first video. For example, the plurality of sub-videos can be generated according to the material in the first video, which is not limited in the embodiments of the present application.

[0318] 820, displaying a second display interface, the second display interface including a plurality of display areas for displaying the plurality of sub-videos;

[0319] For example, referring to FIG. 8, the second display interface can be the display interface 420, the sub-videos can be the video 421 and the video 422, the plurality of display areas can include the display area where the video 421 and the video 422 are located, and the display area can be used to carry the sub-videos.

[0320] 830, in response to detecting that the gaze point of the user's eyes is located in the display area where the first sub-video is located, playing the first sub-video, wherein the first sub-video is a sub-video in the plurality of sub-videos.

[0321] For example, referring to FIG. 8, when the gaze point of the user's eyes is located in the display area where the video 421 is located, the electronic device can play the video 421.

[0322] According to the embodiments of the present application, when the user sets the selected video as the wallpaper, the electronic device can generate a plurality of sub-videos according to the video, and when it is detected that the gaze point of the user's eyes is located in the display area where the first sub-video is located, the target sub-video can be played.

[0323] In this way, the electronic device can generate a plurality of videos according to the video set as the wallpaper, and the diversity of the wallpaper display can be improved. The electronic device can also play the video where the user's eyes gaze, so that the display effect of playing the video where the user's eyes gaze can be realized, thereby improving the user experience.

[0324] In some implementations, the method 800 further includes:

[0325] In response to detecting that the gaze point of the user’s eye is out of the first display region in which the first sub-video is located, pausing playing the first sub-video.

[0326] Based on the embodiments of the present application, when the electronic device detects that the gaze point of the user’s eye is out of the first sub-video, the electronic device can pause playing the first sub-video. In this way, the electronic device can conveniently realize playing and pausing of the video in the second display interface.

[0327] In some implementations, the method 800 further includes:

[0328] In response to detecting that the gaze point of the user’s eye is in the display region in which the second sub-video is located, playing the second sub-video, the second sub-video being a sub-video in the plurality of sub-videos.

[0329] Based on the embodiments of the present application, when the electronic device detects that the gaze point of the user’s eye is in the display region in which the second sub-video is located, the electronic device can play the second sub-video. In this way, the electronic device can conveniently switch the video played in the second display interface.

[0330] In some implementations, the first display interface includes at least one of a screen-off display interface, a lock screen display interface, or a desktop.

[0331] FIG. 13 is a schematic block diagram of an electronic device according to an embodiment of the present application. As shown in FIG. 13, the electronic device 900 can include one or more processors 910, one or more memories 920, and the one or more memories 920 store one or more instructions, when the instructions are executed by the one or more processors 910, cause the display method as described in any possible implementation manner to be performed.

[0332] Exemplarily, the electronic device 900 can be the electronic device 200, the electronic device 300, the electronic device 400, the electronic device 500, and the electronic device 900 can be configured to perform the method 700, the method 800, etc.

[0333] The embodiments of the present application further provide an apparatus including a processor and a communication interface, the communication interface is configured to receive a signal and transmit the signal to the processor, and the processor processes the signal, so that the display method as described in any possible implementation manner is performed.

[0334] The apparatus can be a chip. For example, the chip can be a chip system or an independent chip, etc.

[0335] The embodiment of the present application further provides a readable storage medium, which stores instructions, and when the instructions are run on a device, the device executes the related method steps to realize the display method in the above embodiment.

[0336] The embodiment of the present application further provides a program product, which, when run on a device, causes the device to execute the related steps to realize the display method in the above embodiment.

[0337] The embodiment of the present application further provides a device, which comprises a module for realizing the display method in any of the above embodiments.

[0338] In addition, the embodiment of the present application further provides a device, which can be a chip, a component or a module. The device can comprise a processor and a memory connected to each other. The memory is used to store instructions, and the processor can execute the instructions stored in the memory to cause the device to perform the display method in the above method embodiments when the device runs.

[0339] The device, the readable storage medium, the program product or the device provided by the embodiment can be used to execute the corresponding method provided above, and thus the beneficial effects thereof can refer to the beneficial effects of the corresponding method provided above, which will not be described herein again.

[0340] Those skilled in the art can understand that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software mode depends on the specific application and design constraints of the technical solution. The skilled person can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0341] Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the above method embodiments, which will not be described herein again.

[0342] In the several embodiments provided by the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only schematic. The division of the units is only a logical function division. There can be another division manner for actual implementation, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections between the units can be indirect couplings or communication connections through some interfaces, devices or units, and can be electrical, mechanical or in other forms.

[0343] The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, i.e. may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.

[0344] In addition, the functional units in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit.

[0345] The functions, if realized in the form of software functional units and sold or used as independent products, can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application or the part of the present application that essentially contributes to the prior art or the part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk.

[0346] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A display method characterized by comprising: The method is applied to an electronic device, and the method comprises: displaying a first display interface, the first display interface comprising one or more display elements; in response to detecting a first interaction action of a user, generating a first animation, the first animation being associated with at least one target display element of the one or more display elements; displaying the first animation in the first display interface.

2. The method of claim 1, wherein, The at least one target display element is a plurality of target display elements, The generating of the first animation comprises: generating an animation associated with each target display element of the plurality of target display elements to obtain a plurality of animations; The displaying of the first animation in the first display interface comprises: respectively displaying the plurality of animations in the first display interface.

3. The method of claim 2, wherein, The plurality of animations have the same action, or the actions of at least two animations of the plurality of animations are different.

4. The method according to any one of claims 1-3, characterized in that, The generating of the first animation in response to detecting the first interaction action of the user comprises: detecting a change in a gaze direction of a user's eyes gazing at the first display interface; determining rotation data of the at least one target display element according to the change in the gaze direction; generating the first animation according to the rotation data.

5. The method according to any one of claims 1-3, characterized in that, The generating of the first animation in response to detecting the first interaction action of the user comprises: detecting a change in an angle of a user's face relative to a display screen; determining rotation data of the at least one target display element according to the change in the angle; generating the first animation according to the rotation data.

6. The method according to claim 4 or 5, characterized in that, The rotation data at least comprises a rotation angle of a first target display element of the at least one target display element in a first direction, The generating of the first animation according to the rotation data comprises: rotating the first target display element according to the rotation angle in the first direction to generate an animation associated with the first target display element.

7. The method according to any one of claims 1-3, characterized in that, The generating of the first animation in response to detecting the first interaction action of the user comprises: obtaining data of an inertial measurement unit of the electronic device; determining movement data of the at least one target display element according to the data of the inertial measurement unit, the movement data comprising a movement direction and / or an acceleration value; generating the first animation according to the movement data.

8. The method according to any one of claims 1-7, characterized in that, The first display interface comprises at least one of a screen-off display interface, a lock screen display interface, or a desktop.

9. The method according to any one of claims 1-8, characterized in that, The at least one target display element is a three-dimensional expression sphere.

10. A display method characterized by comprising: The method is applied to an electronic device, and the method comprises: in response to an operation of setting a first video as a wallpaper of a second display interface, generating a plurality of sub-videos according to the first video; displaying the second display interface, the second display interface comprising a plurality of display regions for playing the plurality of sub-videos; in response to detecting that a gaze point of a user's eyes is located in a display region in which a first sub-video is located, playing the first sub-video, wherein the first sub-video is a sub-video of the plurality of sub-videos.

11. The method of claim 10, wherein, The method further comprises: in response to detecting that the gaze point of the user's eyes leaves the first display region in which the first sub-video is located, pausing the playing of the first sub-video.

12. The method of claim 11, wherein, The method further comprises: In response to detecting that the gaze point of the user's eye is located at a second display area where a second sub-video is located, playing the second sub-video.

13. The method according to any one of claims 10-12, characterized in that, The second display interface includes at least one of a screen-off display interface, a lock screen display interface, or a desktop.

14. An electronic device, comprising: Comprising: one or more processors; one or more memories; the one or more memories store one or more programs, when the one or more programs are executed by one or more processors, so that the display method as claimed in any one of claims 1-13 is executed.

15. A chip, characterized by The chip includes a processor and a communication interface, the communication interface is used for receiving a signal and transmitting the signal to the processor, the processor processes the signal, so that the display method as claimed in any one of claims 1-13 is executed.

16. A readable storage medium, characterized by, The readable storage medium stores instructions, when the instructions run on the electronic device, so that the display method as claimed in any one of claims 1-13 is executed.

17. A program product, characterized by The program product includes program code, when the program code runs on the electronic device, so that the display method as claimed in any one of claims 1-13 is executed.

Images