Display method and electronic equipment

Abstract

The invention provides a display method and electronic equipment. According to the embodiment of the invention, the electronic equipment can generate the animation in real time according to the interaction action of the user and the preset rule, for example, the electronic equipment can generate the dynamic screen locking animation in real time, so that the dynamic interaction with the user can be realized, and the interestingness of screen locking is improved. In addition, the electronic equipment can also display a plurality of videos and play the videos watched by the eyes of the user, so that the display effect that the eyes of the user watch which video, which video is played, can be realized.

Description

[0001] This application is a divisional application. The application number of the original application is 202411048849.6, and the original application date is July 31, 2024. The entire contents of the original application are incorporated into this application by reference. Technical Field

[0002] The present application relates to the field of electronic technology, and more specifically, to a display method and an electronic device. Background Art

[0003] Users can set lock screen wallpapers, off screen wallpapers, etc. according to their preferences. For example, when setting the lock screen, users can use pictures, two-dimensional animations, or three-dimensional animations as lock screen wallpapers. However, after the user sets the wallpaper, the picture, two-dimensional animation, or three-dimensional animation is generally fixed and has a relatively simple form, which can easily cause aesthetic fatigue to users. Summary of the invention

[0004] The embodiment of the present application provides a display method and an electronic device. In the technical solution, the electronic device can generate an animation in real time according to the user's interactive actions and pre-set rules. For example, the electronic device can generate a dynamic lock screen animation in real time, thereby realizing dynamic interaction with the user and improving the fun of the lock screen.

[0005] In a first aspect, a display method is provided, which is applied to an electronic device, and the method comprises: displaying a first display interface, the first display interface comprising one or more display elements; generating a first animation in response to detecting a first interaction action of a user, the first animation being associated with at least one target display element among the one or more display elements; and displaying the first animation on the first display interface.

[0006] The display element may be a two-dimensional display element or a three-dimensional display element.

[0007] Based on the embodiment of the present application, the first display interface displayed by the electronic device may include one or more display elements. When a first interaction action of the user is detected, the electronic device may generate an animation of the display element in real time according to the first rule and play the animation.

[0008] In this way, the electronic device can generate an animation of the target display element in real time according to the user's interactive actions. For example, if the target display element is a lock screen element, the electronic device can generate a dynamic lock screen animation in real time, thereby achieving dynamic interaction with the user and enhancing the fun of the lock screen.

[0009] In addition, each time the user unlocks the device, the electronic device can generate a different lock screen animation based on the user's interactive actions, thereby increasing the diversity of the lock screen animation and improving the user's experience of using the lock screen.

[0010] In some implementations, the at least one target display element is a plurality of target display elements, and generating the first animation includes: generating an animation associated with each of the plurality of target display elements to obtain a plurality of animations; and displaying the first animation on the first display interface includes: displaying the plurality of animations respectively on the first display interface.

[0011] Based on the embodiment of the present application, when the first display interface includes multiple target display elements, the electronic device can generate an animation associated with each target display element according to the user's interactive action, and display the multiple animations in the first display interface. In this way, each target display element has a corresponding animation, so that multiple target display elements in the first display interface can all change, thereby improving the display effect of the electronic device.

[0012] In some implementations, the multiple animations have the same action, or the actions of at least two of the multiple animations are different.

[0013] Based on the embodiments of the present application, when multiple animations have the same action, the animation effects of multiple target display elements in the first display interface can be made the same, for example, multiple target display elements rotate in the same direction, thereby presenting a better display effect. When at least two of the multiple animations have different actions, the diversity and fun of the animations can be improved.

[0014] In some implementations, the first animation is generated in response to detecting a first interactive action of the user, including: detecting a change in the gaze direction of the user's eyes looking at the first display interface; determining rotation data of the at least one target display element based on the change in the gaze direction; and generating the first animation based on the rotation data.

[0015] For example, the electronic device may detect changes in gaze direction through a camera, or may also detect changes in gaze direction through a time-of-flight TOF sensor.

[0016] Based on the embodiment of the present application, the electronic device can detect changes in the gaze direction of the user's eyes, determine the rotation data of the target display element according to the changes in the gaze direction, and generate a first animation according to the rotation data.

[0017] In this way, the target display element can rotate according to the change of the gaze direction of the user's eyes, thereby achieving the effect of the user's eyes controlling the rotation of the display element.

[0018] In some implementations, generating a first animation in response to detecting a first interactive action of a user includes: detecting a change in the angle of the user's face relative to a display screen; determining rotation data of at least one target display element based on the change in the angle; and generating the first animation based on the rotation data.

[0019] For example, the electronic device may obtain changes in the angle of the user's face relative to the display screen through a camera.

[0020] In this way, the target display element can change according to the rotation of the user's face, thereby achieving the effect of the user's face controlling the rotation of the display element.

[0021] In some implementations, the rotation data includes at least a rotation angle of a first target display element among the at least one target display element in a first direction, and generating the first animation based on the rotation data includes: rotating the first target display element according to the rotation angle in the first direction to generate an animation associated with the first target display element.

[0022] It should be understood that the first target display element may be a display element in at least one target display element. In this case, the first target display element has a rotation angle in the first direction, and the present application does not limit the rotation direction and rotation angle of other target display elements in at least one target display element except the first target display element. The rotation direction of the other target display element may be the same as or different from the first direction; the rotation angle of the other target display element may be the same as or different from the rotation angle of the first target display element.

[0023] It should also be understood that the first target display element may also be multiple target display elements in the at least one target display element. In this case, the multiple target display elements may have the same rotation angle in the first direction, so that the multiple target display elements may have the same rotation effect.

[0024] In some cases, the first target display element and the at least one target display element may also be the same. In this case, all display elements in the at least one target display element have the same animation effect.

[0025] Exemplarily, the first direction may be clockwise or counterclockwise, or the first direction may be the X-axis direction, the Y-axis direction or the Z-axis direction in a three-dimensional coordinate system.

[0026] Exemplarily, the rotation data may also include a rotation angle of at least one target display element in a second direction, or may also include a rotation angle of at least one target display element in a third direction. For example, the rotation data includes rotation angles in the X-axis direction, the Y-axis direction, and the Z-axis direction in a three-dimensional coordinate system.

[0027] Based on the embodiment of the present application, the electronic device can rotate the first target display element according to a rotation angle in the first direction to generate an animation corresponding thereto.

[0028] In some implementations, generating a first animation in response to detecting a first interactive action of a user includes: acquiring data from an inertial measurement unit of the electronic device; determining movement data of at least one target display element based on the data from the inertial measurement unit, the movement data including a movement direction and / or an acceleration value; and generating the first animation based on the movement data.

[0029] For example, when a user shakes the electronic device, the electronic device can acquire data from the inertial measurement unit.

[0030] Based on the embodiment of the present application, the electronic device can determine the movement data of the target display element according to the data of the inertial measurement unit, and generate the first animation of the target display element according to the movement data.

[0031] In this way, when the user shakes the electronic device, the target display element can move in the direction of the user's shaking, thereby improving the user's experience.

[0032] In some implementations, the first display interface includes at least one of an off-screen display interface, a lock-screen display interface, or a desktop.

[0033] In a second aspect, a display method is provided, which is applied to an electronic device, and the method includes: in response to an operation of setting a first video as a wallpaper of a second display interface, generating multiple sub-videos based on the first video; displaying the second display interface, the second display interface including a display area for displaying multiple sub-videos; in response to detecting that a gaze point of a user's eyes is located within the display area where the first sub-video is located, playing the first sub-video, wherein the first sub-video is a sub-video among the multiple sub-videos.

[0034] Based on the embodiment of the present application, when the user sets the selected video as wallpaper, the electronic device can generate multiple sub-videos based on the video, and when it is detected that the gaze point of the user's eyes is within the display area where the first sub-video is located, the target sub-video can be played.

[0035] In this way, the electronic device can generate multiple videos according to the video set as wallpaper, which can improve the diversity of wallpaper display. The electronic device can also play the video that the user's eyes are looking at, so that the display effect of playing the video that the user's eyes are looking at can be achieved, thereby improving the user's experience.

[0036] In some implementations, the method further includes: pausing playback of the first sub-video in response to detecting that a gaze point of the user's eyes leaves a first display area where the first sub-video is located.

[0037] Based on the embodiment of the present application, when the electronic device detects that the user's eye gaze point leaves the first sub-video, the first sub-video can be paused. In this way, the electronic device can conveniently play and pause the video.

[0038] In some implementations, the method further includes: in response to detecting that a gaze point of the user's eyes is located within a display area where a second sub-video is located, playing the second sub-video, the second sub-video being a sub-video among the multiple sub-videos.

[0039] Based on the embodiment of the present application, when the electronic device detects that the gaze point of the user's eyes is located in the display area where the second sub-video is located, the second sub-video can be played. In this way, the electronic device can conveniently switch the video played in the second display interface.

[0040] In some implementations, the second display interface includes at least one of an off-screen display interface, a lock-screen display interface, or a desktop.

[0041] In a third aspect, an electronic device is provided, comprising: one or more processors; one or more memories; the one or more memories storing one or more programs, and when the one or more programs are executed by one or more processors, the display method described in the first aspect and any possible implementation thereof is executed.

[0042] In a fourth aspect, a display device is provided, comprising a module for implementing the display method as described in the first aspect and any possible implementation manner thereof.

[0043] In a fifth aspect, a chip is provided, which includes a processor and a communication interface, the communication interface is used to receive signals and transmit the signals to the processor, and the processor processes the signals so that the display method described in the first aspect and any possible implementation thereof is executed.

[0044] In a sixth aspect, a readable storage medium is provided, in which instructions are stored. When the instructions are executed on a device, the display method described in the first aspect and any possible implementation thereof is executed.

[0045] In a seventh aspect, a program product is provided, the program product comprising a program code, and when the program code runs on a device, the display method as described in the first aspect and any possible implementation thereof is executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0047] Figure 2 It is a schematic diagram of the software structure of the electronic device provided in the embodiment of the present application.

[0048] Figure 3 A schematic diagram of a set of graphical user interfaces GUI provided in an embodiment of the present application

[0049] Figure 4 It is a schematic diagram of a group of GUIs provided in an embodiment of the present application.

[0050] Figure 5 It is a schematic diagram of a group of GUIs provided in an embodiment of the present application.

[0051] Figure 6 It is a schematic diagram of a group of GUIs provided in an embodiment of the present application.

[0052] Figure 7 It is a schematic diagram of a group of GUIs provided in an embodiment of the present application.

[0053] Figure 8 It is a schematic diagram of a group of GUIs provided in an embodiment of the present application.

[0054] Fig. 9 It is a schematic diagram of a group of GUIs provided in an embodiment of the present application.

[0055] Fig.10 It is a schematic architecture diagram of an electronic device provided in an embodiment of the present application.

[0056] Fig.11 It is a schematic flow chart of a display method provided in an embodiment of the present application.

[0057] Fig.12 It is a schematic flow chart of a display method provided in an embodiment of the present application.

[0058] Fig.13 It is a schematic block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0059] The technical solution in this application will be described below in conjunction with the accompanying drawings.

[0060] The method in the embodiments of the present application can be applied to electronic devices such as smart phones, tablet computers, laptops, personal computers (PCs), ultra-mobile personal computers (UMPCs), netbooks, vehicle-mounted devices, smart TVs, wearable devices, foldable devices, and Internet of Things (IoT) devices.

[0061] Figure 1 1 shows a schematic diagram of the structure of the electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0062] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0063] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0064] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0065] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0066] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus interface, etc.

[0067] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL).

[0068] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170.

[0069] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface.

[0070] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160.

[0071] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 .

[0072] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc.

[0073] The USB interface 130 is an interface that complies with USB standard specifications, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transmit data between the electronic device 100 and a peripheral device.

[0074] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0075] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0076] The power management module 141 is used to connect the battery 142 , the charging management module 140 and the processor 110 .

[0077] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0078] The mobile communication module 150 can provide wireless communication solutions including 2G / 3G / 4G / 5G etc. applied on the electronic device 100 .

[0079] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0080] The wireless communication module 160 can provide wireless communication solutions for application in the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Bluetooth low energy (BLE), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc.

[0081] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with the network and other devices through wireless communication technology.

[0082] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0083] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), or a display panel made of one of the materials such as an organic light-emitting diode (OLED), an active matrix organic light-emitting diode or an active matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), miniled, microled, micro-oled or quantum dot light emitting diodes (QLED). In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0084] In the embodiment of the present application, the display screen can be used to display animations generated in real time by the electronic device.

[0085] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0086] The ISP is used to process data fed back by the camera 193. The camera 193 is used to capture still images or videos.

[0087] Digital signal processors are used to process digital signals. In addition to processing digital image signals, they can also process other digital signals.

[0088] Video codecs are used to compress or decompress digital video.

[0089] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 .

[0090] The internal memory 121 may be used to store computer executable program codes, wherein the executable program codes include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121 .

[0091] The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0092] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals.

[0093] The speaker 170A, also called a "horn", is used to convert audio electrical signals into sound signals.

[0094] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals.

[0095] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.

[0096] The earphone jack 170D is used to connect a wired earphone.

[0097] Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, an acceleration sensor 180E, a distance sensor 180F, a fingerprint sensor 180H, a touch sensor 180K, a bone conduction sensor 180M, etc.

[0098] Buttons 190 include a power button, a volume button, and the like.

[0099] Motor 191 can generate vibration prompts.

[0100] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0101] The SIM card interface 195 is used to connect a SIM card.

[0102] Figure 2 1 is a software structure diagram of the electronic device 100 of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the system library, and the kernel layer. The application layer can include a series of application packages.

[0103] like Figure 2 As shown, the application package may include applications (application, App) such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, wallet, etc.

[0104] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0105] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0106] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0107] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0108] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0109] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0110] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0111] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0112] The core library consists of two parts: one part is the function that the Java language needs to call, and the other part is the core library.

[0113] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0114] The system library may include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0115] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0116] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0117] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0118] A 2D graphics engine is a drawing engine for 2D drawings.

[0119] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0120] Before introducing the technical solution of the present application, some professional terms that may be involved in the present application are first introduced as follows.

[0121] The screen-off state can be understood as when the user does not operate the electronic device within a preset time or the user presses the power button of the electronic device, the electronic device will enter a state where the screen is off, the electronic device is locked but in standby mode. In the screen-off state, the electronic device can display a screen-off wallpaper, which can be a picture, animation, or video.

[0122] It should be understood that the screen of the electronic device turns off and locks after displaying the screen-off wallpaper. After the electronic device is locked, when the electronic device detects that the user is looking at the display screen of the electronic device, the electronic device can also display the screen-off wallpaper, or when the electronic device detects that the user clicks the display screen, the screen-off wallpaper can be displayed.

[0123] The lock screen state can be understood as when the user does not operate the electronic device within a preset period of time or the user presses the power button of the electronic device, the electronic device will enter the lock screen state.

[0124] When the user double-clicks the display interface displayed in the off-screen state or presses the power button of the electronic device, the electronic device can display a lock screen wallpaper. For example, the lock screen wallpaper can be a picture, animation, or video. In the lock screen state, the user needs to unlock the electronic device before using the electronic device normally.

[0125] When using an electronic device, a user can set the lock screen wallpaper, off screen wallpaper, etc. of the electronic device according to their own preferences. For example, when setting the lock screen, a user can use a two-dimensional animation or a three-dimensional animation as the lock screen wallpaper. However, the two-dimensional animation or the three-dimensional animation is fixed and the form is relatively simple, which can easily cause aesthetic fatigue to the user.

[0126] In view of this, the embodiments of the present application provide a display method and an electronic device. In the technical solution, the electronic device can generate an animation in real time according to the user's interactive actions and pre-set rules. For example, the electronic device can generate a dynamic lock screen animation in real time, thereby realizing dynamic interaction with the user and improving the fun of the lock screen.

[0127] The following will introduce the display method in the embodiment of the present application in combination with several sets of graphical user interfaces (GUIs).

[0128] For example, Figure 3 is a schematic diagram of a set of GUIs provided in an embodiment of the present application. Figure 3 (a) to (c) in the figure show the process of the electronic device 200 dynamically generating a lock screen animation.

[0129] See also Figure 3 In (a), the GUI may be a screen-off display interface 210 of the electronic device 200. The display interface 210 may display the current date and time.

[0130] For example, when the electronic device 200 detects that the user presses the power button, the following information may be displayed: Figure 3 GUI shown in (b) in .

[0131] Alternatively, when the electronic device 200 detects that the user double-clicks the display screen, the following information may be displayed: Figure 3 GUI shown in (b) in .

[0132] It is understandable that the embodiment of the present application does not limit the electronic device to enter the display from the display interface 210. Figure 3 The specific method of the GUI shown in (b) in FIG.

[0133] See also Figure 3 In (b), the GUI may be a lock screen display interface 220 of the electronic device 200. The display interface 220 may be used to display a lock screen wallpaper or a lock screen animation set by a user. The display interface 220 may include a plurality of display elements 221.

[0134] The multiple display elements 221 may be distributed in a plurality of rows or columns (such as three rows and three columns, or six rows and three columns, etc.), or in other regular or irregular shapes. In the embodiment of the present application, the multiple display elements are distributed in three rows and three columns as an example for description.

[0135] It should be understood that the display element 221 can also be called an element, a lock screen element or an animation element, etc.

[0136] In the embodiment of the present application, the display element 221 is taken as an example of a two-dimensional expression.

[0137] In other examples, the display element 221 may be a three-dimensional object model, such as a three-dimensional expression sphere, a three-dimensional animal, a three-dimensional plant, a three-dimensional building, a three-dimensional object, etc., which is not limited in the embodiments of the present application.

[0138] In some examples, the electronic device 200 has already pre-set the corresponding lock screen wallpaper, or the electronic device has already applied the corresponding theme including the corresponding lock screen wallpaper. Unlike the current lock screen wallpaper, the lock screen wallpaper of the embodiment of the present application is not fixed, and the lock screen elements therein can change in real time according to the user's interactive actions, thereby improving the user's experience of using the lock screen animation.

[0139] When the electronic device 200 displays the display interface 220, the electronic device 200 can detect the gaze direction of the user's eyes, and the display elements 221 in the display interface 220 can change with the user's eyes. For example, the display elements 221 can rotate or move according to the gaze direction of the user's eyes.

[0140] It is understandable that the embodiments of the present application do not limit the specific technical means for how the electronic device determines the gaze direction of the user's eyes.

[0141] Exemplarily, the electronic device may detect the gaze direction of the user's eyes using a camera. For example, the electronic device obtains the user's facial information through a camera and further determines the gaze direction of the user's eyes.

[0142] In other examples, the display interface 210 may also include the multiple display elements 221. For example, the multiple display elements 221 may be displayed at low brightness in the display interface 210. In this way, the consistency of the display content from the off screen to the lock screen of the electronic device can be maintained.

[0143] It should be understood that in the present application, the electronic device obtains the user's facial information or the user's eye gaze point through the camera with the user's authorization.

[0144] For example, the current gaze point of the user's eyes is located in the middle of the display screen. When the electronic device detects that the user's eyes move from the current gaze point to the upper right of the display screen, the following information may be displayed: Figure 3 GUI shown in (c) in FIG.

[0145] Alternatively, when the electronic device detects that the user's eye gaze direction is located in the upper right area of ​​the display screen, the following may be displayed: Figure 3 GUI shown in (c) in FIG.

[0146] See also Figure 3 In (c), the multiple display elements 221 can be rotated in the direction of the user's eye gaze to be consistent with the direction of the user's eye gaze.

[0147] The gaze direction of the user's eyes can also be understood as the gaze point of the user's eyes.

[0148] It is understandable that in the embodiment of the present application, the movement direction or gaze direction of the user's eyes is only illustrative. In other examples, if the electronic device detects that the user's eyes move from the current gaze point to the lower right of the display screen or the user's gaze direction is located in the lower right area of ​​the display screen, the multiple display elements 221 can also rotate in another direction, which is not limited in the embodiment of the present application.

[0149] In other examples, multiple display elements 221 may also rotate in different directions, or the multiple display elements 221 may rotate at different angles. In this case, the electronic device needs to determine the direction or angle of rotation of each display element 221 according to the response rule of each display element 221, so that the movement of each display element 221 can form a separate animation, thereby improving the diversity and fun of the lock screen animation.

[0150] In the embodiment of the present application, the developer of the lock screen animation can define the attributes of the display elements and the response rules of the display elements in the form of a configuration file. The response rules of multiple display elements can be the same or different. The response rules of the display elements will be introduced in conjunction with the specific embodiments below, and will not be described in detail here.

[0151] The configuration file may be an extensible markup language (XML), a domain-specific language (DSL), a JavaScript object notation (JSON), or the like.

[0152] In other examples, when the display element 221 is a three-dimensional object model, for example, the display element 221 is a three-dimensional expression sphere. Then the electronic device 200 can detect the gaze direction of the user's eyes and control the display element 221 to rotate in the direction of the user's eyes. It should be understood that the electronic device 200 can continuously detect the gaze direction of the user's eyes, and when the gaze direction of the user's eyes changes, the display element 221 is controlled to rotate dynamically according to the direction of the user's eyes, so that the user has the display effect of controlling the display element 221 in real time using the eyes.

[0153] Based on the embodiments of the present application, in the lock screen display interface of the electronic device, the electronic device can dynamically control the changes of display elements according to the gaze direction of the user to form a lock screen animation, thereby improving the interactivity between the user and the electronic device and improving the user's experience of using the lock screen animation.

[0154] For example, Figure 4 is a schematic diagram of a set of GUIs provided in an embodiment of the present application. Figure 4 (a) to (c) in the figure show the process of the electronic device 200 dynamically generating a lock screen animation.

[0155] It should be understood that Figure 4 For (a) to (b) in Figure 3 For the sake of brevity, the relevant descriptions in (a) to (b) are not described in detail here.

[0156] When the electronic device 200 detects that the sensor data has changed, it can display Figure 4 The GUI shown in (c) in FIG. The sensor may be a gyroscope sensor or a gravity acceleration sensor, etc.

[0157] For example, when the user holds the electronic device 200 and shakes it to the right side (the side where the power button is located), the data of the sensor of the electronic device 200 will change, and the electronic device 200 can determine the moving direction and acceleration of the display element according to the change in the sensor data. Alternatively, the electronic device 200 can further determine the moving speed or moving distance, etc. according to the change in the sensor data.

[0158] See also Figure 4 In (c), the multiple display elements 221 can be moved to the right, and the display elements 221 distributed in each row are close to each other, wherein the display elements 221 in the rightmost column can be close to the right side of the display screen.

[0159] In other examples, the moving directions, acceleration values, moving distances, or moving speeds of the multiple display elements 221 may also be the same, which is not limited in the embodiments of the present application. In this case, the multiple display elements 221 visually present a display effect of moving to one side as a whole.

[0160] In other examples, the multiple display elements 221 may also present a display effect of mutual collision and compression, etc., which is not limited in the embodiment of the present application.

[0161] It should be understood that the embodiment of the present application only takes the example of a user shaking the electronic device 200 to the right. In other examples, the user can also shake the electronic device 200 in other directions, and the multiple display elements 221 can move according to the shaking direction of the user. The embodiment of the present application is not limited to this.

[0162] Based on the embodiments of the present application, when the electronic device displays the lock screen display interface, when the user shakes the electronic device, the electronic device can detect changes in sensor data and control the movement of display elements according to the changes in sensor data, thereby achieving a display effect in which the display elements move according to the user's shaking.

[0163] Combination of the above Figure 4-5 A technical solution is described in which multiple display elements can generate the same animation effect. In some embodiments, each of the multiple display elements can also generate different animation effects. Figure 5 Introduce the technical solution.

[0164] For example, Figure 5 is a schematic diagram of a set of GUIs provided in an embodiment of the present application. Figure 5(a) to (c) in the figure show the process of the electronic device 200 dynamically generating a lock screen animation.

[0165] It should be understood that Figure 5 For (a) to (b) in Figure 3 For the sake of brevity, the relevant descriptions in (a) to (b) are not repeated here.

[0166] For example, when the electronic device 200 detects that the gaze direction or gaze point of the user's eyes is located in the display element 2211 among the multiple display elements 221, and the gaze direction of the user's eyes moves downward, the following may be displayed: Figure 5 GUI shown in (c) in FIG.

[0167] See also Figure 5 In (c), the display element 2211 may move downward according to the gaze direction of the user's eyes, while the other display elements remain unchanged.

[0168] In this case, the response rule of each display element in the multiple display elements 221 may be different, that is, each display element has a separate animation effect. Taking display element 2211 as an example, its response rule may be that when the electronic device detects that the gaze direction of the user's eyes is located on the display element 2211, and the gaze direction of the user's eyes changes again, for example, the gaze direction of the user's eyes moves downward from the current position, then the display element 2211 may move following the gaze direction of the user, thereby achieving a display effect that the display element the user is gazing at moves following the gaze direction of the user.

[0169] Based on the embodiments of the present application, each display element in the lock screen display interface can have a separate animation effect, so that when the user looks at a display element and his or her line of sight moves, the display element will move with the user's line of sight, thereby achieving the effect of the display element following the eye movement, thereby improving the user's experience of using the lock screen animation.

[0170] In some cases, the technical solution of the embodiments of the present application can also be applied to the screen-off scenario.

[0171] For example, Figure 6 is a schematic diagram of a set of GUIs provided in an embodiment of the present application. Figure 6 (a) to (b) show the dynamic generation process of the electronic device 300 in the screen-off scenario.

[0172] See also Figure 6 In (a), the GUI may be an off-screen display interface 310 of the electronic device 300. The display interface 310 may display information such as date and time, and may further display a plurality of display elements 311.

[0173] It should be understood that the display element 311 can refer to the description of the display element 211 in the previous text, and for the sake of brevity, it will not be repeated here.

[0174] For example, the current gaze point of the user's eyes is located in the middle of the display screen. When the electronic device 300 detects that the user's eyes move from the current gaze point to the upper right of the display screen, the following may be displayed: Figure 6 GUI shown in (b) in .

[0175] Alternatively, when the electronic device 300 detects that the gaze direction of the user's eyes is located in the upper right area of ​​the display screen, the following may be displayed: Figure 6 GUI shown in (b) in .

[0176] See also Figure 6 In (b), the multiple display elements 311 can be rotated in the direction of the user's eye gaze to be consistent with the direction of the user's eye gaze.

[0177] It is understandable that in the embodiment of the present application, the movement direction or gaze direction of the user's eyes is only illustrative. In other examples, if the electronic device detects that the user's eyes move from the current gaze point to the lower right of the display screen or the user's gaze direction is located in the lower right area of ​​the display screen, the multiple display elements 311 can also rotate in another direction, which is not limited in the embodiment of the present application.

[0178] It should be understood that Figure 6 The display element 311 in (b) can also be seen in Figure 3 Related description of display element 221 in (c) of FIG.

[0179] Based on the embodiments of the present application, in the screen-off display interface of an electronic device, the electronic device can dynamically control the changes in display elements according to the gaze direction of the user to form a screen-off animation, thereby improving the interactivity between the user and the electronic device and improving the user's experience of using the screen-off animation.

[0180] For example, Figure 7 is a schematic diagram of a set of GUIs provided in an embodiment of the present application. Figure 7 (a) to (b) show the process of the electronic device 300 dynamically generating animation in the screen-off scenario.

[0181] It should be understood that Figure 7 For (a) in Figure 6 For the sake of brevity, the relevant description of (a) in FIG. 1 is not repeated here.

[0182] When the electronic device 300 detects that the sensor data has changed, it can display Figure 7The sensor may be a gyroscope sensor or a gravity acceleration sensor.

[0183] For example, when the user holds the electronic device 300 and shakes it to the right side (the side where the power button is located), the data of the sensor of the electronic device 300 will change, and the electronic device 300 can determine the moving direction, moving speed or acceleration or moving distance of the display element based on the change in sensor data.

[0184] See also Figure 7 In (b), the multiple display elements 311 can be moved to the right, and the display elements 311 distributed in each row are close to each other, wherein the display elements 311 in the rightmost column can be close to the right side of the display screen.

[0185] In other examples, the moving directions, moving distances or moving speeds of the multiple display elements 311 may also be the same, which is not limited in the embodiments of the present application. In this case, the multiple display elements 311 visually present a display effect of moving to one side as a whole.

[0186] In other examples, the multiple display elements 311 may also present a display effect of mutual collision and compression, etc., which is not limited in the embodiment of the present application.

[0187] It should be understood that the embodiment of the present application only illustrates the example of a user shaking the electronic device 300 to the right. In other examples, the user can also shake the electronic device 300 in other directions, and the multiple display elements 311 can move according to the shaking direction of the user. The embodiment of the present application is not limited to this.

[0188] Based on the embodiments of the present application, when the electronic device displays the off-screen display interface, when the user shakes the electronic device, the electronic device can detect changes in sensor data and control the movement of display elements according to the changes in sensor data, thereby achieving a display effect in which the display elements move according to the user's shaking.

[0189] In some optional examples, the display element can also be a display element on the desktop. For example, after the electronic device is unlocked, the wallpaper on the desktop of the electronic device may include the above-mentioned display element 221, which can also generate dynamic animations in real time based on the interaction actions with the user to enhance the user experience.

[0190] Combination of the above Figure 3-7 This article introduces the process by which display elements in the off-screen display interface or lock-screen display interface of an electronic device can generate animations in real time based on the interaction with the user. In some cases, users can also set dynamic pictures or videos as lock-screen animations or off-screen animations. Figure 8-9 Introduce the technical solution.

[0191] For example, Figure 8 is a schematic diagram of a set of GUIs provided in an embodiment of the present application. Figure 8 (a) to (c) in the figure show the process of the electronic device 400 playing the lock screen video.

[0192] It should be understood that Figure 8 For (a) in Figure 3 For the sake of brevity, the relevant description of (a) in FIG. 1 is not repeated here.

[0193] When the electronic device 400 detects that the user clicks the power button, the following information may be displayed: Figure 8 GUI shown in (b) in .

[0194] Alternatively, when the electronic device 400 detects that the user double-clicks the display screen, the following information may be displayed: Figure 8 GUI shown in (b) in .

[0195] See also Figure 8 In (b), the GUI may be a lock screen display interface 420 of the electronic device. The display interface 420 may include date, time, and multiple videos, for example, the multiple videos are video 421 and video 422.

[0196] It should be understood that before the embodiment of the present application, when performing lock screen setting, the electronic device 400 has set the target video selected by the user as the lock screen wallpaper. The source of the video 421 and the video 422 can be the target video.

[0197] Exemplarily, the electronic device 400 may have artificial intelligence (AI) capabilities, and the electronic device 400 may use AI to analyze the target video to obtain the video 421 and the video 422 .

[0198] For example, the video 421 and the video 422 may be the highlights of the target video determined by the electronic device through AI.

[0199] Alternatively, the video 421 and the video 422 may also be the video clips that include the most video main body parts. For example, if the target video is a video that includes a pet shot by the user, the video 421 and the video 422 may be the video clips that include the most pet parts.

[0200] For another example, the video 421 and the video 422 may be randomly cropped from the target video by the electronic device through AI.

[0201] For another example, the video 421 and the video 422 may also be obtained by the electronic device through AI creation of the target video. For example, the electronic device may identify the subject (such as a person, a pet, a building, etc.) in the target video, and create based on the identified subject to obtain the video 421 and the video 422 corresponding to the subject.

[0202] It should be understood that the embodiment of the present application does not limit the specific duration of video 421 and video 422. For example, the duration of video 421 and video 422 is 5 seconds or 10 seconds, etc. In addition, the duration of video 421 and video 422 can be the same or different.

[0203] It should be understood that the embodiment of the present application does not limit the specific number of videos displayed in the display interface 420. In other examples, the display interface 420 may also display three or more videos.

[0204] It should also be understood that the present embodiment of the application does not limit the layout of the multiple videos displayed in the display interface 420. In some examples, the video 421 and the video 422 can be distributed vertically. In other examples, the video 421 and the video 422 can also be distributed horizontally.

[0205] In some optional embodiments, the video 421 and the video 422 may also be selected by the user. For example, the electronic device may respond to the user selecting the video 421 and the video 422 and use the video 421 and the video 422 together as the lock screen wallpaper.

[0206] In the embodiment of the present application, the electronic device 400 can obtain the gaze point of the user's eyes in real time. When the electronic device 400 determines that the gaze point of the user's eyes is located in the display area where the video 421 is located, it can display the following Figure 8 GUI shown in (c) in FIG.

[0207] Alternatively, when the electronic device 400 detects that the user clicks on the video 421, it can display Figure 8 GUI shown in (c) in FIG.

[0208] See also Figure 8 In (c), the electronic device can play video 421 but not play video 422.

[0209] In other examples, when electronic device 400 determines that the gaze point of the user's eyes is located within the display area where video 422 is located, the electronic device can play video 422 but not play video 421.

[0210] Alternatively, when electronic device 400 determines that the gaze point of the user's eyes is neither within the display area where video 421 is located nor within the display area where video 422 is located, electronic device 400 may not play video 421 and video 422.

[0211] Based on the embodiment of the present application, the electronic device can analyze the video selected by the user as the lock screen wallpaper to determine multiple videos, and use the multiple videos as the lock screen wallpaper, and can determine whether to play the video according to the user's eye gaze point. Thus, the display effect of playing the video that the user's eyes are looking at can be achieved on the lock screen display interface.

[0212] For example, Fig. 9 is a schematic diagram of a set of GUIs provided in an embodiment of the present application. Fig. 9 (a) to (b) show the process of the electronic device 500 playing a video with the screen turned off.

[0213] See also Fig. 9 In (a), the GUI may be an off-screen display interface 510 of the electronic device 500. The display interface 510 may display information such as date and time, and may also display multiple videos, such as video 521 and video 522.

[0214] It is understandable that the multiple videos can be found in the above text. Figure 8 (b) The description of multiple videos is not included here for brevity.

[0215] In the embodiment of the present application, the electronic device 500 can obtain the gaze point of the user's eyes in real time. When the electronic device 500 determines that the gaze point of the user's eyes is located in the display area where the video 521 is located, it can display the following Fig. 9 GUI shown in (b) in .

[0216] See also Fig. 9 In (b), the electronic device 500 can play the video 521 but not the video 522.

[0217] In other examples, when the electronic device 500 determines that the gaze point of the user's eyes is located within the display area where the video 522 is located, the electronic device can play the video 522 but not play the video 521.

[0218] Alternatively, when electronic device 500 determines that the gaze point of the user's eyes is neither within the display area where video 521 is located nor within the display area where video 522 is located, electronic device 500 may not play video 521 and video 522.

[0219] Based on the embodiments of the present application, the electronic device can analyze the video selected by the user as the off-screen wallpaper to determine multiple videos, and use the multiple videos as the off-screen wallpaper, and can determine whether to play the video according to the user's eye gaze point. Thus, the off-screen display interface can achieve the display effect of playing the video that the user's eyes are looking at.

[0220] The following will combine Fig.10 An architecture diagram of an electronic device in an embodiment of the present application is introduced, and the architecture of the electronic device is used to introduce how the electronic device can achieve a process of dynamically generating animations.

[0221] For example, Fig.10 is a schematic architecture diagram of an electronic device provided in an embodiment of the present application. Fig.10 As shown, the electronic device may at least include a scene definition module, an input module, a theme service module and a display module.

[0222] The scene definition module can be used to define display elements and response rules of the display elements.

[0223] For an example, see Figure 3 In (b), each of the multiple display elements 221 can be defined by the scene definition module. For example, for one of the display elements, the developer can define the name of the display element, the specific model of the display element, the display position of the display element, etc. The developer can also define the distribution method of the multiple display elements in the display interface, etc.

[0224] The scene definition module can also define the response rules for each display element.

[0225] For example, the response rule of one of the display elements is defined as an example for explanation. The response rule of the display element is as follows:

[0226] <ViewName="Name 1", Type="First Type", TargetProperty="rotation", X-axis rotation angle="sin(camera azimuth angle data in X direction)*50", Y-axis rotation angle="sin(camera azimuth angle data in Y direction)*50", X-axis rotation angle="null">.

[0227] Among them, the above types may include the two types shown in Table 1 below, and this type may support extension.

[0228] Table 1

[0229] type meaning Type I Camera azimuth data Type II Sensor data

[0230] The first type means that the camera azimuth data needs to be acquired. The second type means that the sensor data needs to be acquired.

[0231] The above target attributes may include two types as shown in Table 2 below, and the target attributes may support extension.

[0232] Table 2

[0233] type meaning Rotation Rotate along the X, Y, and Z axes move Move according to the moving direction and gravity acceleration value

[0234] If the target attribute is "rotate", it can be understood that the display element needs to be rotated according to the angles of the X, Y, and Z axes. If the target attribute is "move", it can be understood that the display element needs to be moved according to the moving direction and the gravity acceleration value.

[0235] It should be understood that the electronic device can also move the display element according to the moving direction or gravity acceleration value.

[0236] It should be understood that the scenario definition module can configure the response rules of each display element in the form of an XML file.

[0237] For another example, see Figure 8 In (b), the scene definition module can define two objects, upper and lower, which can be used to carry video 421 and video 422 respectively.

[0238] The input module can be used to receive data from various physical units or sensors of the electronic device, and transmit the received data to the subject service module.

[0239] For example, the input module may receive the azimuth angle data of the camera and transmit the azimuth angle data to the theme service module.

[0240] For another example, the input module may also receive data from various sensors (such as a gyroscope sensor, a gravity accelerometer, etc.), and transmit the data acquired by the sensor to the theme service module.

[0241] In the embodiment of the present application, the data of the gyro sensor and the gravity accelerometer can be obtained through an inertial measurement unit (IMU). Alternatively, when the electronic device does not have an IMU, the data can also be obtained through a gyro sensor and a gravity accelerometer.

[0242] The theme service module may at least include an event conversion module and a scene management and rendering module.

[0243] The event conversion module in the subject service module can be used to receive data transmitted by the input module and convert the received data into corresponding numerical values.

[0244] For example, the event conversion module may be used to receive an angle value of a camera and convert the angle value of the camera into an azimuth angle value between the camera and the user's face.

[0245] As another example, the event conversion module may be used to receive data from a gyroscope sensor and a gravity accelerometer, and convert the data into a moving direction and acceleration value of a display element.

[0246] Afterwards, the event conversion module can transmit the converted values ​​to the scene management and rendering module.

[0247] After receiving the data sent by the event conversion module, the scene management and rendering module can be used to calculate the final result according to the formula or render according to the data.

[0248] For example, the scene management and rendering module receives a display element named "display element A" and the camera azimuth data corresponding to the display element of the first type is [100,100,100]. Then, the rotation angle in the X direction = "sin(100)*50" = 49.2 degrees, the rotation angle in the Y direction = "sin(100)*50" = 49.2 degrees, and the rotation angle in the X direction = "null = 0 degrees".

[0249] The scene management and rendering module may rotate the display element A by 49.2 degrees toward the X axis, 49.2 degrees toward the Y axis, and 0 degrees about the Z axis (i.e., the Z axis does not rotate), and render the rotation result. Afterwards, the scene management and rendering module may send the rendering result to the display module for display.

[0250] In one example, the display module may be used to display the rotation effect of the display element, etc. according to the display data sent by the scene management and rendering modules in the theme service module.

[0251] For example, see Figure 3In (b), if the multiple display elements 221 are three-dimensional expression spheres, when the electronic device detects that the gaze direction of the user's eyes has changed, the input module can transmit the received camera angle value to the event conversion module in the theme service module. The event conversion module can convert the camera angle value into an azimuth value between the camera and the user's face, and send the azimuth value to the scene management and rendering module. For example, if the azimuth value of the camera is [100, 100, 100], the scene management and rendering module can rotate the multiple display elements 221 49.2 degrees toward the X axis, 49.2 degrees toward the Y axis, and 0 degrees along the Z axis to achieve a display effect in which multiple display elements rotate according to the user's eyes at the same time. In this case, the response rules of each display element 221 are the same. In other cases, the response rules of each display element 221 can also be different, which is not limited in the embodiment of the present application. When the response rules of each display element 221 are different, the rotation angles of the multiple display elements 221 can be different.

[0252] For example, see Figure 8 In (b), the input module can transmit the received camera angle value to the event conversion module in the theme service module. The event conversion module can convert the camera angle value into an azimuth value between the camera and the user's face, and send the azimuth value to the scene management and rendering module. The scene management and rendering module can determine that the user's eye gaze point is located in the video 421 according to the azimuth value, and can render the corresponding playback effect, and send the rendered result to the display module for display to play the video 421.

[0253] For another example, the scene management and rendering module receives a display element named "display element B" and a moving direction and acceleration value corresponding to a display element of the second type. The scene management and rendering module can move the display element B according to the moving direction and acceleration value, and render the moving effect.

[0254] Alternatively, the scene management and rendering module receives a display element named "display element C" and a moving direction and acceleration value 1 corresponding to a display element of the second type. The scene management and rendering module can also recalculate the acceleration value 2 according to formula C, move the display element C according to the moving direction and acceleration to 2, and render the moving effect.

[0255] It should be understood that the present application does not limit the formula C. For example, the formula C=acceleration value 1 / 10, or the formula C=acceleration value 1 / 5, etc.

[0256] See also Figure 4In (b) to (c), when the electronic device detects that the user shakes the electronic device to the right, the input module can transmit the received sensor data to the event conversion module in the theme service module. The event conversion module obtains the moving direction and gravity acceleration value of the display element by calculation, and sends the moving direction and gravity acceleration value to the scene management and rendering module. The scene management and rendering module can render the display element according to the moving direction and gravity acceleration value, and send the rendering result to the display module for display, so as to present the real-time movement effect of the display element.

[0257] It is understandable that the names of the above modules are merely illustrative. In other examples, on the basis of having the same functions, the above modules may also be called modules with other names, which is not limited in the embodiments of the present application.

[0258] In other examples, the scene management and rendering module may also be two modules, namely a scene management module and a rendering module, wherein the scene management module may be used to calculate results, and the rendering module may be used to render and display data.

[0259] Fig.11 is a schematic flow chart of a display method provided in an embodiment of the present application. Fig.11 As shown, the method 700 may be applied to an electronic device, and the method 700 may include steps 710 to 730.

[0260] 710. An electronic device displays a first display interface, where the first display interface includes one or more display elements.

[0261] The display element may be a two-dimensional display element or a three-dimensional display element.

[0262] For example, the display element may be a two-dimensional expression, an animal, a building, etc. The three-dimensional display element may be a three-dimensional expression sphere, a three-dimensional animal, a three-dimensional plant, a three-dimensional building, etc.

[0263] For example, see Figure 3 The first display interface may be display interface 220, that is, the first display interface may be a lock screen display interface. The display element may be display element 221.

[0264] For example, see Figure 6 , the first display interface may be display interface 310 , that is, the first display interface may be an off-screen display interface, and the display element may be display element 311 .

[0265] It should be understood that the first display interface may also be a desktop, which is not limited in the embodiment of the present application.

[0266] 720 , in response to detecting a first interaction action of the user, generate a first animation, where the first animation is associated with at least one target display element among the one or more display elements.

[0267] For example, the first interactive action may be a change in the gaze direction of the user's eyes gazing at the first display interface, or the first interactive action may be the user shaking the electronic device, or the first interactive action may be the user tilting the electronic device, etc. The electronic device may generate an animation in real time according to the first interactive action.

[0268] 730. The electronic device displays a first animation in a first display interface.

[0269] It should be understood that the electronic device displaying the first animation in the first display interface can also be understood as the electronic device playing the first animation in the first display interface.

[0270] Based on the embodiment of the present application, the first display interface displayed by the electronic device may include one or more display elements. When a first interaction action of the user is detected, the electronic device can generate an animation of the target display element in real time according to the first rule and play the animation.

[0271] In this way, the electronic device can generate an animation of the target display element in real time according to the user's interactive actions. For example, if the target display element is a lock screen element, the electronic device can generate a dynamic lock screen animation in real time, thereby achieving dynamic interaction with the user and enhancing the fun of the lock screen.

[0272] In addition, each time the user unlocks the device, the electronic device can generate a different lock screen animation based on the user's interactive actions, thereby increasing the diversity of the lock screen animation and improving the user's experience of using the lock screen.

[0273] In some embodiments, the at least one target display element is a plurality of target display elements, and generating a first animation includes:

[0274] generating an animation associated with each target display element in the plurality of target display elements to obtain a plurality of animations;

[0275] Displaying a first animation on a first display interface includes:

[0276] A plurality of animations are displayed respectively in the first display interface.

[0277] Based on the embodiment of the present application, when the first display interface includes multiple target display elements, the electronic device can generate an animation associated with each target display element according to the user's interactive action, and display the multiple animations in the first display interface. In this way, each target display element has a corresponding animation, so that multiple target display elements in the first display interface can all change, thereby improving the display effect of the electronic device.

[0278] In some embodiments, the multiple animations have the same action, or the actions of at least two of the multiple animations are different.

[0279] Based on the embodiments of the present application, when multiple animations have the same action, the animation effects of multiple target display elements in the first display interface can be made the same, for example, multiple target display elements rotate in the same direction, thereby presenting a better display effect. When at least two of the multiple animations have different actions, the diversity and fun of the animations can be improved.

[0280] In some embodiments, in response to detecting a first interaction action of a user, generating a first animation includes:

[0281] Detecting a change in the gaze direction of the user's eyes on the first display interface;

[0282] Determining rotation data of one or more target display elements based on the change in gaze direction;

[0283] A first animation is generated according to the rotation data.

[0284] For example, the electronic device may detect changes in gaze direction through a camera, or may also detect changes in gaze direction through a time-of-flight TOF sensor.

[0285] When detecting the change of the gaze direction by using a camera, the change of the gaze direction can be represented by the azimuth angle data of the camera.

[0286] Based on the embodiment of the present application, the electronic device can detect changes in the gaze direction of the user's eyes, determine the rotation data of the target display element according to the changes in the gaze direction, and generate a first animation according to the rotation data.

[0287] In this way, the target display element can rotate according to the change of the gaze direction of the user's eyes, thereby achieving the effect of the user's eyes controlling the rotation of the target display element.

[0288] In some embodiments, in response to detecting a first interaction action of a user, generating a first animation includes:

[0289] Detecting changes in the angle of the user's face relative to the display screen;

[0290] determining rotation data of at least one target display element according to the change in the angle;

[0291] A first animation is generated according to the rotation data.

[0292] Exemplarily, the electronic device may obtain changes in the angle of the user's face relative to the display screen through a camera.

[0293] For example, when the electronic device detects that the user's face turns from facing the display screen to one side, the target display element may rotate in the same direction or in a certain direction following the rotation of the user's face.

[0294] In this way, the target display element can change according to the rotation of the user's face, thereby achieving the effect of the user's face controlling the rotation of the display element.

[0295] In some embodiments, the rotation data at least includes a rotation angle of a first target display element in the at least one target display element in a first direction.

[0296] Generating the first animation according to the rotation data includes:

[0297] The first target display element is rotated according to a rotation angle in a first direction to generate an animation associated with the first target display element.

[0298] It should be understood that the first target display element may be a display element in at least one target display element. In this case, the first target display element has a rotation angle in the first direction, and the present application does not limit the rotation direction and rotation angle of other target display elements in at least one target display element except the first target display element. The rotation direction of the other target display element may be the same as or different from the first direction; the rotation angle of the other target display element may be the same as or different from the rotation angle of the first target display element.

[0299] For example, see Figure 3 , the first target display element may be one of the multiple display elements 211 .

[0300] It should also be understood that the first target display element may also be multiple target display elements in the at least one target display element. In this case, the multiple target display elements may have the same rotation angle in the first direction, so that the multiple target display elements may have the same rotation effect.

[0301] In some cases, the first target display element and the at least one target display element may also be the same. In this case, all display elements in the at least one target display element have the same animation effect.

[0302] Exemplarily, the first direction may be clockwise or counterclockwise, or the first direction may be the X-axis direction, the Y-axis direction or the Z-axis direction in a three-dimensional coordinate system.

[0303] Exemplarily, the rotation data may also include the rotation angle of the target display element in the second direction, or may also include the rotation angle of the target display element in the third direction. For example, the rotation data includes the rotation angles in the X-axis direction, the Y-axis direction, and the Z-axis direction in the three-dimensional coordinate system.

[0304] Based on the embodiment of the present application, the electronic device can rotate the first target display element according to a rotation angle in the first direction to generate an animation corresponding thereto.

[0305] In some embodiments, in response to detecting a first interaction action of a user, generating a first animation includes:

[0306] Acquire data from an inertial measurement unit of an electronic device;

[0307] Determine movement data of at least one target display element according to the data of the inertial measurement unit, the movement data including movement direction and / or acceleration value;

[0308] A first animation is generated based on the movement data.

[0309] The inertial measurement unit may include a gyroscope sensor, a gravity acceleration sensor, etc. Alternatively, the inertial measurement unit may also be replaced by a gyroscope sensor or a gravity acceleration sensor.

[0310] For example, when the user shakes the electronic device, the electronic device can obtain data from the inertial measurement unit. It should be understood that the electronic device can obtain the data from the inertial measurement unit in real time, and determine the corresponding movement data in real time to generate the first animation in real time.

[0311] In other examples, the movement data may also include movement distance, speed, or the corresponding relationship between speed and time, the corresponding relationship between acceleration value and time, etc.

[0312] In some cases, when the movement data includes a movement direction, the electronic device may also move the target element according to a default movement distance or movement speed.

[0313] In some cases, when the movement data includes an acceleration value, the electronic device may also move the target element in a default movement direction.

[0314] Based on the embodiment of the present application, the electronic device can determine the movement data of the target display element according to the data of the IMU, and generate a first animation of the display element according to the movement data.

[0315] In this way, when the user shakes the electronic device, the target display element can move in the direction of the user's shaking, thereby improving the user's experience.

[0316] Fig.12 is a schematic flow chart of a display method provided in an embodiment of the present application. Fig.12 As shown, the method 800 may be applied to an electronic device, and the method 800 may include steps 810 to 830.

[0317] 810, in response to an operation of setting a first video as a wallpaper of a first display interface, generating a plurality of sub-videos according to the first video;

[0318] It should be understood that the multiple sub-videos may be directly derived from the first video. For example, the multiple sub-videos may be generated by editing the first video, such as the multiple sub-videos may be multiple highlights in the first video.

[0319] Alternatively, the plurality of sub-videos are indirectly derived from the first video. For example, the plurality of sub-videos may be created and generated based on the materials in the first video, which is not limited in the embodiment of the present application.

[0320] 820, displaying a second display interface, where the second display interface includes a plurality of display areas for displaying a plurality of sub-videos;

[0321] For example, see Figure 8 The second display interface may be display interface 420, the sub-videos may be video 421 and video 422, the multiple display areas may include a display area where video 421 and video 422 are located, and the display area may be used to carry the sub-videos.

[0322] 830. In response to detecting that the gaze point of the user's eyes is located in the display area where the first sub-video is located, play the first sub-video, wherein the first sub-video is a sub-video among multiple sub-videos.

[0323] For example, see Figure 8 When the gaze point of the user's eyes is located in the display area where the video 421 is located, the electronic device can play the video 421.

[0324] Based on the embodiment of the present application, when the user sets the selected video as wallpaper, the electronic device can generate multiple sub-videos based on the video, and when it is detected that the gaze point of the user's eyes is within the display area where the first sub-video is located, the target sub-video can be played.

[0325] In this way, the electronic device can generate multiple videos according to the video set as wallpaper, which can improve the diversity of wallpaper display. The electronic device can also play the video that the user's eyes are looking at, so that the display effect of playing the video that the user's eyes are looking at can be achieved, thereby improving the user's experience.

[0326] In some implementations, the method 800 further includes:

[0327] In response to detecting that the gaze point of the user's eyes leaves the first display area where the first sub-video is located, pausing the playing of the first sub-video.

[0328] Based on the embodiment of the present application, when the electronic device detects that the user's eye gaze point leaves the first sub-video, the first sub-video can be paused. In this way, the electronic device can conveniently play and pause the video in the second display interface.

[0329] In some implementations, the method 800 further includes:

[0330] In response to detecting that the gaze point of the user's eyes is located in the display area where the second sub-video is located, the second sub-video is played, and the second sub-video is a sub-video among multiple sub-videos.

[0331] Based on the embodiment of the present application, when the electronic device detects that the gaze point of the user's eyes is located in the display area where the second sub-video is located, the second sub-video can be played. In this way, the electronic device can conveniently switch the video played in the second display interface.

[0332] In some implementations, the first display interface includes at least one of an off-screen display interface, a lock-screen display interface, or a desktop.

[0333] Fig.13 is a schematic block diagram of an electronic device provided in an embodiment of the present application. Fig.13 As shown, the electronic device 900 may include one or more processors 910; one or more memories 920; the one or more memories 920 store one or more instructions, and when the instructions are executed by the one or more processors 910, the display method described in any possible implementation method described above is executed.

[0334] Exemplarily, the electronic device 900 may be the electronic device 200, the electronic device 300, the electronic device 400, or the electronic device 500 mentioned above, and the electronic device 900 may be used to execute the above-mentioned method 700, method 800, etc.

[0335] An embodiment of the present application also provides a device, including a processor and a communication interface, the communication interface is used to receive a signal and transmit the signal to the processor, the processor processes the signal so that the display method described in any possible implementation method described above is executed.

[0336] The device may be a chip. For example, the chip may be a chip system or an independent chip.

[0337] An embodiment of the present application also provides a readable storage medium, which stores instructions. When the instructions are executed on a device, the device executes the above-mentioned related method steps to implement the display method in the above-mentioned embodiment.

[0338] The embodiment of the present application also provides a program product. When the program product is run on a device, the device executes the above-mentioned related steps to implement the display method in the above-mentioned embodiment.

[0339] An embodiment of the present application also provides a device, including a module for implementing the display method described in any of the above embodiments.

[0340] In addition, an embodiment of the present application also provides a device, which may specifically be a chip, a component or a module, and the device may include a connected processor and a memory; wherein the memory is used to store instructions, and when the device is running, the processor may execute the instructions stored in the memory so that the device executes the display method in the above-mentioned method embodiments.

[0341] Among them, the equipment, readable storage medium, program product or device provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0342] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0343] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0344] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0345] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0346] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0347] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk, or an optical disk.

[0348] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A display method, characterized in that: The method is applied to an electronic device, and the method comprises: Displaying a first display interface, where the first display interface includes one or more display elements; In response to detecting a first interaction action of a user, generating a first animation, wherein the first animation is associated with at least one target display element among the one or more display elements; The first animation is displayed on the first display interface.

2. The method according to claim 1, characterized in that The at least one target display element is a plurality of target display elements, The generating of the first animation comprises: generating an animation associated with each target display element in the plurality of target display elements to obtain a plurality of animations; The displaying the first animation on the first display interface includes: The multiple animations are displayed respectively in the first display interface.

3. The method according to claim 2, characterized in that The multiple animations have the same action, or at least two animations among the multiple animations have different actions.

4. The method according to any one of claims 1 to 3, characterized in that The step of generating a first animation in response to detecting a first interactive action of a user comprises: Detecting a change in a gaze direction of the user's eyes gazing at the first display interface; determining rotation data of the at least one target display element according to the change in the gaze direction; The first animation is generated according to the rotation data.

5. The method according to any one of claims 1 to 3, characterized in that: The step of generating a first animation in response to detecting a first interactive action of a user comprises: Detecting changes in the angle of the user's face relative to the display screen; Determining rotation data of the at least one target display element according to the change of the angle; The first animation is generated according to the rotation data.

6. The method according to claim 4 or 5, characterized in that: The rotation data at least includes a rotation angle of a first target display element in the at least one target display element in a first direction, Generating the first animation according to the rotation data includes: The first target display element is rotated according to a rotation angle in the first direction to generate an animation associated with the first target display element.

7. The method according to any one of claims 1 to 3, characterized in that The step of generating a first animation in response to detecting a first interactive action of a user comprises: Acquiring data from an inertial measurement unit of the electronic device; Determining movement data of the at least one target display element according to the data of the inertial measurement unit, the movement data including a movement direction and / or an acceleration value; The first animation is generated according to the movement data.

8. The method according to any one of claims 1 to 7, characterized in that The first display interface includes at least one of an off-screen display interface, a locked screen display interface, or a desktop.

9. The method according to any one of claims 1 to 8, characterized in that The at least one target display element is a three-dimensional display element.

10. The method according to claim 9, characterized in that The at least one target display element is one of a three-dimensional expression sphere, a three-dimensional animal, a three-dimensional plant, a three-dimensional building, and a three-dimensional object.

11. A display method, characterized in that: The method is applied to an electronic device, and the method comprises: In response to an operation of setting the first video as wallpaper of the second display interface, generating a plurality of sub-videos according to the first video; Displaying the second display interface, where the second display interface includes a plurality of display areas for playing the plurality of sub-videos; In response to detecting that a gaze point of the user's eyes is located within a display area where a first sub-video is located, the first sub-video is played, wherein the first sub-video is a sub-video among the multiple sub-videos.

12. The method according to claim 11, characterized in that The method further comprises: In response to detecting that the gaze point of the user's eyes leaves the first display area where the first sub-video is located, pausing the playing of the first sub-video.

13. The method according to claim 12, characterized in that The method further comprises: In response to detecting that the gaze point of the user's eyes is located in the second display area where the second sub-video is located, the second sub-video is played.

14. The method according to any one of claims 11 to 13, characterized in that The second display interface includes at least one of an off-screen display interface, a locked screen display interface, or a desktop.

15. An electronic device, characterized in that: include: one or more processors; One or more memories; the one or more memories store one or more programs, and when the one or more programs are executed by one or more processors, the display method according to any one of claims 1 to 14 is executed.

16. A chip, characterized in that: The chip includes a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the display method according to any one of claims 1 to 14 is executed.

17. A readable storage medium, characterized in that: The readable storage medium stores instructions, and when the instructions are executed on the electronic device, the display method according to any one of claims 1 to 14 is executed.

18. A program product, characterized in that The program product includes a program code, and when the program code is run on an electronic device, the display method according to any one of claims 1 to 14 is executed.

Images