Display method, electronic device and computer storage medium

Abstract

The present application discloses a display method, an electronic device, and a computer storage medium. The method includes: displaying a first interface, the first interface including a first image in a first display mode; detecting that the state of a first user changes from a first state to a second state, the state of the first user including at least one of the following: the angle of the user's head relative to the electronic device, the position of the user's face relative to the electronic device, a gesture action, a facial expression, the position of the line of sight gazing at the display screen, an appearance feature; updating the display mode of the first image to a second display mode, the first display mode being related to the first state, and the second display mode being related to the second state. In the present application, the display mode of the image changes with the change of the user's state, which can enhance the user attraction of the display function and increase the usage time.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction technology, and in particular, to a display method, an electronic device, and a computer storage medium. Background Art

[0002] Currently, a terminal may have an always-on display (AOD) function. For example, after the terminal is locked, it displays content such as a background, time, fingerprint icon, and notification message. The background is usually a picture selected by the user or a picture preset by the system. Users often only view information such as time and notification messages through the AOD function, and exit the AOD function (such as switching to the screen-off state or the screen-on state) after obtaining this information. The usage time of the AOD function is short, and the user attraction is not high, resulting in low usability of the AOD function. Summary of the Invention

[0003] This application discloses a display method, an electronic device, and a computer storage medium, which can improve the user attraction of display functions such as the always-on display function, increase the usage time, and thus improve the usability of the display function.

[0004] In a first aspect, this application provides a display method applied to an electronic device. The electronic device includes a display screen, and the method includes: displaying a first interface, where the first interface includes a first image in a first display mode (for example, a wallpaper image); detecting that the state of a first user changes from a first state to a second state, where the state of the first user includes at least one of the following: the angle of the user's head relative to the electronic device, the position of the user's face relative to the electronic device, a gesture action, a facial expression, the position of the line of sight gazing at the display screen, and an appearance feature; updating the display mode of the first image to a second display mode (for example, a static display mode or a dynamic display mode), where the first display mode is related to the first state, and the second display mode is related to the second state.

[0005] In some examples, the first interface is an always-on display (AOD) interface, and the first image is the wallpaper image of the AOD interface. In other examples, the first interface is a lock screen interface, and the first image is the wallpaper image of the lock screen interface. In still other examples, the first interface is a desktop, and the first image is the wallpaper image of the desktop.

[0006] In the above method, the display mode of the first image in the first interface can change with the change of the state of the first user, and the states of the user are diverse. That is to say, the user can change their state multiple times and at will (which can be of different types) so that the first image displayed by the electronic device 100 changes, endowing the image display function (such as the wallpaper display function) with playability / new features, rather than just being used to display limited information such as time, thereby effectively enhancing the user attraction of the image display function, making the user motivated to spend more time using the image display function and improving the usability of the image display function.

[0007] In a possible implementation manner, the first image includes a first virtual object, and the first virtual object is a virtual character, a virtual animal, or a virtual object.

[0008] For example, the display mode of the first image includes the display mode of the first virtual object. The display mode of the first virtual object in the first image of the first display mode is related to the first state, and the display mode of the first virtual object in the first image of the second display mode is related to the second state.

[0009] For example, the first virtual object is an animated image.

[0010] In the above method, the first image includes a first virtual object, and the display mode of the first virtual object can change with the change of the state of the first user. Through the change of the first virtual object, the user can more intuitively feel the change of the first image, giving the user a sense of déjà vu that "the first virtual object is the virtual image of oneself and the virtual image of oneself changes when oneself changes", further enhancing the user attraction of the image display function, and thus further improving the usability of the image display function.

[0011] In a possible implementation manner, the first image includes at least one image content, the at least one image content includes the image content of the first virtual object, and the display mode of the first image includes at least one of the following: the position of the image content, the size of the image content, whether the image content is in a hidden state, the color of the image content, the shape of the image content, the brightness of the image content, the expression of the first virtual object, the gesture actions of the first virtual object, the appearance characteristics of the first virtual object.

[0012] In the above method, the display modes of the variable first image are diverse. For example, it is not limited to the position and size of the image content, and can also include content similar to the user state such as the expression of the first virtual object. Therefore, when the display mode of the first image changes, it can give the user a more rich, layered, and intuitive display effect, that is, provide a better display effect for the user, thereby improving the user experience.

[0013] In a possible implementation, the detection that the state of the first user changes from the first state to the second state includes: when the head of the first user rotates relative to the electronic device in a first direction, or the electronic device rotates relative to the first user in a second direction, detecting that the angle between the head of the first user and the electronic device changes from a first angle to a second angle, where the first direction and the second direction are opposite; the updating of the display mode of the first image to a second display mode includes: updating the first virtual object or a first part of the first virtual object from a first position to a second position, where the first position is related to the first angle, the second position is related to the second angle, and the second position is in the first direction of the first position.

[0014] In the above method, the first user can rotate the head in the first direction or control the electronic device to rotate in the second direction, so that the position of the first virtual object or the first part of the first virtual object changes in the first direction. The direction of rotation of the first user relative to the electronic device is the same as the changing direction of the first virtual object or the first part, and the changing effect is interesting and more intuitive, further enhancing the user experience.

[0015] In a possible implementation, the detection that the state of the first user changes from the first state to the second state includes: when the face of the first user translates relative to the electronic device in a third direction, or the electronic device translates relative to the first user in a fourth direction, detecting that the position of the face of the first user relative to the electronic device changes from a third position to a fourth position, where the third direction and the fourth direction are opposite, and the fourth position is in the third direction of the third position; the updating of the display mode of the first image to a second display mode includes: updating the first virtual object or a first part of the first virtual object from a fifth position to a sixth position, where the fifth position is related to the third position, the sixth position is related to the fourth position, and the sixth position is in the third direction of the fifth position.

[0016] In the above method, the first user can translate the face in the third direction or control the electronic device to translate in the fourth direction, so that the position of the first virtual object or the first part of the first virtual object changes in the third direction. The direction of translation of the first user relative to the electronic device is the same as the changing direction of the first virtual object or the first part, and the changing effect is interesting and more intuitive, further enhancing the user experience.

[0017] In a possible implementation, the detection that the state of the first user changes from the first state to the second state includes: detecting that the expression of the first user changes from the first expression to the second expression; the expression of the first virtual object in the first image in the first display mode is the first expression, and the expression of the first virtual object in the first image in the second display mode is the second expression.

[0018] In the above method, the expression of the first virtual object is consistent with the expression of the first user. When the expression of the first user changes, the expression of the first virtual object also changes correspondingly. The change effect is interesting and more intuitive, further improving the user experience.

[0019] In a possible implementation, the second state includes that the gesture action of the first user is the first gesture, the first virtual object in the first image in the first display mode is in a hidden state, and the first virtual object in the first image in the second display mode is in a displayed state; or, the first virtual object in the first image in the first display mode is in a displayed state, and the first virtual object in the first image in the second display mode is in a hidden state.

[0020] In some examples, the updating the display mode of the first image to the second display mode includes: changing the first virtual object from a hidden state to a displayed state, where the display content of the first virtual object gradually increases.

[0021] In some examples, the updating the display mode of the first image to the second display mode includes: changing the first virtual object from a displayed state to a hidden state, where the display content of the first virtual object gradually decreases.

[0022] In the above method, the user can perform the first gesture to control the first virtual object to "appear" or "disappear", giving the user a feeling of "the first virtual object comes and goes at will", further improving the playability of the image display function, thereby enhancing the user experience.

[0023] In a possible implementation, the detection that the state of the first user changes from the first state to the second state includes: detecting that the position where the first user's sight gazes at the display screen changes from the seventh position to the eighth position; the first virtual object in the first image in the first display mode is located at the seventh position, and the first virtual object in the first image in the second display mode is located at the eighth position.

[0024] In the above method, the display position of the first virtual object is the position where the first user's line of sight gazes at the display screen. The first user can control the display position of the first virtual object to change by changing the position where the line of sight gazes at the display screen, further enhancing the playability of the image display function, thereby enhancing the user experience.

[0025] In a possible implementation, the first state includes the ninth position where the first user's line of sight gazes at the display screen, the second state includes the tenth position where the first user's line of sight gazes at the display screen, the first virtual object in the first image is located at the tenth position, and the display states of the first virtual object in the first image in the first display mode and the first image in the second display mode are different. The display state includes at least one of the following: size, color, shape, brightness.

[0026] In the above method, the display state of the first virtual object is related to whether the first user gazes at the first virtual object. For example, the first virtual object is a light bulb. When the first user does not gaze at the first virtual object, the first virtual object is in an off state (i.e., the first virtual object is in an off state in the first image in the first display mode), and when the first user gazes at the first virtual object, the first virtual object is in a powered state (i.e., the first virtual object is in a lit state in the first image in the second display mode). The first user can control the display state of the first virtual object by changing the position where the line of sight gazes at the display screen, further enhancing the playability of the image display function, thereby enhancing the user experience.

[0027] In a possible implementation, the detection that the state of the first user changes from the first state to the second state includes: detecting that the position where the first user's line of sight gazes moves in the fifth direction; the update of the display mode of the first image to the second display mode includes: updating the first virtual object or the first part of the first virtual object from the eleventh position to the twelfth position, and the twelfth position is in the fifth direction of the eleventh position.

[0028] In the above method, the change direction of the position of the first virtual object or the first part is consistent with the change direction of the position where the first user's line of sight gazes. The first user can control the change direction of the position of the first virtual object or the first part by moving the position where the line of sight gazes, further enhancing the playability of the image display function, thereby enhancing the user experience.

[0029] In a possible implementation, the first state includes that the appearance feature of the first user is the first feature, the second state includes that the appearance feature of the first user is the second feature, the appearance feature of the first virtual object in the first image of the first display mode matches the first feature, and the appearance feature of the first virtual object in the first image of the second display mode matches the second feature. The appearance feature includes at least one of the following: clothing, accessories, hairstyle, and facial features.

[0030] In the above method, the appearance feature of the first virtual object is consistent with that of the first user. When the appearance feature of the first user changes, the appearance feature of the first virtual object also changes correspondingly. The change effect is interesting and more intuitive, further enhancing the user experience.

[0031] In a possible implementation, before displaying the first interface, the method further includes: displaying a first setting interface, where the first setting interface includes multiple images; and receiving a first operation on the first image among the multiple images.

[0032] In the above method, the first image can be selected by the user from multiple images. The user can select a favorite image as the image displayed on the first interface, and the first image meets the user's needs, further enhancing the user experience.

[0033] In a possible implementation, before displaying the first interface, the method further includes: sending a first request message to a network device, where the first request message includes information about a first account associated with the electronic device; receiving a second image sent by the network device, where the second image is an image of a second user of the first account; and obtaining the first image based on the second image. The first virtual object in the first image is a virtual character, and the first virtual object is obtained based on the second user in the second image.

[0034] For example, the first account is determined by the electronic device in response to a user operation, that is, the first account is selected by the user.

[0035] In the above method, the first image can be generated based on the image of the second user of the first account. For example, the first account is an account associated with the account of the first user (such as a family account). In this way, the first user can see and control the changing first virtual object, which is the virtual image of the second user related to the first user. This can not only meet the user's personalized needs but also be more interesting, further enhancing the user experience.

[0036] In a possible implementation, before displaying the first interface, the method further includes: receiving a third image uploaded by the first user; obtaining the first image according to the third image; where the third image is the same as the first image; or, the first virtual object in the first image is obtained according to the object in the third image.

[0037] In the above method, the first image can be generated according to the image uploaded by the first user. For example, the first virtual object corresponds to the object in the image uploaded by the first user, which can meet the personalized needs of the user and further improve the user experience.

[0038] In a possible implementation, before displaying the first interface, the method further includes: collecting a fourth image through the camera of the electronic device; obtaining the first image according to the fourth image, and the first virtual object in the first image is obtained according to the object in the fourth image.

[0039] In the above method, the first image can be generated according to the image collected by the electronic device in real time. For example, when different users use the electronic device, the electronic device can display different first virtual objects. For example, when the same user is in different states and uses the electronic device, the electronic device can display different first virtual objects. The displayed first virtual object is closely related to the user image collected by the electronic device in real time, giving the user a more interesting and intuitive display effect and further improving the user experience.

[0040] In a possible implementation, the second image is an image of the second user at a first time, and the external characteristics of the second user in the second image are third characteristics. The external characteristics of the first virtual object in the first image in the first display mode match the third characteristics. After displaying the first interface, the method further includes: sending a second request message to the network device; receiving a fifth image sent by the network device, where the fifth image is an image of the second user at a second time, and the second time is later than the first time. The external characteristics of the second user in the fifth image are fourth characteristics; updating the display mode of the first image to a third display mode, and the external characteristics of the first virtual object in the first image in the third display mode match the fourth characteristics.

[0041] For example, the first time and the second time are one day apart.

[0042] In the above method, after the electronic device displays the first interface, it can obtain the latest appearance features of the second user of the associated account (i.e., the first account) through the network device, and update the displayed first virtual object in a timely manner according to the obtained appearance features, so that the first virtual object displayed by the electronic device matches the latest appearance features of the second user, giving the user a more interesting and intuitive display effect and further improving the user experience.

[0043] In a possible implementation manner, updating the display manner of the first image to a second display manner includes: when the first image is an animation, switching the currently playing node of the first image from a first node to a second node; when the first image is a picture including multiple layers, adjusting the display manner of at least one layer in the first image.

[0044] In the above method, the changeable first image can be an animation or a picture, not limited to an animation. In this way, even if the first image is a picture, the display manner of the first image can be correspondingly changed, expanding the application scenario of the playable image display function provided by this application.

[0045] In a possible implementation manner, the method further includes: after displaying the first interface, when it is detected that the first user does not gaze at the display screen, controlling the display screen to turn off; when it is detected that the first user gazes at the display screen, displaying the first interface.

[0046] In the above method, when the first user does not gaze at the display screen, the first display screen can turn off, and when the first user gazes at the display screen, the first display screen displays the first interface again, avoiding unnecessary power consumption caused by still displaying the first interface when the first user does not gaze at the display screen, reducing the device power consumption, and improving the device usability.

[0047] In a possible implementation manner, the method further includes: after displaying the first interface, when it is detected that an object approaches the electronic device, controlling the display screen to turn off; when it is detected that the object leaves the electronic device, displaying the first interface.

[0048] In the above method, when the object approaches, the first display screen can turn off, and when the object leaves, the first display screen displays the first interface again, avoiding unnecessary power consumption caused by still displaying the first interface when the user does not watch the first interface when the object approaches, reducing the device power consumption, and improving the device usability.

[0049] In a possible implementation, the method further includes: displaying a second setting interface for previewing the first interface, where the second setting interface includes the first image in the first display manner; detecting that the state of the first user changes from the first state to the second state; and updating the display manner of the first image to the second display manner.

[0050] For example, the second setting interface is used to select or input a first image.

[0051] In the above method, when the user views the second setting interface of the first interface, the second setting interface can be used to preview the process in which the display manner of the first image changes as the user's state changes. This makes it more convenient for the user to select a favorite first image. The user does not need to select the first image and then go to the first interface to view the above process, reducing the time and effort spent by the user in selecting the first image and further improving the user experience.

[0052] In a possible implementation, the displaying the second setting interface includes: when displaying the first interface, receiving a second operation; and in response to the second operation, displaying the second setting interface.

[0053] In the above method, the first user can quickly call up the second setting interface of the first interface through the second operation when the electronic device displays the first interface, without having to switch the electronic device to the lit screen state and then perform a series of operations to call up the second setting interface, reducing user operations and further improving the user experience.

[0054] In a possible implementation, the method further includes: after a first duration has elapsed since the first interface is displayed, displaying a second interface, where the second interface includes a sixth image that is different from the first image.

[0055] In the above method, the electronic device can switch the displayed image (such as a wallpaper image) every first duration, allowing the user to experience more variable images and providing the user with a more diverse display effect, further improving the user experience.

[0056] In a second aspect, the present application provides an electronic device, including a transceiver, a processor, and a memory; the memory is used to store a computer program, and the processor calls the computer program to execute the display method provided in the first aspect of the present application and any implementation manner of the first aspect.

[0057] In a third aspect, the present application provides a computer storage medium that stores a computer program, and when the computer program is executed by a processor, it implements the display method provided in the first aspect of the present application and any implementation manner of the first aspect.

[0058] Fourthly, the present application provides a computer program product. When the computer program product runs on an electronic device, the electronic device is caused to execute the display method provided in the first aspect of the present application and any implementation manner of the first aspect.

[0059] Fifthly, the present application provides an electronic device, which includes a method or device introduced in any aspect or implementation manner of the present application. The above-mentioned electronic device is, for example, a chip.

[0060] It should be understood that the description of technical features, technical solutions, beneficial effects or similar languages in the present application does not imply that all features and advantages can be achieved in any single implementation manner. On the contrary, it can be understood that the description of features or beneficial effects means that at least one implementation manner includes specific technical features, technical solutions or beneficial effects. Therefore, the description of technical features, technical solutions or beneficial effects in the present application does not necessarily refer to the same implementation manner. Furthermore, the technical features, technical solutions and beneficial effects described in the present application can be combined in any appropriate manner. Those skilled in the art will understand that the present application can be implemented without one or more specific technical features, technical solutions or beneficial effects of a specific implementation manner. In other implementation manners, additional technical features and beneficial effects can also be identified in specific implementation manners that do not embody all implementation manners. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] The following introduces the drawings used in the present application.

[0062] Figure 1 is a schematic diagram of the hardware structure of an electronic device provided by the present application;

[0063] Figure 2 is a schematic diagram of the software architecture of an electronic device provided by the present application;

[0064] Figures 3A - 3E is a schematic diagram of some always-on display (AOD) interfaces provided by the present application;

[0065] Figures 4A - 4E is a schematic diagram of some other AOD interfaces provided by the present application;

[0066] Figures 5A - 5E is a schematic diagram of some other AOD interfaces provided by the present application;

[0067] Figure 6 and Figure 7 and Figure 8A and Figure 8B is a schematic diagram of some other AOD interfaces provided by the present application;

[0068] Figures 9A - 9DSchematic diagrams of some other AOD interfaces provided by this application;

[0069] Figures 10A - 10C Schematic diagrams of some setting interfaces provided by this application;

[0070] Figure 11A 、 Figure 11B Schematic diagrams of some other setting interfaces provided by this application;

[0071] Figure 12A Schematic diagram of another type of setting interface provided by this application;

[0072] Figure 12B Schematic diagram of another type of AOD interface provided by this application;

[0073] Figure 13A 、 Figure 13B Schematic diagrams of some other setting interfaces provided by this application;

[0074] Figure 14 Schematic diagram of another type of setting interface provided by this application;

[0075] Figure 15A 、 Figure 15B Schematic diagrams of some other AOD interfaces provided by this application;

[0076] Figure 16 Schematic diagram of another type of setting interface provided by this application;

[0077] Figure 17 Schematic diagram of the process of a display method provided by this application;

[0078] Figure 18A 、 Figure 18B Schematic diagram of the relationship between the changes in some user states and the display mode of the screen-off image provided by this application;

[0079] Figure 19A Schematic diagram of a lock screen interface provided by this application;

[0080] Figure 19B Schematic diagram of a desktop provided by this application. Detailed implementation manners

[0081] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings. Among them, in the description of the embodiments of the present application, unless otherwise specified, " / " means "or". For example, A / B can mean A or B. The "and / or" in the text is only a description of the association relationship between associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present application, "a plurality of" means two or more than two.

[0082] Hereinafter, the terms "first" and "second" are only used for descriptive purposes and cannot be construed as implying or suggesting relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include one or more of such features. In the description of the embodiments of the present application, unless otherwise specified, the meaning of "a plurality of" is two or more.

[0083] The present application provides a display method applied to an electronic device. The image (such as a wallpaper image) displayed by the electronic device can change with the change of the user's state. Among them, the image can be an image displayed in the always-on display (AOD) state (which can be simply referred to as an always-on image), or an image displayed in the locked screen state, or an image displayed on the desktop. For example, in the AOD state, when the user's face rotates / moves, the always-on image also rotates / moves accordingly. This can increase the playability of the displayed images such as the always-on image, enhance the user attraction of the display functions such as the AOD function, thereby increasing the usage time of the display functions such as the AOD function and enhancing the usability of the display functions such as the AOD function. For the convenience of description, the following embodiments mainly take the AOD scenario (the always-on image displayed by the electronic device changes with the change of the user's state) as an example for description. The locked screen scenario and the desktop scenario are similar.

[0084] Among them, the display screen of the electronic device (which can also be understood as the electronic device) can include a screen-off state (which can also be called a black screen state), an AOD state, and a screen-on state. In the screen-off state, the display screen is not lit. In the AOD state, the electronic device can light up some or all areas of the display screen to display limited information, such as background, time, fingerprint icon, and notification messages, etc. The background is, for example, the above-mentioned screen-off image. In the screen-on state, the electronic device can light up the entire area of the display screen to display interfaces such as the desktop and the user interface of the application program. In one implementation, in the AOD state, the electronic device can be locked, and only some functions can be used, such as viewing the above-mentioned limited information, camera, flashlight, etc. The user can use information such as password, face, fingerprint, etc. to authenticate the locked electronic device. After successful authentication, the electronic device can be unlocked, and all functions of the electronic device can be used after unlocking. In one implementation, in the screen-on state, the electronic device is not locked.

[0085] The electronic device can switch between any two of the screen-off state, the AOD state, and the screen-on state. In some examples, the electronic device can switch from the screen-off state to the AOD state when receiving a user operation (such as a touch operation on the display screen). In other examples, the electronic device can switch from the screen-off state to the AOD state when detecting that the user is gazing at the display screen, which can also be called eyes on display (EOD).

[0086] The above-mentioned screen-off image is a changeable image. In one implementation, the screen-off image is a picture including multiple layers, and the screen-off image can be changed by adjusting at least one of these multiple layers. In another implementation, the screen-off image is an animation, and the animation can include multiple picture frames. The screen-off image can be changed by adjusting the currently displayed picture frame (such as switching from the first frame to the last frame). The animation includes, for example, but is not limited to, formats such as graphics interchange format (GIF) and audio video interleaved (AVI).

[0087] The above-mentioned user state can include, but is not limited to, the angle of the user's head (relative to the electronic device, and all subsequent angles of the user's head are relative to the electronic device), the position of the user's face (relative to the electronic device, and all subsequent positions of the user's face are relative to the electronic device), the user's expression, the user's operations (such as touch operations, gesture movements), the user's line of sight, appearance features (such as clothing, accessories, facial features, hairstyle), etc.

[0088] Exemplarily, the above-mentioned rotation can be rotation around a preset central axis. Exemplarily, the above-mentioned movement can be translation.

[0089] In this application, the electronic device may be, but is not limited to, a mobile phone, a tablet computer, a handheld computer, a desktop computer, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), as well as smart home devices such as a smart TV and a smart camera, wearable devices such as a smart bracelet, a smart watch, and smart glasses, extended reality (XR) devices such as augmented reality (AR), virtual reality (VR), and mixed reality (MR), in-vehicle devices or smart city devices. The specific type of the electronic device is not particularly limited in the embodiments of this application.

[0090] Next, the structure of the exemplary electronic device provided in the embodiments of this application will be introduced.

[0091] Figure 1 An exemplary schematic diagram of the hardware structure of an electronic device 100 is shown.

[0092] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, an attitude sensor 180M, etc.

[0093] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figures, or combine certain components, or split certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0094] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0095] The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.

[0096] A memory may also be provided in the processor 110 for storing instructions and data. In one implementation, the memory in the processor 110 is a cache memory. This memory can store the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0097] The charging management module 140 is used to receive charging input from a charger. The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives the inputs from the battery 142 and / or the charging management module 140 and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160, etc. The power management module 141 can also be used to monitor parameters such as the battery capacity, the number of battery charge cycles, and the battery health status (leakage, impedance). In another implementation, the power management module 141 may also be provided in the processor 110. In another implementation, the power management module 141 and the charging management module 140 may also be provided in the same device.

[0098] The wireless communication function of the electronic device 100 can be implemented through Antenna 1, Antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor, etc. In one implementation, the electronic device 100 can be connected and communicate with other electronic devices through the wireless communication function, and display the Smart Ring on the display screen of other electronic devices. In some examples, the other electronic device can be a wearable device, such as but not limited to including a smart bracelet, a smart watch, smart glasses, etc. Displaying the Smart Ring through the wearable device can allow users to obtain the event progress more conveniently and further improve the efficiency of users to obtain information.

[0099] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, Antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In another implementation, the antenna can be used in combination with a tuning switch.

[0100] The mobile communication module 150 can provide solutions for wireless communication including second generation (2G) / third generation (3G) / fourth-generation (4G) / fifth generation (5G) / six generation (6G) and other wireless communication technologies applied to the electronic device 100. The mobile communication module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from Antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves through Antenna 1 and radiate it out. In one implementation, at least some functional modules of the mobile communication module 150 can be provided in the processor 110. In one implementation, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 can be provided in the same device.

[0101] The modulation and demodulation processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194. In one implementation, the modulation and demodulation processor may be an independent device. In another implementation, the modulation and demodulation processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.

[0102] The wireless communication module 160 may provide solutions for wireless communications applied to the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSSs), frequency modulation (FM), near field communication (NFC), infrared technology (IR), and so on. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive the signals to be transmitted from the processor 110, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 2 for radiation.

[0103] In one embodiment, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technologies. The wireless communication technologies may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), Beidou Navigation Satellite System (BDS), Quasi-Zenith Satellite System (QZSS), and / or Satellite Based Augmentation Systems (SBAS).

[0104] The electronic device 100 implements the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change the display information.

[0105] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In one embodiment, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0106] The electronic device 100 can implement the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc.

[0107] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light passes through the lens and is transmitted to the camera photosensitive element. The optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, etc. of the image. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In one embodiment, the ISP can be set in the camera 193.

[0108] The camera 193 is used to capture static images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in standard RGB, YUV, etc. formats. In one embodiment, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0109] In one embodiment, the camera 193 may include a front camera and a rear camera. The front camera may be located on the side where the display screen 194 is located, for example, at the top or bottom of the display screen 194, and the rear camera may be located on the back of the display screen 194.

[0110] In one embodiment, the front camera may be used to collect the user's face image in real time. The face image collected in real time may be sent to the processor 110. The processor 110 may determine whether the user's state has changed according to the user's face image. For example, whether the angle of the user's head has changed, whether the user's face has shifted, whether the user's expression has changed, whether a gesture action has been performed, whether the gaze position has changed, whether the appearance features have changed, etc. When the user's state changes, the processor 110 may instruct the display screen 194 to correspondingly adjust the displayed screen-off image. For example, when the angle of the user's head changes, the screen-off image also rotates correspondingly.

[0111] The external memory interface 120 may be used to connect to an external memory card, such as a Micro SD card, to implement the storage capacity expansion of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, files such as music and videos are saved in the external memory card.

[0112] The internal memory 121 may be used to store computer-executable program codes, and the executable program codes include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, application programs required for at least one function (such as a sound playback function, an image playback function, etc.). The data storage area may store data created during the use of the electronic device 100 (such as audio data, phone book, etc.). In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121 and / or the instructions stored in the memory provided in the processor.

[0113] The electronic device 100 can implement audio functions through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor, etc. For example, music playback, recording, etc. The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used for encoding and decoding audio signals. In one implementation, the audio module 170 can be disposed in the processor 110, or some functional modules of the audio module 170 can be disposed in the processor 110. The speaker 170A, also known as the "loudspeaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or hands-free calls through the speaker 170A. The receiver 170B, also known as the "earpiece", is used to convert an audio electrical signal into a sound signal. When the electronic device 100 answers a call or a voice message, the receiver 170B can be placed close to the human ear to receive the voice. The microphone 170C, also known as the "microphone", "transmitter", is used to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak close to the microphone 170C with their mouth to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In another implementation, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also implement a noise reduction function. In another implementation, the electronic device 100 can also be provided with three, four or more microphones 170C to implement sound signal collection, noise reduction, and can also identify the sound source to implement functions such as directional recording. The headphone jack 170D is used to connect a wired headphone.

[0114] The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In one implementation, the pressure sensor 180A can be disposed on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can include at least two parallel plates with conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In one implementation, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, the instruction to view short messages is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.

[0115] The touch sensor 180K, also known as the "touch control device". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also known as the "touch control screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In another implementation, the touch sensor 180K can also be disposed on the surface of the electronic device 100, in a different position from the display screen 194.

[0116] In one implementation, the pressure sensor 180A and / or the touch sensor 180K can be disposed in the display screen 194 for detecting touch operations on the display screen 194. When the pressure sensor 180A and / or the touch sensor 180K detect a touch operation on the display screen 194 (such as a swipe operation), they can report the information of the touch operation to the processor 110, and the processor 110 can, according to the information of the touch operation (such as the operation type, the direction of the swipe, the amplitude of the swipe, etc.), instruct the display screen 194 to correspondingly adjust the displayed lock screen image. For example, when the touch operation is a swipe operation, the lock screen image also rotates / moves correspondingly.

[0117] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In one implementation, the angular velocity of the electronic device 100 around three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can also be used for anti-shake shooting, navigation, motion-sensing game scenarios, etc. Optionally, the gyroscope sensor 180B can be disposed on the circuit board of the electronic device 100.

[0118] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device. Without limitation, it can also be applied to applications such as horizontal and vertical screen switching, pedometer, etc. Optionally, the acceleration sensor 180E can be disposed on the circuit board of the electronic device 100.

[0119] In one implementation, the gyroscope sensor 180B and / or the acceleration sensor 180E can be used to detect whether the electronic device 100 moves, so as to be used by the processor 110 to determine whether the relative position between the electronic device 100 and the user changes. For example, whether the angle of the user's head relative to the electronic device 100 changes (which can also be referred to as whether the angle of the electronic device 100 relative to the user changes), and whether the user's face is displaced relative to the electronic device 100 (which can also be referred to as whether there is a displacement relative to the user by the electronic device 100). When the relative position between the electronic device 100 and the user changes, the processor 110 can instruct the display screen 194 to correspondingly adjust the displayed screen-off image.

[0120] The barometric pressure sensor 180C is used to measure barometric pressure. The magnetic sensor 180D includes a Hall sensor, and the electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. The distance sensor 180F is used to measure distance. The fingerprint sensor 180H is used to collect fingerprints. The temperature sensor 180J is used to detect temperature. The ambient light sensor 180L is used to sense the ambient light brightness.

[0121] The proximity light sensor 180G can include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The electronic device 100 emits infrared light outward through the light-emitting diode. The electronic device 100 uses the photodiode to detect the infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100.

[0122] The attitude sensor 180M can be used to detect the user state, such as but not limited to including the angle of the user's head, the position of the user's face, the user's expression, gesture actions, the user's line of sight, etc. The detected user state can be used by the processor 110 to instruct the display screen 194 to adjust the displayed screen-off image.

[0123] This application does not limit the specific type of the sensor used to detect the user state.

[0124] The button 190 includes a power-on button, volume buttons, etc. The button 190 can be a mechanical button or a touch button. The electronic device 100 can receive button inputs and generate key signal inputs related to the user settings and function control of the electronic device 100. The motor 191 can generate vibration prompts. The indicator 192 can be an indicator light, which can be used to indicate the charging state, power change, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card.

[0125] The software system of the electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservices architecture, or cloud architecture. For example, the software system with a layered architecture can be the Android system, or the Harmony operating system (OS), or other software systems. In this embodiment of the application, the Android system with a layered architecture is taken as an example to illustrate the software structure of the electronic device 100.

[0126] Figure 2 Exemplarily shown is a schematic diagram of the software architecture of an electronic device 100.

[0127] The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In one implementation, the Android system is divided into four layers, from top to bottom are the application layer, application framework layer, Android runtime and system libraries, and kernel layer.

[0128] The application layer can include a series of application packages.

[0129] As Figure 2 shown, the application packages can include applications such as camera, calendar, map, WLAN, music, short message, gallery, call, navigation, Bluetooth, video, screen-off display, etc. The screen-off display in this application can be an independent application or a functional component integrated in other applications. This application does not limit this. The applications in this application can also be replaced by other software such as applets and atomic services.

[0130] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions.

[0131] As Figure 2 shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc.

[0132] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0133] The content provider is used to store and obtain data, and make this data accessible to applications. The data may include videos, images, audio, dialed and answered calls, browsing history and bookmarks, phone books, etc.

[0134] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.

[0135] The phone manager is used to provide the communication function of the electronic device 100. For example, the management of call status (including connection, disconnection, etc.).

[0136] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0137] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform that the download is completed, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or a scroll bar text, such as a notification of a background-running application, and can also be a notification that appears on the screen in the form of a dialogue window. For example, prompting text information in the status bar, emitting a prompt tone, the electronic device 100 vibrating, the indicator light flashing, etc.

[0138] Android runtime includes a core library and a virtual machine. Android runtime is responsible for the scheduling and management of the Android system.

[0139] The core library contains two parts: one part is the functional functions that need to be called by the Java language, and the other part is the core library of Android.

[0140] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to manage the object life cycle, stack management, thread management, security and exception management, and garbage collection and other functions.

[0141] The system library can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing library (e.g., OpenGL ES), 2D graphics engine (e.g., SGL), etc.

[0142] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

[0143] The media library supports the playback and recording of various common audio and video formats, as well as static image files, etc. The media library can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0144] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.

[0145] The 2D graphics engine is a drawing engine for 2D drawing.

[0146] The kernel layer is the layer between hardware and software. The kernel layer contains at least a display driver, a camera driver, an audio driver, and a sensor driver.

[0147] Next, in combination with the scenario of the always-on display, the working processes of the software and hardware of the electronic device 100 will be exemplarily described.

[0148] The display screen 194 of the electronic device 100 is in the off-screen state. When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including information such as touch coordinates and the time stamp of the touch operation). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch click operation as an example, the always-on display application calls the interface of the application framework layer to start the always-on display, and then starts the display driver by calling the kernel layer to control the display screen 194 to switch from the off-screen state to the AOD state, and displays the always-on image through the display screen 194.

[0149] Next, the application scenarios involved in the embodiments of the present application and the schematic diagram of the user interface in this scenario will be introduced.

[0150] Scenario 1: The electronic device 100 is in the AOD state. When it detects that the user's head rotates (i.e., the angle of the user's head changes), the off-screen image displayed by the electronic device 100 can change correspondingly (e.g., rotate). For specific examples, please refer to the following Figures 3A - 3E .

[0151] Figure 3A An exemplary schematic diagram of an AOD interface is shown.

[0152] As Figure 3A shown, when the electronic device 100 is in the off-screen state, if it detects that the user 200 is looking at the display screen (for example, all the images captured by the front camera within a preset time are Image 1), it can display the user interface 310. The user interface 310 can be an AOD interface. The user interface 310 can include an off-screen image 311 and a prompt message 312. The off-screen image 311 can include eyes and a mouth. The line of sight of the eyes in the off-screen image 311 can change, and the position and arc of the mouth in the off-screen image can change. The prompt message 312 includes information such as time, date, and battery level, for example. The electronic device 100 can obtain the angle of the user 200's head based on the image 1 of the user 200 captured by the front camera, and determine that the user 200's head is in the centered position and not rotating according to the obtained angle. At this time, the off-screen image 311 displayed by the electronic device 100 can remain unchanged.

[0153] In this application, the angle of the user 200's head can be the actual angle obtained based on the relative position between the user's face and the user's shoulders. However, it is not limited to this. In some other examples, it can also be the difference between the current actual angle and the initial angle (i.e., the actual angle obtained based on the Figure 3A shown Image 1). This application does not make any limitations in this regard.

[0154] Figure 3B An exemplary schematic diagram of another AOD interface is shown.

[0155] As Figure 3B shown, the electronic device 100 can obtain the angle of the user 200's head based on the image 2 of the user 200 captured by the front camera, and determine that the user 200's head rotates to the left (with the user 200 as a reference). At this time, the electronic device 100 can display the user interface 320. The user interface 320 is similar to the Figure 3A shown user interface 310. The difference is that in the user interface 320, the line of sight of the eyes in the off-screen image 311 is to the left (with the user 200 as a reference. If the electronic device 100 is used as a reference, it is to the right), and the position of the mouth in the off-screen image 311 can move to the left (moving to the left is with the user 200 as a reference. If the electronic device 100 is used as a reference, it is to the right), corresponding to the user 200's head rotating to the left.

[0156] Figure 3C Schematic diagram exemplarily showing another AOD interface.

[0157] As Figure 3C shown, the electronic device 100 can obtain the angle of the user 200's head based on the image 3 of the user 200 captured by the front camera, and determine that the user 200's head turns to the right (with the user 200 as a reference) according to this angle. At this time, the electronic device 100 can display the user interface 330. The user interface 330 is similar to the Figure 3A shown user interface 310. The difference is that in the user interface 330, the line of sight of the eyes in the off-screen image 311 is to the right (with the user 200 as a reference), and the position of the mouth in the off-screen image 311 can move to the right (with the user 200 as a reference), corresponding to the user 200's head turning to the right.

[0158] Figure 3D Schematic diagram exemplarily showing another AOD interface.

[0159] As Figure 3D shown, the electronic device 100 can obtain the angle of the user 200's head based on the image 4 of the user 200 captured by the front camera, and determine that the user 200's head is lifted upward according to this angle. At this time, the electronic device 100 can display the user interface 340. The user interface 340 is similar to the Figure 3A shown user interface 310. The difference is that in the user interface 340, the line of sight of the eyes in the off-screen image 311 is upward, and the position of the mouth in the off-screen image 311 can move upward, corresponding to the user 200's head being lifted upward.

[0160] Figure 3E Schematic diagram exemplarily showing another AOD interface.

[0161] As Figure 3E shown, the electronic device 100 can obtain the angle of the user 200's head based on the image 5 of the user 200 captured by the front camera, and determine that the user 200 bows downward according to this angle. At this time, the electronic device 100 can display the user interface 350. The user interface 350 is similar to the Figure 3A shown user interface 310. The difference is that in the user interface 350, the line of sight of the eyes in the off-screen image 311 is downward, and the position of the mouth in the off-screen image 311 can move downward, corresponding to the user 200 bowing downward.

[0162] Not limited to Figures 3A - 3E the off-screen image 311 shown. In some other examples, it can also be other off-screen images, such as Figures 4A - 4E the off-screen image 411 shown, Figure 5A the off-screen image 512 shown,Figure 8A The off-screen image 811 shown, the lower Figure 9A The off-screen image in the user interface 910 shown, the lower Figure 9C The off-screen image 931 shown, the lower Figure 9D The off-screen image 941 shown, the lower Figure 12B The off-screen image 1221 shown. The present application does not limit the specific content of the off-screen image.

[0163] Figures 3A - 3E Taking the movement of the off-screen image as an example for illustration. In some other examples, the off-screen image can also rotate around a preset central axis. For example, when the off-screen image is a 2D image, it can move, and when the off-screen image is a 3D image, it can rotate. Examples of rotation can be seen below Figures 4A - 4E The present application does not limit the change mode of the off-screen image.

[0164] Scenario 2: When the electronic device 100 is in the AOD state, when it detects the movement of the position of the user's face, the off-screen image displayed by the electronic device 100 can change correspondingly (such as moving). Specific examples can be seen below Figures 4A - 4E .

[0165] Figure 4A Exemplarily shows a schematic diagram of another AOD interface.

[0166] Such as Figure 4A As shown, when the electronic device 100 is in the screen-off state, if it detects that the user 200 is gazing at the display screen (for example, all the images captured by the front camera within a preset time period are Image 6), it can display the user interface 410. The user interface 410 can be an AOD interface. The user interface 410 can include an off-screen image 411 and a prompt message 412. The off-screen image 411 can include a background 411A and a cartoon character of an astronaut 411B (which can be simply referred to as the astronaut 411B). The size of the background 411A in the off-screen image 411 can change, and the display ratio of the astronaut 411B in the off-screen image 411 can change. Specific examples can be seen below Figure 6 and Figure 7, which will not be elaborated here for the time being. The display angle of the astronaut 411B in the off-screen image 411 can change (which can be understood as being rotatable), and the prompt information 412 includes, for example, information such as time, date, and battery level. The electronic device 100 can obtain the position 1 of the user 200's face based on the image 6 of the user 200 captured by the front camera. Among them, the position 1 can include the longitudinal position 1-1 (for example, the longitudinal position where the midpoint of the two eyes of the user 200 is located) and the transverse position 1-2 (for example, the transverse position where the tip of the user 200's nose is located). The image 6 can be captured when the electronic device 100 detects that the user 200 is looking at the display screen. Therefore, the position 1 corresponding to the image 6 can be considered as the initial position of the user 200's face. Subsequently, the electronic device 100 can continue to capture the face image of the user 200 through the front camera and obtain the position of the user 200's face based on the captured image. For example, if the face position obtained based on the re-captured image is still the initial position (i.e., position 1), that is, the position of the user 200's face remains unchanged (which can also be understood as the displacement of the user 200's face in the transverse direction and the longitudinal direction is 0 compared to the initial position), at this time, the off-screen image 411 displayed by the electronic device 100 can remain unchanged.

[0167] Figure 4B Exemplarily shows a schematic diagram of another AOD interface.

[0168] As Figure 4B shown, the electronic device 100 can obtain the position 2 of the user 200's face based on the image 7 of the user 200 captured by the front camera. Among them, the longitudinal position 2-1 of the position 2 is on the right side of the longitudinal position 1-1 of the initial position (i.e., position 1) (taking the image 7 as a reference). The electronic device 100 can determine that the user 200's face moves to the left compared to the initial position based on the relationship between the position 1 and the position 2 (taking the user 200 as a reference). At this time, the electronic device 100 can display the user interface 420, and the user interface 420 is similar to the Figure 4A shown user interface 410. The difference is that the astronaut 411B in the off-screen image 411 shown in the user interface 420 rotates to the left (rotating to the left is taking the user 200 as a reference. If taking the electronic device 100 as a reference, it rotates to the right), corresponding to the left movement of the user 200's face.

[0169] Figure 4C Exemplarily shows a schematic diagram of another AOD interface.

[0170] As Figure 4CAs shown, the electronic device 100 can obtain the position 3 of the face of the user 200 based on the image 8 of the user 200 captured by the front camera. Among them, the vertical position 3-1 of the position 3 is on the left side of the vertical position 1-1 of the initial position (i.e., position 1) (referring to the image 8). The electronic device 100 can determine that the face of the user 200 has moved to the right compared to the initial position based on the relationship between position 1 and position 3 (referring to the user 200). At this time, the electronic device 100 can display the user interface 430. The user interface 430 is similar to the Figure 4A shown user interface 410, except that the astronaut 411B in the off-screen image 411 shown in the user interface 430 rotates to the right (referring to the user 200), corresponding to the rightward movement of the face of the user 200.

[0171] Figure 4D An exemplary schematic diagram of another AOD interface is shown.

[0172] As Figure 4D shown, the electronic device 100 can obtain the position 4 of the face of the user 200 based on the image 8 of the user 200 captured by the front camera. Among them, the horizontal position 4-2 of the position 4 is above the horizontal position 1-2 of the initial position (i.e., position 1). The electronic device 100 can determine that the face of the user 200 has moved upward compared to the initial position based on the relationship between position 1 and position 4. At this time, the electronic device 100 can display the user interface 440. The user interface 440 is similar to the Figure 4A shown user interface 410, except that the astronaut 411B in the off-screen image 411 shown in the user interface 440 rotates upward, corresponding to the upward movement of the face of the user 200.

[0173] Figure 4E An exemplary schematic diagram of another AOD interface is shown.

[0174] As Figure 4E shown, the electronic device 100 can obtain the position 5 of the face of the user 200 based on the image 9 of the user 200 captured by the front camera. Among them, the horizontal position 5-2 of the position 5 is below the horizontal position 1-2 of the initial position (i.e., position 1). The electronic device 100 can determine that the face of the user 200 has moved downward compared to the initial position based on the relationship between position 1 and position 5. At this time, the electronic device 100 can display the user interface 450. The user interface 450 is similar to the Figure 4A shown user interface 410, except that the astronaut 411B in the off-screen image 411 shown in the user interface 450 rotates downward, corresponding to the downward movement of the face of the user 200.

[0175] Scenario 2 is illustrated by taking the change in the position of the user's face as an example where the user's face moves on the current plane (the distance between the user's face and the electronic device remains unchanged). In another implementation, the change in the position of the user's face can also be a change in the distance between the user's face and the electronic device. In some examples, when the electronic device 100 detects that the user's face is closer to the electronic device 100, it can control the off-screen image to become larger. When the electronic device 100 detects that the user's face is farther from the electronic device, it can control the off-screen image to become smaller. For example, after the off-screen image becomes larger, the off-screen image displayed on the display screen can include partial or all content. For example, the electronic device 100 can detect whether the distance between the user's face and the electronic device 100 changes according to the size of the user's face in the image captured by the front camera.

[0176] Scenario 3: The electronic device 100 is in the AOD state. When the electronic device 100 moves but the user's face remains stationary (which can also be understood as a change in the relative angle and / or position between the user's face and the electronic device 100), the off-screen image displayed by the electronic device 100 can change accordingly.

[0177] In one implementation, the angle of the user's head and the position of the user's face can remain unchanged, and the user can operate the electronic device 100 to rotate relative to the user's face. For example, in Figure 3A the illustrated implementation, the electronic device 100 can obtain the angle of the electronic device 100 relative to the user 200 based on the captured Image 1, and this angle can be understood as the initial angle. Then, the user 200 can remain stationary, and the electronic device 100 can rotate to the right relative to the user 200 (rotating to the right is with reference to the user 200, and with reference to the electronic device 100, it is rotating to the left). In this case, the electronic device 100 can capture Figure 3B the illustrated Image 2 through the front camera, determine that the angle of the electronic device 100 relative to the user 200 has changed compared to the initial angle based on Image 2, and determine that the electronic device 100 rotates to the right relative to the user 200 (with reference to the user 200) according to the change in this angle. At this time, the electronic device 100 can display Figure 3B the illustrated user interface 320, and the off-screen image 311 in the user interface 320 rotates to the left.

[0178] In another implementation, the angle of the user's head and the position of the user's face can remain unchanged, and the user can operate the electronic device 100 to translate relative to the user's face. For example, in Figure 4AIn the illustrated embodiment, the electronic device 100 can obtain the position of the electronic device 100 relative to the user 200 based on the image 6, and this position can be understood as the initial position. Then, the user 200 can remain stationary, and the electronic device 100 can translate to the right relative to the user 200 (translating to the right is with reference to the user 200, and with reference to the electronic device 100 it is translating to the left). In this case, the electronic device 100 can capture through the front camera and obtain Figure 4B the image 7 as shown. According to the image 7, it is determined that the electronic device 100 translates to the right relative to the user 200 compared to the initial position (with reference to the user 200). At this time, the electronic device 100 can display Figure 4B the user interface 420 as shown, and the off-screen image 411 in the user interface 420 rotates to the left.

[0179] The scenarios in the above examples are illustrated with the rotation directions of the user 200 / electronic device 100 and the movement modes of the user 200 / electronic device 100 including up, down, left, and right. In other examples, it can also be upper left, lower left, upper right, or lower right. Correspondingly, the change direction of the off-screen image can also be upper left, lower left, upper right, or lower right. This application does not make any limitations in this regard.

[0180] Scenario 4: The electronic device 100 is in the AOD state. When the electronic device 100 detects a change in the user's expression, the off-screen image displayed by the electronic device 100 can change correspondingly.

[0181] In one embodiment, the electronic device 100 can control changes such as rotation and movement of the off-screen image according to the change situation of the user's expression. Specific examples can be seen below Figure 5A .

[0182] Figure 5A An exemplary schematic diagram of another AOD interface is shown.

[0183] As Figure 5A shown, the electronic device 100 detects that the user 200 is gazing at the display screen (for example, all the images captured by the front camera within a preset time period are Figure 3AAs shown in the image 1), the user interface 510 can be displayed. The user interface 510 can be an AOD interface. The user interface 510 can include the time 511 and the always-on display (AOD) image 512, and the content of the AOD image 512 can change. The electronic device 100 can capture an image 10 of the user 200 using the front camera, and based on the image 10, obtain that the expression of the user 200 is squinting the right eye (which can also be understood as a change in the expression compared to the expression shown in image 1 is squinting the right eye). The electronic device 100 can control the AOD image 512 to rotate to the right according to the current expression (i.e., squinting the right eye) / expression change situation, and switch the content of the AOD image 512 from "just love me" shown in the user interface 510 to other content (such as the current date "Monday May 01"). It can also be understood that the content "just love me" switches from the display state to the hidden state, and the above other content switches from the hidden state to the display state.

[0184] In one embodiment, the electronic device 100 can control the expression shown in the AOD image according to the user's expression. The expression shown in the AOD image can change with the change of the user's expression, and the expression shown in the AOD image and the user's expression can be kept consistent. For a specific example, please refer to the following Figures 5B - 5E .

[0185] Figure 5B Exemplarily shows a schematic diagram of another AOD interface.

[0186] As Figure 5B shown, when the electronic device 100 is in the AOD state, it can obtain the user's expression based on the image 11 of the user captured by the front camera, and display the user interface 520 according to the expression. The user interface 520 is similar to the Figure 3A shown user interface 310. Since the user shown in the image 11 has a blank expression (open eyes and a straight mouth arc), therefore, the expression shown in the AOD image 311 in the user interface 520 is open eyes and a straight mouth arc.

[0187] Figure 5C Exemplarily shows a schematic diagram of another AOD interface. Figure 5C And Figure 5B similar, the difference is that Figure 5C in, the image of the user captured by the front camera of the electronic device 100 is image 12. Since the user's expression shown in the image 12 is a smile, therefore, in the user interface 530 displayed by the electronic device 100 according to the image 12, the expression shown in the AOD image 311 is open eyes and a mouth arc bent upward.

[0188] Figure 5D Exemplarily shows a schematic diagram of another AOD interface. Figure 5D And Figure 5B similar, the difference is thatFigure 5D In this case, the image of the user captured by the front camera of the electronic device 100 is Image 13. Since the user expression shown in Image 13 is with eyes closed and a straight mouth arc, in the user interface 540 displayed by the electronic device 100 based on Image 13, the expression shown in the always-on display (AOD) image 311 is with eyes closed and a straight mouth arc.

[0189] Figure 5E An exemplary schematic diagram of another AOD interface is shown. Figure 5E and Figure 5B Similarly, the difference is that Figure 5E In this case, the image of the user captured by the front camera of the electronic device 100 is Image 14. Since the user expression shown in Image 14 is angry (the outer corners and tails of the eyes and eyebrows are upward, the inner corners and heads of the eyes and eyebrows are downward, and the mouth arc is downward), in the user interface 550 displayed by the electronic device 100 based on Image 14, the expression shown in the AOD image 311 is with the outer corners of the eyes upward, the inner corners of the eyes downward, and the mouth downward.

[0190] Scenario 5: The electronic device 100 is in the AOD state. The electronic device 100 can control the displayed AOD image according to user operations. In one case, when the electronic device 100 detects that the user performs a preset gesture action, the AOD image displayed by the electronic device 100 can change correspondingly. For specific examples, see below Figure 6 and Figure 7 In another case, the electronic device 100 can control the displayed AOD image according to the user's touch operation on the display screen. For specific examples, see below Figure 8A and Figure 8B .

[0191] In one implementation, when the user performs Gesture 1, the electronic device 100 can display the start animation effect of the AOD image. When the user performs Gesture 2, the electronic device 100 can display the end animation effect of the AOD image. For specific examples, see below Figure 6 and Figure 7 wherein, the start animation effect can be the change effect within a period of time after the AOD image starts to change, and the end animation effect can be the change effect within a period of time before the AOD image ends changing. Between the start animation effect and the end animation effect, the AOD image can change with the change of the user state, such as changing with the angle of the user's head / the displacement of the user's face.

[0192] Figure 6 An exemplary schematic diagram of another AOD interface is shown.

[0193] As Figure 6 shown in (A) of, when the electronic device 100 is in the screen-off state, if it detects that the user 200 is gazing at the display screen, it can display the user interface 610. The user interface 610 and Figure 4ASimilar to the user interface 410 shown, the difference is that the standby screen image 411 shown in the user interface 610 only includes the background 411A and does not include the astronaut 411B. When the electronic device 100 detects that the user 200 performs gesture 1 (such as the OK gesture), it can display the start animation effect of the standby screen image 411, such as showing the process of the appearance of the astronaut 411B (which can also be understood as the astronaut 411B switching from the hidden state to the displayed state). During this process, the background 411A can gradually become smaller, and the display ratio of the astronaut 411B (i.e., the ratio of the entire standby screen image) can gradually increase (starting from 0). For some interface examples of this process, please refer to Figure 6 (B), (C), and (D) of

[0194] As Figure 6 shown in (B) of Figure 6 the electronic device 100 can display the user interface 620. The user interface 620 is similar to the user interface 610, but the difference is that the background 411A in the user interface 620 is smaller and also includes the astronaut 411B. As Figure 6 shown in (C) of Figures 4B - 4E the electronic device 100 can display the user interface 630. The user interface 630 can be displayed after the user interface 620. The user interface 630 is similar to the user interface 620, but the difference is that the background 411A in the user interface 630 is smaller and the display ratio of the astronaut 411B is larger. As Figure 6 shown in (D) of Figures 4B - 4E the electronic device 100 can display the user interface 640. The user interface 640 can be displayed after the user interface 630. The user interface 640 is similar to the user interface 630, but the difference is that the background 411A in the user interface 640 is smaller and the display ratio of the astronaut 411B is larger. In some examples, when the electronic device 100 displays the user interface 640 and detects a change in the user state, it can control the corresponding change of the standby screen image 411. For specific examples, please refer to Figures 4B - 4E 。

[0195] Figure 7 Exemplarily shows a schematic diagram of another AOD interface.

[0196] As Figure 7 shown in (A) of Figure 4A when the electronic device 100 is in the AOD state, it can display the user interface 710. For the description of the user interface 710, please refer to the description of the user interface 410 shown in Figure 4A For example, the user interface 710 can be Figure 6The user interface 640 shown in (D). When the electronic device 100 detects that the user 200 performs gesture 2 (such as a gesture of waving hands back and forth), it can display the end animation effect of the off-screen image 411, for example, display the process of the astronaut 411B disappearing (which can also be understood as the astronaut 411B switching from the display state to the hidden state). During this process, the background 411A can gradually become larger, and the display ratio of the astronaut 411B can gradually decrease (the minimum is 0). For some interface examples of this process, please refer to Figure 7 (B), (C), and (D). Figure 7 The user interface 720 shown in (B) of Figure 6 is the user interface 630 shown in (C) of Figure 7 The user interface 730 shown in (C) of Figure 6 is the user interface 620 shown in (B) of Figure 7 The user interface 740 shown in (D) of Figure 6 is the user interface 610 shown in (A) of

[0197] Not limited to the above embodiments, in another embodiment, when the user performs gesture 3, the electronic device 100 can also control the off-screen image to achieve changes such as rotation and movement. For example, when the electronic device 100 detects that the user performs a gesture of waving hands left and right, it can control Figure 4A the off-screen image 411 in the user interface 410 shown to rotate left and right. In another embodiment, when the user performs gesture 4, the electronic device 100 can control the off-screen image to remain unchanged. For example, in the case where the off-screen image changes within a period of time before the user performs gesture 4, it can be understood that gesture 4 is used to trigger the suspension of the change process of the off-screen image. Optionally, when the user subsequently performs gesture 5, the electronic device 100 can control the off-screen image to continue to change, which can be understood that gesture 5 is used to trigger the continuation of the change process of the off-screen image.

[0198] Not limited to the gestures in the above examples, in other examples, the user's gestures can also include an O-shaped gesture, an open palm, an open back of the hand, etc. This application does not limit the type of gesture actions.

[0199] Figure 8A Exemplarily shows a schematic diagram of another AOD interface.

[0200] Such as Figure 8AAs shown, when the electronic device 100 is in the AOD state, it can display the user interface 810. The user interface 810 can include the always-on display (AOD) image 811 and the date and battery level 812. The AOD image 811 can include the background 811A and the pattern 811B of the time information, giving the user the feeling that "the pattern 811B is installed in the background 811A". The positions of the background 811A and the pattern 811B can change, and the angle of the pattern 811B can also change. The electronic device 100 can receive a touch operation from the user on the display screen. This touch operation can be, for example, an operation of knocking on the display screen with a knuckle. The electronic device 100 can respond to this touch operation and control the change of the AOD image 811, such as moving it left and right. Among them, the moving directions of the background 811A and the pattern 811B can be different, giving the user the feeling that "the pattern 811B in the AOD image 811 shakes when knocking on the display screen".

[0201] Figure 8B Exemplarily shown is a schematic diagram of another AOD interface.

[0202] As Figure 8B shown, the electronic device 100 can display Figure 8A the user interface 810 as shown. The electronic device 100 can receive a touch operation from the user on the display screen. This touch operation can be, for example, a swipe operation. The electronic device 100 can respond to this touch operation and control the change of the AOD image 811. For example, the moving direction of the AOD image 811 is the same as the moving direction of the touch operation. Figure 8B Taking the touch operation as a swipe from left to right, correspondingly, the AOD image 811 moves from left to right as an example for illustration.

[0203] Not limited to the user operations in the above examples, in some other examples, when the electronic device 100 receives a voice input from the user, it can control the corresponding change of the AOD image according to this voice input. For example, Figure 6 in the scenario shown, the OK gesture can be replaced by the voice input "start playing". This application does not limit the type of user operations for controlling the AOD image for display.

[0204] Scenario 6: The electronic device 100 is in the AOD state. The electronic device 100 can control the displayed AOD image according to the user's gaze. When the electronic device 100 detects a change in the position of the gaze, the displayed AOD image of the electronic device 100 can change correspondingly.

[0205] In one implementation, the electronic device 100 can present the position of the user's gaze through the AOD image. For specific examples, please refer to the following Figure 9A , Figure 9B , Figure 9C , where Figure 9A and Figure 9BPresent the position where the user's line of sight is gazing through "the place where light converges". Figure 9C Present the position where the user's line of sight is gazing through a cartoon character.

[0206] In one embodiment, the electronic device 100 can control the state of the off-screen image according to the position where the user's line of sight is gazing. For specific examples, please refer to the following Figure 9A , Figure 9B , Figure 9D , where Figure 9A and Figure 9B control whether the off-screen image is lit according to whether the position where the user's line of sight is gazing is the position where the off-screen image is located, Figure 9D control the change direction of the off-screen image according to the moving direction of the position where the user's line of sight is gazing (which can be simply referred to as the line-of-sight direction).

[0207] Figure 9A Exemplarily show a schematic diagram of another AOD interface.

[0208] As Figure 9A shown, when the electronic device 100 is in the AOD state, it can display the user interface 910. The user interface 910 can include multiple off-screen images, such as image 911, image 912, image 913, image 914, image 915, and image 916. Among them, image 911, image 912, and image 913 are bulbs in the extinguished state, image 914 and image 915 are lights emitting light, and image 916 is the place where the light emitted by image 914 and image 915 converges. The position 1 where image 916 is located is the position where the user 200's line of sight is detected by the electronic device 100. When the electronic device 100 detects that the position where the user 200's line of sight is gazing moves to other positions, such as position 2 outside the positions where image 911, image 912, and image 913 are located in the user interface 910, the electronic device 100 can control the light change of image 914 and image 915 and control the position change of image 916 so that the light emitted by image 914 and image 915 converges at position 2 (i.e., the position of image 916 is position 2).

[0209] Figure 9B Exemplarily show a schematic diagram of another AOD interface.

[0210] As Figure 9B shown, when the electronic device 100 is in the AOD state, it can display the user interface 920. The user interface 920 and Figure 9AThe user interface 910 shown is similar, except that the position where the line of sight of user 200 detected by the current electronic device 100 is not position 1 but the position where image 912 is located. Therefore, in user interface 920, the light rays emitted by image 914 and image 915 converge at the position where image 912 is located, that is, image 916 is located at the position where image 912 is located. Moreover, image 912 in user interface 920 is in the lit state. It can be understood that when user 200 does not gaze at image 912, image 912 is in the extinguished state (such as image 912 shown in user interface 910), and when user 200 gazes at image 912, image 912 is in the lit state (such as image 912 shown in user interface 920). The descriptions of image 911 and image 913 are similar to that of image 912. In some examples, Figure 9B After the embodiment shown, the position where the line of sight of user 200 is located changes and is not the position where image 912 is located. The electronic device 100 can control image 912 to be extinguished. When the electronic device 100 detects that the position where the line of sight of user 200 is located is the position where image 911 is located, the electronic device 100 can control image 911 to be lit, and control the light rays emitted by image 914 and image 915 to converge at the position where image 911 is located, that is, image 916 is located at the position where image 911 is located.

[0211] Figure 9C An exemplary schematic diagram of another AOD interface is shown.

[0212] As Figure 9C shown, when the electronic device 100 is in the AOD state, it can display user interface 930. User interface 930 may include a standby image 931, and the standby image 931 is a cartoon image of a puppy. The position 3 where the standby image 931 is located is the position where the line of sight of user 200 detected by the electronic device 100 is located. When the electronic device 100 detects that the position where the line of sight of user 200 is located moves to another position (such as position 4), the electronic device 100 can control the standby image 931 to move to position 4.

[0213] Figure 9D An exemplary schematic diagram of another AOD interface is shown.

[0214] As Figure 9DAs shown, when the electronic device 100 is in the AOD state, the user interface 940 can be displayed. The user interface 940 can include a screen-off image 941, and the screen-off image 941 can be a launched rocket. The screen-off image 941 is located at position 5 on the lower side of the user interface 940. When the electronic device 100 detects that the position where the user 200's line of sight is fixed moves upward (i.e., the line of sight direction is upward), the electronic device 100 can control the screen-off image 941 to move upward. For example, it moves from position 5 to position 6, and then from position 6 to position 7, giving the user the feeling of "rocket launch". In some examples, during the process of the screen-off image 941 moving upward, the screen-off image 941 can gradually become smaller. Without limitation, the shape and pattern of the screen-off image 941 can also change. This application does not make any limitations in this regard, so as to provide a more vivid "rocket launch" effect.

[0215] It can be understood that when the user 200's line of sight is fixed on a certain position, the display mode of the corresponding screen-off image can be static or dynamic (i.e., display an animation). For example, Figure 9B in, when the user 200 gazes at the image 912, the image 912 can remain in the lit state. At this time, it can be understood as a static display mode. Or, the image 912 can be in a blinking state, that is, a state in which the lit state and the screen-off state alternate. At this time, it can be understood as a dynamic display mode.

[0216] It can be understood that when the positions where the user 200's line of sight is fixed are different, the display modes of the corresponding screen-off images can be different. For example, Figure 9D in, when the user 200's line of sight is fixed on positions 5, 6, and 7, the sizes of the screen-off images 941 displayed at these positions are different. For example, Figure 9C in, when the user 200's line of sight is fixed on position 3, an "exit" / "disappearance" animation of the screen-off image 931 (a puppy) can be displayed at position 3, and when the user 200's line of sight is fixed on position 4, an "entry" / "appearance" animation of the screen-off image 931 (a puppy) can be displayed at position 4. The embodiments of this application do not make any limitations on the specific display modes.

[0217] In one implementation, when the electronic device 100 displays the AOD interface, if it detects that the user does not gaze at the display screen and the duration is greater than or equal to a preset duration, it can control the display screen to turn off. Optionally, when the electronic device 100 subsequently detects that the user gazes at the display screen, it can control the display screen to display the AOD interface again. For examples of the AOD interface, reference can be made to the AOD interfaces in Scenarios 1-6 above.

[0218] In one embodiment, when the electronic device 100 displays the AOD interface, if it detects that an object is approaching (e.g., detected by a proximity light sensor), it can control the display screen to turn off. Optionally, when the electronic device 100 subsequently detects that the object has left, it can control the display screen to display the AOD interface again. For examples of the AOD interface, refer to the AOD interfaces in Scenarios 1-6 above.

[0219] In one embodiment, after the electronic device 100 enters the AOD state, it can first display the start animation of the screen-off image. In some examples, when the electronic device 100 is in the screen-off state, if it detects that the user is gazing at the display screen, it can enter the AOD state and display the start animation of the screen-off image. Assuming the screen-off image is the screen-off image 411 shown in Scenarios 2 and 5, the start animation of the screen-off image 411 can be the process of the astronaut 411B appearing. For an example interface of this process, refer to Figure 6 , in order from earliest to latest, includes: Figure 6 the user interface 610 shown in (A) of Figure 6 the user interface 620 shown in (B) of Figure 6 the user interface 630 shown in (C) of Figure 6 the user interface 640 shown in (D) of

[0220] In one embodiment, before the electronic device 100 cancels the AOD state, it can first display the end animation of the screen-off image. In some examples, when the electronic device 100 is in the AOD state, if it detects a preset event (e.g., the user is not gazing at the display screen and the duration is greater than or equal to a preset duration, an object is approaching, a user operation is received, etc.), it can first display the end animation of the screen-off image. Assuming the screen-off image is the screen-off image 411 shown in Scenarios 2 and 5, the end animation of the screen-off image 411 can be the process of the astronaut 411B disappearing. For an example interface of this process, refer to Figure 7 , in order from earliest to latest, includes: Figure 7 the user interface 710 shown in (A) of Figure 7 the user interface 720 shown in (B) of Figure 7 the user interface 730 shown in (C) of Figure 7 the user interface 740 shown in (D) of, and then switch to the screen-off state or the lit state corresponding to the preset event.

[0221] In one embodiment, the screen-off image in the AOD state can be selected by the user through the settings interface of the electronic device 100. For specific examples, refer to the following Figure 10A 、 Figure 10B 、 Figure 10C, optionally, the user can also preview, through the settings interface, the process in which the screen-off image changes as the user's state changes in the AOD state. The specific process is similar to the above Scenarios 1-6, except that the screen-off image is not displayed on the AOD interface but on the settings interface.

[0222] Figure 10A An exemplary schematic diagram of a settings interface is shown.

[0223] As Figure 10A shown, the electronic device 100 can display a user interface 1010. For example, the user interface 1010 is the user interface of a settings application. The user interface 1010 may include a title "Screen-off Display", setting information 1011, setting information 1012, and multiple categories. The setting information 1011 may include a function name "Screen-off Display", a function description "When the screen is off, display information such as time, date, text messages, and incoming call reminders", and a control 1011A. The control 1011A can be used to turn on or off the "Screen-off Display" function. The setting information 1012 can be used to set the display mode of the "Screen-off Display" function, such as "All-day Display" shown in the user interface 1010. Any one of the multiple categories may include at least one image that can be selected as the screen-off image (which can be simply referred to as a candidate image). The multiple categories include, for example, a category 1013 of personalized pictures, a category 1014 of artistic styles, and a category 1015 of dial clocks, etc. Exemplarily, the image 1013A under the category 1013 is in a selected state, indicating that the currently selected screen-off image is the image 1013A.

[0224] In one embodiment, the electronic device 100 can receive a user operation on any one of the categories in the user interface 1010 (such as a click operation on the category 1013), and in response to the user operation, display the detailed information of the category. For a specific example, see below Figure 10B .

[0225] As Figure 10BAs shown, the electronic device 100 may display a user interface 1020. For example, the user interface 1020 is a user interface of a settings application. The user interface 1020 may include a title "Personalized Picture", indicating that the current interface is used to display detailed information about personalized picture classification. The user interface 1020 may include multiple candidate images under the personalized picture classification, such as image 1013A and image 1013B. The electronic device 100 may, in response to a user operation (such as a click operation) on any one of the multiple candidate images, display the candidate image in area 1021 of the user interface 1020. For example, after image 1013B is selected, area 1021 displays image 1013B. Area 1021 can be understood as an analog AOD interface. The user interface 1020 may include a prompt message "You can control the picture change by rotating, moving the face, etc.", to prompt the user about the relevant AOD function. When the electronic device 100 detects a change in the user state, the image 1013B displayed in area 1021 may change accordingly. Specific examples are similar to those in Scenarios 1 - 6 above and will not be elaborated here. The user interface 1020 may further include a control 1022, which can be used to upload pictures or videos, and the uploaded pictures or videos can be used by the electronic device 100 to obtain corresponding candidate images. The user interface 1020 further includes a control 1023, which can be used to turn on or off the function of "displaying time and date in the AOD interface". When control 1023 is in the on state, area 1021 and the AOD interface can display time and date. The user interface 1020 further includes a control 1024, which can be used to set the state of the setting options of the AOD function to the state of the setting options shown in the user interface 1020. For example, the electronic device 100 may, in response to a user operation (such as a click operation) on control 1024, set the image 1013B currently displayed in area 1021 as the screen-off image, and turn on the function of "displaying time and date in the AOD interface".

[0226] Figure 10A and Figure 10B Taking the example that the user selects a screen-off image from multiple preset candidate images, in some other examples, the user can also select an associated account and set the character image of the associated account as the screen-off image. For specific examples, please refer to the following Figure 10C .

[0227] Figure 10C Exemplarily shows a schematic diagram of another settings interface.

[0228] As Figure 10C shown, the electronic device 100 may display a user interface 1030. In some examples, the user interface 1030 may be in response to an operation on Figure 10AThe user operation display of the setting information (not shown) of "Associated Family Members" in the user interface 1010 shown. The user interface 1030 may include a title "Always-on Display" and setting information 1031. The setting information 1031 may include a function name "Associated Family Members", a function description "Use the cartoon image of family members as the always-on image", and a control 1031A for turning on or off the function of "Associated Family Members". When the function of "Associated Family Members" is turned on, the user interface 1030 may display a list 1032 and a preview area 1033. The list 1032 may include setting options for associated family members, such as a setting option for "daughter", a setting option for "husband" 1032A, and a setting option for "mom". For example, the setting option 1032A in the user interface 1030 is in a selected state, indicating that the cartoon image of "husband" has been selected as the always-on image. The electronic device 100 may obtain the face image of the selected family member "husband" from the cloud, generate a cartoon image based on the face image, and generate an always-on image based on the cartoon image. When the electronic device 100 is in the AOD state, it may display the generated always-on image. The electronic device 100 may also display the generated always-on image through the preview area 1033. When the electronic device 100 detects a change in the user state, the image displayed in the preview area 1033 may change accordingly. Specific examples are similar to the above Scenarios 1 - 6 and will not be elaborated here.

[0229] Not limited to Figure 10C In the case of examples, in some other examples, the real person image of the associated account may also be used as the always-on image. This application does not limit the specific method of generating the always-on image based on the image of the associated family member.

[0230] In another implementation, the always-on image in the AOD state may also be obtained based on an image (such as a picture or video) uploaded by the user. For specific examples, see below Figure 11A and Figure 11B 。

[0231] In some examples, the electronic device 100 may respond to a user operation (such as a click operation) on the control 1022 in the Figure 10B user interface 1020 shown, and display multiple pictures (such as pictures stored in the electronic device 100). The electronic device 100 may respond to a user operation (such as a click operation) on any one of these multiple pictures (which may be referred to as Picture 1), and display a setting interface for Picture 1. For specific details, see Figure 11A the user interface 1110 shown.

[0232] Such as Figure 11AAs shown, the user interface 1110 may include a title "Custom Personality Picture", a picture 1111 (i.e., the picture 1 uploaded by the user), a control 1112, and a control 1113. The picture 1111 may include a person 1111A, and the person 1111A may be an image of a real person or an image of a cartoon character. Taking the person 1111A as an image of a real person as an example for illustration. The control 1112 may be used to trigger the generation of candidate images based on the picture 1111 (at this time, the person in the candidate image is a real person), and the control 1113 may be used to trigger the generation of candidate images based on the cartoon picture corresponding to the picture 1111 (at this time, the person in the candidate image is a cartoon character). In some examples, the electronic device 100 may, in response to a user operation on the control 1113 (such as a click operation), generate a cartoon picture based on the picture 1111 (such as generating a cartoon character corresponding to the person 1111A), and generate candidate images that can be selected as the lock screen image based on the cartoon picture. The electronic device 100 may display the generated candidate images. For specific examples, please refer to Figure 11B the user interface 1120 shown.

[0233] As Figure 11B shown, the user interface 1120 and Figure 10B the user interface 1020 shown are similar. The difference is that the candidate images under the personality picture classification shown in the user interface 1120 further include an image 1121. The image 1121 is a cartoon image generated based on Figure 11A the picture 1111 shown. The cartoon character shown in the image 1121 is generated based on the person 1111A in the picture 1111. It can be understood that the cartoon character shown in the image 1121 is the cartoon image of the person 1111A. And, the image 1121 in the user interface 1120 is selected. Therefore, the area 1021 in the user interface 1120 can display the image 1121. When the electronic device 100 detects a change in the user state, the image 1121 displayed in the area 1021 can change accordingly. Specific examples are similar to the above Scenario 1 - Scenario 6 and will not be elaborated here.

[0234] The above examples are illustrated by taking the user uploading a person image as an example. In some other examples, the user may also upload an image of an animal. In some other examples, the user may also upload an image of an object. The electronic device 100 may directly generate candidate images based on the uploaded picture, or generate a cartoon image based on the uploaded image (such as generating a cartoon image corresponding to the animal, generating a cartoon image corresponding to the object) and generate candidate images based on the cartoon image. In some other examples, the user may also upload other images, such as an image obtained by taking a screenshot or recording a screen of the interface displayed on the electronic device 100. The present application does not limit the images uploaded by the user.

[0235] In another embodiment, the off-screen image in the AOD state can also be obtained based on an image (such as a picture or video) captured by the camera of the electronic device 100. For specific examples, please refer to the following Figure 12A and Figure 12B .

[0236] Figure 12A Exemplarily shown is a schematic diagram of another settings interface.

[0237] As Figure 12A shown, the electronic device 100 can display the user interface 1210. The user interface 1210 is similar to the user interface 1010 shown Figure 10A herein. The difference is that the candidate images shown in the user interface 1210 are not in the selected state. The user interface 1210 further includes setting information 1211. The setting information 1211 may include the function name "Automatic Facial Animation", the function description "The image displayed when the screen is off is automatically generated based on the face captured by the camera", and a control 1211A. The control 1211A is used to turn on or off the "Automatic Facial Animation" function. For example, when the control 1211A in the user interface 1210 is in the on state and the "Automatic Facial Animation" function is turned on, the electronic device 100 can, when in the AOD state, capture an image through the camera (such as capturing the user's face image through the front camera) and generate an off-screen image based on the captured image, and display the generated off-screen image on the AOD interface. For specific examples, please refer to the following Figure 12B .

[0238] Figure 12B Exemplarily shown is a schematic diagram of another AOD interface.

[0239] As Figure 12B shown, when the electronic device 100 is in the AOD state, it can capture the face image of the user 200 through the front camera, such as image 15. The electronic device 100 can display the user interface 1220 based on the captured image 15. The user interface 1220 may include an off-screen image 1221 and time and date information. The off-screen image 1221 can be generated based on the image 15, and the character shown in the off-screen image 1221 is a cartoon character generated based on the real person shown in the image 15. When the electronic device 100 detects a change in the state of the user 200, it can control the change of the off-screen image 1221. The specific examples are similar to those in the above Scenarios 1 - 6 and will not be elaborated here.

[0240] In one embodiment, the user can set the display mode of the off-screen display through the settings interface of the electronic device 100. In some examples, the electronic device 100 can respond to an operation on Figure 10AUser operations (such as click operations) on the setting information 1012 in the user interface 1010 shown display a setting interface for the always-on display mode. For specific examples, see below. Figure 13A and Figure 13B .

[0241] Figure 13A Exemplarily shown is a schematic diagram of another setting interface.

[0242] As Figure 13A shown, the electronic device 100 can display a user interface 1310. The user interface 1310 can include a title "Display Mode" and setting information for multiple display modes. These multiple setting information can include, for example, setting information 1311 for "Intelligent Display", setting information 1312 for "Timed Display", and setting information 1313 for "All-Day Display". Among them, the setting information 1311 can include an explanation of the "Intelligent Display" mode "When the screen is touched or a human eye gaze is detected, the always-on display appears", and a control 1311A for selecting the "Intelligent Display" mode; the setting information 1312 can include a control 1312A for selecting the "Timed Display" mode; the setting information 1313 can include an explanation of the "All-Day Display" mode "When the battery power is less than 10%, the always-on display does not appear", and a control 1313A for selecting the "All-Day Display" mode. For example, if the control 1313A in the user interface 1310 is in a selected state, it indicates that the currently selected display mode of the always-on display is "All-Day Display". In this case, when the battery power of the electronic device 100 is greater than or equal to 10%, it can be in the AOD state except in the lit screen state and does not enter the off-screen state.

[0243] Not limited to the above examples, in some other examples, the electronic device 100 can also respond to a user operation (such as a click operation) on the control 1311A in the user interface 1310 and select the "Intelligent Display" mode as the display mode of the always-on display. In this case, when the electronic device 100 is in the off-screen state, if a human eye gaze at the display screen or the display screen is touched, it can enter the AOD state. In some other examples, the electronic device 100 can also respond to a user operation (such as a click operation) on the control 1312A in the user interface 1310 and select the "Timed Display" mode as the display mode of the always-on display, and can display the setting information for the always-on display time. For specific examples, see below. Figure 13B the user interface 1320 shown.

[0244] As Figure 13B shown, the user interface 1320 and Figure 13AThe user interface 1320 is similar to the shown user interface 1310, except that the control in the selected state in the user interface 1320 is the control 1312A, and the setting information 1312 in the user interface 1320 further includes a setting option 1312B for the start time of the always-on display and a setting option 1312C for the end time. For example, the setting option 1312B is set to 7:00 am and the setting option 1312C is set to 11:00 pm. In this case, during the period from 7:00 am to 11:00 pm, the electronic device 100 can be in the AOD state except when the screen is on and does not enter the screen-off state.

[0245] In one implementation, the setting interface for the always-on display can be displayed in response to a user operation when the electronic device 100 is in the screen-on state. Such user operation can be, for example, a user operation on the setting option for the always-on display function in the settings application, and is not limited thereto. In another implementation, when the electronic device 100 is in the AOD state, it can also display the setting interface for the always-on display in response to a user operation. For specific examples, see below Figure 14 .

[0246] Figure 14 An exemplary schematic diagram showing how to bring up the setting interface is illustrated.

[0247] As Figure 14 shown in (A) of Figure 4A , the electronic device 100 can display the user interface 1410 (i.e., the user interface 410 shown Figure 14 ). The electronic device 100 can receive a user operation, which can be, for example, a touch operation on the display screen. Such touch operation can be, for example, a swipe operation, such as a single-finger swipe, a two-finger swipe, a three-finger swipe, a swipe from the lower side of the screen upwards, a swipe from the upper side of the screen downwards, a swipe from the left side of the screen to the right, a swipe from the right side of the screen to the left, etc., and is not limited thereto. Such user operation can also be voice input, gesture input, brain wave input, etc. Figure 14 Taking the user operation of a single-finger swipe from the lower side of the screen upwards as an example for illustration. The electronic device 100 can display multiple function options in response to the above user operation. For specific examples, see

[0248] As Figure 14 shown in (B) of Figure 10A , Figure 10B ,Figure 10C , Figure 11B , Figure 12A , Figure 13A , Figure 13B . Without limitation, in some other examples, the electronic device 100 may also only display some of the setting information in the always-on display setting interface, such as Figure 10A any one of the setting information in the user interface 1010 shown, or any one of the categories in the user interface 1010.

[0249] In one implementation, when the electronic device 100 is in the AOD state, it can adaptively / dynamically adjust the always-on image according to the appearance features in the image captured by the camera (for example, adding corresponding appearance features to the cartoon image shown in the always-on image). The appearance features include, for example but not limited to: whether wearing glasses, whether wearing a hat, hairstyle, whether wearing jewelry, clothing, facial features, etc. For specific examples, please refer to the following Figure 15A and Figure 15B .

[0250] Figure 15A Exemplarily shows a schematic diagram of another AOD interface.

[0251] As Figure 15A shown, when the electronic device 100 is in the AOD state, it can collect the face image of the user 200 through the front camera, such as image 16. And the electronic device 100 can display the user interface 1510 according to image 16. The user interface 1510 is similar to the Figure 12B user interface 1220 shown, the difference is that the appearance features of the always-on image are different. Among them, the always-on image 1511 in the user interface 1510 is generated according to image 16, and the always-on image 1221 in the user interface 1220 is generated according to image 15. Since the person in image 16 and the Figure 12B person in the image 15 shown are the same, the difference is that the person in image 16 wears a hat while the person in image 16 does not wear a hat. Therefore, the cartoon characters shown in the always-on image 1511 and the always-on image 1221 are the same, the difference is that the cartoon character shown in the always-on image 1511 wears a hat while the cartoon character shown in the always-on image 1221 does not wear a hat.

[0252] Figure 15B Exemplarily shows a schematic diagram of another AOD interface.

[0253] As Figure 15B shown, when the electronic device 100 is in the AOD state, it can collect the face image of the user 200 through the front camera, such as image 17. And the electronic device 100 can display the user interface 1520 according to image 17. The user interface 1520 and Figure 12BThe user interface 1220 shown is similar, except that the appearance features of the screen-off image are different. Among them, the screen-off image 1521 in the user interface 1520 is generated based on Image 17, and the screen-off image 1221 in the user interface 1220 is generated based on Image 15. Since the people in Image 17 and Figure 12B the people in Image 15 shown are the same, the difference is that the person in Image 17 wears glasses while the person in Image 15 does not wear glasses. Therefore, the cartoon characters shown in the screen-off image 1521 and the screen-off image 1221 are the same, the difference being that the cartoon character shown in the screen-off image 1521 wears glasses while the cartoon character shown in the screen-off image 1221 does not wear glasses.

[0254] In one implementation, when the screen-off image is an image generated based on the character image of an associated account, the electronic device 100 can obtain the character image of the associated account from the cloud (such as obtaining the character image of the day), and adaptively / dynamically adjust the screen-off image according to the appearance features in the obtained character image (such as adding corresponding appearance features to the cartoon image shown in the screen-off image). Specific examples are the same as Figure 15A and Figure 15B similar, the difference being that the face image used to generate the screen-off image at this time is not captured by the camera of the electronic device 100, but obtained by the electronic device 100 from the cloud. Without limitation, in some other examples, the cloud can also obtain the appearance features in the character image of the associated account, and the electronic device 100 can directly obtain the appearance features of the associated account from the cloud (such as the appearance features of the day).

[0255] The above implementation is described by taking the display of one screen-off image in the AOD state as an example. In another implementation, the electronic device 100 can also display a series of screen-off images in the AOD state. For example, the displayed screen-off image is updated every preset duration, that is, the next screen-off image is switched and displayed every preset duration. Specific examples can be seen in Figure 16 .

[0256] Figure 16 Exemplarily shows a schematic diagram of another setting interface.

[0257] As Figure 16 shown, the electronic device 100 can display the user interface 1610, and the user interface 1610 and Figure 10AThe user interface 1610 shown is similar to the user interface 1010, except that the user interface 1610 further includes setting information 1611. The setting information 1611 may include a function name "Polling Display", a function description "Update the off-screen image at regular intervals", a control 1611A, a setting option 1611B, and a setting list 1611C. The control 1611A is used to turn on or off the function "Polling Display". The setting option 1611B is used to set the interval duration of "Polling Display", that is, the interval duration for updating the off-screen image, such as 1 minute shown in the user interface 1610. The setting list 1611C is used to set the range of "Polling Display", that is, the range of off-screen images displayed in the AOD state. The setting list 1611C may include setting options for multiple categories (i.e., Figure 10A multiple categories in the user interface 1010 shown), such as setting options for "Personalized Pictures", "Art Styles", and "Dial Clocks". When any one of the setting options is in a selected state, the off-screen images displayed in the AOD state may include candidate images corresponding to the category of the selected setting option. In some examples, when the setting option for "Personalized Pictures" is in a selected state, when the electronic device 100 is in the AOD state, it can display candidate images in the "Personalized Pictures" category in a certain order and at preset intervals. For example, the "Personalized Pictures" category includes Figure 10B the image 1013A and the image 1013B in the user interface 1020 shown. The electronic device 100 may first display Figure 3A the user interface 310 shown (the off-screen image is the image 1013A). After a preset duration (such as 1 minute), it displays Figure 4A the user interface 410 shown (the off-screen image is the image 1013B, and the time is 8:01 at this time). The setting list 1611C may further include a custom setting option, which can be used to custom-select multiple images as the off-screen images for polling display, such as including some images from different categories, images stored in the electronic device 100, etc.

[0258] The setting interface is not limited to the above examples. In specific implementations, the setting interface may include more or fewer controls. In some other examples, Figure 10B the user interface 1020 shown may further include: a control for turning on or off the function of "displaying the battery level in the AOD interface".

[0259] The above embodiments are illustrated by taking the example that there is only one user of the electronic device 100. In another embodiment, there may also be multiple users of the electronic device 100. When the electronic device 100 detects that multiple users are all looking at the display screen, it can control the change of the off-screen image. In some examples, Figure 3AAfter the embodiment shown, the image captured by the front camera of the electronic device 100 includes the faces of multiple users. The electronic device 100 can control the off-screen image 311 being displayed to change to a preset expression. The preset expression is, for example, an expression of surprise / panic (at this time, the eyes of the off-screen image 311 can become larger and the mouth can be round). Without limitation, in some other examples, the electronic device 100 can also control the number of off-screen images 311 being displayed to increase. Assuming that the image captured by the front camera of the electronic device 100 includes the faces of 2 users, the electronic device 100 can display 2 off-screen images 311. The states of these 2 off-screen images 311 are respectively determined by the states of the above 2 users. For example, if the face of user 1 in the image is larger than the face of user 2, the off-screen image 311 corresponding to user 1 is larger than the off-screen image 311 corresponding to user 2. The state of any off-screen image 311 changes with the change of the state of the corresponding user. The specific description is the same as the description of the embodiment with one user above. This application does not limit the change mode of the off-screen image when the electronic device 100 detects that multiple users are all looking at the display screen.

[0260] Based on the above embodiments, the display method involved in this application is introduced. This method can be applied to Figure 1 the electronic device 100 shown. This method can be applied to Figure 2 the electronic device 100 shown.

[0261] Please refer to Figure 17 , Figure 17 which is a schematic flowchart of a display method provided by an embodiment of this application. Figure 17 Taking the camera 193, which is a sensor for detecting the user state, as an example for illustration. This method can include but is not limited to the following steps:

[0262] 1. The display screen 194 of the electronic device 100 is in the off-screen state.

[0263] 2. The camera 193 of the electronic device 100 detects that the user is looking at the display screen 194.

[0264] 3. The camera 193 reports a first event to the processor 110 of the electronic device 100. The first event is the event that the user is looking at the display screen 194.

[0265] 4. The processor 110, based on the first event, instructs the display screen 194 to enter the AOD state.

[0266] 5. In response to the instruction of the processor 110, the display screen 194 switches from the off-screen state to the AOD state. At this time, the first off-screen image can be displayed according to the first display method.

[0267] In one embodiment, the processor 110 may send information of the first display mode (which may be simply referred to as the first display information) to the display screen 194. The display screen 194 may perform display according to the received first display information to implement displaying the first standby screen image in the first display mode. In some examples, the first standby screen image is a picture including multiple layers, and the first display information may include information on the display modes of these multiple layers. The display mode of a layer may, for example but not limited to, include whether to display, display position, display order, display size, display style (such as color and shape), etc. In other examples, the first standby screen image is an animation, and the first display information may include node information for starting playback, and optionally node information for ending playback. For example, if the first standby screen image is a 10-second animation, the node information for starting playback in the first display information is the 2nd second, and the node information for ending playback is the 8th second.

[0268] In one embodiment, the first display mode is related to the user state detected by the camera 193 of the electronic device 100. Among them, the user state may, for example but not limited to, include the angle of the user's head relative to the electronic device 100, the position of the user's face relative to the electronic device 100, the user's expression, the position where the user's sight is fixed, gesture actions, appearance features (such as clothing, accessories, facial features, hairstyle), etc. For example, Figures 3A - 3E the display mode of the standby screen image 311 is related to the angle of the user's head. Again, for example, Figures 4A - 4E the display mode of the standby screen image 411 is related to the position of the user's face. Again, for example, Figures 5B - 5E the display mode of the standby screen image 311 is related to the user's expression. Again, for example, Figures 9A - 9B the display mode of the standby screen image (such as image 912, image 914, image 915, image 916) is related to the position where the user's sight is fixed.

[0269] In one embodiment, the display mode of the standby screen image may, for example but not limited to, include display position, display size, display angle, display content, display color, display shape, display brightness, appearance features, etc. Among them, for examples of the display content, reference can be made to Figure 5A the standby screen image 512 shown. In some examples, the standby screen image may include virtual objects. The virtual objects may include people, animals, and objects, etc. The display mode of the standby screen image may include the display mode of the virtual objects. The display mode of the virtual objects may include the display mode of the whole virtual object, and may also include the display mode of the local part of the virtual object (such as the face of a person, the facial features of a person). The above appearance features are specifically the appearance features of the virtual objects.

[0270] 6. The camera 193 detects a change in the user's state, such as but not limited to including at least one of the following: a change in the angle of the user's head relative to the electronic device 100, a change in the position of the user's face relative to the electronic device 100, a change in the user's expression, the user performing a user operation (such as a touch operation, a gesture, a voice input, etc.), a change in the position where the user's line of sight is directed, a change in the user's appearance characteristics, etc.

[0271] 7. The camera 193 reports a second event (including the first information about the change in the user's state) to the processor 110. Among them, the second event is an event of a change in the user's state, the second event may include the first information, and the first information may include information related to the change in the user's state. The first information is such as but not limited to including at least one of the following: the occurrence time, the type of the user's state ( Figure 17 wherein multiple user states in the examples of 5 belong to different types), the user's state before the change, the user's state after the change, a value for measuring the change in the user's state (which can be simply referred to as a measurement value). Among them, the measurement value is, for example, the change value of the angle of the user's head, the change amplitude of the position of the user's face, the change amplitude of the position where the user's line of sight is directed, etc.

[0272] 8. The processor 110 determines a second display mode of the first screen-off image according to the first information, and the second display mode is different from the first display mode.

[0273] In one implementation manner, the processor 110 may determine to adjust the display mode of the first screen-off image and the adjustment content according to the first information. Optionally, the processor 110 may determine the degree of change in the display mode of the first screen-off image according to the measurement value in the first information, and this degree of change may characterize the difference between the second display mode and the first display mode. Specific examples are shown as follows.

[0274] In some examples, different measurement values may correspond to different display modes. For example Figure 18AAs shown, assume that x is a metric value representing the change in the user state, and y indicates the display mode of the off-screen image. x and y can satisfy a continuous function f1. When x is 0, y is y1, that is, when the metric value is 0, the display mode of the off-screen image is the display mode 1 indicated by y1. When x is x1 (greater than 0), y corresponding to x1 can be determined according to f1 as y2, that is, when the metric value is x1, the display mode of the off-screen image is the display mode 2 indicated by y2. When x is x2 (greater than 0), y corresponding to x2 can be determined according to f1 as y3, that is, when the metric value is x2, the display mode of the off-screen image is the display mode 3 indicated by y3. That is to say, different x values correspond to different y values. For example, if the first display mode is the display mode 1 indicated by y1 and the metric value in the first piece of information is x1, then the determined second display mode is the display mode 2 indicated by y2. For example, in the above scenario 2, every time the electronic device 100 detects that the user's face moves to the left and the ratio of the displacement of the user's face to the width of the user's face increases by 1%, it can control the off-screen image 411 to rotate 5 degrees to the left. For example, compared with Figure 4A the image 6 shown, Figure 4B in the image 7 shown, the user's face moves to the left and the ratio of the displacement of the user's face to the width of the user's face increases by 1%. Therefore, compared with Figure 4A the off-screen image 411 shown, Figure 4B the off-screen image 411 shown rotates 5 degrees to the left.

[0275] In some other examples, metric values in different ranges can correspond to different display modes. For example Figure 18B as shown, Figure 18B and Figure 18A are similar, except that Figure 18B in it, x and y satisfy a discontinuous function f2. When x is greater than or equal to 0 and less than x1, y corresponding to it can be determined according to f2 as y1, that is, when the metric value is greater than or equal to 0 and less than x1, the display mode of the off-screen image is display mode 1. When x is greater than or equal to x1 (for example, x is x1 or x2), y corresponding to it can be determined according to f2 as y2, that is, when the metric value is greater than or equal to x1, the display mode of the off-screen image is display mode 2. For example, if the first display mode is the display mode 1 indicated by y1 and the metric value in the first piece of information is a value greater than or equal to x1 (for example, x2), then the determined second display mode is the display mode 2 indicated by y2. For example, in the above scenario 2, when the electronic device 100 detects that the user's face moves to the left and the ratio of the displacement of the user's face to the width of the user's face is less than 1 / 2, it displays Figure 4A the off-screen image 411 shown, and when it detects that the user's face moves to the left and the ratio of the displacement of the user's face to the width of the user's face is greater than 1 / 2, it displays Figure 4B the off-screen image 411 shown.

[0276] 9. The processor 110 instructs the display screen 194 to display the first off-screen image in a second display mode.

[0277] 10. In response to the instruction of the processor 110, the display screen 194 displays the first off-screen image in a second display mode.

[0278] In some examples, the second event is an event in which the angle of the user's head relative to the electronic device 100 changes. Figure 17 For the examples shown in 5-10, reference can be made to the above-mentioned scenario 1 and scenario 3.

[0279] In some examples, the second event is an event in which the position of the user's face relative to the electronic device 100 changes. Figure 17 For the examples shown in 5-10, reference can be made to the above-mentioned scenario 2 and scenario 3.

[0280] In some examples, the second event is an event in which the user's expression changes. Figure 17 For the examples shown in 5-10, reference can be made to the above-mentioned scenario 4.

[0281] In some examples, the second event is an event in which the user performs a user operation. Figure 17 For the examples shown in 5-10, reference can be made to the above-mentioned scenario 5.

[0282] In some examples, the second event is an event in which the position where the user's gaze is fixed changes. Figure 17 For the examples shown in 5-10, reference can be made to the above-mentioned scenario 6.

[0283] In some examples, the second event is an event in which the user's appearance characteristics change. Figure 17 For the examples shown in 5-10, reference can be made to the above Figures 15A - 15B description.

[0284] In one implementation manner, Figure 1 After 5 or 10 shown, the method further includes: The camera 193 detects that the user is not gazing at the display screen 194 and reports the corresponding event to the processor 110. The processor 110 can instruct the display screen 194 to enter the off-screen state according to this event. Without limitation, in some other examples, it may also be that when the proximity light sensor 180G detects that an object is approaching, the processor 110 instructs the display screen 194 to enter the off-screen state. This application does not limit the event used to trigger entering the off-screen state. In one implementation manner, before the display screen 194 enters the off-screen state, it may first display the end animation effect of the first off-screen image. Specific examples and ​ are similar, the difference being that no gesture is performed at this time.

[0285] In one implementation manner, ​Before the "5" shown, the display screen 194 may first display the start animation effect of the first off-screen image. Specific examples are similar to ​ However, the difference is that no gesture is performed at this time.

[0286] In one embodiment, ​ The first off-screen image shown may be determined by the electronic device 100 in response to a selection operation for multiple images. For specific examples, please refer to ​ and ​ . In another embodiment, the first off-screen image may also be generated by the electronic device 100 according to the character image of the associated account. For example, ​ Before the "5" shown, the electronic device 100 may send a request message to the network device to obtain the face image of the associated account selected by the user, and generate the first off-screen image according to the face image. For specific examples, please refer to ​ . In another embodiment, the first off-screen image may also be generated by the electronic device 100 according to the image uploaded by the user. For example, ​ Before the "5" shown, the electronic device 100 may receive the image uploaded by the user, and generate the first off-screen image according to the image. For specific examples, please refer to ​ and ​ . In another embodiment, the first off-screen image may also be obtained by the electronic device 100 according to the image captured by the camera. For example, ​ The first event in the "3" shown may include the face image captured by the camera 193, and the processor 110 may generate the first off-screen image according to the face image. For specific examples, please refer to ​ .

[0287] In one embodiment, ​ After the "5" shown, the method further includes: when the processor 110 detects that a preset duration has elapsed, it may instruct the display screen 194 to switch the first off-screen image to a second off-screen image. Optionally, this function may be set by the electronic device 100 in response to a user operation. For specific examples, please refer to ​ .

[0288] Not limited to ​ the embodiment shown, in another embodiment, the processor 110 may also instruct the display screen 194 to enter the AOD state according to other events. For example, when the pressure sensor 180A and / or the touch sensor 180K receive a touch operation of the user on the display screen 194, they report the corresponding event to the processor 110, and the processor 110 may instruct the display screen 194 to enter the AOD state according to the event. This application does not limit the events used to trigger the entry into the AOD state.

[0289] Not limited to ​In the embodiment shown, in another embodiment, ​ 1 shown may also be that the display screen 194 is in the lit state. At this time, the first event may be replaced by other events. For example, an event of receiving a touch operation by the user on the power button is used. This application does not limit the state of the electronic device 100 before the AOD state.

[0290] The above embodiments are described by taking the image in the AOD interface changing with the change of the user state as an example. However, it is not limited thereto. In some other embodiments, the image in the lock screen interface may also change with the change of the user state. For example ​ In the example shown, in some other embodiments, the image on the desktop may also change with the change of the user state. For example Figure 19B In the example shown. Figure 19A 、 Figure 19B Taking the control of the state of the image according to the position where the user's line of sight gazes as an example for illustration.

[0291] Figure 19A An exemplary schematic diagram of a lock screen interface is shown.

[0292] As Figure 19A shown, the electronic device 100 may display the user interface 1910. The user interface 1910 may be a lock screen interface. The user interface 1910 may include a status bar at the top (for example, including indicators for cellular communication, WLAN, battery level, etc.), date information, time information, and a fingerprint collection area, etc. The user interface 1910 may further include an image 1911. The image 1911 may be the wallpaper image of the lock screen interface. The image 1911 may be a cartoon puppy. When the electronic device 100 detects that the user 200's line of sight gazes at the position 8 in the user interface 1910, the electronic device 100 may display the image 1911 at the position 8. For example, display the "entry" animation of the image 1911. The "entry" animation may include the puppy shown in the image 1911 changing from not being displayed to being displayed and gradually growing larger when displayed. Figure 19A The image 1911 at the position 8 shown may be the display image when the "entry" animation is completed. When the electronic device 100 detects that the position where the user 200's line of sight gazes changes to the position 9 in the user interface 1910, the electronic device 100 may display the image 1911 at the position 9. For example, display the "exit" animation of the image 1911. The "exit" animation may include the puppy shown in the image 1911 gradually shrinking until it is not displayed. Figure 19A The image 1911 at the position 9 shown may be the display image when the "exit" animation is in progress (gradually shrinking). Therefore, Figure 19A The image 1911 at the position 9 shown is smaller than Figure 19A The image 1911 at the position 8 shown.

[0293] Figure 19B An exemplary schematic diagram of a desktop is shown.

[0294] As Figure 19B shown, the electronic device 100 may display a user interface 1920, which may be a desktop. The user interface 1920 may include a status bar at the top (e.g., including indicators for cellular communication, WLAN, battery level, etc.), date information, time information, and icons of multiple applications. The user interface 1920 may also include images 1921, 1922, and 1923, which may be wallpaper images of the desktop and may be light bulbs. For any one of these images, when the electronic device 100 does not detect the user 200's gaze on the image, the image may be in a screen-off state (e.g., lower brightness, darker color). When the electronic device 100 detects the user 200's gaze on the image, the image may be in a lit state (e.g., higher brightness, lighter color). Exemplarily, Figure 19B taking the example that the electronic device 100 detects the user 200's gaze on the image 1922 for illustration, then Figure 19B in the shown user interface 1920, the image 1922 is in a lit state, and the images 1921 and 1923 are in a screen-off state. In some examples, the lit states of the images 1921, 1922, and 1923 may be different, such as different brightness, different colors, etc. For example, when the electronic device 100 detects the user 200's gaze on the image 1922, the image 1922 may be in a red lit state. When the electronic device 100 detects the user 200's gaze on the image 1921 / image 1923, the image 1921 / image 1923 may be in a blue lit state.

[0295] In the methods provided by the embodiments of the present application, they can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wirelessly (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that the computer can access, or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a digital video disc (DVD)), or a semiconductor medium (such as a solid state disk (SSD), etc.). As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than limiting them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A display method, characterized in that, Applied to an electronic device, the electronic device includes a display screen, and the method includes: Displaying a first interface, the first interface including a first image in a first display mode; Detecting that the state of a first user changes from a first state to a second state, the state of the first user including at least one of the following: the angle of the user's head relative to the electronic device, the position of the user's face relative to the electronic device, gesture actions, facial expressions, the position where the line of sight gazes at the display screen, and appearance features; Updating the display mode of the first image to a second display mode, the first display mode being related to the first state, and the second display mode being related to the second state, wherein the first image is obtained from a second image, the second image being an image of a second user of a first account, the first account being an account associated with the account of the first user, and the first virtual object in the first image is obtained from the second user in the second image.

2. The method according to claim 1, characterized in that, When the state of the first user includes the angle of the user's head relative to the electronic device, the detecting that the state of the first user changes from the first state to the second state includes: When the head of the first user rotates in a first direction relative to the electronic device, or the electronic device rotates in a second direction relative to the first user, detecting that the angle of the head of the first user relative to the electronic device changes from a first angle to a second angle, the first direction and the second direction being opposite; The updating the display mode of the first image to the second display mode includes: Updating the first virtual object or a first part of the first virtual object from a first position to a second position, the first position being related to the first angle, the second position being related to the second angle, and the second position being in the first direction of the first position.

3. The method according to claim 1, characterized in that When the state of the first user includes the position of the user's face relative to the electronic device, the detecting that the state of the first user changes from the first state to the second state includes: When the face of the first user translates in a third direction relative to the electronic device, or the electronic device translates in a fourth direction relative to the first user, detecting that the position of the face of the first user relative to the electronic device changes from a third position to a fourth position, the third direction and the fourth direction being opposite, and the fourth position being in the third direction of the third position; The updating the display mode of the first image to the second display mode includes: Updating the first virtual object or a first part of the first virtual object from a fifth position to a sixth position, the fifth position being related to the third position, the sixth position being related to the fourth position, and the sixth position being in the third direction of the fifth position.

4. The method according to claim 1, characterized in that, When the state of the first user includes facial expressions, the detecting that the state of the first user changes from the first state to the second state includes: Detecting that the expression of the first user changes from a first expression to a second expression; The expression of the first virtual object in the first image of the first display mode is the first expression, and the expression of the first virtual object in the first image of the second display mode is the second expression.

5. The method according to claim 1, wherein When the state of the first user includes a gesture action, the second state includes that the gesture action of the first user is the first gesture. In the first image of the first display mode, the first virtual object is in a hidden state, and in the first image of the second display mode, the first virtual object is in a display state; or, in the first image of the first display mode, the first virtual object is in a display state, and in the first image of the second display mode, the first virtual object is in a hidden state.

6. The method according to claim 1, wherein When the state of the first user includes the position where the line of sight is directed at the display screen, the detection that the state of the first user changes from the first state to the second state includes: Detecting that the position where the first user's line of sight is directed at the display screen changes from the seventh position to the eighth position; In the first image of the first display mode, the first virtual object is located at the seventh position, and in the first image of the second display mode, the first virtual object is located at the eighth position.

7. The method according to claim 1, characterized in that, When the state of the first user includes the position where the line of sight is directed at the display screen, the first state includes that the first user's line of sight is directed at the ninth position of the display screen, the second state includes that the first user's line of sight is directed at the tenth position of the display screen, the first virtual object in the first image is located at the tenth position, and the display states of the first virtual object in the first image of the first display mode and the first image of the second display mode are different, and the display state includes at least one of the following: size, color, shape, and brightness.

8. The method according to claim 1, wherein When the state of the first user includes the position where the line of sight is directed at the display screen, the detection that the state of the first user changes from the first state to the second state includes: Detecting that the position where the first user's line of sight is directed moves in the fifth direction; The updating of the display mode of the first image to the second display mode includes: Updating the first virtual object or the first part of the first virtual object from the eleventh position to the twelfth position, and the twelfth position is in the fifth direction of the eleventh position.

9. The method according to claim 1, characterized in that, When the state of the first user includes appearance features, the first state includes that the appearance feature of the first user is the first feature, the second state includes that the appearance feature of the first user is the second feature, the appearance feature of the first virtual object in the first image of the first display mode matches the first feature, and the appearance feature of the first virtual object in the first image of the second display mode matches the second feature. The appearance feature includes at least one of the following: clothing, accessories, hairstyle, and facial features.

10. The method according to any one of claims 1-9, characterized in that, Before displaying the first interface, the method further includes: Sending a first request message to the network device, and the first request message includes information of the first account; Receiving the second image sent by the network device.

11. The method according to claim 10, characterized in that, The second image is an image of the second user at a first time. An appearance feature of the second user in the second image is a third feature. An appearance feature of the first virtual object in the first image in the first display mode matches the third feature. After displaying the first interface, the method further includes: Sending a second request message to the network device; Receiving a third image sent by the network device. The third image is an image of the second user at a second time, and the second time is later than the first time. An appearance feature of the second user in the third image is a fourth feature; Updating the display mode of the first image to a third display mode. An appearance feature of the first virtual object in the first image in the third display mode matches the fourth feature.

12. The method according to any one of claims 1-9, characterized in that, The updating the display mode of the first image to a second display mode includes: When the first image is an animation, switching a currently played node of the first image from a first node to a second node; When the first image is a picture including multiple layers, adjusting a display mode of at least one layer in the first image.

13. The method according to any one of claims 1-9, characterized in that The method further includes: After displaying the first interface, when it is detected that the first user does not gaze at the display screen, controlling the display screen to turn off; When it is detected that the first user gazes at the display screen, displaying the first interface.

14. The method according to any one of claims 1-9, characterized in that The method further includes: After displaying the first interface, when it is detected that an object approaches the electronic device, controlling the display screen to turn off; When it is detected that the object leaves the electronic device, displaying the first interface.

15. The method according to any one of claims 1-9, characterized in that The method further includes: Displaying a second setting interface for previewing the first interface. The second setting interface includes the first image in the first display mode; Detecting that a state of the first user changes from the first state to the second state; Updating the display mode of the first image to the second display mode.

16. The method according to claim 15, wherein The displaying the second setting interface includes: When displaying the first interface, receiving a second operation; In response to the second operation, displaying the second setting interface.

17. The method according to any one of claims 1-9, characterized in that, The method further includes: After a first duration has elapsed after displaying the first interface, displaying a second interface. The second interface includes a fourth image, and the fourth image is different from the first image.

18. The method according to any one of claims 1-9, characterized in that, The first interface is an always-on display (AOD) interface, or the first interface is a lock screen interface, or the first interface is a desktop.

19. The method according to any one of claims 1-9, characterized in that, Before displaying the first interface, the method further includes: Receiving a second gesture of the first user; In response to the second gesture, displaying a start animation effect of the first image; After updating the display mode of the first image to the second display mode, the method further includes: Receiving a third gesture of the user; In response to the third gesture, displaying an end animation effect of the first image; The first image displayed after the start animation effect of the first image and before the end animation effect of the first image includes the first image in the first display mode and the first image in the second display mode.

20. An electronic device, characterized in that, It includes a transceiver, a processor and a memory. The memory is used to store a computer program, and the processor calls the computer program to execute the method according to any one of claims 1-19.

21. A computer storage medium, characterized in that, The computer storage medium stores a computer program, which, when executed by a processor, implements the method according to any one of claims 1-19.

Images