Display method, electronic device, and computer storage medium

Abstract

The present application discloses a display method, an electronic device, and a computer storage medium. The method comprises: displaying a first interface, wherein the first interface comprises a first image in a first display mode; detecting that the state of a first user changes from a first state to a second state, wherein the state of the first user comprises at least one of the following: the angle of the head of the user relative to an electronic device, the position of the face of the user relative to the electronic device, a gesture action, a facial expression, the position of a line of sight on a display screen, and an appearance feature; and updating the display mode of the first image to a second display mode, wherein the first display mode is related to the first state, and the second display mode is related to the second state. In the present application, the display mode of an image changes along with the change of the state of a user, improving the attractiveness of a display function to the user, increasing use time.

Description

Display method, electronic device, and computer storage medium

[0001] This application claims priority to the Chinese patent application with application number 202310780790.9 filed with the State Intellectual Property Office of China on June 28, 2023, and priority to the Chinese patent application with the invention name “Off-screen display method, electronic device and computer storage medium”. This application claims priority to the Chinese patent application with application number 202410295539.8 filed with the State Intellectual Property Office of China on March 14, 2024, and priority to the Chinese patent application with the invention name “Display method, electronic device and computer storage medium”. The entire contents of these patent applications are incorporated into this application by reference. Technical Field

[0002] The present application relates to the field of human-computer interaction technology, and in particular to a display method, an electronic device, and a computer storage medium. Background Art

[0003] Currently, terminals can have an always on display (AOD) function, which, for example, displays a background image, time, fingerprint icon, and notification messages after the terminal is locked. The background image is usually a user-selected image or a system-preset image. Users often only use the AOD function to view information such as the time and notification messages, and then exit the AOD function (for example, switching to a screen-off state or a screen-on state) after obtaining this information. The AOD function has a short usage time and is not very attractive to users, resulting in low usability of the AOD function.

[0004] Summary of the Invention

[0005] The present application discloses a display method, an electronic device, and a computer storage medium, which can enhance the user appeal of display functions such as an off-screen display function, increase usage time, and thus improve the usability of the display function.

[0006] In a first aspect, the present application provides a display method, which is applied to an electronic device, wherein the electronic device includes a display screen, and the method includes: displaying a first interface, wherein the first interface includes a first image in a first display mode (for example, a wallpaper image); detecting that the state of a first user changes from the first state to a second state, wherein the state of the first user includes at least one of the following: the angle of the user's head relative to the electronic device, the position of the user's face relative to the electronic device, gestures, facial expressions, the position of the line of sight looking at the display screen, and appearance features; updating the display mode of the first image to a second display mode (for example, a static display mode or a dynamic display mode), wherein the first display mode is related to the first state, and the second display mode is related to the second state.

[0007] In some examples, the first interface is an AOD interface displayed when the screen is off, and the first image is the wallpaper image of the AOD interface. In other examples, the first interface is a lock screen interface, and the first image is the wallpaper image of the lock screen interface. In other examples, the first interface is the desktop, and the first image is the wallpaper image of the desktop.

[0008] In the above method, the display mode of the first image in the first interface can change with the change of the state of the first user, and the state of the user is diverse, that is, the user can change his state (which can be of different types) multiple times and at will to change the first image displayed by the electronic device 100, which gives playability / new features to the image display function (such as the wallpaper display function), rather than being used only to display limited information such as time, thereby effectively enhancing the user appeal of the image display function, motivating users to spend more time using the image display function, and improving the usability of the image display function.

[0009] In a possible implementation, the first image includes a first virtual object, which is a virtual character, a virtual animal, or a virtual object.

[0010] For example, the display mode of the first image includes the display mode of the first virtual object, the display mode of the first virtual object in the first image of the first display mode is related to the first state, and the display mode of the first virtual object in the first image of the second display mode is related to the second state.

[0011] For example, the first virtual object is an animated character.

[0012] In the above method, the first image includes a first virtual object, and the display mode of the first virtual object can change with the change of the state of the first user. Through the change of the first virtual object, the user can feel the change of the first image more intuitively, giving the user a sense of "the first virtual object is the virtual image of the user, and the virtual image of the user changes when the user changes", further enhancing the user appeal of the image display function, thereby further improving the usability of the image display function.

[0013] In one possible implementation, the first image includes at least one image content, the at least one image content includes the image content of the first virtual object, and the display method of the first image includes at least one of the following: the position of the image content, the size of the image content, whether the image content is hidden, the color of the image content, the shape of the image content, the brightness of the image content, the expression of the first virtual object, the gesture of the first virtual object, and the appearance characteristics of the first virtual object.

[0014] In the above method, the display mode of the changeable first image is diverse. For example, it is not limited to the position and size of the image content, but can also include the expression of the first virtual object and other content similar to the user status. Therefore, when the display mode of the first image changes, it can provide users with a richer, layered, and intuitive display effect, that is, provide users with a better display effect, thereby improving the user experience.

[0015] In one possible implementation, the detecting that the state of the first user changes from the first state to the second state includes: when the first user's head rotates in a first direction relative to the electronic device, or when the electronic device rotates in a second direction relative to the first user, detecting that the angle of the first user's head relative to the electronic device changes from a first angle to a second angle, and the first direction and the second direction are opposite; the updating of the display mode of the first image to the second display mode includes: updating the first virtual object or the first part of the first virtual object from a first position to a second position, the first position is related to the first angle, the second position is related to the second angle, and the second position is located in the first direction of the first position.

[0016] In the above method, the first user can turn his head in the first direction, or control the electronic device to rotate in the second direction, so that the position of the first virtual object or the first part of the first virtual object changes in the first direction. The direction in which the first user rotates relative to the electronic device is consistent with the change direction of the first virtual object or the first part. The change effect is interesting and more intuitive, further improving the user experience.

[0017] In one possible implementation, the detecting that the state of the first user changes from the first state to the second state includes: when the face of the first user is translated relative to the electronic device in a third direction, or the electronic device is translated relative to the first user in a fourth direction, detecting that the position of the face of the first user relative to the electronic device changes from the third position to the fourth position, the third direction is opposite to the fourth direction, and the fourth position is located in the third direction of the third position; updating the display mode of the first image to the second display mode includes: updating the first virtual object or the first part of the first virtual object from the fifth position to the sixth position, the fifth position is related to the third position, the sixth position is related to the fourth position, and the sixth position is located in the third direction of the fifth position.

[0018] In the above method, the first user can translate the face toward the third direction, or control the electronic device to translate toward the fourth direction, so that the position of the first virtual object or the first part of the first virtual object changes toward the third direction. The direction in which the first user translates relative to the electronic device is consistent with the direction in which the first virtual object or the first part changes. The change effect is interesting and more intuitive, further enhancing the user experience.

[0019] In one possible implementation, the detection of the first user's state changing from the first state to the second state includes: detecting that the first user's expression changes from the first expression to the second expression; the expression of the first virtual object in the first image of the first display mode is the first expression, and the expression of the first virtual object in the first image of the second display mode is the second expression.

[0020] In the above method, the expression of the first virtual object is consistent with the expression of the first user. When the expression of the first user changes, the expression of the first virtual object also changes accordingly. The change effect is interesting and more intuitive, further improving the user experience.

[0021] In one possible implementation, the second state includes the gesture action of the first user being a first gesture, the first virtual object in the first image of the first display mode is in a hidden state, and the first virtual object in the first image of the second display mode is in a displayed state; or, the first virtual object in the first image of the first display mode is in a displayed state, and the first virtual object in the first image of the second display mode is in a hidden state.

[0022] In some examples, updating the display mode of the first image to the second display mode includes: changing the first virtual object from a hidden state to a displayed state, wherein the displayed content of the first virtual object gradually increases.

[0023] In some examples, updating the display mode of the first image to a second display mode includes: changing the first virtual object from a displayed state to a hidden state, wherein the display content of the first virtual object gradually decreases.

[0024] In the above method, the user can perform the first gesture to control the first virtual object to "appear" or "disappear", giving the user a feeling that "the first virtual object comes and goes at will", further improving the playability of the image display function, thereby improving the user experience.

[0025] In one possible implementation, the detecting that the state of the first user changes from the first state to the second state includes: detecting that the position where the first user's line of sight is looking at the display screen changes from the seventh position to the eighth position; the first virtual object in the first image of the first display mode is located at the seventh position, and the first virtual object in the first image of the second display mode is located at the eighth position.

[0026] In the above method, the display position of the first virtual object is the position where the first user's line of sight is looking at the display screen. The first user can control the change of the display position of the first virtual object by changing the position where the line of sight is looking at the display screen, thereby further improving the playability of the image display function and thus improving the user experience.

[0027] In one possible implementation, the first state includes the first user's line of sight looking at the ninth position of the display screen, the second state includes the first user's line of sight looking at the tenth position of the display screen, the first virtual object in the first image is located at the tenth position, and the display state of the first virtual object in the first image of the first display mode and the first image of the second display mode is different, and the display state includes at least one of the following: size, color, shape, and brightness.

[0028] In the above method, the display state of the first virtual object is related to whether the first user is looking at the first virtual object. For example, the first virtual object is a light bulb. When the first user is not looking at the first virtual object, the first virtual object is in an off state (that is, the first virtual object is off in the first image of the first display mode). When the first user is looking at the first virtual object, the first virtual object is in a power state (that is, the first virtual object is in a lit state in the first image of the second display mode). The first user can control the display state of the first virtual object by changing the position of the display screen where the user is looking, thereby further improving the playability of the image display function and thus improving the user experience.

[0029] In one possible implementation, detecting that the state of the first user changes from the first state to the second state includes: detecting that the position where the first user's line of sight moves toward the fifth direction; updating the display mode of the first image to the second display mode includes: updating the first virtual object or the first part of the first virtual object from the eleventh position to the twelfth position, and the twelfth position is located in the fifth direction of the eleventh position.

[0030] In the above method, the direction of change of the position of the first virtual object or the first part is consistent with the direction of change of the position of the first user's gaze. The first user can control the direction of change of the position of the first virtual object or the first part by moving the position of the gaze, thereby further improving the playability of the image display function and thus improving the user experience.

[0031] In one possible implementation, the first state includes the appearance feature of the first user as a first feature, the second state includes the appearance feature of the first user as a second feature, the appearance feature of the first virtual object in the first image of the first display mode matches the first feature, and the appearance feature of the first virtual object in the first image of the second display mode matches the second feature, and the appearance features include at least one of the following: clothing, accessories, hairstyle, and facial features.

[0032] In the above method, the appearance characteristics of the first virtual object are consistent with the appearance characteristics of the first user. When the appearance characteristics of the first user change, the appearance characteristics of the first virtual object also change accordingly. The change effect is interesting and more intuitive, further improving the user experience.

[0033] In a possible implementation, before displaying the first interface, the method further includes: displaying a first setting interface, where the first setting interface includes multiple images; and receiving a first operation on the first image among the multiple images.

[0034] In the above method, the first image can be selected by the user from multiple images. The user can choose his or her favorite image as the image displayed on the first interface. The first image meets the user's needs and further improves the user experience.

[0035] In one possible implementation, before displaying the first interface, the method also includes: sending a first request message to a network device, the first request message including information of a first account associated with the electronic device; receiving a second image sent by the network device, the second image being an image of a second user of the first account; obtaining the first image based on the second image, the first virtual object in the first image being a virtual character, and the first virtual object being obtained based on the second user in the second image.

[0036] For example, the first account is determined by the electronic device in response to a user operation, that is, the first account is selected by the user.

[0037] In the above method, the first image can be generated based on the image of the second user of the first account. For example, the first account is an account associated with the account of the first user (such as a family account). In this way, the first virtual object that the first user can see and control the changes is the virtual image of the second user related to the first user. This can not only meet the user's personalized needs, but also be more interesting, further enhancing the user experience.

[0038] In one possible implementation, before displaying the first interface, the method further includes: receiving a third image uploaded by the first user; obtaining the first image based on the third image; wherein the third image is the same as the first image; or, the first virtual object in the first image is obtained based on the object in the third image.

[0039] In the above method, the first image can be generated based on the image uploaded by the first user. For example, the first virtual object corresponds to the object in the image uploaded by the first user, which can meet the user's personalized needs and further enhance the user experience.

[0040] In a possible implementation, before displaying the first interface, the method further includes: capturing a fourth image through a camera of the electronic device; obtaining the first image based on the fourth image, and the first virtual object in the first image is obtained based on the object in the fourth image.

[0041] In the above method, the first image can be generated based on the image collected by the electronic device in real time. For example, when different users use the electronic device, the electronic device can display different first virtual objects. For example, when the same user in different user states uses the electronic device, the electronic device can display different first virtual objects. The displayed first virtual object is closely related to the user image collected by the electronic device in real time, giving the user a more interesting and intuitive display effect, further enhancing the user experience.

[0042] In one possible implementation, the second image is an image of the second user at the first time, the appearance feature of the second user in the second image is a third feature, and the appearance feature of the first virtual object in the first image in the first display mode matches the third feature. After displaying the first interface, the method further includes: sending a second request message to the network device; receiving a fifth image sent by the network device, the fifth image is an image of the second user at the second time, the second time is later than the first time, and the appearance feature of the second user in the fifth image is a fourth feature; updating the display mode of the first image to a third display mode, and the appearance feature of the first virtual object in the first image in the third display mode matches the fourth feature.

[0043] For example, the first time and the second time are separated by one day.

[0044] In the above method, after the electronic device displays the first interface, it can obtain the latest appearance features of the second user of the associated account (i.e., the first account) through the network device, and promptly update the displayed first virtual object based on the acquired appearance features, so that the first virtual object displayed by the electronic device matches the latest appearance features of the second user, giving the user a more interesting and intuitive display effect, further improving the user experience.

[0045] In one possible implementation, updating the display mode of the first image to the second display mode includes: when the first image is an animation, switching the node currently playing the first image from the first node to the second node; when the first image is a picture including multiple layers, adjusting the display mode of at least one layer in the first image.

[0046] In the above method, the changeable first image can be an animation or a picture, and is not limited to animation. In this way, even if the first image is a picture, the display mode of the first image can be changed accordingly, which expands the application scenario of the playable image display function provided by this application.

[0047] In a possible implementation, the method further includes: after displaying the first interface, when it is detected that the first user is not looking at the display screen, controlling the display screen to turn off; when it is detected that the first user is looking at the display screen, displaying the first interface.

[0048] In the above method, when the first user is not looking at the display screen, the first display screen can be turned off. When the first user is looking at the display screen, the first display screen displays the first interface again, thereby avoiding unnecessary power consumption caused by the first interface still being displayed when the first user is not looking at the display screen, reducing device power consumption, and improving device availability.

[0049] In a possible implementation, the method further includes: after displaying the first interface, when an object is detected approaching the electronic device, controlling the display screen to turn off; when the object is detected leaving the electronic device, displaying the first interface.

[0050] In the above method, when an object approaches, the first display screen can be turned off, and when the object leaves, the first display screen will display the first interface again, so as to avoid unnecessary power consumption caused by the user not viewing the first interface when the object approaches but still displaying the first interface, thereby reducing device power consumption and improving device availability.

[0051] In one possible implementation, the method further includes: displaying a second setting interface, the second setting interface being used to preview the first interface, the second setting interface including the first image in the first display mode; detecting that the state of the first user changes from the first state to the second state; and updating the display mode of the first image to the second display mode.

[0052] For example, the second setting interface is used to select or input a first image.

[0053] In the above method, when the user views the second setting interface of the first interface, the user can preview through the second setting interface: the process in which the display mode of the first image changes as the user's status changes. This makes it more convenient for the user to select a favorite first image. The user does not need to select the first image and then go to the first interface to view the above process, which reduces the time and energy spent by the user on selecting the first image and further improves the user experience.

[0054] In a possible implementation, displaying the second settings interface includes: receiving a second operation while displaying the first interface; and displaying the second settings interface in response to the second operation.

[0055] In the above method, when the electronic device displays the first interface, the first user can quickly call out the second setting interface of the first interface through the second operation, without having to switch the electronic device to the bright screen state and then perform a series of operations to call out the second setting interface, thereby reducing user operations and further improving the user experience.

[0056] In a possible implementation, the method further includes: displaying a second interface after a first time period has passed after the first interface is displayed, wherein the second interface includes a sixth image, and the sixth image is different from the first image.

[0057] In the above method, the electronic device can switch the displayed image (such as wallpaper image) every first time period, allowing users to experience more changeable images, giving users richer and more diverse display effects, and further improving user experience.

[0058] In a second aspect, the present application provides an electronic device comprising a transceiver, a processor and a memory; the memory is used to store a computer program, and the processor calls the computer program to execute the display method provided in the first aspect of the present application and any one of the implementation methods of the first aspect.

[0059] In a third aspect, the present application provides a computer storage medium storing a computer program, which, when executed by a processor, implements the display method provided in the first aspect of the present application and any one of the implementations of the first aspect.

[0060] In a fourth aspect, the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the display method provided in the first aspect of the present application and any one of the implementations of the first aspect.

[0061] In a fifth aspect, the present application provides an electronic device, the electronic device including a method or apparatus for executing any aspect or embodiment of the present application. The electronic device is, for example, a chip.

[0062] It should be understood that the description of technical features, technical solutions, beneficial effects or similar language in this application does not imply that all features and advantages can be realized in any single embodiment. On the contrary, it is understood that the description of a feature or beneficial effect means that a specific technical feature, technical solution or beneficial effect is included in at least one embodiment. Therefore, the description of a technical feature, technical solution or beneficial effect in this application does not necessarily refer to the same embodiment. Furthermore, the technical features, technical solutions and beneficial effects described in this application can also be combined in any appropriate manner. Those skilled in the art will understand that this application can be implemented without one or more specific technical features, technical solutions or beneficial effects of a specific embodiment. In other embodiments, additional technical features and beneficial effects can also be identified in specific embodiments that do not embody all embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] The following is an introduction to the drawings used in this application.

[0064] FIG1 is a schematic diagram of the hardware structure of an electronic device provided by the present application;

[0065] FIG2 is a schematic diagram of a software architecture of an electronic device provided by the present application;

[0066] Figures 3A-3E are schematic diagrams of some off-screen display AOD interfaces provided by this application;

[0067] 4A-4E are schematic diagrams of some further AOD interfaces provided by this application;

[0068] 5A-5E are schematic diagrams of some further AOD interfaces provided by this application;

[0069] Figures 6, 7, 8A, and 8B are schematic diagrams of some further AOD interfaces provided by this application;

[0070] 9A-9D are schematic diagrams of some further AOD interfaces provided by this application;

[0071] Figures 10A-10C are schematic diagrams of some setting interfaces provided by this application;

[0072] 11A and 11B are schematic diagrams of some other setting interfaces provided by this application;

[0073] FIG12A is a schematic diagram of another setting interface provided by the present application;

[0074] FIG12B is a schematic diagram of another AOD interface provided by the present application;

[0075] 13A and 13B are schematic diagrams of some other setting interfaces provided by this application;

[0076] FIG14 is a schematic diagram of another setting interface provided by the present application;

[0077] FIG15A and FIG15B are schematic diagrams of some further AOD interfaces provided by the present application;

[0078] FIG16 is a schematic diagram of another setting interface provided by the present application;

[0079] FIG17 is a flow chart of a display method provided by the present application;

[0080] FIG18A and FIG18B are schematic diagrams showing the relationship between some user status changes and the display mode of the off-screen image provided by the present application;

[0081] FIG19A is a schematic diagram of a lock screen interface provided by the present application;

[0082] FIG19B is a schematic diagram of a desktop provided in the present application. DETAILED DESCRIPTION

[0083] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " represents or, for example, A / B can represent A or B; "and / or" in the text is merely a description of the association relationship between associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" refers to two or more than two.

[0084] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.

[0085] The present application provides a display method, which is applied to an electronic device, and the image displayed by the electronic device (such as a wallpaper image) can change as the user status changes, wherein the image can be an image displayed in the always on display (AOD) state (which can be simply referred to as the off-screen image), or an image displayed in the lock screen state, or an image displayed on the desktop. For example, in the AOD state, when the user's face rotates / moves, the off-screen image will also rotate / move, which can increase the playability of the off-screen image and other display images, enhance the user appeal of display functions such as the AOD function, thereby increasing the usage time of display functions such as the AOD function, and enhancing the usability of display functions such as the AOD function. For the sake of convenience, the following embodiments are mainly described by taking the AOD scenario (the off-screen image displayed by the electronic device changes as the user status changes) as an example, and the lock screen scenario is similar to the desktop scenario.

[0086] Among them, the display screen of the electronic device (which can also be understood as an electronic device) can include a screen-off state (also known as a black screen state), an AOD state and a screen-on state. In the screen-off state, the display screen is not lit. In the AOD state, the electronic device can light up part or all of the display screen to display limited information, such as background, time, fingerprint icon and notification message, etc. The background is, for example, the above-mentioned screen-off image. In the screen-on state, the electronic device can light up all areas of the display screen to display interfaces such as the desktop and the user interface of the application. In one embodiment, in the AOD state, the electronic device can be locked, and only some functions can be used, such as viewing the above-mentioned limited information, camera, flashlight, etc. The user can use passwords, faces, fingerprints and other information to authenticate the locked electronic device. After the authentication is passed, the electronic device can be unlocked, and all functions of the electronic device can be used after being unlocked. In one embodiment, in the screen-on state, the electronic device is not locked.

[0087] An electronic device can switch between any two states: screen-off state, AOD state, and screen-on state. In some examples, the electronic device can switch from the screen-off state to the AOD state when receiving a user operation (such as a touch operation on the display screen). In other examples, the electronic device can switch from the screen-off state to the AOD state when detecting that the user is looking at the display screen, which can also be called eyes on display (EOD).

[0088] The above-mentioned off-screen image is a changeable image. In one embodiment, the off-screen image is a picture including multiple layers, and the off-screen image can be changed by adjusting at least one of the multiple layers. In another embodiment, the off-screen image is an animation, and the animation can include multiple picture frames. The off-screen image can be changed by adjusting the currently displayed picture frame (for example, switching from the first frame to the last frame). The animation includes, for example, but not limited to, graphics interchange format (GIF), audio video interleaved format (AVI) and other formats.

[0089] The above-mentioned user status may include, but is not limited to, the angle of the user's head (relative to the electronic device, and the angles of the user's head described later are all relative to the electronic device), the position of the user's face (relative to the electronic device, and the positions of the user's face described later are all relative to the electronic device), user expressions, user operations (such as touch operations, gestures), user lines of sight, appearance characteristics (such as clothing, accessories, facial features, hairstyle), etc.

[0090] Exemplarily, the rotation may be a rotation around a preset central axis, and exemplary, the movement may be a translation.

[0091] In the present application, electronic devices may include, but are not limited to, mobile phones, tablet computers, handheld computers, desktop computers, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, cellular phones, personal digital assistants (PDAs), smart home devices such as smart TVs and smart cameras, wearable devices such as smart bracelets, smart watches, and smart glasses, extended reality (XR) devices such as augmented reality (AR), virtual reality (VR), and mixed reality (MR), in-vehicle devices, or smart city devices. The embodiments of the present application do not impose any special restrictions on the specific types of electronic devices.

[0092] Next, the structure of an exemplary electronic device provided by an embodiment of the present application is introduced.

[0093] FIG1 exemplarily shows a schematic diagram of the hardware structure of an electronic device 100 .

[0094] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a posture sensor 180M, etc.

[0095] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0096] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0097] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0098] Processor 110 may also include a memory for storing instructions and data. In one embodiment, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly retrieve it from the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0099] The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), etc. In another embodiment, the power management module 141 can also be set in the processor 110. In another embodiment, the power management module 141 and the charging management module 140 can also be set in the same device.

[0100] The wireless communication function of the electronic device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, a modem processor, and a baseband processor. In one embodiment, the electronic device 100 can connect and communicate with other electronic devices through the wireless communication function, and display the smart ring through the display screen of the other electronic device. In some examples, the other electronic device can be a wearable device, such as but not limited to a smart bracelet, a smart watch, smart glasses, etc. Displaying the smart ring on the wearable device allows users to more conveniently obtain event progress, further improving the efficiency of users in obtaining information.

[0101] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In another embodiment, the antenna can be used in conjunction with a tuning switch.

[0102] The mobile communication module 150 can provide wireless communication solutions for the electronic device 100, including second generation (2G), third generation (3G), fourth generation (4G), fifth generation (5G), and sixth generation (6G). The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor and convert them into electromagnetic waves for radiation via the antenna 1. In one embodiment, at least some of the functional modules of the mobile communication module 150 can be located in the processor 110. In another embodiment, at least some of the functional modules of the mobile communication module 150 and at least some of the modules of the processor 110 can be located in the same device.

[0103] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In one embodiment, the modem processor may be an independent device. In another embodiment, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0104] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0105] In one embodiment, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0106] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0107] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In one embodiment, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0108] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0109] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and transformed into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and other factors. It can also optimize parameters such as exposure and color temperature of the captured scene. In one embodiment, the ISP can be located within camera 193.

[0110] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In one embodiment, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0111] In one embodiment, the camera 193 may include a front camera and a rear camera. The front camera may be located on the side where the display screen 194 is located, for example, at the top or bottom of the display screen 194 , and the rear camera may be located on the back of the display screen 194 .

[0112] In one embodiment, the front camera can be used to capture the user's facial image in real time, and the real-time captured facial image can be sent to the processor 110. The processor 110 can determine whether the user's status has changed based on the user's facial image, such as whether the angle of the user's head has changed, whether the user's face has shifted, whether the user's expression has changed, whether a gesture has been performed, whether the gaze position has changed, whether the appearance features have changed, etc. When the user's status changes, the processor 110 can instruct the display screen 194 to adjust the displayed off-screen image accordingly. For example, when the angle of the user's head changes, the off-screen image also rotates accordingly.

[0113] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0114] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0115] The electronic device 100 can implement audio functions through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor. For example, music playback, recording, etc. The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In one embodiment, the audio module 170 can be set in the processor 110, or some functional modules of the audio module 170 can be set in the processor 110. The speaker 170A, also known as the "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A. The receiver 170B, also known as the "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be heard by placing the receiver 170B close to the human ear. Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In another embodiment, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In another embodiment, the electronic device 100 can also be provided with three, four or more microphones 170C to realize the collection of sound signals, noise reduction, identification of sound sources, and directional recording functions, etc. The headphone jack 170D is used to connect wired headphones.

[0116] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In one embodiment, pressure sensor 180A can be located on display screen 194. There are many types of pressure sensors 180A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force acts on pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the touch intensity based on pressure sensor 180A. Electronic device 100 can also calculate the touch location based on the detection signal from pressure sensor 180A. In one embodiment, touch operations applied to the same touch location but with different touch intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, a command to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, a command to create a new short message is executed.

[0117] The touch sensor 180K is also called a "touch-sensitive device." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In another embodiment, the touch sensor 180K can also be disposed on the surface of the electronic device 100, in a location different from that of the display screen 194.

[0118] In one embodiment, the pressure sensor 180A and / or the touch sensor 180K may be disposed in the display screen 194 to detect a touch operation on the display screen 194. When the pressure sensor 180A and / or the touch sensor 180K detects a touch operation (e.g., a sliding operation) on the display screen 194, the pressure sensor 180A and / or the touch sensor 180K may report the touch operation information to the processor 110. The processor 110 may instruct the display screen 194 to adjust the displayed off-screen image accordingly based on the touch operation information (e.g., operation type, sliding direction, sliding amplitude, etc.). For example, when the touch operation is a sliding operation, the off-screen image also rotates / moves accordingly.

[0119] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In one embodiment, the gyroscope sensor 180B can be used to determine the angular velocity of the electronic device 100 around three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can also be used for image stabilization, navigation, and somatosensory gaming scenarios. Optionally, the gyroscope sensor 180B can be provided on the circuit board of the electronic device 100.

[0120] Accelerometer 180E can detect the magnitude of acceleration of electronic device 100 in all directions (generally three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the electronic device's posture, but is not limited to this. It can also be applied to applications such as landscape / portrait screen switching and pedometers. Optionally, accelerometer 180E can be located on the circuit board of electronic device 100.

[0121] In one embodiment, the gyroscope sensor 180B and / or the accelerometer 180E can be used to detect whether the electronic device 100 has moved, thereby allowing the processor 110 to determine whether the relative position of the electronic device 100 and the user has changed, such as whether the angle of the user's head relative to the electronic device 100 has changed (also referred to as whether the angle of the electronic device 100 relative to the user has changed) or whether the user's face has shifted relative to the electronic device 100 (also referred to as whether the electronic device 100 has shifted relative to the user). When the relative position of the electronic device 100 and the user changes, the processor 110 can instruct the display screen 194 to adjust the displayed off-screen image accordingly.

[0122] The air pressure sensor 180C measures air pressure. The magnetic sensor 180D includes a Hall effect sensor, allowing the electronic device 100 to detect the opening and closing of the flip case. The distance sensor 180F measures distance. The fingerprint sensor 180H collects fingerprints. The temperature sensor 180J measures temperature. The ambient light sensor 180L senses ambient light brightness.

[0123] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The electronic device 100 emits infrared light through the light emitting diode. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100.

[0124] The posture sensor 180M can be used to detect the user status, such as but not limited to the angle of the user's head, the position of the user's face, the user's expression, gestures, the user's line of sight, etc. The detected user status can be used by the processor 110 to instruct the display screen 194 to adjust the displayed off-screen image.

[0125] This application does not limit the specific type of sensor used to detect the user status.

[0126] Keys 190 include a power button, volume button, and other buttons. Keys 190 can be mechanical or touch-sensitive. Electronic device 100 can receive key inputs and generate key signal inputs related to user settings and function control of electronic device 100. Motor 191 can generate vibration prompts. Indicator 192 can be an indicator light that can be used to indicate charging status, battery level changes, messages, missed calls, notifications, and more. SIM card interface 195 is used to connect a SIM card.

[0127] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a microservice architecture, or a cloud architecture. For example, the software system with a layered architecture can be an Android system, a Harmony operating system (OS), or other software systems. The embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100.

[0128] FIG2 exemplarily shows a schematic diagram of a software architecture of an electronic device 100 .

[0129] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In one embodiment, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0130] The application layer can include a series of application packages.

[0131] As shown in Figure 2, the application package may include applications such as camera, calendar, map, WLAN, music, short message, gallery, call, navigation, Bluetooth, video, and screen-off display. The screen-off display in this application can be an independent application or a functional component integrated into other applications, and this application does not limit this. The application in this application can also be replaced by other software such as mini-programs and atomic services.

[0132] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0133] As shown in FIG2 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0134] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0135] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0136] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0137] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0138] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0139] The notification manager enables applications to display notification information in the status bar. This can be used to convey notification-type messages and can disappear automatically after a short period of time without user interaction. For example, the notification manager is used to notify the completion of downloads, message reminders, etc. The notification manager can also be used to display notifications in the form of icons or scrolling text in the top status bar of the system, such as notifications from applications running in the background, or notifications that appear on the screen in the form of dialog windows. For example, a text message can be displayed in the status bar, a notification sound can be emitted, the electronic device 100 can vibrate, an indicator light can flash, etc.

[0140] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for scheduling and management of the Android system.

[0141] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0142] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0143] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0144] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0145] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0146] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0147] A 2D graphics engine is a drawing engine for 2D drawings.

[0148] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0149] The following is an example of the workflow of the software and hardware of the electronic device 100, combined with the screen-off display scenario.

[0150] The display screen 194 of the electronic device 100 is in the off-screen state. When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into an original input event (including touch coordinates, timestamp of the touch operation and other information). The original input event is stored in the kernel layer. The application framework layer obtains the original input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch single-click operation as an example, the off-screen display application calls the interface of the application framework layer to start the off-screen display, and then starts the display driver by calling the kernel layer, controls the display screen 194 to switch from the off-screen state to the AOD state, and displays the off-screen image through the display screen 194.

[0151] The following describes an application scenario involved in an embodiment of the present application and a user interface diagram for the scenario.

[0152] Scenario 1: The electronic device 100 is in the AOD state. When it detects that the user's head is turning (i.e., the angle of the user's head changes), the off-screen image displayed by the electronic device 100 can change accordingly (for example, rotate). For specific examples, please see Figures 3A-3E below.

[0153] FIG3A exemplarily shows a schematic diagram of an AOD interface.

[0154] As shown in Figure 3A, when the electronic device 100 is in the screen-off state, if it is detected that the user 200 is looking at the display screen (for example, the images captured by the front camera within a preset time period are all image 1), a user interface 310 can be displayed. The user interface 310 can be an AOD interface. The user interface 310 can include a screen-off image 311 and prompt information 312. The screen-off image 311 can include eyes and a mouth. The line of sight of the eyes in the screen-off image 311 can change, and the position and curvature of the mouth in the screen-off image can change. The prompt information 312 includes, for example, time, date, power level and other information. The electronic device 100 can obtain the angle of the user 200's head based on the image 1 of the user 200 captured by the front camera, and determine that the user 200's head is in the center position and has not rotated based on the obtained angle. At this time, the screen-off image 311 displayed by the electronic device 100 can remain unchanged.

[0155] In the present application, the angle of the user 200's head may be an actual angle obtained based on the relative positions of the user's face and the user's shoulders, but is not limited thereto. In other examples, it may also be the difference between the current actual angle and the initial angle (i.e., the actual angle obtained based on image 1 shown in FIG3A ). The present application does not limit this.

[0156] FIG3B exemplarily shows a schematic diagram of yet another AOD interface.

[0157] As shown in Figure 3B, the electronic device 100 can obtain the angle of the user 200's head based on the image 2 of the user 200 taken by the front camera, and determine that the user 200's head is turned to the left (with the user 200 as a reference) based on the angle. At this time, the electronic device 100 can display the user interface 320. The user interface 320 is similar to the user interface 310 shown in Figure 3A. The difference is that in the user interface 320, the line of sight of the eyes in the off-screen image 311 is to the left (with the user 200 as a reference, and to the right if the electronic device 100 is used as a reference), and the position of the mouth in the off-screen image 311 can be moved to the left (moving to the left is based on the user 200 as a reference, and moving to the right if the electronic device 100 is used as a reference), corresponding to the left rotation of the user 200's head.

[0158] FIG3C exemplarily shows a schematic diagram of yet another AOD interface.

[0159] As shown in Figure 3C, the electronic device 100 can obtain the angle of the user 200's head based on the image 3 of the user 200 captured by the front camera, and determine that the user 200's head is turned to the right (with the user 200 as a reference) based on the angle. At this time, the electronic device 100 can display a user interface 330. The user interface 330 is similar to the user interface 310 shown in Figure 3A. The difference is that in the user interface 330, the eyes in the off-screen image 311 are looking to the right (with the user 200 as a reference), and the position of the mouth in the off-screen image 311 can be moved to the right (with the user 200 as a reference), corresponding to the user 200's head turning to the right.

[0160] FIG3D exemplarily shows a schematic diagram of yet another AOD interface.

[0161] As shown in Figure 3D, the electronic device 100 can obtain the angle of the user 200's head based on the image 4 of the user 200 captured by the front camera, and determine that the user 200's head is raised upward based on the angle. At this time, the electronic device 100 can display a user interface 340. The user interface 340 is similar to the user interface 310 shown in Figure 3A. The difference is that in the user interface 340, the eyes in the off-screen image 311 look upward, and the position of the mouth in the off-screen image 311 can be moved upward, corresponding to the user 200's head being raised upward.

[0162] FIG3E exemplarily shows a schematic diagram of yet another AOD interface.

[0163] As shown in Figure 3E, the electronic device 100 can obtain the angle of the user 200's head based on the image 5 of the user 200 captured by the front camera, and determine that the user 200 is lowering his head based on the angle. At this time, the electronic device 100 can display a user interface 350. The user interface 350 is similar to the user interface 310 shown in Figure 3A. The difference is that in the user interface 350, the eyes in the off-screen image 311 look downward, and the position of the mouth in the off-screen image 311 can be moved downward, corresponding to the user 200 lowering his head.

[0164] The screen-off image 311 is not limited to the one shown in FIG3A to FIG3E . In other examples, other screen-off images may be used, such as the screen-off image 411 shown in FIG4A to FIG4E below, the screen-off image 512 shown in FIG5A below, the screen-off image 811 shown in FIG8A below, the screen-off image in the user interface 910 shown in FIG9A below, the screen-off image 931 shown in FIG9C below, the screen-off image 941 shown in FIG9D below, and the screen-off image 1221 shown in FIG12B below. This application does not limit the specific content of the screen-off image.

[0165] Figures 3A-3E illustrate the movement of the off-screen image as an example. In other examples, the off-screen image can also rotate around a preset central axis. For example, the off-screen image can be moved when it is a 2D image, and can be rotated when it is a 3D image. Examples of rotation can be found in Figures 4A-4E below. This application does not limit the way the off-screen image changes.

[0166] Scenario 2: The electronic device 100 is in the AOD state. When the position of the user's face is detected to move, the off-screen image displayed by the electronic device 100 can change accordingly (for example, move). For specific examples, please refer to Figures 4A-4E below.

[0167] FIG4A exemplarily shows a schematic diagram of yet another AOD interface.

[0168] As shown in Figure 4A, when the electronic device 100 is in the screen-off state, if it is detected that the user 200 is looking at the display screen (for example, the images captured by the front camera within a preset time period are all image 6), a user interface 410 can be displayed. The user interface 410 can be an AOD interface. The user interface 410 can include a screen-off image 411 and prompt information 412. The screen-off image 411 can include a background 411A and an astronaut cartoon character 411B (which can be simply referred to as astronaut 411B). The size of the background 411A in the screen-off image 411 can change, and the display ratio of the astronaut 411B in the screen-off image 411 can change. Specific examples can be found in Figures 6 and 7 below. Details are not provided for the time being. The display angle of the astronaut 411B in the screen-off image 411 can change (which can be understood as being rotatable). The prompt information 412 includes, for example, time, date, battery level and other information. The electronic device 100 can obtain the position 1 of the face of the user 200 based on the image 6 of the user 200 captured by the front camera, wherein the position 1 may include a longitudinal position 1-1 (e.g., the longitudinal position of the midpoint of the two eyes of the user 200) and a transverse position 1-2 (e.g., the transverse position of the tip of the nose of the user 200). The image 6 may be captured when the electronic device 100 detects that the user 200 is looking at the display screen, so the position 1 corresponding to the image 6 can be considered as the initial position of the face of the user 200. Subsequently, the electronic device 100 can continue to capture the facial image of the user 200 through the front camera and obtain the position of the face of the user 200 based on the captured image. For example, the facial position obtained based on the image captured again is still the initial position (i.e., position 1), that is, the position of the face of the user 200 remains unchanged (it can also be understood that compared to the initial position, the lateral displacement and the longitudinal displacement of the face of the user 200 are 0). At this time, the off-screen image 411 displayed by the electronic device 100 can remain unchanged.

[0169] FIG4B exemplarily shows a schematic diagram of yet another AOD interface.

[0170] As shown in Figure 4B, the electronic device 100 can obtain the position 2 of the user 200 face based on the image 7 of the user 200 captured by the front camera, wherein the position 2 is at the longitudinal position 2-1, and is located to the right of the longitudinal position 1-1 of the initial position (i.e., position 1) (with reference to image 7). The electronic device 100 can determine that the user 200 face has moved to the left compared to the initial position based on the relationship between position 1 and position 2 (with reference to the user 200). At this time, the electronic device 100 can display the user interface 420. The user interface 420 is similar to the user interface 410 shown in Figure 4A, except that the astronaut 411B in the off-screen image 411 shown in the user interface 420 is rotated to the left (rotating to the left is based on the user 200, and rotating to the right if based on the electronic device 100), corresponding to the leftward movement of the user 200 face.

[0171] FIG4C is a schematic diagram showing another AOD interface.

[0172] As shown in Figure 4C, the electronic device 100 can obtain the position 3 of the user 200 face based on the image 8 of the user 200 captured by the front camera, wherein the position 3 is at the longitudinal position 3-1, and is located to the left of the longitudinal position 1-1 of the initial position (i.e., position 1) (with reference to image 8). The electronic device 100 can determine that the user 200 face has moved to the right compared to the initial position based on the relationship between position 1 and position 3 (with reference to the user 200). At this time, the electronic device 100 can display the user interface 430. The user interface 430 is similar to the user interface 410 shown in Figure 4A, except that the astronaut 411B in the off-screen image 411 shown in the user interface 430 rotates to the right (with reference to the user 200), corresponding to the rightward movement of the user 200 face.

[0173] FIG4D exemplarily shows a schematic diagram of yet another AOD interface.

[0174] As shown in Figure 4D, the electronic device 100 can obtain the position 4 of the user 200 face based on the image 8 of the user 200 captured by the front camera, wherein the position 4 is at the horizontal position 4-2, and is located on the upper side of the horizontal position 1-2 of the initial position (i.e., position 1). The electronic device 100 can determine that the user 200 face has moved upward compared to the initial position based on the relationship between position 1 and position 4. At this time, the electronic device 100 can display a user interface 440. The user interface 440 is similar to the user interface 410 shown in Figure 4A, except that the astronaut 411B in the off-screen image 411 shown in the user interface 440 rotates upward, corresponding to the upward movement of the user 200 face.

[0175] FIG4E exemplarily shows a schematic diagram of yet another AOD interface.

[0176] As shown in Figure 4E, the electronic device 100 can obtain the position 5 of the user 200 face based on the image 9 of the user 200 captured by the front camera, wherein the position 5 is at the horizontal position 5-2, and is located below the horizontal position 1-2 of the initial position (i.e., position 1). The electronic device 100 can determine that the user 200 face has moved downward compared to the initial position based on the relationship between position 1 and position 5. At this time, the electronic device 100 can display a user interface 450. The user interface 450 is similar to the user interface 410 shown in Figure 4A, except that the astronaut 411B in the off-screen image 411 shown in the user interface 450 rotates downward, corresponding to the downward movement of the user 200 face.

[0177] Scenario 2 is illustrated by taking the change in the position of the user's face as the movement of the user's face in the current plane (the distance between the user's face and the electronic device remains unchanged) as an example. In another embodiment, the change in the position of the user's face may also be a change in the distance between the user's face and the electronic device. In some examples, when the electronic device 100 detects that the user's face is closer to the electronic device 100, the off-screen image may be controlled to become larger. When the electronic device 100 detects that the user's face is farther away from the electronic device, the off-screen image may be controlled to become smaller. For example, after the off-screen image becomes larger, the off-screen image displayed on the display may include partial or full content. For example, the electronic device 100 may detect whether the distance between the user's face and the electronic device 100 has changed based on the size of the user's face in the image captured by the front camera.

[0178] Scenario 3: The electronic device 100 is in the AOD state. When the electronic device 100 moves but the user's face remains motionless (it can also be understood that the relative angle and / or position of the user's face and the electronic device 100 changes), the off-screen image displayed by the electronic device 100 can change accordingly.

[0179] In one embodiment, the angle of the user's head and the position of the user's face can remain unchanged, and the user can operate the electronic device 100 to rotate relative to the user's face. For example, in the embodiment shown in FIG3A , the electronic device 100 can obtain the angle of the electronic device 100 relative to the user 200 based on the captured image 1, which can be understood as the initial angle. Then, the user 200 can remain motionless, and the electronic device 100 can rotate right relative to the user 200 (rotating right is based on the user 200 as a reference, and rotating left with the electronic device 100 as a reference). In this case, the electronic device 100 can capture the image 2 shown in FIG3B through the front camera, and determine based on image 2 that the angle of the electronic device 100 relative to the user 200 has changed compared to the initial angle. Based on the change in the angle, it is determined that the electronic device 100 has rotated right relative to the user 200 (with the user 200 as a reference). At this time, the electronic device 100 can display the user interface 320 shown in FIG3B , and the screen-off image 311 in the user interface 320 is rotated left.

[0180] In another embodiment, the angle of the user's head and the position of the user's face can remain unchanged, and the user can operate the electronic device 100 to translate relative to the user's face. For example, in the embodiment shown in FIG4A , the electronic device 100 can obtain the position of the electronic device 100 relative to the user 200 based on image 6, which can be understood as the initial position. Then, the user 200 can remain motionless, and the electronic device 100 can translate to the right relative to the user 200 (translation to the right is based on the user 200 as a reference, and translation to the left is based on the electronic device 100 as a reference). In this case, the electronic device 100 can capture the image 7 shown in FIG4B through the front camera, and determine based on image 7 that the electronic device 100 has translated to the right relative to the user 200 (based on the user 200 as a reference) compared to the initial position. At this time, the electronic device 100 can display the user interface 420 shown in FIG4B , and the off-screen image 411 in the user interface 420 is rotated to the left.

[0181] The above example scenarios are illustrated with the rotation direction of the user 200 / electronic device 100 and the movement mode of the user 200 / electronic device 100 including upward, downward, left and right. In other examples, it can also be upper left, lower left, upper right, lower right. Correspondingly, the change direction of the off-screen image can also be upper left, lower left, upper right or lower right. This application does not limit this.

[0182] Scenario 4: The electronic device 100 is in the AOD state. When the electronic device 100 detects a change in the user's expression, the off-screen image displayed by the electronic device 100 may change accordingly.

[0183] In one embodiment, the electronic device 100 can control the off-screen image to rotate, move, or perform other changes according to changes in the user's facial expressions. For a specific example, see FIG5A below.

[0184] FIG5A is a schematic diagram showing another AOD interface.

[0185] As shown in FIG5A , electronic device 100 detects that user 200 is looking at the display screen (for example, the images captured by the front camera for a preset duration are all image 1 shown in FIG3A ), and may display user interface 510. User interface 510 may be an AOD interface. User interface 510 may include time 511 and an off-screen image 512. The content of off-screen image 512 may vary. Electronic device 100 may capture image 10 of user 200 via the front camera, and may detect from image 10 that user 200 is squinting their right eye (which may also be understood as a change from the expression shown in image 1 to squinting their right eye). Based on the current expression (i.e., squinting their right eye) / change in expression, electronic device 100 may control off-screen image 512 to rotate rightward, switching the content of off-screen image 512 from "just love me" shown in user interface 510 to other content (e.g., the current date "Monday May 01"). This may also be understood as the content "just love me" switching from a displayed state to a hidden state, and the other content switching from a hidden state to a displayed state.

[0186] In one embodiment, the electronic device 100 can control the expression shown in the off-screen image according to the user's expression. The expression shown in the off-screen image can change with the change of the user's expression. The expression shown in the off-screen image and the user's expression can remain consistent. Specific examples can be seen in Figures 5B-5E below.

[0187] FIG5B exemplarily shows a schematic diagram of yet another AOD interface.

[0188] As shown in Figure 5B, when the electronic device 100 is in the AOD state, it can obtain the user's expression based on the image 11 of the user taken by the front camera, and display the user interface 520 based on the expression. The user interface 520 is similar to the user interface 310 shown in Figure 3A. Since the user shown in image 11 has no expression (eyes open and the curvature of the mouth is straight), the expression shown in the off-screen image 311 in the user interface 520 is eyes open and the curvature of the mouth is straight.

[0189] Figure 5C is a schematic diagram illustrating another exemplary AOD interface. Figure 5C is similar to Figure 5B, except that in Figure 5C, the image of the user captured by the front camera of the electronic device 100 is image 12. Since the user expression shown in image 12 is a smile, the expression shown in the off-screen image 311 in the user interface 530 displayed by the electronic device 100 based on image 12 is an open-eyed expression with an upwardly curved mouth.

[0190] Figure 5D illustrates another exemplary AOD interface. Figure 5D is similar to Figure 5B, except that in Figure 5D, the image of the user captured by the front camera of the electronic device 100 is image 13. Since the user expression shown in image 13 is eyes closed and the curvature of the mouth is straight, the expression shown in the off-screen image 311 in the user interface 540 displayed by the electronic device 100 based on image 13 is eyes closed and the curvature of the mouth is straight.

[0191] Figure 5E is a schematic diagram of another AOD interface. Figure 5E is similar to Figure 5B, except that in Figure 5E, the image of the user captured by the front camera of the electronic device 100 is image 14. Since the user expression shown in image 14 is angry (the tails of the eyes and eyebrows are upward, the beginnings of the eyes and eyebrows are downward, and the corners of the mouth are curved downward), the expression shown in the screen-off image 311 in the user interface 550 displayed by the electronic device 100 based on image 14 is the tails of the eyes upward, the beginnings of the eyes are downward, and the corners of the mouth are downward.

[0192] Scenario 5: The electronic device 100 is in the AOD state, and the electronic device 100 can control the displayed screen-off image according to the user operation. In one case, when the electronic device 100 detects that the user performs a preset gesture action, the screen-off image displayed by the electronic device 100 can change accordingly. Specific examples can be seen in Figures 6 and 7 below. In another case, the electronic device 100 can control the displayed screen-off image according to the user's touch operation on the display screen. Specific examples can be seen in Figures 8A and 8B below.

[0193] In one embodiment, when the user performs gesture 1, the electronic device 100 can display the start animation of the screen-off image. When the user performs gesture 2, the electronic device 100 can display the end animation of the screen-off image. Specific examples can be seen in Figures 6 and 7 below, where the start animation can be the change effect within a period of time after the screen-off image starts to change, and the end animation can be the change effect within a period of time before the screen-off image stops changing. Between the start animation and the end animation, the screen-off image can change with changes in the user's status, for example, with changes in the angle of the user's head / the displacement of the user's face.

[0194] FIG6 exemplarily shows a schematic diagram of yet another AOD interface.

[0195] As shown in FIG6(A), when electronic device 100 is in the screen-off state, if it detects that user 200 is looking at the display screen, user interface 610 may be displayed. User interface 610 is similar to user interface 410 shown in FIG4A, except that screen-off image 411 shown in user interface 610 includes only background 411A and does not include astronaut 411B. When electronic device 100 detects that user 200 performs gesture 1 (e.g., an OK gesture), it may display the start animation of screen-off image 411, such as the appearance of astronaut 411B (which can also be understood as astronaut 411B switching from a hidden state to a visible state). During this process, background 411A may gradually decrease in size, and the display ratio of astronaut 411B (i.e., the proportion of astronaut 411B in the entire screen-off image) may gradually increase (starting from 0). Some interface examples of this process can be seen in FIG6(B), (C), and (D).

[0196] As shown in FIG6(B), electronic device 100 may display user interface 620. User interface 620 is similar to user interface 610, except that background 411A in user interface 620 is smaller and includes astronaut 411B. As shown in FIG6(C), electronic device 100 may display user interface 630. User interface 630 may be displayed after user interface 620. User interface 630 is similar to user interface 620, except that background 411A in user interface 630 is smaller and astronaut 411B is displayed at a larger scale. As shown in FIG6(D), electronic device 100 may display user interface 640. User interface 640 may be displayed after user interface 630. User interface 640 is similar to user interface 630, except that background 411A in user interface 640 is smaller and astronaut 411B is displayed at a larger scale. In some examples, when electronic device 100 displays user interface 640, if it detects a change in the user's status, it may control the screen-off image 411 to change accordingly. For specific examples, see FIG6(D).

[0197] FIG7 exemplarily shows a schematic diagram of yet another AOD interface.

[0198] As shown in FIG7 (A), when the electronic device 100 is in the AOD state, a user interface 710 may be displayed. For an explanation of the user interface 710, reference may be made to the explanation of the user interface 410 shown in FIG4A. For example, the user interface 710 may be the user interface 640 shown in FIG6 (D). When the electronic device 100 detects that the user 200 performs gesture 2 (e.g., a gesture of waving the hand back and forth), the end animation of the screen-off image 411 may be displayed, such as the process of the astronaut 411B disappearing (which may also be understood as the astronaut 411B switching from a display state to a hidden state). During this process, the background 411A may gradually increase in size, and the display ratio of the astronaut 411B may gradually decrease (to a minimum of 0). For some interface examples of this process, reference may be made to FIG7 (B), (C), and (D). The user interface 720 shown in (B) of Figure 7 is the user interface 630 shown in (C) of Figure 6 , the user interface 730 shown in (C) of Figure 7 is the user interface 620 shown in (B) of Figure 6 , and the user interface 740 shown in (D) of Figure 7 is the user interface 610 shown in (A) of Figure 6 .

[0199] Not limited to the above-mentioned embodiment, in another embodiment, when the user performs gesture 3, the electronic device 100 may also control the off-screen image to rotate, move, or other changes. For example, when the electronic device 100 detects that the user performs a left and right waving gesture, it may control the off-screen image 411 in the user interface 410 shown in FIG4A to rotate left and right. In another embodiment, when the user performs gesture 4, the electronic device 100 may control the off-screen image to remain unchanged. For example, the situation where the off-screen image changes within a period of time before the user performs gesture 4 can be understood as gesture 4 being used to trigger the pause of the change process of the off-screen image. Optionally, when the user subsequently performs gesture 5, the electronic device 100 may control the off-screen image to continue to change, which can be understood as gesture 5 being used to trigger the continuation of the change process of the off-screen image.

[0200] Not limited to the gestures in the above examples, in other examples, the user's gestures may also include an O-shaped gesture, an open palm, an open back of the hand, etc. This application does not limit the type of gesture action.

[0201] FIG8A is a schematic diagram showing another AOD interface.

[0202] As shown in FIG8A , when the electronic device 100 is in the AOD state, a user interface 810 may be displayed. The user interface 810 may include an off-screen image 811 and a date and power level 812. The off-screen image 811 may include a background 811A and a pattern 811B with time information, which may give the user the feeling that "the pattern 811B is contained in the background 811A". The positions of the background 811A and the pattern 811B may change, and the angle of the pattern 811B may change. The electronic device 100 may receive a touch operation of the user on the display screen, such as an operation of tapping the display screen with a knuckle. In response to the touch operation, the electronic device 100 may control the off-screen image 811 to change, such as to move left and right. The moving directions of the background 811A and the pattern 811B may be different, giving the user the feeling that "the pattern 811B in the off-screen image 811 shakes when the display screen is tapped".

[0203] FIG8B exemplarily shows a schematic diagram of yet another AOD interface.

[0204] As shown in Figure 8B, the electronic device 100 can display the user interface 810 shown in Figure 8A. The electronic device 100 can receive a touch operation of the user on the display screen, and the touch operation is, for example, a sliding operation. The electronic device 100 can respond to the touch operation to control the change of the screen-off image 811. For example, the moving direction of the screen-off image 811 is consistent with the moving direction of the touch operation. Figure 8B illustrates the touch operation as sliding from left to right, and accordingly, the screen-off image 811 moves from left to right as an example.

[0205] Not limited to the user operations in the above examples, in other examples, when the electronic device 100 receives the user's voice input, it can control the corresponding changes of the off-screen image according to the voice input. For example, in the scenario shown in Figure 6, the OK gesture can be replaced by the voice input "start playing". This application does not limit the type of user operation used to control the displayed off-screen image.

[0206] Scenario 6: The electronic device 100 is in the AOD state. The electronic device 100 can control the displayed screen-off image according to the user's line of sight. When the electronic device 100 detects that the position of the gaze has changed, the screen-off image displayed by the electronic device 100 can change accordingly.

[0207] In one embodiment, the electronic device 100 can present the location where the user's gaze is looking through an off-screen image. Specific examples can be seen in Figures 9A, 9B, and 9C below, where Figures 9A and 9B present the location where the user's gaze is looking through "where light converges", and Figure 9C presents the location where the user's gaze is looking through a cartoon image.

[0208] In one embodiment, the electronic device 100 can control the state of the off-screen image according to the position where the user's line of sight is looking. Specific examples can be seen in Figures 9A, 9B, and 9D below, where Figures 9A and 9B control whether the off-screen image is lit up according to whether the position where the user's line of sight is looking is the position where the off-screen image is located, and Figure 9D controls the changing direction of the off-screen image according to the moving direction of the position where the user's line of sight is looking (which can be simply referred to as the line of sight direction).

[0209] FIG9A is a schematic diagram showing another AOD interface.

[0210] As shown in FIG9A , when electronic device 100 is in the AOD state, it may display user interface 910. User interface 910 may include multiple off-screen images, such as images 911, 912, 913, 914, 915, and 916. Images 911, 912, and 913 are off-screen light bulbs, images 914 and 915 are light-emitting lamps, and image 916 is the point where the light emitted by images 914 and 915 converge. Position 1 at which image 916 is located is the position detected by electronic device 100 where user 200 is looking. When electronic device 100 detects that the position at which user 200 is looking has moved to another position, such as position 2 in user interface 910 other than the positions of images 911, 912, and 913, electronic device 100 may control the light changes of images 914 and 915 and the position change of image 916 so that the light emitted by images 914 and 915 converges at position 2 (i.e., image 916 is located at position 2).

[0211] FIG9B exemplarily shows a schematic diagram of yet another AOD interface.

[0212] As shown in FIG9B , when the electronic device 100 is in the AOD state, a user interface 920 may be displayed. The user interface 920 is similar to the user interface 910 shown in FIG9A , except that the location detected by the electronic device 100 as being the gaze of the user 200 is not position 1, but the location of image 912. Therefore, in the user interface 920, the light emitted by images 914 and 915 converges at the location of image 912, that is, image 916 is located at the location of image 912. Furthermore, image 912 in the user interface 920 is in a lit state. This means that when the user 200 is not looking at image 912, image 912 is in an off state (e.g., image 912 shown in the user interface 910). When the user 200 is looking at image 912, image 912 is in a lit state (e.g., image 912 shown in the user interface 920). The descriptions of images 911 and 913 are similar to those of image 912. In some examples, after the implementation shown in Figure 9B, the location where the user 200 is looking changes and is no longer the location where image 912 is located. The electronic device 100 can control image 912 to turn off. When the electronic device 100 detects that the location where the user 200 is looking is the location where image 911 is located, the electronic device 100 can control image 911 to light up, and control the light emitted by images 914 and 915 to converge at the location where image 911 is located, that is, image 916 is located at the location where image 911 is located.

[0213] FIG9C is a schematic diagram showing another AOD interface.

[0214] As shown in Figure 9C, when the electronic device 100 is in the AOD state, a user interface 930 can be displayed. The user interface 930 can include an off-screen image 931. The off-screen image 931 is a cartoon image of a puppy. The position 3 where the off-screen image 931 is located is the position where the electronic device 100 detects that the user 200 is looking at a certain position. When the electronic device 100 detects that the position where the user 200 is looking at a certain position has moved to another position (for example, position 4), the electronic device 100 can control the off-screen image 931 to move to position 4.

[0215] FIG9D exemplarily shows a schematic diagram of yet another AOD interface.

[0216] As shown in Figure 9D, when the electronic device 100 is in the AOD state, a user interface 940 can be displayed. The user interface 940 can include an off-screen image 941. The off-screen image 941 can be a launched rocket. The off-screen image 941 is located at position 5 on the lower side of the user interface 940. When the electronic device 100 detects that the position where the user 200 is looking has moved upward (i.e., the direction of sight is upward), the electronic device 100 can control the off-screen image 941 to move upward, for example, from position 5 to position 6, and then from position 6 to position 7, giving the user a feeling of "rocket launch". In some examples, during the upward movement of the off-screen image 941, the off-screen image 941 can gradually become smaller. Without limitation, the shape and pattern of the off-screen image 941 can also change. This is not limited in the present application. This can provide a more vivid "rocket launch" effect.

[0217] It can be understood that when the user 200 looks at a certain position, the display mode of the corresponding off-screen image can be static or dynamic (i.e., display animation). For example, in Figure 9B, when the user 200 looks at image 912, image 912 can remain in a lit state, which can be understood as a static display mode. Alternatively, image 912 can be in a flashing state, that is, a state in which the lit state and the off-screen state alternate, which can be understood as a dynamic display mode.

[0218] It can be understood that when the user 200 looks at different positions, the display mode of the corresponding off-screen image may be different. For example, in Figure 9D, when the user 200 looks at position 5, position 6 and position 7, the sizes of the corresponding off-screen images 941 displayed at these positions are different. For example, in Figure 9C, when the user 200 looks at position 3, the "exit" / "disappearance" animation of the off-screen image 931 (puppy) can be displayed at position 3, and when the user 200 looks at position 4, the "entry" / "appearance" animation of the off-screen image 931 (puppy) can be displayed at position 4. The embodiments of the present application do not limit the specific display mode.

[0219] In one embodiment, when the electronic device 100 displays the AOD interface, if it is detected that the user is not looking at the display screen and the duration is greater than or equal to a preset time length, the display screen can be controlled to turn off. Optionally, when the electronic device 100 subsequently detects that the user is looking at the display screen, the display screen can be controlled to display the AOD interface again. Examples of the AOD interface can be found in the AOD interfaces in the above-mentioned scenarios 1-6.

[0220] In one embodiment, when the electronic device 100 displays the AOD interface, if it detects that an object is approaching (for example, through a proximity light sensor), the display screen can be controlled to turn off. Optionally, if the electronic device 100 subsequently detects that the object has left, the display screen can be controlled to display the AOD interface again. Examples of the AOD interface can be found in the AOD interfaces in the above-mentioned scenarios 1-6.

[0221] In one embodiment, after the electronic device 100 enters the AOD state, it can first display the start animation of the screen-off image. In some examples, when the electronic device 100 is in the screen-off state, if it detects that the user is looking at the display screen, it can enter the AOD state and display the start animation of the screen-off image. Assuming that the screen-off image is the screen-off image 411 shown in Scene 2 and Scene 5, the start animation of the screen-off image 411 can be the process of astronaut 411B appearing. An interface example of this process can be seen in Figure 6, which includes, in order from early to late time: the user interface 610 shown in Figure 6 (A), the user interface 620 shown in Figure 6 (B), the user interface 630 shown in Figure 6 (C), and the user interface 640 shown in Figure 6 (D).

[0222] In one embodiment, before the electronic device 100 cancels the AOD state, the end animation of the screen-off image can be displayed first. In some examples, when the electronic device 100 is in the AOD state, if a preset event is detected (for example, the user is not looking at the display screen and the duration is greater than or equal to the preset time, an object approaches, a user operation is received, etc.), the end animation of the screen-off image can be displayed first. Assuming that the screen-off image is the screen-off image 411 shown in scene 2 and scene 5, the end animation of the screen-off image 411 can be the process of astronaut 411B disappearing. An interface example of this process can be seen in Figure 7, which includes, in order from early to late time: user interface 710 shown in Figure 7 (A), user interface 720 shown in Figure 7 (B), user interface 730 shown in Figure 7 (C), and user interface 740 shown in Figure 7 (D), and then switches to the screen-off state or screen-on state corresponding to the preset event.

[0223] In one embodiment, the screen-off image in the AOD state can be selected by the user through the setting interface of the electronic device 100. Specific examples can be seen in Figures 10A, 10B, and 10C below. Optionally, the user can also preview the process of the screen-off image in the AOD state changing with the user status through the setting interface. The specific process is similar to the above-mentioned scenes 1 to 6, with the difference that the screen-off image is not displayed on the AOD interface, but on the setting interface.

[0224] FIG10A is a schematic diagram showing an exemplary setting interface.

[0225] As shown in FIG10A , electronic device 100 may display user interface 1010. For example, user interface 1010 is a user interface for a settings application. User interface 1010 may include a title "Off Screen Display," settings information 1011, settings information 1012, and multiple categories. Settings information 1011 may include the function name "Off Screen Display," a function description of "Displaying time, date, text message and call reminders, and other information when the screen is off," and a control 1011A. Control 1011A may be used to turn the "Off Screen Display" function on or off. Settings information 1012 may be used to set the display mode of the "Off Screen Display" function, such as the "All-Day Display" shown in user interface 1010. Any of the multiple categories may include at least one image that can be selected as an off-screen image (referred to as a candidate image). For example, the multiple categories include category 1013 for personalized pictures, category 1014 for artistic styles, and category 1015 for watch face clocks. For example, image 1013A under category 1013 is selected, indicating that the currently selected off-screen image is image 1013A.

[0226] In one embodiment, the electronic device 100 can receive a user operation on any category in the user interface 1010 (for example, a click operation on category 1013), and display detailed information of the category in response to the user operation. For a specific example, see Figure 10B below.

[0227] As shown in Figure 10B, electronic device 100 may display user interface 1020. For example, user interface 1020 is the user interface for a settings application. User interface 1020 may include the title "Personalized Pictures," indicating that the current interface is used to display detailed information about a personalized picture category. User interface 1020 may include multiple candidate images under the personalized picture category, such as image 1013A and image 1013B. In response to a user action (e.g., a click) on any of these multiple candidate images, electronic device 100 may display the candidate image in area 1021 of user interface 1020. For example, after image 1013B is selected, area 1021 displays image 1013B. Area 1021 can be understood as a simulated AOD interface. User interface 1020 may include a prompt message "You can control image changes by rotating or moving your face," to remind the user of relevant AOD functions. When electronic device 100 detects a change in user status, image 1013B displayed in area 1021 may change accordingly. The specific examples are similar to those in scenarios 1-6 above and will not be repeated here. The user interface 1020 may further include a control 1022, which may be used to upload pictures or videos, and the uploaded pictures or videos may be used by the electronic device 100 to obtain corresponding candidate images. The user interface 1020 also includes a control 1023, which may be used to turn on or off the function of "displaying time and date on the AOD interface". When the control 1023 is on, the area 1021 and the AOD interface may display the time and date. The user interface 1020 also includes a control 1024, which may be used to set the state of the setting options of the AOD function to the state of the setting options shown in the user interface 1020. For example, the electronic device 100 may respond to a user operation (such as a click operation) on the control 1024, set the image 1013B currently displayed in the area 1021 to an off-screen image, and turn on the function of "displaying time and date on the AOD interface".

[0228] Figures 10A and 10B illustrate an example in which a user selects an off-screen image from multiple preset candidate images. In other examples, the user can also choose to associate an account and set the character image of the associated account as the off-screen image. For specific examples, see Figure 10C below.

[0229] FIG. 10C exemplarily shows a schematic diagram of another setting interface.

[0230] As shown in FIG10C , electronic device 100 may display user interface 1030. In some examples, user interface 1030 may be displayed in response to a user operation on the "Associate Family Members" setting information (not shown) in user interface 1010 shown in FIG10A . User interface 1030 may include a title "Off-Screen Display" and setting information 1031. Setting information 1031 may include the function name "Associate Family Members," the function description "Use cartoon avatars of family members as off-screen images," and a control 1031A for turning the "Associate Family Members" function on or off. When the "Associate Family Members" function is enabled, user interface 1030 may display a list 1032 and a preview area 1033. List 1032 may include setting options for associated family members, such as a setting option for "Daughter," a setting option 1032A for "Husband," and a setting option for "Mom." For example, setting option 1032A in user interface 1030 is selected, indicating that the cartoon avatar of "Husband" has been selected as the off-screen image. The electronic device 100 can obtain the facial image of the selected family member "husband" from the cloud, generate a cartoon image based on the facial image, and generate an off-screen image based on the cartoon image. When the electronic device 100 is in the AOD state, the off-screen image generated above can be displayed. The electronic device 100 can also display the off-screen image generated above through the preview area 1033. When the electronic device 100 detects a change in the user status, the image displayed in the preview area 1033 can change accordingly. The specific example is similar to the above-mentioned scenarios 1-6 and will not be repeated here.

[0231] Not limited to the example of FIG10C , in other examples, the real person image of the associated account may also be used as the screen-off image. This application does not limit the specific method of generating the screen-off image based on the images of the associated family members.

[0232] In another embodiment, the screen-off image in the AOD state may also be obtained based on an image (such as a picture or video) uploaded by the user. For specific examples, see Figures 11A and 11B below.

[0233] In some examples, the electronic device 100 can display multiple pictures (e.g., pictures stored in the electronic device 100) in response to a user operation (e.g., a click operation) on the control 1022 in the user interface 1020 shown in Figure 10B. The electronic device 100 can display a settings interface for picture 1 in response to a user operation (e.g., a click operation) on any one of the multiple pictures (which can be referred to as picture 1). For details, please refer to the user interface 1110 shown in Figure 11A.

[0234] As shown in Figure 11A, user interface 1110 may include a title "Customized Personalized Picture", picture 1111 (i.e., picture 1 uploaded by the user), controls 1112, and controls 1113. Picture 1111 may include person 1111A. Person 1111A may be an image of a real person or an image of a cartoon character. The following description is made using person 1111A as an example of an image of a real person. Control 1112 may be used to trigger the generation of candidate images based on picture 1111 (in this case, the person in the candidate image is a real person), and control 1113 may be used to trigger the generation of candidate images based on the cartoon image corresponding to picture 1111 (in this case, the person in the candidate image is a cartoon character). In some examples, electronic device 100 may generate a cartoon image based on picture 1111 (e.g., a cartoon character corresponding to person 1111A) in response to a user operation (e.g., a click operation) on control 1113, and generate a candidate image that can be selected as the screen-off image based on the cartoon image. Electronic device 100 may display the generated candidate images. For specific examples, see user interface 1120 shown in Figure 11B.

[0235] As shown in FIG11B , user interface 1120 is similar to user interface 1020 shown in FIG10B , except that the candidate images under the personality picture category shown in user interface 1120 also include image 1121. Image 1121 is a cartoon image generated based on image 1111 shown in FIG11A , and the cartoon character shown in image 1121 is generated based on character 1111A in image 1111. It can be understood that the cartoon character shown in image 1121 is a cartoon image of character 1111A. Furthermore, image 1121 is selected in user interface 1120, so area 1021 in user interface 1120 can display image 1121. When electronic device 100 detects a change in user status, image 1121 displayed in area 1021 can change accordingly. The specific examples are similar to those in scenarios 1 to 6 above and will not be repeated here.

[0236] The above examples are illustrated by using the example of users uploading images of people. In other examples, users can also upload images of animals. In other examples, users can also upload images of objects. The electronic device 100 can directly generate candidate images based on the uploaded pictures, or generate cartoon images based on the uploaded images (for example, generate cartoon images corresponding to animals, generate cartoon images corresponding to objects) and generate candidate images based on the cartoon images. In other examples, users can also upload other images, such as images obtained by screenshots or recordings of the interface displayed by the electronic device 100. This application does not limit the images uploaded by users.

[0237] In another embodiment, the screen-off image in the AOD state can also be obtained based on the image (such as a picture or video) captured by the electronic device 100 through the camera. For specific examples, please refer to Figures 12A and 12B below.

[0238] FIG12A exemplarily shows a schematic diagram of another setting interface.

[0239] As shown in Figure 12A, the electronic device 100 can display a user interface 1210. The user interface 1210 is similar to the user interface 1010 shown in Figure 10A, except that the candidate image shown in the user interface 1210 is not selected. The user interface 1210 also includes setting information 1211. The setting information 1211 may include the function name "Automatic Face Animation", the function description "The image displayed when the screen is off is automatically generated based on the face captured by the camera" and the control 1211A. The control 1211A is used to turn on or off the "Automatic Face Animation" function. For example, when the control 1211A in the user interface 1210 is on, after the "Automatic Face Animation" function is turned on, the electronic device 100 can capture images through the camera (for example, the user's face image is captured through the front camera) and generate an off-screen image based on the captured image when in the AOD state, and display the generated off-screen image on the AOD interface. For a specific example, see Figure 12B below.

[0240] FIG12B is a schematic diagram showing another AOD interface.

[0241] As shown in FIG12B , when the electronic device 100 is in the AOD state, it can capture a facial image of the user 200, such as image 15, through the front camera. The electronic device 100 can display a user interface 1220 based on the captured image 15. The user interface 1220 can include an off-screen image 1221 and time and date information. The off-screen image 1221 can be generated based on image 15. The person shown in the off-screen image 1221 is a cartoon character generated based on the real person shown in image 15. When the electronic device 100 detects a change in the state of the user 200, it can control the change of the off-screen image 1221. The specific examples are similar to those in the above-mentioned scenarios 1 to 6 and are not repeated here.

[0242] In one embodiment, a user can set the display mode of the screen-off display through the setting interface of the electronic device 100. In some examples, the electronic device 100 can display the setting interface of the screen-off display mode in response to a user operation (such as a click operation) on the setting information 1012 in the user interface 1010 shown in Figure 10A. Specific examples can be found in Figures 13A and 13B below.

[0243] FIG13A exemplarily shows a schematic diagram of another setting interface.

[0244] As shown in Figure 13A, the electronic device 100 can display a user interface 1310, which may include a title "Display Mode" and setting information for multiple display modes. The multiple setting information may include, for example, setting information 1311 for "Smart Display", setting information 1312 for "Scheduled Display" and setting information 1313 for "All-Day Display", wherein the setting information 1311 may include a description of the "Smart Display" mode "When the screen is touched or human eye gaze is detected, the off-screen display appears", and a control 1311A for selecting the "Smart Display" mode; the setting information 1312 may include a control 1312A for selecting the "Scheduled Display" mode; the setting information 1313 may include a description of the "All-Day Display" mode "When the battery level is less than 10%, the off-screen display does not appear", and a control 1313A for selecting the "All-Day Display" mode. For example, the control 1313A in the user interface 1310 is in the selected state, indicating that the currently selected off-screen display mode is "all-day display". In this case, when the battery level of the electronic device 100 is greater than or equal to 10%, it can be in the AOD state except for the screen-on state, and will not enter the screen-off state.

[0245] Without being limited to the above example, in other examples, the electronic device 100 may also select the "smart display" mode as the screen-off display mode in response to a user operation (such as a click operation) on the control 1311A in the user interface 1310. In this case, when the electronic device 100 is in the screen-off state, if it detects that a person is looking at the display screen or touching the display screen, it may enter the AOD state. In other examples, the electronic device 100 may also select the "timed display" mode as the screen-off display mode in response to a user operation (such as a click operation) on the control 1312A in the user interface 1310, and may display the setting information of the screen-off display time. For specific examples, see the user interface 1320 shown in Figure 13B below.

[0246] As shown in Figure 13B, the user interface 1320 is similar to the user interface 1310 shown in Figure 13A, except that the control in the selected state in the user interface 1320 is control 1312A, and the setting information 1312 in the user interface 1320 also includes a setting option 1312B for the start time of the screen-off display and a setting option 1312C for the end time. For example, setting option 1312B is set to 7 a.m. and setting option 1312C is set to 11 p.m. In this case, during the period from 7 a.m. to 11 p.m., the electronic device 100 can be in the AOD state except for the screen-on state, and will not enter the screen-off state.

[0247] In one embodiment, the setting interface for off-screen display may be displayed in response to a user operation when the electronic device 100 is in the screen-on state. The user operation may be, for example, a user operation for a setting option for the off-screen display function in a setting application. Without limitation, in another embodiment, when the electronic device 100 is in the AOD state, the setting interface for off-screen display may also be displayed in response to a user operation. For a specific example, see Figure 14 below.

[0248] FIG. 14 exemplarily shows a schematic diagram of calling up a setting interface.

[0249] As shown in (A) of FIG14 , the electronic device 100 can display a user interface 1410 (i.e., the user interface 410 shown in FIG4A ). The electronic device 100 can receive a user operation, such as a touch operation on the display screen, such as a sliding operation, such as a single-finger sliding, a two-finger sliding, a three-finger sliding, sliding upward from the bottom of the screen, sliding downward from the top of the screen, sliding from the left side of the screen to the right, sliding from the right side of the screen to the left, etc., without limitation thereto, the user operation can also be voice input, gesture input, brainwave input, etc. FIG14 illustrates the user operation as a single-finger sliding upward from the bottom of the screen as an example. The electronic device 100 can display multiple function options in response to the above-mentioned user operation, specifically referring to the user interface 1420 shown in (B) of FIG14 .

[0250] As shown in (B) of Figure 14, user interface 1420 is similar to user interface 1410, except that user interface 1420 also includes multiple function options, such as option 1421 for a recording function, option 1422 for a calculator function, option 1423 for a flashlight function, and option 1424 for a setting function. The electronic device 100 can display a setting interface for off-screen display in response to a user operation (e.g., a touch operation) on option 1424. For specific examples, see Figures 10A, 10B, 10C, 11B, 12A, 13A, and 13B above. Not limited to this, in other examples, the electronic device 100 can also only display part of the setting information in the setting interface for off-screen display, such as any one of the setting information in the user interface 1010 shown in Figure 10A, or any one of the categories in the user interface 1010.

[0251] In one embodiment, when the electronic device 100 is in the AOD state, it can adaptively / dynamically adjust the off-screen image (for example, add corresponding appearance features to the cartoon character shown in the off-screen image) based on the appearance features in the image captured by the camera. The appearance features include, but are not limited to: whether wearing glasses, whether wearing a hat, hairstyle, whether wearing accessories, clothing, facial features, etc. Specific examples can be seen in Figures 15A and 15B below.

[0252] FIG15A is a schematic diagram showing another AOD interface.

[0253] As shown in FIG15A , when the electronic device 100 is in the AOD state, the front camera can be used to capture a facial image of the user 200, such as image 16, and the electronic device 100 can display a user interface 1510 based on image 16. User interface 1510 is similar to user interface 1220 shown in FIG12B , except that the appearance features of the off-screen image are different. Specifically, the off-screen image 1511 in user interface 1510 is generated based on image 16, while the off-screen image 1221 in user interface 1220 is generated based on image 15. Since the person in image 16 is the same as the person in image 15 shown in FIG12B , except that the person in image 16 wears a hat, while the person in image 16 does not wear a hat, the cartoon character shown in off-screen image 1511 is the same as the cartoon character shown in off-screen image 1221, except that the cartoon character shown in off-screen image 1511 wears a hat, while the cartoon character shown in off-screen image 1221 does not wear a hat.

[0254] FIG15B is a schematic diagram showing another AOD interface.

[0255] As shown in Figure 15B, when the electronic device 100 is in the AOD state, the facial image of the user 200, such as image 17, can be collected through the front camera, and the electronic device 100 can display the user interface 1520 based on image 17. The user interface 1520 is similar to the user interface 1220 shown in Figure 12B, except that the appearance features of the screen-off image are different. The screen-off image 1521 in the user interface 1520 is generated based on image 17, and the screen-off image 1221 in the user interface 1220 is generated based on image 15. Since the character in image 17 is the same as the character in image 15 shown in Figure 12B, the difference is that the character in image 17 wears glasses, and the character in image 17 does not wear glasses. Therefore, the cartoon character shown in the screen-off image 1521 is the same as the cartoon character shown in the screen-off image 1221, except that the cartoon character shown in the screen-off image 1521 wears glasses, and the cartoon character shown in the screen-off image 1221 does not wear glasses.

[0256] In one embodiment, when the off-screen image is an image generated based on the character image of the associated account, the electronic device 100 can obtain the character image of the associated account from the cloud (for example, obtain the character image of the day), and adaptively / dynamically adjust the off-screen image based on the appearance features in the obtained character image (for example, add corresponding appearance features to the cartoon character shown in the off-screen image). The specific example is similar to Figures 15A and 15B above, with the difference that the facial image used to generate the off-screen image is not captured by the camera of the electronic device 100, but is obtained by the electronic device 100 from the cloud. Without limitation, in other examples, the appearance features in the character image of the associated account can also be obtained from the cloud, and the electronic device 100 can directly obtain the appearance features of the associated account (for example, the appearance features of the day) from the cloud.

[0257] The above embodiment is described by taking the display of an off-screen image in the AOD state as an example. In another embodiment, the electronic device 100 may also display a series of off-screen images in the AOD state. For example, the displayed off-screen image is updated every preset time period, that is, the next off-screen image is switched to display every preset time period. For a specific example, please see Figure 16 below.

[0258] FIG16 exemplarily shows a schematic diagram of another setting interface.

[0259] As shown in Figure 16, the electronic device 100 can display a user interface 1610. The user interface 1610 is similar to the user interface 1010 shown in Figure 10A, except that the user interface 1610 also includes setting information 1611. The setting information 1611 may include the function name "Polling Display", the function description "Update the off-screen image at regular intervals", a control 1611A, setting options 1611B and a setting list 1611C. The control 1611A is used to turn the "Polling Display" function on or off, and the setting option 1611B is used to set the interval duration of the "Polling Display", that is, the interval duration for updating the off-screen image, such as 1 minute as shown in the user interface 1610. The setting list 1611C is used to set the range of the "Polling Display", that is, the range of the off-screen image displayed in the AOD state. The setting list 1611C may include setting options for multiple categories (i.e., multiple categories in the user interface 1010 shown in FIG10A ), for example, including a setting option for “personal picture”, a setting option for “artistic style”, and a setting option for “dial clock”. When any setting option is selected, the off-screen image displayed in the AOD state may include candidate images under the category corresponding to the setting option. In some examples, when the setting option for “personal picture” is selected, when the electronic device 100 is in the AOD state, the candidate images under the personal picture category may be displayed in a certain order and at preset time intervals. For example, the “personal picture” category includes image 1013A and image 1013B in the user interface 1020 shown in FIG10B . The electronic device 100 may first display the user interface 310 shown in FIG3A (the off-screen image is image 1013A), and then display the user interface 410 shown in FIG4A (the off-screen image is image 1013B, and the time is 8:01 at this time) after a preset time (e.g., 1 minute). The setting list 1611C may also include customized setting options, which may be used to customize the selection of multiple images as off-screen images for polling display, such as some images in different categories, images stored in the electronic device 100, and the like.

[0260] Not limited to the setting interface of the above example, in a specific implementation, the setting interface may include more or fewer controls. In other examples, the user interface 1020 shown in Figure 10B may also include: a control for turning on or off the function of "displaying battery level on the AOD interface".

[0261] The above embodiments are illustrated by taking the case where there is only one user of the electronic device 100 as an example. In another embodiment, there may be multiple users of the electronic device 100. The electronic device 100 detects that multiple users are looking at the display screen and can control the change of the off-screen image. In some examples, after the embodiment shown in FIG3A , the image captured by the front camera of the electronic device 100 includes the faces of multiple users. The electronic device 100 can control the displayed off-screen image 311 to change to a preset expression. The preset expression is, for example, an expression of surprise / panic (in this case, the eyes of the off-screen image 311 can become larger and the mouth can be round). Not limited to this, in other examples, the electronic device 100 can also control the display The number of screen-off images 311 increases. Assuming that the image captured by the front camera of the electronic device 100 includes the faces of two users, the electronic device 100 can display two screen-off images 311. The states of the two screen-off images 311 are respectively determined by the states of the above-mentioned two users. For example, if the face of user 1 is larger than the face of user 2 in the image, then the screen-off image 311 corresponding to user 1 is larger than the screen-off image 311 corresponding to user 2. The state of any screen-off image 311 changes with the change of the state of the corresponding user. The specific description is consistent with the description of the implementation method of one user mentioned above. This application does not limit the way the screen-off image changes when the electronic device 100 detects that multiple users are looking at the display screen.

[0262] Based on the above embodiments, the display method involved in this application is introduced. The method can be applied to the electronic device 100 shown in Figure 1. The method can also be applied to the electronic device 100 shown in Figure 2.

[0263] Please refer to Figure 17, which is a flow chart of a display method provided by an embodiment of the present application. Figure 17 is illustrated using the example of a camera 193 as the sensor for detecting the user status. The method may include but is not limited to the following steps:

[0264] 1. The display screen 194 of the electronic device 100 is in the off state.

[0265] 2. The camera 193 of the electronic device 100 detects that the user is looking at the display screen 194 .

[0266] 3. The camera 193 reports a first event to the processor 110 of the electronic device 100 , where the first event is an event in which the user is looking at the display screen 194 .

[0267] 4. The processor 110 instructs the display screen 194 to enter the AOD state according to the first event.

[0268] 5. The display screen 194 switches from the screen-off state to the AOD state in response to the instruction of the processor 110, and at this time, the first screen-off image can be displayed in the first display mode.

[0269] In one embodiment, the processor 110 may send information of a first display mode (which may be referred to as the first display information) to the display screen 194, and the display screen 194 may display according to the received first display information to realize displaying the first off-screen image in the first display mode. In some examples, the first off-screen image is a picture including multiple layers, and the first display information may include information on the display modes of the multiple layers. The display modes of the layers include, but are not limited to, whether to display, display position, display order, display size, display style (such as color and shape), etc. In other examples, the first off-screen image is an animation, and the first display information may include node information for starting to play, and optionally, node information for ending to play. For example, the first off-screen image is a 10-second animation, and the node information for starting to play in the first display information is the 2nd second, and the node information for ending to play is the 8th second.

[0270] In one embodiment, the first display mode is related to the user state detected by the camera 193 of the electronic device 100, wherein the user state may include, but is not limited to, the angle of the user's head relative to the electronic device 100, the position of the user's face relative to the electronic device 100, the user's expression, the position of the user's gaze, gestures, appearance characteristics (such as clothing, accessories, facial features, hairstyle), etc. For example, the display mode of the off-screen image 311 in Figures 3A-3E is related to the angle of the user's head, and for another example, the display mode of the off-screen image 411 in Figures 4A-4E is related to the position of the user's face, and for another example, the display mode of the off-screen image 311 in Figures 5B-5E is related to the user's expression, and for another example, the display mode of the off-screen images (such as images 912, 914, 915, and 916) in Figures 9A-9B is related to the position of the user's gaze.

[0271] In one embodiment, the display manner of the off-screen image may include, but is not limited to, display position, display size, display angle, display content, display color, display shape, display brightness, appearance characteristics, etc., wherein an example of display content can be seen in off-screen image 512 shown in FIG5A . In some examples, the off-screen image may include a virtual object, which may include a person, an animal, or an object, etc. The display manner of the off-screen image may include the display manner of the virtual object, which may include the display manner of the entire virtual object or the display manner of a portion of the virtual object (e.g., a person's face or facial features). The aforementioned appearance characteristics are specifically the appearance characteristics of the virtual object.

[0272] 6. The camera 193 detects changes in the user's status, such as but not limited to at least one of the following: a change in the angle of the user's head relative to the electronic device 100, a change in the position of the user's face relative to the electronic device 100, a change in the user's expression, a change in the user's performance of a user operation (such as a touch operation, gesture, voice input, etc.), a change in the position of the user's gaze, a change in the user's appearance features, etc.

[0273] 7. Camera 193 reports a second event (including first information indicating a change in user status) to processor 110. The second event is an event indicating a change in user status. The second event may include first information, which may include relevant information regarding the change in user status. The first information may include, for example, but is not limited to, at least one of the following: the time of occurrence, the type of user status (the multiple user statuses in Example 5 of FIG17 belong to different types), the user status before the change, the user status after the change, and a value used to measure the change in the user status (which may be referred to as a measurement value). The measurement value may include, for example, a change in the angle of the user's head, a change in the position of the user's face, or a change in the position of the user's gaze.

[0274] 8. The processor 110 determines a second display mode of the first screen-off image based on the first information, and the second display mode is different from the first display mode.

[0275] In one embodiment, the processor 110 can determine the adjustment mode and content of the display of the first off-screen image based on the first information. Optionally, the processor 110 can determine the degree of change in the display mode of the first off-screen image based on the measurement value in the first information. The degree of change can represent the difference between the second display mode and the first display mode. A specific example is shown below.

[0276] In some examples, different metric values ​​may correspond to different display modes. For example, as shown in FIG18A , assuming that x is a metric value of the change in user status, and y indicates the display mode of the screen-off image, x and y may satisfy a continuous function f1. When x is 0, y is y1, that is, when the metric value is 0, the display mode of the screen-off image is display mode 1 indicated by y1. When x is x1 (greater than 0), it can be determined according to f1 that the y corresponding to x1 is y2, that is, when the metric value is x1, the display mode of the screen-off image is display mode 2 indicated by y2. When x is x2 (greater than 0), it can be determined according to f1 that the y corresponding to x2 is y3, that is, when the metric value is x2, the display mode of the screen-off image is display mode 3 indicated by y3. In other words, different x corresponds to different y. For example, if the first display mode is display mode 1 indicated by y1 and the metric value in the first information is x1, the second display mode determined is display mode 2 indicated by y2. For example, in the above scenario 2, each time the electronic device 100 detects that the user's face moves to the left, and the ratio of the displacement of the user's face to the width of the user's face increases by 1%, it can control the off-screen image 411 to rotate 5 degrees to the left. For example, compared with image 6 shown in Figure 4A, the user's face in image 7 shown in Figure 4B moves to the left, and the ratio of the displacement of the user's face to the width of the user's face increases by 1%. Therefore, compared with the off-screen image 411 shown in Figure 4A, the off-screen image 411 shown in Figure 4B is rotated 5 degrees to the left.

[0277] In other examples, metric values ​​within different ranges may correspond to different display modes, such as shown in FIG18B . FIG18B is similar to FIG18A , except that in FIG18B , x and y satisfy the discontinuous function f2. When x is greater than or equal to 0 and less than x1, the corresponding y can be determined to be y1 according to f2, that is, when the metric value is greater than or equal to 0 and less than x1, the display mode of the off-screen image is display mode 1. When x is greater than or equal to x1 (for example, x is x1 or x2), the corresponding y can be determined to be y2 according to f2, that is, when the metric value is greater than or equal to x1, the display mode of the off-screen image is display mode 2. For example, if the first display mode is display mode 1 indicated by y1 and the metric value in the first information is a value greater than or equal to x1 (for example, x2), the second display mode determined is display mode 2 indicated by y2. For example, in the above scenario 2, when the electronic device 100 detects that the user's face moves to the left, and the ratio of the displacement of the user's face to the width of the user's face is less than 1 / 2, the screen-off image 411 shown in Figure 4A is displayed. When it detects that the user's face moves to the left, and the ratio of the displacement of the user's face to the width of the user's face is greater than 1 / 2, the screen-off image 411 shown in Figure 4B is displayed.

[0278] 9. The processor 110 instructs the display screen 194 to display the first screen-off image in the second display mode.

[0279] 10. In response to the instruction of the processor 110, the display screen 194 displays the first screen-off image in the second display mode.

[0280] In some examples, the second event is an event in which the angle of the user's head relative to the electronic device 100 changes. The examples 5-10 shown in FIG17 can be referred to the above-mentioned scenarios 1 and 3.

[0281] In some examples, the second event is an event in which the position of the user's face relative to the electronic device 100 changes. The examples 5-10 shown in FIG17 can refer to the above-mentioned scenarios 2 and 3.

[0282] In some examples, the second event is an event in which the user's expression changes. The examples 5-10 shown in FIG17 can refer to the above scenario 4.

[0283] In some examples, the second event is an event in which a user performs a user operation. For the examples 5-10 shown in FIG17 , reference can be made to the above-mentioned scenario 5.

[0284] In some examples, the second event is an event in which the position where the user's gaze is directed changes. For examples 5-10 shown in FIG17 , reference can be made to the above-mentioned scenario 6.

[0285] In some examples, the second event is an event in which the user's appearance characteristics change. The examples 5-10 shown in FIG17 can be referred to the description of FIG15A-FIG15B above.

[0286] In one embodiment, after 5 or 10 shown in Figure 17, the method further includes: the camera 193 detects that the user is not looking at the display screen 194, and reports the corresponding event to the processor 110, and the processor 110 can instruct the display screen 194 to enter the screen-off state according to the event. Not limited to this, in other examples, when the proximity light sensor 180G detects that an object is approaching, the processor 110 instructs the display screen 194 to enter the screen-off state. This application does not limit the event used to trigger the entry into the screen-off state. In one embodiment, before the display screen 194 enters the screen-off state, the end animation of the first screen-off image can be displayed first. The specific example is similar to Figure 7, except that no gesture is performed at this time.

[0287] In one embodiment, before 5 shown in FIG17 , the display screen 194 may first display the start animation of the first screen-off image. The specific example is similar to FIG6 , except that no gesture is performed at this time.

[0288] In one embodiment, the first screen-off image shown in FIG17 may be determined by the electronic device 100 in response to a selection operation for multiple images. For specific examples, see FIG10A and FIG10B. In another embodiment, the first screen-off image may also be generated by the electronic device 100 based on the character image of the associated account. For example, before 5 shown in FIG17, the electronic device 100 may send a request message to the network device to obtain the facial image of the associated account selected by the user, and generate the first screen-off image based on the facial image. For specific examples, see FIG10C. In another embodiment, the first screen-off image may also be generated by the electronic device 100 based on an image uploaded by the user. For example, before 5 shown in FIG17, the electronic device 100 may receive an image uploaded by the user and generate the first screen-off image based on the image. For specific examples, see FIG11A and FIG11B. In another embodiment, the first screen-off image may also be obtained by the electronic device 100 based on the image captured by the camera. For example, the first event 3 shown in Figure 17 may include a face image captured by the camera 193, and the processor 110 may generate the first screen-off image based on the face image. Specific examples can be seen in Figures 12A-12B.

[0289] In one embodiment, after 5 shown in Figure 17, the method also includes: the processor 110 detects that a preset time period has passed, and can instruct the display screen 194 to switch the first screen-off image to the second screen-off image. Optionally, this function can be set by the electronic device 100 in response to user operation. For specific examples, see Figure 16.

[0290] Not limited to the embodiment shown in Figure 17, in another embodiment, the processor 110 can also instruct the display screen 194 to enter the AOD state based on other events. For example, when the pressure sensor 180A and / or the touch sensor 180K receives a touch operation of the user on the display screen 194, the corresponding event is reported to the processor 110. The processor 110 can instruct the display screen 194 to enter the AOD state based on the event. This application does not limit the event used to trigger entry into the AOD state.

[0291] Not limited to the embodiment shown in Figure 17, in another embodiment, 1 shown in Figure 17 can also be the display screen 194 in the bright screen state. At this time, the first event can be replaced by other events, for example, an event of receiving a user's touch operation on the power button. This application does not limit the state of the electronic device 100 before the AOD state.

[0292] The above embodiments illustrate the example of an image in the AOD interface changing as the user's status changes, but are not limited thereto. In other embodiments, the image in the lock screen interface may also change as the user's status changes, such as the example shown in FIG19A . In other embodiments, the image on the desktop may also change as the user's status changes, such as the example shown in FIG19B . FIG19A and FIG19B illustrate the example of controlling the state of an image based on the position of the user's gaze.

[0293] FIG19A is a schematic diagram showing an exemplary lock screen interface.

[0294] As shown in FIG19A , electronic device 100 may display user interface 1910, which may be a lock screen interface. User interface 1910 may include a status bar at the top (e.g., including a cellular communication indicator, a WLAN indicator, a battery level, etc.), date information, time information, and a fingerprint collection area. User interface 1910 may also include image 1911, which may be a wallpaper image for the lock screen interface. Image 1911 may be a cartoon puppy. When electronic device 100 detects that user 200 is looking at position 8 in user interface 1910, electronic device 100 may display image 1911 at position 8, for example, displaying an "entry" animation of image 1911. This "entry" animation may include the puppy shown in image 1911 changing from non-display to display and gradually becoming larger during display. Image 1911 at position 8 shown in FIG19A may be the image displayed when the "entry" animation is complete. When the electronic device 100 detects that the position where the user 200 is looking has changed to position 9 in the user interface 1910, the electronic device 100 may display image 1911 at position 9, for example, displaying an "exit" animation of image 1911. The "exit" animation may include the puppy shown in image 1911 gradually becoming smaller until it is no longer displayed. The image 1911 at position 9 shown in FIG19A may be the displayed image during the "exit" animation (gradually becoming smaller). Therefore, the image 1911 at position 9 shown in FIG19A is smaller than the image 1911 at position 8 shown in FIG19A.

[0295] FIG19B exemplarily shows a schematic diagram of a desktop.

[0296] As shown in FIG19B , the electronic device 100 can display a user interface 1920. The user interface 1920 can be a desktop. The user interface 1920 can include a status bar at the top (e.g., including a cellular communication indicator, a WLAN indicator, a battery level, etc.), date information, time information, and icons for multiple applications. The user interface 1920 can also include images 1921, 1922, and 1923. These images can be desktop wallpaper images or light bulbs. For any of the images, when the electronic device 100 does not detect that the user 200 is looking at the image, the image can be in an off-screen state (e.g., lower brightness, darker color). When the electronic device 100 detects that the user 200 is looking at the image, the image can be in a lit state (e.g., higher brightness, lighter color). For example, FIG19B illustrates the case where the electronic device 100 detects that the user 200 is looking at image 1922. In the user interface 1920 shown in FIG19B , image 1922 is lit, and images 1921 and 1923 are off-screen. In some examples, the lighting states of image 1921, image 1922, and image 1923 may be different, such as different brightness, different color, etc. For example, when electronic device 100 detects that user 200 is looking at image 1922, image 1922 may be in a red lighting state; when electronic device 100 detects that user 200 is looking at image 1921 / image 1923, image 1921 / image 1923 may be in a blue lighting state.

[0297] The methods provided in the various embodiments of the present application may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, they may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, or a magnetic tape), an optical medium (e.g., a digital video disc (DWD), or a semiconductor medium (e.g., a solid state drive (SSD)). As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit the same. Although the present application has been described in detail with reference to the above embodiments, a person skilled in the art should understand that the technical solutions described in the above embodiments may be modified, or some of the technical features thereof may be replaced by equivalents. However, such modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A display method, characterized in that: Applied to an electronic device, the electronic device includes a display screen, and the method includes: Displaying a first interface, wherein the first interface includes a first image in a first display mode; detecting that the state of the first user changes from the first state to the second state, wherein the state of the first user includes at least one of the following: an angle of the user's head relative to the electronic device, a position of the user's face relative to the electronic device, a gesture, a facial expression, a position of the user's gaze on the display screen, and appearance features; The display mode of the first image is updated to a second display mode, wherein the first display mode is related to the first state, and the second display mode is related to the second state.

2. The method according to claim 1, characterized in that The first image includes a first virtual object, which is a virtual character, a virtual animal, or a virtual object.

3. The method according to claim 2, characterized in that The first image includes at least one image content, and the at least one image content includes the image content of the first virtual object. The display method of the first image includes at least one of the following: the position of the image content, the size of the image content, whether the image content is hidden, the color of the image content, the shape of the image content, the brightness of the image content, the expression of the first virtual object, the gesture of the first virtual object, and the appearance characteristics of the first virtual object.

4. The method according to claim 2 or 3, characterized in that The detecting that the state of the first user changes from the first state to the second state includes: When the first user's head rotates in a first direction relative to the electronic device, or when the electronic device rotates in a second direction relative to the first user, it is detected that the angle of the first user's head relative to the electronic device changes from a first angle to a second angle, and the first direction is opposite to the second direction; The updating the display mode of the first image to a second display mode includes: The first virtual object or a first part of the first virtual object is updated from a first position to a second position, wherein the first position is related to the first angle, the second position is related to the second angle, and the second position is located in the first direction of the first position.

5. The method according to claim 2 or 3, characterized in that: The detecting that the state of the first user changes from the first state to the second state includes: When the face of the first user is translated relative to the electronic device in a third direction, or the electronic device is translated relative to the first user in a fourth direction, it is detected that the position of the face of the first user relative to the electronic device changes from the third position to the fourth position, the third direction is opposite to the fourth direction, and the fourth position is located in the third direction of the third position; The updating the display mode of the first image to a second display mode includes: The first virtual object or the first part of the first virtual object is updated from a fifth position to a sixth position, wherein the fifth position is related to the third position, the sixth position is related to the fourth position, and the sixth position is located in the third direction of the fifth position.

6. The method according to claim 2 or 3, characterized in that: The detecting that the state of the first user changes from the first state to the second state includes: detecting that the expression of the first user changes from a first expression to a second expression; The expression of the first virtual object in the first image in the first display mode is the first expression, and the expression of the first virtual object in the first image in the second display mode is the second expression.

7. The method according to claim 2 or 3, characterized in that: The second state includes that the gesture action of the first user is a first gesture, the first virtual object in the first image of the first display mode is in a hidden state, and the first virtual object in the first image of the second display mode is in a displayed state; or, the first virtual object in the first image of the first display mode is in a displayed state, and the first virtual object in the first image of the second display mode is in a hidden state.

8. The method according to claim 2 or 3, characterized in that: The detecting that the state of the first user changes from the first state to the second state includes: detecting that the position where the first user's gaze is directed at the display screen changes from the seventh position to the eighth position; The first virtual object in the first image in the first display mode is located at the seventh position, and the first virtual object in the first image in the second display mode is located at the eighth position.

9. The method according to claim 2 or 3, characterized in that: The first state includes the first user's line of sight gazing at the ninth position of the display screen, the second state includes the first user's line of sight gazing at the tenth position of the display screen, the first virtual object in the first image is located at the tenth position, the display state of the first virtual object in the first image of the first display mode and the first image of the second display mode is different, and the display state includes at least one of the following: size, color, shape, and brightness.

10. The method according to claim 2 or 3, characterized in that: The detecting that the state of the first user changes from the first state to the second state includes: detecting that the position where the first user is looking moves toward a fifth direction; The updating the display mode of the first image to a second display mode includes: The first virtual object or the first part of the first virtual object is updated from an eleventh position to a twelfth position, where the twelfth position is located in the fifth direction of the eleventh position.

11. The method according to claim 2 or 3, characterized in that: The first state includes the appearance feature of the first user being a first feature, the second state includes the appearance feature of the first user being a second feature, the appearance feature of the first virtual object in the first image of the first display mode matches the first feature, and the appearance feature of the first virtual object in the first image of the second display mode matches the second feature, and the appearance features include at least one of the following: clothing, accessories, hairstyle, and facial features.

12. The method according to any one of claims 1 to 11, characterized in that: Before displaying the first interface, the method further includes: Displaying a first setting interface, wherein the first setting interface includes a plurality of images; A first operation is received for the first image of the plurality of images.

13. The method according to any one of claims 1 to 11, characterized in that: Before displaying the first interface, the method further includes: Sending a first request message to a network device, wherein the first request message includes information of a first account associated with the electronic device; receiving a second image sent by the network device, where the second image is an image of a second user of the first account; The first image is obtained according to the second image, the first virtual object in the first image is a virtual character, and the first virtual object is obtained according to the second user in the second image.

14. The method according to any one of claims 1 to 11, characterized in that: Before displaying the first interface, the method further includes: receiving a third image uploaded by the first user; The first image is obtained according to the third image; wherein, The third image is the same as the first image; or, The first virtual object in the first image is obtained according to the object in the third image.

15. The method according to any one of claims 1 to 11, characterized in that: Before displaying the first interface, the method further includes: Acquire a fourth image by using a camera of the electronic device; The first image is obtained according to the fourth image, and the first virtual object in the first image is obtained according to the object in the fourth image.

16. The method according to claim 13, characterized in that The second image is an image of the second user at the first time, an appearance feature of the second user in the second image is a third feature, an appearance feature of the first virtual object in the first image in the first display mode matches the third feature, and after displaying the first interface, the method further includes: Sending a second request message to the network device; receiving a fifth image sent by the network device, where the fifth image is an image of the second user at a second time, where the second time is later than the first time, and an appearance feature of the second user in the fifth image is a fourth feature; The display mode of the first image is updated to a third display mode, and the appearance feature of the first virtual object in the first image in the third display mode matches the fourth feature.

17. The method according to any one of claims 1 to 16, characterized in that: The updating the display mode of the first image to a second display mode includes: When the first image is an animation, switching the node currently playing the first image from the first node to the second node; When the first image is a picture including multiple layers, a display mode of at least one layer in the first image is adjusted.

18. The method according to any one of claims 1 to 17, characterized in that: The method further comprises: After the first interface is displayed, when it is detected that the first user is not looking at the display screen, controlling the display screen to turn off; When it is detected that the first user is gazing at the display screen, the first interface is displayed.

19. The method according to any one of claims 1 to 17, characterized in that: The method further comprises: After the first interface is displayed, when it is detected that an object is close to the electronic device, the display screen is controlled to turn off; When it is detected that the object leaves the electronic device, the first interface is displayed.

20. The method according to any one of claims 1 to 19, characterized in that The method further comprises: displaying a second setting interface, where the second setting interface is used to preview the first interface, and the second setting interface includes the first image in the first display mode; detecting that the state of the first user changes from the first state to the second state; The display mode of the first image is updated to the second display mode.

21. The method of claim 20, wherein: The displaying of the second setting interface includes: When the first interface is displayed, receiving a second operation; In response to the second operation, the second setting interface is displayed.

22. The method according to any one of claims 1 to 21, characterized in that The method further comprises: After a first time period has passed after the first interface is displayed, a second interface is displayed, where the second interface includes a sixth image, and the sixth image is different from the first image.

23. The method according to any one of claims 1 to 21, characterized in that The first interface is an AOD interface displayed when the screen is off, or the first interface is a lock screen interface, or the first interface is a desktop.

24. An electronic device, characterized in that: The method comprises a transceiver, a processor and a memory, wherein the memory is used to store a computer program, and the processor calls the computer program to execute the method according to any one of claims 1 to 23.

25. A computer storage medium, characterized in that The computer storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 23 is implemented.

Images