Screen-off display method and related device

Abstract

The invention provides a screen-off display method and a related device. In the method, when the electronic equipment is in a screen-off state, whether the electronic equipment is in a folded state or not can be judged firstly, then whether the conditions for displaying the AOD interface are met or not is judged, for example, the conditions for recognizing a human face or human eyes and the like are met or not, and a screen used for displaying the AOD interface is determined. In this way, the AOD interface can be better displayed in combination with user requirements.

Description

Screen-off display method and related device

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on September 11, 2023, with application number 202311171236.7 and application name “Screen-off Display Method and Related Devices”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the field of computers, and in particular to a screen-off display method and related devices. Background Art

[0003] Electronic devices can display some information when the screen is off, and users can directly observe the displayed information. For outward-folding screen electronic devices (including a main screen and a back screen), how to display information when the outward-folding screen electronic device is in different states is an urgent problem that technicians in this field need to solve.

[0004] Summary of the Invention

[0005] This application implements a method and related device for displaying an off-screen display. This can be used to determine the screen that displays the AOD interface. This allows the AOD interface to be displayed in a better way in accordance with user needs.

[0006] In the first aspect, an embodiment of the present application provides a screen-off display method, which is applied to an electronic device, wherein the electronic device includes a main screen, a back screen, a main screen camera, and a back screen camera, the main screen and the back screen are connected by a folding component, the main screen camera and the main screen face the same direction, and the back screen camera and the main screen face opposite directions. The method includes: when the electronic device is in a folded state, detecting a first screen-off operation, in which the main screen and the back screen both face the outside of the electronic device; starting the main screen camera and the back screen camera; if the back screen camera captures an image containing human eyes and / or a human face, and the main screen camera does not capture an image containing human eyes and / or a human face, displaying a first AOD interface on the back screen; if the main screen camera captures an image containing human eyes and / or a human face, and the back screen camera does not capture an image containing human eyes and / or a human face, displaying a second AOD interface on the main screen.

[0007] It can be seen from the above method that the electronic device can consider the actual needs of the user to determine the screen displaying the AOD interface by recognizing human eyes or faces, thereby avoiding the situation where the AOD interface is not displayed on the screen facing the user, while the AOD interface is displayed on the screen not facing the user.

[0008] In combination with the first aspect, in some implementations, the method further includes: if the main screen camera captures an image containing human eyes and / or human faces, and the back screen camera captures an image containing human eyes and / or human faces, determining the orientation of the main screen and the back screen; if the back screen is facing upward, displaying the first AOD interface on the back screen; if the main screen is facing upward, displaying the second AOD interface on the main screen; upward refers to the direction opposite to pointing vertically to the ground.

[0009] In combination with the first aspect, in some implementations, the method further includes: if the main screen camera does not capture an image containing human eyes and / or faces, and the back screen camera does not capture an image containing human eyes and / or faces, determining the orientation of the main screen and the back screen; if the back screen is facing upward, displaying the first AOD interface on the back screen in response to the back screen facing upward, or displaying the first AOD interface on the back screen after receiving a touch operation on the back screen, or displaying the first AOD interface on the back screen after entering a preset time period; if the main screen is facing upward, displaying the second AOD interface on the main screen in response to the main screen facing upward, or displaying the second AOD interface on the main screen after receiving a touch operation on the main screen, or displaying the second AOD interface on the main screen after entering the preset time period; upward refers to the direction opposite to vertically pointing to the ground.

[0010] In combination with the first aspect, in some implementations, when the first screen-off operation is detected, the electronic device is held by a user.

[0011] In combination with the first aspect, in some implementations, when the electronic device is in a folded state and is not held by a user, a second screen-off operation is detected; the orientation of the main screen and the back screen is determined; if the back screen is facing upward, the first AOD interface is displayed on the back screen in response to the back screen facing upward, or the first AOD interface is displayed on the back screen after receiving a touch operation acting on the back screen, or the first AOD interface is displayed on the back screen after entering a preset time period, or the back screen camera is started, and the back screen camera captures an image containing human eyes and / or human faces. The first AOD interface is displayed on the back screen in the case of an image; if the main screen is facing upward, the second AOD interface is displayed on the main screen in response to the main screen facing upward, or, the second AOD interface is displayed on the main screen after receiving a touch operation acting on the main screen, or, the second AOD interface is displayed on the main screen after entering the preset time period, or, the main screen camera is started, and the second AOD interface is displayed on the main screen when the main screen camera captures an image containing human eyes and / or human faces; upward refers to the direction opposite to vertically pointing to the ground.

[0012] In combination with the first aspect, in some implementations, the method further includes: when the electronic device is in an unfolded state, a third screen-off operation is detected, and in the unfolded state, the main screen and the back screen are facing the same direction; in response to the main screen and the back screen facing the same direction, a third AOD interface is displayed on the screen, or, after receiving a touch operation acting on the screen, the third AOD interface is displayed on the screen, or, after entering a preset time period, the back screen camera or the main screen camera is started, and the third AOD interface is displayed on the screen when the back screen camera or the main screen camera captures an image containing human eyes and / or human faces; the screen includes the back screen and the main screen facing the same direction.

[0013] In combination with the first aspect, in some implementations, before the first screen-off operation is detected, if the electronic device is in a screen-off state, the first screen-off operation includes: a touch screen operation; if the electronic device is in a screen-on state, the screen-off operation includes: a lock screen operation; if the electronic device is in a power-off state, the first screen-off operation includes a power-on operation.

[0014] In combination with the first aspect, in some implementations, the icons in the first AOD interface only include: the first icon; the icons in the second AOD interface only include: the first icon; the size of the first icon in the first AOD interface is equal to the size of the first icon in the second AOD interface.

[0015] In combination with the first aspect, in some implementations, the first AOD interface includes: a first icon and a second icon; the second AOD interface includes: the first icon and the second icon; the size of the first icon and the second icon in the first AOD interface is smaller than the size of the first icon and the second icon in the second AOD interface.

[0016] In combination with the first aspect, in some implementations, the first AOD interface includes: a third icon; the second AOD interface includes: the third icon; the size of the third icon in the first AOD interface is smaller than the size of the third icon in the second AOD interface.

[0017] In combination with the first aspect, in some implementations, the text in the first AOD interface only includes: the first text; the text in the second AOD interface only includes: the first text; the size of the first text in the first AOD interface is equal to the size of the first text in the second AOD interface.

[0018] In combination with the first aspect, in some implementations, the first AOD interface includes: a first text and a second text; the second AOD interface includes: the first text and the second text; the size of the first text and the second text in the first AOD interface is smaller than the size of the first text and the second text in the second AOD interface.

[0019] In combination with the first aspect, in some implementations, the first AOD interface includes: a fourth icon; the second AOD interface includes: a fifth icon; wherein the fourth icon and the fifth icon belong to the same theme.

[0020] In a second aspect, the present application provides an electronic device comprising one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, wherein the computer program code comprises computer instructions. When the one or more processors execute the computer instructions, the electronic device performs the method of the first aspect or any embodiment of the first aspect.

[0021] In a third aspect, an embodiment of the present application provides a computer storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method of the first aspect or any one of the implementations of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] FIG1A is a schematic diagram of an AOD interface provided in an embodiment of the present application;

[0023] 1B-1E are schematic diagrams of user interfaces for setting an AOD function according to an embodiment of the present application;

[0024] FIG2A is a schematic diagram of an electronic device in an unfolded state provided by an embodiment of the present application;

[0025] FIG2B is a schematic diagram of an electronic device provided in an embodiment of the present application in a folded state;

[0026] FIG3A is a schematic flow chart of a method for displaying an off-screen display according to an embodiment of the present application;

[0027] FIG3B is a schematic flow chart of a method for displaying an off-screen display provided in an embodiment of the present application;

[0028] FIG4A is a schematic diagram of the screen posture of an electronic device provided by an embodiment of the present application when the screen is gradually unfolded;

[0029] FIG4B is a schematic diagram of the screen posture of the electronic device provided by an embodiment of the present application when the screen is gradually folded;

[0030] FIG5A is a schematic diagram of an electronic device according to an embodiment of the present application displaying an AOD interface on a main screen;

[0031] FIG5B is a schematic diagram of an electronic device provided in an embodiment of the present application displaying an AOD interface on a back screen;

[0032] FIG6A is a schematic diagram of an electronic device according to an embodiment of the present application displaying an AOD interface on a main screen;

[0033] FIG6B is a schematic diagram of an electronic device provided in an embodiment of the present application displaying an AOD interface on a back screen;

[0034] FIG7A is a schematic diagram of an electronic device according to an embodiment of the present application displaying an AOD interface on a main screen;

[0035] FIG7B is a schematic diagram of an electronic device provided in an embodiment of the present application displaying an AOD interface on a back screen;

[0036] FIG8A is a schematic diagram of an electronic device according to an embodiment of the present application displaying an AOD interface on a main screen;

[0037] FIG8B is a schematic diagram of an electronic device provided in an embodiment of the present application displaying an AOD interface on a back screen;

[0038] FIG9A is a schematic diagram of an electronic device according to an embodiment of the present application displaying an AOD interface on a main screen;

[0039] FIG9B is a schematic diagram of an electronic device provided in an embodiment of the present application displaying an AOD interface on a back screen;

[0040] FIG10 is a schematic diagram of a hardware architecture of an electronic device provided in an embodiment of the present application;

[0041] FIG11 is a schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0042] The following is a clear and detailed description of the technical solutions in the embodiments of the present application in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship between related objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0043] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.

[0044] The term "user interface (UI)" in the following embodiments of this application refers to a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device and finally presented as content that the user can recognize. The commonly used form of user interface is graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.

[0045] To facilitate understanding of the solutions provided by the embodiments of the present application, the following describes the relevant concepts involved in the embodiments of the present application:

[0046] 1. Always on display (AOD)

[0047] The AOD function refers to the function of an electronic device displaying information such as time, date, and icons in a partial area of ​​the screen without lighting up the entire screen (that is, the electronic device maintains low power consumption), which is beneficial to saving the power consumption of the screen generated by the user to view information such as time and date. In an embodiment of the present application, the screen of the electronic device can be divided into a screen-off state, a screen-on state, and a screen-off state. Among them, the screen-off state (OFF state) indicates that the screen of the electronic device is off; the screen-on state (ON state) indicates that the screen of the electronic device is all lit, that is, the lit area of ​​the screen includes the black area of ​​the screen; the screen-off state (Doze state) indicates that the screen of the electronic device is partially lit, that is, the part of the screen except the black area is lit. At this time, the screen is dormant and the electronic device is in a low power consumption state. The change of the screen-on and screen-off state can include the screen switching from the ON state to the OFF state, or from the ON state to the Doze state, or from the OFF state to the Doze state, or from the Doze state to the ON state, or from the OFF state to the ON state, and so on.

[0048] The following introduces the AOD interface and AOD functions in combination with several user interfaces.

[0049] Exemplarily, FIG1A shows an AOD interface provided by an electronic device.

[0050] As shown in Figure 1A, user interface 100 may be an AOD interface provided by an electronic device. User interface 100 may include, but is not limited to, time 101, region 102, date 103, battery level 104, and icon 105. Even when the screen of the electronic device is off, users can access information such as time and date, which helps save power consumption that would otherwise be required to view the screen.

[0051] For example, FIG. 1B to FIG. 1E show some user interfaces of an electronic device for setting an AOD function.

[0052] As shown in FIG1B , user interface 110 may be the user interface of a settings application provided by the electronic device. User interface 110 may include, but is not limited to, a screen-off and lock screen bar 111 and other function bars. In response to a click on screen-off and lock screen bar 111, the electronic device may display user interface 120.

[0053] As shown in Figure 1C, the user interface 120 can be a user interface provided by the electronic device for setting the screen off function and the lock screen function. The user interface 120 may include, but is not limited to: a screen off display control 121 and a screen off notification light effect control 122. The screen off display control 121 may also include prompt information 121A. For example, the prompt information 121A may display the text content "On", which indicates that the electronic device has started the screen off display function. The screen off notification light effect control 122 may also include prompt information 122A. For example, the prompt information 122A may display the text content "None", which indicates that the electronic device is not set with a screen off notification light effect. The electronic device can respond to a click operation on the screen off display control 121 and can display the user interface 130.

[0054] As shown in Figure 1D, user interface 130 may be a user interface provided by an electronic device for setting the screen-off display function. User interface 130 may include, but is not limited to, a screen-off display switch 131, a display mode control 132, and multiple screen-off icons 133. The electronic device may enable or disable the screen-off display function in response to a click on the screen-off display switch 131. In response to a click on one of the multiple screen-off icons 133, the electronic device may determine the icon displayed when the electronic device's screen is off. In response to a click on the display mode control 132, the electronic device may display user interface 140.

[0055] As shown in Figure 1E, user interface 140 can be a user interface provided by the electronic device for selecting the screen-off display mode. User interface 140 may include, but is not limited to, display mode 141, display mode 142, display mode 143, and display mode 144. Exemplarily, display mode 141 is a touch display mode that can display the text "Display for 10 seconds after clicking the screen." Display mode 142 is an always-on display mode that can display the text "Always display." Display mode 143 is a timed display mode that can display the text "Timed display." Furthermore, in response to a click operation on display mode 143, the electronic device displays controls for selecting the start and end times of the timed display. Exemplarily, a start time control 143A and an end time control 143B can be displayed. Specifically, the electronic device can select any time as the start and end times of the timed display in response to user operation. Display mode 144 is an intelligent display mode that can display the text "Intelligent recognition display."

[0056] In the embodiment of the present application, the above user interface is only used for exemplary description. For example, the user interface 120 may only display content related to the screen off. Various user interfaces may also include more or less content, which is not limited to this.

[0057] In some implementations, the electronic device may enable the screen-off display function. When the electronic device meets the conditions for displaying the AOD interface, the electronic device may display the AOD interface. The modes for displaying the AOD interface may include but are not limited to the following:

[0058] Mode 1: Touch Display Mode. Mode 1 may mean that the electronic device can display the AOD interface for a period of time in response to a user's touch operation when in Doze mode. In the embodiments of this application, the period of time for displaying the AOD interface is not limited and can be 5 seconds, 8 seconds, 10 seconds, etc.

[0059] Mode 2: Always-on display mode. Mode 2 may mean that the electronic device can always display the AOD interface when in Doze state. In one possible implementation, when the electronic device switches to the on-screen state and in a very short time after switching to the lock screen state, the electronic device may need a very short time to recognize that it has switched to the lock screen state, and then display the AOD interface after the electronic device recognizes that it has switched to the lock screen state. To a certain extent, the above very short time can be ignored.

[0060] Mode 3: Timed Display Mode. Mode 3 may mean that during a preset time period, the electronic device, while in Doze mode, may display the AOD interface. This preset time period may be user-configurable. For example, as shown in FIG1E , the preset time period may be between 7:00 AM and 11:00 PM.

[0061] Mode 4: Smart Display Mode. Mode 4 may mean that when the electronic device is in Doze mode and recognizes a human figure, it may display the AOD interface for a period of time, for example, 10 seconds. In some implementations, the electronic device may capture image data via a camera and perform human figure recognition based on the image data. This human figure recognition may include recognizing human eyes and / or faces.

[0062] In some implementations, the electronic device may select any one of the above modes 1, 2, and 3 to implement the screen-off display function. The electronic device may select any one of the above modes 2, 3, and 4 to implement the screen-off display function. In one possible implementation, the electronic device may also select mode 4 while selecting mode 1, mode 2, or mode 3.

[0063] 2. Outward folding screen

[0064] An outward-folding folding screen means that the user can observe the folded screen, that is, the folded screen faces outward. It should be noted that on an outward-folding folding screen, the main screen and the back screen can be different display areas of the same screen, or different display areas of two screens, without limitation. In one possible implementation, the main screen and the back screen can be connected by a folding component (for example, a side display or a hinge).

[0065] The following describes the structure of the outward folding screen in conjunction with Figures 2A and 2B. The electronic device can include: an unfolded state and a folded state. The electronic device can be equipped with or portable terminal devices with other operating systems, such as mobile phones, tablet computers, desktop computers, laptop computers, handheld computers, notebook computers, ultra-mobile personal computers (UMPCs), netbooks, as well as personal digital assistants (PDAs), augmented reality (AR) devices, virtual reality (VR) devices, artificial intelligence (AI) devices, wearable devices, in-vehicle devices, smart home devices and / or smart city devices, etc.

[0066] All types of electronic devices described in this application are equipped with a foldable screen, that is, the display screen of the electronic device can be folded, and after folding, it is divided into at least two display screens by a folding axis.

[0067] FIG. 2A exemplarily shows the structural form of an electronic device in an unfolded state.

[0068] As shown in Figure 2A, the electronic device may include a back screen 201, a main screen 202, and a central axis 203. The back screen 201 and the main screen 202 may be referred to as the entire screen. When the electronic device is in the unfolded state, the entire screen of the electronic device faces the same direction as the back screen 201 and the main screen 202. That is, the main screen 202 faces the same direction as the back screen 201. When the user faces the entire screen, the observed display area is the entire screen. The electronic device may also include a back screen camera 204 and a main screen camera 205. The back screen camera 204 may include one or more cameras, and the main screen camera 205 may include one or more cameras. In the unfolded state, the main screen camera 205 is located on one side of the entire screen, that is, the direction of the main screen camera 205 is consistent with the direction of the back screen 201 and the main screen 202. The back screen camera 204 is located on one side of the back of the entire screen, that is, the direction of the back screen camera 204 and the main screen camera 205 are opposite.

[0069] FIG. 2B exemplarily shows the structural form of an electronic device in a folded state.

[0070] As shown in Figure 2B, (a) and (b) are electronic devices in the same folded state. Among them, (b) can be a schematic diagram after (a) is flipped 180 degrees around the central axis. The electronic devices may include but are not limited to: a back screen 211 and a main screen 212. Among them, the back screen 211 and the main screen 212 are in opposite directions. In (a), the back screen 211 of the electronic device can face the user, while the main screen 212 is facing away from the user. In (b), the main screen 212 of the electronic device can face the user, while the back screen 211 is facing away from the user. The electronic device may also include a back screen camera 213 and a main screen camera 214. Among them, when the electronic device is in the folded state, the back screen camera 213 is located on the side of the back screen 211, that is, the direction of the back screen camera 213 is consistent with the direction of the back screen 211; the main screen camera 214 is located on the side of the main screen 212, that is, the direction of the main screen camera 214 is consistent with the direction of the main screen 212.

[0071] In some implementations, the length of the back screen 211 is the same as the length of the main screen 212, and the width of the back screen 211 is 85% of the width of the main screen 212. In the embodiment of the present application, the above value of 85% is only for illustration, and it is sufficient that the width of the main screen 212 is greater than the width of the back screen 211, and this is not limited to this.

[0072] In some implementations, electronic devices with outward-folding folding screens can also display the AOD interface. An electronic device in a folded state can determine the orientation of the main screen and the back screen. When the main screen of the electronic device is facing upward, the electronic device can display the AOD interface on the main screen; when the back screen of the electronic device is facing upward, the electronic device can display the AOD interface on the back screen. However, in some cases, the electronic device may be in a state where neither the main screen nor the back screen is facing upward. For example, when the user holds or places it on other devices, the folding part of the electronic device (such as the side display) is facing upward. At this time, it may not be possible to determine whether the AOD interface is displayed on the back screen or the main screen, resulting in the electronic device not displaying the AOD interface, which will affect the user experience. In other cases, the user may be in a state similar to lying flat, in which case the screen that the user may need to observe that displays the AOD interface should be facing downward. Since the electronic device is based on the principle of displaying the AOD interface on a screen that is facing upward, the electronic device may not display the AOD interface on the screen where the user needs to view the AOD interface (for example, the screen that is facing downward).

[0073] In the embodiment of the present application, upward may refer to a direction opposite to the direction pointing vertically to the ground or a direction opposite to the direction pointing approximately vertically to the ground, and downward may refer to a direction perpendicular to the ground or a direction approximately perpendicular to the ground.

[0074] To address the above issues, embodiments of the present application provide a method and electronic device for displaying an off-screen display. In this method, the electronic device adds an off-screen display mode that recognizes a face or eye. In the off-screen state, the folding state of the electronic device can be determined first, and then the conditions for displaying the AOD interface can be determined. For example, if a face or eye is recognized, the AOD interface can be displayed on the main screen or on the back screen.

[0075] Furthermore, the electronic device can also determine whether it is held by the user, thereby more accurately determining the screen used to display the AOD interface.

[0076] By implementing the above method, it is possible to avoid judging the screen displaying the AOD interface solely by the screen orientation, which can better display the AOD interface in accordance with user needs.

[0077] The following describes the method for screen-off display provided by an embodiment of the present application in conjunction with Figure 3A. The method execution subject shown in Figure 3A may be the electronic device mentioned above. Alternatively, the method execution subject shown in Figure 3A may be a chip in an electronic device, which is not limited in the embodiment of the present application. Figure 3A is illustrated by taking an electronic device as an example of the execution subject of the method. The electronic device includes a display screen, and the display screen includes a main screen and a back screen, and the main screen and the back screen are two display areas of the same display screen; when the electronic device is folded, the main screen and the back screen face opposite directions; when the electronic device is unfolded, the main screen and the back screen face the same direction, and the display area is the entire display screen. The method includes:

[0078] S301: In response to a screen-off operation, the electronic device determines whether the electronic device is in a folded state.

[0079] In some implementations, before executing S301, in order to save the user from viewing the sequin work number generated by information such as time and date, the electronic device can turn on the screen-off display function.

[0080] The above-mentioned screen-off operation may include but is not limited to: lock screen operation, power-on operation, tap operation, etc. Specifically, the lock screen operation may include but is not limited to: pressing the lock screen button on the side or top of the electronic device, clicking the lock screen control in the user interface, voice commands, gesture commands, etc. In the case where the screen-off operation is a lock screen operation, the screen-off operation can be used to trigger the screen display state to switch from the ON state to the Doze state. The power-on operation may include: long pressing the power button on the side or top of the electronic device. In the case where the screen-off operation is a power-on operation, the screen-off operation can be used to trigger the screen display state to switch from the ON state to the Doze state. In fact, before responding to the power-on operation, the electronic device is in the power-off state, and after responding to the power-on operation, the electronic device switches from the power-off state to the ON state of the power-on state. The operation of tapping the lock screen interface may include: the user tapping the screen after the electronic device turns off the screen. In the case where the screen-off operation is a tap operation, the screen-off operation can be used to trigger the screen display state to switch from the OFF state to the Doze state. It is worth noting that when the user performs the screen-off operation by lightly touching the screen, the mode in which the AOD interface is displayed can only be Mode 1. In other words, if the electronic device does not use Mode 1 to implement the screen-off display function, the light touch operation cannot trigger the screen display state to change from the OFF state to the Doze state.

[0081] In the software structure of electronic devices, the application layer includes AOD applications; the application framework layer includes Device State Provider, Fold Screen Manager Service, Power Manager Service, and Device Manager Service; and the hardware abstraction layer includes Sensor Service. After turning on the AOD function, the specific implementation process of determining whether the electronic device is in the folded state can be referred to as follows:

[0082] The electronic device can enable the AOD application, and the AOD application registers for detection with the Power Manager Service. The specific event detected by the AOD application is whether the screen display state of the Power Manager Service changes to the Doze state or whether the screen display state of the Power Manager Service changes from the Doze state to the ON state; when the Power Manager Service responds to the screen display state changing to the Doze state, it uses the callback function onDreamingStarted to notify the AOD application that the current screen display state has changed to the Doze state; the AOD application calls the getDisplayMode function to obtain the screen posture of the electronic device from the device status provider.

[0083] In some implementations, after the electronic device responds to the screen-off operation, it can determine whether the electronic device is in the folded state. Specifically, the electronic device can determine whether the electronic device is in the folded state using a posture sensor and / or a Hall sensor. The posture sensor may include an acceleration sensor and a gyroscope sensor.

[0084] In one possible implementation, the electronic device can detect the angle between the main screen and the back screen through a posture sensor, and determine the screen posture of the electronic device based on the angle. The above-mentioned angle between the main screen and the back screen refers to the angle between the plane where the main screen is located and the plane where the back screen is located. The specific implementation method of using the posture sensor to determine whether the electronic device is in a folded state can refer to the following content: Sensor Service can provide posture sensor data (i.e., the angle between the main screen and the back screen) to Device State Provider, and Device State Provider determines the screen posture of the electronic device based on the posture sensor data provided by Sensor Service.

[0085] The following describes how to determine the screen posture of an electronic device based on the angle between the main screen and the back screen.

[0086] Figure 4A exemplarily shows a schematic diagram of the screen posture of an electronic device when the screen is gradually unfolded. Figure 4B exemplarily shows a schematic diagram of the screen posture of an electronic device when the screen is gradually folded.

[0087] As shown in Figure 4A, when the screen of the electronic device is gradually unfolded, when the angle between the main screen and the back screen is 0 to 60 degrees, it can be determined that the screen of the electronic device is in a folded state. When the angle between the main screen and the back screen is 63 to 153 degrees, it can be determined that the screen posture of the electronic device is in a stand state. When the angle between the main screen and the back screen is 153 to 180 degrees, it can be determined that the screen posture of the electronic device is in an unfolded state. As shown in Figure 4B, when the screen of the electronic device is gradually folded, when the angle between the main screen and the back screen is 150 to 180 degrees, it can be determined that the screen of the electronic device is in an unfolded state. When the angle between the main screen and the back screen is 57 to 147 degrees, it can be determined that the screen posture of the electronic device is in a stand state. When the angle between the main screen and the back screen is 0 to 57 degrees, it can be determined that the screen posture of the electronic device is in a folded state. In the process of transforming from the folded state to the stand state or vice versa, a certain error rate can be guaranteed by a 3-degree hysteresis. The previous screen posture is used as the screen posture in the hysteresis angle, which is beneficial to improving the accuracy of detecting the screen posture of the electronic device. In the process of transforming from the stand state to the folded state or vice versa, when the angle between the main screen and the back screen is at the boundary value, the previous screen posture is also used as the current screen posture, which is beneficial to improving the accuracy of detecting the screen posture of the electronic device. In the embodiment of the present application, the degree of hysteresis can be any predefined value. Here, 3 degrees is used as an example and is not limited here.

[0088] In another possible implementation, the electronic device can detect the magnetic field strength between the main screen and the back screen through a Hall sensor, and determine the screen posture of the electronic device based on the magnetic field strength. For example, when the magnetic field strength between the main screen and the back screen is greater than or equal to a preset magnetic field strength value, it can be determined that the screen state of the electronic device is in a folded state; when the magnetic field strength between the main screen and the back screen is less than the preset magnetic field strength value, it can be determined that the screen state of the electronic device is in an unfolded state or a stand state. The specific implementation method of determining whether the electronic device is in a folded state by using a Hall sensor can refer to the following content: The Sensor Service can provide Hall sensor data (that is, whether the electronic device is in a folded state) to the Device State Provider, and the Device State Provider determines the screen posture of the electronic device based on the Hall sensor data provided by the Sensor Service.

[0089] In another possible implementation, the electronic device can determine the screen state of the electronic device through a gesture sensor and a Hall sensor. This can further improve the accuracy of detecting the screen gesture of the electronic device. The method of jointly determining the screen state of the electronic device through a gesture sensor and a Hall sensor can be referred to above and will not be repeated here.

[0090] Exemplarily, the electronic device determines that the screen posture of the electronic device is in a folded state based on the angle between the main screen and the back screen. At this time, it is necessary to further determine the screen posture of the electronic device based on the Hall sensor data. If the Hall sensor data also determines that the screen posture of the electronic device is also in a folded state, then the screen posture of the electronic device can be determined to be in a folded state; if the Hall sensor data determines that the screen posture of the electronic device is not in a folded state, then it is necessary to re-acquire the data detected by the posture sensor and / or the Hall sensor to re-judge the screen posture of the electronic device. In the embodiment of the present application, the above is only an exemplary explanation, and other methods can also be included to more accurately determine the screen posture through two sensors, which is not limited to this.

[0091] In one possible implementation, when the electronic device detects a change in screen posture (for example, the user folds an unfolded electronic device, or unfolds a folded electronic device), the screen posture needs to be re-determined, that is, the method flow shown in Figure 3A is re-executed.

[0092] If it is determined that the screen posture of the electronic device is in the folded state, S302 is executed; if it is determined that the screen posture of the electronic device is in the unfolded state, S312 is executed.

[0093] S302: When the electronic device is in the folded state, determine whether the electronic device is in the handheld state.

[0094] In some implementations, when the electronic device is in a handheld state, it can be understood that the current user is holding the electronic device, and it is not only necessary to consider the state of the electronic device but also the user's needs must be considered first; when the electronic device is in a non-handheld state, the current user is not holding the electronic device, and the electronic device may be placed on other objects. At this time, the state of the electronic device can be given priority.

[0095] Since the electronic device is in a folded state as shown in FIG2B , if a user wants to hold the electronic device, they will inevitably touch the main screen and / or back screen of the electronic device to a large extent. In some implementations, the electronic device can use a touch sensor to determine whether the electronic device is in a handheld state. Specifically, the electronic device can determine whether the electronic device is currently in a handheld state by judging the data collected by the touch sensor and analyzing the position where the electronic device is touched.

[0096] In one possible implementation, the electronic device may further combine an acceleration sensor, a proximity light sensor, and a temperature sensor to further determine whether the current electronic device is in a handheld state. Specifically, the electronic device may determine whether the motion trajectory of the electronic device conforms to the motion trajectory of a user holding the electronic device through the data collected by the acceleration sensor. If so, it is determined that the electronic device may be in a handheld state. Furthermore, based on determining whether the motion trajectory of the electronic device conforms to the motion trajectory of a user holding the electronic device, if the electronic device determines through the proximity light sensor that a portion of the electronic device is blocked and then determines through the temperature sensor that the temperature of the blocked portion is close to the temperature of a human hand, it can be further determined that the electronic device is in a handheld state.

[0097] In the embodiment of the present application, the above-mentioned method of determining whether the electronic device is in a handheld state is only illustrative, and other methods may also be included, which are not limited to this.

[0098] If the electronic device is determined to be in the non-handheld state, S303 is executed; if the electronic device is determined to be in the handheld state, S306 is executed.

[0099] S303: When the electronic device is in a non-handheld state, determine the screen orientation of the electronic device.

[0100] In some implementations, the prerequisite for S303 is that the electronic device is in a non-handheld state and the screen of the electronic device is in a folded state. Therefore, the electronic device may be placed statically on other objects, and the main screen and the back screen are definitely not facing the same direction.

[0101] In an embodiment of the present application, when the electronic device determines that the screen posture is in a folded state, it can further determine the screen orientation of the electronic device based on posture angle, acceleration and other data, so as to subsequently display the AOD interface according to the screen orientation. The above-mentioned screen orientation may refer to the orientation of the main screen, such as the main screen facing up or the main screen facing down. Optionally, the screen orientation of the electronic device may also refer to the orientation of the back screen, such as the back screen facing up or the back screen facing down. In an embodiment of the present application, the main screen facing up may also be understood as the back screen facing down, and the main screen facing down may also be understood as the back screen facing up, without limitation.

[0102] The specific implementation method for determining the screen orientation of an electronic device can be found below: When the screen of an electronic device is in the folded state, the AOD application calls the registerDeviceListener function to check the Device Manager Service. The specific event detected is that the Device Manager Service determines the screen orientation of the electronic device and sends the screen orientation information to the AOD application. Accordingly, the AOD application can obtain the screen orientation of the electronic device.

[0103] In one possible implementation, when an electronic device determines the screen orientation of the electronic device, the specific implementation may be: the electronic device obtains the vertical acceleration of the electronic device when it is in a stationary state; if the direction of the vertical acceleration is downward, the electronic device determines that the main screen of the electronic device is facing upward; if the direction of the vertical acceleration is upward, the electronic device determines that the main screen of the electronic device is facing downward.

[0104] In a specific implementation, when the electronic device is in a stationary state, the acceleration sensor is used to obtain the vertical acceleration of the electronic device at this time. The screen orientation of the electronic device can be determined based on the direction of the vertical acceleration. Specifically, if the direction of the vertical acceleration is downward (for example, the vertical acceleration is 9.8), the main screen of the electronic device is considered to be facing upward; if the direction of the vertical acceleration is upward (for example, the vertical acceleration is -9.8), the main screen of the electronic device is considered to be facing downward.

[0105] Optionally, when the electronic device obtains the vertical acceleration when the electronic device is in a stationary state, specifically, the electronic device obtains the vertical acceleration when the electronic device is in a stationary state and the attitude angle is less than a preset value. The attitude angle refers to the angle between the display plane of the electronic device and the horizontal plane. The preset value can be 8 degrees or any preset value, which is not limited here. Based on this method, the display plane of the electronic device can be kept as level as possible with the horizontal plane within a certain error range, which is conducive to improving the accuracy of determining the screen orientation of the electronic device.

[0106] In one possible implementation, the electronic device may execute S303 at fixed time intervals. For example, when the electronic device responds to a screen-off operation, then determines that the screen posture is folded, and then determines that the electronic device is in a non-handheld state, the electronic device may determine the screen orientation of the electronic device every one minute. In the embodiments of the present application, the above-mentioned fixed time intervals are merely illustrative and are not limiting.

[0107] In one possible implementation, the function of recognizing a person's portrait through the main screen camera or the rear screen camera can be disabled during the execution of S301-S303. The function of recognizing a person's eye or portrait through the camera can be enabled after the screen orientation of the electronic device is determined. This can save power.

[0108] When the electronic device determines that the screen orientation is that the main screen is facing upward, S304 is executed; when the electronic device determines that the screen orientation is that the rear screen is facing upward, S305 is executed.

[0109] S304 : When the main screen of the electronic device is facing upward and a first condition for displaying the AOD interface is met, the AOD interface is displayed on the main screen.

[0110] In some implementations, the first condition may include any one of the following: when the electronic device adopts mode 1, the main screen of the electronic device receives a tap operation; when the electronic device adopts mode 2, no operation needs to be received; when the electronic device adopts mode 3, no operation needs to be received within a preset time period; when the electronic device adopts mode 4, the electronic device recognizes human eyes or faces through the camera on the main screen; when the electronic device adopts mode 1 and mode 4 at the same time, the main screen of the electronic device receives a tap operation or recognizes human eyes or faces through the camera on the main screen.

[0111] Among them, the time for displaying the AOD interface in S304 can refer to the relevant instructions for introducing AOD above. Specifically, when the electronic device adopts mode 1 and the main screen of the electronic device receives a tap operation, the AOD interface can be displayed on the main screen for a period of time (for example, 10 seconds). When the electronic device adopts mode 2, the AOD interface can be displayed on the main screen until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 3, the AOD interface can be displayed on the main screen within a preset time period until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 4 and the electronic device recognizes a face or a face through the camera on the main screen, the AOD interface can be displayed on the main screen for a period of time (for example, 10 seconds).

[0112] In one possible implementation, when the electronic device uses both Mode 1 and Mode 4, the mode triggered later than the time when the electronic device displays the AOD interface shall prevail. For example, the electronic device receives a touch operation on the main screen at time a, and detects a face through the camera of the main screen at time b, where time b is 4 seconds after time a. The main screen can display the AOD interface for 14 seconds after time a, that is, the AOD interface is displayed for 10 seconds after time b.

[0113] In another possible implementation, when the electronic device adopts mode 1 and mode 4 at the same time, the time for the electronic device to display the AOD interface is based on the mode that is triggered first. For example, the electronic device receives a touch operation on the main screen at moment a, and detects a face through the camera of the main screen at moment b, wherein moment b is after moment a and the difference is 4 seconds. The main screen can display the AOD interface for 10 seconds after moment a, that is, the AOD interface is displayed for 6 seconds after moment b. In the embodiment of the present application, the duration of displaying the AOD interface in the above two modes at the same time is only illustrative and is not limited here.

[0114] In one possible implementation, if the screen orientation of the electronic device changes while the electronic device is displaying the AOD interface, the screen of the electronic device displaying the AOD interface will also change, and the time for displaying the AOD interface will also change.

[0115] Specifically, the electronic device can determine that the electronic device has flipped from the main screen facing up to the back screen facing up by the direction of the vertical acceleration. The judgment method can refer to the relevant description in the above S303 and will not be repeated here. The electronic device can then display the AOD interface on the back screen. The electronic device can reset the time for displaying the AOD interface, or it can sum up the total time displayed on the main screen and the back screen. For example, when the electronic device adopts mode 1, the main screen of the electronic device faces up, and at moment c, in response to a light touch operation on the main screen, the AOD interface is displayed on the main screen. At moment d, the electronic device flips over, the back screen of the electronic device faces up, and the AOD interface is displayed on the back screen. Among them, moment d is after moment c, and the difference is 4 seconds. The duration of displaying the AOD interface on the back screen can be 10 seconds or 6 seconds. In the embodiment of the present application, there is no limitation on the time for displaying the AOD interface on another screen after the electronic device displaying the AOD interface is flipped.

[0116] In one possible implementation, when the electronic device is in a non-handheld state and the main screen of the electronic device is facing upward, the back screen of the electronic device will not display the AOD interface even if a light touch operation is received.

[0117] S305: When the back screen of the electronic device is facing upward and the second condition for displaying the AOD interface is met, the AOD interface is displayed on the back screen.

[0118] In some implementations, the second condition may include any one of the following: when the electronic device adopts mode 1, the back screen of the electronic device receives a light touch operation; when the electronic device adopts mode 2, no operation needs to be received; when the electronic device adopts mode 3, no operation needs to be received within a preset time period; when the electronic device adopts mode 4, the electronic device recognizes human eyes or faces through the camera on the back screen; when the electronic device adopts mode 1 and mode 4 at the same time, the back screen of the electronic device receives a light touch operation or recognizes human eyes or faces through the camera on the back screen.

[0119] Among them, the time for displaying the AOD interface in S305 can refer to the relevant instructions for introducing AOD above. Specifically, when the electronic device adopts mode 1 and the back screen of the electronic device receives a touch operation, the AOD interface can be displayed on the back screen for a period of time (for example, 10 seconds). When the electronic device adopts mode 2, the AOD interface can be displayed on the back screen until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 3, the AOD interface can be displayed on the back screen within a preset time period until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 4 and the electronic device recognizes a face or a face through the camera on the back screen, the AOD interface can be displayed on the main screen for a period of time (for example, 10 seconds).

[0120] In one possible implementation, when the electronic device uses both mode 1 and mode 4, the time at which the electronic device displays the AOD interface is based on the mode triggered later. For example, the electronic device receives a touch operation on the back screen at time a, and detects a face through the camera of the back screen at time b, where time b is after time a and the difference is 4 seconds. The back screen can display the AOD interface for 14 seconds after time a, that is, it can display the AOD interface for 10 seconds after time b.

[0121] In another possible implementation, when the electronic device adopts mode 1 and mode 4 at the same time, the time for the electronic device to display the AOD interface is based on the mode that is triggered first. For example, the electronic device receives a light touch operation on the back screen at moment a, and detects a face through the camera of the back screen at moment b, wherein moment b is after moment a and the difference is 4 seconds. The back screen can display the AOD interface for 10 seconds after moment a, that is, the AOD interface can be displayed for 6 seconds after moment b. In the embodiment of the present application, the duration of displaying the AOD interface in the above two modes at the same time is only illustrative and is not limited here.

[0122] In one possible implementation, if the screen orientation of the electronic device changes while the electronic device is displaying the AOD interface, the screen of the electronic device displaying the AOD interface will also change, and the time for displaying the AOD interface will also change.

[0123] Specifically, the electronic device can determine that the electronic device has flipped from the back screen facing up to the main screen facing up by the direction of the vertical acceleration. The judgment method can refer to the relevant description in S303 above and will not be repeated here. The electronic device can then display the AOD interface on the main screen. The electronic device can reset the time for displaying the AOD interface, or it can sum up the total time displayed on the main screen and the back screen. For example, when the electronic device adopts mode 1, the back screen of the electronic device faces up, and at moment c, in response to a light touch operation on the back screen, the AOD interface is displayed on the back screen. At moment d, the electronic device flips over, the main screen of the electronic device faces up, and the AOD interface is displayed on the main screen. Among them, moment d is after moment c and the difference is 4 seconds. The duration of displaying the AOD interface on the main screen can be 10 seconds or 6 seconds. In the embodiment of the present application, there is no limitation on the time for displaying the AOD interface on another screen after the electronic device displaying the AOD interface is flipped.

[0124] In one possible implementation, when the electronic device is in a non-handheld state, with the back screen of the electronic device facing upward, the AOD interface will not be displayed on the main screen even if the main screen of the electronic device receives a light touch operation.

[0125] In one possible implementation, when the electronic device adopts mode 4, after determining the screen orientation of the electronic device, since the camera located in the screen facing downward may not be able to collect valid face or eye data, the camera located in the screen facing downward may be turned off, or the camera located in the screen facing downward may be turned on but the collected image data is not uploaded. In this way, the collection of unnecessary image data is reduced and the power consumption of the electronic device is reduced. For example, in S304, the main screen of the electronic device is facing upward, at this time, the camera of the back screen may be turned off or the camera of the back screen may be turned on but the image data collected by the camera of the back screen may not be uploaded. In S305, the back screen of the electronic device is facing upward, at this time, the camera of the main screen may be turned off or the camera of the main screen may be turned on but the image data collected by the camera of the main screen may be uploaded.

[0126] S306: When the electronic device is in a handheld state, determine whether the electronic device recognizes a human face or human eyes through the main screen camera or the back screen camera.

[0127] In some implementations, the electronic device may display the AOD interface in mode 4 according to user settings, or the electronic device may automatically display the AOD interface in mode 4. When the electronic device is determined to be in a handheld state, both the main screen camera and the back screen camera of the electronic device are activated. It is understandable that the camera face or eye recognition function in S306 can be used to determine whether to display the AOD interface on the main screen or on the back screen.

[0128] If the main screen camera of the electronic device recognizes a human face or human eyes, execute S307; if the back screen camera of the electronic device recognizes a human face or human eyes, execute S308; if neither the main screen camera nor the back screen camera of the electronic device recognizes a human face or human eyes, execute S309.

[0129] S307: When the electronic device recognizes a human face or human eyes through the main screen camera, the AOD interface is displayed on the main screen.

[0130] In some implementations, the electronic device's recognition of a face or eye via the main screen camera can be interpreted as indicating that the user is currently facing or looking at the main screen. It's worth noting that the user may be lying down, with the main screen of the electronic device facing downward. That is, in one possible implementation, the AOD interface can be displayed on the main screen when the back screen of the electronic device is facing upward.

[0131] In some implementations, when the electronic device only adopts mode 4, the AOD interface can be displayed on the main screen for a period of time (for example, 10 seconds) after the main screen camera recognizes a face or a human eye. When the electronic device adopts mode 1 and mode 4, the main screen of the electronic device receives a tap operation and displays the AOD interface on the main screen for a period of time (for example, 10 seconds) after the main screen camera recognizes a face or a human eye. When the electronic device adopts mode 2 and mode 4, the AOD interface is displayed on the main screen until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 3 and mode 4, the AOD interface can be displayed on the main screen within a preset time period after the main screen camera recognizes a face or a human eye until the electronic device switches from the Doze state to the OFF state or switches to the ON state.

[0132] In one possible implementation, when the electronic device uses Mode 1 and Mode 4, the AOD interface can be displayed on the main screen for a period of time (e.g., 10 seconds) after the main screen camera recognizes a face or eye. In other words, the first display on the main screen can be triggered without a tap operation, and the next display on the main screen requires a tap operation to trigger.

[0133] In one possible implementation, after executing S307, the electronic device can recognize a face or eye through the back screen camera, but cannot recognize a face or eye through the main screen camera, and can switch to displaying the AOD interface on the back screen. Specifically, the electronic device can recognize a face or eye through the back screen camera. Then the electronic device can display the AOD interface on the back screen. The electronic device can reset the time for displaying the AOD interface, or it can sum up the total time displayed on the main screen and the back screen. For example, when the electronic device adopts mode 1, at time c, the electronic device recognizes a face or eye through the main screen camera, and displays the AOD interface on the main screen. At time d, the electronic device recognizes a face or eye through the back screen camera, but cannot recognize a face or eye through the main screen camera, and can display the AOD interface on the back screen. Among them, time d is after time c, and the difference is 4 seconds. The duration of displaying the AOD interface on the back screen can be 10 seconds or 6 seconds. In the embodiment of the present application, there is no limitation on the time for displaying the AOD interface on another screen after the camera of the electronic device displaying the AOD interface detects a change in the human eye or face.

[0134] S308. When the electronic device recognizes a human face or human eyes through the back screen camera, the AOD interface is displayed on the back screen.

[0135] In some implementations, the electronic device's recognition of a face or eye via the rear-screen camera can be interpreted as indicating that the user is facing or gazing at the rear screen. It's worth noting that the user may be lying down, with the rear screen of the electronic device facing downward. That is, in one possible implementation, the AOD interface can be displayed on the main screen of the electronic device when the main screen is facing upward.

[0136] In some implementations, when the electronic device only adopts mode 4, the AOD interface can be displayed on the main screen for a period of time (for example, 10 seconds) after the back-screen camera recognizes a face or a human eye. When the electronic device adopts mode 1 and mode 4, after the back-screen camera recognizes a face or a human eye, the back screen of the electronic device receives a touch operation and displays the AOD interface on the back screen for a period of time (for example, 10 seconds). When the electronic device adopts mode 2 and mode 4, the AOD interface is displayed on the back screen until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 3 and mode 4, after the back-screen camera recognizes a face or a human eye, the AOD interface can be displayed on the back screen within a preset time period until the electronic device switches from the Doze state to the OFF state or switches to the ON state.

[0137] In one possible implementation, when the electronic device uses Mode 1 and Mode 4, the AOD interface can be displayed on the back screen for a period of time (e.g., 10 seconds) after the back screen camera recognizes a face or eye. In other words, the first display on the back screen can be triggered without a tap, and the next display on the back screen requires a tap.

[0138] In one possible implementation, after executing S308, the electronic device can recognize a human face or human eyes through the main screen camera, but cannot recognize a human face or human eyes through the back screen camera, then the electronic device can switch to the main screen to display the AOD interface.

[0139] In one possible implementation, if the electronic device can recognize a human face or human eyes through both the main screen camera and the back screen camera, the screen orientation of the electronic device can be further determined.

[0140] In one possible implementation, as can be seen from S307 or S308 above, when the electronic device is in Doze mode and is held in hand, as long as a camera of the electronic device recognizes a human eye or face, the AOD interface can be displayed on the main screen or back screen where the camera that recognized the human eye or face is located. In this way, the AOD interface can be displayed by recognizing a face or eye even when the screen orientation of the electronic device is neither the main screen facing up nor the back screen facing up.

[0141] S309: When the electronic device cannot recognize a human face and human eyes, determine the screen orientation of the electronic device.

[0142] In some implementations, when the electronic device is in handheld mode, the electronic device cannot recognize human eyes or faces. This means that the ambient lighting in which the electronic device is located is extremely dim, or the angle between the user and the electronic device is such that the electronic device cannot recognize human faces or eyes, but the user can observe the content on the screen of the electronic device facing upwards. In this case, the electronic device can determine the screen orientation of the electronic device. For details on how to determine the screen orientation of the electronic device, please refer to the relevant description in S303 and will not be repeated here.

[0143] When the electronic device cannot recognize a human face and eyes and determines that the screen orientation is the main screen facing upward, execute S310; when the electronic device cannot recognize a human face and eyes and determines that the screen orientation is the rear screen facing upward, execute S311.

[0144] S310 : When the main screen of the electronic device faces upward and a third condition for displaying the AOD interface is met, displaying the AOD interface on the main screen.

[0145] In some implementations, the third condition may include any one of the following: when the electronic device adopts mode 1, the main screen of the electronic device receives a tap operation; when the electronic device adopts mode 2, no operation needs to be received; when the electronic device adopts mode 3, no operation needs to be received within a preset time period.

[0146] Among them, the time for displaying the AOD interface in S310 can refer to the relevant instructions for introducing AOD above. Specifically, when the electronic device adopts mode 1 and the main screen of the electronic device receives a tap operation, the AOD interface can be displayed on the main screen for a period of time (for example, 10 seconds). When the electronic device adopts mode 2, the AOD interface can be displayed on the main screen until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 3, the AOD interface can be displayed on the main screen within a preset time period until the electronic device switches from the Doze state to the OFF state or switches to the ON state.

[0147] In one possible implementation, if the screen orientation of the electronic device changes while the electronic device is displaying the AOD interface, the screen on which the electronic device displays the AOD interface will also change, and the time for displaying the AOD interface will also change. For the above specific implementation, please refer to the relevant description in S304 and will not be repeated here.

[0148] In one possible implementation, when the electronic device is in a handheld state and the main screen of the electronic device is facing upward, the back screen of the electronic device will not display the AOD interface even if a light touch operation is received.

[0149] S311 . When the back screen of the electronic device is facing upward and the fourth condition for displaying the AOD interface is met, display the AOD interface on the back screen.

[0150] In some implementations, the fourth condition may include any one of the following: when the electronic device adopts mode 1, the back screen of the electronic device receives a tap operation; when the electronic device adopts mode 2, no operation needs to be received; when the electronic device adopts mode 3, no operation needs to be received within a preset time period.

[0151] Among them, the time for displaying the AOD interface in S311 can refer to the relevant instructions for introducing AOD above. Specifically, when the electronic device adopts mode 1 and the back screen of the electronic device receives a light touch operation, the AOD interface can be displayed on the back screen for a period of time (for example, 10 seconds). When the electronic device adopts mode 2, the AOD interface can be displayed on the back screen until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 3, the AOD interface can be displayed on the back screen within a preset time period until the electronic device switches from the Doze state to the OFF state or switches to the ON state.

[0152] In one possible implementation, if the screen orientation of the electronic device changes while the AOD interface is being displayed, the screen on which the AOD interface is displayed will also change, and the time for displaying the AOD interface will also change. For the specific implementation, reference may be made to the relevant description in S305 and will not be repeated here.

[0153] In one possible implementation, when the electronic device is in a handheld state with the back screen of the electronic device facing upward, the AOD interface will not be displayed on the main screen even if the main screen of the electronic device receives a light touch operation.

[0154] S312: When the electronic device is in the unfolded state and the fifth condition for displaying the AOD interface is met, the AOD interface is displayed in full screen.

[0155] In some implementations, the fifth condition may include any one of the following: when the electronic device adopts mode 1, the main screen of the electronic device receives a tap operation; when the electronic device adopts mode 2, no operation needs to be received; when the electronic device adopts mode 3, no operation needs to be received within a preset time period; when the electronic device adopts mode 4, the electronic device recognizes human eyes or faces through the camera on the main screen; when the electronic device adopts mode 1 and mode 4 at the same time, the main screen of the electronic device receives a tap operation or recognizes human eyes or faces through the camera on the main screen.

[0156] By implementing the above method, when the electronic device is in a folded state, it can be determined whether the AOD interface is displayed on the main screen or on the back screen, and it can also be determined when the AOD interface is displayed and how long it is displayed. In addition, when the user holds the electronic device, it is possible to more accurately identify the screen of the electronic device that can be used to display the AOD interface. In this way, the user's usage situation can be fully taken into account, and the user's desire to view the AOD interface on the screen facing themselves can be met to the greatest extent.

[0157] Another method for displaying a screen off is described below in conjunction with FIG3B. Another method for displaying a screen off is described below in conjunction with FIG3B according to an embodiment of the present application.

[0158] S313. The electronic device determines whether the electronic device is in a folded state in response to the screen-off operation.

[0159] For the relevant description of S313, please refer to the detailed description of S301 above, which will not be repeated here.

[0160] S314: When the electronic device is in the folded state, determine whether the electronic device recognizes a human face or human eyes through the main screen camera or the back screen camera.

[0161] When the electronic device implements the AOD function using only Mode 4 and is in a folded state, the electronic device activates the portrait or eye recognition functions of the main screen camera and the rear screen camera. If the main screen camera of the electronic device recognizes a face or eye, S315 is executed; if the rear screen camera of the electronic device recognizes a face or eye, S316 is executed; if neither the main screen camera nor the rear screen camera of the electronic device recognizes a face or eye, S317 is executed.

[0162] S315: When the electronic device recognizes a human face or human eyes through the main screen camera, the AOD interface is displayed on the main screen.

[0163] For the relevant description of S315, please refer to the detailed description of S307 above, which will not be repeated here.

[0164] S316. When the electronic device recognizes a human face or human eyes through the back screen camera, the AOD interface is displayed on the back screen.

[0165] For the relevant description of S316, please refer to the detailed description of S308 above, which will not be repeated here.

[0166] S317: When the electronic device cannot recognize the human face and human eyes, determine the screen orientation of the electronic device.

[0167] For the relevant description of S317, please refer to the detailed description of S309 above, which will not be repeated here.

[0168] S318 . When the main screen of the electronic device is facing upward and the third condition for displaying the AOD interface is met, the AOD interface is displayed on the main screen.

[0169] For the relevant description of S318, please refer to the detailed description of S310 above, which will not be repeated here.

[0170] S319: When the back screen of the electronic device is facing upward and the fourth condition for displaying the AOD interface is met, the AOD interface is displayed on the back screen.

[0171] For the relevant description of S319, please refer to the detailed description of S311 above, which will not be repeated here.

[0172] By implementing the above method, the electronic device can first consider the actual needs of the user to display the AOD interface by recognizing the human eye or face, and then display the AOD interface based on the auxiliary judgment of the screen orientation of the electronic device. In one possible implementation, there is no need to determine whether the electronic device is in a handheld or non-handheld state.

[0173] In the embodiment of the present application, when the electronic device is in the folded state, the main screen and the back screen will not display the AOD interface at the same time, but the main screen and the back screen can display the same AOD interface at different times. Since the main screen and the back screen are of different sizes, the sizes of the elements in the same AOD interface displayed on the main screen and the back screen may be different.

[0174] Several AOD interfaces provided in the embodiments of the present application are described below with reference to FIG. 5A to FIG. 9B .

[0175] Figure 5A shows the AOD interface displayed on the main screen of an electronic device. As shown in Figure 5A, user interface 500 is the AOD interface displayed on the main screen of the electronic device. User interface 500 may include, but is not limited to, icon 501, date clock 502, date clock 503, and battery level 504. In response to user operation, the electronic device can select a preset theme to which icon 501 belongs from multiple preset themes. In other words, icon 501 is preset by the electronic device. Date clock 502 and date clock 503 can represent the date and time in different regions at the same moment. Interval 505 is used to indicate the distance between date clock 502 and date clock 503. For example, date clock 502 displays the text "00:53 New York, Wednesday, November 28th," and date clock 503 displays the text "12:53 New York, Wednesday, November 28th." Battery level 504 indicates that the current battery level of the electronic device is 100%.

[0176] Figure 5B shows the AOD interface displayed on the back screen of an electronic device. As shown in Figure 5B , user interface 510 is the AOD interface displayed on the back screen of the electronic device. Because it is the same AOD interface, user interface 510 contains the same elements as user interface 500. User interface 510 may also include, but is not limited to, icons 511, date clock 512, date clock 513, and battery level 514. Interval 515 indicates the distance between date clock 512 and date clock 513.

[0177] In some implementations, when an icon in the AOD interface is preset by the electronic device, that is, when the theme to which the icon belongs is preset by the electronic device, the size of the icon in the AOD interface displayed on the main screen is the same as that of the icon in the AOD interface displayed on the back screen. For example, the size of icon 501 is the same as that of icon 511. When dual clock text is displayed in the AOD interface, that is, when the date and time of two regions are displayed in the AOD interface, the text size of the date clock in the AOD interface displayed on the back screen is 85% of the text size of the date clock in the AOD interface displayed on the main screen. For example, the size of the text in date clock 512 is 85% of the size of the text in date clock 502, and the size of the text in date clock 513 is 85% of the size of the text in date clock 503. In the embodiment of the present application, the above ratio of 85% is only for example and can also refer to other ratios, such as any value between 70% and 90%, as long as the text can be fully displayed on the back screen and the text displayed on the back screen is smaller than the text displayed on the main screen. This is not limited to this. Optionally, when dual clock characters are displayed in the AOD interface, the interval between the two clock characters in the AOD interface displayed on the back screen is also 85% of the interval between the two clock characters in the AOD interface displayed on the main screen. For example, the size of interval 515 is 85% of the size of interval 505.

[0178] Figure 6A shows another AOD interface displayed on the main screen of an electronic device. As shown in Figure 6A, user interface 600 is the AOD interface displayed on the main screen of the electronic device. User interface 600 may include, but is not limited to, icon 601, date clock 602, and battery level 603, etc. The electronic device can respond to user operations and select a third-party theme to which icon 601 belongs from multiple third-party themes. In other words, icon 601 may belong to a theme provided by a third-party application downloaded by the electronic device. Date clock 602 can indicate the date and time of a certain region at a certain moment. For example, date clock 602 displays the text content "08:08 Friday, October 18, September 12, Year of the Pig". Battery level 603 indicates that the current battery level of the electronic device is 100%.

[0179] Figure 6B shows the AOD interface displayed on the back screen of an electronic device. As shown in Figure 6B, user interface 610 is the AOD interface displayed on the back screen of the electronic device. Since it is the same AOD interface, user interface 610 contains the same elements as user interface 600. User interface 610 may also include, but is not limited to, icons 611, a date and time clock 612, and a battery level 613.

[0180] In some implementations, when an icon in the AOD interface is provided by a third-party application downloaded by the electronic device, or is a picture in an album application downloaded by the electronic device, the icon may fill the screen as much as possible. The width of the icon in the AOD interface displayed on the main screen is consistent with the width of the main screen, and the width of the icon in the AOD interface displayed on the back screen is consistent with the width of the back screen. In other words, the aspect ratio of the icon in the AOD interface displayed on the main screen is consistent with the aspect ratio of the icon in the AOD interface displayed on the back screen. For example, the aspect ratio of icon 601 is consistent with the aspect ratio of icon 611. In the case where a single clock text is displayed in the AOD interface, that is, when the date and time of a region are displayed in the AOD interface, the text size of the date clock in the AOD interface displayed on the back screen is consistent with the text size of the date clock in the AOD interface displayed on the main screen. For example, the size of the text in the date clock 612 is consistent with the size of the text in the date clock 602.

[0181] Figure 7A shows another AOD interface displayed on the main screen of an electronic device. As shown in Figure 7A, the user interface 700 is the AOD interface displayed on the main screen of the electronic device. The user interface 700 may include, but is not limited to, a clock icon 701, a date 702, and a battery level 703, etc. The electronic device may select the clock icon 701 from a plurality of preset screen-off icons in response to user operations. In other words, the clock icon 701 may be preset by the electronic device. The date 702 may represent the date of a certain region. For example, the clock icon 701 indicates that the current time is 02:35, and the date 702 displays the text "June 17, Saturday, April 30, Guimao Year". The battery level 703 indicates that the current battery level of the electronic device is 100%.

[0182] Figure 7B shows the AOD interface displayed on the back screen of the electronic device. As shown in Figure 7B, user interface 710 is the AOD interface displayed on the back screen of the electronic device. Since it is the same AOD interface, user interface 710 contains the same elements as user interface 700. User interface 710 may also include, but is not limited to, a clock icon 711, a date 712, and a battery level 713, etc.

[0183] In some implementations, when the clock icon in the AOD interface is preset in the electronic device, the clock icon in the AOD interface displayed on the main screen is the same size as the clock icon in the AOD interface displayed on the back screen. For example, the size of the clock icon 701 is the same as the size of the clock icon 711. When a single date text is displayed in the AOD interface, that is, when a date of a region is displayed in the AOD interface, the text size of the date in the AOD interface displayed on the back screen is the same as the text size of the date in the AOD interface displayed on the main screen. For example, the size of the text in the date 702 is the same as the size of the text in the date 712.

[0184] Figure 8A illustrates another AOD interface displayed on the home screen of an electronic device. As shown in Figure 8A , user interface 800 is the AOD interface displayed on the home screen of the electronic device. User interface 800 may include, but is not limited to, a clock icon 801, a clock icon 802, a date area 803, a date area 804, and a battery level 805. In response to user operation, the electronic device may select clock icon 801 and clock icon 802 from a plurality of preset off-screen icons. In other words, clock icon 801 and clock icon 802 may be preset in the electronic device. Date area 803 may represent the date in one region, while date area 804 may represent the date in another region. For example, clock icon 801 indicates the current time as 02:35, clock icon 802 indicates the current time as 14:35, date area 803 displays the text "New York, November 28, Wednesday," and date area 804 displays the text "Beijing, November 28, Wednesday." Spacer 806 indicates the distance between date area 803 and date area 804. The power level 805 indicates that the current power level of the electronic device is 100%.

[0185] Figure 8B shows the AOD interface displayed on the back screen of an electronic device. As shown in Figure 8B , user interface 810 is the AOD interface displayed on the back screen of the electronic device. Since it is the same AOD interface, user interface 810 contains the same elements as user interface 800. User interface 810 may also include, but is not limited to, a clock icon 811, a clock icon 812, a date area 813, a date area 814, and a battery level 815. A gap 816 is used to indicate the distance between date area 813 and date area 814.

[0186] In some implementations, when the AOD interface displays two clock icons preset in the electronic device, the size of the two clock icons in the AOD interface displayed on the back screen is 85% of the text size of the two clock icons in the AOD interface displayed on the main screen. For example, the size of clock icon 811 is 85% of the size of clock icon 801, and the size of clock icon 812 is 85% of the size of clock icon 802. When the AOD interface displays text in two date regions, that is, when the AOD interface displays dates in two regions, the text size of the date in the AOD interface displayed on the back screen is 85% of the text size of the date in the AOD interface displayed on the main screen. For example, the size of the text in the date region 813 is 85% of the size of the text in the date region 803, and the size of the text in the date region 814 is 85% of the size of the text in the date region 804. In the embodiment of the present application, the above-mentioned ratio of 85% is only for illustrative purposes and may also refer to other ratios, such as any value between 70% and 90%. It only needs to satisfy the requirement that the text can be fully displayed on the back screen and that the text displayed on the back screen is smaller than the text displayed on the main screen. There is no limitation on this. Optionally, when the AOD interface displays dual date and region text, the spacing between the two date and region texts in the AOD interface displayed on the back screen is also 85% of the spacing between the two date and region texts in the AOD interface displayed on the main screen. For example, the size of interval 816 is 85% of the size of interval 806.

[0187] Figure 9A shows another AOD interface displayed on the main screen of an electronic device. As shown in Figure 9A, user interface 900 is the AOD interface displayed on the main screen of the electronic device. User interface 900 may include, but is not limited to, icons 901, a date clock 902, a date clock 903, and a battery level 904, etc.

[0188] Figure 9B shows another AOD interface displayed on the back screen of an electronic device. As shown in Figure 9B, user interface 910 is the AOD interface displayed on the back screen of the electronic device. Since it is the same AOD interface, user interface 910 contains the same types of elements as user interface 900. User interface 910 may also include, but is not limited to: icon 911, date clock 912, date clock 913, and battery level 914, etc. Among them, the above-mentioned icon 901 and icon 911 are not the same icon, and can be referred to as a set of screen-off icons.

[0189] In some implementations, the pre-set themes in the electronic device include a set of screen-off icons, that is, the icons in the AOD interface displayed on the main screen of the electronic device and the icons in the AOD interface displayed on the back screen belong to the same pre-set theme. The set of screen-off icons for the same pre-set theme may include two or more screen-off icons. Exemplarily, icon 901 and icon 911 may belong to the same pre-set theme and may be regarded as a set of screen-off icons. In this way, the diversity of the user's observation of the AOD interface can be increased, adding a sense of freshness.

[0190] In an embodiment of the present application, the AOD interface displayed on the back screen may be referred to as the first AOD interface. The AOD interface displayed on the main screen may be referred to as the second AOD interface. The AOD interface displayed on the screen including the main screen and the back screen when the electronic device is in the unfolded state may be referred to as the third AOD interface. The icons displayed in the AOD interface preset by the electronic device, that is, the screen-off icons provided by the system application may be referred to as the first icon and the second icon. The icons displayed in the AOD interface provided by the third-party application downloaded by the electronic device may be referred to as the third icon. The date clock text area displayed in the AOD interface may be referred to as the first text and the second text. Different screens off belonging to the same theme set may be referred to as the fourth icon and the fifth icon.

[0191] FIG10 shows a schematic structural diagram of the electronic device 100 .

[0192] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0193] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0194] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0195] In some implementations, the processor 110 can be used to determine whether the electronic device 100 is in a folded state. The processor 110 can also be used to determine whether the electronic device 100 is in a handheld state. The processor 110 can also be used to determine the screen orientation of the electronic device. The processor 110 can also be used to determine whether a face or eye is recognized through the main screen camera or the back screen camera.

[0196] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0197] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0198] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0199] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device via the power management module 141.

[0200] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0201] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0202] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0203] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0204] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0205] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0206] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0207] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0208] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0209] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0210] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and transformed into a visible image. The ISP can also perform algorithmic optimization for image noise, brightness, and color. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0211] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0212] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0213] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0214] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0215] The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).

[0216] Random access memory may include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM, for example, the fifth generation DDR SDRAM is generally referred to as DDR5 SDRAM), etc.; non-volatile memory may include disk storage devices and flash memory.

[0217] Flash memory can be divided into NOR FLASH, NAND FLASH, 3D NAND FLASH, etc. according to the operating principle; single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc. according to the storage cell potential level; universal flash storage (UFS) and embedded multi media card (eMMC) can be divided into UFS and eMMC according to the storage specification.

[0218] The random access memory can be directly read and written by the processor 110, and can be used to store executable programs (such as machine instructions) of the operating system or other running programs, and can also be used to store user and application data.

[0219] The non-volatile memory may also store executable programs and user and application data, etc., and may be loaded into the random access memory in advance for direct reading and writing by the processor 110 .

[0220] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 via the external memory interface 120 to implement data storage. For example, files such as music and videos can be stored in the external non-volatile memory.

[0221] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0222] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0223] The pressure sensor 180A is used to sense pressure signals and convert the pressure signals into electrical signals.

[0224] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.

[0225] In some implementations, the gyro sensor 180B may be used to obtain angular velocity and send the angular velocity to the processor 110 so that the processor 110 can determine the screen posture.

[0226] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude using the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.

[0227] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover based on the magnetic sensor 180D. Based on the detected opening and closing status of the case or flip cover, features such as automatic unlocking of the flip cover can be configured.

[0228] In some implementations, the magnetic sensor 180D can be used to determine the magnetic field strength between the primary screen and the secondary screen, and send the magnetic field strength to the processor 110 so that the processor 110 can determine the screen posture.

[0229] Accelerometer 180E can detect the magnitude of acceleration of electronic device 100 in all directions (generally three axes). It can also detect the magnitude and direction of gravity when electronic device 100 is stationary. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.

[0230] In some implementations, the acceleration sensor 180E may be used to obtain acceleration and send the acceleration to the processor 110 so that the processor 110 can determine the screen posture.

[0231] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance using infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focusing.

[0232] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user is holding the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0233] In some implementations, the proximity light sensor 180G can be used to obtain light change data of the user holding the electronic device, so that the processor 110 can further determine that the electronic device is in a handheld state.

[0234] The ambient light sensor 180L is used to sense the brightness of the ambient light.

[0235] The fingerprint sensor 180H is used to collect fingerprints.

[0236] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to prevent the electronic device 100 from shutting down abnormally due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 boosts the output voltage of the battery 142 to prevent abnormal shutdown due to low temperature.

[0237] In some implementations, the temperature sensor 180J may also be used to obtain the temperature of the electronic device when the user holds the electronic device, so that the processor 110 can further determine that the electronic device is in a handheld state.

[0238] The touch sensor 180K is also called a "touch-sensitive device." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, at a location different from that of the display screen 194.

[0239] In some implementations, the touch sensor 180K may be used to detect a touch operation and send the specific location of the touch operation to the processor 110. The touch sensor 180K may also be used to detect a light touch operation in the screen-off state.

[0240] The bone conduction sensor 180M can acquire vibration signals.

[0241] The buttons 190 include a power button, a volume button, and the like.

[0242] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts and can also be used for touch vibration feedback.

[0243] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0244] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0245] FIG11 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present invention.

[0246] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: application layer, application framework layer, system library layer, and kernel layer, from top to bottom.

[0247] The application layer can include a series of application packages.

[0248] As shown in Figure 11, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, AOD, short message and other applications. Among them, the AOD application can detect the screen posture of the device and the handheld or non-handheld state of the electronic device to display the AOD interface.

[0249] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0250] As shown in Figure 11, the application framework layer may include a device state provider (Device State Provider), a folding screen management service (Fold Screen Manager Service), a power management service (Power Manager Service), a device management service (Device Manager Service), a portrait recognition service, etc.

[0251] Device State Provider is used to provide screen posture information. For example, expanded state, folded state, etc. Specifically, it can obtain posture sensor data (such as the angle between the main screen and the back screen) and Hall sensor data (such as the magnetic field strength between the main screen and the back screen) from the hardware abstraction layer, and judge the current screen posture based on this sensor data. Device State Provider can also be used to determine whether the electronic device is in handheld state. Specifically, it can obtain touch sensor data, temperature sensor data, and proximity sensor data from the hardware abstraction layer, and judge whether the current electronic device is in handheld state based on this sensor data.

[0252] The Fold Screen Manager Service is used to manage the screen display of an external folding screen electronic device. It can realize the display of the user interface on the main screen, back screen or full screen according to the coordinates formulated by the dual-screen (i.e. main screen and back screen) display scheme. For example, the AOD interface can be displayed on the main screen of an external folding screen mobile phone, the AOD interface can also be displayed on the back screen of an external folding screen mobile phone, or the AOD interface can be displayed on the entire screen of an external folding screen mobile phone. Of course, the user interface can also be displayed on the main screen of an external folding screen mobile phone, etc., which is not limited here.

[0253] Power Manager Service is one of the system services responsible for managing and coordinating device power management. Common functions include turning on the screen, turning off the screen, brightness adjustment, low power mode, keeping the CPU awake, etc., which will be coordinated and processed by Power Manager Service. For example, Power Manager Service can monitor the changes in the screen's on and off state, thereby controlling the start and end of displaying the AOD interface. In an embodiment of the present application, the screen of the electronic device can be divided into an off state, a bright state, and a screen-off state; wherein, the off state (OFF state) indicates that the electronic device screen is off; the bright state (ON state) indicates that the electronic device screen is lit; the screen-off state (Doze state) indicates that the electronic device screen is dormant and in a low-power state. Changes in the on and off state can include the screen changing from the ON state to the OFF state, or from the ON state to the Doze state, or from the OFF state to the Doze state, or from the Doze state to the ON state, or from the OFF state to the ON state, and so on.

[0254] The Device Manager Service provides information about the device's screen orientation. For example, whether a foldable phone's main screen faces upward or downward. Specifically, the service obtains data such as attitude angle and acceleration from the hardware abstraction layer to determine the device's screen orientation.

[0255] The portrait recognition service can be used to identify whether the camera has captured a human portrait based on the data collected by the camera sensor. It can also determine whether the human face or eyes were captured by the main screen camera or the rear screen camera.

[0256] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0257] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0258] The system library can include multiple functional modules, such as the surface manager and media libraries.

[0259] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0260] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0261] The Hardware Abstraction Layer (HAL) is an interface layer between the operating system kernel and the hardware circuitry. Its purpose is to abstract the hardware. It hides the platform-specific hardware interface details and provides the operating system with a virtual hardware platform. The HAL can include sensor services, among others. These services can provide sensor data, attitude angles, acceleration, and other information. For example, they can provide sensor data to the Device State Provider and attitude angles, acceleration, and other information to the Device Manager Service.

[0262] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0263] The various implementation modes of this application can be combined arbitrarily to achieve different technical effects.

[0264] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described herein are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0265] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0266] In short, the above description is only an embodiment of the technical solution of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made based on the disclosure of the present invention should be included in the scope of protection of the present invention.

Claims

1. A method for displaying a screen off, characterized in that: Applied to an electronic device, the electronic device comprises a main screen, a back screen, a main screen camera, and a back screen camera, the main screen and the back screen are connected by a folding component, the main screen camera and the main screen face the same direction, and the back screen camera and the main screen face opposite directions, the method comprises: When the electronic device is in a folded state, a first screen-off operation is detected, and in the folded state, both the main screen and the back screen face the outside of the electronic device; Starting the main screen camera and the back screen camera; If the back screen camera captures an image containing human eyes and / or human faces, and the main screen camera does not capture an image containing human eyes and / or human faces, displaying a first AOD interface on the back screen; If the main screen camera captures an image containing human eyes and / or human faces, and the back screen camera does not capture an image containing human eyes and / or human faces, a second AOD interface is displayed on the main screen.

2. The method according to claim 1, characterized in that The method further comprises: If the main screen camera captures an image containing human eyes and / or human faces, and the back screen camera captures an image containing human eyes and / or human faces, determine the orientation of the main screen and the back screen; If the back screen is facing upward, displaying the first AOD interface on the back screen; If the main screen is facing upward, the second AOD interface is displayed on the main screen; the upward direction refers to the direction opposite to vertically pointing to the ground.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: If the main screen camera does not capture an image containing human eyes and / or human faces, and the back screen camera does not capture an image containing human eyes and / or human faces, determine the orientation of the main screen and the back screen; If the back screen is facing upward, the first AOD interface is displayed on the back screen in response to the back screen facing upward, or the first AOD interface is displayed on the back screen after receiving a touch operation on the back screen, or the first AOD interface is displayed on the back screen after entering a preset time period; If the main screen is facing upward, the second AOD interface is displayed on the main screen in response to the main screen facing upward, or, the second AOD interface is displayed on the main screen after receiving a touch operation applied to the main screen, or, the second AOD interface is displayed on the main screen after entering the preset time period; upward refers to the direction opposite to pointing vertically to the ground.

4. The method according to any one of claims 1 to 3, characterized in that When the first screen-off operation is detected, the electronic device is held by a user.

5. The method according to claim 4, characterized in that The method further comprises: When the electronic device is in a folded state and is not held by a user, a second screen-off operation is detected; Determining the orientation of the main screen and the back screen; If the back screen is facing upward, the first AOD interface is displayed on the back screen in response to the back screen facing upward, or the first AOD interface is displayed on the back screen after receiving a touch operation on the back screen, or After a preset time period, the first AOD interface is displayed on the back screen, or the back screen camera is started, and the first AOD interface is displayed on the back screen when the back screen camera captures an image containing human eyes and / or human faces; If the main screen is facing upward, the second AOD interface is displayed on the main screen in response to the main screen facing upward, or, the second AOD interface is displayed on the main screen after receiving a touch operation applied to the main screen, or, the second AOD interface is displayed on the main screen after entering the preset time period, or, the main screen camera is started and the second AOD interface is displayed on the main screen when the main screen camera captures an image containing human eyes and / or faces; upward refers to the direction opposite to pointing vertically to the ground.

6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: When the electronic device is in an unfolded state, a third screen-off operation is detected, and in the unfolded state, the main screen and the back screen face the same direction; In response to the main screen and the back screen being oriented in the same direction, a third AOD interface is displayed on the screen, or the third AOD interface is displayed on the screen after a touch operation applied to the screen is received, or the third AOD interface is displayed on the screen after entering a preset time period, or the back screen camera or the main screen camera is started, and the third AOD interface is displayed on the screen when the back screen camera or the main screen camera captures an image containing human eyes and / or human faces; the screen includes the back screen and the main screen that are oriented in the same direction.

7. The method according to any one of claims 1 to 6, characterized in that Before the first screen-off operation is detected, If the state of the electronic device is the screen-off state, the first screen-off operation includes: an operation of touching the screen; If the state of the electronic device is the screen-on state, the screen-off operation includes: a screen-locking operation; If the electronic device is in a power-off state, the first screen-off operation includes a power-on operation.

8. The method according to any one of claims 1 to 7, characterized in that The icons in the first AOD interface only include: a first icon; The icons in the second AOD interface only include: the first icon; The size of the first icon in the first AOD interface is equal to the size of the first icon in the second AOD interface.

9. The method according to any one of claims 1 to 7, characterized in that: The first AOD interface includes: a first icon and a second icon; The second AOD interface includes: the first icon and the second icon; The sizes of the first icon and the second icon in the first AOD interface are smaller than the sizes of the first icon and the second icon in the second AOD interface.

10. The method according to any one of claims 1 to 7, characterized in that The first AOD interface includes: a third icon; The second AOD interface includes: the third icon; The size of the third icon in the first AOD interface is smaller than the size of the third icon in the second AOD interface.

11. The method according to any one of claims 1 to 10, characterized in that The text in the first AOD interface only includes: the first text; The text in the second AOD interface only includes: the first text; The size of the first text in the first AOD interface is equal to the size of the first text in the second AOD interface.

12. The method according to any one of claims 1 to 10, characterized in that The first AOD interface includes: a first text and a second text; The second AOD interface includes: the first text and the second text; The sizes of the first text and the second text in the first AOD interface are smaller than the sizes of the first text and the second text in the second AOD interface.

13. The method according to any one of claims 1 to 7, characterized in that The first AOD interface includes: a fourth icon; The second AOD interface includes: a fifth icon; The fourth icon and the fifth icon belong to the same theme.

14. An electronic device, characterized in that: include: One or more processors, one or more memories; wherein the one or more memories are coupled to the one or more processors, the one or more memories are used to store computer program codes, the computer program codes include computer instructions, and when the one or more processors execute the computer instructions, the electronic device executes the method as described in any one of claims 1-13.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program includes program instructions. When the program instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 13.

Images