Screen-off display method and related device

Abstract

The invention provides a screen-off display method and a related device. In the method, when the electronic equipment is in a screen-off state, whether the electronic equipment is in a folded state or not can be judged firstly, then whether the conditions for displaying the AOD interface are met or not is judged, for example, the conditions for recognizing a human face or human eyes and the like are met or not, and a screen used for displaying the AOD interface is determined. In this way, the AOD interface can be better displayed in combination with user requirements.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computers, and in particular to a screen-off display method and related devices. Background Art

[0002] Electronic devices can display some information in the screen-off state, and users can directly observe the displayed information. For external folding screen electronic devices (including a main screen and a back screen), when the external folding screen electronic device is in different states, how to display information when the screen is off is a problem that technicians in this field need to solve urgently. Summary of the invention

[0003] This application implements a method and a related device for displaying an off-screen display, which can be used to determine the screen on which the AOD interface is displayed, so that the AOD interface can be displayed in a better manner in accordance with user needs.

[0004] In a first aspect, an embodiment of the present application provides a screen-off display method, which is applied to an electronic device, wherein the electronic device includes a main screen, a back screen, a main screen camera, and a back screen camera, the main screen and the back screen are connected by a folding component, the main screen camera and the main screen are oriented in the same direction, and the back screen camera and the main screen are oriented in opposite directions, the method comprising: when the electronic device is in a folded state, detecting a first screen-off operation, in which the main screen and the back screen both face the outside of the electronic device; starting the main screen camera and the back screen camera; if the back screen camera captures an image containing human eyes and / or a human face, and the main screen camera does not capture an image containing human eyes and / or a human face, displaying a first AOD interface on the back screen; if the main screen camera captures an image containing human eyes and / or a human face, and the back screen camera does not capture an image containing human eyes and / or a human face, displaying a second AOD interface on the main screen.

[0005] It can be seen from the above method that the electronic device can consider the actual needs of the user to determine the screen displaying the AOD interface by recognizing the human eyes or face, thereby avoiding the situation where the AOD interface is not displayed on the screen facing the user, while the AOD interface is displayed on the screen not facing the user.

[0006] In combination with the first aspect, in some implementations, the method also includes: if the main screen camera captures an image containing human eyes and / or human faces, and the back screen camera captures an image containing human eyes and / or human faces, determining the orientation of the main screen and the back screen; if the back screen is facing upward, displaying the first AOD interface on the back screen; if the main screen is facing upward, displaying the second AOD interface on the main screen; upward refers to the direction opposite to pointing vertically to the ground.

[0007] In combination with the first aspect, in some implementations, the method also includes: if the main screen camera does not capture images containing human eyes and / or faces, and the back screen camera does not capture images containing human eyes and / or faces, determining the orientation of the main screen and the back screen; if the back screen is facing upward, displaying the first AOD interface on the back screen in response to the back screen facing upward, or, displaying the first AOD interface on the back screen after receiving a touch operation on the back screen, or, displaying the first AOD interface on the back screen after entering a preset time period; if the main screen is facing upward, displaying the second AOD interface on the main screen in response to the main screen facing upward, or, displaying the second AOD interface on the main screen after receiving a touch operation on the main screen, or, displaying the second AOD interface on the main screen after entering the preset time period; upward refers to the direction opposite to pointing vertically to the ground.

[0008] In combination with the first aspect, in some implementations, when the first screen-off operation is detected, the electronic device is held by a user.

[0009] In combination with the first aspect, in some implementations, when the electronic device is in a folded state and is not held by a user, a second screen-off operation is detected; the orientation of the main screen and the back screen is determined; if the back screen is facing upward, the first AOD interface is displayed on the back screen in response to the back screen facing upward, or, after receiving a touch operation acting on the back screen, the first AOD interface is displayed on the back screen, or, after entering a preset time period, the first AOD interface is displayed on the back screen, or, the back screen camera is started, and when the back screen camera captures an image containing human eyes and / or human faces, the back screen camera captures an image containing human eyes and / or human faces. The first AOD interface is displayed on the back screen in the case of an image; if the main screen is facing upwards, the second AOD interface is displayed on the main screen in response to the main screen facing upwards, or, the second AOD interface is displayed on the main screen after receiving a touch operation on the main screen, or, the second AOD interface is displayed on the main screen after entering the preset time period, or, the main screen camera is started, and the second AOD interface is displayed on the main screen when the main screen camera captures an image containing human eyes and / or human faces; upward refers to the direction opposite to vertically pointing to the ground.

[0010] In combination with the first aspect, in some implementations, the method also includes: when the electronic device is in an unfolded state, a third screen-off operation is detected, and in the unfolded state, the main screen and the back screen are oriented in the same direction; in response to the main screen and the back screen being oriented in the same direction, a third AOD interface is displayed on the screen, or, after receiving a touch operation applied to the screen, the third AOD interface is displayed on the screen, or, after entering a preset time period, the back screen camera or the main screen camera is started, and the third AOD interface is displayed on the screen when the back screen camera or the main screen camera captures an image containing human eyes and / or human faces; the screen includes the back screen and the main screen oriented in the same direction.

[0011] In combination with the first aspect, in some implementations, before the first screen-off operation is detected, if the electronic device is in a screen-off state, the first screen-off operation includes: an operation of touching the screen; if the electronic device is in a screen-on state, the screen-off operation includes: a screen-locking operation; if the electronic device is in a power-off state, the first screen-off operation includes a power-on operation.

[0012] In combination with the first aspect, in some implementations, the icons in the first AOD interface only include: the first icon; the icons in the second AOD interface only include: the first icon; the size of the first icon in the first AOD interface is equal to the size of the first icon in the second AOD interface.

[0013] In combination with the first aspect, in some implementations, the first AOD interface includes: a first icon and a second icon; the second AOD interface includes: the first icon and the second icon; the size of the first icon and the second icon in the first AOD interface is smaller than the size of the first icon and the second icon in the second AOD interface.

[0014] In combination with the first aspect, in some implementations, the first AOD interface includes: a third icon; the second AOD interface includes: the third icon; the size of the third icon in the first AOD interface is smaller than the size of the third icon in the second AOD interface.

[0015] In combination with the first aspect, in some implementations, the text in the first AOD interface includes only: the first text; the text in the second AOD interface includes only: the first text; the size of the first text in the first AOD interface is equal to the size of the first text in the second AOD interface.

[0016] In combination with the first aspect, in some implementations, the first AOD interface includes: a first text and a second text; the second AOD interface includes: the first text and the second text; the size of the first text and the second text in the first AOD interface is smaller than the size of the first text and the second text in the second AOD interface.

[0017] In combination with the first aspect, in some implementations, the first AOD interface includes: a fourth icon; the second AOD interface includes: a fifth icon; wherein the fourth icon and the fifth icon belong to the same theme.

[0018] In a second aspect, the present application provides an electronic device, comprising one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program codes, and the computer program codes include computer instructions, and when the one or more processors execute the computer instructions, the electronic device executes the method of the first aspect or any implementation of the first aspect.

[0019] In a third aspect, an embodiment of the present application provides a computer storage medium, including computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method of the first aspect or any implementation method of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1A is a schematic diagram of an AOD interface provided in an embodiment of the present application;

[0021] Figure 1B-Figure 1E is a schematic diagram of a user interface for setting an AOD function provided in an embodiment of the present application;

[0022] Figure 2A is a schematic diagram of an electronic device provided by an embodiment of the present application in an unfolded state;

[0023] Figure 2B is a schematic diagram of an electronic device provided by an embodiment of the present application in a folded state;

[0024] Figure 3A This is a schematic flow chart of a method for displaying an off-screen display provided in an embodiment of the present application;

[0025] Figure 3B This is a schematic flow chart of a method for displaying an off-screen display provided in an embodiment of the present application;

[0026] Figure 4A is a schematic diagram of the screen posture of the electronic device provided by the embodiment of the present application when the screen is gradually unfolded;

[0027] Figure 4Bis a schematic diagram of the screen posture of the electronic device provided by the embodiment of the present application when the screen is gradually folded;

[0028] Figure 5A It is a schematic diagram of an electronic device provided in an embodiment of the present application displaying an AOD interface on a main screen;

[0029] Figure 5B It is a schematic diagram of an electronic device provided in an embodiment of the present application displaying an AOD interface on a back screen;

[0030] Fig. 6A It is a schematic diagram of an electronic device provided in an embodiment of the present application displaying an AOD interface on a main screen;

[0031] Figure 6B It is a schematic diagram of an electronic device provided in an embodiment of the present application displaying an AOD interface on a back screen;

[0032] Fig. 7A It is a schematic diagram of an electronic device provided in an embodiment of the present application displaying an AOD interface on a main screen;

[0033] Figure 7B It is a schematic diagram of an electronic device provided in an embodiment of the present application displaying an AOD interface on a back screen;

[0034] Fig. 8A It is a schematic diagram of an electronic device provided in an embodiment of the present application displaying an AOD interface on a main screen;

[0035] Figure 8B It is a schematic diagram of an electronic device provided in an embodiment of the present application displaying an AOD interface on a back screen;

[0036] Fig.9A It is a schematic diagram of an electronic device provided in an embodiment of the present application displaying an AOD interface on a main screen;

[0037] Fig. 9B It is a schematic diagram of an electronic device provided in an embodiment of the present application displaying an AOD interface on a back screen;

[0038] Fig.10 A schematic diagram of the hardware architecture of an electronic device provided in an embodiment of the present application;

[0039] Fig.11 A schematic diagram of the software architecture of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0040] The technical solutions in the embodiments of the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0041] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0042] The term "user interface (UI)" in the following embodiments of the present application refers to a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device, and finally presented as content that can be recognized by the user. The commonly used form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.

[0043] In order to facilitate understanding of the solution provided by the embodiment of the present application, the following introduces the relevant concepts involved in the embodiment of the present application:

[0044] 1. Always on display (AOD)

[0045] The AOD function refers to the function of an electronic device displaying information such as time, date, and icons in a partial area of ​​the screen without lighting up the entire screen (that is, the electronic device maintains low power consumption), which is conducive to saving the power consumption of the screen generated by the user to view the time, date, and other information. In an embodiment of the present application, the screen of the electronic device can be divided into a screen-off state, a screen-on state, and a screen-off state. Among them, the screen-off state (OFF state) indicates that the screen of the electronic device is off; the screen-on state (ON state) indicates that the screen of the electronic device is all lit, that is, the lit area of ​​the screen includes the black area of ​​the screen; the screen-off state (Doze state) indicates that the screen of the electronic device is partially lit, that is, the part of the screen other than the black area is lit, and the screen is dormant at this time, and the electronic device is in a low power consumption state. The change of the screen-on and screen-off state can include the screen switching from the ON state to the OFF state, or from the ON state to the Doze state, or from the OFF state to the Doze state, or from the Doze state to the ON state, or from the OFF state to the ON state, and so on.

[0046] The following introduces the AOD interface and AOD functions in combination with several user interfaces.

[0047] For example, Figure 1A The AOD interface provided by the electronic device is shown.

[0048] like Figure 1A As shown, the user interface 100 may be an AOD interface provided by the electronic device. The user interface 100 may include, but is not limited to: time 101, region 102, date 103, power 104, and icon 105. When the electronic device is in the screen-off state, the user can also obtain information such as time and date, which is conducive to saving the power consumption of the screen when the user checks the time, date, and other information.

[0049] For example, Figure 1B-Figure 1E Some user interfaces of electronic devices for setting up AOD functions are shown.

[0050] like Figure 1B As shown, the user interface 110 may be a user interface of a setting application provided by the electronic device. The user interface 110 may include, but is not limited to: a screen-off and lock screen bar 111 and other function bars. The electronic device may display the user interface 120 in response to a click operation on the screen-off and lock screen bar 111.

[0051] like Figure 1CAs shown, the user interface 120 may be a user interface provided by the electronic device for setting the screen off function and the lock screen function. The user interface 120 may include, but is not limited to: a screen off display control 121 and a screen off notification light effect control 122. The screen off display control 121 may also include a prompt message 121A. For example, the prompt message 121A may display the text content "turned on", which indicates that the electronic device has started the screen off display function. The screen off notification light effect control 122 may also include a prompt message 122A. For example, the prompt message 122A may display the text content "none", which indicates that the electronic device is not provided with a screen off notification light effect. The electronic device may display the user interface 130 in response to a click operation on the screen off display control 121.

[0052] like Figure 1D As shown, the user interface 130 may be a user interface provided by the electronic device for setting the screen-off display function. The user interface 130 may include, but is not limited to: a screen-off display switch 131, a display mode control 132, and multiple screen-off icons 133. The electronic device may start or turn off the screen-off display function in response to a click operation on the screen-off display switch 131. The electronic device may determine the icon displayed when the electronic device is screen-off in response to a click operation on one of the multiple screen-off icons 133. The electronic device may display the user interface 140 in response to a click operation on the display mode control 132.

[0053] like Figure 1E As shown, user interface 140 may be a user interface provided by an electronic device for selecting a screen-off display mode. User interface 140 may include, but is not limited to: display mode 141, display mode 142, display mode 143, and display mode 144. Exemplarily, display mode 141 is a touch display mode, which may display the text content "display for 10 seconds after clicking the screen". Display mode 142 is a constant-light display mode, which may display the text content "always display". Display mode 143 is a timed display mode, which may display the text content "timed display". In addition, the electronic device responds to a click operation on display mode 143, and displays a control for selecting the start time and end time of the timed display. Exemplarily, a start time control 143A and an end time control 143B may be displayed. Among them, the electronic device may select any time as the start time and end time of the timed display in response to a user operation. Display mode 144 is an intelligent display mode, which may display the text content "intelligent recognition display".

[0054] In the embodiment of the present application, the above user interface is only used for exemplary description, for example, the user interface 120 may only display content related to the screen off. Various user interfaces may also include more or less content, which is not limited.

[0055] In some implementations, the electronic device may start the screen-off display function. When the electronic device meets the conditions for displaying the AOD interface, the electronic device may display the AOD interface. Among them, the modes for displaying the AOD interface may include but are not limited to the following:

[0056] Mode 1: Touch display mode. Mode 1 may mean that the electronic device can respond to the user's touch screen operation and display the AOD interface for a period of time when in Doze state. In the embodiment of the present application, the period of time for displaying the AOD interface is not limited, and can also be 5 seconds, 8 seconds, 10 seconds, etc.

[0057] Mode 2: Always-on display mode. Mode 2 may mean that the electronic device can always display the AOD interface when in Doze state. In one possible implementation, when the electronic device switches to the on-screen state and within a very short time after switching to the lock-screen state, the electronic device may need a very short time to recognize that it has switched to the lock-screen state, and then display the AOD interface after the electronic device recognizes that it has switched to the lock-screen state. To a certain extent, the above very short time can be ignored.

[0058] Mode 3: Timed display mode. Mode 3 may mean that during a preset time period, the electronic device can display the AOD interface when in Doze mode. The preset time period can be set by the user. For example, Figure 1E As shown, the preset time period may be between 7:00 and 23:00.

[0059] Mode 4: Smart Display Mode. Mode 4 may mean that when the electronic device is in Doze mode, if the electronic device recognizes a human portrait, the AOD interface may be displayed for a period of time. For example, 10 seconds. In some implementations, the electronic device may collect image data through a camera and perform human portrait recognition based on the image data. The above-mentioned recognition of human portraits may include: recognizing human eyes and / or human faces.

[0060] In some implementations, the electronic device may select any one of the above modes 1, 2, and 3 to implement the screen-off display function. The electronic device may select any one of the above modes 2, 3, and 4 to implement the screen-off display function. In a possible implementation, the electronic device may also select mode 4 while selecting mode 1, mode 2, or mode 3.

[0061] 2. Outward folding screen

[0062] An outward-folding folding screen means that the user can observe the screen after folding, that is, the screen after folding is facing outward. It should be noted that on an outward-folding folding screen, the main screen and the back screen can be different display areas of the same screen, or different display areas of two screens, without limitation. In one possible implementation, the main screen and the back screen can be connected by a folding component (for example, a side display or a hinge).

[0063] Combine the following Figure 2A , Figure 2B The structure of the folding screen is introduced. The electronic device can include: unfolded state and folded state. The electronic device can be equipped with Or portable terminal devices of other operating systems, such as mobile phones, tablet computers, desktop computers, laptop computers, handheld computers, notebook computers, ultra-mobile personal computers (UMPC), netbooks, and personal digital assistants (PDA), augmented reality (AR) devices, virtual reality (VR) devices, artificial intelligence (AI) devices, wearable devices, vehicle-mounted devices, smart home devices and / or smart city devices, etc.

[0064] All types of electronic devices described in the present application are equipped with a folding screen, that is, the display screen of the electronic device can be folded, and after folding, it is divided into at least two display screens by a folding axis.

[0065] Figure 2A The structural form of the electronic device in the unfolded state is exemplified.

[0066] like Figure 2A As shown, the electronic device may include a back screen 201, a main screen 202, and a central axis 203. The back screen 201 and the main screen 202 may be referred to as the entire screen. When the electronic device is in the unfolded state, the entire screen of the electronic device is oriented in the same direction as the back screen 201 and the main screen 202. That is, the main screen 202 is oriented in the same direction as the back screen 201. When the user faces the entire screen, the observed display area is the entire screen. The electronic device may also include a back screen camera 204 and a main screen camera 205. The back screen camera 204 may include one or more cameras, and the main screen camera 205 may include one or more cameras. Among them, when the electronic device is in the unfolded state, the main screen camera 205 is located on one side of the entire screen, that is, the direction of the main screen camera 205 is consistent with the direction of the back screen 201 and the main screen 202. The back screen camera 204 is located on one side of the back of the entire screen, that is, the direction of the back screen camera 204 is opposite to that of the main screen camera 205.

[0067] Figure 2B The structural form of an electronic device in a folded state is exemplified.

[0068] like Figure 2B As shown, (a) and (b) are electronic devices in the same folded state. Among them, (b) can be a schematic diagram after (a) is flipped 180 degrees around the central axis. The electronic devices may include but are not limited to: a back screen 211 and a main screen 212. Among them, the back screen 211 and the main screen 212 are in opposite directions. In (a), the back screen 211 of the electronic device can face the user, while the main screen 212 is facing away from the user. In (b), the main screen 212 of the electronic device can face the user, while the back screen 211 is facing away from the user. The electronic device may also include a back screen camera 213 and a main screen camera 214. Among them, when the electronic device is in the folded state, the back screen camera 213 is located on one side of the back screen 211, that is, the direction of the back screen camera 213 is consistent with the direction of the back screen 211; the main screen camera 214 is located on one side of the main screen 212, that is, the direction of the main screen camera 214 is consistent with the direction of the main screen 212.

[0069] In some implementations, the length of the back screen 211 is the same as the length of the main screen 212, and the width of the back screen 211 is 85% of the width of the main screen 212. In the embodiment of the present application, the above value 85% is only for exemplary description, and it is sufficient that the width of the main screen 212 is greater than the width of the back screen 211, and there is no limitation on this.

[0070] In some implementations, an electronic device with an outward folding screen can also display an AOD interface. An electronic device in a folded state can determine the orientation of the main screen and the back screen. When the main screen of the electronic device is facing up, the electronic device can display the AOD interface on the main screen; when the back screen of the electronic device is facing up, the electronic device can display the AOD interface on the back screen. However, in some cases, the electronic device may be in a state where neither the main screen is facing up nor the back screen is facing up. For example, when the user holds or places it on other devices, the folding part of the electronic device (such as the side display screen) faces up. At this time, it may not be possible to determine whether the AOD interface is displayed by the back screen or the main screen, resulting in the electronic device may not display the AOD interface, which will affect the user experience. In other cases, the user may be in a state similar to lying flat, and the screen that the user may need to observe that the AOD interface should be facing down. Since the electronic device is based on the principle of displaying the AOD interface on a screen facing up, the electronic device may not display the AOD interface on the screen where the user needs to view the AOD interface (for example, the screen facing down).

[0071] In the embodiment of the present application, upward may refer to a direction opposite to that pointing vertically to the ground or a direction opposite to that pointing approximately vertically to the ground, and downward may refer to a direction opposite to that pointing vertically to the ground or a direction approximately pointing vertically to the ground.

[0072] In order to solve the above problems, the embodiments of the present application provide a method for displaying the screen off and an electronic device, in which the electronic device adds a screen off display mode by recognizing a human face or human eyes. In the screen off state, the folding state of the electronic device can be determined first, and then it can be determined whether the conditions for displaying the AOD interface are met, such as recognizing a human face or human eyes, etc., to determine whether to display the AOD interface on the main screen or on the back screen.

[0073] Furthermore, the electronic device can also determine whether it is held by the user, thereby more accurately determining the screen used to display the AOD interface.

[0074] By implementing the above method, it is possible to avoid judging the screen displaying the AOD interface only by the orientation of the screen, so that the AOD interface can be displayed in a better manner in accordance with user needs.

[0075] Combine the following Figure 3A Hereinafter, the method for displaying the screen off provided in an embodiment of the present application will be introduced. Figure 3A The method execution subject shown can be the electronic device mentioned above. Or, Figure 3A The method execution entity shown may be a chip in an electronic device, which is not limited in the embodiments of the present application. Figure 3A An electronic device is used as an example to illustrate the method. The electronic device includes a display screen, and the display screen includes a main screen and a back screen. The main screen and the back screen are two display areas of the same display screen. When the electronic device is folded, the main screen and the back screen face opposite directions. When the electronic device is unfolded, the main screen and the back screen face the same direction, and the display area is the entire display screen. The method includes:

[0076] S301. In response to a screen-off operation, the electronic device determines whether the electronic device is in a folded state.

[0077] In some implementations, before executing S301, in order to save the user from viewing the sequin work number generated by the time, date and other information, the electronic device can turn on the screen-off display function.

[0078] The above-mentioned screen-off operation may include but is not limited to: lock screen operation, power-on operation, touch operation, etc. Specifically, the lock screen operation may include but is not limited to: pressing operation of the lock screen button on the side or top of the electronic device, clicking operation on the lock screen control in the user interface, voice command and gesture command, etc. In the case where the screen-off operation is a lock screen operation, the screen-off operation can be used to trigger the screen display state to switch from the ON state to the Doze state. The power-on operation may include: a long press operation of the power-on / off button on the side or top of the electronic device. In the case where the screen-off operation is a power-on operation, the screen-off operation can be used to trigger the screen display state to switch from the ON state to the Doze state. In fact, the electronic device is in the power-off state before responding to the power-on operation, and after responding to the power-on operation, the electronic device switches from the power-off state to the ON state of the power-on state. The operation of lightly touching the lock screen interface may include: the operation of the user lightly touching the screen after the electronic device turns off the screen. In the case where the screen-off operation is a light touch operation, the screen-off operation can be used to trigger the screen display state to switch from the OFF state to the Doze state. It is worth noting that when the screen-off operation performed by the user is a touch operation on the screen, the mode for displaying the AOD interface can only be mode 1. In other words, if the electronic device does not use mode 1 to implement the screen-off display function, the touch operation cannot trigger the screen display state to change from the OFF state to the Doze state.

[0079] In the software structure of the electronic device, the application layer includes the AOD application; the application framework layer includes the DeviceState Provider, Fold Screen Manager Service, Power Manager Service and DeviceManager Service; the hardware abstraction layer includes the Sensor Service. After turning on the AOD function, the specific implementation process of determining whether the electronic device is in the folded state can refer to the following:

[0080] The electronic device can enable the AOD application, and the AOD application registers for detection with the Power Manager Service, wherein the specific event detected by the AOD application is whether the screen display state of the Power Manager Service changes to the Doze state or whether the screen display state of the Power Manager Service changes from the Doze state to the ON state; when the Power ManagerService responds to the screen display state changing to the Doze state, it uses the callback function onDreamingStarted to notify the AOD application that the current screen display state has changed to the Doze state; the AOD application calls the getDisplayMode function to obtain the screen posture of the electronic device from the device status provider.

[0081] In some implementations, after the electronic device responds to the screen-off operation, it can determine whether the electronic device is in a folded state. Specifically, the electronic device can determine whether the electronic device is in a folded state through a posture sensor and / or a Hall sensor. The posture sensor may include: an acceleration sensor and a gyroscope sensor.

[0082] In one possible implementation, the electronic device can detect the angle between the main screen and the back screen through a posture sensor, and determine the screen posture of the electronic device based on the angle. The above-mentioned angle between the main screen and the back screen refers to the angle between the plane where the main screen is located and the plane where the back screen is located. The specific implementation method of using a posture sensor to determine whether the electronic device is in a folded state can refer to the following content: Sensor Service can provide posture sensor data (i.e., the angle between the main screen and the back screen) to Device State Provider, and Device State Provider determines the screen posture of the electronic device based on the posture sensor data provided by SensorService.

[0083] The following describes how to determine the screen posture of an electronic device based on the angle between the main screen and the back screen.

[0084] Figure 4A The diagram exemplarily shows the screen posture of an electronic device when the screen is gradually unfolded. Figure 4B The diagram exemplarily shows the screen posture of an electronic device when the screen is gradually folded.

[0085] like Figure 4A As shown, when the screen of the electronic device is gradually unfolded, when the angle between the main screen and the back screen is 0 to 60 degrees, it can be determined that the screen of the electronic device is in a folded state. When the angle between the main screen and the back screen is 63 to 153 degrees, it can be determined that the screen posture of the electronic device is in a stand state. When the angle between the main screen and the back screen is 153 to 180 degrees, it can be determined that the screen posture of the electronic device is in an unfolded state. Figure 4BAs shown, in the process of gradually folding the screen of the electronic device, when the angle between the main screen and the back screen is 150 to 180 degrees, it can be determined that the screen of the electronic device is in the unfolded state. When the angle between the main screen and the back screen is 57 to 147 degrees, it can be determined that the screen posture of the electronic device is in the bracket state. When the angle between the main screen and the back screen is 0 to 57 degrees, it can be determined that the screen posture of the electronic device is in the folded state. In the process of the above-mentioned folding state changing to the bracket state or the bracket state changing to the folded state, a certain error rate can be guaranteed by hysteresis of 3 degrees, and the previous screen posture is used as the screen posture in the hysteresis angle, which is conducive to improving the accuracy of detecting the screen posture of the electronic device. In the process of changing from the bracket state to the folded state or from the folded state to the bracket state, when the angle between the main screen and the back screen is at the boundary value, the previous screen posture is also used as the current screen posture, which is conducive to improving the accuracy of detecting the screen posture of the electronic device. In the embodiment of the present application, the degree of hysteresis can be any predefined value, and 3 degrees is taken as an example here, which is not limited here.

[0086] In another possible implementation, the electronic device can detect the magnetic field strength between the main screen and the back screen through a Hall sensor, and determine the screen posture of the electronic device based on the magnetic field strength. Exemplarily, when the magnetic field strength between the main screen and the back screen is greater than or equal to a preset value of the magnetic field strength, it can be determined that the screen state of the electronic device is in a folded state; when the magnetic field strength between the main screen and the back screen is less than the preset value of the magnetic field strength, it can be determined that the screen state of the electronic device is in an unfolded state or a stand state. The specific implementation method of determining whether an electronic device is in a folded state by using a Hall sensor can refer to the following content: The Sensor Service can provide Hall sensor data (i.e., whether the electronic device is in a folded state) to the Device State Provider, and the Device State Provider determines the screen posture of the electronic device based on the Hall sensor data provided by the Sensor Service.

[0087] In another possible implementation, the electronic device can determine the screen state of the electronic device through a posture sensor and a Hall sensor. In this way, the accuracy of detecting the screen posture of the electronic device can be further improved. The method of determining the screen state of the electronic device through a posture sensor and a Hall sensor can refer to the above content, and will not be repeated here.

[0088] Exemplarily, the electronic device determines that the screen posture of the electronic device is in a folded state based on the angle between the main screen and the back screen. At this time, it is necessary to further determine the screen posture of the electronic device based on the Hall sensor data. If the Hall sensor data also determines that the screen posture of the electronic device is also in a folded state, then it can be determined that the screen posture of the electronic device is in a folded state; if the Hall sensor data determines that the screen posture of the electronic device is not in a folded state, then it is necessary to re-acquire the data detected by the posture sensor and / or the Hall sensor to re-judge the screen posture of the electronic device. In the embodiment of the present application, the above is only an exemplary description, and other methods may also be included to more accurately determine the screen posture through two sensors, which is not limited to this.

[0089] In a possible implementation, when the electronic device detects that the screen posture has changed (for example, the user folds the unfolded electronic device, or unfolds the folded electronic device), the screen posture needs to be re-determined, that is, the screen posture is re-executed. Figure 3A The method flow is shown.

[0090] When it is determined that the screen posture of the electronic device is in the folded state, S302 is executed; when it is determined that the screen posture of the electronic device is in the unfolded state, S312 is executed.

[0091] S302: When the electronic device is in the folded state, determine whether the electronic device is in the handheld state.

[0092] In some implementations, when the electronic device is in a handheld state, it can be understood that the current user is holding the electronic device, and it is not only the state of the electronic device that must be considered but also the user's needs must be considered first; when the electronic device is in a non-handheld state, the current user is not holding the electronic device and the electronic device may be placed on other objects, and at this time the state of the electronic device can be given priority.

[0093] Since electronic devices in a folded state are Figure 2B As shown, if a user wants to hold an electronic device, the main screen and / or back screen of the electronic device will inevitably be touched to a large extent. In some implementations, the electronic device can determine whether the electronic device is in a handheld state through a touch sensor. Specifically, the electronic device can determine whether the electronic device is currently in a handheld state by determining the data collected by the touch sensor and analyzing the position of the touched electronic device.

[0094] In a possible implementation, the electronic device may further determine whether the current electronic device is in a handheld state by combining an acceleration sensor, a proximity light sensor, and a temperature sensor. Specifically, the electronic device may determine whether the motion trajectory of the electronic device conforms to the motion trajectory of a user holding the electronic device through the data collected by the acceleration sensor. If so, it is determined that the electronic device may be in a handheld state. Furthermore, on the basis of determining whether the motion trajectory of the electronic device conforms to the motion trajectory of a user holding the electronic device, if the electronic device determines through the proximity light sensor that a portion of the electronic device is blocked and then determines through the temperature sensor that the temperature of the blocked portion is close to the temperature of a human hand, it can be further determined that the electronic device is in a handheld state.

[0095] In the embodiment of the present application, the above-mentioned method of determining whether the electronic device is in a handheld state is only illustrative, and other methods may also be included, which are not limited to this.

[0096] If the electronic device is determined to be in a non-handheld state, S303 is executed; if the electronic device is determined to be in a handheld state, S306 is executed.

[0097] S303: When the electronic device is in a non-handheld state, determine the screen orientation of the electronic device.

[0098] In some implementations, the prerequisite of S303 is that the electronic device is in a non-handheld state and the screen of the electronic device is in a folded state. Therefore, the electronic device may be placed statically on other objects, and the main screen and the back screen are definitely not facing the same direction.

[0099] In an embodiment of the present application, when the electronic device determines that the screen posture is in a folded state, the screen orientation of the electronic device can be further determined based on the posture angle, acceleration and other data, so as to display the AOD interface according to the screen orientation later. The above-mentioned screen orientation may refer to the orientation of the main screen, such as the main screen facing up or the main screen facing down. Optionally, the screen orientation of the electronic device may also refer to the orientation of the back screen, such as the back screen facing up or the back screen facing down. In an embodiment of the present application, the main screen facing up can also be understood as the back screen facing down, and the main screen facing down can also be understood as the back screen facing up, without limitation.

[0100] The specific implementation method of determining the screen orientation of the electronic device can refer to the following content: When the screen posture of the electronic device is folded, the AOD application calls the registerDeviceListener function to detect the Device ManagerService. The specific event detected is that after the Device Manager Service determines the screen orientation of the electronic device, it sends the screen orientation of the electronic device to the AOD application. Accordingly, the AOD application can obtain the screen orientation of the electronic device.

[0101] In one possible implementation, when an electronic device determines the screen orientation of the electronic device, the specific implementation may be: the electronic device obtains the vertical acceleration of the electronic device when it is in a stationary state; if the direction of the vertical acceleration is downward, the electronic device determines that the main screen of the electronic device is facing upward; if the direction of the vertical acceleration is upward, the electronic device determines that the main screen of the electronic device is facing downward.

[0102] In a specific implementation, when the electronic device is in a stationary state, the acceleration sensor is used to obtain the vertical acceleration of the electronic device at this time. The screen orientation of the electronic device can be determined according to the direction of the vertical acceleration. Specifically, if the direction of the vertical acceleration is downward (for example, the vertical acceleration is 9.8), it is considered that the main screen of the electronic device is facing upward; if the direction of the vertical acceleration is upward (for example, the vertical acceleration is -9.8), it is considered that the main screen of the electronic device is facing downward.

[0103] Optionally, when the electronic device obtains the vertical acceleration when the electronic device is in a stationary state, specifically, it can be: the electronic device obtains the vertical acceleration when the electronic device is in a stationary state and the attitude angle is less than a preset value. Wherein, the attitude angle refers to the angle between the display plane of the electronic device and the horizontal plane. The preset value can be 8 degrees, or it can be any preset value, which is not limited here. Based on this method, it is possible to ensure that the display plane of the electronic device is as level as possible with the horizontal plane within a certain error range, which is conducive to improving the accuracy of determining the screen orientation of the electronic device.

[0104] In a possible implementation, the electronic device may execute S303 at fixed time intervals. For example, when the electronic device responds to the screen-off operation, and then the electronic device determines that the screen posture is in a folded state, and then the electronic device determines that it is in a non-handheld state, the screen orientation of the electronic device is determined every 1 minute. In the embodiment of the present application, the above fixed time interval is only used for exemplary description and is not limited thereto.

[0105] In a possible implementation, the function of recognizing a person's portrait through the main screen camera or the back screen camera may be turned off during the execution of S301-S303. The function of recognizing a person's eyes or a person's portrait through the camera is activated after the screen orientation of the electronic device is determined. This can save power consumption.

[0106] When the electronic device determines that the screen orientation is that the main screen is facing upward, S304 is executed; when the electronic device determines that the screen orientation is that the rear screen is facing upward, S305 is executed.

[0107] S304: When the main screen of the electronic device faces upward and the first condition for displaying the AOD interface is met, the AOD interface is displayed on the main screen.

[0108] In some implementations, the first condition may include any one of the following: when the electronic device adopts mode 1, the main screen of the electronic device receives a tap operation; when the electronic device adopts mode 2, no operation needs to be received; when the electronic device adopts mode 3, no operation needs to be received within a preset time period; when the electronic device adopts mode 4, the electronic device recognizes human eyes or faces through the camera on the main screen; when the electronic device adopts mode 1 and mode 4 at the same time, the main screen of the electronic device receives a tap operation or recognizes human eyes or faces through the camera on the main screen.

[0109] Among them, the time for displaying the AOD interface in S304 can refer to the relevant instructions for introducing AOD above. Specifically, when the electronic device adopts mode 1 and the main screen of the electronic device receives a tap operation, the AOD interface can be displayed on the main screen for a period of time (for example, 10 seconds). When the electronic device adopts mode 2, the AOD interface can be displayed on the main screen until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 3, the AOD interface can be displayed on the main screen within a preset time period until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 4 and the electronic device recognizes a face or a face through the camera on the main screen, the AOD interface can be displayed on the main screen for a period of time (for example, 10 seconds).

[0110] In a possible implementation, when the electronic device adopts both mode 1 and mode 4, the mode triggered after the time when the electronic device displays the AOD interface shall prevail. For example, the electronic device receives a touch operation on the main screen at time a, and detects a face through the camera of the main screen at time b, where time b is 4 seconds after time a, and the main screen can display the AOD interface for 14 seconds after time a, that is, display the AOD interface for 10 seconds after time b.

[0111] In another possible implementation, when the electronic device adopts both mode 1 and mode 4 at the same time, the time for the electronic device to display the AOD interface is based on the mode that is triggered first. For example, the electronic device receives a touch operation on the main screen at time a, and detects a face through the camera of the main screen at time b, where time b is after time a and the difference is 4 seconds. The main screen can display the AOD interface for 10 seconds after time a, that is, the AOD interface is displayed for 6 seconds after time b. In the embodiment of the present application, the duration of displaying the AOD interface in the above two modes at the same time is only illustrative and is not limited here.

[0112] In a possible implementation, if the screen orientation of the electronic device changes while the electronic device is displaying the AOD interface, the screen of the electronic device displaying the AOD interface will also change, and the time for displaying the AOD interface will also change.

[0113] Specifically, the electronic device can judge that the electronic device is flipped from the main screen facing up to the back screen facing up by the direction of the vertical acceleration. The judgment method can refer to the relevant description in the above S303, which will not be repeated here. Then the electronic device can display the AOD interface on the back screen. The electronic device can reset the time to display the AOD interface, or it can sum up the total time displayed on the main screen and the back screen. Exemplarily, when the electronic device adopts mode 1, the main screen of the electronic device faces up, and at moment c, in response to a touch operation on the main screen, the AOD interface is displayed on the main screen. At moment d, the electronic device flips, the back screen of the electronic device faces up, and the AOD interface is displayed on the back screen. Among them, moment d is located after moment c, and the difference is 4 seconds. The duration of displaying the AOD interface on the back screen can be 10 seconds or 6 seconds. In the embodiment of the present application, the time for displaying the AOD interface on another screen after the electronic device displaying the AOD interface is flipped is not limited.

[0114] In one possible implementation, when the electronic device is in a non-handheld state and the main screen of the electronic device is facing upward, the AOD interface will not be displayed on the back screen even if the back screen of the electronic device receives a light touch operation.

[0115] S305: When the back screen of the electronic device faces upward and the second condition for displaying the AOD interface is met, display the AOD interface on the back screen.

[0116] In some implementations, the second condition may include any one of the following: when the electronic device adopts mode 1, the back screen of the electronic device receives a light touch operation; when the electronic device adopts mode 2, no operation needs to be received; when the electronic device adopts mode 3, no operation needs to be received within a preset time period; when the electronic device adopts mode 4, the electronic device recognizes human eyes or faces through the camera on the back screen; when the electronic device adopts mode 1 and mode 4 at the same time, the back screen of the electronic device receives a light touch operation or recognizes human eyes or faces through the camera on the back screen.

[0117] Among them, the time for displaying the AOD interface in S305 can refer to the relevant instructions for introducing AOD above. Specifically, when the electronic device adopts mode 1 and the back screen of the electronic device receives a light touch operation, the AOD interface can be displayed on the back screen for a period of time (for example, 10 seconds). When the electronic device adopts mode 2, the AOD interface can be displayed on the back screen until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 3, the AOD interface can be displayed on the back screen within a preset time period until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 4 and the electronic device recognizes a face or a face through the camera on the back screen, the AOD interface can be displayed on the main screen for a period of time (for example, 10 seconds).

[0118] In a possible implementation, when the electronic device adopts both mode 1 and mode 4, the time when the electronic device displays the AOD interface shall be based on the mode triggered later. For example, the electronic device receives a touch operation on the back screen at time a, and detects a face through the camera of the back screen at time b, where time b is after time a and the difference is 4 seconds. The back screen can display the AOD interface for 14 seconds after time a, that is, display the AOD interface for 10 seconds after time b.

[0119] In another possible implementation, when the electronic device adopts mode 1 and mode 4 at the same time, the time for the electronic device to display the AOD interface is based on the mode that is triggered first. For example, the electronic device receives a touch operation on the back screen at time a, and detects a face through the camera of the back screen at time b, wherein time b is after time a and the difference is 4 seconds. The back screen can display the AOD interface for 10 seconds after time a, that is, the AOD interface can be displayed for 6 seconds after time b. In the embodiment of the present application, the duration of displaying the AOD interface in the above two modes at the same time is only illustrative and is not limited here.

[0120] In a possible implementation, if the screen orientation of the electronic device changes while the electronic device is displaying the AOD interface, the screen of the electronic device displaying the AOD interface will also change, and the time for displaying the AOD interface will also change.

[0121] Specifically, the electronic device can judge that the electronic device is flipped from the back screen facing up to the main screen facing up by the direction of the vertical acceleration. The judgment method can refer to the relevant description in the above S303, which will not be repeated here. Then the electronic device can display the AOD interface on the main screen. The electronic device can reset the time to display the AOD interface, or it can sum up the total time displayed on the main screen and the back screen. Exemplarily, when the electronic device adopts mode 1, the back screen of the electronic device faces up, and at moment c, in response to a touch operation on the back screen, the AOD interface is displayed on the back screen. At moment d, the electronic device flips, the main screen of the electronic device faces up, and the AOD interface is displayed on the main screen. Among them, moment d is located after moment c, and the difference is 4 seconds. The duration of displaying the AOD interface on the main screen can be 10 seconds or 6 seconds. In the embodiment of the present application, the time for displaying the AOD interface on another screen after the electronic device displaying the AOD interface is flipped is not limited.

[0122] In one possible implementation, when the electronic device is in a non-handheld state, with the back screen of the electronic device facing upward, the AOD interface will not be displayed on the main screen even if the main screen of the electronic device receives a light touch operation.

[0123] In a possible implementation, when the electronic device adopts mode 4, after determining the screen orientation of the electronic device, since the camera located in the screen facing downward may not collect valid face or eye data, the camera located in the screen facing downward may be turned off, or the camera located in the screen facing downward may be turned on but the collected image data is not uploaded. In this way, the collection of unnecessary image data is reduced and the power consumption of the electronic device is reduced. Exemplarily, in S304, the main screen of the electronic device faces upward, at which time the camera of the back screen may be turned off or the camera of the back screen may be turned on but the image data collected by the camera of the back screen may not be uploaded. In S305, the back screen of the electronic device faces upward, at which time the camera of the main screen may be turned off or the camera of the main screen may be turned on but the image data collected by the camera of the main screen may not be uploaded.

[0124] S306: When the electronic device is in a handheld state, determine whether the electronic device recognizes a human face or a human eye through a main screen camera or a back screen camera.

[0125] In some implementations, the electronic device may use mode 4 to display the AOD interface according to user settings, or the electronic device may automatically use mode 4 to display the AOD interface. When the electronic device is determined to be in a handheld state, the main screen camera and the back screen camera of the electronic device are both started. It is understandable that the camera face or eye recognition function in S306 can be used to determine whether to display the AOD interface on the main screen or on the back screen.

[0126] When the main screen camera of the electronic device recognizes a human face or a human eye, execute S307; when the back screen camera of the electronic device recognizes a human face or a human eye, execute S308; when neither the main screen camera nor the back screen camera of the electronic device recognizes a human face or a human eye, execute S309.

[0127] S307: When the electronic device recognizes a human face or human eyes through the main screen camera, the AOD interface is displayed on the main screen.

[0128] In some implementations, the electronic device's recognition of a face or eye through the main screen camera can be understood as: the user is currently facing or looking at the main screen. It is worth noting that the user may be lying down at this time, so the main screen of the electronic device is facing down. That is to say, in a possible implementation, when the back screen of the electronic device is facing up, the AOD interface can be displayed on the main screen.

[0129] In some implementations, when the electronic device only adopts mode 4, the AOD interface can be displayed on the main screen for a period of time (for example, 10 seconds) after the main screen camera recognizes a face or a human eye. When the electronic device adopts mode 1 and mode 4, after the main screen camera recognizes a face or a human eye, the main screen of the electronic device receives a touch operation and displays the AOD interface on the main screen for a period of time (for example, 10 seconds). When the electronic device adopts mode 2 and mode 4, the AOD interface is displayed on the main screen until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 3 and mode 4, after the main screen camera recognizes a face or a human eye, the AOD interface can be displayed on the main screen within a preset time period until the electronic device switches from the Doze state to the OFF state or switches to the ON state.

[0130] In a possible implementation, when the electronic device adopts mode 1 and mode 4, the AOD interface can be displayed on the main screen for a period of time (e.g., 10 seconds) after the main screen camera recognizes a face or eye. That is, the first display on the main screen can be triggered without a tap operation, and the next display on the main screen requires a tap operation trigger.

[0131] In a possible implementation, after executing S307, the electronic device can recognize a face or eye through the back screen camera, but cannot recognize a face or eye through the main screen camera, and can switch to the back screen to display the AOD interface. Specifically, the electronic device can recognize a face or eye through the back screen camera. Then the electronic device can display the AOD interface on the back screen. The electronic device can reset the time to display the AOD interface, or it can sum up the total time displayed on the main screen and the back screen. Exemplarily, when the electronic device adopts mode 1, at moment c, the electronic device recognizes a face or eye through the main screen camera, and displays the AOD interface on the main screen. At moment d, the electronic device recognizes a face or eye through the back screen camera, but cannot recognize a face or eye through the main screen camera, and can display the AOD interface on the back screen. Among them, moment d is after moment c, and the difference is 4 seconds. The duration of displaying the AOD interface on the back screen can be 10 seconds or 6 seconds. In the embodiment of the present application, there is no limitation on the time for displaying the AOD interface on another screen after the camera of the electronic device displaying the AOD interface detects a change in the human eye or face.

[0132] S308: When the electronic device recognizes a human face or human eyes through the back screen camera, an AOD interface is displayed on the back screen.

[0133] In some implementations, the electronic device's recognition of a face or eye through the back screen camera can be understood as: the user is currently facing or looking at the back screen. It is worth noting that the user may be lying down at this time, so the back screen of the electronic device is facing down. That is to say, in a possible implementation, when the main screen of the electronic device is facing up, the AOD interface can be displayed on the main screen.

[0134] In some implementations, when the electronic device only adopts mode 4, the AOD interface can be displayed on the main screen for a period of time (for example, 10 seconds) after the back-screen camera recognizes a face or eye. When the electronic device adopts mode 1 and mode 4, after the back-screen camera recognizes a face or eye, the back screen of the electronic device receives a touch operation and displays the AOD interface on the back screen for a period of time (for example, 10 seconds). When the electronic device adopts mode 2 and mode 4, the AOD interface is displayed on the back screen until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 3 and mode 4, after the back-screen camera recognizes a face or eye, the AOD interface can be displayed on the back screen within a preset time period until the electronic device switches from the Doze state to the OFF state or switches to the ON state.

[0135] In a possible implementation, when the electronic device adopts mode 1 and mode 4, the AOD interface can be displayed on the back screen for a period of time (e.g., 10 seconds) after the back screen camera recognizes a face or eye. That is, the first display on the back screen can be triggered without a light touch operation, and the next display on the back screen needs to be triggered by a light touch operation.

[0136] In one possible implementation, after executing S308, the electronic device can recognize a human face or human eyes through the main screen camera, but cannot recognize a human face or human eyes through the back screen camera, and the electronic device can switch to the main screen to display the AOD interface.

[0137] In a possible implementation, if the electronic device can recognize a human face or human eyes through both the main screen camera and the back screen camera, the screen orientation of the electronic device can be further determined.

[0138] In a possible implementation, it can be known from the above S307 or S308 that when the electronic device is in Doze state and in handheld state, as long as a certain camera of the electronic device recognizes a human eye or a human face, the AOD interface can be displayed on the main screen or back screen where the camera that recognizes the human eye or the human face is located. In this way, the AOD interface can be displayed by recognizing a human face or a human eye when the screen of the electronic device is facing neither the main screen nor the back screen.

[0139] S309: When the electronic device cannot recognize a human face and human eyes, determine the screen orientation of the electronic device.

[0140] In some implementations, when the electronic device is in a handheld state, the electronic device cannot recognize human eyes or faces. This means that the ambient light of the electronic device is extremely dim, or the angle between the user and the electronic device is such that the electronic device cannot recognize human faces and eyes, but the user can observe the content on the screen of the electronic device facing upward. In this case, the electronic device can determine the screen orientation of the electronic device. For how to determine the screen orientation of the electronic device, please refer to the relevant description in S303, which will not be repeated here.

[0141] When the electronic device cannot recognize a human face and human eyes, if it is determined that the screen orientation is that the main screen is facing upward, execute S310; when the electronic device cannot recognize a human face and human eyes, if it is determined that the screen orientation is that the rear screen is facing upward, execute S311.

[0142] S310: When the main screen of the electronic device faces upward and a third condition for displaying the AOD interface is met, displaying the AOD interface on the main screen.

[0143] In some implementations, the third condition may include any one of the following: when the electronic device adopts mode 1, the main screen of the electronic device receives a tap operation; when the electronic device adopts mode 2, no operation needs to be received; when the electronic device adopts mode 3, no operation needs to be received within a preset time period.

[0144] Among them, the time for displaying the AOD interface in S310 can refer to the relevant instructions for introducing AOD above. Specifically, when the electronic device adopts mode 1 and the main screen of the electronic device receives a tap operation, the AOD interface can be displayed on the main screen for a period of time (for example, 10 seconds). When the electronic device adopts mode 2, the AOD interface can be displayed on the main screen until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 3, the AOD interface can be displayed on the main screen within a preset time period until the electronic device switches from the Doze state to the OFF state or switches to the ON state.

[0145] In a possible implementation, if the screen orientation of the electronic device changes during the display of the AOD interface, the screen of the electronic device displaying the AOD interface will also change, and the time for displaying the AOD interface will also change. The above specific implementation can refer to the relevant description in S304, which will not be repeated here.

[0146] In one possible implementation, when the electronic device is in a handheld state and the main screen of the electronic device is facing upward, the AOD interface will not be displayed on the back screen even if the back screen of the electronic device receives a light touch operation.

[0147] S311. When the back screen of the electronic device is facing upward and the fourth condition for displaying the AOD interface is met, the AOD interface is displayed on the back screen.

[0148] In some implementations, the fourth condition may include any one of the following: when the electronic device adopts mode 1, the back screen of the electronic device receives a tap operation; when the electronic device adopts mode 2, no operation needs to be received; when the electronic device adopts mode 3, no operation needs to be received within a preset time period.

[0149] Among them, the time for displaying the AOD interface in S311 can refer to the relevant instructions for introducing AOD above. Specifically, when the electronic device adopts mode 1 and the back screen of the electronic device receives a tap operation, the AOD interface can be displayed on the back screen for a period of time (for example, 10 seconds). When the electronic device adopts mode 2, the AOD interface can be displayed on the back screen until the electronic device switches from the Doze state to the OFF state or switches to the ON state. When the electronic device adopts mode 3, the AOD interface can be displayed on the back screen within a preset time period until the electronic device switches from the Doze state to the OFF state or switches to the ON state.

[0150] In a possible implementation, if the screen orientation of the electronic device changes during the process of displaying the AOD interface, the screen of the electronic device displaying the AOD interface will also change, and the time for displaying the AOD interface will also change. The above specific implementation can refer to the relevant description in S305, which will not be repeated here.

[0151] In a possible implementation, when the electronic device is in a handheld state with the back screen of the electronic device facing upward, the AOD interface will not be displayed on the main screen even if the main screen of the electronic device receives a light touch operation.

[0152] S312: When the electronic device is in the unfolded state and the fifth condition for displaying the AOD interface is met, the AOD interface is displayed in full screen.

[0153] In some implementations, the fifth condition may include any one of the following: when the electronic device adopts mode 1, the main screen of the electronic device receives a tap operation; when the electronic device adopts mode 2, no operation needs to be received; when the electronic device adopts mode 3, no operation needs to be received within a preset time period; when the electronic device adopts mode 4, the electronic device recognizes human eyes or faces through the camera on the main screen; when the electronic device adopts mode 1 and mode 4 at the same time, the main screen of the electronic device receives a tap operation or recognizes human eyes or faces through the camera on the main screen.

[0154] By implementing the above method, when the electronic device is in a folded state, it can be determined whether the AOD interface is displayed on the main screen or on the back screen, and it can also be determined when the AOD interface is displayed and how long it is displayed. In addition, when the user holds the electronic device, the screen of the electronic device that can be used to display the AOD interface can be more accurately identified. In this way, the user's usage can be fully taken into account, and the user's desire to view the AOD interface on the screen facing him can be met to the greatest extent.

[0155] Combine the following Figure 3BIntroducing another method of displaying the screen off. Figure 3B Another method for displaying an off-screen display provided in an embodiment of the present application will be described below.

[0156] S313: In response to the screen-off operation, the electronic device determines whether the electronic device is in a folded state.

[0157] For the relevant description of S313, please refer to the detailed description of S301 above, which will not be repeated here.

[0158] S314: When the electronic device is in the folded state, determine whether the electronic device recognizes a human face or a human eye through the main screen camera or the back screen camera.

[0159] When the electronic device only uses mode 4 to implement the AOD function, and when the electronic device is in a folded state, the electronic device activates the portrait or eye recognition function of the main screen camera and the back screen camera. When the main screen camera of the electronic device recognizes a face or eye, S315 is executed; when the back screen camera of the electronic device recognizes a face or eye, S316 is executed; when neither the main screen camera nor the back screen camera of the electronic device recognizes a face or eye, S317 is executed.

[0160] S315: When the electronic device recognizes a human face or human eyes through the main screen camera, the AOD interface is displayed on the main screen.

[0161] For the relevant description of S315, please refer to the detailed description of S307 above, which will not be repeated here.

[0162] S316: When the electronic device recognizes a human face or human eyes through the back screen camera, an AOD interface is displayed on the back screen.

[0163] For the relevant description of S316, please refer to the detailed description of S308 above, which will not be repeated here.

[0164] S317: When the electronic device cannot recognize the human face and human eyes, determine the screen orientation of the electronic device.

[0165] For the relevant description of S317, please refer to the detailed description of S309 above, which will not be repeated here.

[0166] S318: When the main screen of the electronic device faces upward and the third condition for displaying the AOD interface is met, the AOD interface is displayed on the main screen.

[0167] For the relevant description of S318, please refer to the detailed description of S310 above, which will not be repeated here.

[0168] S319: When the back screen of the electronic device is facing upward and the fourth condition for displaying the AOD interface is met, the AOD interface is displayed on the back screen.

[0169] For the relevant description of S319, please refer to the detailed description of S311 above, which will not be repeated here.

[0170] By implementing the above method, the electronic device can first consider the actual needs of the user to display the AOD interface by recognizing human eyes or faces, and then display the AOD interface by auxiliary judgment of the screen orientation of the electronic device. In one possible implementation, it is not necessary to judge whether the electronic device is in a handheld or non-handheld state.

[0171] In the embodiment of the present application, when the electronic device is in the folded state, the main screen and the back screen will not display the AOD interface at the same time, but the main screen and the back screen can display the same AOD interface at different times. Since the sizes of the main screen and the back screen are different, the sizes of the elements in the same AOD interface displayed by the main screen and the back screen may be different.

[0172] Combine the following Figures 5A-9B Several AOD interfaces provided in the embodiments of the present application are introduced.

[0173] Figure 5A FIG. 4 shows an AOD interface displayed on the main screen of an electronic device. Figure 5A As shown, user interface 500 is an AOD interface displayed by the electronic device on the main screen. User interface 500 may include, but is not limited to: icon 501, date clock 502, date clock 503, and power 504, etc. The electronic device can respond to user operations and select a preset theme to which icon 501 belongs from multiple preset themes. In other words, icon 501 is preset by the electronic device. Date clock 502 and date clock 503 can represent the date and time of different regions at the same time. Interval 505 is used to represent the spacing between date clock 502 and date clock 503. Exemplarily, date clock 502 displays the text content "00:53 New York, Wednesday, November 28", and date clock 503 displays the text content "12:53 New York, Wednesday, November 28". Power 504 indicates that the current power of the electronic device is 100%.

[0174] Figure 5B The AOD interface of the electronic device displayed on the back screen is shown. Figure 5BAs shown, user interface 510 is an AOD interface displayed on the back screen of the electronic device. Since it is the same AOD interface, the types of elements contained in user interface 510 and user interface 500 are the same. User interface 510 can also include but is not limited to: icon 511, date clock 512, date clock 513, and power 514, etc. Interval 515 is used to indicate the distance between date clock 512 and date clock 513.

[0175] In some implementations, when the icon in the AOD interface is preset by the electronic device, that is, when the theme to which the icon belongs is preset by the electronic device, the icon in the AOD interface displayed on the main screen is the same size as the icon in the AOD interface displayed on the back screen. Exemplarily, the size of icon 501 is the same as that of icon 511. In the case where the AOD interface displays dual clock text, that is, when the date and time of two regions are displayed in the AOD interface, the text size of the date clock in the AOD interface displayed on the back screen is 85% of the text size of the date clock in the AOD interface displayed on the main screen. Exemplarily, the size of the text in the date clock 512 is 85% of the size of the text in the date clock 502, and the size of the text in the date clock 513 is 85% of the size of the text in the date clock 503. In the embodiment of the present application, the above ratio of 85% is only for exemplary explanation, and can also refer to other ratios, such as any value in 70%-90%, as long as the text can be fully displayed on the back screen, and the text displayed on the back screen is smaller than the text displayed on the main screen, and there is no limitation on this. Optionally, when dual clock characters are displayed in the AOD interface, the interval between the two clock characters in the AOD interface displayed on the back screen is also 85% of the interval between the two clock characters in the AOD interface displayed on the main screen. Exemplarily, the size of interval 515 is 85% of the size of interval 505.

[0176] Fig. 6A Another AOD interface displayed on the main screen of an electronic device is shown. Fig. 6A As shown, user interface 600 is an AOD interface displayed by the electronic device on the main screen. User interface 600 may include, but is not limited to: icon 601, date clock 602, and power 603, etc. The electronic device may respond to user operations and select a third-party theme to which icon 601 belongs from multiple third-party themes. In other words, icon 601 may belong to a theme provided by a third-party application downloaded by the electronic device. Date clock 602 may indicate the date and time of a certain region at a certain moment. Exemplarily, date clock 602 displays the text content "08:08 Friday, October 18, September 12, Year of the Pig". Power 603 indicates that the current power of the electronic device is 100%.

[0177] Figure 6B The AOD interface of the electronic device displayed on the back screen is shown. Figure 6B As shown, user interface 610 is an AOD interface displayed on the back screen of the electronic device. Since it is the same AOD interface, the types of elements included in user interface 610 and user interface 600 are the same. User interface 610 can also include but is not limited to: icon 611, date clock 612, and power 613, etc.

[0178] In some implementations, when the icon in the AOD interface is provided by a third-party application downloaded by the electronic device, or is a picture in an album application downloaded by the electronic device, the icon may fill the screen as much as possible. The width of the icon in the AOD interface displayed on the main screen is consistent with the width of the main screen, and the width of the icon in the AOD interface displayed on the back screen is consistent with the width of the back screen. In other words, the aspect ratio of the icon in the AOD interface displayed on the main screen is consistent with the aspect ratio of the icon in the AOD interface displayed on the back screen. Exemplarily, the aspect ratio of icon 601 is consistent with the aspect ratio of icon 611. In the case of a single clock text displayed in the AOD interface, that is, when the date and time of a region are displayed in the AOD interface, the text size of the date clock in the AOD interface displayed on the back screen is consistent with the text size of the date clock in the AOD interface displayed on the main screen. Exemplarily, the size of the text in the date clock 612 is consistent with the size of the text in the date clock 602.

[0179] Fig. 7A Another AOD interface displayed on the main screen of an electronic device is shown. Fig. 7A As shown, user interface 700 is an AOD interface displayed on the main screen of the electronic device. User interface 700 may include, but is not limited to: clock icon 701, date 702, and power 703, etc. The electronic device may select clock icon 701 from a plurality of preset screen-off icons in response to user operation. In other words, clock icon 701 may be preset by the electronic device. Date 702 may represent the date of a certain region. Exemplarily, clock icon 701 indicates that the current time is 02:35, and date 702 displays the text content "June 17, Saturday, April 30, Guimao Year". Power 703 indicates that the current power of the electronic device is 100%.

[0180] Figure 7B The AOD interface of the electronic device displayed on the back screen is shown. Figure 7B As shown, user interface 710 is an AOD interface displayed on the back screen of the electronic device. Since it is the same AOD interface, the types of elements included in user interface 710 and user interface 700 are the same. User interface 710 can also include but is not limited to: clock icon 711, date 712, and power 713, etc.

[0181] In some implementations, when the clock icon in the AOD interface is preset in the electronic device, the clock icon in the AOD interface displayed on the main screen is the same size as the clock icon in the AOD interface displayed on the back screen. Exemplarily, the size of clock icon 701 is the same as that of clock icon 711. In the case where a single date text is displayed in the AOD interface, that is, when the date of a region is displayed in the AOD interface, the text size of the date in the AOD interface displayed on the back screen is the same as the text size of the date in the AOD interface displayed on the main screen. Exemplarily, the size of the text in date 702 is the same as the size of the text in date 712.

[0182] Fig. 8A Another AOD interface displayed on the main screen of an electronic device is shown. Fig. 8A As shown, user interface 800 is an AOD interface displayed by the electronic device on the main screen. User interface 800 may include, but is not limited to: clock icon 801, clock icon 802, date area 803, date area 804, and power 805, etc. The electronic device can respond to user operations and select clock icon 801 and clock icon 802 from multiple preset screen icons. In other words, clock icon 801 and clock icon 802 can be preset by the electronic device. Date area 803 can represent the date of a certain area, and date area 804 can represent the date of another area. Exemplarily, clock icon 801 indicates that the current time is 02:35, clock icon 802 indicates that the current time is 14:35, date area 803 displays the text content "Wednesday, November 28, New York", and date area 804 displays the text content "Wednesday, November 28, Beijing". Interval 806 is used to indicate the distance between date area 803 and date area 804. Power 805 indicates that the current power of the electronic device is 100%.

[0183] Figure 8B The AOD interface of the electronic device displayed on the back screen is shown. Figure 8B As shown, user interface 810 is an AOD interface displayed on the back screen of the electronic device. Since it is the same AOD interface, the types of elements contained in user interface 810 and user interface 800 are the same. User interface 810 may also include, but is not limited to: clock icon 811, clock icon 812, date area 813, date area 814, and power 815, etc. Interval 816 is used to indicate the distance between date area 813 and date area 814.

[0184] In some implementations, when there are two clock icons preset in the AOD interface, the size of the two clock icons in the AOD interface displayed on the back screen is 85% of the text size of the two clock icons in the AOD interface displayed on the main screen. Exemplarily, the size of clock icon 811 is 85% of the size of clock icon 801, and the size of clock icon 812 is 85% of the size of clock icon 802. In the case where the AOD interface displays dual date region text, that is, when the AOD interface displays dates of two regions, the text size of the date in the AOD interface displayed on the back screen is 85% of the text size of the date in the AOD interface displayed on the main screen. Exemplarily, the size of the Chinese characters in the date region 813 is 85% of the size of the Chinese characters in the date region 803, and the size of the Chinese characters in the date region 814 is 85% of the size of the Chinese characters in the date region 804. In the embodiment of the present application, the above-mentioned ratio of 85% is only for illustrative purposes and may also refer to other ratios, such as any value between 70% and 90%. It is only necessary to satisfy the requirement that the text can be fully displayed on the back screen and the text displayed on the back screen is smaller than the text displayed on the main screen. There is no limitation on this. Optionally, in the case where double date region text is displayed in the AOD interface, the spacing between the two date region texts in the AOD interface displayed on the back screen is also 85% of the spacing between the two date region texts in the AOD interface displayed on the main screen. Exemplarily, the size of interval 816 is 85% of the size of interval 806.

[0185] Fig.9A Another AOD interface displayed on the main screen of an electronic device is shown. Fig.9A As shown, the user interface 900 is an AOD interface displayed on the main screen of the electronic device. The user interface 900 may include, but is not limited to: an icon 901, a date clock 902, a date clock 903, and a power level 904, etc.

[0186] Fig. 9B Another AOD interface displayed on the back screen of an electronic device is shown. Fig. 9B As shown, user interface 910 is an AOD interface displayed on the back screen of the electronic device. Since it is the same AOD interface, the types of elements contained in user interface 910 and user interface 900 are the same. User interface 910 may also include, but is not limited to: icon 911, date clock 912, date clock 913, and battery 914, etc. Among them, the above-mentioned icon 901 and icon 911 are not the same icon, and can be called a set of screen-off icons.

[0187] In some implementations, the pre-set themes in the electronic device include a set of screen-off icons, that is, the icons in the AOD interface displayed on the main screen of the electronic device and the icons in the AOD interface displayed on the back screen belong to the same preset theme. The set of screen-off icons for the same preset theme may include two or more screen-off icons. Exemplarily, icon 901 and icon 911 may belong to the same preset theme and may be regarded as a set of screen-off icons. In this way, the diversity of the AOD interface observed by the user can be increased, adding a sense of freshness.

[0188] In an embodiment of the present application, the AOD interface displayed on the back screen may be referred to as the first AOD interface. The AOD interface displayed on the main screen may be referred to as the second AOD interface. The AOD interface displayed on the screen including the main screen and the back screen when the electronic device is in an unfolded state may be referred to as the third AOD interface. The icons displayed in the AOD interface preset by the electronic device, that is, the screen-off icons provided by the system application may be referred to as the first icon and the second icon. The icons displayed in the AOD interface provided by the third-party application downloaded by the electronic device may be referred to as the third icon. The date clock text area displayed in the AOD interface may be referred to as the first text and the second text. Different screens off belonging to the same theme set may be referred to as the fourth icon and the fifth icon.

[0189] Fig.10 A schematic structural diagram of an electronic device 100 is shown.

[0190] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0191] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0192] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0193] In some implementations, the processor 110 can be used to determine whether the electronic device 100 is in a folded state. The processor 110 can also be used to determine whether the electronic device 100 is in a handheld state. The processor 110 can also be used to determine the screen orientation of the electronic device. The processor 110 can also be used to determine whether a face or eye is recognized through the main screen camera or the back screen camera.

[0194] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0195] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0196] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0197] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0198] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0199] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0200] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0201] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0202] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0203] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0204] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0205] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0206] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0207] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0208] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0209] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0210] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0211] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0212] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0213] The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).

[0214] Random access memory may include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM, for example, the fifth generation DDR SDRAM is generally referred to as DDR5 SDRAM), etc.; non-volatile memory may include disk storage devices and flash memory.

[0215] Flash memory can be divided into NOR FLASH, NAND FLASH, 3D NAND FLASH, etc. according to the operating principle; single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc. according to the storage unit potential level; universal flash storage (UFS), embedded multi media card (eMMC), etc. according to the storage specification.

[0216] The random access memory can be directly read and written by the processor 110, and can be used to store executable programs (such as machine instructions) of the operating system or other running programs, and can also be used to store user and application data.

[0217] The non-volatile memory may also store executable programs and user and application data, etc., and may be loaded into the random access memory in advance for direct reading and writing by the processor 110 .

[0218] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos are stored in the external non-volatile memory.

[0219] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0220] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0221] The pressure sensor 180A is used to sense pressure signals and convert the pressure signals into electrical signals.

[0222] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

[0223] In some implementations, the gyro sensor 180B may be used to obtain the angular velocity and send the angular velocity to the processor 110 so that the processor 110 can determine the screen posture.

[0224] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0225] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover can be automatically unlocked.

[0226] In some implementations, the magnetic sensor 180D may be used to determine the magnetic field strength between the primary screen and the secondary screen, and send the magnetic field strength to the processor 110 so that the processor 110 determines the screen posture.

[0227] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0228] In some implementations, the acceleration sensor 180E may be used to obtain acceleration and send the acceleration to the processor 110 so that the processor 110 can determine the screen posture.

[0229] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0230] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0231] In some implementations, the proximity light sensor 180G may be used to obtain light change data of a user holding the electronic device, so that the processor 110 may further determine that the electronic device is in a handheld state.

[0232] The ambient light sensor 180L is used to sense the brightness of ambient light.

[0233] The fingerprint sensor 180H is used to collect fingerprints.

[0234] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of a processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0235] In some implementations, the temperature sensor 180J may also be used to obtain the temperature of the electronic device when the user holds the electronic device, so that the processor 110 can further determine that the electronic device is in a handheld state.

[0236] The touch sensor 180K is also called a "touch control device". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch control screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0237] In some implementations, the touch sensor 180K may be used to obtain a touch operation and send the specific location where the touch operation is received to the processor 110. The touch sensor 180K may also be used to obtain a light touch operation in the screen-off state.

[0238] Bone conduction sensor 180M can obtain vibration signals.

[0239] Buttons 190 include a power button, a volume button, and the like.

[0240] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.

[0241] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0242] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system of the layered architecture is taken as an example to exemplify the software structure of the electronic device 100.

[0243] Fig.11 1 is a software structure block diagram of the electronic device 100 according to an embodiment of the present invention.

[0244] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: application layer, application framework layer, system library and kernel layer.

[0245] The application layer can include a series of application packages.

[0246] like Fig.11As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, AOD, short message and other applications. Among them, the AOD application can detect the screen posture of the device and the handheld or non-handheld state of the electronic device to display the AOD interface.

[0247] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0248] like Fig.11 As shown, the application framework layer may include a device state provider (Device State Provider), a folding screen management service (Fold Screen Manager Service), a power management service (PowerManager Service), a device management service (Device Manager Service), a portrait recognition service, and the like.

[0249] Device State Provider is used to provide screen posture. For example, unfolded state, folded state, etc. Specifically, you can obtain posture sensor data (such as the angle between the main screen and the back screen), Hall sensor data (such as the magnetic field strength between the main screen and the back screen) from the hardware abstraction layer, and judge the current screen posture based on these sensor data. Device State Provider can also be used to determine whether the electronic device is in a handheld state. Specifically, you can obtain touch sensor data, temperature sensor data, and proximity light sensor data from the hardware abstraction layer, and judge whether the current electronic device is in a handheld state based on these sensor data.

[0250] Fold Screen Manager Service is used to manage the screen display of external folding screen electronic devices. It can realize the display of user interface on the main screen, back screen or full screen according to the coordinates formulated by the dual-screen (i.e. main screen and back screen) display scheme. For example, the AOD interface can be displayed on the main screen of an external folding screen mobile phone, the AOD interface can also be displayed on the back screen of an external folding screen mobile phone, or the AOD interface can be displayed on the entire screen of an external folding screen mobile phone. Of course, it is also possible to display the user interface on the main screen of an external folding screen mobile phone, etc., which is not limited here.

[0251] Power Manager Service is one of the system services responsible for managing and coordinating device power management. Common functions include turning on the screen, turning off the screen, brightness adjustment, low power mode, keeping the CPU awake, etc., which will be coordinated and processed by Power Manager Service. For example, Power Manager Service can monitor the changes in the screen's on and off state, thereby controlling the start and end of displaying the AOD interface. In an embodiment of the present application, the screen of an electronic device can be divided into an off state, a on state, and a off state; wherein the off state (OFF state) indicates that the electronic device screen is off; the on state (ON state) indicates that the electronic device screen is lit; the off state (Doze state) indicates that the electronic device screen is dormant and in a low power consumption state. The change in the on and off state can include the screen changing from the ON state to the OFF state, or from the ON state to the Doze state, or from the OFF state to the Doze state, or from the Doze state to the ON state, or from the OFF state to the ON state, and so on.

[0252] Device Manager Service is used to provide the screen orientation of the device. For example, the main screen of an outward-folding screen phone faces upwards, the main screen of an outward-folding screen phone faces downwards, etc. Specifically, the attitude angle, acceleration and other data can be obtained from the hardware abstraction layer, and the screen orientation of the current device can be determined based on these data.

[0253] The portrait recognition service can be used to identify whether the camera captures a portrait based on the data collected by the camera sensor. It can also determine whether the face or eyes of a person are captured by the main screen camera or the back screen camera.

[0254] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0255] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0256] The system library can include multiple functional modules, such as surface manager, media libraries, etc.

[0257] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0258] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0259] The hardware abstraction layer is an interface layer between the operating system kernel and the hardware circuit, and its purpose is to abstract the hardware. It hides the hardware interface details of a specific platform and can provide a virtual hardware platform for the operating system. The hardware abstraction layer can include sensor services, etc. Among them, the sensor service can provide sensor data, attitude angle, acceleration and other information, such as providing sensor data to the Device State Provider and providing attitude angle, acceleration and other information to the Device Manager Service.

[0260] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0261] The various implementation modes of the present application can be combined arbitrarily to achieve different technical effects.

[0262] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)), etc.

[0263] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

[0264] In short, the above description is only an embodiment of the technical solution of the present invention, and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for displaying a screen off, characterized in that: Applied to an electronic device, the electronic device comprises a main screen, a back screen, a main screen camera, and a back screen camera, the main screen and the back screen are connected by a folding component, the main screen camera and the main screen face the same direction, and the back screen camera and the main screen face opposite directions, the method comprises: When the electronic device is in a folded state, a first screen-off operation is detected, and in the folded state, both the main screen and the back screen face the outside of the electronic device; Starting the main screen camera and the back screen camera; If the back screen camera captures an image containing human eyes and / or human faces, and the main screen camera does not capture an image containing human eyes and / or human faces, displaying a first AOD interface on the back screen; If the main screen camera captures an image containing human eyes and / or human faces, and the back screen camera does not capture an image containing human eyes and / or human faces, a second AOD interface is displayed on the main screen.

2. The method according to claim 1, characterized in that The method further comprises: If the main screen camera captures an image containing human eyes and / or human faces, and the back screen camera captures an image containing human eyes and / or human faces, determine the orientation of the main screen and the back screen; If the back screen is facing upward, displaying the first AOD interface on the back screen; If the main screen is facing upward, the second AOD interface is displayed on the main screen; the upward direction refers to the direction opposite to vertically pointing to the ground.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: If the main screen camera does not capture an image containing human eyes and / or human faces, and the back screen camera does not capture an image containing human eyes and / or human faces, determine the orientation of the main screen and the back screen; If the back screen is facing upward, the first AOD interface is displayed on the back screen in response to the back screen facing upward, or the first AOD interface is displayed on the back screen after receiving a touch operation on the back screen, or the first AOD interface is displayed on the back screen after entering a preset time period; If the main screen is facing upward, the second AOD interface is displayed on the main screen in response to the main screen facing upward, or, the second AOD interface is displayed on the main screen after receiving a touch operation applied to the main screen, or, the second AOD interface is displayed on the main screen after entering the preset time period; upward refers to the direction opposite to pointing vertically to the ground.

4. The method according to any one of claims 1 to 3, characterized in that When the first screen-off operation is detected, the electronic device is held by a user.

5. The method according to claim 4, characterized in that The method further comprises: When the electronic device is in a folded state and is not held by a user, a second screen-off operation is detected; Determining the orientation of the main screen and the back screen; If the back screen is facing upward, the first AOD interface is displayed on the back screen in response to the back screen facing upward, or the first AOD interface is displayed on the back screen after receiving a touch operation on the back screen, or the first AOD interface is displayed on the back screen after entering a preset time period, or the back screen camera is started, and the first AOD interface is displayed on the back screen when the back screen camera captures an image containing human eyes and / or human faces; If the main screen is facing upward, the second AOD interface is displayed on the main screen in response to the main screen facing upward, or, the second AOD interface is displayed on the main screen after receiving a touch operation applied to the main screen, or, the second AOD interface is displayed on the main screen after entering the preset time period, or, the main screen camera is started and the second AOD interface is displayed on the main screen when the main screen camera captures an image containing human eyes and / or faces; upward refers to the direction opposite to pointing vertically to the ground.

6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: When the electronic device is in an unfolded state, a third screen-off operation is detected, and in the unfolded state, the main screen and the back screen face the same direction; In response to the main screen and the back screen being oriented in the same direction, a third AOD interface is displayed on the screen, or the third AOD interface is displayed on the screen after a touch operation applied to the screen is received, or the third AOD interface is displayed on the screen after entering a preset time period, or the back screen camera or the main screen camera is started, and the third AOD interface is displayed on the screen when the back screen camera or the main screen camera captures an image containing human eyes and / or human faces; the screen includes the back screen and the main screen that are oriented in the same direction.

7. The method according to any one of claims 1 to 6, characterized in that Before the first screen-off operation is detected, If the state of the electronic device is the screen-off state, the first screen-off operation includes: an operation of touching the screen; If the state of the electronic device is the screen-on state, the screen-off operation includes: a screen-locking operation; If the electronic device is in a power-off state, the first screen-off operation includes a power-on operation.

8. The method according to any one of claims 1 to 7, characterized in that The icons in the first AOD interface only include: a first icon; The icons in the second AOD interface only include: the first icon; The size of the first icon in the first AOD interface is equal to the size of the first icon in the second AOD interface.

9. The method according to any one of claims 1 to 7, characterized in that: The first AOD interface includes: a first icon and a second icon; The second AOD interface includes: the first icon and the second icon; The sizes of the first icon and the second icon in the first AOD interface are smaller than the sizes of the first icon and the second icon in the second AOD interface.

10. The method according to any one of claims 1 to 7, characterized in that The first AOD interface includes: a third icon; The second AOD interface includes: the third icon; The size of the third icon in the first AOD interface is smaller than the size of the third icon in the second AOD interface.

11. The method according to any one of claims 1 to 10, characterized in that The text in the first AOD interface only includes: the first text; The text in the second AOD interface only includes: the first text; The size of the first text in the first AOD interface is equal to the size of the first text in the second AOD interface.

12. The method according to any one of claims 1 to 10, characterized in that The first AOD interface includes: a first text and a second text; The second AOD interface includes: the first text and the second text; The sizes of the first text and the second text in the first AOD interface are smaller than the sizes of the first text and the second text in the second AOD interface.

13. The method according to any one of claims 1 to 7, characterized in that The first AOD interface includes: a fourth icon; The second AOD interface includes: a fifth icon; The fourth icon and the fifth icon belong to the same theme.

14. An electronic device, characterized in that: include: One or more processors, one or more memories; wherein the one or more memories are coupled to the one or more processors, the one or more memories are used to store computer program codes, the computer program codes include computer instructions, and when the one or more processors execute the computer instructions, the electronic device executes the method as described in any one of claims 1-13.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program includes program instructions. When the program instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 13.

Images