Unlocking method and electronic device

Abstract

An unlocking method and an electronic device are provided, which relate to the field of communication technology. A user's identity can be identified without the user fully unfolding the mobile phone, so that unlocking is completed quickly when the user's identity is valid. This improves the efficiency of the interaction between the user and the mobile phone. The method is applied to an electronic device. The electronic device includes a first screen and a second screen formed in a screen folding state. The first screen is an inner screen, the second screen is an outer screen, the first screen has an associated first collection component, and the second screen has an associated second collection component. The method includes obtaining an unlocking intention, in response to the unlocking intention, invoking a second collection component to collect user's identity information, identifying the user's identity based on the identity information collected by the second collection component, and unlocking the first screen if the user's identity is valid and the electronic device meets a condition for using the first screen.

Description

[Technical field]

[0002] The present application relates to the field of electronic technology, and in particular to an unlocking method and an electronic device. [Background technology]

[0003] A foldable screen device usually has a large screen and can provide a better visual viewing experience for users. In order to ensure the security of important data such as user privacy, the foldable screen device generally has a lock screen function. After the screen of the foldable screen device is locked, the user needs to input valid identity authentication information (e.g., a correct fingerprint, digital password, or face data) into the foldable screen device to unlock the screen and restore the interaction between the foldable screen device and the user.

[0004] Unlocking a folding screen mobile phone in a scenario of receiving a new message is used as an example. Currently, as shown in FIG. 1A and FIG. 1B, the folding screen mobile phone receives new messages (e.g., two WeChat notifications) in a screen lock state. If a user needs to read and reply to a message on the inner screen of the folding screen mobile phone, the user must first unfold the mobile phone from a folded state to an unfolded state, and enter identity authentication information into the unfolded mobile phone (e.g., enter face data through the camera on the inner screen). It can be found that unlocking a mobile phone without a folding screen usually takes only a short time, while unlocking a mobile phone with a folding screen needs to first unfold the mobile phone and then enable identity authentication, which results in low unlocking efficiency and low efficiency of interaction between the user and the terminal. Summary of the Invention [Means for solving the problem]

[0005] The present application provides an unlocking method and electronic device, in which the user's identity can be identified without the user fully unfolding the mobile phone, so that unlocking can be completed quickly when the user's identity is valid, thereby improving the efficiency of the interaction between the user and the terminal.

[0006] In order to achieve the aforementioned objectives, the following technical solutions are used in this application:

[0007] According to a first aspect, the present application provides an unlocking method. The method is applied to an electronic device, or a device capable of implementing the function of an electronic device (e.g., a chip of an electronic device). For example, the method can be applied to an electronic device. The electronic device includes a first screen and a second screen formed in a screen folding state. The first screen is an inner screen, the second screen is an outer screen, the first screen has an associated first collection component, and the second screen has an associated second collection component.

[0008] The method includes the electronic device obtaining an unlock intent, and in response to the unlock intent, invoking a second collection component to collect user identity information, identifying the user identity based on the identity information collected by the second collection component, and unlocking the first screen if the user identity is valid and the electronic device meets a condition for using the first screen.

[0009] Once the user's unlocking intention is obtained, the user's identity information can be collected using a sensor associated with the outer screen, and the user's identity can be found to be identified based on the identity information. Compared with the prior art, which allows identity identification only after the mobile phone is unfolded, resulting in low unlocking efficiency, in the technical solution of the present application, the user's identity can be identified without fully unfolding the mobile phone, so that unlocking is completed quickly when the user's identity is valid. In this case, the efficiency of the interaction between the user and the terminal is improved. In addition, when the terminal detects that the terminal meets the conditions for using the first screen, it indicates that the user wants to unlock the first screen when unlocking the terminal screen. In this case, after the user's identity is determined to be valid, the terminal can intelligently and conveniently unlock the first screen for the user. This further improves the efficiency of the interaction between the terminal and the user.

[0010] In a possible design, the unlock intent may be an unlock command input by a user, for example, the user inputs an unlock command into the electronic device by pressing a power button or double tapping the screen.

[0011] In a possible design, the unlocking intent may further be an unlocking intent sensed and determined by the electronic device. For example, when it is detected that the user has picked up the mobile phone, the electronic device may pre-determine that the user has an unlocking intent.

[0012] In a possible design, after the user's identity is determined to be valid, and before unlocking the first screen, the method further includes unlocking a second screen and displaying the first interface on the second screen.

[0013] In a possible design, after unlocking the first screen, the method further includes displaying, on the first screen, a second interface associated with the first interface.

[0014] Specifically, if the user's identity is determined to be valid based on the identity information collected by the collection component associated with the outer screen, the electronic device can first unlock the outer screen and display a first interface on the outer screen. The first interface displayed on the outer screen can be further connected to the inner screen. A second interface connected to the inner screen for display is associated with the first interface.

[0015] In some designs, the second interface connected to the inner screen for display may be the same interface as the first interface displayed on the outer screen. In this specification, the first interface being the same as the second interface means that the content contained therein is the same. The sizes of the first interface and the second interface, the layout of elements within the interfaces, the size of the elements, etc. may be different.

[0016] In some other designs, the second interface connected to the inner screen for display is associated with the content of the first interface. For example, the second interface is a detailed display interface of the first interface. In another example, if the user does not tap a music control on the outer screen after the outer screen is unlocked, the second interface entered by the inner screen is the Home screen after the mobile phone is unfolded. If the user taps a music control on the outer screen after the outer screen is unlocked, the second interface entered by the inner screen is a music interface, such as a music playlist interface, after the mobile phone is unfolded. Alternatively, the content displayed on the first interface and the content displayed on the second interface may be the same.

[0017] In a possible design, before unlocking the first screen, the method further includes: if the user's identity cannot be identified based on the identity information collected by the second collection component, calling the first collection component to collect the user's identity information, and identifying the user's identity based on the identity information collected by the first collection component. In this way, the probability of successful unlocking can be increased.

[0018] In a possible design, identifying the user's identity based on the identity information collected by the first collection component includes identifying the user's identity based on the identity information collected by the second collection component and the identity information collected by the first collection component. Facial recognition is an example. Before the electronic device invokes the image sensor of the camera on the inner screen, the image sensor of the camera on the outer screen has collected some facial images required for facial recognition. In this case, the image sensor of the camera on the inner screen can capture fewer facial images to complete facial recognition. This shortens the time between invoking the image sensor of the camera on the inner screen and successful facial recognition, speeding up facial recognition.

[0019] In a possible design, invoking the first collection component to collect the user's identity information when the user's identity cannot be identified based on the identity information collected by the second collection component includes invoking the first collection component to collect the user's identity information when it is detected that the deployment angle of the electronic device reaches a preset angle and the user's identity cannot be identified based on the identity information collected by the second collection component.

[0020] In a possible design, before unlocking the first screen, the method includes: Further including displaying a third interface or playing an audio prompt, where the third interface is used to prompt the user to deploy the electronic device, and where the audio prompt is used to prompt the user to deploy the electronic device.

[0021] In a possible design, the method includes: Further comprising receiving configuration instructions input by a user, the configuration instructions being used to set any one or more of a pre-configured application, a pre-configured time period, a pre-configured geographic location range, and a pre-configured unlocking instruction.

[0022] In a possible design, obtaining the unlock intent includes receiving an unlock command input by a user; In response to the unlock intent, invoking a second collection component to collect identity information of the user, In response to the unlock command, invoking a second collection component to collect user identity information.

[0023] In possible designs, the first collection component and the second collection component are the same or different.

[0024] In a possible design, the conditions for using the first screen include one or more combinations of: a current time is within a preset time period; a current location is within a preset geographic location range; a new message is received and the new message is a message of a preset application; the electronic device is in an unfolded state; and an unlock command entered by the user is a preset unlock command.

[0025] In a possible design, the pre-configured unlock command includes any one or more combinations of a gesture, a pattern, a number, a fingerprint, and a voice pre-configured to unlock the first screen.

[0026] In a possible design, the first collection component includes any one or more of a fingerprint collection component, a voiceprint collection component, and an image capture component, and the second collection component includes any one or more of a fingerprint collection component, a voiceprint collection component, and an image capture component.

[0027] According to a second aspect, an electronic device is provided, the electronic device comprising: a processor; a first screen and a second screen formed in a screen folding state, the first screen being an inner screen and the second screen being an outer screen, the first screen having an associated first collection component and the second screen having an associated second collection component; The processor is configured to obtain an unlock intent, and in response to the unlock intent, invoke a second collection component to collect user identity information, identify the user identity based on the identity information collected by the second collection component, and unlock the first screen if the user identity is valid and the electronic device meets a condition for using the first screen.

[0028] In a possible design, the processor is further configured to unlock the second screen; The second screen is configured to display the first interface.

[0029] In a possible design, the first screen is configured to display a second interface associated with the first interface after the first screen is unlocked.

[0030] In a possible design, the processor is further configured to, if the user's identity cannot be identified based on the identity information collected by the second collection component, invoke the first collection component to collect user identity information, and identify the user's identity based on the identity information collected by the first collection component.

[0031] In a possible design, the processor identifying the identity of the user based on the identity information collected by the first collection component includes identifying the identity of the user based on the identity information collected by the second collection component and the identity information collected by the first collection component.

[0032] In a possible design, the processor being configured to invoke the first collection component to collect user identity information when the user identity cannot be identified based on the identity information collected by the second collection component includes invoking the first collection component to collect user identity information when it is detected that the deployment angle of the electronic device reaches a preset angle and the user identity cannot be identified based on the identity information collected by the second collection component.

[0033] In a possible design, the second screen is further configured to display a third interface or play an audio prompt, where the third interface is used to prompt the user to deploy the electronic device, and where the audio prompt is used to prompt the user to deploy the electronic device.

[0034] In a possible design, the processor is further configured to receive configuration instructions input by a user, the configuration instructions being used to configure any one or more of the pre-configured application, the pre-configured time period, the pre-configured geographic location range, and the pre-configured unlocking instructions.

[0035] In a possible design, the processor being configured to obtain the unlock intent includes receiving an unlock command input by a user; The processor being configured to invoke a second collection component to collect user identification information in response to an unlock intent includes invoking the second collection component to collect user identification information in response to an unlock command.

[0036] In possible designs, the first collection component and the second collection component are the same or different.

[0037] In a possible design, the conditions for using the first screen include one or more combinations of: a current time is within a preset time period; a current location is within a preset geographic location range; a new message is received and the new message is a message of a preset application; the electronic device is in an unfolded state; and an unlock command entered by the user is a preset unlock command.

[0038] In a possible design, the pre-configured unlock command includes any one or more combinations of a gesture, a pattern, a number, a fingerprint, and a voice pre-configured to unlock the first screen.

[0039] In a possible design, the first collection component includes any one or more of a fingerprint collection component, a voiceprint collection component, and an image capture component, and the second collection component includes any one or more of a fingerprint collection component, a voiceprint collection component, and an image capture component.

[0040] For the technical effects of the electronic device in the second aspect, please refer to the technical effects of the unlocking method in the first aspect, and the details will not be described again in this specification.

[0041] According to a third aspect, the present application provides an electronic device. The electronic device has a function for implementing the unlocking method according to the first aspect and any one of the possible implementation forms of the first aspect. The function may be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the aforementioned functions.

[0042] According to a fourth aspect, the present application provides a computer-readable storage medium comprising computer instructions, which when executed on an electronic device, enable the electronic device to perform an unlocking method according to the first aspect and any one of the possible implementations of the first aspect.

[0043] According to a fifth aspect, the present application provides a computer program product, which, when executed on an electronic device, enables the electronic device to perform an unlocking method according to the first aspect and any one of the possible implementations of the first aspect.

[0044] According to a sixth aspect, a circuit system is provided, the circuit system including a processing circuit configured to perform an unlocking method according to the first aspect and any one of the possible implementation forms of the first aspect.

[0045] According to a seventh aspect, an embodiment of the present application provides a chip system including at least one processor and at least one interface circuit. The at least one interface circuit performs a transceiver function and is configured to send instructions to the at least one processor. When the at least one processor executes the instructions, the at least one processor performs an unlocking method according to the first aspect and any one of the possible implementation forms of the first aspect. [Brief description of the drawings]

[0046] [Figure 1A] 1 illustrates a process of unlocking a flip screen mobile phone in the prior art. [Figure 1B] 1 illustrates a process of unlocking a flip screen mobile phone in the prior art. [Diagram 2] FIG. 1 is a schematic diagram of a structure of an electronic device according to an embodiment of the present application. [Figure 3-1] 1 is a schematic diagram illustrating the shape of a foldable screen electronic device according to an embodiment of the present invention. FIG. [Figure 3-2] 1 is a schematic diagram illustrating the shape of a foldable screen electronic device according to an embodiment of the present invention. FIG. [Figure 3-3] 1 is a schematic diagram illustrating the shape of a foldable screen electronic device according to an embodiment of the present invention. FIG. [Diagram 3-4] 1 is a schematic diagram illustrating the shape of a foldable screen electronic device according to an embodiment of the present invention. FIG. [Figure 4] FIG. 2 is a schematic diagram showing the included angle of a foldable screen according to an embodiment of the present application. [Diagram 5] FIG. 2 is a block diagram of the software structure of an electronic device according to one embodiment of the present application. [Figure 6(1)] FIG. 2 is a schematic diagram of a group of interfaces according to an embodiment of the present application. [Figure 6 (2)] FIG. 2 is a schematic diagram of a group of interfaces according to an embodiment of the present application. [Figure 6 (3)] FIG. 2 is a schematic diagram of a group of interfaces according to an embodiment of the present application. [Figure 6 (4)] FIG. 2 is a schematic diagram of a group of interfaces according to an embodiment of the present application. [Figure 6 (5)] FIG. 2 is a schematic diagram of a group of interfaces according to an embodiment of the present application. [Figure 7] 1 is a schematic flowchart of an unlocking method according to an embodiment of the present application; [Figure 8-1(2)] 8-1(1) and 8-1(2) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 8-1(3)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 8-1(4)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 8-1(5)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 8-2(2)] 8-2(1) and 8-2(2) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 8-2(3)]FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 8-2(4)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 8-2(5)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 8-3(2)] 8-3(1) and 8-3(2) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 8-3(3)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 8-3(5)] 8-3(4) and 8-3(5) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 8-3(6)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 8-4(2)] 8-4(1) and 8-4(2) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 8-4(3)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 8-4(4)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 8-4(5)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 8-5(2)] 8-5(1) and 8-5(2) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 8-5(4)] FIG. 8-5(4) and FIG. 8-5(5) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 8-6(2)] 8-6(1) and 8-6(2) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 8-6(4)] FIG. 8-6(3) and FIG. 8-6(4) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 8-7(2)] 8-7(1) and 8-7(2) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 8-7(4)] 8-7(3) and 8-7(4) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 8-7(5)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 8-8(2)] 8-8(1) and 8-8(2) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 8-8(3)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 8-8(4)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 8-9(2)] 8-9(1) and 8-9(2) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 8-9(4)] 8-9(4) and 8-9(4) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 8-9(5)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 8-10(2)] 8-10(1) and 8-10(2) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 8-10(4)] 8-10(3) and 8-10(4) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 9-1(2)] 9-1(1) and 9-1(2) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 9-1(4)] FIG. 9-1(3) and FIG. 9-2(4) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 9-1(6)] 9-1(5) and 9-1(6) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 9-2(2)] 9-2(1) and 9-2(2) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 9-2(4)] 9-2(3) and 9-2(4) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 10(2)] 10(1) and 10(2) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 10(3)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 10(4)] 10(4) and 10(5) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 10(6)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 10(7)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 11 (3)] 11(1), 11(2) and 11(3) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 11 (5)] 11(1) and 11(5) are schematic diagrams of an interface according to one embodiment of the present application. [Figure 12(1)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 12 (2)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 12 (3)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 12 (4)] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application. [Figure 13] 1 is a schematic diagram of an apparatus according to an embodiment of the present application; [Figure 14] FIG. 1 is a schematic diagram of a chip system according to an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0047] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The unlocking method and electronic device provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0048] The unlocking method provided in the embodiments of the present application can be applied to electronic devices. For example, the electronic device may be a mobile phone, a tablet computer, a wearable device, an in-vehicle device, an augmented reality (AR) / virtual reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an artificial intelligence device, a dedicated camera (e.g., a single-lens reflex camera or a card camera), etc. The specific type of the electronic device is not limited in the embodiments of the present application.

[0049] 2 is a schematic diagram of the structure of electronic device 100. Electronic device 100 may include processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) port 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headset jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display 194, subscriber identification module (SIM) card interface 195, etc.

[0050] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, a neural-network processing unit (NPU), etc. The different processing units may be separate components or may be integrated into one or more processors.

[0051] The controller may be the nerve center and command center of the electronic device 100. The controller can generate operation control signals based on the instruction operation codes and time series signals to control the reading and execution of instructions.

[0052] A memory may further be disposed in the processor 110 and configured to store instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that have been used or are used periodically by the processor 110. When the processor 110 needs to use the instructions or data again, the processor 110 may directly recall the instructions or data from the memory. This avoids repeated accesses, reduces the latency of the processor 110, and improves system efficiency.

[0053] In some embodiments of the present application, the processor 110 is configured to collect user identity information by using a sensor associated with the outer screen, and identify the user identity based on the identity information when the user's unlocking intention is obtained (the unlocking command input by the user is received). When the user's identity is determined to be valid and it is detected that the terminal meets the condition for using the first screen, which indicates that the user wants to unlock the first screen when unlocking the terminal screen, the terminal can intelligently and conveniently unlock the first screen for the user, thereby improving the efficiency of the interaction between the terminal and the user.

[0054] The charging management module 140 is configured to receive a charging input from a charger.

[0055] The power management module 141 is configured to connect to the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 and provides power to the processor 110, the display 194, the camera 193, etc.

[0056] The wireless communication functionality of the electronic device 100 may be implemented via antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, a modem processor, a baseband processor, and the like.

[0057] The mobile communication module 150 can be applied to the electronic device 100 to provide wireless communication solutions including 2G, 3G, 4G, 5G, etc. The wireless communication module 160 can be applied to the electronic device 100 to provide wireless communication solutions including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) networks), Bluetooth (bluetooth, BT), etc.

[0058] The electronic device 100 implements display functions by using a GPU, a display 194, an application processor, etc. The GPU is a microprocessor for image processing and is connected to the display 194 and the application processor. The GPU is configured to perform mathematical and geometric calculations and render images. The processor 110 can include one or more GPUs, which execute program instructions to generate or modify display information.

[0059] The display 194 is configured to display images, videos, etc. The display 194 includes a display panel. In some embodiments, the electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0060] In some embodiments, the display 194 may display a capture preview interface, a video record preview interface, a capture interface in video record mode, and may further display a video playback interface during video playback, and the like.

[0061] The electronic device 100 can implement a photographing function using an ISP, a camera 193, a video codec, a GPU, a display 194, an application processor, and the like.

[0062] The ISP is configured to process data fed back by the camera 193. For example, during shooting, the shutter is pressed, light is transmitted through the lens to the camera photosensitive element, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert the electrical signal into an image visible to the naked eye. The ISP can further perform algorithm optimization on noise, brightness, and skin tone of the image. The ISP can further optimize parameters such as exposure and color temperature of the shooting scenario. In some embodiments, the ISP may be located in the camera 193. For example, the ISP can control the photosensitive element to perform exposure and shooting based on the shooting parameters.

[0063] The camera 193 is configured to capture still images or video. An object produces an optical image that is projected through a lens onto a photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) optoelectronic transistor. The photosensitive element converts the optical signal into an electrical signal, which is then transmitted to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into a standard image signal in a format such as RGB or YUV.

[0064] In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1. The cameras 193 may be located in an edge region of the electronic device, may be under-screen cameras, or pop-up cameras, or may be cut-out cameras. The cameras 193 may include rear cameras, and may further include front cameras. The specific locations and forms of the cameras 193 are not limited in the embodiments of the present application.

[0065] For example, see FIG. 3-1 for the layout of cameras on electronic device 100. The front of electronic device 100 is the plane on which display 194 is located. As shown in FIG. 3-1(a), camera 1931 is located on the front of electronic device 100, and thus the camera is a front camera. As shown in FIG. 3-1(b), camera 1932 is located on the back of electronic device 100, and thus the camera is a rear camera.

[0066] Optionally, the solution in this embodiment of the present application can be applied to an electronic device 100 having multiple foldable screens (specifically, the display is foldable).

[0067] In some embodiments, the folding screen may be a flexible folding screen. The flexible folding screen includes a folding shaft made of a flexible material. Some or all of the flexible folding screen is made of a flexible material. For example, the flexible folding screen may have only a folding portion (e.g., a folding shaft) made of a flexible material and other portions made of a rigid material, or the flexible folding screen may be entirely made of a flexible material. The folding screen may be folded along the folding shaft to form at least two sub-screens.

[0068] For example, FIG. 3-1(c) shows a foldable screen electronic device 100. In response to a user's operation, as shown in FIG. 3-1(d), the foldable screen is folded inward (or folded outward) along a folding shaft, so that the foldable screen forms at least two sub-screens (such as sub-screen A and sub-screen B). Optionally, as shown in FIG. 3-1(e), there is a display (e.g., screen C) on the folded outside. If the electronic device 100 is provided with a camera on the surface on which the screen C is located, in a scenario in which the electronic device 100 is unfolded, as shown in FIG. 3-1(c), the camera on the screen C is located on the back of the electronic device 100 and can be considered as a rear camera. In a scenario in which the electronic device 100 is folded, as shown in FIG. 3-1(e), the camera on the screen C is located on the front of the electronic device 100 and can be considered as a front camera. In other words, the front camera and the rear camera in this application do not limit the characteristics of the cameras, but merely describe the positional relationship.

[0069] Optionally, the foldable screen of the foldable screen electronic device can form multiple (e.g., two or three) sub-screens. For example, the flexible foldable screen shown in (1) of FIG. 3-2 may include a foldable line 030 and a foldable line 031. After the flexible foldable screen is folded vertically along the foldable line 030, a sub-screen 032, a sub-screen 033, and a sub-screen 034 shown in (2) of FIG. 3-2 may be formed.

[0070] Optionally, the screen arrangement manner of the foldable screen electronic device may be, for example, an up-down screen arrangement shown in (d) of FIG. 3-1, a left-right screen arrangement shown in (1) or (2) of FIG. 3-3, etc. The screen arrangement manner of the foldable screen electronic device is not limited to this embodiment of the present application. After the flexible foldable screen shown in (1) of FIG. 3-3 is folded horizontally along the folding line 040, the sub-screen 041 and the sub-screen 042 shown in (2) of FIG. 3-3 may be formed. For example, the foldable screen device may be a mobile phone in a folded state, or a tablet computer in an unfolded state.

[0071] The included angle between two adjacent sub-screens in the folding screen is greater than or equal to 0° and less than or equal to 180°. The included angle between two adjacent sub-screens in the folding screen can also be referred to as the angle at which the folding screen device is unfolded, or the unfolding angle of the folding screen device, or the folding angle of the folding screen. Based on the range of the included angle between the two adjacent sub-screens in the folding screen, the folding screen can include a folded state and a non-folded state. The non-folded state includes an unfolded state and a semi-folded state.

[0072] The unfolded state indicates that the folding screen is fully unfolded. Specifically, the included angle between two adjacent sub-screens in the folding screen is 180° or close to 180° due to some industrial design factors. For example, FIG. 3-3 (1) is a schematic diagram of the folding screen in the folded state.

[0073] The folded state indicates that the folding screen is fully folded. Specifically, due to some industrial design factors, the included angle between two adjacent sub-screens in the folding screen is 0° or close to 0°. For example, (1) in FIG. 3-4 is a schematic diagram of the folding screen in the folded state, where the included angle between the sub-screen 044 and the sub-screen 045 is 0°.

[0074] The semi-folded state or the non-folded state may be a state between the unfolded state and the folded state. Specifically, the included angle between two adjacent sub-screens in the folding screen is 0° to 180°. For example, FIG. 3-3 (2) and FIG. 3-4 (2) are schematic diagrams of the semi-folded state of the folding screen. For example, as shown in FIG. 3-3 (2), the included angle φ between the sub-screen 041 and the sub-screen 042 is greater than 0° and less than 180°. The included angle φ may also be referred to as the angle at which the folding screen device is unfolded or folded. Optionally, based on the industrial design level, user experience, etc., another value range of the included angle φ may be defined to indicate the semi-folded state. For example, the included angle φ is greater than 10° and less than 170°, and thus the folded state is defined when the included angle φ is less than or equal to 10°.

[0075] In the process of folding or unfolding the folding screen, the angle between the at least two sub-screens formed by the folding screen may change. For example, as shown in (2) of FIG. 3-3, in the process of folding the folding screen, the angle between the sub-screen 41 and the sub-screen 42 becomes smaller, and in the process of unfolding the folding screen, the angle between the sub-screen 41 and the sub-screen 42 becomes larger. It should be understood that the at least two screens formed after the folding screen is folded may be multiple screens that exist independently, or may be a complete screen that is an integrated structure and is folded into at least two parts.

[0076] In some other embodiments, the folding screen may alternatively be a multi-screen folding screen. The multi-screen folding screen may include at least two sub-screens. The at least two sub-screens are independent displays and may be connected in sequence by using a folding shaft, and may rotate separately around the folding shaft to implement the folding of the multi-screen folding screen. For example, as shown in (2) of FIG. 3-4, the folding screen device includes a folding shaft 043, a sub-screen 044, and another sub-screen 045 independent of the sub-screen 044. The sub-screen 044 and the sub-screen 045 can rotate around the folding shaft 043. The included angle φ between the sub-screen 044 and the sub-screen 045 may be referred to as the angle at which the folding screen device is unfolded or folded.

[0077] In this embodiment of the application, the foldable screen may be a single-sided screen (i.e., only one side may display a user interface) or a double-sided screen (i.e., both sides may display a user interface).

[0078] For a single-sided folding screen, if the folding screen is folded toward the side where a user interface can be displayed (i.e., the front side of the single-sided folding screen), it may be referred to as forward folding, and if the folding screen is folded toward the opposite side where a user interface can be displayed (i.e., the rear side of the single-sided folding screen), it may be referred to as backward folding. For example, (2) in FIG. 3-3 is a schematic diagram of forward folding, and (2) in FIG. 3-4 is a schematic diagram of backward folding. The current folding of the folding screen device may be forward folding or backward folding.

[0079] Through folding forward or folding backward, the folding screen can be in a semi-folded state. In the semi-folded state in the folding forward scenario, the included angle between the sides with display function on two adjacent sub-screens is greater than 0° and less than 180°. For the semi-folded state in the folding backward scenario, the included angle between the sides without display function on two adjacent sub-screens is greater than 0° and less than 180°.

[0080] The digital signal processor processes digital signals, and may process other digital signals besides digital image signals. For example, if the electronic device 100 selects a frequency, the digital signal processor is configured to perform a Fourier transform on the frequency energy.

[0081] A video codec is configured to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record video in multiple coding formats, e.g., moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, and MPEG 4.

[0082] The NPU is a neural-network (NN) computing processor, and by utilizing the structure of biological neural networks, for example, by utilizing the transmission mode between neurons in the human brain, it can rapidly process input information and further continuously implement self-learning. Applications such as intelligent cognition of the electronic device 100, for example, image recognition, face recognition, voice recognition, and text understanding, can be implemented through the NPU.

[0083] In some embodiments, the NPU identifies whether the image captured by the camera 193 includes a facial image by using image recognition techniques. In addition, the NPU can further determine whether the user's identity is valid based on the facial image to determine whether to unlock the screen.

[0084] The external memory interface 120 may be configured to connect to an external memory card, such as a Micro SD card, to expand the storage capabilities of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 and implements a data storage function, for example, storing files such as music and videos within the external memory card.

[0085] The internal memory 121 may be configured to store computer-executable program code, which includes instructions. The processor 110 executes the instructions stored in the internal memory 121 and / or in memory located within the processor to implement various functions, applications, and data processing of the electronic device 100.

[0086] The electronic device 100 can implement audio functions, such as music playback and recording, via an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, an application processor, and the like.

[0087] The audio module 170 is configured to convert digital audio data to an analog audio electrical signal for output, and is further configured to convert an analog audio electrical signal input to digital audio data. The audio module 170 may include an analog-to-digital converter and a digital-to-analog converter. For example, the audio module 170 is configured to convert an analog audio electrical signal output by the microphone 170C to digital audio data. The audio module 170 may be further configured to encode and decode audio data. In some embodiments, the audio module 170 may be disposed within the processor 110, or some functional modules within the audio module 170 are disposed within the processor 110.

[0088] Speaker 170A, also referred to as a "loudspeaker," is configured to convert analog audio electrical signals into voice signals. Electronic device 100 may be configured to listen to music in hands-free mode and answer calls via speaker 170A.

[0089] Receiver 170B, also referred to as an "earpiece," is configured to convert analog audio electrical signals into voice signals such that when a call is answered or voice information is received via electronic device 100, receiver 170B can be held close to a person's ear to hear the sound.

[0090] The microphone 170C, also referred to as a "mike" or "mic", is configured to convert a voice signal into an analog audio electrical signal. When making a phone call or transmitting voice information, a user can speak from the user's mouth near the microphone 170C to input a voice signal to the microphone 170C. The microphone 170C may be built into the electronic device 100 or may be external to the electronic device 100.

[0091] In some embodiments, the electronic device 100 may include one or more microphones 170C. Each microphone or multiple microphones may cooperate to implement the function of collecting audio signals in each direction and converting the collected audio signals into analog audio electrical signals, which may further implement noise reduction, sound source identification, direction recording, etc.

[0092] The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, an optical proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0093] The gyroscope sensor 180B may be configured to determine the motion attitude of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (x, y, and z axes) may be determined by using the gyroscope sensor 180B. The gyroscope sensor 180B may be configured to implement image stabilization during shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle at which the electronic device 100 jitters, and through calculations based on the angle, obtains the distance that the lens module needs to compensate, so that the lens can make an inverse movement to offset the jitter of the electronic device 100, thereby implementing image stabilization. The gyroscope sensor 180B may further be used in navigation scenarios and motion-sensing game scenarios.

[0094] In this embodiment of the present application, a gyroscope sensor 180B can be disposed on each sub-screen to measure the orientation (i.e., the direction vector of the orientation) of the sub-screen. For example, in the electronic device shown in FIG. 3-3(2), both the sub-screen 041 and the sub-screen 042 include a gyroscope sensor 180B configured to measure the orientation of the sub-screen 041 and the sub-screen 042, respectively. The electronic device can determine the included angle between adjacent sub-screens based on the angular change in the orientation of each sub-screen.

[0095] For example, electronic device 100 is a foldable screen device shown in Fig. 3-1. The foldable screen of electronic device 100 can be folded to form sub-screen 061 and sub-screen 062 shown in Fig. 4(1). Gyroscope sensor 1 is disposed on sub-screen 061, and gyroscope sensor 2 is disposed on sub-screen 062.

[0096] The coordinate system of the gyroscope sensor may be, for example, but is not limited to, a geographic coordinate system. As shown in (2) of FIG. 4, the origin O of the geographic coordinate system is located at a point where a carrier (i.e., a device including a gyroscope sensor, for example, electronic device 100) is located. In this specification, the x-axis points east (E) along a local latitude line, the y-axis points north (N) along a local meridian line, and the z-axis points upward along a local geographic vertical line. The z-axis, the x-axis, and the y-axis form a right-handed Cartesian coordinate system. The plane formed by the x-axis and the y-axis is the local horizontal plane, and the plane formed by the y-axis and the z-axis is the local meridian plane. Therefore, it can be understood that the coordinate system of the gyroscope sensor uses the gyroscope sensor as the origin O, the direction pointing east along a local latitude line as the x-axis, the direction pointing north along a local meridian line as the y-axis, and the direction pointing up along a local geographic vertical line (i.e., the opposite direction of the geographic vertical line) as the z-axis.

[0097] By using the gyroscope sensor arranged on each sub-screen, the electronic device 100 can obtain a direction vector of the orientation of each sub-screen in the coordinate system of the gyroscope sensor arranged on the sub-screen through measurement. For example, as shown in the side view of the electronic device shown in (1) of FIG. 4, the direction vector of the orientation of the sub-screen 061 in the coordinate system of the gyroscope sensor 1 and obtained by the electronic device through measurement is vector z1, and the direction vector of the orientation of the sub-screen 062 in the coordinate system of the gyroscope sensor 2 and obtained by the electronic device through measurement is vector z2. The electronic device can calculate the included angle θ between vector z1 and vector z2 based on vector z1 and z2.

[0098] From FIG. 4, it can also be seen that the vector z1 is perpendicular to the sub-screen 061, and the vector z2 is perpendicular to the sub-screen 062, so that the included angle between the sub-screen 061 and the sub-screen 062 can be obtained as φ=180°-θ. In other words, the electronic device can determine the included angle φ between the sub-screen 061 and the sub-screen 062 based on the direction vector (i.e., vector z1) of the orientation of the sub-screen 061 in the coordinate system of the gyroscope sensor 1 and obtained through measurement, and the direction vector (i.e., vector z2) of the orientation of the sub-screen 062 in the coordinate system of the gyroscope sensor 2 and obtained through measurement. When the included angle φ is greater than 0° and less than 180°, the electronic device is currently in a semi-folded state corresponding to forward folding. When the included angle φ is greater than 180° and less than 360°, the electronic device is currently in a semi-folded state corresponding to backward folding.

[0099] It should be noted that the positions of the gyroscope sensors disposed on the sub-screen 061 and the sub-screen 062 do not overlap, in other words, the origins of the coordinate systems of the gyroscope sensors on the sub-screen 061 and the sub-screen 062 do not overlap. However, the x-axis, y-axis and z-axis of the two coordinate systems are parallel. Therefore, the coordinate systems of the gyroscope sensors disposed on the sub-screen 061 and the sub-screen 062 can be considered to be parallel. In this way, although the vector z1 and the vector z2 are not in the same coordinate system, the two coordinate systems have parallel axes, so that the included angle θ between the vector z1 and the vector z2 can be calculated based on the formula (1).

[0100] In some embodiments, the included angle α between the sub-screen 061 and the sub-screen 062 can be alternatively measured through the cooperation of one or more other sensors. For example, one acceleration sensor may be disposed on each screen of the folding screen. The electronic device 100 (e.g., the processor 110) can use the acceleration sensor to measure the motion acceleration generated when each sub-screen is rotated, and then calculate the rotation angle of one screen relative to another screen, i.e., the included angle φ between the sub-screen 061 and the sub-screen 062, based on the motion acceleration obtained through the measurement.

[0101] In some other embodiments, the gyroscope sensor may be a virtual gyroscope sensor formed by multiple other sensors. The virtual gyroscope sensor may be configured to calculate the included angle φ between adjacent screens of the folding screen, i.e., between sub-screen 061 and sub-screen 062.

[0102] Additionally, in this embodiment of the present application, sensors such as the gyroscope sensor 180B and the acceleration sensor 180E may be further configured to determine the status of each sub-screen to determine whether the foldable screen is currently in a forward folding state or a backward folding state.

[0103] For example, the gyroscope sensor 180B on the sub-screen can measure the angular velocity of the sub-screen when it is folded, and the included angle of the sub-screen with respect to a particular coordinate system (e.g., a geographic coordinate system) can be obtained by performing an integration on the angular velocity to obtain the attitude of the sub-screen. The orientation of the sub-screen may be learned based on the attitude of the sub-screen. Based on the orientation of each sub-screen, it can be known that the foldable screen is currently in a forward folding state or a backward folding state.

[0104] The distance sensor 180F is configured to measure distance. The electronic device 100 can measure distance by infrared or laser. In some embodiments, in a shooting scenario, the electronic device 100 can measure distance through the distance sensor 180F to implement fast focusing.

[0105] The touch sensor 180K is also referred to as a "touch panel." The touch sensor 180K may be disposed on a display 194, and the touch sensor 180K and the display 194 form a touch screen, also referred to as a "touch control screen." The touch sensor 180K is configured to detect a touch operation performed on or near the touch sensor 180K.

[0106] It may be understood that the structure shown in this embodiment of the application does not constitute a particular limitation on the electronic device 100. In some other embodiments of the application, the electronic device 100 may include more or fewer components than those shown in the figures, some components may be combined, or some components may be divided, or different component arrangements may be used. The components shown in the figures may be implemented by hardware, software, or a combination of software and hardware.

[0107] The software system of the electronic device 100 can use a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In this embodiment of the present invention, the Android system having a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0108] FIG. 5 is a block diagram illustrating the software architecture of electronic device 100 according to one embodiment of the present invention.

[0109] In a layered architecture, software is divided into multiple layers, and each layer has a clear role and task. The layers communicate with each other through software interfaces. In some embodiments, the operating system of an electronic device (e.g., the Android system) is divided into four layers from bottom to top: a kernel layer, a hardware abstraction layer (HAL), an application framework layer, and an application layer.

[0110] The kernel layer is a layer between the hardware and the software. The kernel layer includes at least a camera driver, an audio driver, a display driver, and a sensor driver. The sensor driver includes, but is not limited to, an image sensor driver and an acoustic sensor driver.

[0111] In some embodiments, for example in a face recognition scenario, a camera driver at the kernel layer is called to turn on the camera. In another example, an image sensor driver calls the image sensor to complete the image capture.

[0112] The hardware abstraction layer (HAL) is located between the kernel layer and the application framework layer, and is configured to define an interface for the driver application hardware implementation and convert the value of the driver hardware implementation into a software implementation programming language. For example, the value of a camera driver is identified, converted into a software programming language, and uploaded to the application framework layer to call the corresponding function.

[0113] In some embodiments, the HAL can upload face images captured by the camera 193 to the application framework layer for further processing.

[0114] The application framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer obtains original input events from the kernel layer through the HAL and identifies controls corresponding to the input events. The application framework layer includes some predefined functions.

[0115] As shown in FIG. 5, the application framework layer may include a view system, a telephone manager, a resource manager, a notification manager, a window manager, and the like.

[0116] In some embodiments, the application framework layer includes a first module. The first module is configured to call a corresponding display driver to display a screen based on a user's unlocking intent. For example, if it is determined that the user wants to unlock an outer screen, the first module calls the display driver of the outer screen to display an unlocked interface on the outer screen.

[0117] Optionally, the first module may be further arranged in another layer, and the first module may be further divided into more sub-modules, each sub-module being configured to perform a corresponding function.

[0118] The view system includes visual controls, such as controls for displaying text and controls for displaying images. The view system can be configured to build applications. A display interface can include one or more views. For example, a display interface that includes a short message notification icon may include a text display view and an image display view.

[0119] The telephone manager is configured to provide communication functions of the electronic device 100, such as managing the call status (including answering, rejecting, etc.).

[0120] The resource manager provides various resources such as localized strings, icons, images, layout files, video files, etc. to the application.

[0121] The notification manager may be configured to allow applications to display notification information in the status bar and to communicate notification messages. The notification manager may disappear automatically after a short stay without user interaction. For example, the notification manager may be configured to notify of download completion, provide message notifications, etc. The notification manager may alternatively be a notification that appears in the top status bar of the system in the form of a graph or scrollbar text, for example, a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, textual information is displayed in the status bar, a prompt sound is played, the electronic device vibrates, or an indicator light flashes.

[0122] A window manager is configured to manage window programs. The window manager may obtain the size of the display, determine if there is a status bar, implement screen locking, take screen shots, etc.

[0123] The application layer may include a series of application packages.

[0124] As shown in FIG. 5, the application package may include applications such as camera, video, phone, WLAN, music, messaging, Bluetooth, maps, calendar, gallery, and navigation.

[0125] The application layer and the application framework layer run on a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is configured to implement functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0126] The unlocking method provided in the embodiments of the present application is applicable to, but not limited to, scenarios such as message receiving, music playing, payment, and photography. The following describes the unlocking method provided in the embodiments of the present application in different scenarios by using an example in which the electronic device is a mobile phone having the structure shown in Figures 1A, 1B, and 5.

[0127] When using a folding screen device, a user can interact with the mobile phone through the outer screen or the inner screen. The roles of the inner and outer screens may change in different scenarios. For example, in a forward folding scenario shown in FIG. 3-3, the inner screens may be sub-screens 041 and 042, and the outer screens may be screens arranged behind the folding screen. As another example, in a backward folding scenario shown in FIG. 3-4, the outer screens may be sub-screens 044 and 045, and the inner screens may be screens arranged behind the folding screen. That is, the scenarios etc. do not limit the inner and outer screens.

[0128] In the embodiment of the present application, when obtaining the user's unlocking intention, the mobile phone can collect the user's identity information by using a sensor associated with the outer screen, and identify the user's identity based on the identity information. When the user's identity is determined by the terminal to be valid and the terminal detects that it meets the condition for using the first screen, it indicates that the user wants to unlock the first screen when unlocking the terminal screen. In this case, the terminal can intelligently and conveniently unlock the first screen for the user. It can be found that in the technical solution in the embodiment of the present application, the user's identity can be identified without the user fully unfolding the mobile phone, so that the unlocking progress can be accelerated, and the efficiency of the interaction between the terminal and the user can be improved. In addition, if the user wants to unlock the first screen, the first screen can be unlocked intelligently, so that the efficiency of the interaction between the terminal and the user can be further improved.

[0129] For example, a user actively unlocks a mobile phone. For example, the mobile phone is unlocked by a face unlocking method. As shown in FIG. 6(1), the mobile phone is in a folded state (the screen is locked). The user can trigger the mobile phone to call an image sensor in the camera on the outer screen to capture the user's face image, perform face recognition on the user based on the face image, identify the user's identity, and determine whether to unlock the screen based on the user's identity, for example, by double tapping the screen. Alternatively, when the user has an unlocking intention, the user may not need to double tap the screen, but can trigger the mobile phone to call an image sensor in the camera on the outer screen to capture the user's face image by performing an operation such as lifting the mobile phone. The condition for triggering the mobile phone to call an image sensor in the camera on the outer screen to capture the user's face image is not limited in this embodiment of the present application.

[0130] Optionally, during the facial recognition process, the mobile phone may display text such as “Facial recognition process in progress...” as shown in FIG. 6(2) to prompt the user that facial recognition is being performed.

[0131] In some cases, when the face image captured by the camera on the outer screen is determined to be a correct face image and the mobile phone is in a folded state, it indicates that the user probably wants to unlock the outer screen, and the mobile phone unlocks the outer screen. In this way, the user can interact with the mobile phone through the outer screen. Optionally, after unlocking the outer screen, the mobile phone displays an interface shown in FIG. 6(3). The interface may be the interface displayed by the mobile phone before the screen is locked, or may be a home screen or another interface. The interface presented after the screen is unlocked is not limited in this embodiment of the present application. It can be found that according to the unlocking method in the embodiment of the present application, the mobile phone can be unlocked without being unfolded. After that, the user can unfold the mobile phone for use, or use the mobile phone in a folded state based on the request.

[0132] In some other cases, when the mobile phone determines that the face image captured by the camera on the outer screen is the correct face image and the mobile phone is not in a folded state, it indicates that the user probably wants to unlock the inner screen this time. In this case, the mobile phone unlocks the inner screen. In this way, the user can interact with the mobile phone through the inner screen. Optionally, after unlocking the inner screen, the mobile phone displays the interface shown in FIG. 6(4) (e.g., the interface that was displayed before the screen was locked). In the prior art, it can be found that the mobile phone needs to be unfolded to a large angle before starting to call the camera on the inner screen to perform face recognition, and it takes a long time to unlock the face, and the efficiency of unlocking is low. In the unlocking method provided in the embodiment of the present application, when the mobile phone is unfolded to a small angle, the inner screen can be unlocked, so that the user can quickly use the inner screen.

[0133] In addition, in scenarios where a user needs to perform operations requiring high security, such as viewing confidential documents, the mobile phone can be unlocked and the document can be viewed simply by unfolding the mobile phone to a small angle, thereby avoiding the low security issues caused by unlocking and viewing the document by unfolding the mobile phone to a large angle.

[0134] Optionally, the user can then further fully unfold the mobile phone and use the mobile phone in the unfolded state shown in FIG. 6(5).

[0135] Optionally, the mobile phone can enable a multitasking function. After the multitasking function is enabled, the user can simultaneously enable multiple applications on the interface or display different interfaces of the same application. The user can switch between multiple applications or switch between different functions.

[0136] For example, as shown in FIG. 6(5), in addition to displaying the WeChat message from Sara, the inner screen of the mobile phone can further display information such as the contact list, so that the user can view contacts and new messages on the same screen.

[0137] As another example, the interface shown in Figure 8-3(3) is used as an example. In addition to the details of the email, the interface can further display the email list within a certain period in a split-screen manner so that the user can view the overview of different emails.

[0138] Optionally, the split screen situations for different applications or combinations of applications may be different. The particular split screen situation may be set by the system or by the user.

[0139] Please note that in Figure 6(1)-Figure 6(5), the unlocking method in this embodiment of the present application is described by using an example in which the mobile phone is unfolded by the user after Figure 6(2). The case in which the mobile phone is unfolded by the user may alternatively be another occasion. For example, the mobile phone is unfolded by the user between the occasions of Figure 6(1) and Figure 6(2).

[0140] In some embodiments, the operation of double tapping the screen, lifting the mobile phone, or performing a voice "unlock" by the user (used to trigger the mobile phone to perform face unlock, etc.) is referred to as an unlock operation, and the command input by the user to the mobile phone by using the unlock operation is referred to as an unlock command. FIG. 7 is a flowchart of an unlock method according to an embodiment of the present application when an unlock command input by the user is detected. The method is applied to an electronic device. The electronic device includes a screen 1 and a screen 2 formed in a screen folding state. For example, the screen 1 (e.g., the screen 1 shown in FIG. 6(4)) is an inner screen, and the screen 2 (e.g., the screen 2 shown in FIG. 6(3)) is an outer screen. As shown in FIG. 7, the method includes the following steps.

[0141] S101: A mobile phone obtains an unlocking intent.

[0142] The unlocking intent may be an unlocking command input by a user. The user inputs the unlocking command into the mobile phone by performing an unlocking operation to indicate that the user has the intent to unlock the mobile phone screen. For example, the user may input the unlocking command by double tapping the screen interface shown in FIG. 6(2). As another example, the user may input the unlocking command by a method such as voice.

[0143] Alternatively, the unlocking intent may be an unlocking intent sensed and determined by the mobile phone, for example, when the user picks up the mobile phone, the mobile phone can pre-determine that the user has an unlocking intent.

[0144] The specific type and implementation of the unlock command are not limited in this embodiment of the application.

[0145] S102: In response to the unlocking intent, the mobile phone invokes a second collection component associated with the outer screen to collect identity information input by the user.

[0146] Optionally, the mobile phone may be unlocked with one or more unlocking methods in response to the user's unlocking intention. The unlocking methods include, but are not limited to, one or more of face unlocking, fingerprint unlocking, pattern unlocking, password unlocking, and voiceprint unlocking. The face unlocking methods include, but are not limited to, three-color (red, green, blue, RGB) face unlocking, infrared face unlocking, and 3D structured light face unlocking. Correspondingly, each unlocking method may correspond to one or more collection components that may be configured to collect user identity information.

[0147] Optionally, the collection component for unlocking may include a collection component configured to collect user identity information. The user identity information represents the identity of the user. If the user identity information is correct, the mobile phone unlocks the screen. The identity information includes, but is not limited to, the user's face image, fingerprint information, voiceprint information, input pattern information, and input password information.

[0148] For example, when the unlocking method is face unlocking, the collection component for unlocking may be an image capture component, such as a camera. The image capture component includes, but is not limited to, an image sensor. The image sensor may be, but is not limited to, a complementary metal-oxide-semiconductor (CMOS) sensor, for example.

[0149] When the unlocking method is fingerprint unlocking, the collection component for unlocking may be, for example, a fingerprint collection component including a fingerprint sensor configured to collect fingerprint information. The fingerprint sensor may use any type of sensing technology, including, but not limited to, optical sensing technology, capacitive sensing technology, piezoelectric sensing technology, and ultrasonic sensing technology.

[0150] When the unlocking method is voiceprint unlocking, the collection component for unlocking may be a voiceprint collection component, for example, an acoustic sensor.

[0151] Optionally, the collection component for unlocking may alternatively be a touch panel or the like.

[0152] In this embodiment of the present application, when a user's unlock command is detected, the mobile phone calls a second collection component (e.g., an image sensor) associated with the outer screen to collect identity information entered by the user or information used for identity authentication. The second collection component associated with the outer screen can be, but is not limited to, an image sensor associated with the outer screen, a fingerprint sensor associated with the outer screen, etc.

[0153] For example, when the set unlock method is face unlock, the mobile phone invokes the camera associated with the outer screen to capture an image of the user's face.

[0154] It should be noted that this embodiment of the present application is mainly described by using an example in which a face image is captured by using a camera associated with an outer screen to identify the identity of a user. However, the user identity authentication method in this embodiment of the present application is not limited thereto and is uniformly described herein.

[0155] S103: The mobile phone identifies the user's identity based on the identity information collected by the second collection component associated with the outer screen.

[0156] For example, the second collection component associated with the exterior screen of the mobile phone and configured to collect identity information is an image sensor. In a possible implementation, the image sensor of the exterior screen transmits a captured facial image to the mobile phone processor, and the mobile phone compares the facial image with a pre-stored target facial image to identify whether the user's identity is valid.

[0157] S104: If the user's identity is valid and the electronic device meets the conditions for using the inside screen, the mobile phone unlocks the inside screen.

[0158] The conditions for using the first screen include one or more combinations of: a current time is within a preset time period, a current location is within a preset geographic location range, a new message is received and the new message is a message of a preset application, the electronic device is in an unfolded state, and the unlock command is a preset unlock command. The preset unlock command includes any one or more combinations of a gesture, a pattern, a number, a fingerprint, and a voice preset to unlock the first screen.

[0159] For example, a condition for using the first screen is that the electronic device is in a non-folded state. The mobile phone can detect whether the foldable screen is in a folded state.

[0160] In a possible implementation, the mobile phone detects whether the mobile phone is in a folded state by detecting an angle between a first sub-screen and a second sub-screen of a folding screen. For example, the mobile phone detects an angle between sub-screen A and sub-screen B shown in (d) of FIG. 3-1, and determines whether the mobile phone is in a folded state based on the angle.

[0161] Optionally, the gyroscope is disposed on both the first sub-screen and the second sub-screen, and configured to measure the orientation (direction vector) of the sub-screen on which the gyroscope is disposed. The mobile phone determines an included angle between the first sub-screen and the second sub-screen based on the measurement result of the gyroscope.

[0162] Optionally, the mobile phone may periodically detect the folding state of the mobile phone, or may be triggered to detect whether the mobile phone is in the folding state based on an event. For example, when an unlock command input by a user is detected, the mobile phone is triggered to detect whether the folding screen is in the folding state. The trigger condition for triggering the detection of whether the folding screen is in the folding state is not limited in this embodiment of the present application.

[0163] The mobile phone can determine whether the user wants to unlock the inner screen or the outer screen based on whether the folding screen is in a folded state. Optionally, when the mobile phone changes from a folded state to a non-folded state, the mobile phone performs step S104 to unlock the inner screen, or when the mobile phone is in a folded state, the mobile phone performs step S105 to unlock the outer screen.

[0164] When the mobile phone detects that the mobile phone has changed from a folded state to an unfolded state, it can be understood that it indicates that the user probably wants to unfold the mobile phone and interact with the mobile phone through the inner screen. In this case, the mobile phone unlocks the inner screen to meet the user's usage requirements. Optionally, the degree to which the foldable screen is unfolded to the unfolded state to identify and determine that the user's current intention is to unlock the inner screen may be set based on actual requirements.

[0165] S105: If the user's identity is valid and the electronic device does not meet the conditions for using the inner screen, the mobile phone unlocks the outer screen.

[0166] For example, as shown in FIG. 6(3), when it is determined that the user's identity is valid and the electronic device is in a folded state, which indicates that the user wishes to unlock the outer screen, the mobile phone unlocks the outer screen.

[0167] In the following, the unlocking method provided in this embodiment of the present application will be described with reference to a specific scenario.

[0168] 1. Scenario for receiving new messages As shown in Figure 8-1(1), after the mobile phone is folded and the screen is locked, the mobile phone receives two WeChat notification messages.

[0169] Optionally, before unlocking, the detailed content of the message is not displayed (e.g., partial information of the message is displayed, e.g., the amount of the message is displayed), and the detailed content of the message is displayed after unlocking.

[0170] In some embodiments, when the mobile phone receives a new message while the screen is locked, the mobile phone may be triggered to display a message reminder interface 401 shown in FIG. 8-1(2) to prompt the user that a new message has been received.

[0171] Optionally, the message reminder interface 401 may not display information such as message content or sender, but only display information without privacy data such as the application to which new messages received belong and the amount of new messages, to reduce the probability of user privacy leakage.

[0172] Alternatively, optionally, the message reminder interface 401 may display the sender, but not display information such as the specific content of the message, so that the user can choose whether to unlock the mobile phone to view the message when they know the sender. Also, since the specific content of the message is not displayed, the possibility of privacy leakage can be minimized.

[0173] Alternatively, optionally, the message reminder interface 401 can display most of the information of the message, including but not limited to the message content, sender, etc. Optionally, the application to which the received message belongs is a pre-set type of application. The pre-set type of application includes but is not limited to, for example, an application with low security requirements. The application with low security requirements may be, for example, an application with no user privacy information or an application with little user privacy information. The application with low security requirements may be a default application with low security requirements in the system (e.g., an application that does not read information such as the user's phone number or location) or an application set by the user.

[0174] Optionally, the message reminder interface of different applications may include different information. In a possible implementation, for messages of some private applications, the mobile phone erases private information from the message when it prompts the user that a new message has been received. For messages of non-private applications, the mobile phone may display most of the information corresponding to the message when it prompts the user that a new message has been received. For example, for a phone application, the incoming call information of some contacts can be set to invisible. In this way, when some contacts receive or call some of the contacts, some of the information about some contacts will not be displayed on the call screen, such as, but not limited to, one or more of the following information: the contact's phone number and the contact's name. Furthermore, some of the information about some contacts may not be displayed on the call record, such as, but not limited to, one or more of the following information: the contact's phone number, the call duration, the location where the contact's phone number belongs, the incoming or outgoing status, and the call date. Alternatively, the call record of some contacts is hidden.

[0175] The specific display content of the message reminder interface 401 is not limited in this embodiment of the present application.

[0176] In a scenario where the mobile phone receives a new message, when the user has an intention to unlock, the user triggers the mobile phone to turn on the screen by, for example, double-tapping the screen, call the camera on the outer screen to capture the user's face image, perform face recognition on the user, identify the user's identity, and determine whether to unlock the screen based on the user's identity. Alternatively, when the user has an intention to unlock, the user may not need to double-tap the screen, but can trigger the mobile phone to turn on the screen and call the camera on the outer screen to capture the user's face image by performing an operation such as lifting the mobile phone. In this embodiment of the present application, the conditions for triggering the mobile phone to call the camera on the outer screen to capture the user's face image are not limited.

[0177] In some other embodiments, when the mobile phone receives a new message in the screen lock state, the mobile phone is not triggered to display the message reminder interface 401 shown in FIG. 8-1(2), but the user is reminded that a new message has been received in another manner (e.g., non-interface manner). For example, the indicator of the mobile phone flashes, or the mobile phone vibrates or rings. In this case, the screen of the mobile phone may still be in a black screen state. When the user has an unlocking intention, the user can trigger the mobile phone to turn on the screen by performing an operation such as pressing the power button, lifting the mobile phone, or double-tapping the screen, and can call the camera on the outer screen to capture the user's face image to perform identity authentication for the user. Optionally, in the identity authentication process, the mobile phone can display the interface shown in FIG. 8-1(3) to prompt the user that the mobile phone is performing identity authentication.

[0178] In some other embodiments, the mobile phone can prompt the user that a new message has been received in multiple ways, for example, the indicator flashes, the mobile phone vibrates, and displays the message reminder interface shown in FIG. 8-1(2). The manner in which the mobile phone prompts for a new message is not limited in this embodiment of the present application.

[0179] When the face image captured by the camera on the outer screen is determined to be a correct face image and the mobile phone is in a folded state, which indicates that the user probably wants to unlock the outer screen, the mobile phone unlocks the outer screen. In this way, the user can interact with the mobile phone through the outer screen. For example, the user reads a received WeChat notification and replies with a WeChat message through the outer screen. Optionally, after unlocking the outer screen, the mobile phone displays a related interface of a new message shown in FIG. 8-1(4), where the interface includes message details.

[0180] When the mobile phone determines that the face image captured by the camera on the outer screen is the correct face image and the mobile phone is not in a folded state, it indicates that the user probably wants to unlock the inner screen this time. In this case, the mobile phone unlocks the inner screen. In this way, the user can interact with the mobile phone through the inner screen, for example, read certain WeChat notification content and reply to WeChat messages through the inner screen.

[0181] In some cases, if the user performs an operation such as tapping control 402 on the interface shown in FIG. 8-1(2), after unlocking the inner screen, the mobile phone may display a new message related interface shown in FIG. 8-1(5). If the user does not tap control 402, after unlocking the inner screen, the mobile phone may enter a previously closed desktop or application interface or display another interface.

[0182] It is considered that in some other cases, the user may not be convenient to input the relevant operation instruction of the new message. The mobile phone may determine that the user's unlocking intention is to view the new message based on the user's unlocking requirement and the unlocking opportunity (e.g., after receiving a new message), and display the relevant interface of the new message after the screen is unlocked.

[0183] In this embodiment of the present application, the associated interface of the new message may be an interface that includes message details, including but not limited to one or more of message content, sender, sender avatar, and sent time.

[0184] In some embodiments, the mobile phone responds to a user's operation command for a new message (such as, but not limited to, tapping on a new message) by displaying a related interface for the new message after unlocking the screen. The interface display method may be applied to one or more of the inner screen or the outer screen. If the user does not perform an operation on the new message, the desktop or previous application interface may be displayed.

[0185] For example, as shown in FIG. 8-1(2), when a user wants to view two WeChat message notifications, the user may tap control 402 to trigger the mobile phone to display the WeChat message interface shown in FIG. 8-1(4) after unlocking the screen.

[0186] In some other embodiments, the user may not be convenient to input the related operation command of the new message. For example, the user does not tap the control 402 shown in FIG. 8-1(2). In this case, even if the new message is prompted to the user in time, or another factor is taken into consideration, and the mobile phone does not detect the user's operation command for the new message, the mobile phone can display the related interface of the new message after unlocking the screen. The interface display method can be applied to one or more of the inner screen or the outer screen.

[0187] For example, see further FIG. 8-1(1) and FIG. 8-1(2). The mobile phone receives a new message in the screen lock state, and optionally displays the message reminder interface 401. If the user wants to view the two WeChat notifications, the user can lift the mobile phone (the user does not tap the control 402). The mobile phone identifies the user's operation of lifting the mobile phone, and determines that the user now wants to unlock the mobile phone. In addition, because the user unlocks the mobile phone after the mobile phone receives the WeChat notification message, the mobile phone determines that the user's intention is to view the WeChat notification message. Therefore, in the process of lifting the mobile phone, the mobile phone calls the camera on the outer screen to complete face recognition, unlocks the screen based on the face recognition result, and displays the WeChat message interface shown in FIG. 8-1(4).

[0188] It can be found that in some scenarios where it is inconvenient for the user to perform operations on new messages, the mobile phone can determine that the user's unlocking intention is to view new messages based on the user's unlocking requirements and unlocking occasions (e.g., after receiving new messages), and display the relevant interface of the new messages after the screen is unlocked. In this way, the interaction experience between the user and the mobile phone can be improved.

[0189] 2.Payment Scenarios In some scenarios, as shown in FIG. 9-1(1), the mobile phone is in a screen-locked state, and the user needs to complete identity authentication to perform a payment. As shown in FIG. 9-1(2), the mobile phone determines whether the user's identity is valid through a face image captured by a camera on the outer screen. If the user's identity is determined to be valid and the user has not unfolded the mobile phone, the mobile phone determines that the user's unlocking purpose is to unlock the outer screen, and the mobile phone can unlock the outer screen and display the interface shown in FIG. 9-1(3).

[0190] In some embodiments, to facilitate use by the user, the mobile phone can display one or more functions of the application on the desktop, for example, in the form of a shortcut icon of the function, and then the user can quickly use the corresponding function by operating the shortcut icon of the function.

[0191] For example, as shown in FIG. 9-1(3), after unlocking the outer screen, the mobile phone displays a shortcut icon for a payment collection function of the wallet application. By operating the shortcut icon (e.g., tapping the shortcut icon), the user can trigger the mobile phone to display a payment QR code shown in FIG. 9-1(4). The user can then use the payment QR code for payment.

[0192] In some other scenarios, the user may choose to complete the payment operation via the inner screen of the mobile phone. As shown in Figures 9-1(1) and 9-1(2), the user unlocks the mobile phone with a face recognition scheme. When the user's identity is determined by the mobile phone to be valid and the mobile phone is not in a folded state, which indicates that the user wishes to unlock the inner screen, the mobile phone may unlock the inner screen and display the interface shown in Figure 9-1(5). The interface includes an icon of a wallet application (or includes an icon of a payment function). The user may then use one or more functions of the wallet application (e.g., collection and payment functions) by performing an operation such as tapping the wallet icon. Optionally, the user may further choose to unfold the mobile phone to another angle, e.g., fully unfold the mobile phone for use. For example, the mobile phone enters the interface of the wallet application in response to the user tapping the wallet application icon shown in Figure 9-1(5). In response to a user's operation of selecting the payment and collection function on the wallet application interface, the mobile phone can display the payment and collection function interface shown in FIG. 9-1(6).

[0193] Optionally, in the payment scenario in this embodiment of the present application, the payment method includes, but is not limited to, QR code payment, near field communication (NFC) payment, and barcode payment.

[0194] NFC payment is used as an example. As shown in FIG. 9-2(1), the mobile phone touches the NFC bus card in the folded state (and the screen is locked) and displays the interface shown in FIG. 9-2(2). The user can trigger the mobile phone to verify the user's identity by performing an operation such as clicking the "recharge" option. Optionally, the mobile phone can call the camera on the outer screen to perform face recognition and display the interface shown in FIG. 9-2(3). If the mobile phone determines that the user's identity is valid and the mobile phone is in the folded state, it indicates that the user wants to unlock the outer screen. In this case, the mobile phone can unlock the outer screen and display the interface shown in FIG. 9-2(4). The user can select the corresponding recharge amount through the interface to recharge.

[0195] 3. Shooting scenario As shown in FIG. 10(1), the mobile phone is in a folded state (screen lock state). A user can perform some operations on the mobile phone to trigger the mobile phone to enable a camera application. For example, the user presses the power button to turn on the outer screen, triggering the mobile phone to display the camera application icon shown in FIG. 10(2) through the outer screen. The user can trigger the mobile phone to enable the camera application by using an operation such as tapping the camera application icon. As shown in FIG. 10(3), the mobile phone enables the camera application and enters the interface of the camera application. The interface may include a gallery control, a shooting control, and a camera switching control.

[0196] It should be noted that when the outer screen is not unlocked, it may be configured that some functions of the camera application are available and some functions are not available.

[0197] For example, a user may trigger the mobile phone to take a picture by tapping a picture-taking control, in other words, when the outer screen is not unlocked, the picture-taking functionality of the camera application is available.

[0198] In another example, the user can switch between the front and rear cameras, for example, by tapping a camera switching control. In other words, when the outer screen is not unlocked, the camera switching function of the camera application is available.

[0199] Optionally, the user may attempt to enter the gallery by using an operation, e.g., a tap. In this scenario, optionally, to avoid disclosing some private images in the gallery of the mobile phone, the mobile phone may display to the user only images generated through current shooting by using the gallery. In this case, the user may view only images taken by the user by operating the shooting control after the camera application is enabled this time by using the gallery. In other words, if the outer screen is not unlocked, only permission to view images taken when the outer screen is not unlocked is available.

[0200] Optionally, when the outer screen is not unlocked, the camera application is disabled or images stored in the gallery are deleted after the screen is locked.

[0201] The previous example is still used. After the mobile phone displays the interface shown in FIG. 10(3), the user can trigger the mobile phone to display images in the gallery shown in FIG. 10(4) by performing an operation such as tapping the gallery control. Optionally, the interface shown in FIG. 10(4) may include a gallery control. In order to improve the security of private images in the gallery of the mobile phone, when a user's operation, for example, tapping the gallery control 2, is detected, the mobile phone can prompt the user to unlock the screen. For example, the mobile phone may display a prompt interface shown in FIG. 10(5). When a user's unlock operation is detected by the mobile phone, for example, when it is detected that the user taps the screen, the mobile phone calls the camera on the outer screen to capture the user's face image and identify the user's identity. If the user's identity is valid and it is detected that the mobile phone is in a non-folded state, the mobile phone can unlock the inner screen and display the gallery interface shown in FIG. 10(6) for the user to browse and view. The gallery interface may include one or more images in the mobile phone. Conversely, if the user's identity is valid and the mobile phone is detected to be in a folded state, the mobile phone can unlock the outer screen and display the gallery interface shown in FIG. 10(7).

[0202] Please note that the unlocking procedure shown in FIG. 10(1) to FIG. 10(7) is merely an example. There may be other implementation forms, such as conditions for triggering the enablement of the camera, triggered by the user operating the gallery control, and the actual response of the mobile phone. This is not limited in this embodiment of the present application. For example, when a user's operation such as touching the gallery control 1 is detected and an image is taken after the camera application is enabled this time, the mobile phone displays the image taken this time by the user. Also, the mobile phone can switch and display multiple images taken this time according to the user's operation such as a left / right sliding operation. If it is detected that the user touched the gallery control 1 and an image has not been taken after the camera application is enabled this time, the mobile phone prompts the user to unlock the screen to view the mobile phone's gallery.

[0203] 4.Music Playback Scenario As shown in Fig. 11(1), the mobile phone is in a folded state and plays music in the background. The user can turn on the outer screen, such as by tapping the screen or pressing the power button. Optionally, when music is playing in the background and the screen is not unlocked, the mobile phone can display the interface shown in Fig. 11(2) after turning on the screen. Optionally, the interface can include a control 406.

[0204] Optionally, when the screen is not unlocked, the user cannot perform music-related operations on the outer screen interface, for example cannot switch songs, cannot control pausing or playing songs.

[0205] Alternatively, optionally, when the screen is not unlocked, the mobile phone can execute some functions of the music application to reduce the user's unlocking frequency. For example, the user can switch, pause, or play songs by using the control 406. Optionally, the mobile phone does not support some other functions. For example, the user cannot implement functions such as music collection by using the control 406.

[0206] In response to an unlocking operation input by the user, for example, double tapping the screen, the mobile phone calls the camera on the outer screen to capture a facial image, and then performs facial recognition based on the captured facial image to determine whether the user's identity is valid. Optionally, in the facial recognition process, the mobile phone can display an interface shown in FIG. 11(3).

[0207] If it is determined that the user's identity is valid and the mobile phone is in an unfolded state, the mobile phone unlocks the inner screen. Optionally, if the user performs an operation on control 406 via the interface shown in FIG. 11(2) (e.g., taps control 406), after the inner screen is unlocked, the mobile phone displays the interface of the music application shown in FIG. 11(4). If the user does not perform an operation on control 406, after the mobile phone unlocks the inner screen, the inner screen may enter the last displayed desktop or application interface.

[0208] Conversely, if it is determined that the user's identity is valid and the mobile phone is in a folded state, the mobile phone unlocks the outer screen. Optionally, after unlocking the outer screen, the mobile phone displays the music application interface shown in FIG. 11(5).

[0209] 11(1)-11(5) mainly show an example in which a user double-tap the music control 406 to trigger face unlocking, and the mobile phone displays the relevant interface of the music application after unlocking. In some other embodiments, the user may alternatively not perform an operation on the music control 406, but may trigger the mobile phone to perform face unlocking in another way, for example, by sliding the interface shown in FIG. 11(2) by using a finger. In this case, after the mobile phone is unlocked, the mobile phone may enter the home screen or interface last displayed by the mobile phone.

[0210] In some embodiments, the mobile phone can be directly unlocked after the face recognition is successful. Receiving a new message is used as an example. For example, see further FIG. 8-1(3) and FIG. 8-1(4). After the face recognition is successful, if it is determined that the mobile phone is in a folded state, the outer screen is directly unlocked.

[0211] In some other embodiments, the mobile phone may be alternatively unlocked based on an unlock operation (e.g., a screen slide operation) input by the user after the face recognition is successful. Receiving a new message is still used as an example. For example, see FIG. 8-2(1) and FIG. 8-2(2). The mobile phone performs face recognition in response to the user's unlock request. After the face recognition is successful, the mobile phone may display the interface shown in FIG. 8-2(3). When a swipe-up operation input by the user is detected and the mobile phone is detected to be in a folded state, the mobile phone may unlock the outer screen and display the unlock interface shown in FIG. 8-2(4). When a swipe-up operation input by the user is detected and the mobile phone is detected to be in a non-folded state, the mobile phone may unlock the inner screen and display the unlock interface shown in FIG. 8-2(5).

[0212] The above-mentioned embodiment is mainly described by using an example in which it is determined whether the user wants to unlock the outer screen or the inner screen by determining whether the mobile phone is in a folded state. In some other embodiments, the mobile phone can not only determine whether the mobile phone is in a folded state, but also determine a certain unfolding angle of the mobile phone. If it is determined that the unfolding angle of the mobile phone is within a preset range, the mobile phone unlocks the inner screen. The preset range can be set separately based on the actual application. This is not limited in this embodiment of the present application.

[0213] In some other embodiments, in addition to determining the folded state of the mobile phone, another determination condition may be further set, so that the mobile phone more accurately determines whether the user wants to unlock the inner screen or the outer screen. Optionally, the another determination condition includes, but is not limited to, one or more of: the current time is within a preset time period, the current location is within a preset geographic location range, the new message is a message of a preset application, and a preset unlock operation is detected.

[0214] The pre-configured application includes, but is not limited to, an office application. For example, the work application may be, for example, a mailbox (such as a corporate mailbox, a private mailbox, etc.), or an instant messaging application (such as an enterprise version of WeChat or a personal version of WeChat).

[0215] The preset unlock operation may be an operation used to unlock the inner screen, such as a preset unlock gesture or unlock pattern. The preset unlock operation may be set by the system or by a user.

[0216] Optionally, when it is detected that one or more of the aforementioned conditions are met, the mobile phone may unlock the inside screen.

[0217] For example, the mobile phone may obtain a user profile or collect behavior data used to reflect user behavior characteristics to determine whether the user wants to unlock the outer screen or the inner screen when unlocking the screen at different times, different locations, or different scenarios. In this way, when the user unlocks the terminal screen at a corresponding time, corresponding location, or corresponding scenario, the terminal can implement efficient interaction between the user and the terminal based on determining whether the user currently wants to unlock the inner screen or the outer screen.

[0218] A user profile typically includes one or more tags of the user (e.g., gender, lagging habits, or reading preferences), the user profile can reflect the user's information summary, and the terminal can predict the user's current possible behavior or hobbies based on the user profile.

[0219] For example, the user profile of a user indicates that the user is a person who has entertainment habits before going to bed (e.g., playing games before going to bed) and the user's sleep time is 23:00 to 7:30. In this case, the terminal can determine, based on the user profile, the unlock purpose of unlocking the terminal by the user between 22:00 and 23:00 (before going to bed) as unlocking the inner screen and running game application B. Thus, if it is detected that the user has inputted correct identity authentication information (e.g., correct face information) into the terminal between 22:00 and 23:00, the terminal can unlock the inner screen and automatically run game application B.

[0220] For example, the user profile of a user indicates that the user normally uses the inner screen when using the mobile phone at home, and the user normally uses the outer screen in a public place such as a subway. In this case, the terminal can determine the unlocking purpose of unlocking the mobile phone by the user at home as unlocking the inner screen based on the user profile authorized by the user. Thus, if it is detected that the user is at home and the user inputs correct identity authentication information into the terminal, the terminal unlocks the inner screen. If it is detected that the user is in a public place such as a subway and the user inputs correct identity authentication information into the terminal, the terminal unlocks the outer screen.

[0221] In this embodiment of the present application, different unlocking instructions can be set for the outer screen and the inner screen. The pre-set unlocking instruction is an unlocking instruction used to unlock the inner screen, and the pre-set unlocking instruction includes any one or more combinations of pre-set gestures, patterns, numbers, and fingerprints.

[0222] For example, drawing an unlock pattern "M" is set as the preset unlock command to unlock the inner screen, and drawing an unlock pattern "N" is set as the unlock command used by the user to unlock the outer screen. In this case, when an unlock command to draw the unlock pattern M on the outer screen by the user is detected and the mobile phone is currently in a non-folded state, the mobile phone determines that the user's unlock intent is to unlock the inner screen, and the mobile phone unlocks the inner screen based on the user's unlock intent.

[0223] In another example, generally speaking, corporate e-mail may involve business secrets, and therefore has high security requirements. Considering this characteristic of corporate e-mail, when a mobile phone receives a corporate e-mail in a screen-locked state, the mobile phone can unlock the inner screen in response to an unlock command input by a user (e.g., a face image input by using a camera on the outer screen) to reduce the probability of corporate secret leakage in the process of viewing and replying to the corporate e-mail. For example, as shown in FIG. 8-3(1), a mobile phone receives a corporate e-mail in a screen-locked state. In this case, the mobile phone performs identity authentication on the user by using the camera on the outer screen in response to the user's unlocking operation, e.g., lifting the mobile phone. If the user's identity is determined to be valid and the mobile phone is in a semi-folded state shown in FIG. 8-3(2), the mobile phone can unlock the inner screen. Optionally, after unlocking the inner screen, the mobile phone displays an interface shown in FIG. 8-3(3). The interface includes the content of the e-mail.

[0224] As another example, in some scenarios, if the user does not actively deploy the mobile phone, the mobile phone may prompt the user to deploy the mobile phone to process corporate emails with high security requirements. As shown in FIG. 8-3(4), after the user's identity is determined to be valid, the mobile phone may display interface 404 (an example of a third interface) to prompt the user to deploy the mobile phone for use.

[0225] Optionally, if the mobile phone is detected to be in an unfolded state within a period of time after interface 404 is displayed, which indicates that the user's unlocking intent is indeed to unlock the inner screen, the mobile phone unlocks the inner screen. Optionally, after unlocking the inner screen, the mobile phone displays the interface shown in FIG. 8-3(5). For example, the interface includes email details. In another example, the interface includes email details and email list in a split screen manner.

[0226] Alternatively, optionally, if it is detected that the mobile phone is still in a folded state within a certain period of time, it indicates that the user's unlocking purpose is probably to unlock only the outer screen. In this case, the mobile phone only unlocks the outer screen. Optionally, after unlocking the outer screen, the mobile phone displays the interface shown in FIG. 8-3(6).

[0227] In other words, when the mobile phone receives a message of an application with high security requirements (e.g., corporate e-mail), the mobile phone processes the message through the inner screen as much as possible. Specifically, when the user's identity is determined to be valid, the mobile phone preferentially unlocks the inner screen if the mobile phone is determined to be in an unfolded state. Alternatively, when the user's identity is determined to be valid, if the mobile phone is still determined to be in a folded state, the user can be prompted that the mobile phone can be unfolded for use. In this way, the probability that the user uses the inner screen to process the message (e.g., corporate e-mail) can be increased.

[0228] In some other embodiments, to further increase the probability that the user uses the inner screen to process, for example, corporate email, the mobile phone can further prompt the user to unfold the mobile phone for use through multiple interfaces. For example, the interface shown in FIG. 8-3(2) or FIG. 8-3(4) prompts the user to unfold the mobile phone for use. The specific occasions and methods of prompting are not limited in this embodiment of the present application.

[0229] The above describes the unlocking method provided in this embodiment of the present application by using an example in which the new message is a corporate email with high security requirements. In some other embodiments, the new message may alternatively be a message of a non-preset application or non-preset function, or a message that is not received within a pre-set period, or a message that is not received within a pre-set geographic location range. For example, the new message may be a message with low security requirements. For such messages, the user can choose whether to interact with the mobile phone via the inner screen based on the user's usage habits.

[0230] For example, the new message is a new e-mail with low security requirements. For example, as shown in FIG. 8-4(1) and FIG. 8-4(2), the mobile phone receives a new e-mail in a screen lock state and displays an interface 405. The interface may include basic information of the new e-mail. Then, in response to an unlock command input by a user, for example, a user double-tapping the screen, the mobile phone calls the camera on the outer screen to capture a face image and perform face recognition. Optionally, in the face recognition process, the mobile phone can display the interface shown in FIG. 8-4(3).

[0231] In some cases, if the mobile phone determines based on the face recognition result that the user's identity is valid and the mobile phone is in an unfolded state, the mobile phone determines that the user's unlocking intent is to unlock the inner screen, and the mobile phone unlocks the inner screen. Optionally, after unlocking the inner screen, the mobile phone displays the interface shown in FIG. 8-4(4).

[0232] In some other cases, if the mobile phone determines, based on the facial recognition result, that the user's identity is valid and the mobile phone is still in the folded state, the mobile phone unlocks the outer screen. Optionally, after unlocking the outer screen, the mobile phone displays the interface shown in FIG. 8-4(5).

[0233] From the above embodiment, it can be seen that in some scenarios where the inside screen is not required (e.g., for some messages that do not involve security leakage risk), the mobile phone unlocks the outside screen without user intervention (e.g., the user does not unfold the mobile phone). In other words, the mobile phone interacts with the user through the outside screen as much as possible. In some scenarios where the inside screen is required, the mobile phone unlocks the inside screen and interacts with the user via the inside screen as much as possible.

[0234] In some other embodiments, the mobile phone can further prompt the user to unfold the mobile phone for use. For example, the prompt information is displayed on the interface shown in FIG. 8-4(2) or FIG. 8-4(3). Alternatively, the prompt information is displayed after the user's identity is identified as valid and before the screen is unlocked. The manner in which the mobile phone prompts the user to unfold the mobile phone is not limited to an interface manner, and may be, for example, a voice (one example of a voice prompt) prompt manner. The specific prompt occasion and prompt manner are not limited in this embodiment of the present application.

[0235] In some other embodiments, the mobile phone may alternatively determine whether to interact with the user through the inside screen based on other conditions, for example some other detection may be performed on email messages to determine whether to recommend that the user unlock the inside screen to process the email message.

[0236] For example, the mobile phone detects whether a newly received e-mail has an attachment. If the e-mail carries an attachment, the mobile phone unlocks the inner screen when it is detected that the user has an unlocking requirement, and actively unfolds the mobile phone. Alternatively, the mobile phone recommends the user to unfold the mobile phone for use. The prompt method is not limited to an interface method, a voice method, etc.

[0237] In another example, the mobile phone detects whether a newly received email carries an attachment whose size exceeds a threshold. If the email carries a large attachment (e.g., an attachment whose size is greater than 10M), the mobile phone unlocks the inner screen and actively unfolds the mobile phone when it is detected that the user has an unlocking requirement. Alternatively, the mobile phone recommends the user to unfold the mobile phone for use.

[0238] The threshold value can be flexibly set based on the scenario, which is not limited in this embodiment of the present application.

[0239] In another example, the mobile phone detects whether a newly received email carries a pre-set type of attachment. If the email carries a pre-set type of attachment, the mobile phone unlocks the inner screen when it is detected that the user has an unlocking requirement and actively unfolds the mobile phone. Alternatively, the mobile phone recommends the user to unfold the mobile phone for use.

[0240] Optionally, the pre-set type of attachment may be an attachment suitable for viewing through an inner screen (e.g., a large screen). Optionally, the pre-set type of attachment may be an attachment with high privacy, e.g., an encrypted attachment.

[0241] For example, the pre-configured types may be, but are not limited to, an image, a video, a Word document, or an encrypted attachment, for example. Image types include, but are not limited to, any one or more of the following types: jpg, png, tif, and gif.

[0242] In some other embodiments, the terminal may further determine the user's unlocking purpose with reference to detecting the aforementioned conditions. For example, the terminal may detect whether the current time is within a preset period and whether the electronic device is in a folded state. In a possible design, in some cases, if the user inputs correct identity authentication information within a preset period and the terminal detects that the terminal is in a non-folded state, it indicates that the user is preparing to unfold the terminal for use, and the terminal may directly unlock the inner screen. In some other cases, if the user inputs correct identity authentication information within a preset period and the terminal detects that the terminal is in a folded state, the user may not unfold the terminal in time. In this case, the terminal may display prompt information, for example, the terminal may display "Face recognition was successful. Please unfold the terminal to unlock the inner screen" to prompt the user to unfold the terminal. If it is detected that the terminal is unfolded within a period after the terminal displays the prompt information, the terminal may unlock the inner screen. If it is detected that the terminal is not unfolded within a period after the terminal displays the prompt information, the terminal may unlock the outer screen.

[0243] In another possible design, if the terminal detects that the user has entered correct identity credentials within a preset period, the terminal may first unlock the outer screen and display a first interface on the outer screen, and when it detects that the user has unfolded the mobile phone, the terminal may unlock the inner screen and display a second interface on the inner screen that is associated with the first interface. In this way, the interface of the outer screen may be associated and connected to the inner screen.

[0244] In some other embodiments, the user needs to interact with the mobile phone through the inner screen, and due to some factors, the mobile phone cannot successfully perform face recognition through the camera on the outer screen. For example, the process of the user unfolding the mobile phone is fast, and the amount of face images captured by the camera on the outer screen is low, or the angle of the face images captured by the camera on the outer screen is biased, and the mobile phone cannot identify the user's identity based on the captured image.

[0245] In some cases, as shown in FIG. 8-5(1) and FIG. 8-5(2), when face unlocking fails to be performed by using the camera on the outer screen, the mobile phone can call the camera on the inner screen to continue capturing the user's face image (one example of user identity information) and identify the user's identity based on the face image captured by the camera on the inner screen. Optionally, the mobile phone displays an interface shown in FIG. 8-5(3) through the inner screen to prompt the user that face recognition is being performed. If the user's identity is determined to be valid based on the face recognition result, the mobile phone can unlock the inner screen. Optionally, after unlocking the inner screen, the mobile phone displays an interface shown in FIG. 8-5(4) on the inner screen.

[0246] In some other cases, when face unlocking fails to be performed by using the image sensor of the outer screen, the mobile phone can call the image sensor of the inner screen (an example of a first collection component) to continue capturing face images. In addition, considering that the camera on the outer screen may have captured some face images, the mobile phone can identify the user's identity by using the face images captured by the camera on the outer screen and the face images captured by the camera on the inner screen. In this way, before the mobile phone calls the camera on the inner screen, the camera on the outer screen has captured some face images required for face recognition. Therefore, the camera on the outer screen can collect fewer face images to complete face recognition. This shortens the time from calling the camera on the inner screen to successful face recognition, and speeds up face recognition.

[0247] Optionally, in this embodiment of the present application, the mobile phone can determine the opportunity to call the camera on the inner screen based on the positional relationship between the user and the mobile phone. For example, if the user's face is determined to be outside the field of view (FOV) range of the camera on the outer screen and the duration reaches a preset duration, it indicates that the camera on the outer screen cannot capture face images with a high probability. In this case, when the mobile phone is in a non-folded state, the mobile phone continues to call the camera on the inner screen to capture face images, so as to increase the success rate of face recognition.

[0248] Optionally, when the mobile phone determines that the user's face is outside the field of view (FOV) range of the camera on the outer screen and the duration reaches a preset duration, the mobile phone controls the outer screen to be turned off to reduce power consumption.

[0249] Optionally, the mobile phone can further determine an opportunity to call up the camera on the inner screen in response to an instruction input by the user. For example, when it is detected that the user performs an operation such as pressing a power button, the mobile phone calls up the camera on the inner screen.

[0250] Optionally, the mobile phone can further determine the opportunity to call the camera on the inner screen based on the angle at which the folding screen is unfolded or based on the folded angle of the mobile phone. Specifically, when the folding angle of the mobile phone is within a preset angle range, the camera on the inner screen is called to capture a face image. The preset angle range can be determined based on the viewing range of the camera on the inner screen. When the folding angle of the mobile phone is within a preset angle range, the camera on the inner screen can normally capture a face image. When the camera on the inner screen is a wide-angle or ultra-wide-angle camera, the viewing range of the camera on the inner screen is large, and the corresponding preset angle range is also large. When the camera on the inner screen is narrow, the corresponding preset angle range is small. The preset angle range is not limited in this embodiment of the present application. In this embodiment, it can be found that the camera on the inner screen is called to start the operation only when the user's face is within the viewing range of the camera on the inner screen. This reduces the power consumption caused by invoking the camera on the inner screen in advance and reduces as much as possible the probability of slow face recognition speed caused by delayed invoking the camera on the inner screen.

[0251] Optionally, the on-screen camera used for face recognition may be a camera with a wide viewing range, which increases the probability that the user's face is within the viewing range of the on-screen camera and helps the on-screen camera capture the face image, thereby improving the success rate of face recognition.

[0252] For example, the preset angle range is 80°~145°. See FIG. 8-6(1). The mobile phone receives a new e-mail in a screen-locked state, and the user picks up the mobile phone and tries to unlock the mobile phone for use. In response to the user's unlocking operation, the mobile phone calls the camera on the outer screen to capture a face image and performs face recognition.

[0253] Optionally, in the face recognition process, the mobile phone can display the interface shown in FIG. 8-6(2). Then, the user gradually unfolds the mobile phone. When the mobile phone detects that the mobile phone is unfolded to an angle of 80° and is still not unlocked, the mobile phone calls the camera on the inner screen to continue capturing face images. Optionally, the mobile phone can identify the user's identity based on the face image captured by the camera on the inner screen. Alternatively, to further improve the face recognition speed, the mobile phone can perform face recognition based on the face image captured by the camera on the outer screen and the face image captured by the camera on the inner screen.

[0254] Optionally, during the facial recognition process, the mobile phone can display the interface shown in Figure 8-6(3). If the user's identity is determined to be valid, the mobile phone can unlock the inner screen and display the interface shown in Figure 8-6(4).

[0255] In some other embodiments, the mobile phone can determine the opportunity to call the camera on the inner screen based on the angle at which the mobile phone is unfolded and the positional relationship between the user and the mobile phone, and call the camera on the inner screen at a more accurate opportunity. For example, when the folding angle of the mobile phone reaches 80°, the user's face is close to the mobile phone, and it is detected that the user's identity is not currently identified, the mobile phone calls the camera on the inner screen to capture the user's face image to continue performing face recognition.

[0256] In some embodiments, the mobile phone may further prompt the user whether to unfold the mobile phone to unlock the inside screen.

[0257] Receiving a new message is still used as an example. For example, as shown in FIG. 8-7(1), the mobile phone is in a screen lock state, and then the mobile phone receives a new message. In this case, the mobile phone can display a message reminder interface shown in FIG. 8-7(2). The message reminder interface may include words such as "unfold the mobile phone to enter the inner screen display" to prompt the user to unlock the inner screen by unfolding the mobile phone. Then, in response to a user's operation such as double-tapping the screen, the mobile phone captures a face image by using the camera on the outer screen to perform face recognition. Optionally, in the face recognition process, the mobile phone displays an interface shown in FIG. 8-7(3).

[0258] In some cases, if the mobile phone determines through facial recognition that the user's identity is valid and the mobile phone is not in a folded state, which indicates that the user has unfolded the mobile phone, the user's unlocking purpose is to unlock the inner screen. In this case, the mobile phone unlocks the inner screen. Optionally, after unlocking the inner screen, the mobile phone displays a message details interface shown in FIG. 8-7(4).

[0259] In some other cases, if the mobile phone determines through facial recognition that the user's identity is valid and the mobile phone is in a folded state, which indicates that the user has not unfolded the mobile phone, the user's unlocking purpose is to unlock the outer screen. In this case, the mobile phone unlocks the outer screen. Optionally, after unlocking the inner screen, the mobile phone displays a message details interface shown in FIG. 8-7(5).

[0260] As another example, as shown in FIG. 8-7(1) to FIG. 8-7(4), in the face recognition process, the mobile phone can prompt the user to unfold the mobile phone to unlock the inner screen. If the mobile phone determines based on the face recognition result that the user's identity is valid and the mobile phone is not in a folded state, it indicates that the user has unfolded the mobile phone, and the user's unlocking purpose is to unlock the inner screen. In this case, the mobile phone unlocks the inner screen based on the user's unlocking purpose. Conversely, if the mobile phone determines based on the face recognition result that the user's identity is valid and the mobile phone is in a folded state, it indicates that the user has not unfolded the mobile phone, and the user's unlocking purpose is to unlock the outer screen. In this case, the mobile phone unlocks the outer screen.

[0261] As another example, as shown in FIG. 8-9(1) to FIG. 8-9(5), after the mobile phone determines the user's identity to be valid based on the face recognition result, the mobile phone can display the interface 403 shown in FIG. 8-9(3) to prompt the user to unfold the mobile phone and unlock the inner screen. If the mobile phone detects that the mobile phone has been unfolded within a period of time after the prompt interface 403 is displayed, it indicates that the user's unlocking purpose is to unlock the inner screen, and the mobile phone unlocks the inner screen based on the user's unlocking purpose. Conversely, if the mobile phone does not detect that the mobile phone has been unfolded within a period of time after the prompt interface 403 is displayed, it indicates that the user may want to interact with the mobile phone only through the outer screen. In this case, the mobile phone unlocks the outer screen to restore the interaction of the outer screen.

[0262] It should be noted that the manner in which the mobile phone prompts the user to unfold the mobile phone is not limited to the manner in which the interface shown in FIG. 8-7(2), the interface 407 shown in FIG. 8-8(1) to FIG. 8-8(4), and the interface shown in FIG. 8-9(3) are displayed. For example, the swipe-up unlock icon shown in FIG. 8-2(3) may be added with prompt information, such as "unfold the mobile phone and swipe up to unlock the inside screen." In addition, the angle at which the mobile phone may be unfolded may alternatively be prompted to the user through the interface. For example, the user is prompted to "unfold the mobile phone by about 15 degrees (just as an example) to trigger the unlocking of the inside screen."

[0263] In addition, the manner in which the mobile phone prompts the user to unfold the mobile phone is not limited to the interface prompt method, and may be, for example, a voice prompt method. The specific prompt occasion and the prompt method are not limited in this embodiment of the present application.

[0264] Optionally, if it is determined that the user's unlocking purpose is to unlock the inner screen, the mobile phone unlocks the inner screen. In this case, if the mobile phone detects that the outer screen is still in a screen-on state, the mobile phone can control the outer screen to turn off the outer screen to reduce the overall power consumption caused by the screen-on of the outer screen.

[0265] Alternatively, optionally, if the mobile phone determines that the user's unlocking purpose is to unlock the inner screen, the mobile phone can alternatively unlock both the inner screen and the outer screen. For example, in some shooting scenarios, the user may need to preview the image to be shot through the inner screen and the outer screen in order to shoot an image with good effect.

[0266] In some embodiments, shortcut entry methods may be further configured for specific functions of specific applications to more quickly unlock and enter the corresponding functions of the corresponding applications.

[0267] For example, as shown in Fig. 10(2), a shortcut launch icon is set for the camera application on the lock screen, which allows the user to quickly use the camera application by operating the shortcut launch icon for the camera application.

[0268] As another example, a shortcut start icon may be further set for the payment function of the wallet application. After the user performs an operation (e.g., a tap operation) on the shortcut start icon of the payment function, the mobile phone performs identity authentication for the user. If it is determined that the user's identity is valid, the mobile phone directly displays the payment QR code. In this way, the user's payment operation can be simplified, and the user does not need to search for the wallet application in multiple applications on the desktop after unlocking and select to enter the payment QR code interface.

[0269] For example, the mobile phone performs identity authentication on the user through face recognition by using the camera. In some embodiments, if the user's identity is determined to be valid by the camera on the outer screen, the mobile phone can alternatively unlock the outer screen first. Then, when it is detected that the user unfolds the mobile phone, the mobile phone can associate and connect the interface of the outer screen to the inner screen for display. An example is used in which the mobile phone is unlocked in a scenario in which a new message is received. See Figure 8-10(1) and Figure 8-10(2). The mobile phone receives a new message in a screen-locked state, the user lifts the mobile phone to unlock it, and the mobile phone captures a face image by using the camera on the outer screen and performs face recognition on the user. After the face recognition is successful, the mobile phone unlocks the outer screen and displays the message interface (an example of a first interface) shown in Figure 8-10(3). The user then unfolds the mobile phone for use, and the mobile phone can associate and connect the interface displayed on the outer screen, for example the interface shown in FIG. 8-10(3), to the inner screen and display the interface shown in FIG. 8-10(4) on the inner screen. In one example, the interface on the outer screen can be synchronously switched to the inner screen for display to implement a seamless switch from the interface on the outer screen to the interface on the inner screen. In some other examples, when the interface on the outer screen is switched to the inner screen for display, an interface associated with the interface on the outer screen can be displayed on the inner screen. For example, the outer screen can display an email details interface and the inner screen can display an interface (an example of a second interface) in a split-screen manner. The email details are displayed in one portion of the interface and a list of sent and received emails is displayed in the other portion of the interface. In another example, the outer screen displays an interface of currently playing music and when switched to the inner screen for display, the music list interface is displayed on the inner screen.In other words, an interface that is associated with an interface on the outer screen may be displayed on the inner screen.

[0270] Compared with the solutions of Figures 8-10(1) to 8-10(4), in the solutions shown in Figures 6(1) to 6(5), when the user's identity is determined to be valid and the mobile phone is unfolded for use, the mobile phone can directly unlock the inner screen instead of unlocking the outer screen, so that the power consumption caused by unlocking the outer screen can be further reduced.

[0271] In some embodiments, taking into account that the inner screen and the outer screen have different characteristics, for the same function of the same application, the functional interface displayed on the inner screen and the functional interface displayed on the outer screen of the mobile phone may be different.

[0272] A payment scenario (not limited to a payment scenario) is used as an example. For example, considering that the security of the inner screen is usually higher than that of the outer screen, the payment function interface displayed on the outer screen in FIG. 9-1(4) contains less information (e.g., only includes QR code information used to complete the payment function shown in the figure), and the payment function interface displayed on the inner screen in FIG. 9-1(6) contains more information (e.g., includes QR code information and barcode information used to complete the payment function shown in the figure). In this way, important privacy information, etc. can be displayed on the inner screen as much as possible to improve the security of user information.

[0273] As another example, given the difference between the size of the inner screen and the size of the outer screen, for the same function within the same application, the interface of the function displayed on a smaller sized screen contains less information and the interface of the function displayed on a larger sized screen contains more information.

[0274] This embodiment of the present application may further provide a setting portal for users to set related unlocking features.

[0275] For example, Figures 12(1) to 12(4) show relevant setting interfaces of applications configured to operate on the inner screen. The mobile phone may receive setting instructions input by a user via the setting interface, and the setting instructions are used to configure the pre-configured application. Similarly, the mobile phone may further provide one or more optional setting inputs, such as a duration (i.e., a pre-configured duration) of the operation performed through the inner screen, a location (i.e., a pre-configured geographic location range) of the operation performed through the inner screen, and an unlocking instruction (i.e., a pre-configured unlocking instruction) used to unlock the inner screen.

[0276] In the above, for the purpose of explanation, the example in which the first collection component is a camera on the inner screen and the second collection component is a camera on the outer screen is mainly used. In this case, the first collection component may be different from the second collection component. In some other embodiments, the first collection component and the second collection component may alternatively be the same part. For example, the electronic device is still a flip screen mobile phone, and the first collection component and the second collection component may be the same fingerprint collection component. The fingerprint collection component may be configured to collect the user's fingerprint information and may be further configured to unlock the inner screen or the outer screen.

[0277] Some other embodiments of the present application provide an apparatus. The apparatus may be the aforementioned electronic device (e.g., a flip screen mobile phone). The apparatus may include a display, a memory, and one or more processors. The display and the memory are coupled to the processor. The memory is configured to store computer program code. The computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device can perform the functions or steps performed by the mobile phone in the aforementioned method embodiments. For the structure of the electronic device, please refer to the electronic device shown in FIG. 2.

[0278] The core structure of the electronic device can be represented as the structure shown in Figure 13. The core structure can include a processing module 1301, an input module 1302, a storage module 1303, and a display module 1304.

[0279] The processing module 1301 may include at least one of a central processing unit (CPU), an application processor (AP), or a communication processor (CP). The processing module 1301 may perform operations or data processing related to control and / or communication of at least one of other components of the user electronic device. Specifically, the processing module 1301 may be configured to control the content displayed on the main screen based on a certain trigger condition, or determine the content displayed on the screen based on a pre-set rule. The processing module 1301 is further configured to process input instructions or data and determine a display style based on the processed data. The processing module 1301 further includes a rendering engine for rendering interface elements UI, etc.

[0280] The input module 1302 is configured to acquire instructions or data input by a user and transmit the acquired instructions or data to another module of the electronic device. In particular, the input mode of the input module 1302 may include touch, gesture, proximity to a screen, etc., or may be voice input. For example, the input module may be a screen of the electronic device, acquire a user's input operation, generate an input signal based on the acquired input operation, and transmit the input signal to the processing module 1301. In this embodiment of the present application, the input module may be configured to receive an unlocking command input by a user and / or perform another step.

[0281] The storage module 1303 may include a volatile memory and / or a non-volatile memory. The storage module is configured to store instructions or data related to at least one of the other modules of the user terminal device. In particular, the storage module can record the position of the interface where the terminal interface element UI is located.

[0282] The display module 1304 may include, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a microelectromechanical system (MEMS) display, or an electronic paper display. The display module 1304 is configured to display content (e.g., text, images, videos, icons, symbols, etc.) that can be viewed by a user. In this embodiment of the application, the display module may be implemented as a display screen, for example, a first screen and / or a second screen.

[0283] Optionally, the structure shown in FIG. 13 may further include a communication module 1305 configured to support the electronic device to communicate with another electronic device. For example, the communication module may be connected to a network via wireless or wired communication to communicate with other personal terminals or network servers. The wireless communication may use at least one of cellular communication protocols such as Long Term Evolution (LTE), Long Term Evolution Advanced (LTE-A), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Universal Mobile Telecommunications System (UMTS), Wireless Broadband (WiBro), or Global System for Mobile Communications (GSM). The wireless communication may include, for example, short-range communication. The short-range communication may include at least one of Wireless Fidelity (Wi-Fi), Bluetooth, Near Field Communication (NFC), Magnetic Stripe Transmission (MST), or GNSS.

[0284] An embodiment of the present application further provides a chip system. As shown in FIG. 14, the chip system includes at least one processor 1401 and at least one interface circuit 1402. The processor 1401 and the interface circuit 1402 may be connected via a line. For example, the interface circuit 1402 may be configured to receive a signal from another device (e.g., a memory of an electronic device). As another example, the interface circuit 1402 may be configured to transmit a signal to another device (e.g., the processor 1401). For example, the interface circuit 1402 may read an instruction stored in a memory and transmit the instruction to the processor 1401. When the instruction is executed by the processor 1401, the electronic device is enabled to perform the steps in the aforementioned embodiment. Certainly, the chip system may further include another discrete device. This is not particularly limited in this embodiment of the present application.

[0285] An embodiment of the present application further provides a computer storage medium, which includes computer instructions, which when executed on the aforementioned electronic device, enable the electronic device to perform the functions or steps performed by the mobile phone in the aforementioned method embodiments.

[0286] An embodiment of the present application further provides a computer program product, which, when executed on a computer, enables the computer to perform the functions or steps performed by the mobile phone in the aforementioned method embodiments.

[0287] The above description of the implementation form allows those skilled in the art to clearly understand that the above division of functional modules is used as an example for explanation, for convenient and concise description. During actual application, the above functions can be allocated to different functional modules and implemented based on requirements, that is, the internal structure of the device is divided into different functional modules to implement all or part of the above-described functions.

[0288] In the embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-mentioned apparatus embodiments are merely examples. For example, the division of modules or units is merely a logical division of functions. There may be other division ways during actual implementation. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not implemented. In addition, the shown or discussed mutual couplings or direct couplings or communication connections may be implemented through some interfaces. Indirect couplings or communication connections between apparatuses or units may be implemented in electrical, mechanical, or other forms.

[0289] The units described as separate parts may or may not be physically separate, and the parts shown as units may be one or more physical units, located in one place or distributed in different places. Some or all of the units may be selected according to actual requirements to achieve the objectives of the solutions in the embodiments.

[0290] In addition, the functional units in the embodiments of the present application may be integrated into one processing unit, and each of the units may exist physically alone, or two or more units may be integrated into one unit. The integrated unit may be implemented in the form of hardware or in the form of a software functional unit.

[0291] When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, the integrated unit may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application essentially, or the part contributing to the prior art, or all or part of the technical solutions may be implemented in the form of a software product. The software product is stored in a storage medium and includes a plurality of instructions for instructing a device (which may be a single-chip microcomputer, chip, etc.) or a processor to perform all or part of the steps of the method described in the embodiments of the present application. The aforementioned storage medium includes any medium that can store program code, such as a USB flash drive, a removable hard disk, a read only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0292] The above contents are only specific implementation forms of the present application, and are not intended to limit the protection scope of the present application. Any variations or replacements within the technical scope disclosed in this application shall be included within the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims. [Explanation of symbols]

[0293] 1 Antenna 2 Antennas 100 Electronic Devices 110 Processor 120 External Memory Interface 121 Internal Memory 130 Universal Serial Bus port 140 Charging Management Module 141 Power Management Module 142 Battery 150 Mobile communication module 160 Wireless Communication Module 170 Audio Module 170A Speaker 170B Receiver 170C Microphone 170D Headset Jack 180 Sensor Module 190 Button 191 Motor 192 Indicator 193 Camera 1931 Camera 1932 Camera 194 Display 195 Subscriber Identity Module Card Interface 180A PRESSURE SENSOR 180B Gyroscope Sensor 180C Barometric Pressure Sensor 180D Magnetic Sensor 180E Acceleration Sensor 180F Distance Sensor 180G Optical Proximity Sensor 180H Fingerprint Sensor 180J Temperature Sensor 180K touch sensor 180L Ambient Light Sensor 180M Bone Conduction Sensor 30 Foldable Line 31 Folding Line 32 Sub Screen 33 Sub Screen 34 Sub Screen 40 Foldable Line 41 Sub Screen 42 Sub Screen 43 Folding shaft 44 Sub Screen 45 Sub Screen 61 Sub Screen 62 Sub Screen 1 Gyroscope Sensor 2 Gyroscope Sensor 1 screen 2 screens 401 Message Reminder Interface 402 Control 403 Prompt Interface 404 Interface 405 Interface 406 Control 407 Interface 1. Gallery Control 1301 Processing Module 1302 Input Module 1303 Memory Module 1304 Display module 1305 Communication Module 1401 Processor 1402 Interface circuit

Claims

1. 1. An unlocking method, the method being applied to an electronic device, the electronic device comprising a first screen and a second screen formed in a screen folding state, the first screen being an inner screen and the second screen being an outer screen, the first screen having an associated first collection component and the second screen having an associated second collection component, the method comprising: obtaining an unlocking intent; in response to the unlock intent, invoking the second collection component to collect user identity information, and identifying the user identity based on the identity information collected by the second collection component; if the identity of the user cannot be identified based on the identity information collected by the second collection component, invoking the first collection component to collect identity information of the user and identifying the identity of the user based on the identity information collected by the first collection component; and unlocking the first screen if the identity of the user is valid and the electronic device meets a condition for using the first screen.

2. 2. The method of claim 1, wherein after the identity of the user is determined to be valid and before the step of unlocking the first screen, the method further comprises the step of unlocking the second screen and displaying a first interface on the second screen.

3. 3. The method of claim 2, wherein after the step of unlocking the first screen, the method further comprises the step of displaying a second interface on the first screen, the second interface being associated with the first interface.

4. 2. The method of claim 1, wherein the step of identifying the identity of the user based on the identity information collected by the first collection component includes a step of identifying the identity of the user based on the identity information collected by the second collection component and the identity information collected by the first collection component.

5. 2. The method of claim 1, wherein the step of invoking the first collection component to collect identity information of the user when the identity of the user cannot be identified based on the identity information collected by the second collection component comprises the step of invoking the first collection component to collect identity information of the user when the identity of the user cannot be identified based on the identity information collected by the second collection component when it is detected that a deployment angle of the electronic device has reached a preset angle.

6. Prior to the step of unlocking the first screen, the method further comprises:

10. The method of claim 1, further comprising the step of displaying a third interface or playing an audio prompt, wherein the third interface is used to prompt the user to unpack the electronic device, and the audio prompt is used to prompt the user to unpack the electronic device.

7. Prior to the step of obtaining an unlock intent, the method further comprises:

2. The method of claim 1, further comprising: receiving configuration instructions input by the user, the configuration instructions being used to set any one or more of a pre-configured application, a pre-configured time period, a pre-configured geographic location range, and a pre-configured unlocking instruction.

8. The step of obtaining an unlocking intent includes receiving an unlocking command input by the user; In response to the unlock intent, the step of invoking the second collection component to collect user identity information comprises: The method of claim 1 , further comprising the step of invoking the second collection component to collect the identity of the user in response to the unlock command.

9. The method of claim 1 , wherein the first collection component and the second collection component are the same or different.

10. 8. The method of claim 7, wherein the conditions for using the first screen include one or more combinations of: a current time is within the preset time period; a current location is within the preset geographic location range; a new message is received and the new message is a message of the preset application; the electronic device is in an unfolded state; and the unlock command input by the user is the preset unlock command.

11. 11. The method of claim 10, wherein the pre-configured unlock command comprises any one or more combinations of a gesture, a pattern, a number, a fingerprint, and a voice pre-configured to unlock the first screen.

12. 2. The method of claim 1, wherein the first collection component includes any one or more of a fingerprint collection component, a voiceprint collection component, and an image capture component, and the second collection component includes any one or more of a fingerprint collection component, a voiceprint collection component, and an image capture component.

13. An electronic device comprising: a processor; and a first screen and a second screen formed in a screen folding state, the first screen being an inner screen and the second screen being an outer screen, the first screen having an associated first collection component and the second screen having an associated second collection component; The processor, Get the unlock intent, In response to the unlock intent, invoke the second collection component to collect user identity information, and identify the user identity based on the identity information collected by the second collection component; if the identity of the user cannot be identified based on the identity information collected by the second collection component, then invoking the first collection component to collect identity information of the user and identifying the identity of the user based on the identity information collected by the first collection component; unlocking the first screen if the identity of the user is valid and the electronic device meets a condition for using the first screen.

1. An electronic device configured to:

14. The processor is further configured to unlock the second screen; The electronic device of claim 13 , wherein the second screen is configured to display a first interface.

15. 15. The electronic device of claim 14, wherein the first screen is configured to display a second interface associated with the first interface after the first screen is unlocked.

16. The electronic device of claim 13, wherein identifying the identity of the user based on the identity information collected by the first collection component includes identifying the identity of the user based on the identity information collected by the second collection component and the identity information collected by the first collection component.

17. The electronic device of claim 13, wherein invoking the first collection component to collect identity information of the user when the identity of the user cannot be identified based on the identity information collected by the second collection component comprises invoking the first collection component to collect identity information of the user when the identity of the user cannot be identified based on the identity information collected by the second collection component when it is detected that the deployment angle of the electronic device has reached a preset angle.

18. 14. The electronic device of claim 13, wherein the second screen is further configured to display a third interface or play an audio prompt before unlocking the first screen, the third interface being used to prompt the user to unpack the electronic device, and the audio prompt being used to prompt the user to unpack the electronic device.

19. 14. The electronic device of claim 13, wherein the processor is further configured to receive configuration instructions input by the user, the configuration instructions being used to configure any one or more of a pre-configured application, a pre-configured time period, a pre-configured geographic location range, and a pre-configured unlocking instruction.

20. Obtaining an unlocking intent includes receiving an unlocking command input by the user; 14. The electronic device of claim 13, wherein invoking the second collection component to collect user identity information in response to the unlock intent comprises invoking the second collection component to collect the user identity information in response to the unlock command.

21. The electronic device of claim 13 , wherein the first collection component and the second collection component are the same or different.

22. 20. The electronic device of claim 19, wherein the conditions for using the first screen include one or more combinations of: a current time being within the preset time period; a current location being within the preset geographic location range; a new message being received and the new message being a message of the preset application; the electronic device being in an unfolded state; and the unlock command entered by the user being the preset unlock command.

23. 23. The electronic device of claim 22, wherein the preset unlock command comprises any one or more combinations of a gesture, a pattern, a number, a fingerprint, and a voice preset to unlock the first screen.

24. 14. The electronic device of claim 13, wherein the first collection component includes any one or more of a fingerprint collection component, a voiceprint collection component, and an image capture component, and the second collection component includes any one or more of a fingerprint collection component, a voiceprint collection component, and an image capture component.

25. 11. An electronic device comprising a processor and a memory, the memory coupled to the processor, the memory configured to store computer program code, the computer program code including computer instructions, and wherein when the processor reads the computer instructions from the memory, the electronic device is enabled to perform the unlocking method of claim 1.

26. 13. A computer-readable storage medium having instructions stored therein that, when executed on an electronic device, enable the electronic device to perform the unlocking method of claim 1.

27. A computer program comprising instructions, when said computer program is executed on an electronic device, said electronic device being enabled to perform the unlocking method according to claim 1.

Images