Display control method and related device

Abstract

The invention discloses a display control method and a related device, and when a folding screen of electronic equipment is in an unfolded state, the electronic equipment can display a first interface of a first application and a second interface of a second application on the folding screen in a split-screen manner. When the folding screen of the electronic equipment is switched from the unfolded state to the semi-folded state, the folding screen is folded to form the first screen and the second screen, and at the moment, if the face of a specified user is not recognized through a camera, the electronic equipment can display a first interface on the first screen and display a screen locking interface or a screen turn-off interface on the second screen. After the second screen displays the screen locking interface or the screen is turned off, the electronic equipment can display the first interface on the first screen and display the second interface on the second screen after the face of the specified user is recognized. Thus, if the face of the specified user is not recognized through the camera when the folding screen is switched from the unfolded state to the semi-folded state, an interface can be displayed on the first screen, and the second screen is locked, so that privacy leakage is avoided.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a display control method and related devices. Background Art

[0002] With the continuous development of electronic devices, more and more electronic devices with display screens are used in people's daily life and work, such as mobile phones with display screens. And with the development of screen technology, the display screens of electronic devices are becoming larger and larger to provide users with richer information and bring users a better user experience.

[0003] If the display screen of an electronic device is too large, it will seriously affect its portability. Therefore, electronic devices equipped with folding screens (such as folding screen mobile phones) proposed in recent years are the direction of future electronic device development. However, after the electronic device is folded at a certain angle, the folding screen of the electronic device is also divided into different display areas. At present, the display area of ​​the folding screen on the electronic device cannot be fully utilized, and the display effect is not good. Summary of the invention

[0004] The present application provides a display control method and related devices, which realize that when an electronic device displays two interfaces in a split screen, if the face of a designated user is not recognized by the camera when the folding screen is switched from an unfolded state to a semi-folded state, one interface can be displayed on the first screen and the second screen can be locked, thereby avoiding privacy leakage.

[0005] In a first aspect, the present application provides a display control method, which is applied to an electronic device including a folding screen, which can be folded to form at least two screens, and the at least two screens include a first screen and a second screen; the method includes: when the folding screen is in an unfolded form, displaying a first interface in a first display area of ​​the folding screen, and displaying a second interface in a second display area of ​​the folding screen, wherein the first display area and the second display area are different; when the folding screen is transformed from the unfolded form to a semi-folded form and the face of a designated user is not recognized by the camera, the first interface is displayed on the first screen, and a lock screen interface is displayed on the second screen; when the folding screen is in the semi-folded form and the face of a designated user is recognized by the camera, the first interface is displayed on the first screen, and the second interface is displayed on the second screen.

[0006] Through a display control method provided by the present application, when the folding screen of an electronic device is in an unfolded form, the electronic device can display the first interface of a first application and the second interface of a second application on the folding screen split screen. When the folding screen of the electronic device switches from the unfolded form to the semi-folded form, the folding screen is folded to form a first screen and a second screen. At this time, if the face of a designated user is not recognized by the camera, the electronic device can display the first interface on the first screen and display the lock screen interface or turn off the screen on the second screen. After the lock screen interface is displayed on the second screen or the screen is turned off, when the face of the designated user is recognized, the electronic device can display the first interface on the first screen and display the second interface on the second screen. In this way, when the electronic device displays two interfaces in a split screen, if the folding screen switches from the unfolded form to the semi-folded form, one interface can be displayed on the first screen and the second screen can be locked, thereby avoiding privacy leakage.

[0007] In a possible implementation, the method further includes: if the folding screen is in the semi-folded state and the face of the designated user is not recognized by the camera for a first period of time after the second screen displays the lock screen interface, turning off the second screen. In this way, the power consumption of the electronic device can be saved.

[0008] In a possible implementation, when the folding screen is transformed from the unfolded form to the semi-folded form and the face of the designated user is not recognized by the camera, the first interface is displayed on the first screen and the lock screen interface is displayed on the second screen, specifically including: when the folding screen is transformed from the unfolded form to the semi-folded form and the face of the designated user is not recognized by the camera, the first interface is displayed on the first screen and the second screen is turned off; after the second screen is turned off, if the first message of the application to which the second interface belongs is obtained, the lock screen interface is displayed on the second screen, and the first notification prompt is displayed on the lock screen interface, and the first notification prompt is used to prompt the user that the electronic device has received the first message of the application to which the second interface belongs. In this way, when the folding screen is in the semi-folded form, if the electronic device obtains a new message, the electronic device can display a prompt message of the new message on the second screen, thereby reducing the obstruction of the content displayed on the first screen.

[0009] In a possible implementation, the method further includes: if the lock screen interface is displayed on the second screen, and after the first notification prompt is displayed on the lock screen interface, the face of the designated user is recognized by the camera, and a third interface is displayed on the second screen, and the third interface includes at least a part of the content of the first message. In this way, when the user's face recognition is passed, the third interface including the new message can be directly displayed on the second screen, so that the user can quickly see the new message.

[0010] In a possible implementation, the method further includes: after the second screen is turned off, if the camera detects that the user's gaze is on the second screen, turning on the second screen and displaying the lock screen interface or the second interface on the second screen. In this way, the content that the user wants to see can be displayed on the second screen in a timely manner according to the user's gaze.

[0011] In a possible implementation, after the first screen displays the first interface and the second screen displays the second interface, the method further includes: recognizing a first air gesture of the user through the camera; and in response to the first air gesture, displaying the second interface on the first screen and the first interface on the second screen. In this way, the content displayed on the first screen and the second screen is adjusted according to the air gesture of the user.

[0012] In a possible implementation, after the second interface is displayed on the first screen and the first interface is displayed on the second screen, the method further includes: recognizing a second air gesture of the user through the camera; and in response to the second air gesture, performing a target operation corresponding to the second air gesture on the second interface displayed on the first screen. In this way, the content displayed on the first screen can be controlled through the user's air gesture.

[0013] In a possible implementation, the target operation includes any one of the following: screenshot, swiping up a page, swiping down a page, and clicking.

[0014] In a possible implementation, when the folding screen is in the semi-folded state and the face of the designated user is recognized by the camera, the first interface is displayed on the first screen, and the second interface is displayed on the second screen, specifically including: when the folding screen is in the semi-folded state and the face of the designated user is recognized by the camera, the first interface is displayed on the first screen, the second interface is displayed in the third display area of ​​the second screen, and the time information is displayed in the fourth display area of ​​the second screen, and the first display area and the fourth display area, and the third display area and the fourth display area do not overlap. In this way, the user can be prevented from being overly immersed in watching the content displayed on the first screen.

[0015] In a possible implementation, when the folding screen is transformed from the unfolded form to the semi-folded form and the face of the designated user is not recognized by the camera, the first interface is displayed on the first screen, and the lock screen interface is displayed on the second screen, specifically including: after the air gesture function is turned on, when the folding screen is transformed from the unfolded form to the semi-folded form and the face of the designated user is not recognized by the camera, the first interface is displayed on the first screen, and the lock screen interface is displayed on the second screen. In this way, after the air gesture function is turned on, the first interface can be displayed on the first screen, and the lock screen interface can be displayed on the second screen when the folding screen is transformed from the unfolded form to the semi-folded form and the face of the designated user is not recognized by the camera, thereby realizing privacy protection of the content displayed on the second screen.

[0016] In a possible implementation, the method also includes: after the air gesture function is not turned on, when the folding screen is transformed from the unfolded state to the semi-folded state, the first interface is displayed on the first screen, and the second interface is displayed on the second screen.

[0017] In one possible implementation, when the time for which the angle between the first screen and the second screen remains between the first angle threshold and the second angle threshold is greater than the first time threshold, the electronic device detects that the folding screen is transformed into a semi-folded state.

[0018] In a second aspect, the present application provides an electronic device, including a folding screen, one or more cameras, one or more processors, and one or more memories. The folding screen can be folded to form at least two screens, and the at least two screens include a first screen and a second screen. The folding screen, one or more cameras, one or more memories are coupled to one or more processors. The one or more memories are used to store a computer program, and when one or more processors execute the computer program, the electronic device executes the method in any possible implementation of any of the above aspects.

[0019] In a third aspect, the present application provides a computer storage medium, including a computer program, which, when executed on a processor on an electronic device, enables the electronic device to execute a method in any possible implementation of any of the above aspects.

[0020] In a fourth aspect, the present application provides a chip comprising a processing circuit and an interface circuit, the interface circuit being used to receive code instructions and transmit them to the processing circuit, the processing circuit being used to run the code instructions so that the chip executes a method in any possible implementation of any of the above aspects.

[0021] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when executed on a computer, enables the computer to execute a method in any possible implementation of any of the above aspects.

[0022] The beneficial effects of the second to fifth aspects can refer to the beneficial effects of the first aspect and any possible implementation method of the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 A schematic diagram of a product form of an electronic device provided in an embodiment of the present application;

[0024] Figure 2 A schematic diagram of a product form of another electronic device provided in an embodiment of the present application;

[0025] Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0026] Figure 4 A schematic diagram of the principle of calculating the angle α between screen A and screen B provided in an embodiment of the present application;

[0027] Figure 5 A schematic diagram of an example of a geographical marking system provided in an embodiment of the present application;

[0028] Figure 6 A schematic diagram of a principle for calculating an angle β1 between a plane where screen A is located and a horizontal plane and an angle β2 between a plane where screen B is located and a horizontal plane provided in an embodiment of the present application;

[0029] Figure 7 A schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application;

[0030] Figure 8 A usage scenario of an electronic device in a semi-folded state provided in an embodiment of the present application;

[0031] Figure 9A-9D A schematic diagram of a set of air gesture activation processes provided in an embodiment of the present application;

[0032] Figure 10A-10E A first group of interface schematic diagrams of the display control method provided in an embodiment of the present application;

[0033] Figures 11A-11C A second group of interface schematic diagrams of the display control method provided in an embodiment of the present application;

[0034] Figure 12A-12C A third group of interface schematic diagrams of the display control method provided in an embodiment of the present application;

[0035] Figure 13A-13C A fourth group of interface schematic diagrams of the display control method provided in an embodiment of the present application;

[0036] Figure 14A-14BA fifth group of interface schematic diagrams of the display control method provided in the embodiment of the present application;

[0037] Figure 15A-15E This is the fifth group of interface schematic diagrams of the display control method provided in the embodiment of the present application. DETAILED DESCRIPTION

[0038] The technical solutions in the embodiments of the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0039] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0040] The present application provides a display control method. In some embodiments, the method can be applied to an electronic device 100 having a folding screen. The folding screen can be folded to form at least two screens. For example, the folding screen can be folded along a folding edge or a folding axis to form a first screen and a second screen.

[0041] Among them, the folding methods of the folding screen on the electronic device 100 can be divided into two categories. One is a folding screen that folds outward (referred to as the outward folding screen), and the other is a folding screen that folds inward (referred to as the inward folding screen). Among them, take the folding screen that can be folded to form a first screen and a second screen as an example. After the outward folding screen is folded, the display direction of the first screen and the display direction of the second screen are opposite to each other. After the inward folding screen is folded, the display direction of the first screen and the display direction of the second screen are opposite. In an embodiment of the present application, the first screen can be called screen A and the second screen can be called screen B.

[0042] In the embodiment of the present application, the electronic device 100 adopts an inward-folding screen, that is, when the folding screen is in a fully folded state, the display direction of the first screen is opposite to the display direction of the second screen.

[0043] For example, see Figure 1 , which shows a schematic diagram of a product form of an electronic device 100 with an inward folding screen provided in an embodiment of the present application. Figure 1(a) is a schematic diagram of the inward folding screen when it is fully unfolded. The inward folding screen can be folded along the folding edge according to Figure 1 Folding 11a and 11b in the direction shown in (a) can form Figure 1 The semi-folded A screen and B screen are shown in (b) of FIG. When the folding screen is folded into the A screen and the B screen, the A screen can be on the same side as the front camera of the electronic device 100. The inward folding screen can be folded along the folding edge according to Figure 1 The A screen and the B screen shown in (b) of FIG. The inward folding screen can be folded along the folding edge according to Figure 1 Continuing to fold the directions 12a and 12b shown in (b) above, a Figure 1 The fully folded outward folding screen shown in (c) is shown in FIG. Figure 1 As shown in (c) in FIG. 1 , after the folding screen of the electronic device 100 is completely folded, screen A and screen B are opposite to each other and are invisible to the user.

[0044] It should be noted that a display screen may be provided on the back of the first screen or the second screen of the inward-folding screen provided in the embodiment of the present application, which may be referred to as a third screen.

[0045] Above Figure 1 In the embodiment of the present application, the folding screen of the electronic device 100 is folded horizontally, that is, it is folded into two left and right screens (i.e., screen A and screen B) according to the longitudinal folding edge on the folding screen. In the embodiment of the present application, the folding screen of the electronic device 100 can also be folded vertically, that is, it is folded into two upper and lower screens (i.e., screen A and screen B) according to the transverse folding edge on the folding screen. For example, Figure 2 The folding screen shown in (a) is folded in sequence along the folding edge in the horizontal direction of the folding screen to form Figure 2 (b) in Figure 2 (c) / Figure 2 As shown in (d) in .

[0046] In some embodiments of the present application, the electronic device 100 may be provided with a display screen on the back of the first screen or the second screen, which may be referred to as a third screen. Figure 2 As shown in (d) in the figure, a C screen (third screen) may be provided on the back of the A screen (first screen), and the C screen may be on the same side as the rear camera on the electronic device 100.

[0047] In some embodiments, the folding screen of the electronic device 100 may surround the electronic device 100, and the above-mentioned A screen (first screen), B screen (second screen), and C screen (third screen) may all be part of the folding screen. When the folding screen is folded, the A screen may be opposite to the C screen, and the A screen may be adjacent to the B screen.

[0048] In the embodiment of the present application, the angle between screen A and screen B of the folding screen of the electronic device 100 ranges from [0°, 180°]. Wherein, if α∈[0°, P1], the electronic device 100 can determine that the folding screen is in a fully folded state; if α∈(P1, P2), the electronic device 100 can determine that the folding screen is in a semi-folded state; α∈[P2, 180°], the electronic device 100 can determine that the folding screen is in a fully unfolded state. Wherein, 0°<P1<P2<180°. P1 and P2 can be preset angle thresholds. P1 and P2 can be determined based on the usage habits of a large number of users using folding screens; or, P1 and P2 can be set by the user in the electronic device 100.

[0049] In some embodiments, according to the usage habits of most users, when the angle α between screen A and screen B is greater than 100°, the user is more likely to want to use screen A and screen B as a whole (i.e., as a complete display screen). When the angle α between screen A and screen B is less than 80 degrees, the user is more likely to want to use screen A or screen B alone, and the folding screen can be in a fully folded state. When the angle α between screen A and screen B is between 80° and 100°, the user is more likely to want to use screen A and screen B to display different display contents, and the folding screen can be in a semi-folded state.

[0050] Therefore, in the embodiment of the present application, the value range of the preset angle threshold P1 may be (0, 80°], and the value range of the preset angle threshold P2 may be [100°, 180°]. For example, the preset angle threshold P1 may be 75°, and the preset angle threshold P2 may be 105°. The above examples are only used to explain the present application and should not be construed as limiting.

[0051] It should be noted that the at least two screens formed after the folding screen in the embodiment of the present application is folded can be multiple independent screens, or can be a complete screen with an integrated structure, which is just folded into at least two parts.

[0052] For example, the folding screen may be a flexible folding screen, and the flexible folding screen includes a folding edge made of a flexible material. Part or all of the flexible folding screen is made of a flexible material. The at least two screens formed after the flexible folding screen is folded are a complete screen of an integrated structure, but are folded to form at least two parts.

[0053] For another example, the folding screen may be a multi-screen folding screen. The multi-screen folding screen may include multiple (two or more) screens. The multiple screens are multiple separate display screens. The multiple screens may be connected in sequence through folding axes. Each screen may rotate around the folding axis connected thereto to achieve folding of the multi-screen folding screen.

[0054] Among them, in the subsequent embodiments of the present application, the folding screen is a flexible folding screen that can be folded horizontally as an example to illustrate the method provided in the embodiments of the present application.

[0055] Exemplarily, the electronic device 100 in the embodiment of the present application can be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, as well as a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, and the like including the above-mentioned folding screen. The embodiment of the present application does not impose any special restrictions on the specific type of the electronic device 100.

[0056] The electronic device 100 provided in the embodiment of the present application is described below with reference to the accompanying drawings.

[0057] Figure 3 A schematic structural diagram of an electronic device 100 is shown.

[0058] The following is a detailed description of the embodiment using the electronic device 100 as an example. It should be understood that: Figure 3 The electronic device 100 shown is only an example, and the electronic device 100 may have more Figure 3 More or fewer components may be shown, two or more components may be combined, or there may be a different configuration of components. Figure 3 The various components shown in the EMBODIMENTS 2000 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0059] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0060] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0061] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0062] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0063] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0064] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0065] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0066] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0067] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0068] The mobile communication module 150 can provide wireless communication solutions including 2G / 3G / 4G / 5G etc. applied on the electronic device 100 .

[0069] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0070] The wireless communication module 160 can provide wireless communication solutions for application in the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc.

[0071] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0072] The display screen 194 is used to display images, videos, etc. The display screen 194 may include the above-mentioned inner folding screen. In some embodiments, the display screen 194 includes the above-mentioned inner folding screen and the C screen, such as the above-mentioned Figure 2 As shown in (d) in .

[0073] The display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0074] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0075] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise and brightness of the image.

[0076] The camera 193 is used to capture still images or videos. The electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0077] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0078] The electronic device 100 can implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, and an application processor. For example, music playback, recording, etc. The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The speaker 170A, also known as a "speaker", is used to convert audio electrical signals into sound signals. The receiver 170B, also known as a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a call or voice message, the voice can be answered by placing the receiver 170B close to the human ear. The microphone 170C, also known as a "microphone" or "microphone", is used to convert sound signals into electrical signals. The headphone jack 170D is used to connect wired headphones. The pressure sensor 180A is used to sense pressure signals and can convert pressure signals into electrical signals.

[0079] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

[0080] In the embodiment of the present application, the display screen 194 of the electronic device 100 can be folded to form multiple screens. A gyroscope sensor 180B can be provided in the multiple screens to measure the orientation of the corresponding screen (i.e., the orientation vector). The electronic device 100 can determine the angle between adjacent screens (e.g., the angle between screen A and screen B) based on the orientation angle change of each screen measured by the gyroscope sensor 180B.

[0081] It should be noted that, in the embodiment of the present application, the folding screen of the electronic device 100 (such as the display screen 194) can be folded to form multiple screens. Each screen may include a gyroscope sensor (such as the gyroscope sensor 180B) for measuring the orientation of the corresponding screen (i.e., the orientation vector). Figure 1 or Figure 2 , the display screen 194 of the electronic device 100 can be folded to form screen A (i.e., the first screen) and screen B (i.e., the second screen), then the screen A and the screen B both include a gyroscope sensor 180B, which is used to measure the orientation of screen A and screen B respectively. The electronic device 100 can determine the angle between adjacent screens and the angular relationship between each screen and the horizontal plane based on the measured angular change of the orientation of each screen.

[0082] For example, the foldable screen of the electronic device 100 can be folded to form Figure 4 Screen A and screen B are shown. Screen A is provided with a gyro sensor A, and screen B is provided with a gyro sensor B. In the embodiment of the present application, the principle that gyro sensor A measures the orientation of screen A (i.e., the orientation direction vector), gyro sensor B measures the orientation of screen B (i.e., the orientation direction vector), and the principle that electronic device 100 calculates the angle α between screen A and screen B according to the orientation of screen A and the orientation of screen B are explained.

[0083] Among them, the coordinate system of the gyroscope sensor is the geographic coordinate system. Figure 5 As shown, the origin O of the geographic coordinate system is located at the point where the carrier (i.e., the device containing the gyroscope sensor, such as the electronic device 100) is located, the X-axis points to the east (E) along the local latitude, the Y-axis points to the north (N) along the local meridian, and the Z-axis points upward along the local geographic vertical line, and forms a right-handed rectangular coordinate system with the X-axis and the Y-axis. Among them, the plane formed by the X-axis and the Y-axis is the local horizontal plane, and the plane formed by the Y-axis and the Z-axis is the local meridian plane. Therefore, it can be understood that the coordinate system of the gyroscope sensor is: with the gyroscope sensor as the origin O, the X-axis points east along the local latitude, the Y-axis points north along the local meridian, and the Z-axis points upward along the local geographic vertical line (i.e., the direction of the geographic vertical line).

[0084] The electronic device 100 uses the gyro sensor provided in each screen to measure the direction vector of each screen in the coordinate system of the gyro sensor provided in the device. Figure 4 The side view of the electronic device 100 shown in the figure, the electronic device 100 measures the direction vector of the orientation of the A screen in the coordinate system of the gyroscope sensor A as vector The direction vector of the orientation of screen B in the coordinate system of gyro sensor B is vector The electronic device 100 uses the following formula (1) to calculate the vector With vector The angle θ is:

[0085]

[0086] According to Figure 4 It can be seen that due to the vector Perpendicular to screen A, vector is perpendicular to screen B, therefore, the angle between screen A and screen B can be obtained as α=180°-θ. That is, the electronic device 100 can measure the direction vector (i.e., vector θ) of the orientation of screen A in the coordinate system of gyro sensor A according to the measured orientation vector (i.e., vector θ) of screen A in the coordinate system of gyro sensor A. ) and the direction vector of the orientation of the B screen in the coordinate system of the gyroscope sensor B (i.e., vector ), determine the angle α between screen A and screen B.

[0087] It should be noted that although the positions of the gyro sensors set in screen A and screen B do not overlap, that is, the origins of the coordinate systems of the gyro sensors of screen A and screen B do not overlap, the X-axis, Y-axis, and Z-axis of the two coordinate systems are parallel, so it can be considered that the coordinate systems of the gyro sensors set in screen A and screen B are parallel. and vector They are not in the same coordinate system, but because the axes of the two coordinate systems are parallel, the vector can still be calculated using the above formula (1) With vector The angle θ.

[0088] In some embodiments, one or more other sensors may be used to measure the angle α between screen A and screen B. For example, an acceleration sensor may be provided in each screen of the folding screen. The electronic device 100 (such as the processor 110) may use the acceleration sensor to measure the motion acceleration of each screen when it is rotated; and then calculate the rotation angle of one screen relative to the other screen, that is, the angle α between screen A and screen B, based on the measured motion acceleration.

[0089] In other embodiments, the gyroscope sensor may be a virtual gyroscope sensor formed by cooperation with multiple other sensors. The virtual gyroscope sensor may be used to calculate the angle between adjacent screens of the folding screen, that is, the angle α between screen A and screen B.

[0090] In other embodiments, an angle sensor is installed at the folding portion of the folding line of the electronic device 100 (for example, on the hinge), and the electronic device 100 can measure the angle α formed by screen A and screen B by setting the angle sensor at the folding portion of the folding screen.

[0091] In some embodiments of the present application, the electronic device 100 may also measure the angle β1 between the A screen and the horizontal plane, and the angle β2 between the B screen and the horizontal plane through the gyroscope sensor 180B.

[0092] Please refer to Figure 6 (a) in FIG. 1 shows the coordinate system of the gyro sensor of the upper A screen of the electronic device 100. The plane formed by the X-axis and the Y-axis is the local horizontal plane, and the plane formed by the Y-axis and the Z-axis is the local meridian plane. The direction vector of the A screen of the electronic device 100 in the coordinate system of the gyro sensor is the vector vector The angle γ1 with the XOY plane (i.e. the horizontal plane) is in the following relationship: Among them, the A screen of the electronic device 100 and the vector Vertically, the angle β1 and the angle γ1 between the plane where the A screen of the electronic device 100 is located and the XOY plane (ie, the horizontal plane) are complementary, that is, β1+γ1=90°. It can be seen that: the vector The angle β1 between the plane where the screen A of the electronic device 100 is located and the horizontal plane has the following relationship: in,

[0093]

[0094] Please refer to Figure 6 (b) in FIG. 1 shows the coordinate system of the gyro sensor of the upper B screen of the electronic device 100. The plane formed by the X-axis and the Y-axis is the local horizontal plane, and the plane formed by the Y-axis and the Z-axis is the local meridian plane. The direction vector of the B screen of the electronic device 100 in the coordinate system of the gyro sensor is the vector vector The angle γ2 with the XOY plane (i.e. the horizontal plane) has the following relationship: Among them, the B screen of the electronic device 100 and the vector Vertically, the angle β2 and the angle γ2 between the plane where the B screen of the electronic device 100 is located and the XOY plane (ie, the horizontal plane) are complementary, that is, β2+γ2=90°. It can be seen that: the vector The angle β2 between the plane where the B screen of the electronic device 100 is located and the horizontal plane has the following relationship: in,

[0095]

[0096] In summary, the electronic device 100 measures the direction vector of the orientation of the A screen in the coordinate system of the gyro sensor. The angle β1 between the screen A of the electronic device 100 and the horizontal plane can be determined by using the above formula (2). The direction vector of the orientation of the screen B of the electronic device 100 in the gyro sensor coordinate system is obtained by measuring The above formula (3) can be used to determine the angle β2 between the B screen of the electronic device 100 and the horizontal plane.

[0097] The air pressure sensor 180C is used to measure air pressure. The magnetic sensor 180D includes a Hall sensor. The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device, and is applied to applications such as horizontal and vertical screen switching, pedometers, etc. The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The ambient light sensor 180L is used to sense the brightness of the ambient light. The fingerprint sensor 180H is used to collect fingerprints. The temperature sensor 180J is used to detect the temperature. The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be arranged on the surface of the electronic device 100, which is different from the position of the display screen 194. The bone conduction sensor 180M can obtain vibration signals. The button 190 includes a power button, a volume button, etc. The button 190 can be a mechanical button. The motor 191 can generate a vibration prompt. The indicator 192 can be an indicator light, which can be used to indicate the charging status, the change of the power, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card.

[0098] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system of the layered architecture is taken as an example to exemplify the software structure of the electronic device 100.

[0099] Figure 7 It is a software structure block diagram of the electronic device 100 provided in an embodiment of the present application.

[0100] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0101] The application (APP) layer can include a series of application packages. Figure 7 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0102] The application framework layer provides an application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. Figure 7 As shown, the framework layer may include a sensor manager module 707, a posture recognition module 708, a display manager module 709, and a window manager service (WMS) 710. Optionally, it may also include an activity manager service (AMS), a content provider, a view system, a phone manager, a resource manager, a notification manager, etc. (not shown in the drawings).

[0103] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0104] The hardware abstraction layer (HAL) includes a sensor service module (sensor service) 706. The sensor service module 706 can be used to report the processing result of the sensor data processing module 705 in the kernel layer to the sensor management module 707 in the framework layer.

[0105] The kernel layer is a layer between hardware and software. The kernel layer may include a sensor data processing module 705. The sensor data processing module 705 may be used to obtain data reported by one or more sensors in the hardware layer, process the data, and report the processing results to the sensor service module 706.

[0106] The hardware layer may include an acceleration sensor 701, a gyroscope sensor 702, an acceleration sensor 703, a gyroscope sensor 704, and the like. The acceleration sensor 701 and the gyroscope sensor 702 may be arranged in the A screen of the electronic device 100, and the acceleration sensor 703 and the gyroscope sensor 704 may be arranged in the B screen of the electronic device 100. The acceleration sensor 701 may be used to measure the acceleration data of the A screen and report it to the sensor data processing module 705. The acceleration sensor 703 may be used to measure the acceleration data of the B screen and report it to the sensor data processing module 705. The gyroscope sensor 702 may be used to measure the gyroscope data of the A screen and report it to the sensor data processing module 705. The gyroscope sensor 704 may be used to measure the gyroscope data of the B screen and report it to the sensor data processing module 705.

[0107] When the user performs an input operation on the electronic device 100 (such as the operation of the folding screen), the acceleration sensor 701, the gyroscope sensor 702, the acceleration sensor 703 and the gyroscope sensor 704 in the hardware layer can report the sensor data measured by each sensor to the sensor data processing module 705 in the kernel layer. The sensor data processing module 705 can calculate the direction vector of the A screen according to the sensor data reported by the multiple sensors in the hardware layer. B screen direction vector The angle α between screen A and screen B. Then, the sensor data processing module 705 can use the sensor service module 706 in the hardware abstraction layer to convert the direction vector of screen A to B screen direction vector The angle α between screen A and screen B is reported to the sensor management module 707 in the framework layer. The sensor management module 707 can be used to convert the vector vector The angle α between the vector vector and angle α, identify the posture type of the folding screen of the electronic device 100. And send the posture type to the display management module 709. The display management module 709 can set the full-screen display of the folding screen or the A screen display or the B screen display, etc. according to the posture type. The display management module 709 can notify the window management module 710 to create a window and update the window properties (such as size, position). The window management module 710 can refresh the window system, redraw the window, and notify the upper-level application to adjust the properties of the display elements in the window (such as size, position). Exemplarily, when the folding screen of the electronic device 100 is in a semi-folded state (the angle α between the A screen and the B screen is between 80 degrees and 100 degrees), the electronic device 100 can display the display interface of the foreground application that starts the camera on the A screen or the B screen.

[0108] Figure 8 A usage scenario of an electronic device provided in an embodiment of the present application when in a semi-folded form is shown.

[0109] like Figure 8 As shown, when the user needs to stay away from the electronic device 100 and it is inconvenient to hold the electronic device 100, but wants to watch the content displayed on the electronic device 100, the user can switch the folding screen of the electronic device 100 to a semi-folded state and place it on a flat surface such as a desktop. Among them, the B screen of the folding screen can be parallel to the plane where the desktop is located, and the A screen can remain upright on the desktop. Among them, the screen orientation of the A screen can be consistent with the orientation of the camera 801. In this way, when it is inconvenient for the user to hold the electronic device 100, the user can also watch the display content on the electronic device 100 from a distance.

[0110] However, when the user is watching the content displayed on the electronic device 100 from a distance, the user also needs to control the electronic device 100. For example, the user can watch a short video displayed on screen A of the electronic device 100 from a distance, and after watching a short video, the user needs to control the electronic device 100 to switch to display the next short video on screen A.

[0111] Therefore, when the folding screen of the electronic device 100 is in a semi-folded state, the electronic device 100 can use the air gesture function. In this way, the electronic device 100 can capture the user's gesture action through the camera 801 at a distance, and perform the operation corresponding to the gesture action (for example, turning pages up and down or sliding long pages, taking screenshots, pressing, etc.) based on the user's gesture action.

[0112] Figure 9A-9D A schematic diagram of the activation process of the air gesture provided in an embodiment of the present application is shown.

[0113] like Fig.9A As shown, the electronic device 100 can display a desktop 910. The desktop 910 displays a page with application icons, which includes multiple application icons (for example, a weather application icon, a stock application icon, a calculator application icon, a settings application icon 911, a mail application icon, a gallery application icon, a music application icon, a video application icon, a browser application icon, etc.).

[0114] The electronic device 100 may receive a user input for setting an application icon 911 in the desktop 910, and in response to the input, the electronic device 100 may display the following Fig. 9B The settings application interface 920 is shown.

[0115] like Fig. 9BAs shown, the setting application interface 920 may include one or more setting items. Among them, the one or more setting items include wireless and network setting items, device connection setting items, application and notification setting items, battery setting items, display setting items, sound setting items, storage setting items, biometrics and password items, auxiliary function setting items 921, system setting items, etc.

[0116] The electronic device 100 may receive a user input for the auxiliary function setting item 921, and in response to the input, the electronic device 100 may display the following Fig. 9C An accessibility setting interface 930 is shown.

[0117] like Fig. 9C As shown, the auxiliary function setting interface 930 may include smart perception setting entries 931 and other setting entries (for example, accessibility setting entries, travel assistant setting entries, one-handed mode setting entries, quick launch and gesture setting entries, smart multi-window setting entries, leather case operation setting entries, anti-mistouch mode setting entries, timed power on and off setting entries, etc.).

[0118] The electronic device 100 may receive a user input for the smart perception setting item 931, and in response to the input, the electronic device 100 may display the following Fig.9D The smart perception setting interface 940 is shown.

[0119] like Fig.9D As shown, the smart perception setting interface 940 may include relevant setting entries for air gestures (e.g., air sliding screen setting entry 943, air screenshot setting entry 944, air press setting entry 945, etc.) and other setting entries (e.g., staring at the screen without turning off the screen 941, staring at the screen to reduce the volume of incoming calls 942, smart payment, etc.). Among them, the relevant setting entries for air gestures can be used to trigger the electronic device 100 to turn on or off the air gesture function. For example, the air sliding screen setting entry 943 can be used to trigger the air sliding screen function to be turned on or off. The air screenshot setting entry 944 can be used to trigger the air screenshot function to be turned on or off. The air press setting entry 945 can be used to trigger the air press function to be turned on or off.

[0120] A display control method provided in an embodiment of the present application is introduced below in conjunction with an application scenario.

[0121] In some application scenarios, when the folding screen of the electronic device 100 is in the unfolded form, the electronic device 100 can display the first interface of the first application and the second interface of the second application on the folding screen. For example, the first interface is displayed in the first display area of ​​the folding screen, and the second interface is displayed in the second display area of ​​the folding screen, and the first display area and the second display area are different. When the folding screen of the electronic device 100 switches from the unfolded form to the semi-folded form and the face of the designated user is not recognized by the camera, the folding screen is folded to form screen A and screen B. At this time, the electronic device 100 can display the first interface on screen A and display the lock screen interface or turn off the screen on screen B. After the lock screen interface is displayed on screen B or the screen is turned off, if the electronic device 100 recognizes the face of the designated user through the camera, the electronic device 100 can display the first interface on screen A and display the second interface on screen B.

[0122] In this way, when the folding screen of the electronic device 100 is in a semi-folded state, the user is unlikely to hold the electronic device 100, but will place the electronic device 100 at a distance for viewing. Since screen A directly faces the user, the user wants to view the content displayed on screen A at a distance, while screen B does not directly face the user, and the user does not view screen B frequently. However, the content displayed on screen B is seen by others, which can easily lead to the leakage of the user's privacy. Therefore, when the electronic device 100 displays two interfaces in split screen, if the folding screen is switched from the unfolded state to the semi-folded state, one interface can be displayed on screen A, and screen B can be locked to avoid privacy leakage.

[0123] For example, Fig. 10A As shown, when the folding screen of the electronic device 100 is in the unfolded state, the electronic device 100 can display the short video application interface 1010 and the chat application interface 1020 in the upper and lower split screens of the folding screen. Among them, the short video application interface 1010 may include a video screen 1016 and one or more functional controls. Among them, the one or more functional controls may include a video publisher avatar control 1011, a like control 1012, a comment control 1013, a collection control 1014 and a sharing control 1015. The chat application interface 1020 may include a contact page, and the contact page may include one or more contact entries.

[0124] like Fig. 10B As shown, when the folding screen of the electronic device 100 is switched from the unfolded state to the semi-folded state and the electronic device 100 does not recognize the face of the designated user, the electronic device 100 can display the short video application interface 1010 on the A screen and display the lock screen interface 1030 on the B screen. The lock screen interface 1030 may include a lock screen logo 1031 and time information 1032.

[0125] like Fig. 10CAs shown, when the electronic device 100 is in a semi-folded state and no unlocking operation by the user is detected for a certain period of time, the electronic device 100 can turn off screen B.

[0126] like Fig. 10D As shown, when the user enters the field of view of the camera 801, the electronic device 100 can detect the user's face through the camera 801 and authenticate the user's face. If the face of the specified user is recognized, the electronic device 100 can display the lock screen interface 1030 and display the unlocking mark 1033 on the lock screen interface 1030. The unlocking mark 1033 is used to prompt that the electronic device 100 has been unlocked.

[0127] like Fig. 10E As shown, after the electronic device 100 unlocks the mark 1033 for a certain period of time, the electronic device 100 can unlock the B screen and display the above-mentioned chat application interface 1020 on the B screen.

[0128] In one possible implementation, when the electronic device 100 is in a semi-folded state and no unlocking operation by the user is detected for a certain period of time, thereby turning off the B screen, if the face of a designated user is recognized by the camera 801, the electronic device 100 can directly display the lock screen interface 1030 on the B screen.

[0129] In some embodiments, when the folding screen of the electronic device 100 is in an unfolded form, the electronic device 100 can display the first interface of the first application and the second interface of the second application on the folding screen in split screens. When the folding screen of the electronic device 100 is in a semi-folded form and the face of the designated user is not recognized through the camera, the electronic device 100 can display the first interface on screen A and display the lock screen interface or turn off the screen on screen B. After the lock screen interface is displayed on screen B or the screen is turned off, if the electronic device 100 obtains the first message of the second application to which the second interface belongs, the electronic device 100 can display the lock screen interface on screen B and display the first notification prompt on the lock screen interface. The first notification prompt is used to prompt that the first message of the second application has been received. After the electronic device 100 recognizes the face of the designated user through the camera, the electronic device 100 can display the first interface on screen A and display a third interface including at least a portion of the content in the first message on screen B.

[0130] For example, Fig.11AAs shown, when the electronic device 100 is switched to the semi-folded state, the electronic device 100 can display the short video application interface 1010 on the A screen and display the lock screen interface 1030 on the B screen. Among them, the lock screen interface 1030 may include a lock screen logo 1031 and time information 1032. The electronic device 100 can receive a first message sent to the electronic device 100 by another device through a chat application. After receiving the first message, the electronic device 100 can display a notification prompt 1034 on the lock screen interface 1030. Among them, the notification prompt 1034 can be used to prompt the electronic device 100 to obtain a new message of the chat application.

[0131] like Fig. 11B As shown, when the user enters the field of view of the camera 801, the electronic device 100 can detect the user's face through the camera 801. If the face of the specified user is recognized, the electronic device 100 can display an unlocking mark 1033 on the lock screen interface 1030. The unlocking mark 1033 is used to prompt that the electronic device 100 has been unlocked.

[0132] like Fig. 11C As shown, after the electronic device 100 unlocks the mark 1033 for a certain period of time, the electronic device 100 can unlock the B screen and display a chat interface 1040 on the B screen. The chat interface 1040 may include a first message 1041 (for example, a text chat message "Hi" sent by the contact "Lily") sent by another device to the electronic device 100 through a chat application.

[0133] In a possible implementation, the electronic device 100 is as described above. Fig.11A After the notification prompt 1034 is displayed on the lock screen interface 1030 shown in the figure, if the face of the designated user is recognized by the camera 801, the electronic device 100 can directly display the above-mentioned notification prompt 1034 on the B screen. Fig. 11C Chat interface 1040 is shown.

[0134] In some embodiments, when the folding screen is in the unfolded state, the electronic device 100 displays the first interface and the second interface on the folding screen split screen. After the air gesture function is turned on, when the folding screen is changed from the unfolded state to the semi-folded state and the face of the designated user is not recognized by the camera, the electronic device displays the first interface on the first screen and displays the lock screen interface on the second screen. If the air gesture function is not turned on, when the folding screen is changed from the unfolded state to the semi-folded state, the first interface is displayed on the first screen and the second interface is displayed on the second screen.

[0135] In some application scenarios, since the A screen directly faces the user when the folding screen of the electronic device 100 is in a semi-folded state, the user wants to watch the content displayed on the A screen from a distance. Sometimes the user may need to view other information on the electronic device 100 and adjust the content displayed on the A screen. When the user places the electronic device 100 with the folding screen in a semi-folded state at a distance, it is inconvenient for the user to switch the content displayed on the A screen by approaching the electronic device 100 through touch input. When the folding screen of the electronic device 100 is in a semi-folded state, the electronic device 100 can display the first interface on the A screen and the second interface on the B screen. The electronic device 100 can receive and respond to the user's air gesture, display the second interface on the A screen, and display the first interface on the B screen. Among them, when the electronic device 100 is in a semi-folded state, the electronic device 100 can assume that the user's air gesture is to control the content displayed on the A screen. In this way, it is convenient for the user to switch the display content on the A screen and the B screen when the user is far away from the electronic device 100, so that the user can control the target display area on the electronic device 100.

[0136] For example, Fig. 12A As shown, the folding screen of the electronic device 100 is in a half-folded state. The electronic device 100 can display the first interface on the A screen and the second interface on the B screen.

[0137] The electronic device 100 may receive the user's air gesture 1. For example, the air gesture 1 may be that both the left hand and the right hand are opened with the palms facing the A screen and the left hand is above the right hand in the direction perpendicular to the ground, and then the left hand moves downward perpendicular to the ground and the right hand moves upward perpendicular to the ground until the right hand is above the left hand in the direction perpendicular to the ground.

[0138] like Fig. 12B As shown, the electronic device 100 can display the chat application interface 1020 on screen A and the short video application interface 1010 on screen B in response to the air gesture 1.

[0139] In a possible implementation, when the folding screen of the electronic device 100 is in a semi-folded state, the electronic device 100 displays different interfaces on screen A and screen B. The electronic device 100 can place the focus window of the air gesture on screen A. The user can control the interface displayed on screen A using air gestures.

[0140] For example, Fig. 12B , Fig. 12CAs shown, when the folding screen of the electronic device 100 is in a semi-folded state, the chat application interface 1020 is displayed on the A screen, and the short video application interface 1010 is displayed on the B screen. The electronic device 100 can receive and respond to the user's air sliding gesture (for example, the user's right palm slides upward) to slide the contact page displayed in the chat application interface 1020 displayed on the A screen upward.

[0141] In some application scenarios, when the folding screen of the electronic device 100 is in a semi-folded state, the A screen directly faces the user, and the user wants to watch the content displayed on the A screen from a distance, while the B screen does not directly face the user, and the user does not watch the B screen frequently. When the folding screen of the electronic device 100 is in an unfolded state, the electronic device 100 can display the first interface of the first application and the second interface of the second application on the folding screen. When the folding screen of the electronic device 100 is switched from the unfolded state to the semi-folded state and the face of the designated user is not recognized by the camera, the electronic device 100 can display the first interface on the A screen and turn off the B screen. After the B screen is turned off, the electronic device 100 can identify the direction of the user's gaze through the camera. If the direction of the user's gaze falls on the B screen, the electronic device 100 can light up the B screen and display the above-mentioned second interface on the B screen. Among them, when the B screen is lit and the second interface is displayed, if the electronic device 100 does not detect that the direction of the user's gaze falls on the B screen for more than a certain period of time, the electronic device 100 can turn off the B screen. In this way, the power consumption of the electronic device 100 can be saved, and the user's viewing experience will not be affected.

[0142] For example, Fig.13A As shown, when the folding screen of the electronic device 100 is in the unfolded state, the electronic device 100 can display the short video application interface 1010 and the chat application interface 1020 in the upper and lower split screens of the folding screen. For the text description of the short video application interface 1010 and the chat application interface 1020, please refer to the aforementioned Fig. 10A The illustrated embodiments will not be described in detail here.

[0143] like Fig. 13B , Fig. 13C As shown, when the folding screen of the electronic device 100 switches from the unfolded state to the semi-folded state, the electronic device 100 can display the short video application interface 1010 on the A screen and turn off the B screen. When the electronic device 100 detects through the camera 801 that the user's gaze is on the B screen, the electronic device 100 can turn on the B screen and display the chat application interface 1020 on the B screen.

[0144] In a possible implementation, after the B screen is turned off, the electronic device 100 can identify the direction of the user's gaze through the camera. If the direction of the user's gaze falls on the B screen, the electronic device 100 can turn on the B screen and display the above lock screen interface on the B screen. After the electronic device 100 displays the above lock screen interface on the B screen, if the user's face recognition is successful, the second interface is displayed on the B screen.

[0145] In some application scenarios, when the folding screen of the electronic device 100 is in a semi-folded state, the A screen directly faces the user, and the user wants to watch the content displayed on the A screen from a distance, while the B screen does not directly face the user, and the user does not watch the B screen frequently. And the content that the user wants to watch from a distance is generally continuously played (for example, video images), and the continuously played content will cause the user to watch immersively and forget the time. Therefore, when the folding screen of the electronic device 100 is in an unfolded state, the electronic device 100 can display the first interface of the first application and the second interface of the second application on the folding screen in split screen. When the folding screen of the electronic device 100 switches from the unfolded state to the semi-folded state, the electronic device 100 can display the first interface on the A screen, and the second interface and time information displayed in the B screen in split screen. For example, the second interface is displayed in the third display area of ​​the B screen, and the time information is displayed in the fourth display area of ​​the B screen, and the third display area and the fourth display area are different. In this way, the user can avoid being overly immersed in watching the content displayed on the A screen.

[0146] For example, when the folding screen of the electronic device 100 is in the unfolded state, the electronic device 100 is as described above. Fig. 10A As shown, the short video application interface 1010 and the chat application interface 1020 are displayed in split screens on the folding screen.

[0147] like Fig.14A As shown, when the folding screen of the electronic device 100 is switched from the unfolded state to the half-folded state, the electronic device 100 can display the short video application interface 1010 on the A screen, and display the chat application interface 1020 and the time information 1051 on the B screen. For example, the chat application interface 1020 can be displayed on the left half of the B screen, and the time information 1051 can be displayed on the right half of the B screen.

[0148] In one possible implementation, when the folding screen of the electronic device 100 is in the unfolded state, the electronic device 100 can display the first interface of the first application (for example, a video application, a game application, a video chat application) and the second interface of the second application on the folding screen in split screen. When the folding screen of the electronic device 100 switches from the unfolded state to the semi-folded state, the folding screen is folded to form screen A and screen B. At this time, the electronic device 100 can display the screen in the first interface on screen A, and display the function controls, the second interface and time information in the first interface on screen B in split screen. In this way, the user can better watch the screen in the first interface that is continuously displayed on screen A, reduce the obstruction of the screen in the first interface by the function controls in the first interface, and at the same time, prevent the user from being overly immersed in watching the content displayed on screen A.

[0149] For example, Fig. 14B As shown, when the folding screen of the electronic device 100 is switched from the unfolded state to the half-folded state, the electronic device 100 can display the video screen 1016 in the short video application interface 1010 on the A screen, and the B screen is divided into three areas, and the chat application interface 1020, the function controls in the short video application interface 1010 (for example, the video publisher avatar control 1011, the like control 1012, the comment control 1013, the collection control 1014 and the sharing control 1015) and the time information 1051 are respectively displayed on the three areas of the B screen. For example, the electronic device 100 can display the chat application interface 1020 in the left half area of ​​the B screen, display the function controls in the short video application interface 1010 (for example, the video publisher avatar control 1011, the like control 1012, the comment control 1013, the collection control 1014 and the sharing control 1015) in the upper right area of ​​the B screen, and display the time information 1051 in the lower right area of ​​the B screen.

[0150] In some application scenarios, since the folding screen of the electronic device 100 is in an unfolded form, or the display screen of the electronic device 100 is a non-folding screen, the electronic device 100 can display multiple interfaces in split screen or multiple windows, and the multiple interfaces include a first interface and a second interface. When it is inconvenient for the user to control the electronic device 100 by touch input (for example, there is oil or water on the user's hands, and the electronic device 100 is far away from the user), the user will use air gestures to the electronic device 100, but it is necessary to first determine the target window that the user's air gesture wants to control. Therefore, the electronic device 100 can display prompt information and a check box when detecting the user's air gesture A. The prompt information is used to prompt the user to select a target window from the windows of multiple interfaces, and the check box can be used to prompt the user of the target window currently selected. The electronic device 100 can switch the currently selected target window when detecting the user's air gesture B. The electronic device 100 can control the interface displayed in the target window when detecting the user's specified air gesture.

[0151] For example, Fig.15A As shown, when the folding screen of the electronic device 100 is in the unfolded state, the short video application interface 1010 and the chat application interface 1020 can be displayed in split screens on the upper and lower sides of the folding screen.

[0152] The electronic device 100 can detect the user's air gesture A (for example, one hand is spread out with the palm facing the display screen) through the camera 801. After the user's air gesture A is detected through the camera 801, the electronic device 100 can display the following Fig. 15B As shown, prompt information 1501 and check box 1502.

[0153] like Fig. 15B As shown, the prompt type of the prompt information 1501 is not limited, and can be a text prompt, a picture prompt, a video prompt, etc. Among them, the text prompt can be "An air gesture is detected, please select the target window for the air gesture to operate." The check box 1502 can first select the window where the short video application interface 1010 is located by default.

[0154] The electronic device 100 can detect the user's air gesture B (for example, one hand is spread out, the palm faces the display screen and rotates clockwise) through the camera 801.

[0155] like Fig. 15C As shown, after detecting the user's air gesture B through the camera 801, the electronic device 100 can switch the selection box 1502 to select the window where the chat application interface 1020 is located.

[0156] The electronic device 100 can detect the user's air gesture C (for example, making a fist with one hand) through the camera 801.

[0157] like Fig.15D As shown, after detecting the user's air gesture C through the camera 801, the electronic device 100 can select the window where the chat application interface 1020 is located with the selection box 1502, determine it as the target window, and cancel the display of the above prompt information 1501.

[0158] The electronic device 100 can detect the user's target air gesture (for example, the user's right palm slides upward) through the camera 801.

[0159] like Fig.15E As shown, after detecting the user's target air gesture (for example, the user's right palm slides upward) through the camera 801, the electronic device 100 can slide upward the contact page displayed in the chat application interface 1020.

[0160] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0161] The embodiments of the present application also provide a computer program product. When the computer program product is executed on a computer, the computer can implement the steps in the above-mentioned various method embodiments.

[0162] The embodiment of the present application also provides a chip system, the chip system includes a processing circuit interface circuit, the interface circuit is used to receive code instructions and transmit them to the processing circuit, and the processing circuit is used to run the code instructions so that the chip system implements the steps of any method embodiment of the present application. The chip system can be a single chip or a chip module composed of multiple chips.

[0163] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A display control method, characterized in that: Applicable to an electronic device including a folding screen, the folding screen can be folded to form at least two screens, the at least two screens include a first screen and a second screen; the method includes: When the folding screen is in an unfolded state, a first interface is displayed in a first display area of ​​the folding screen, and a second interface is displayed in a second display area of ​​the folding screen, wherein the first display area and the second display area are different; When the folding screen is transformed from the unfolded state to the semi-folded state and the face of the designated user is not recognized by the camera, the first interface is displayed on the first screen, and the lock screen interface is displayed on the second screen; When the folding screen is in the semi-folded state and the face of a designated user is recognized by the camera, the first interface is displayed on the first screen, and the second interface is displayed on the second screen.

2. The method according to claim 1, characterized in that The method further comprises: If the folding screen is in the semi-folded state and the face of the designated user is not recognized by the camera for a first period of time after the second screen displays the lock screen interface, the second screen is turned off.

3. The method according to claim 1 or 2, characterized in that: When the folding screen is transformed from the unfolded state to the semi-folded state and the face of the designated user is not recognized by the camera, the first interface is displayed on the first screen and the lock screen interface is displayed on the second screen, specifically including: When the folding screen changes from the unfolded state to the semi-folded state and the face of the designated user is not recognized by the camera, the first interface is displayed on the first screen, and the second screen is turned off; After the second screen is turned off, if the first message of the application to which the second interface belongs is obtained, the lock screen interface is displayed on the second screen, and a first notification prompt is displayed on the lock screen interface, wherein the first notification prompt is used to prompt the user that the electronic device has received the first message of the application to which the second interface belongs.

4. The method according to claim 3, characterized in that The method further comprises: If the lock screen interface is displayed on the second screen and the first notification prompt is displayed on the lock screen interface, the face of the designated user is recognized by the camera, and a third interface is displayed on the second screen, and the third interface includes at least a part of the content of the first message.

5. The method according to claim 2, characterized in that: The method further comprises: After the second screen is turned off, if the camera detects that the user's gaze is directed onto the second screen, the second screen is turned on, and the lock screen interface or the second interface is displayed on the second screen.

6. The method according to any one of claims 1 to 5, characterized in that After the first interface is displayed on the first screen and the second interface is displayed on the second screen, the method further includes: Recognizing a first air gesture of the user through the camera; In response to the first air gesture, the second interface is displayed on the first screen, and the first interface is displayed on the second screen.

7. The method according to claim 6, characterized in that After the second interface is displayed on the first screen and the first interface is displayed on the second screen, the method further includes: Recognizing a second air gesture of the user through the camera; In response to the second air gesture, a target operation corresponding to the second air gesture is performed on the second interface displayed on the first screen.

8. The method according to claim 7, characterized in that The target operation includes any of the following: screenshot, swiping up the page, swiping down the page, and clicking.

9. The method according to any one of claims 1 to 7, characterized in that: When the folding screen is in the semi-folded state and the face of a designated user is recognized by the camera, the first interface is displayed on the first screen, and the second interface is displayed on the second screen, specifically including: When the folding screen is in the semi-folded form and the face of a designated user is recognized by the camera, the first interface is displayed on the first screen, the second interface is displayed in the third display area of ​​the second screen, and time information is displayed in the fourth display area of ​​the second screen, and the first display area and the fourth display area, and the third display area and the fourth display area are different.

10. The method according to any one of claims 1 to 9, characterized in that When the folding screen is transformed from the unfolded state to the semi-folded state and the face of the designated user is not recognized by the camera, the first interface is displayed on the first screen and the lock screen interface is displayed on the second screen, specifically including: After the air gesture function is turned on, when the folding screen is transformed from the unfolded state to the semi-folded state and the face of the designated user is not recognized by the camera, the first interface is displayed on the first screen and the lock screen interface is displayed on the second screen.

11. The method according to claim 10, characterized in that The method further comprises: After the air gesture function is not turned on, when the folding screen changes from the unfolded state to the semi-folded state, the first interface is displayed on the first screen, and the second interface is displayed on the second screen.

12. The method according to any one of claims 1 to 11, characterized in that When the time for which the angle between the first screen and the second screen is maintained between the first angle threshold and the second angle threshold is greater than a first time threshold, the electronic device detects that the folding screen is transformed into a semi-folded state.

13. An electronic device, characterized in that: include: Folding screen, one or more cameras, one or more processors, and one or more memories; The folding screen can be folded to form at least two screens, and the at least two screens include a first screen and a second screen; the folding screen, the one or more cameras, and the one or more memories are respectively coupled to the one or more processors; the one or more memories are used to store computer programs; when the computer program runs on the one or more processors, the electronic device executes the method described in any one of claims 1-12.

14. A computer-readable storage medium, characterized in that: The method comprises a computer program, which, when executed on a processor of an electronic device, enables the electronic device to execute the method according to any one of claims 1 to 12.

15. A chip, characterized in that: include: A processing circuit and an interface circuit, wherein the interface circuit is used to receive code instructions and transmit the code instructions to the processing circuit, and the processing circuit is used to run the code instructions so that the chip executes the method according to any one of claims 1 to 12.

Images