Display methods, electronic devices, and storage media readable by computers.
Patent Information
- Application Number
- VN1202301151
- Authority / Receiving Office
- VN · VN
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-08-11
- Filing Date
- 2022-06-06
- Publication Date
- 2024-01-25
- Estimated Expiration
- 2042-06-06
Smart Images
Figure VN1202301151_0
Abstract
Description
Display method and related device
[0001] This application claims priority to Chinese patent application number 202110642450.0, filed with the Patent Office of China on June 9, 2021, entitled “Display Method and Folding Screen Terminal,” the entire contents of which are incorporated herein by reference. This application claims priority to Chinese patent application number 202110920022.X, filed with the Patent Office of China on August 11, 2021, entitled “Display Method and Related Device,” the entire contents of which are incorporated herein by reference. Technical Field
[0002] The present application relates to the field of electronic technology, and in particular to a display method and related devices. Background Art
[0003] With the development of electronic technology, the display screens of electronic devices are getting bigger and bigger. The display screens can provide users with richer information, thereby bringing a better user experience. For example, a larger folding screen is configured on the front of a mobile phone. When the folding screen is in the folded form, the folding screen can be folded into at least two screens, and the electronic device can display on one of the screens, and the user can control the display content of one of the above screens through touch operations or buttons. When the folding screen is in the unfolded form, the electronic device can display in full screen on the folding screen, and the user can control the display content of the entire folding screen through touch operations or buttons.
[0004] Currently, the interaction between users and folding screens is cumbersome and the user experience is poor.
[0005] Summary of the Invention
[0006] The present application provides a display method that automatically starts the corresponding camera and display screen for real-time preview in a specific posture of a foldable electronic device, avoiding tedious user operations and effectively improving the user experience.
[0007] In a first aspect, the present application provides a display method, which is applied to an electronic device, wherein the electronic device includes a first screen, a folding screen, and a first camera, wherein the folding screen can be folded along a folding edge to form a second screen and a third screen, wherein the first screen and the second screen are oriented in opposite directions, the orientation of the first screen is consistent with the shooting direction of the first camera, and the orientation of the second screen is consistent with the shooting direction of the second camera, and the method includes:
[0008] Based on the detected first angle between the second screen and the third screen, it is determined that the electronic device is in a first preset posture; based on the first preset posture of the electronic device, the electronic device displays a first user interface on the first screen; a first preview display area of the first user interface is used to display an image captured by the first camera, and in the first preset posture, the first angle does not include 0° and 180°; based on the detected first angle, it is determined that the electronic device is in a second preset posture; based on the second preset posture of the electronic device, the electronic device displays a second user interface on the second screen; a second preview display area of the second user interface is used to display an image captured by the second camera, and in the second preset posture, the first angle does not include 0° and 180°.
[0009] In implementing the embodiment of the present application, when the electronic device detects that the electronic device is in a first preset posture, the electronic device can start the first camera corresponding to the first preset posture to capture an image, and display the captured image on the first screen corresponding to the first preset posture. When the electronic device detects that the electronic device is in a second preset posture, the electronic device can start the second camera corresponding to the second preset posture to capture an image, and display the captured image on the second screen corresponding to the second preset posture. It should be noted that when the electronic device is in the first preset posture, it is convenient for the user to view the display content of the first screen; when the electronic device is in the second preset posture, it is convenient for the user to view the display content of the second screen. In this way, after the user places the electronic device in the preset posture, the user can start the camera corresponding to the preset posture to shoot with his hands free, and preview in real time through the display screen corresponding to the preset posture, avoiding tedious user operations and effectively improving the user experience.
[0010] In one implementation, the method further includes: determining that the electronic device is in a third preset posture based on the detected first angle; based on the third preset posture of the electronic device, the electronic device performs split-screen display on the second screen and the third screen, and the display content of the second screen includes a third preview display area, and the third preview display area is used to display the image captured by the second camera. Under the third preset posture, the first angle does not include 0° and 180°.
[0011] In the implementation of the embodiment of the present application, when the electronic device detects that the electronic device is in the third preset posture, the electronic device can start the second camera corresponding to the third preset posture to capture an image, and display the captured image on the second screen corresponding to the third preset posture, and can also display the interface elements associated with the image captured by the second camera through the third screen. It should be noted that the electronic device is in the third preset posture, which can facilitate the user to view the display content of the second screen and the third screen. In this way, after the user places the electronic device in the preset posture, the user can start the second camera corresponding to the preset posture to shoot with his hands free, and preview in real time through the second screen corresponding to the preset posture, and view the interface elements associated with the image captured by the second camera through the third screen, thereby avoiding tedious user operations and effectively improving the user experience.
[0012] In one implementation, the electronic device displays a first user interface on the first screen based on the first preset posture of the electronic device, including: when it is detected that the electronic device is in the first preset posture and the electronic device meets the first preset condition, the electronic device starts the first camera to capture images and displays the first user interface on the first screen; wherein the first preset posture includes a first angle within a first preset range, and the first preset condition includes one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the first screen is in a lit state, the electronic device does not receive any input operation acting on the first screen within a second preset time; a human face or a preset user's face is detected in the image captured by the camera corresponding to the first screen; and a first preset gesture is detected in the image captured by the camera corresponding to the first screen.
[0013] In implementing the embodiment of the present application, after the user places the electronic device in a first preset posture and makes the electronic device meet the first preset condition, the user can start the first camera corresponding to the first preset posture to shoot with both hands free, and perform real-time preview through the first screen corresponding to the first preset posture, avoiding tedious user operations and effectively improving the user experience.
[0014] In one implementation, the electronic device displays a second user interface on the second screen based on the second preset posture of the electronic device, including: when it is detected that the electronic device is in the second preset posture and the electronic device meets the second preset condition, the electronic device starts the second camera to capture images and displays the second user interface on the second screen; wherein the second preset posture includes a first angle within a second preset range, and the second preset condition includes one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the second screen is in a lit state, the electronic device does not receive any input operation acting on the second screen within the second preset time; a human face or the face of a preset user is detected in the image captured by the camera corresponding to the second screen; and a second preset gesture is detected in the image captured by the camera corresponding to the second screen.
[0015] In implementing the embodiment of the present application, after the user places the electronic device in the second preset posture and makes the electronic device meet the second preset condition, the user can start the second camera corresponding to the second preset posture to shoot with both hands free, and perform real-time preview through the second screen corresponding to the second preset posture, avoiding tedious user operations and effectively improving the user experience.
[0016] In one implementation, the above-mentioned electronic device performs split-screen display on the second and third screens based on the third preset posture of the electronic device, including: when it is detected that the electronic device is in the third preset posture and the electronic device meets the third preset condition, the electronic device starts the second camera to capture images, and performs split-screen display on the second and third screens; wherein, the third preset posture includes the first angle being within a third preset range, and the third preset condition includes one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the second screen and / or the third screen is in a lit state, the electronic device does not receive any input operation acting on the second screen or the third screen within the second preset time; in the image captured by the camera corresponding to the second screen, a human face or the face of a preset user is detected; in the image captured by the camera corresponding to the second screen, a third preset gesture is detected.
[0017] In implementing the embodiment of the present application, after the user places the electronic device in the third preset posture and makes the electronic device meet the third preset condition, the user can start the second camera corresponding to the third preset posture to shoot with both hands free, and perform real-time preview through the second screen corresponding to the third preset posture, and view interface elements associated with the image captured by the second camera through the third screen, avoiding tedious user operations and effectively improving the user experience.
[0018] In one implementation, the first preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the third screen orientation and the Z-axis of the geographic coordinate system is less than 90°, and the angle within the first preset range is greater than 0° and less than 120°; or, the first preset posture also includes: the second angle is within the fourth preset range, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is greater than 90°, and the angle within the first preset range is greater than 180° and less than 300°; or, the first preset posture also includes: the difference between the third angle and the second angle is within a fifth preset range, the third angle is the angle between the second screen and the horizontal plane, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is greater than 90°, and the angle within the first preset range is greater than 0° and less than 180°.
[0019] In the embodiment of the present application, by effectively setting the first preset posture, there is no need to install an additional bracket device for the electronic device, and the user does not need to hold the electronic device. The user can view the display content of the first screen more conveniently.
[0020] In one implementation, the first preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the third screen and the Z axis of the geographic coordinate system is less than 90°, and the angle within the first preset range is less than 120°; the above-mentioned display of the first user interface on the first screen includes: displaying the first user interface on the first screen after rotating 180°.
[0021] In one implementation, the first preset posture includes a first bracket state and a fifth bracket state. When it is detected that the electronic device is in the first preset posture and the electronic device meets the first preset condition, the electronic device starts the first camera to capture images and displays the first user interface on the first screen. This includes: when it is detected that the electronic device is in the first bracket state and the electronic device meets the first preset condition, the electronic device starts the first camera to capture images and displays the first user interface on the first screen; after the first user interface is displayed on the first screen, it also includes: when it is detected that the electronic device switches from the first bracket state to the fifth bracket state, the electronic device displays the first user interface rotated 180° on the first screen.
[0022] In implementing the embodiment of the present application, the display direction of the user interface corresponding to the first screen can be adaptively adjusted according to the physical posture of the electronic device to facilitate user viewing, effectively improving the user experience.
[0023] In one implementation, before the first user interface is displayed on the first screen, the above also includes: the electronic device identifies a first area where a preset local feature is located in the image captured by the first camera, and the first preview display area is used to display an enlarged image of the image in the first area.
[0024] In implementing an embodiment of the present application, after the user places the electronic device in a first preset posture and makes the electronic device meet the first preset condition, the user can start the first camera corresponding to the first preset posture to shoot with both hands free, and preview the details of the preset local features in the image captured by the first camera in real time through the first screen.
[0025] In one implementation, after the first user interface is displayed on the first screen, the above further includes: receiving a first input operation from the user; in response to the first input operation, the electronic device displays one or more of the following interface elements in the first user interface: a makeup trial control, a shooting control, a camera switching control, a fill light control, an album control, and a display frame; wherein the makeup trial control is used to add a preset makeup effect to the face in the image displayed in the first preview display area; the shooting control is used to trigger the electronic device to save the image displayed in the first preview display area; the camera switching control is used to switch the camera for capturing the image; the fill light control is used to supplement the ambient light; the album control is used to trigger the electronic device to display the user interface of the album application; and the display frame is used to display an enlarged image of a preset local feature in the image captured by the first camera.
[0026] In the embodiment of the present application, after a user places the electronic device in a first preset posture and the electronic device satisfies a first preset condition, the user can activate the first camera corresponding to the first preset posture to shoot with both hands free, and only the image captured by the first camera is displayed on the first screen. Then, after receiving the user's first input operation, other related interface elements, such as the shooting control, are displayed on the first screen.
[0027] In one implementation, the first camera is an ultraviolet camera, and the image captured by the first camera is used to highlight the area where sunscreen is applied.
[0028] In implementing the embodiment of the present application, after the user places the electronic device in a first preset posture and makes the electronic device meet the first preset condition, the user can start the first camera corresponding to the first preset posture to take pictures with both hands free, and preview the application of sunscreen in real time through the first screen.
[0029] In one implementation, based on a first preset posture of the electronic device, when the electronic device displays the first user interface on the first screen, the method further includes: the electronic device controlling the second screen and the third screen to turn off.
[0030] In the embodiment of the present application, when the electronic device controls the first screen to light up, the second screen and the third screen are controlled to turn off, thereby effectively saving energy consumption.
[0031] In one implementation, the second preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is less than 90°, and the angle within the second preset range is greater than 60° and less than 180°; or, the second preset posture also includes: the second angle is within the fourth preset range, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is greater than 90°, and the angle within the second preset range is greater than 240° and less than 360°; or, the second preset posture also includes: the difference between the third angle and the second angle is within a fifth preset range, the third angle is the angle between the second screen and the horizontal plane, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is greater than 90°, and the angle within the second preset range is greater than 180° and less than 360°.
[0032] In the implementation of the embodiment of the present application, by effectively setting the second preset posture, there is no need to install an additional bracket device for the electronic device, and the user does not need to hold the electronic device. The user can view the display content of the second screen more conveniently.
[0033] In one implementation, in the first preset posture and the second preset posture, the first angle does not include 0° and 180°.
[0034] In one implementation, based on the second preset posture of the electronic device, when the electronic device displays the second user interface on the second screen, the method further includes: the electronic device controlling the first screen to turn off.
[0035] In the embodiment of the present application, when the electronic device controls the second and third screens to light up, it controls the first screen to turn off, thereby effectively saving energy consumption.
[0036] In one implementation, the third preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the orientation of the third screen and the Z axis of the geographic coordinate system is less than 90°, and the angle within the third preset range is greater than 60° and less than 180°.
[0037] In the implementation of the embodiment of the present application, by effectively setting the third preset posture, there is no need to install an additional bracket device for the electronic device, and the user does not need to hold the electronic device. The user can view the display content of the second screen and the third screen more conveniently.
[0038] In one implementation, the display content of the third screen includes an enlarged image of a preset local feature in the image captured by the second camera.
[0039] In the embodiment of the present application, when the user previews the image captured by the second camera in real time on the second screen, the user can also preview the details of the preset local features in the image captured by the second camera in real time on the third screen.
[0040] In one implementation, the split-screen display on the second and third screens includes: split-screen display of the third user interface on the second and third display screens; the display content of the second screen includes a third preview display area of the third user interface, and zero, one, or more interface elements in the third user interface excluding the third preview display area; the display content of the third screen includes one or more interface elements in the third user interface excluding the display content of the second screen; the third user interface also includes one or more of the following interface elements: a makeup trial control, a shooting control, a camera switching control, a fill light control, an album control, and a display frame; wherein the makeup trial control is used to add a preset makeup effect to the face in the image in the preview display area of the third user interface; the shooting control is used to trigger the electronic device to save the image in the preview display area of the third user interface; the camera switching control is used to switch the camera for capturing the image; the fill light control is used to supplement the ambient light; the album control is used to trigger the electronic device to display the user interface of the album application; and the display frame is used to display an enlarged image of a preset local feature in the image captured by the second camera.
[0041] In implementing the embodiment of the present application, after the user places the electronic device in the third preset posture and makes the electronic device meet the third preset condition, the user can start the second camera corresponding to the third preset posture to shoot with both hands free, and perform real-time preview through the second screen corresponding to the third preset posture, and control the shooting parameters of the second camera and the display effect of the preview image in the second screen through the interface elements displayed on the third screen, thereby effectively improving the user experience.
[0042] In a second aspect, the present application provides a display method, which is applied to an electronic device, the electronic device including a first screen, a folding screen, and a first camera. The folding screen can be folded along a folding edge to form a second screen and a third screen. The first screen and the second screen are oriented in opposite directions, and the orientation of the first screen is consistent with the shooting direction of the first camera. The method includes:
[0043] When it is detected that the electronic device is in a first preset posture and the electronic device meets a first preset condition, the electronic device starts the first camera to capture images and displays a first user interface on the first screen, and the first preview display area of the first user interface is used to display the image captured by the first camera; wherein, the first preset posture includes a first angle between the second screen and the third screen being within a first preset range, and the first preset condition includes one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the first screen is in a lit state, the electronic device does not receive any input operation acting on the first screen within a second preset time; a human face or a preset user's face is detected in the image captured by the camera corresponding to the first screen; and a first preset gesture is detected in the image captured by the camera corresponding to the first screen.
[0044] It should be noted that the electronic device being in the first preset posture can facilitate the user to view the display content of the first screen. In the implementation of the embodiment of the present application, after the user places the electronic device in the first preset posture and the electronic device meets the first preset condition, the user can activate the first camera corresponding to the first preset posture to shoot with both hands free, and preview in real time through the first screen corresponding to the first preset posture, thereby avoiding tedious user operations and effectively improving the user experience.
[0045] In the embodiment of the present application, the camera corresponding to the first screen and the first camera can be the same camera or different cameras. Optionally, the camera corresponding to the first screen is a low-power camera.
[0046] In one implementation, the electronic device also includes a second camera, the orientation of the second screen is consistent with the shooting direction of the second camera, and when the folding screen is folded along the folding edge to form the second screen and the third screen, the third screen and the second camera are located on different sides of the folding edge. The method also includes: when it is detected that the electronic device is in a second preset posture and the electronic device meets a second preset condition, the electronic device starts the second camera to capture an image and displays a second user interface on the second screen, and the second preview display area of the second user interface is used to display the image captured by the second camera; wherein the second preset posture includes a first angle within a second preset range, and the second preset condition includes one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the second screen is in a lit state, the electronic device does not receive an input operation acting on the second screen within a second preset time; a face or a face of a preset user is detected in the image captured by the camera corresponding to the second screen; and a second preset gesture is detected in the image captured by the camera corresponding to the second screen.
[0047] It should be noted that the electronic device being in the second preset posture can facilitate the user to view the display content of the second screen. In the implementation of the embodiment of the present application, after the user places the electronic device in the second preset posture and the electronic device meets the second preset condition, the user can activate the second camera corresponding to the second preset posture to shoot with both hands free, and preview in real time through the second screen corresponding to the second preset posture, thereby avoiding tedious user operations and effectively improving the user experience.
[0048] In the embodiment of the present application, the camera corresponding to the second screen and the second camera can be the same camera or different cameras. Optionally, the camera corresponding to the second screen is a low-power camera.
[0049] In one implementation, the electronic device further includes a second camera, the orientation of the second screen is consistent with the shooting direction of the second camera, and when the folding screen is folded along the folding edge to form the second screen and the third screen, the third screen and the second camera are located on different sides of the folding edge. The method further includes: when it is detected that the electronic device is in a third preset posture and the electronic device meets a third preset condition, the electronic device starts the second camera to capture an image and displays it in split screen on the second screen and the third screen, and the display content of the second screen includes a third preview display area, and the third preview display area is used to display the image captured by the second camera; wherein the third preset posture includes the first angle being within a third preset range, and the third preset condition includes one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the second screen and / or the third screen is in a lit state, the electronic device does not receive an input operation acting on the second screen or the third screen within a second preset time; a face or a face of a preset user is detected in the image captured by the camera corresponding to the second screen; and a third preset gesture is detected in the image captured by the camera corresponding to the second screen.
[0050] It should be noted that the electronic device being in the third preset posture can facilitate the user to view the display content of the second screen and the third screen. In the implementation of the embodiment of the present application, after the user places the electronic device in the third preset posture and the electronic device meets the third preset condition, the user can activate the second camera corresponding to the third preset posture to shoot with both hands free, and use the second screen corresponding to the third preset posture for real-time preview, and view the interface elements associated with the image captured by the second camera through the third screen, thereby avoiding cumbersome user operations and effectively improving the user experience.
[0051] In one implementation, the first preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the third screen orientation and the Z-axis of the geographic coordinate system is less than 90°, and the angle within the first preset range is greater than 0° and less than 120°; or, the first preset posture also includes: the second angle is within the fourth preset range, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is greater than 90°, and the angle within the first preset range is greater than 180° and less than 300°; or, the first preset posture also includes: the difference between the third angle and the second angle is within a fifth preset range, the third angle is the angle between the second screen and the horizontal plane, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is greater than 90°, and the angle within the first preset range is greater than 0° and less than 180°.
[0052] In the embodiment of the present application, by effectively setting the first preset posture, there is no need to install an additional bracket device for the electronic device, and the user does not need to hold the electronic device. The user can view the display content of the first screen more conveniently.
[0053] In one implementation, the first preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the third screen and the Z axis of the geographic coordinate system is less than 90°, and the angle within the first preset range is less than 120°; the above-mentioned display of the first user interface on the first screen includes: displaying the first user interface on the first screen after rotating 180°.
[0054] In implementing the embodiment of the present application, the display direction of the user interface corresponding to the first screen can be adaptively adjusted according to the physical posture of the electronic device to facilitate user viewing, effectively improving the user experience.
[0055] In one implementation, before the first user interface is displayed on the first screen, the above also includes: the electronic device identifies a first area where a preset local feature is located in the image captured by the first camera, and the first preview display area is used to display an enlarged image of the image in the first area.
[0056] In implementing an embodiment of the present application, after the user places the electronic device in a first preset posture and makes the electronic device meet the first preset condition, the user can start the first camera corresponding to the first preset posture to shoot with both hands free, and preview the details of the preset local features in the image captured by the first camera in real time through the first screen.
[0057] In one implementation, after the first user interface is displayed on the first screen, the above further includes: receiving a first input operation from the user; in response to the first input operation, the electronic device displays one or more of the following interface elements in the first user interface: a makeup trial control, a shooting control, a camera switching control, a fill light control, an album control, and a display frame; wherein the makeup trial control is used to add a preset makeup effect to the face in the image displayed in the first preview display area; the shooting control is used to trigger the electronic device to save the image displayed in the first preview display area; the camera switching control is used to switch the camera for capturing the image; the fill light control is used to supplement the ambient light; the album control is used to trigger the electronic device to display the user interface of the album application; and the display frame is used to display an enlarged image of a preset local feature in the image captured by the first camera.
[0058] In the embodiment of the present application, after a user places the electronic device in a first preset posture and the electronic device satisfies a first preset condition, the user can activate the first camera corresponding to the first preset posture to shoot with both hands free, and only the image captured by the first camera is displayed on the first screen. Then, after receiving the user's first input operation, other related interface elements, such as the shooting control, are displayed on the first screen.
[0059] In one implementation, the first camera is an ultraviolet camera, and the image captured by the first camera is used to highlight the area where sunscreen is applied.
[0060] In implementing the embodiment of the present application, after the user places the electronic device in a first preset posture and makes the electronic device meet the first preset condition, the user can start the first camera corresponding to the first preset posture to take pictures with both hands free, and preview the application of sunscreen in real time through the first screen.
[0061] In one implementation, when it is detected that the electronic device is in a first preset posture and the electronic device meets a first preset condition, the method further includes: the electronic device controlling the second screen and the third screen to turn off.
[0062] In the embodiment of the present application, when the electronic device controls the first screen to light up, the second screen and the third screen are controlled to turn off, thereby effectively saving energy consumption.
[0063] In one implementation, the second preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is less than 90°, and the angle within the second preset range is greater than 60° and less than 180°; or, the second preset posture also includes: the second angle is within the fourth preset range, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is greater than 90°, and the angle within the second preset range is greater than 240° and less than 360°; or, the second preset posture also includes: the difference between the third angle and the second angle is within a fifth preset range, the third angle is the angle between the second screen and the horizontal plane, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is greater than 90°, and the angle within the second preset range is greater than 180° and less than 360°.
[0064] In the implementation of the embodiment of the present application, by effectively setting the second preset posture, there is no need to install an additional bracket device for the electronic device, and the user does not need to hold the electronic device. The user can view the display content of the second screen more conveniently.
[0065] In one implementation, in the first preset posture and the second preset posture, the first angle does not include 0° and 180°.
[0066] In one implementation, when it is detected that the electronic device is in a second preset posture and the electronic device meets a second preset condition, the method further includes: the electronic device controlling the first screen to turn off.
[0067] In the embodiment of the present application, when the electronic device controls the second and third screens to light up, it controls the first screen to turn off, thereby effectively saving energy consumption.
[0068] In one implementation, the third preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the orientation of the third screen and the Z axis of the geographic coordinate system is less than 90°, and the angle within the third preset range is greater than 60° and less than 180°.
[0069] In the implementation of the embodiment of the present application, by effectively setting the third preset posture, there is no need to install an additional bracket device for the electronic device, and the user does not need to hold the electronic device. The user can view the display content of the second screen and the third screen more conveniently.
[0070] In one implementation, the display content of the third screen includes an enlarged image of a preset local feature in the image captured by the second camera.
[0071] In the embodiment of the present application, when the user previews the image captured by the second camera in real time on the second screen, the user can also preview the details of the preset local features in the image captured by the second camera in real time on the third screen.
[0072] In one implementation, the split-screen display on the second and third screens includes: split-screen display of the third user interface on the second and third display screens; the display content of the second screen includes a third preview display area of the third user interface, and zero, one, or more interface elements in the third user interface excluding the third preview display area; the display content of the third screen includes one or more interface elements in the third user interface excluding the display content of the second screen; the third user interface also includes one or more of the following interface elements: a makeup trial control, a shooting control, a camera switching control, a fill light control, an album control, and a display frame; wherein the makeup trial control is used to add a preset makeup effect to the face in the image in the preview display area of the third user interface; the shooting control is used to trigger the electronic device to save the image in the preview display area of the third user interface; the camera switching control is used to switch the camera for capturing the image; the fill light control is used to supplement the ambient light; the album control is used to trigger the electronic device to display the user interface of the album application; and the display frame is used to display an enlarged image of a preset local feature in the image captured by the second camera.
[0073] In implementing the embodiment of the present application, after the user places the electronic device in the third preset posture and makes the electronic device meet the third preset condition, the user can start the second camera corresponding to the third preset posture to shoot with both hands free, and perform real-time preview through the second screen corresponding to the third preset posture, and control the shooting parameters of the second camera and the display effect of the preview image in the second screen through the interface elements displayed on the third screen, thereby effectively improving the user experience.
[0074] In a third aspect, the present application provides an electronic device comprising a first screen, a folding screen, and a first camera. The folding screen can be folded along a folding edge to form a second screen and a third screen. The first screen and the second screen are oriented in opposite directions. The orientation of the first screen is consistent with the shooting direction of the first camera, and the orientation of the second screen is consistent with the shooting direction of the second camera. The electronic device may include multiple functional modules or units for correspondingly executing the display method provided in the first aspect.
[0075] For example, the detection unit and the display unit.
[0076] a detection unit, configured to determine that the electronic device is in a first preset posture based on a detected first included angle between the second screen and the third screen;
[0077] A display unit, configured to display a first user interface on a first screen based on a first preset posture of the electronic device; a first preview display area of the first user interface is configured to display an image captured by the first camera, wherein in the first preset posture, the first angle does not include 0° and 180°;
[0078] The detection unit is further configured to determine that the electronic device is in a second preset posture based on the detected first angle;
[0079] The display unit is also used to display a second user interface on the second screen based on a second preset posture of the electronic device; the second preview display area of the second user interface is used to display an image captured by the second camera, and under the second preset posture, the first angle does not include 0° and 180°.
[0080] In one implementation, the detection unit is further used to determine that the electronic device is in a third preset posture based on the detected first angle; the display unit is further used to perform split-screen display on the second screen and the third screen based on the third preset posture of the electronic device, and the display content of the second screen includes a third preview display area, and the third preview display area is used to display the image captured by the second camera. Under the third preset posture, the first angle does not include 0° and 180°.
[0081] In one implementation, the above-mentioned display of the first user interface on the first screen based on the first preset posture of the electronic device includes: when it is detected that the electronic device is in the first preset posture and the electronic device meets the first preset condition, starting the first camera to capture images and displaying the first user interface on the first screen; wherein the first preset posture includes a first angle within a first preset range, and the first preset condition includes one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the first screen is in a lit state, the electronic device does not receive any input operation acting on the first screen within a second preset time; in the image captured by the camera corresponding to the first screen, a human face or the face of a preset user is detected; in the image captured by the camera corresponding to the first screen, a first preset gesture is detected.
[0082] In one implementation, the above-mentioned display of the second user interface on the second screen based on the second preset posture of the electronic device includes: when it is detected that the electronic device is in the second preset posture and the electronic device meets the second preset condition, starting the second camera to capture images and displaying the second user interface on the second screen; wherein the second preset posture includes a first angle within a second preset range, and the second preset condition includes one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the second screen is in a lit state, the electronic device does not receive any input operation acting on the second screen within the second preset time; a human face or the face of a preset user is detected in the image captured by the camera corresponding to the second screen; and a second preset gesture is detected in the image captured by the camera corresponding to the second screen.
[0083] In one implementation, the above-mentioned split-screen display on the second and third screens based on the third preset posture of the electronic device includes: when it is detected that the electronic device is in the third preset posture and the electronic device meets the third preset condition, starting the second camera to capture images, and split-screen display on the second and third screens; wherein, the third preset posture includes the first angle being within a third preset range, and the third preset condition includes one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the second screen and / or the third screen is in a lit state, the electronic device does not receive any input operation acting on the second screen or the third screen within the second preset time; in the image captured by the camera corresponding to the second screen, a human face or the face of a preset user is detected; in the image captured by the camera corresponding to the second screen, a third preset gesture is detected.
[0084] In a fourth aspect, the present application provides an electronic device comprising a first screen, a folding screen, and a first camera. The folding screen can be folded along a folding edge to form a second screen and a third screen. The first screen and the second screen are oriented in opposite directions, and the orientation of the first screen is consistent with the shooting direction of the first camera. The electronic device may include multiple functional modules or units for correspondingly executing the display method provided in the second aspect.
[0085] For example, the display unit.
[0086] The display unit is used to start the first camera to capture images and display the first user interface on the first screen when it is detected that the electronic device is in a first preset posture and the electronic device meets a first preset condition. The first preview display area of the first user interface is used to display the image captured by the first camera; wherein the first preset posture includes a first angle between the second screen and the third screen being within a first preset range, and the first preset condition includes one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the first screen is in a lit state, the electronic device does not receive an input operation acting on the first screen within a second preset time; a human face or a face of a preset user is detected in the image captured by the camera corresponding to the first screen; and a first preset gesture is detected in the image captured by the camera corresponding to the first screen.
[0087] In the embodiment of the present application, the camera corresponding to the first screen and the first camera can be the same camera or different cameras. Optionally, the camera corresponding to the first screen is a low-power camera.
[0088] In one implementation, the electronic device further includes a second camera, the orientation of the second screen is consistent with the shooting direction of the second camera, and when the folding screen is folded along the folding edge to form the second screen and the third screen, the third screen and the second camera are located on different sides of the folding edge. The display unit is further configured to, when detecting that the electronic device is in a second preset posture and the electronic device meets a second preset condition, activate the second camera to capture an image and display a second user interface on the second screen, wherein the second preview display area of the second user interface is configured to display the image captured by the second camera; wherein the second preset posture includes a first angle within a second preset range, and the second preset condition includes one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the second screen is in a lit state, the electronic device does not receive any input operation acting on the second screen within a second preset time; a human face or a face of a preset user is detected in the image captured by the camera corresponding to the second screen; and a second preset gesture is detected in the image captured by the camera corresponding to the second screen.
[0089] In the embodiment of the present application, the camera corresponding to the second screen and the second camera can be the same camera or different cameras. Optionally, the camera corresponding to the second screen is a low-power camera.
[0090] In one implementation, the electronic device further includes a second camera, the second screen is oriented in the same direction as the second camera, and when the foldable screen is folded along the folding edge to form the second screen and the third screen, the third screen and the second camera are located on different sides of the folding edge. The display unit is further configured to, upon detecting that the electronic device is in a third preset posture and the electronic device satisfies a third preset condition, activate the second camera to capture an image and display it in split-screen on the second and third screens, wherein the display content of the second screen includes a third preview display area for displaying the image captured by the second camera. The third preset posture includes the first angle being within a third preset range, and the third preset condition includes one or more of the following: the first angle remains at its current angle value for a first preset time; when the second screen and / or the third screen is illuminated, the electronic device does not receive any input operation on the second screen or the third screen within a second preset time; a human face or a face of a preset user is detected in an image captured by the camera corresponding to the second screen; and a third preset gesture is detected in an image captured by the camera corresponding to the second screen.
[0091] In one implementation, the first preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the third screen orientation and the Z-axis of the geographic coordinate system is less than 90°, and the angle within the first preset range is greater than 0° and less than 120°; or, the first preset posture also includes: the second angle is within the fourth preset range, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is greater than 90°, and the angle within the first preset range is greater than 180° and less than 300°; or, the first preset posture also includes: the difference between the third angle and the second angle is within a fifth preset range, the third angle is the angle between the second screen and the horizontal plane, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is greater than 90°, and the angle within the first preset range is greater than 0° and less than 180°.
[0092] In one implementation, the first preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the third screen and the Z axis of the geographic coordinate system is less than 90°, and the angle within the first preset range is less than 120°; the above-mentioned display unit displays the first user interface on the first screen, including: the display unit displays the first user interface rotated 180° on the first screen.
[0093] In one implementation, the electronic device further includes an identification unit, and before the display unit displays the first user interface on the first screen, the identification unit is used to identify a first area where a preset local feature is located in an image captured by the first camera, and the first preview display area is used to display an enlarged image of the image in the first area.
[0094] In one implementation, the electronic device also includes a receiving unit, and after the display unit displays the first user interface on the first screen, the receiving unit is used to receive a first input operation from the user; the display unit is also used to display the following one or more interface elements in the first user interface in response to the first input operation: a makeup trial control, a shooting control, a camera switching control, a fill light control, an album control, and a display frame; wherein the makeup trial control is used to add a preset makeup effect to the face in the image displayed in the first preview display area; the shooting control is used to trigger the electronic device to save the image displayed in the first preview display area; the camera switching control is used to switch the camera for capturing the image; the fill light control is used to supplement the ambient light; the album control is used to trigger the electronic device to display the user interface of the album application; and the display frame is used to display an enlarged image of a preset local feature in the image captured by the first camera.
[0095] In one implementation, the first camera is an ultraviolet camera, and the image captured by the first camera is used to highlight the area where sunscreen is applied.
[0096] In one implementation, the display unit is further configured to control the second screen and the third screen to turn off when it is detected that the electronic device is in a first preset posture and the electronic device meets a first preset condition.
[0097] In one implementation, the second preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is less than 90°, and the angle within the second preset range is greater than 60° and less than 180°; or, the second preset posture also includes: the second angle is within the fourth preset range, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is greater than 90°, and the angle within the second preset range is greater than 240° and less than 360°; or, the second preset posture also includes: the difference between the third angle and the second angle is within a fifth preset range, the third angle is the angle between the second screen and the horizontal plane, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is greater than 90°, and the angle within the second preset range is greater than 180° and less than 360°.
[0098] In one implementation, in the first preset posture and the second preset posture, the first angle does not include 0° and 180°.
[0099] In one implementation, the display unit is further configured to control the first screen to turn off when it is detected that the electronic device is in a second preset posture and the electronic device meets a second preset condition.
[0100] In one implementation, the third preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the orientation of the third screen and the Z axis of the geographic coordinate system is less than 90°, and the angle within the third preset range is greater than 60° and less than 180°.
[0101] In one implementation, the display content of the third screen includes an enlarged image of a preset local feature in the image captured by the second camera.
[0102] In one implementation, the display unit performs split-screen display on the second and third screens, including: the display unit performs split-screen display of the third user interface on the second and third display screens; the display content of the second screen includes a third preview display area of the third user interface, and zero, one, or more interface elements in the third user interface excluding the third preview display area; the display content of the third screen includes one or more interface elements in the third user interface excluding the display content of the second screen; the third user interface also includes one or more of the following interface elements: a makeup trial control, a shooting control, a camera switching control, a fill light control, an album control, and a display frame; wherein the makeup trial control is used to add a preset makeup effect to the face in the image in the preview display area of the third user interface; the shooting control is used to trigger the electronic device to save the image in the preview display area of the third user interface; the camera switching control is used to switch the camera for capturing the image; the fill light control is used to supplement the ambient light; the album control is used to trigger the electronic device to display the user interface of the album application; and the display frame is used to display an enlarged image of a preset local feature in the image captured by the second camera.
[0103] In a fifth aspect, the present application provides an electronic device comprising one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, wherein the computer program code comprises computer instructions. When the one or more processors execute the computer instructions, the electronic device performs the display method in any possible implementation of any of the above aspects.
[0104] In a sixth aspect, an embodiment of the present application provides a computer storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the display method in any possible implementation of any of the above aspects.
[0105] In a seventh aspect, an embodiment of the present application provides a computer program product, which, when running on a computer, enables the computer to execute the display method in any possible implementation of any of the above aspects. BRIEF DESCRIPTION OF THE DRAWINGS
[0106] 1A to 1F are schematic diagrams of a longitudinally foldable electronic device according to an embodiment of the present application;
[0107] 2A to 2F are schematic diagrams of a horizontally foldable electronic device according to an embodiment of the present application;
[0108] 3A to 3C are schematic diagrams of outer screens of a longitudinally foldable electronic device provided in an embodiment of the present application;
[0109] 4A to 4C are schematic diagrams of outer screens of a horizontally foldable electronic device provided in an embodiment of the present application;
[0110] FIG5 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0111] FIG6A is a schematic diagram of a geographic marking system provided in an embodiment of the present application;
[0112] FIG6B is a schematic diagram of calculating the angle between screens A and B according to an embodiment of the present application;
[0113] FIG7A is a schematic diagram of calculating the angle between screen A and the horizontal plane provided in an embodiment of the present application;
[0114] FIG7B is a schematic diagram of calculating the angle between screen B and the horizontal plane provided in an embodiment of the present application;
[0115] FIG8A is a schematic diagram of a coordinate system of an electronic device provided in an embodiment of the present application;
[0116] FIG8B is a schematic diagram of a coordinate system of another electronic device provided in an embodiment of the present application;
[0117] 9A to 9F are schematic diagrams of six bracket states of an electronic device provided in an embodiment of the present application;
[0118] 10A to 10C are display interfaces of screen C in a specific stand state provided by an embodiment of the present application;
[0119] 11A to 11F are schematic diagrams of a set of user interfaces provided in an embodiment of the present application;
[0120] 12A to 12N are another set of user interface schematic diagrams provided in an embodiment of the present application;
[0121] 13A to 13F are display interfaces of screen A in a specific stand state provided by an embodiment of the present application;
[0122] 14A to 14B are display interfaces of an inner screen provided in an embodiment of the present application;
[0123] 15A to 15F are display interfaces of the inner screen in a specific support state provided by an embodiment of the present application;
[0124] FIG16 is a schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application;
[0125] FIG17 is a schematic structural diagram of another electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0126] The following is a clear and detailed description of the technical solutions in the embodiments of the present application in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship between related objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0127] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.
[0128] The term "user interface (UI)" in the following embodiments of the present application refers to a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as iava and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device and finally presented as content that the user can recognize. The commonly used form of user interface is graphical user interface (GUI), which refers to a user interface related to computer operation that is displayed in a graphical manner. It can be a visual interface element such as text, icon, button, menu, tab, text box, dialog box, status bar, navigation bar, widget, etc. displayed on the display screen of an electronic device.
[0129] The embodiment of the present application provides a display method for a folding screen, which can be applied to an electronic device 100 with a longitudinal folding screen or a transverse folding screen. Among them, the folding screen of the electronic device 100 can be folded along the folding edge to form at least two screens, such as screen A and screen B. Depending on the degree of folding, the folding screen can present a variety of forms. In the embodiment of the present application, the folding screen of the electronic device 100 can present an unfolded form, a forward half-folded form, and a forward folded form. Optionally, the folding screen of the electronic device 100 can also present a reverse half-folded form and a reverse folded form.
[0130] Various forms of electronic devices 100 configured with a vertically foldable screen are introduced below.
[0131] For example, Figures 1A to 1F show a schematic diagram of the product form of an electronic device 100 with a longitudinal folding screen provided in an embodiment of the present application, where the folding edge of the longitudinal folding screen is perpendicular to the top edge line (for ease of description, the top edge line is referred to as the top edge) and the bottom edge line (for ease of description, the bottom edge line is referred to as the bottom edge) of the electronic device 100.
[0132] 1A is a schematic diagram of the unfolded form of the longitudinal folding screen. The longitudinal folding screen shown in FIG1A can be folded inward along the folding edge according to the direction 11a and / or 11b shown in FIG1A to form the forward semi-folded form of screen A (i.e., the second screen) and screen B (i.e., the third screen) shown in FIG1B and FIG1C. When the longitudinal folding screen is folded into screen A and screen B, screen A can be on the same side of the folding edge as the front camera on the electronic device 100. The longitudinal folding screen shown in FIG1C can continue to fold inward along the folding edge according to the directions 11a and 11b shown in FIG1C to form the longitudinal folding screen in the forward folding form shown in FIG1D. As shown in FIG1D, after the longitudinal folding screen of the electronic device 100 is completely folded forward, screen A and screen B are opposite to each other and are invisible to the user.
[0133] In some embodiments, the longitudinal folding screen shown in FIG1A can further be folded outward along the folding edge to form screen A and screen B in a reverse half-folded configuration as shown in FIG1E . The longitudinal folding screen shown in FIG1E can further be folded outward along the folding edge in directions 22a and 22b shown in FIG1E to form a longitudinal folding screen in a reverse folded configuration as shown in FIG1F . As shown in FIG1F , after the longitudinal folding screen of the electronic device 100 is completely folded in reverse, screen A and screen B face each other, and the back of the electronic device 100 (i.e., the back of screen A and the back of screen B) are not visible to the user.
[0134] Various forms of electronic devices 100 configured with a horizontally foldable screen are introduced below.
[0135] For example, Figures 2A to 2F show a schematic diagram of the product form of an electronic device 100 with a horizontally folding screen provided in an embodiment of the present application, where the folding edges of the horizontally folding screen are parallel to the top and bottom edges of the electronic device 100.
[0136] Among them, Figure 2A is a schematic diagram of the unfolded form of the horizontal folding screen. The horizontal folding screen shown in Figure 2A can be folded inward along the folding edge according to the direction 33a and / or 33b shown in Figure 2A to form the forward semi-folded form of screen A and screen B shown in Figures 2B and 2C. Among them, when the horizontal folding screen is folded into screen A and screen B, screen A can be on the same side of the folding edge as the front camera on the electronic device 100. The horizontal folding screen shown in Figure 2C can continue to fold inward along the folding edge according to the directions 33a and 33b shown in Figure 2C to form the horizontal folding screen in the forward folding form shown in Figure 2D. As shown in Figure 2D, after the horizontal folding screen of the electronic device 100 is completely folded forward, screen A and screen B are opposite to each other and are invisible to the user.
[0137] In some embodiments, the horizontal folding screen shown in FIG2A can be further folded outward along the folding edge to form screen A and screen B in a reverse half-folded configuration as shown in FIG2E . The horizontal folding screen shown in FIG2E can be further folded outward along the folding edge in directions 44a and 44b shown in FIG2E to form a horizontal folding screen in a reverse folded configuration as shown in FIG2F . As shown in FIG2F , after the horizontal folding screen of the electronic device 100 is completely folded in reverse, screen A and screen B face each other, and the back of the electronic device 100 (i.e., the back of screen A and the back of screen B) are not visible to the user.
[0138] A display screen (screen C) may also be provided on the back of screen A and / or screen B of the folding screen (vertical folding screen or horizontal folding screen) provided in the embodiment of the present application.
[0139] Among them, the folding screen composed of screen A and screen B is the inner screen of the electronic device 100, and screen A, screen B and the front camera are located on the front of the electronic device 100; screen C (i.e. the second screen) is the outer screen of the electronic device 100, and screen C and the rear camera are located on the back of the electronic device 100.
[0140] In the embodiment of the present application, screen C can be called the first screen, screen A can be called the second screen, and screen B can be called the third screen; screen C is arranged on the back of screen A, and screen C and screen A face opposite directions. The rear camera corresponding to screen C can be called the first camera, and the front camera corresponding to screen A can be called the second camera. It can be understood that the direction of screen C is consistent with the shooting direction of the rear camera, and the direction of screen A is consistent with the shooting direction of the front camera. When the folding screen configured in the inner screen of the electronic device is folded along the folding edge to form screen A and screen B, the front cameras corresponding to screen B and screen A (i.e., the second camera) are located on different sides of the folding edge.
[0141] For example, Figures 3A to 3C illustrate schematic diagrams of the outer screen of an electronic device 100 whose inner screen is configured as a vertical folding screen. Figures 4A to 4C illustrate schematic diagrams of the outer screen of an electronic device 100 whose inner screen is configured as a horizontal folding screen.
[0142] For example, as shown in Figures 3A and 3B, a C screen can be set on the back of screen A in the vertical folding screen of the electronic device 100. As shown in Figures 4A and 4B, a C screen can be set on the back of screen A in the horizontal folding screen of the electronic device 100. As shown in Figures 3B and 4B, after the folding screen corresponding to the inner screen is fully folded forward, screens A and B are invisible to the user, and screen C is located on the back of screen A and is visible to the user. Among them, screen C can be on the same side of the folding edge as the rear camera of the electronic device 100.
[0143] For example, as shown in FIG3C , a vertically foldable C screen may be provided on the back of the inner screen A and screen B. For example, as shown in FIG4C , a horizontally foldable C screen may be provided on the back of the inner screen A and screen B. As can be seen from FIG3C and FIG4C , when the inner screen of the electronic device 100 (i.e., the folding screen composed of screens A and B) is in the unfolded form, the outer screen (i.e., screen C) is also in the unfolded form; when the inner screen of the electronic device 100 is folded, the outer screen is also folded accordingly; when the inner screen of the electronic device 100 is in the folded form, the outer screen is also in the folded form.
[0144] It can be understood that for the electronic device 100 with a C screen, when the inner screen (i.e., the folding screen composed of screen A and screen B) is in a folded form, the electronic device 100 can display the user interface on screen C; when the inner screen is in a semi-folded form and an unfolded form, the electronic device 100 can display the user interface on screen A, screen B and / or screen C.
[0145] In some embodiments, the folding screen of the electronic device 100 may surround the electronic device 100 , and the above-mentioned screen A, screen B, and screen C may all be part of the folding screen.
[0146] In an embodiment of the present application, the electronic device 100 can determine the form of the folding screen of the inner screen configuration based on the detected angle α (first angle) between screen A and screen B. In some embodiments, the angle α between screen A and screen B of the folding screen (vertical folding screen or horizontal folding screen) of the electronic device 100 takes a value range of [0°, 180°], and the electronic device 100 cannot be folded in the reverse direction. In some embodiments, the angle α between screen A and screen B of the folding screen (vertical folding screen or horizontal folding screen) of the electronic device 100 takes a value range of [0°, 360°], and the electronic device 100 can be folded both forward and reverse.
[0147] It should be noted that, in the embodiment of the present application, the angle α between screen A and screen B may also be referred to as the first angle.
[0148] Exemplarily, the value range of α is [0°, 360°]. When the angle α∈[0°, P1), the electronic device 100 can determine that the folding screen is in a forward folding state; when the angle α∈[P1, P2), the electronic device 100 can determine that the folding screen is in a forward semi-folding state; when the angle α∈[P2, P3), the electronic device 100 can determine that the folding screen is in an unfolded state; when α∈[P3, P4), the electronic device 100 can determine that the folding screen is in a reverse semi-folding state; when the angle α∈[P4, 360), the electronic device 100 can determine that the folding screen is in a reverse folding state. Among them, 0°<P1<P2<180°<P3<P4<360°. P1, P2, P3 and P4 are preset angle thresholds. P1, P2, P3 and P4 can be set by the user in the electronic device 100, or set by default by the electronic device 100.
[0149] In some embodiments, the difference between P1 and 0°, the difference between P2 and 180°, the difference between P3 and 180°, and the difference between P4 and 360° are all preset error values set by the electronic device 100 or the user. For example, if the preset error value is 2°, P1, P2, P3, and P4 are 2°, 178°, 172°, and 358°, respectively.
[0150] In some embodiments, P1, P2, P3, and P4 can be determined based on the user's usage habits of the foldable screen. For example, according to the usage habits of most users, when the angle α between screen A and screen B is less than 50 degrees, the user is more likely to not use screen A or screen B; when the angle α between screen A and screen B is greater than 50° and less than or equal to 160° (or α is greater than 190° and less than or equal to 280°), the user is more likely to use screen A and screen B to display different content; when the angle α between screen A and screen B is greater than 160° and less than or equal to 190°, the user is more likely to use screen A and screen B as a whole (i.e., as a complete display screen); when the angle between screen A and screen B is greater than 280° and less than or equal to 360°, the user is more likely to use screen A or screen B alone. Based on the above usage habits, the value range of P1 can be (0, 40°), the value range of P2 can be [160°, 180°), the value range of P3 can be [180°, 190°), and the value range of P4 can be [280°, 360°). For example, P1 is 30°, P2 is 170°, P3 is 185°, and P4 is 300°.
[0151] It should be noted that the at least two display screens formed after the folding screen in the embodiment of the present application is folded can be multiple independent display screens, or a complete display screen with an integrated structure, which is just folded into at least two parts.
[0152] For example, the foldable screen can be a flexible foldable screen, including folding edges made of a flexible material. Part or all of the flexible foldable screen is made of a flexible material. When the flexible foldable screen is folded, the at least two screens formed are a complete screen with an integrated structure, but are folded into at least two parts.
[0153] For another example, the foldable screen may be a multi-screen foldable screen. The multi-screen foldable screen may include multiple (two or more) display screens. These multiple display screens are multiple independent display screens. These multiple display screens may be connected in sequence via folding axes. Each screen may rotate about the folding axis connected to it, thereby folding the multi-screen foldable screen.
[0154] In the subsequent embodiments of this application, the display method provided in the embodiments of this application will be explained by taking a flexible folding screen that can be folded horizontally as an example.
[0155] The electronic device 100 provided in the embodiment of the present application is described below with reference to the accompanying drawings.
[0156] The electronic device 100 can be a terminal device equipped with iOS, Android, Microsoft or other operating systems. For example, the electronic device 100 can be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, as well as a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) or virtual reality (VR) device, etc., including the above-mentioned folding screen. The embodiment of the present application does not impose any special restrictions on the specific type of the electronic device 100.
[0157] For example, FIG5 shows a schematic structural diagram of an electronic device 100. As shown in FIG5, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0158] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0159] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0160] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0161] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0162] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.
[0163] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C bus lines. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, and the like via different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K via the I2C interface, enabling communication between the processor 110 and the touch sensor 180K via the I2C bus interface, thereby implementing the touch function of the electronic device 100.
[0164] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.
[0165] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0166] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface, enabling the function of playing music through Bluetooth headphones.
[0167] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the camera function of the electronic device 100. The processor 110 and the display 194 communicate via the DSI interface to implement the display function of the electronic device 100.
[0168] The GPIO interface can be configured via software. The GPIO interface can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, display 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0169] The USB interface 130 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as augmented reality devices.
[0170] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.
[0171] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device 100 via the power management module 141.
[0172] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0173] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0174] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0175] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0176] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0177] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0178] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0179] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0180] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.
[0181] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
[0182] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.
[0183] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0184] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0185] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.
[0186] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.
[0187] The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).
[0188] Random access memory may include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM, for example, the fifth generation DDR SDRAM is generally referred to as DDR5 SDRAM), etc.; non-volatile memory may include disk storage devices and flash memory.
[0189] Flash memory can be divided into NOR FLASH, NAND FLASH, 3D NAND FLASH, etc. according to the operating principle; single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc. according to the storage cell potential level; universal flash storage (UFS) and embedded multi media card (eMMC) can be divided into according to the storage specification.
[0190] The random access memory can be directly read and written by the processor 110, and can be used to store executable programs (such as machine instructions) of the operating system or other running programs, and can also be used to store user and application data.
[0191] The non-volatile memory may also store executable programs and user and application data, etc., and may be loaded into the random access memory in advance for direct reading and writing by the processor 110 .
[0192] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 via the external memory interface 120 to implement data storage. For example, files such as music and videos can be stored in the external non-volatile memory.
[0193] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0194] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.
[0195] The speaker 170A, also called a "horn", is used to convert audio electrical signals into sound signals.
[0196] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals.
[0197] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.
[0198] The headphone jack 170D is used to connect a wired headphone.
[0199] The pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc.
[0200] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.
[0201] It should be noted that the coordinate system of the gyroscope sensor is a geographic coordinate system. As shown in Figure 6A, the origin O of the geographic coordinate system is located at the point where the carrier (i.e., the device containing the gyroscope sensor, such as the electronic device 100) is located, the X-axis points east (E) along the local latitude, the Y-axis points north (N) along the local meridian, and the Z-axis points upward along the local geographic vertical, and forms a right-handed rectangular coordinate system with the X-axis and the Y-axis. Among them, the plane formed by the X-axis and the Y-axis is the local horizontal plane, and the plane formed by the Y-axis and the Z-axis is the local meridian plane. Therefore, it can be understood that the coordinate system of the gyroscope sensor is: with the gyroscope sensor as the origin O, the X-axis pointing east along the local latitude is the X-axis, the Y-axis pointing north along the local meridian is the Y-axis, and the Z-axis pointing upward along the local geographic vertical (i.e., the direction of the geographic vertical) is the Z-axis.
[0202] In an embodiment of the present application, the display screen 194 of the electronic device 100 can be folded to form multiple display screens. Each display screen can be provided with a gyroscope sensor 180B for measuring the orientation of the display screen (i.e., a direction vector perpendicular to the display screen and pointing from the inside of the electronic device 100 to the outside). The electronic device 100 can determine the angle between adjacent screens based on the change in the orientation of each display screen measured by the gyroscope sensor 180B.
[0203] Referring to Figures 1A to 2F , the display screen 194 of electronic device 100 can be folded to form adjacent screens A and B. Screen A is equipped with a gyroscopic sensor A, which allows electronic device 100 to measure the orientation of screen A. Screen B is equipped with a gyroscopic sensor B, which allows electronic device 100 to measure the orientation of screen B. Based on the measured changes in the orientations of screens A and B, electronic device 100 can determine the angle α between screens A and B. The principle of obtaining angle α is described in detail below.
[0204] For example, FIG6B shows a schematic diagram of the angle α between screen A and screen B. As shown in FIG6B , the electronic device 100 uses the gyroscope sensor A to measure the orientation of screen A as vector The direction of screen B is measured by gyro sensor B as vector z2. Perpendicular to screen A, vector Perpendicular to screen B. The electronic device 100 uses the following formula (1) to calculate the vector With vector The included angle θ between screen A and screen B can then be determined by the electronic device 100 to be α=180°-θ.
[0205]
[0206] It should be noted that although the positions of gyro sensor A in screen A and gyro sensor B in screen B do not overlap, that is, the origins of the coordinate systems of the two gyro sensors do not overlap, the two X axes, two Y axes, and two Z axes of the two coordinate systems are parallel. and vector is measured by different gyroscope sensors in different coordinate systems. However, since the axes of the coordinate systems of the two gyroscope sensors are parallel, the electronic device 100 can calculate the vector by the above formula (1): With vector The angle θ.
[0207] In some embodiments, the electronic device 100 measures the angle between adjacent screens of the folding screen, such as the angle α between screen A and screen B, using one or more acceleration sensors. For example, an acceleration sensor can be set in each display screen of the folding screen. The electronic device 100 (such as the processor 110) can use the acceleration sensor to measure the motion acceleration of each display screen when it is rotated; and then calculate the angle of rotation of one display screen relative to another display screen based on the measured motion acceleration, such as the angle α between screen A and screen B.
[0208] In some embodiments, the gyroscope sensor may be a virtual gyroscope sensor formed by a plurality of other sensors. The virtual gyroscope sensor may be used to calculate the angle between adjacent screens of the folding screen, such as the angle α between screen A and screen B.
[0209] In other embodiments, an angle sensor is installed at the folding portion of the electronic device 100 (for example, on the hinge), and the electronic device 100 can use the angle sensor to measure the angle between adjacent screens of the folding screen, such as the angle α formed by screen A and screen B.
[0210] In the embodiment of the present application, the electronic device 100 can also measure the angle β1 between screen A and the horizontal plane through the above-mentioned gyroscope sensor A, and measure the angle β2 between screen B and the horizontal plane through the above-mentioned gyroscope sensor B.
[0211] For example, FIG7A shows the coordinate system of the gyro sensor A of the screen A of the electronic device 100. The XOY plane formed by the X-axis and the Y-axis is the local horizontal plane, and the plane formed by the Y-axis and the Z-axis is the local meridian plane. The orientation of the screen A of the electronic device 100 in the coordinate system of the gyro sensor A is the vector vector The angle γ1 with the XOY plane (i.e. the horizontal plane) is in the following relationship: Among them, the A screen of the electronic device 100 and the vector Vertically, the angle β1 and the angle γ1 between the plane where the screen A of the electronic device 100 is located and the horizontal plane are complementary, that is, β1+γ1=90°. And there is the following relationship: in,
[0212]
[0213] For example, FIG7B shows the coordinate system of the gyro sensor B of the upper B screen of the electronic device 100. The XOY plane formed by the X-axis and the Y-axis is the local horizontal plane, and the plane formed by the Y-axis and the Z-axis is the local meridian plane. The orientation of the B screen of the electronic device 100 in the coordinate system of the gyro sensor is the vector vector The angle γ2 with the XOY plane (i.e., the horizontal plane) has the following relationship: Among them, the B screen of the electronic device 100 and the vector Vertically, the angle β2 and the angle γ2 between the plane where the screen B of the electronic device 100 is located and the horizontal plane are complementary, that is, β2+γ2=90°. The following relationship exists: in,
[0214]
[0215] In summary, the electronic device 100 uses the gyroscope sensor A to measure the direction of the A screen corresponding to the vector Then, the angle β1 between screen A and the horizontal plane can be determined by using the above formula (2). In summary, the vector corresponding to the orientation of screen B measured by the gyro sensor B obtained by the electronic device 100 is Then, the angle β2 between screen B and the horizontal plane can be determined using the above formula (3).
[0216] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude using the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.
[0217] Accelerometer 180E can detect the magnitude of acceleration of electronic device 100 in all directions (generally three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic device 100, enabling applications such as switching between landscape and portrait modes and pedometers.
[0218] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance using infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focusing.
[0219] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the LED.
[0220] The ambient light sensor 180L is used to sense the brightness of the ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the sensed brightness of the ambient light.
[0221] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0222] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy.
[0223] The touch sensor 180K is also called a "touch-sensitive device." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, at a location different from that of the display screen 194.
[0224] The bone conduction sensor 180M can acquire vibration signals.
[0225] The buttons 190 include a power button, a volume button, etc. The buttons 190 can be mechanical buttons or touch buttons.
[0226] Motor 191 can generate vibration prompts.
[0227] Indicator 192 may be an indicator light, which may be used to indicate charging status, charge change, messages, notifications, and the like.
[0228] The SIM card interface 195 is used to connect a SIM card.
[0229] The display direction of the C screen of the electronic device 100 involved in the embodiment of the present application is introduced below.
[0230] In the embodiment of the present application, the electronic device 100 can determine the display direction of the user interface 1 corresponding to the C screen based on the detected physical posture of the C screen.
[0231] For example, referring to the horizontally folded electronic device 100 shown in FIG8A and the vertically folded electronic device 100 shown in FIG8B , the four sides of the C screen include a first side, a second side, a third side, and a fourth side, and the first side and the second side of the C screen are parallel to the folded side of the electronic device 100. The display direction of the user interface 1 corresponding to the C screen includes one or more of display direction 1, display direction 2, display direction 3, and display direction 4.
[0232] Display direction 1 means: the top and bottom edges of the user interface 1 are parallel to the first edge, and the top edge of the user interface 1 is closer to the first edge than the bottom edge of the user interface 1. Display direction 2 means: the top and bottom edges of the user interface 1 are parallel to the first edge, and the bottom edge of the user interface 1 is closer to the first edge than the top edge of the user interface 1. Display direction 3 means: both side edges (left and right edges) of the user interface 1 are parallel to the first edge, and the right edge of the user interface 1 is closer to the first edge than the left edge of the user interface 1. Display direction 4 means: both side edges (left and right edges) of the user interface 1 are parallel to the first edge, and the left edge of the user interface 1 is closer to the first edge than the right edge of the user interface 1.
[0233] In the embodiment of the present application, the physical posture of the electronic device 100 may include: a first physical posture, a second physical posture, a third physical posture, and a fourth physical posture.
[0234] In some embodiments, when the detection electronic device 100 is in a first physical posture, the display direction of the user interface 1 corresponding to the C screen is controlled to be display direction 1; when the detection electronic device 100 is in a second physical posture, the display direction of the user interface 1 corresponding to the C screen is controlled to be display direction 2; when the detection electronic device 100 is in a third physical posture, the display direction of the user interface 1 corresponding to the C screen is controlled to be display direction 3; when the detection electronic device 100 is in a fourth physical posture, the display direction of the user interface 1 corresponding to the C screen is controlled to be display direction 4.
[0235] In some embodiments, referring to the horizontally folded electronic device 100 shown in FIG7A , the default display orientation of the C panel of the electronic device 100 is display orientation 1. When the electronic device 100 is in a first physical posture, the electronic device 100 displays the user interface 1 corresponding to the C panel in the default display orientation of the C panel. When the electronic device 100 is in a second physical posture, the electronic device 100 rotates the user interface corresponding to the C panel 180° before displaying it.
[0236] In some embodiments, referring to the horizontally folded electronic device 100 shown in FIG7A , the default display orientation of the C panel of the electronic device 100 is display orientation 2. When the electronic device 100 is in the second physical posture, the electronic device 100 displays the user interface of the C panel in the default display orientation of the C panel; when the electronic device 100 is in the first physical posture, the electronic device 100 rotates the user interface of the C panel 180° before displaying it.
[0237] In some embodiments, referring to the longitudinally folded electronic device 100 shown in FIG7B , the default display direction of the C screen of the electronic device 100 is display direction 3. When the electronic device 100 is in the third physical posture, the electronic device 100 displays the user interface 1 corresponding to the C screen according to the default display direction of the C screen. When the electronic device 100 is in the first physical posture, the electronic device 100 rotates the user interface corresponding to the C screen 90° before displaying it. When the electronic device 100 is in the fourth physical posture, the electronic device 100 rotates the user interface corresponding to the C screen 180° before displaying it. When the electronic device 100 is in the second physical posture, the electronic device 100 rotates the user interface corresponding to the C screen 270° (or -90°) before displaying it.
[0238] In this way, through the above embodiment, the display direction of the user interface corresponding to the C screen can be adaptively adjusted with the physical posture of the electronic device 100, so as to facilitate user viewing and effectively improve the user experience. Similarly, in the embodiment of the present application, the display direction of the user interface corresponding to the A screen, the B screen and the inner screen can also be adaptively adjusted with the physical posture of the electronic device 100. It can be understood that the default display direction of the A screen, the B screen and the inner screen is generally: the top edge of the user interface is parallel to the top edge of the electronic device 100, and relative to the bottom edge of the user interface, the top edge of the user interface is closer to the top edge of the electronic device 100.
[0239] The following describes how to determine the physical posture of the C screen.
[0240] In the embodiment of the present application, screen C, screen A, and gyroscope sensor A are located on the same side of the folded edge. Gyroscope sensor A can detect the physical posture of screen A and screen C. Screens A and C may or may not share the same coordinate system of electronic device 100. The following description uses the example of screens A and C sharing the same coordinate system of electronic device 100.
[0241] For example, Figures 8A and 8B illustrate the three-axis coordinate system of screen A (or screen C) of electronic device 100. As shown in Figures 8A and 8B, when screen A faces the user, the x1 axis of screen A's three-axis coordinate system is perpendicular to the left side of screen A and points from the left side of screen A to the right side of screen A; the y1 axis of screen A's three-axis coordinate system is perpendicular to the bottom edge of screen A and points from the bottom edge of screen A to the top edge of screen A; and the z1 axis of screen A's three-axis coordinate system is used to indicate the orientation of screen A, and the z1 axis is perpendicular to screen A.
[0242] In some embodiments, referring to the horizontally folded electronic device 100 shown in FIG8A , the gyroscope sensor A can detect the vector corresponding to the y1 axis. When the angle β4 between the projection of the y1 axis on the local meridian plane (i.e., the YOZ plane of the geographic coordinate system) and the Z axis of the geographic coordinate system is within the preset range 11, the electronic device 100 determines that screen C is in the first physical posture. When the angle β4 is within the preset range 12, the electronic device 100 determines that screen C is in the third physical posture. When the angle β4 is within the preset range 13, the electronic device 100 determines that screen C is in the second physical posture. When the angle β4 is within the preset range 12, the electronic device 100 determines that screen C is in the fourth physical posture. For example, the preset range 11 is [-45°, 45°), the preset range 12 is [45°, 135°), the preset range 13 is [135°, 225°), and the preset range 14 is [-45°, -135°).
[0243] In some embodiments, referring to the longitudinally folded electronic device 100 shown in FIG8B , the gyroscope sensor A can detect the vector corresponding to the y1 axis. When the angle β4 between the projection of the y1 axis on the local meridian plane (i.e., the YOZ plane of the geographic coordinate system) and the Z axis of the geographic coordinate system is within a preset range 11, the electronic device 100 determines that screen C is in the third physical posture. When the angle β4 is within a preset range 12, the electronic device 100 determines that screen C is in the second physical posture. When the angle β4 is within a preset range 13, the electronic device 100 determines that screen C is in the fourth physical posture. When the angle β4 is within a preset range 14, the electronic device 100 determines that screen C is in the first physical posture.
[0244] The embodiment of the present application is not limited to the above-mentioned implementation method for determining the physical posture of the electronic device 100. Other implementation methods can also be used to determine the physical posture of the C screen, which is not specifically limited here. For example, the electronic device 100 uses a gyroscope sensor and an accelerometer to detect the pitch angle (i.e., the angle of rotation of the C screen around the x1 axis), the roll angle (i.e., the angle of rotation of the C screen around the y1 axis), and the yaw angle (i.e., the angle of rotation of the C screen around the z1 axis) of the C screen, and then the physical posture of the C screen can be determined based on the pitch angle, roll angle, and yaw angle of the C screen.
[0245] With reference to the longitudinally folded electronic device 100 shown in FIG8B , according to the user's usage habits, the default display orientation of the electronic device 100 in this form is usually display orientation 3. With reference to the transversely folded electronic device 100 shown in FIG8A , according to the user's usage habits, the default display orientation of the electronic device 100 in this form is usually display orientation 2. It should be noted that the display method provided in the subsequent embodiments is described using the transversely folded electronic device 100 with the C screen having the default display orientation of display orientation 2 as an example. Other transversely folded electronic devices 100 with default display orientations and longitudinally folded electronic devices 100 are also applicable to the display method provided in the embodiments of the present application.
[0246] 9A to 9F , several bracket states of the electronic device 100 in the embodiment of the present application are introduced below.
[0247] In some embodiments, when the electronic device 100 detects that the angle β2 between screen B and the horizontal plane is within a preset range 15 (ie, [0, f1], for example, f1 = 10°), the vector corresponding to screen B is When the angle β5 with the Z axis of the geographic coordinate system is less than 90 degrees and the angle α between screen A and screen B is within a preset range 16 (i.e., [f2, f3]), the electronic device 100 is determined to be in the first stand state. Wherein, 0°<f2<f3≤90°, for example, f2=20°, f3=90°. For example, FIG9A shows a schematic diagram of the electronic device 100 in the first stand state.
[0248] In some embodiments, when the electronic device 100 detects that the angle β2 between screen B and the horizontal plane is within a preset range 15 (ie, [0, f1], for example, f1 = 10°), the vector corresponding to screen B is When the angle β5 with the Z axis of the geographic coordinate system is less than 90 degrees, and the angle α between screen A and screen B is within a preset range 17 (i.e., [f4, f5]), the electronic device 100 is determined to be in the second stand state. Wherein, 90° ≤ f4 < f5 < 180°, for example, f4 = 90°, f5 = 160°. For example, FIG9C shows a schematic diagram of two second stand states of the electronic device 100.
[0249] It can be understood that, referring to FIG. 9A and FIG. 9C , in the first stand state and the second stand state, screen B of the electronic device 100 is placed horizontally (or nearly horizontally) upward, and the electronic device 100 is in a forward semi-folded state.
[0250] In some embodiments, when the electronic device 100 detects that the angle β2 between screen B and the horizontal plane is within a preset range 15, the vector corresponding to screen B When the angle β5 with the Z axis of the geographic coordinate system is greater than 90 degrees and the angle α between screen A and screen B is within a preset range 18 (i.e., [f6, f7]), the electronic device 100 is determined to be in the third support state. Wherein, 180° < f6 < f7 ≤ 270°, for example, f6 = 200°, f7 = 270°. For example, FIG9D shows a schematic diagram of the third support state of the electronic device 100.
[0251] In some embodiments, when the electronic device 100 detects that the angle β2 between screen B and the horizontal plane is within a preset range 15, the vector corresponding to screen B When the angle β5 with the Z axis of the geographic coordinate system is greater than 90 degrees and the angle α between screen A and screen B is within a preset range 19 (i.e., [f8, f9]), the electronic device 100 is determined to be in the fourth support state. Wherein, 270°≤f8<f9<360°, for example, f8=270°, f9=340°. For example, FIG9B shows a schematic diagram of the fourth support state of the electronic device 100.
[0252] It can be understood that, referring to FIG. 9D and FIG. 9B , in the third support state and the fourth support state, screen B is placed horizontally (or nearly horizontally) downward, and the electronic device 100 is in a reverse half-folded state.
[0253] It should be noted that in the first bracket state, the second bracket state, the third bracket state and the fourth bracket state, screen C is in the first physical posture, and the display direction of the user interface corresponding to screen C is display direction 1.
[0254] In some embodiments, when the electronic device 100 detects that the difference between the angle β1 and the horizontal plane between the screen A and the angle β2 is within a preset range 20 (i.e., [0°, f10°], for example, f10° = 5°), the vector corresponding to the screen B is When the angle β5 with the Z axis of the geographic coordinate system is greater than 90 degrees and the angle α between screen A and screen B is within the preset range 21 (i.e., [f11, f12]), the electronic device 100 is in the fifth bracket state. Wherein, 0°<f11<f12<180°, for example, f11=30°, f12=150°. For example, Figure 9E shows a schematic diagram of a fifth bracket state of the electronic device 100. It can be understood that in the fifth bracket state, the plane formed by the top and bottom edges of the electronic device 100 is a horizontal plane or a near-horizontal plane, and the electronic device 100 is in a forward semi-folded state.
[0255] In some embodiments, when the electronic device 100 detects that the difference between the angle β1 and the angle β2 between screen A and the horizontal plane is within a preset range 22, the angle β5 between the vector z2 corresponding to screen B and the Z axis of the geographic coordinate system is less than 90 degrees, and the angle α between screen A and screen B is within a preset range 22 (i.e., [f13, f14]), the electronic device 100 is in the sixth bracket state. Wherein, 180°<f13<f14<360°, for example, f13=210°, f14=330°. For example, Figure 9F shows a schematic diagram of a sixth bracket state of the electronic device 100. It can be understood that in the sixth bracket state, the plane formed by the top and bottom edges of the electronic device 100 is a horizontal plane or a near-horizontal plane, and the electronic device 100 is in a reverse semi-folded state.
[0256] It should be noted that, in the fifth bracket state and the sixth bracket state, screen C is in the second physical posture, and the display direction of the user interface corresponding to screen C is display direction 2.
[0257] In the above six support states, there is no need to install an additional support device (such as a mobile phone support) for the electronic device 100. With both hands free, the user can more conveniently view the content displayed on the display screen.
[0258] Illustratively, placing the electronic device 100 in the first bracket state can facilitate the user to view the displayed content of screen C while freeing his hands; placing the electronic device 100 in the second bracket state can facilitate the user to view the displayed content of screens A and B while freeing his hands; placing the electronic device 100 in the third bracket state can facilitate the user to view the displayed content of screen C while freeing his hands. Placing the electronic device 100 in the fourth bracket state can facilitate the user to view the displayed content of screen A while freeing his hands. Placing the electronic device 100 in the fifth bracket state can facilitate the user to view the displayed content of screen C while freeing his hands. Placing the electronic device 100 in the sixth bracket state can facilitate the user to view the displayed content of screen A or screen B while freeing his hands.
[0259] In the display method provided in the embodiment of the present application, when the electronic device 100 detects that the electronic device 100 is in a preset posture and the preset conditions are met, the electronic device 100 activates the camera 1 corresponding to the display screen 1 corresponding to the above preset posture to capture an image, and displays the captured image on the display screen 1. It can be understood that the preset posture of the electronic device 100 can facilitate the user to view the display content of the display screen 1 (i.e., at least one of screens A, B, and C) corresponding to the above preset posture. For example, the display screen 1 displays screen C (i.e., the first screen), and screen C corresponds to the rear camera (i.e., the first camera). For example, the display screen 1 displays screen A (i.e., the second screen), and screen A corresponds to the front camera (i.e., the second camera). In the embodiment of the present application, after the user places the electronic device 100 in the preset posture, the user can activate the camera corresponding to the above preset posture to take a selfie with his hands free, and preview it in real time through the display screen corresponding to the above preset posture, avoiding tedious user operations and effectively improving the user experience.
[0260] Based on the introduction of the hardware structure, display direction and bracket status of the electronic device 100 in the aforementioned embodiment, the display method provided in the embodiment of the present application is described in detail below with reference to the accompanying drawings.
[0261] The following takes the display screen 1 as screen C (i.e., the first screen) as an example to introduce the display method provided in the embodiment of the present application.
[0262] In some embodiments, when electronic device 100 is detected to be in a first preset posture and meets a first preset condition, electronic device 100 displays user interface 11 on screen C. The first preset posture includes: the angle α between screens A and B is within a first preset range. Optionally, electronic device 100 further controls screen A and / or screen B to be turned off.
[0263] It should be noted that controlling screen A (or screen B) to turn off means: if screen A is in the off state, then keep the off state; if screen A is in the lit state, then control screen A to switch to the off state. Displaying the user interface 11 on screen C means: if screen C is in the off state, then light up screen C and display the user interface 11; if screen C is displaying the user interface 12, then switch the display content of screen C to the user interface 11. In one implementation, when the electronic device 100 controls the outer screen (i.e., screen C) to turn on, it also controls the inner screen (i.e., screen A and screen B) to turn off. When the electronic device 100 controls the inner screen to turn on, it also controls the outer screen to turn off. In this way, energy consumption can be effectively saved.
[0264] In some embodiments, after the electronic device 100 controls the C screen to display the user interface 11, it automatically starts the gesture detection service of the rear low-power camera corresponding to the C screen, and uses the above-mentioned low-power camera to detect the user's air gesture operation in real time. In response to the detected air gesture operation, the electronic device 100 can execute the response event corresponding to the above-mentioned air gesture operation. In this way, after the electronic device 100 controls the C screen to display the user interface 11, it can continue to free the user's hands and further realize contactless air interaction.
[0265] In some embodiments, if screen C is currently off, user interface 11 may be the user interface most recently displayed before screen C was off. In some embodiments, user interface 11 is the initial interface corresponding to screen C. In some embodiments, user interface 11 is the user interface most recently displayed on the inner screen (i.e., the display screen composed of screens A and B), thereby enabling continuous display of the inner screen by the outer screen.
[0266] In some embodiments, before the electronic device 100 displays the user interface 11, the rear camera (i.e., the first camera) corresponding to the C screen is started to capture images, and the preview display area of the user interface 11 is used to display the image captured in real time by the rear camera (i.e., the first camera). It can be understood that the image captured in real time by the rear camera is the preview image in the user interface 11. It should be noted that when the C screen corresponds to multiple rear cameras, the user interface 11 includes: images captured by the electronic device 100 through one or more of the above-mentioned multiple rear cameras. Optionally, images captured by the camera with the highest number of pixels among the above-mentioned multiple rear cameras. Optionally, images captured by the macro camera among the above-mentioned multiple rear cameras.
[0267] It should be noted that, in the embodiment of the present application, the user interface 11 displayed on the C screen can be referred to as a first user interface, and the preview display area of the user interface 11 displayed on the C screen can be referred to as a first preview display area.
[0268] It should be noted that in the embodiment of the present application, the rear low-power camera and the first camera corresponding to the C screen can be the same camera or different cameras, and no specific limitation is made here.
[0269] The first preset condition mentioned above is introduced below.
[0270] In some embodiments, the first preset condition includes that the pause time of the electronic device 100 at the current angle value reaches a first preset time, for example, the first preset time is 3 seconds.
[0271] In some embodiments, when screen C is in the illuminated state, the first preset condition further includes that the electronic device 100 does not receive any user input operation on screen C within a second preset time. For example, the second preset time is 2 seconds.
[0272] In some embodiments, the above-mentioned first preset condition also includes the electronic device 100 detecting a face (or the face of a preset user) through the rear camera corresponding to the C screen. Specifically, the electronic device 100 turns on the face detection service of the low-power camera corresponding to the C screen, and uses a face recognition algorithm to detect whether the image captured by the above-mentioned low-power camera includes a face (or the face of a preset user). Optionally, after the electronic device 100 is turned on, the electronic device 100 turns on the face detection service of the low-power camera corresponding to the C screen. Optionally, when the electronic device 100 is in the first preset posture, the electronic device 100 turns on the face detection service of the low-power camera corresponding to the C screen. Optionally, when the electronic device 100 is in the first preset posture and meets other conditions included in the first preset condition, the electronic device 100 turns on the face detection service of the low-power camera corresponding to the C screen.
[0273] In some embodiments, the above-mentioned first preset condition also includes the electronic device 100 detecting a first preset gesture through the rear camera corresponding to the C screen. The first preset gesture is used to trigger the C screen to display the user interface 11 when the electronic device 100 is in the first preset posture. Specifically, the electronic device 100 turns on the gesture detection service of the low-power camera corresponding to the C screen, and uses a gesture recognition algorithm to detect whether the image captured by the above-mentioned low-power camera includes a preset gesture. Optionally, after the electronic device 100 is turned on, the electronic device 100 turns on the gesture detection service of the low-power camera corresponding to the C screen. Optionally, when the electronic device 100 is in the first preset posture, the electronic device 100 turns on the gesture detection service of the low-power camera corresponding to the C screen. Optionally, when the electronic device 100 is in the first preset posture and meets other conditions included in the first preset condition, the electronic device 100 turns on the gesture detection service of the low-power camera corresponding to the C screen.
[0274] In some embodiments, the first preset range includes at least one of a preset range 16 (ie, [f2, f3]), a preset range 18 (ie, [f6, f7]), and a preset range 21 (ie, [f11, f12]).
[0275] The first preset posture is introduced below.
[0276] In some embodiments, the first preset posture specifically includes: the included angle α between screen A and screen B decreases to (and / or increases to) α1, and α1 is within a first preset range.
[0277] In some embodiments, in the first preset posture, the first preset range does not include 0° and 180°.
[0278] In some embodiments, the first preset posture also includes the electronic device 100 being in a first bracket state. In the first preset posture, the first preset range is [d1, d2], and [d1, d2] is within the preset range 16 (i.e., [f2, f3]), i.e., f2≤d1≤d2≤f3. Exemplarily, referring to Figure 10A, the angle α between screen A and screen B is within [d1, d2], the electronic device 100 controls the inner screen to turn off, and displays the user interface 11 rotated 180° on screen C, and the user interface 11 includes an image captured by the rear camera. Optionally, the angle within the first preset range is greater than 0° and less than 120°.
[0279] In some embodiments, the first preset posture also includes the electronic device 100 being in a third bracket state. In the first preset posture, the first preset range is [d3, d4], and [d3, d4] is within the preset range 18 (i.e., [f6, f7]), i.e., f6≤d3≤d4≤f7. Exemplarily, referring to Figure 10B, the angle α between screen A and screen B is within [d3, d4], the electronic device 100 controls the inner screen to turn off, and displays the user interface 11 rotated 180° on screen C, and the user interface 11 includes an image captured by the rear camera. Optionally, the angle within the first preset range is greater than 180° and less than 300°.
[0280] In some embodiments, the first preset posture also includes the electronic device 100 being in the fifth bracket state. In the first preset posture, the first preset range is [d5, d6], and [d5, d6] is within the preset range 21 (i.e., [f11, f12]), i.e., f11≤d5≤d6≤f12. Exemplarily, referring to Figure 10C, the angle α between screen A and screen B is within [d5, d6], the electronic device 100 controls the inner screen to turn off, and displays the user interface 11 on screen C in the default display direction, and the user interface 11 includes an image captured by the rear camera. Optionally, the angle within the first preset range is greater than 0° and less than 180°.
[0281] It should be noted that since the default display direction of screen C is display direction 2, when the electronic device 100 is in the first bracket state and the third bracket state, the corresponding display direction of screen C is display direction 1. Therefore, the electronic device 100 shown in Figures 10A and 10B rotates the user interface 11 180° before displaying it on screen C.
[0282] The following describes several situations in which screen C stops displaying the user interface 11 after screen C displays the user interface 11.
[0283] In some embodiments, referring to FIG10A , after controlling the C screen of the electronic device 100 that meets the first preset condition in the first bracket state to display the user interface 11, when the electronic device 100 detects that the angle α between the A screen and the B screen exceeds [d1, d2], or detects that the electronic device 100 is out of the first bracket state, or detects that the electronic device 100 is folded into an unfolded form, the electronic device 100 stops displaying the user interface 11 on the C screen. For example, when the user continues to fold the electronic device 100 in the first bracket state so that the angle α is less than 5°, the electronic device 100 stops displaying the user interface 11 on the C screen. For example, when the user continues to unfold the electronic device 100 in the first bracket state so that the angle α is greater than 90°, the electronic device 100 stops displaying the user interface 11 on the C screen.
[0284] In some embodiments, referring to Figure 10B, after controlling the C screen of the electronic device 100 that meets the first preset condition in the third bracket state to display the user interface 11, when the electronic device 100 detects that the angle α between the A screen and the B screen exceeds [d3, d4], or detects that the electronic device 100 is out of the third bracket state, or detects that the electronic device 100 is folded into the unfolded form, the electronic device 100 stops displaying the user interface 11 on the C screen.
[0285] In some embodiments, referring to Figure 10B, after controlling the C screen of the electronic device 100 that meets the first preset condition in the fifth bracket state to display the user interface 11, when the electronic device 100 detects that the angle α between the A screen and the B screen exceeds [d5, d6], or detects that the electronic device 100 is out of the fifth bracket state, or detects that the electronic device 100 is folded into the unfolded form, the electronic device 100 stops displaying the user interface 11 on the C screen.
[0286] In some embodiments, the first preset condition includes detecting a human face (or the face of a preset user) through a rear low-power camera, and controlling the C-screen display user interface 11 of the electronic device 100 that meets the first preset condition. When no human face (or the face of a preset user) is detected through the above-mentioned low-power camera within a third preset time, the electronic device 100 stops displaying the user interface 11 on the C-screen and turns off the face detection service of the low-power camera.
[0287] In some embodiments, the electronic device 100 detects a preset gesture 1 of the user using a low-power camera corresponding to the C screen. In response to the preset gesture 1 , the electronic device 100 stops displaying the user interface 11 on the C screen.
[0288] In some embodiments, the electronic device 100 stops displaying the user interface 11 on the C screen, specifically including: the electronic device 100 controls the C screen to turn off; or the electronic device 100 controls the C screen to display other preset interfaces, such as the initial interface corresponding to the C screen, such as the user interface most recently displayed on the C screen before displaying the user interface 11.
[0289] Regarding “the preview display area of the user interface 11 includes an image captured in real time by the rear camera”, the user interface 11 is described in detail below.
[0290] In some embodiments, after the electronic device 100 determines that the first preset condition is met, it starts application 1, calls the rear camera corresponding to screen C through application 1 to capture images, and displays the captured images on screen C through the user interface 11 corresponding to application 1.
[0291] For example, referring to Figure 11A , the preview display area of the user interface 11 is used to display the image captured by the rear camera corresponding to screen C. Optionally, the user interface 11 shown in Figure 11A is a user interface of a mirror application.
[0292] It should be noted that the C screen shown in Figure 11A displays the image captured by the above-mentioned rear camera in full screen, and the preview display area of the user interface 11 occupies the entire C screen; in this embodiment of the present application, the preview display area of the user interface 11 may also occupy only a partial area of the C screen, which is not specifically limited here.
[0293] In some embodiments, the rear camera corresponding to the aforementioned C-screen includes an ultraviolet (UV) camera, and the user interface 11 includes images captured by the UV camera, which uses ultraviolet light as a light source. For example, referring to the user interface 11 shown in FIG11B , since sunscreen blocks ultraviolet rays, the image captured by the UV camera can highlight areas where sunscreen has been applied. Thus, through the user interface 11 displayed on the C-screen, the user can view the application status of sunscreen in real time.
[0294] In some embodiments, referring to FIG11C , the user interface 11 may further include a makeup trial control 201. Exemplarily, the makeup trial control 201 may receive a user input operation (e.g., a touch operation). In response to the input operation, the electronic device 100 displays at least one makeup trial option 202 shown in FIG11D , such as a lipstick option 202A, a blush option 202B, a contouring option, an eyebrow option, an eyelash option, an eyeshadow option, an eyeliner option, and the like.
[0295] In some embodiments, the makeup trial option 1 in the at least one makeup trial option 203 can receive a user input operation (e.g., a touch operation). In response to the input operation, the electronic device 100 displays at least one makeup trial style corresponding to the makeup trial option 1. After the user selects makeup trial style 1 in the at least one makeup trial style, the electronic device 100 can add a makeup trial effect corresponding to the makeup trial style to the face captured by the camera and display it in the user interface 11. In this way, through the user interface 11 displayed on the C screen, the user can preview the makeup trial effect in real time through the C screen. The application 1 corresponding to the user interface 11 can be a makeup trial application.
[0296] For example, taking makeup trial option 1 as lipstick option 202A, the trial style corresponding to lipstick option 202A is a lipstick color number. In response to an input operation for lipstick option 202A, electronic device 100 displays at least one lipstick color number corresponding to lipstick option 202A as shown in FIG11E , such as color number 203A and color number 203B. For example, color number 203A can receive a user input operation (e.g., a touch operation). In response to the above input operation, electronic device 100 transforms the lip color of the face captured in real time by the camera displayed on user interface 11 into color number 203A as shown in FIG11F .
[0297] Similarly, referring to the lipstick option 202A, the user can also select a corresponding trial makeup style through other trial makeup options and preview various trial makeup effects in real time. For example, the trial makeup style corresponding to the blush option 202B can indicate the blush color number, blush position and / or blush shape.
[0298] In some embodiments, referring to FIG12A , the user interface 11 may further include a capture control 204. The application 1 corresponding to the user interface 11 may be a camera application. Optionally, after the user selects a makeup trial style (e.g., color 203A), in response to an input operation on the capture control 204, the electronic device 100 may store the image currently displayed on screen C after adding the makeup trial effect.
[0299] In some embodiments, referring to FIG12B , the user interface 11 may include a camera switching control 205 , which can switch the camera used to capture the image displayed on screen C to another camera. It is understood that the electronic device 100 may include multiple cameras. Exemplarily, the camera switching control 205 can receive user input operations. In response to such operations, the electronic device 100 directly switches the current camera to another preset camera, or displays at least one camera option shown in FIG12C , such as the front camera 205A, the rear telephoto camera 205B, and the rear UV camera 205C. The user can select a target camera from the at least one camera option.
[0300] In some embodiments, if the user chooses to switch the rear camera corresponding to the C screen used for image capture to the front camera, the electronic device 100 further displays a prompt message in response to the user's input operation, and the prompt message is used to prompt the user to fold the electronic device 100 so that the electronic device 100 can capture images through the front camera. For example, the user is prompted to fold the electronic device 100 to the unfolded state (or the second stand state, the fourth stand state, or the sixth stand state).
[0301] In some embodiments, referring to FIG12D , the user interface 11 may further include a fill light control 206. Optionally, in response to an input operation (e.g., a touch operation) on the fill light control 206, the electronic device 100 may display at least one fill light option shown in FIG12E , such as a flash auto fill light control 206A, a flash off control 206B, a flash on control 206C, and a display fill light control 206D. When the user selects the flash auto fill light control 206A, the electronic device 100 may determine whether to turn on the flash based on the ambient light level.
[0302] For example, referring to FIG12F , in response to an input operation (e.g., a touch operation) on the display fill light control 206D, the electronic device 100 increases the brightness of the preset fill light area of screen C. In the embodiment of the present application, the position, shape, and brightness of the preset fill light area can be set by the user or by default by the electronic device 100, and are not specifically limited here.
[0303] In some embodiments, referring to FIG12G , the user interface 11 may further include at least one shooting mode 207 corresponding to a shooting control, such as night mode, portrait mode, large aperture mode, photo mode, video mode, professional mode, etc. After the user selects a shooting mode, the electronic device 100 controls the camera to capture images in that shooting mode and displays them in the user interface 11 corresponding to the C screen. The user interface 11 may further include an album control 208. The album control 208 may receive user input operations, and in response to the input operations, the electronic device 100 may display the user interface of the album application.
[0304] In some embodiments, referring to FIG12H , the user interface 11 may further include a local feature display frame 210. For example, referring to FIG12I , the electronic device 100 identifies the area 1 (i.e., the first area) where the preset local feature (e.g., a face) in the image 1 captured by the camera is located, and displays the image in area 1 in the display frame 210. It will be understood that in this implementation, the electronic device 100 may continuously track the preset local feature (e.g., a face) within the shooting range of the camera, and display the local feature in real time in the display frame 210. Optionally, the electronic device 100 magnifies the image of the preset local feature in area 1 and then displays it in the display frame 210, so that the user can preview the details of the preset local feature.
[0305] It should be noted that, in the embodiment of the present application, area 1 may also be referred to as the first area.
[0306] In some embodiments, the display frame 210 shown in FIG12H can receive user input operations, see FIG12J . In response to the input operations, the electronic device 100 can enlarge the image of the preset local feature in area 1 and display it in full screen on screen C. Then, screen C shown in FIG12J can also receive user input operations (e.g., double-clicking screen C). In response to the input operations, the electronic device 100 can shrink the image of the preset local feature back to the display frame 210, i.e., display the user interface 11 shown in FIG12H again.
[0307] In some embodiments, when it is detected that the electronic device 100 is in a first preset posture and the electronic device 100 meets the first preset condition, the electronic device 100 displays a partially enlarged image of the image captured by the camera in the user interface 11 corresponding to the C screen. Optionally, referring to Figure 12I, the electronic device 100 identifies the area 1 where the preset local features (such as a face) of the image 1 captured by the camera are located, and the above-mentioned partially enlarged image is an enlarged image of the preset local features in the area 1 shown in Figure 12J. Optionally, the above-mentioned locally enlarged image is an enlarged image of the central area of the image 1 captured by the camera. It should be noted that the user interface 11 shown in Figure 12J may also include other interface elements of the user interface 11 shown in Figure 12G (such as the makeup trial control 201).
[0308] In some embodiments, referring to FIG12A or FIG12J , when it is detected that the electronic device 100 is in a first preset posture and the electronic device 100 meets the first preset condition, the user interface 11 displayed on the C screen by the electronic device 100 only includes the image captured by the camera corresponding to the C screen (or a partially enlarged image of the above image); then, the electronic device 100 responds to the received first input operation of the user, and the electronic device 100 can display other interface elements of the user interface 11, such as one or more of the makeup test control 201, the shooting control 204, the camera switching control 205, the fill light control 206, the shooting mode 207, the album control 208, the setting control 209 and the preview box 210. The above-mentioned first input operation can be a touch operation acting on the C screen (for example, the user's finger touches the display screen of the electronic device 100), or it can be a preset air gesture, which is not specifically limited here.
[0309] In some embodiments, the image displayed on user interface 11 is a partially enlarged image of the image captured by the camera. The user can drag the image displayed on user interface 11 to view other areas of the original image captured by the camera. For example, the electronic device 100 shown in FIG12J displays an image within area 1 of the image captured by the camera in real time on user interface 11; the image shown in FIG12J can receive a user's sliding operation (e.g., an upward sliding operation); referring to FIG12K , in response to the sliding operation, the electronic device 100 moves the position of area 1 in a direction opposite to the sliding direction of the sliding operation; referring to FIG12L , the electronic device 100 displays an enlarged image of the image within area 1 after the movement on user interface 11.
[0310] It should be noted that visually, in response to the user's sliding operation, the image displayed on the user interface 11 moves along the user's sliding direction. The sliding operation can be a touch operation or an air gesture, which is not specifically limited here.
[0311] In some embodiments, the user can zoom in and out on the image displayed on the user interface 11. For example, the electronic device 100 shown in FIG12J displays an image within region 1 of the image captured by the camera in real time on the user interface 11; the image shown in FIG12J can receive a zoom operation (e.g., a zoom-out operation) from the user; referring to FIG12M , in response to the zoom operation, the electronic device 100 zooms in on the size of region 1; referring to FIG12N , the electronic device 100 displays an enlarged image of the zoomed image within region 1 on the user interface 11.
[0312] It should be noted that the electronic device 100 can enlarge the size of area 1 based on the user's zoom-out operation; visually, the image displayed on the user interface 11 is reduced in response to the user's zoom-out operation. The electronic device 100 can enlarge the size of area 1 based on the user's zoom-in operation; visually, the image displayed on the user interface 11 is magnified in response to the user's zoom-in operation. The above-mentioned zoom-in operation can be a touch operation or an air gesture, which is not specifically limited here.
[0313] In some embodiments, referring to FIG. 12J , when it is detected that the electronic device 100 is in a first preset posture and the electronic device 100 satisfies a first preset condition, the electronic device 100 displays the image captured by the macro camera in the user interface 11 corresponding to the C screen.
[0314] The following takes the display screen 1 as screen A (i.e., the second screen) as an example to introduce the display method provided in the embodiment of the present application.
[0315] In some embodiments, when electronic device 100 is detected to be in a second preset posture and meets a second preset condition, electronic device 100 displays user interface 11 on screen A. The second preset posture includes: the angle α between screens A and B is within a second preset range. Optionally, electronic device 100 further controls screen C and / or screen B to be turned off.
[0316] In some embodiments, referring to Figures 13A to 13F, after the electronic device 100 controls screen A to display the user interface 11, it can use the gesture detection service of the front low-power camera corresponding to screen A to detect the user's air gesture operation in real time. In response to the detected air gesture operation, the electronic device 100 can execute the response event corresponding to the above-mentioned air gesture operation. In this way, after the electronic device 100 controls screen A to display the user interface 11, it can continue to free the user's hands and further realize touchless air interaction.
[0317] In some embodiments, if screen A is currently off, user interface 11 may be the user interface most recently displayed before screen A (or the inner screen) is off. Specifically, if screen A and screen B are independently displayed in split-screen mode before screen A is off, user interface 11 may be the user interface most recently displayed before screen A is off; if the inner screen composed of screens A and B is displayed in full screen mode before screen A is off, user interface 11 may be the user interface most recently displayed in full screen mode before the inner screen is off.
[0318] In some embodiments, the user interface 11 is a main interface corresponding to the inner screen.
[0319] In some embodiments, before displaying user interface 11, electronic device 100 activates the front-facing camera (i.e., the second camera) corresponding to screen A to capture an image. The preview display area of user interface 11 is used to display the image captured by the front-facing camera (i.e., the second camera) in real time. It should be noted that when screen A corresponds to multiple front-facing cameras, user interface 11 includes images captured by electronic device 100 via one or more of the multiple front-facing cameras.
[0320] It should be noted that, in the embodiment of the present application, the user interface 11 displayed on screen A can be referred to as a second user interface, and the preview display area of the user interface 11 displayed on screen A can be referred to as a second preview display area.
[0321] It should be noted that in the embodiment of the present application, the low-power camera and the second camera corresponding to the above-mentioned screen A can be the same camera or different cameras, and no specific limitation is made here.
[0322] The second preset condition mentioned above is introduced below.
[0323] In some embodiments, the second preset condition includes that the pause time of the electronic device 100 at the current angle value reaches a first preset time, for example, the first preset time is 3 seconds.
[0324] In some embodiments, when screen A is in the illuminated state, the second preset condition further includes that the electronic device 100 does not receive any user input operation on screen A within a second preset time. For example, the second preset time is 2 seconds.
[0325] In some embodiments, the second preset condition further includes the electronic device 100 detecting a human face (or the face of a preset user) through the front low-power camera corresponding to screen A.
[0326] In some embodiments, the second preset condition further includes the electronic device 100 detecting a second preset gesture via a front-mounted low-power camera corresponding to screen A. The second preset gesture is used to trigger screen A to display the user interface 11 when the electronic device 100 is in the second preset posture.
[0327] In some embodiments, the second preset range includes at least one of a preset range 17 (ie, [f4, f5]), a preset range 19 (ie, [f8, f9]), and a preset range 22 (ie, [f13, f14]).
[0328] The second preset posture is introduced below.
[0329] In some embodiments, the second preset posture specifically includes: the included angle α between screen A and screen B decreases to (and / or increases to) α2, and α2 is within the second preset range.
[0330] In some embodiments, the second preset posture also includes the electronic device 100 being in a second bracket state. In the second preset posture, the second preset range is [d7, d8], and [d7, d8] is within the preset range 17 (i.e., [f4, f5]), i.e., f4≤d7≤d8≤f5. Exemplarily, referring to Figures 13A and 13B, the angle α between screen A and screen B is within [d7, d8], the electronic device 100 controls screen C to turn off, screen B to be white or off, and displays the user interface 11 on screen A according to the default display direction of screen A, and the user interface 11 includes an image captured by the front camera. Optionally, the angle within the second preset range is greater than 60° and less than 180°.
[0331] In some embodiments, the second preset posture also includes the electronic device 100 being in the fourth bracket state. In the second preset posture, the second preset range is [d9, d10], and [d9, d10] is within the preset range 19 (i.e., [f8, f9]), i.e., f8≤d9≤d10≤f9. Exemplarily, referring to Figures 13C and 13D, the angle α between screen A and screen B is within [d9, d10], the electronic device 100 controls screen C and screen B to turn off, and displays the user interface 11 on screen A according to the default display direction of screen A, and the user interface 11 includes an image captured by the front camera. Optionally, the angle within the second preset range is greater than 240° and less than 360°.
[0332] In some embodiments, the second preset posture also includes the electronic device 100 being in the sixth stand state. In the second preset posture, the second preset range is [d11, d12], and [d11, d12] is within the preset range 22 (i.e., [f13, f14]), i.e., f13≤d11≤d12≤f14. Exemplarily, referring to Figures 13E and 13F, the angle α between screen A and screen B is within [d11, d12]. The electronic device 100 controls the inner screen to turn off and displays the user interface 11 rotated 180° on screen A. The user interface 11 includes an image captured by the front camera. Optionally, the angle within the second preset range is greater than 180° and less than 360°.
[0333] In some embodiments, in the second preset posture, the second preset range does not include 0° and 180°.
[0334] It should be noted that when the electronic device 100 is in the sixth bracket state, the display direction corresponding to screen A is opposite to the default display direction of screen A. Therefore, the electronic device 100 shown in Figures 13E and 13F rotates the user interface 11 180° before displaying it on screen A.
[0335] The following describes several situations in which screen A stops displaying the user interface 11 after screen A displays the user interface 11.
[0336] In some embodiments, referring to Figures 13A and 13B, after controlling the A screen of the electronic device 100 that meets the second preset condition in the second bracket state to display the user interface 11, when the electronic device 100 detects that the angle α between screen A and screen B exceeds [d7, d8], or detects that the electronic device 100 is out of the second bracket state, the electronic device 100 stops displaying the user interface 11 on screen A.
[0337] In some embodiments, referring to Figures 13C and 13D, after controlling the A screen of the electronic device 100 that meets the second preset condition in the fourth bracket state to display the user interface 11, when the electronic device 100 detects that the angle α between screen A and screen B exceeds [d9, d10], or detects that the electronic device 100 is out of the fourth bracket state, the electronic device 100 stops displaying the user interface 11 on screen A.
[0338] In some embodiments, referring to Figures 13E and 13F, after controlling the A screen of the electronic device 100 that meets the second preset condition in the sixth bracket state to display the user interface 11, when the electronic device 100 detects that the angle α between screen A and screen B exceeds [d11, d12], or detects that the electronic device 100 is out of the sixth bracket state, the electronic device 100 stops displaying the user interface 11 on screen A.
[0339] In some embodiments, the second preset condition includes detecting a human face (or the face of a preset user) through the front low-power camera, controlling the A screen of the electronic device 100 that meets the second preset condition to display the user interface 11, and when no face is detected through the front low-power camera within a third preset time, the electronic device 100 stops displaying the user interface 11 on the A screen and turns off the face detection service of the front low-power camera.
[0340] In some embodiments, the electronic device 100 detects a preset gesture 2 of the user using a low-power camera corresponding to screen A. In response to the preset gesture 2 , the electronic device 100 stops displaying the user interface 11 on screen A.
[0341] In some embodiments, the electronic device 100 stops displaying the user interface 11 on screen A, specifically including: the electronic device 100 controls screen A to turn off; or the electronic device 100 controls screen A to display other preset interfaces, such as part or all of the main interface corresponding to the inner screen, such as the user interface most recently displayed on screen A before displaying the user interface 11.
[0342] In some embodiments, referring to Figures 13A to 13F, after the A screen of the electronic device 100 that meets the second preset condition displays the user interface 11, when it is detected that the electronic device 100 is directly folded into the unfolded form, the electronic device 100 controls the inner screens (screens A and B) to display the preset interface in full screen, for example, the user interface 11 shown in Figure 14A or the main interface 12 shown in Figure 14B is displayed in full screen.
[0343] It should be noted that the user interface 11 displayed on the aforementioned screen A may be the user interface 11 described in the relevant embodiments of the aforementioned Figures 11A to 12N. The difference is that the image in the preview display area of the user interface 11 displayed on the screen A is captured by the electronic device 100 through the front camera corresponding to the screen A. For details, please refer to the relevant description of the aforementioned embodiment, which will not be repeated here. In addition, in the embodiment of the present application, the sizes of the screen A, screen C and inner screen may be different, and the same user interface (such as user interface 11) displayed on the screen A, screen C and inner screen may contain the same interface elements. The sizes of the user interfaces 11 displayed on the three display screens may be different, and the layout (i.e., position and size) of each interface element of the user interface 11 displayed on the three display screens may be different. The layout of each interface element of the user interface 11 displayed on each display screen (such as screen C, screen A, inner screen) is associated with the size of the display screen.
[0344] In some embodiments, referring to the user interface 11 shown in Figures 12B to 12H, if the user chooses to switch the front camera (i.e., the second camera) corresponding to screen A for image capture to the rear camera (i.e., the first camera), then in response to the user's input operation, the electronic device 100 further displays a prompt message, which prompts the user to fold the electronic device 100 so that the electronic device 100 can capture images through the rear camera. For example, the user is prompted to fold the electronic device 100 to an unfolded state (or a first stand state, a third stand state, or a fifth stand state).
[0345] The following takes the display screen 1 as screen A (i.e., the second screen) and screen B (i.e., the third screen) as an example to introduce the display method provided in the embodiment of the present application.
[0346] In some embodiments, referring to FIG15A , when the electronic device 100 detects that the electronic device 100 is in a third preset posture and the electronic device 100 satisfies the third preset condition, the electronic device 100 activates the front camera (i.e., the second camera) corresponding to screen A to capture an image, and displays the user interface 11 on screen A, and displays a partially enlarged image of the image captured by the front camera (i.e., the second camera) on screen B. The preview display area of the user interface 11 is used to display the image captured by the front camera. The partially enlarged image is an enlarged image of a preset local feature in the image captured by the front camera, such as the enlarged image of the face shown in FIG15A .
[0347] In some embodiments, referring to FIG15B , when the electronic device 100 detects that the electronic device 100 is in a third preset posture and that the electronic device 100 satisfies the third preset condition, the electronic device 100 activates the front camera (i.e., the second camera) corresponding to screen A to capture an image, and displays the user interface 11 on screen B. A partially enlarged image of the image captured by the front camera (i.e., the second camera) is displayed on screen A, and the preview display area of the user interface 11 includes the image captured by the front camera. The partially enlarged image is an enlarged image of a preset local feature in the image captured by the front camera.
[0348] Referring to Figures 15A and 15B, in the second bracket state, the user can preview the image captured by the camera in real time on one screen of the inner screen (for example, screen A), and at the same time view the enlarged image of the preset local features in the image captured by the camera (for example, an enlarged image of the face) on another screen of the inner screen (for example, screen B), so that the user can see the facial details while previewing the overall shooting effect, effectively improving the user experience.
[0349] In some embodiments, referring to FIG15B , when the electronic device 100 detects that the electronic device 100 is in a third preset posture and the electronic device 100 satisfies the third preset condition, the electronic device 100 activates the front camera (i.e., the second camera) corresponding to screen A to capture images at shooting angle 1 and shooting angle 2, respectively, and displays the image captured at shooting angle 1 on screen A, and displays the image captured at shooting angle 2 on screen B. Optionally, screen A and / or screen B may also display other interface elements in addition to the image captured by the camera shown in FIG12G . In this way, the user can view the shooting effects at different shooting angles at the same time.
[0350] In some embodiments, referring to FIG. 15C , when the electronic device 100 detects that the electronic device 100 is in a third preset posture and that the electronic device 100 satisfies a third preset condition, the front camera corresponding to screen A is activated to capture an image, and the user interface 11 is displayed on screens A and B in a split screen, i.e., the first portion of the user interface 11 is displayed on screen A, and the second portion of the user interface 11 is displayed on screen B. The first portion of the user interface 11 includes a preview display area of the user interface 11, which is used to display the image captured in real time by the front camera, and the second portion of the user interface 11 includes one or more interface elements in the user interface 11 other than the display content of screen A. The third preset posture includes: the angle α between screens A and B is within a third preset range. Optionally, the electronic device 100 also controls screen C to turn off.
[0351] It should be noted that, in the embodiment of the present application, the user interface 11 displayed in split screens A and B can be referred to as a third user interface, and the preview display area of the third user interface can be referred to as a third preview display area.
[0352] In some embodiments, referring to Figures 15A to 15C, after the electronic device 100 controls the split-screen display of screens A and B, it can use the gesture detection service of the low-power camera corresponding to screen A to detect the user's air gesture operation in real time. In response to the detected air gesture operation, the electronic device 100 can execute the response event corresponding to the above-mentioned air gesture operation. In this way, after the electronic device 100 controls the split-screen display of screens A and B, it can continue to free the user's hands and further realize touchless air interaction.
[0353] The third precondition mentioned above is introduced below.
[0354] In some embodiments, the third preset condition includes that the pause time of the electronic device 100 at the current angle value reaches a first preset time, for example, the first preset time is 3 seconds.
[0355] In some embodiments, when screens A and B are in the illuminated state, the third preset condition further includes that the electronic device 100 does not receive any user input operation on screens A and B within a second preset time. For example, the second preset time is 2 seconds.
[0356] In some embodiments, the third preset condition further includes the electronic device 100 detecting a face (or the face of a preset user) through the front low-power camera corresponding to screen A.
[0357] In some embodiments, the third preset condition further includes the electronic device 100 detecting a third preset gesture via the front low-power camera corresponding to screen A. The third preset gesture is used to trigger split-screen display of screens A and B when the electronic device 100 is in the third preset posture.
[0358] The third preset posture is introduced below.
[0359] In some embodiments, the third preset posture specifically includes: the included angle α between screen A and screen B decreases to (and / or increases to) α3, and α3 is within a third preset range.
[0360] In some embodiments, in the third preset posture, the third preset range does not include 0° and 180°.
[0361] In some embodiments, the third preset posture also includes the electronic device 100 being in the second bracket state. In the third preset posture, the third preset range is [d7, d8], and [d7, d8] is within the preset range 17, that is, f4≤d7≤d8≤f5. Exemplarily, referring to Figure 15C, the angle α between screen A and screen B is within [d7, d8], the electronic device 100 controls screen A to display the image captured in real time by the front camera, screen B to display other interface elements of the user interface 11, and screen C to be off. Optionally, the angle within the third preset range is greater than 60° and less than 180°.
[0362] It should be noted that the user interface 11 displayed on the split screen of screens A and B can be the user interface 11 described in the relevant embodiments of Figures 11A to 12N . The difference is that the image in the preview display area of the user interface 11 displayed on the split screen of screens A and B is captured by the electronic device 100 through the front camera corresponding to screen A. For details, please refer to the relevant description of the aforementioned embodiments, which will not be repeated here. The following description takes the user interface 11 shown in Figure 12G as an example.
[0363] The user interface 11 for split-screen display of screen A and screen B is introduced below.
[0364] In some embodiments, referring to FIG15D , the first part of the user interface 11 displayed on screen A includes only the image captured in real time by the front camera, and the second part of the user interface 11 displayed on screen B includes all other interface elements in the user interface 11 except the above-mentioned image, and the layout of each interface element displayed on screen B is associated with the interface layout of the user interface 11 shown in FIG12G , and the electronic device 100 stores the interface layout of the user interface 11 shown in FIG12G .
[0365] In some embodiments, the second part of the user interface 11 displayed on the B screen includes all the other interface elements mentioned above, as well as secondary interface elements of one or more of the interface elements among all the other interface elements mentioned above. For example, as shown in FIG15E , the second part of the user interface 11 displayed on the B screen includes the makeup trial control 201 and the fill light control 206 of the user interface 11, and also includes secondary interface elements corresponding to the makeup trial control 201, namely one or more makeup trial options 202, and also includes secondary interface elements corresponding to the fill light control 206, namely one or more fill light options. Referring to FIG15E , unlike the interface layout of the user interface 11 shown in FIG12G , the electronic device 100 can rearrange the interface elements of the user interface 11 displayed on the B screen to adapt to the size of the B screen and enhance the user experience.
[0366] In some embodiments, the first portion of the user interface 11 displayed on screen A includes an image captured in real time by the front-facing camera, as well as at least one other interface element of user interface 11, and the second portion of the user interface 11 displayed on screen B includes interface elements in user interface 11 other than the display content of screen A. For example, as shown in FIG15F , the display content of screen A includes the image captured in real time by the front-facing camera, as well as a capture control 204, a camera switching control 205, and an album control 208. The display content of screen B includes a makeup trial control 201 and its corresponding secondary interface elements, a fill light control 206 and its corresponding secondary interface elements, and a capture mode 207.
[0367] As shown in Figures 15D to 15F, in the second stand state, the user can preview the image captured by the camera in real time on Screen A, and control the camera shooting parameters and the display effect of the image captured by the camera on Screen B. For example, in the second stand state, the user can view their facial condition in real time on Screen A, modify the fill light parameters using the fill light options displayed on Screen B, and modify the makeup effect of the face displayed on Screen A using the makeup trial options displayed on Screen B, effectively improving the user experience.
[0368] The following describes several situations in which screens A and B stop displaying the preset content (such as user interface 11) after screens A and B display the preset content in split screen.
[0369] In some embodiments, referring to Figures 15A to 15F, after controlling the inner screen of the electronic device 100 that meets the third preset condition in the second bracket state to display the preset content in split screen, when the electronic device 100 detects that the angle α between screen A and screen B exceeds [d7, d8], or detects that the electronic device 100 is out of the second bracket state, the electronic device 100 stops displaying the above preset content in split screen of screen A and screen B.
[0370] In some embodiments, the third preset condition includes detecting a human face (or the face of a preset user) through the front low-power camera, controlling the split screen display of the electronic device 100 that meets the third preset condition to display preset content, and when no human face is detected through the front low-power camera within the third preset time, the electronic device 100 stops displaying the above-mentioned preset content on the split screen of screen A and screen B, and turns off the face detection service of the front low-power camera.
[0371] In some embodiments, the electronic device 100 detects the user's preset gesture 3 using the low-power camera corresponding to screen A. In response to the preset gesture 3, the electronic device 100 stops displaying the preset content on screens A and B in split screens.
[0372] In some embodiments, the electronic device 100 stops displaying the above preset content on screens A and B in split screen, specifically including: the electronic device 100 controls the inner screen to turn off; or the electronic device 100 controls screens A and B to display other preset interfaces in split screen, such as the main interface corresponding to the inner screen.
[0373] In some embodiments, referring to Figures 15A to 15F, after the A screen and the B screen of the electronic device 100 that meets the third preset condition display the preset content (for example, the user interface 11) in split screen, when it is detected that the electronic device 100 is directly folded into the unfolded form, the electronic device 100 controls the inner screen (screen A and screen B) to display the preset interface in full screen, for example, the user interface 11 shown in Figure 14A or the main interface 12 shown in Figure 14B is displayed in full screen.
[0374] The software structure of the electronic device 100 is exemplarily described below.
[0375] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.
[0376] FIG16 is a software structure block diagram of an electronic device 100 provided in an embodiment of the present application.
[0377] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0378] The application (APP) layer can include a series of application packages. As shown in Figure 16, the application package can include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.
[0379] The application framework layer (Framework) provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions. As shown in Figure 16, the framework layer may include a sensor management module (sensor manager) 707, a posture recognition module (posture recognition) 708, a display management module (display manager) 709, and a window management module (window manager service, WMS) 710. Optionally, it may also include an activity manager (activity manager service, AMS), a content provider, a view system, a phone manager, a resource manager, a notification manager, etc. (not shown in the figure).
[0380] The window manager is used to manage window programs. It can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.
[0381] The hardware abstraction layer (HAL) includes a sensor service module 706, which can be used to report the processing results of the sensor data processing module 705 in the kernel layer to the sensor management module 707 in the framework layer. In some embodiments, the hardware abstraction layer also includes a camera detection service module 713, which can be used to report the image processing results of the camera detection data processing module 712 in the kernel layer to the face recognition module 714 and gesture recognition module 715 in the framework layer.
[0382] The kernel layer (Kernel) is the layer between hardware and software. The kernel layer may include a sensor data processing module 705. Specifically, the sensor data processing module 705 may be used to obtain data reported by one or more sensors in the hardware layer (Hardware), perform data processing, and report the data processing results to the sensor service module 706. In some embodiments, the kernel layer may also include a camera detection data processing module 712. The camera detection data processing module 712 may be used to obtain images reported by the camera 711 in the hardware layer, perform image processing, and report the image processing results to the camera detection service module 713.
[0383] The hardware layer may include an accelerometer 701, a gyroscope sensor 702, an accelerometer 703, a gyroscope sensor 704, and the like. The accelerometer 701 and the gyroscope sensor 702 may be provided in screen A of the electronic device 100, while the accelerometer 703 and the gyroscope sensor 704 may be provided in screen B of the electronic device 100. The accelerometer 701 may be used to measure acceleration data of screen A and report it to the sensor data processing module 705. The accelerometer 703 may be used to measure acceleration data of screen B and report it to the sensor data processing module 705. The gyroscope sensor 702 may be used to measure gyroscope data of screen A and report it to the sensor data processing module 705. The gyroscope sensor 704 may be used to measure gyroscope data of screen B and report it to the sensor data processing module 705.
[0384] When the user folds the electronic device 100, the acceleration sensor 701, gyroscope sensor 702, acceleration sensor 703 and gyroscope sensor 704 in the hardware layer can report the sensor data measured by each sensor to the sensor data processing module 705 in the kernel layer. The sensor data processing module 705 can calculate the vector corresponding to the direction of screen A based on the sensor data reported by multiple sensors in the hardware layer. The vector corresponding to the direction of screen B Then the angle α between screen A and screen B is calculated. Then, the sensor data processing module 705 can use the sensor service module 706 in the hardware abstraction layer to convert the direction vector of screen A to B screen facing direction vector The angle α between screen A and screen B is reported to the sensor management module 707 in the framework layer. The sensor management module 707 can be used to convert the vector vector The angle α between the vector and A is given to the posture recognition module 708. The posture recognition module 708 can be used to vector and the angle α, determine the bracket state of the electronic device 100, and then identify the posture type of the electronic device 100 based on the angle α and the bracket state of the electronic device 100. And send the posture type to the display management module 709. The display management module 709 can determine the display state of each display screen (screen A, screen B and screen C) according to the posture type, and display the user interface 11 on the display screen 1. The display state of the display screen includes the lit state and the unlit state. The display management module 709 can notify the window management module 710 to create a window corresponding to the user interface 11 and update the window properties (such as size and position). The window management module 710 can refresh the window system, redraw the window, and notify the upper-level application to adjust the properties of the display elements in the window (such as size and position).
[0385] In some embodiments, when the posture type is a preset posture, the electronic device 100 turns on the face detection service of the camera 711 corresponding to the above preset posture, and the electronic device 100 uses the camera 711 to collect images and reports the collected images to the camera detection data processing module 712. The camera detection service module 713 performs image processing on the above images and uploads the processed images to the face recognition module 714 through the camera detection service module 713. The face recognition module 714 identifies whether the above images include a face (or the face of a preset user). The display management module 709 can determine the display status and display content of each screen according to the posture type and face recognition results. For example, the first preset posture corresponds to the rear camera, and the second preset posture corresponds to the front camera.
[0386] In some embodiments, after the display management module 709 determines that the display screen 1 (e.g., screen C) is displaying the user interface 11 based on the gesture type, it activates the gesture detection service of the camera 711 corresponding to the display screen 1. The camera detection service module 713 uploads the processed image to the gesture recognition module 715 via the camera detection service module 713. The gesture recognition module 715 identifies the gesture type in the image, and the display management module 709 can update the display state and displayed content of the display screen 1 based on the gesture type.
[0387] The present application also provides an electronic device 100, which includes a first screen, a folding screen and a first camera. The folding screen can be folded along the folding edge to form a second screen and a third screen. The first screen and the second screen have opposite orientations. The orientation of the first screen is consistent with the shooting direction of the first camera, and the orientation of the second screen is consistent with the shooting direction of the second camera.
[0388] Referring to Figure 17, Figure 17 shows a schematic structural diagram of another electronic device provided by an embodiment of the present invention. As shown in Figure 17, the electronic device 100 may include: a detection unit and a display unit.
[0389] a detection unit, configured to determine that the electronic device is in a first preset posture based on a detected first included angle between the second screen and the third screen;
[0390] A display unit, configured to display a first user interface on a first screen based on a first preset posture of the electronic device; a first preview display area of the first user interface is configured to display an image captured by the first camera, wherein in the first preset posture, the first angle does not include 0° and 180°;
[0391] The detection unit is further configured to determine that the electronic device is in a second preset posture based on the detected first angle;
[0392] The display unit is also used to display a second user interface on the second screen based on a second preset posture of the electronic device; the second preview display area of the second user interface is used to display an image captured by the second camera, and under the second preset posture, the first angle does not include 0° and 180°.
[0393] In some embodiments, the detection unit is further used to determine that the electronic device is in a third preset posture based on the detected first angle; the display unit is further used to split the second screen and the third screen based on the third preset posture of the electronic device, and the display content of the second screen includes a third preview display area, and the third preview display area is used to display the image captured by the second camera. Under the third preset posture, the first angle does not include 0° and 180°.
[0394] In some embodiments, the above-mentioned display of the first user interface on the first screen based on the first preset posture of the electronic device includes: when it is detected that the electronic device is in the first preset posture and the electronic device meets the first preset condition, starting the first camera to capture images and displaying the first user interface on the first screen; wherein, the first preset posture includes a first angle within a first preset range, and the first preset condition includes one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the first screen is in a lit state, the electronic device does not receive any input operation acting on the first screen within a second preset time; a human face or a preset user's face is detected in the image captured by the camera corresponding to the first screen; and a first preset gesture is detected in the image captured by the camera corresponding to the first screen.
[0395] In some embodiments, the above-mentioned display of the second user interface on the second screen based on the second preset posture of the electronic device includes: when the electronic device is detected to be in the second preset posture and the electronic device meets the second preset condition, starting the second camera to capture images and displaying the second user interface on the second screen; wherein the second preset posture includes a first angle within a second preset range, and the second preset condition includes one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the second screen is in the lit state, the electronic device does not receive any input operation acting on the second screen within the second preset time; a human face or the face of a preset user is detected in the image captured by the camera corresponding to the second screen; and a second preset gesture is detected in the image captured by the camera corresponding to the second screen.
[0396] In some embodiments, the above-mentioned split-screen display on the second and third screens based on the third preset posture of the electronic device includes: when the electronic device is detected to be in the third preset posture and the electronic device meets the third preset condition, starting the second camera to capture images, and split-screen display on the second and third screens; wherein, the third preset posture includes the first angle being within a third preset range, and the third preset condition includes one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the second screen and / or the third screen is in the lit state, the electronic device does not receive any input operation acting on the second screen or the third screen within the second preset time; in the image captured by the camera corresponding to the second screen, a human face or the face of a preset user is detected; in the image captured by the camera corresponding to the second screen, a third preset gesture is detected.
[0397] The present application also provides an electronic device 100, which includes a first screen, a folding screen, and a first camera. The folding screen can be folded along the folding edge to form a second screen and a third screen. The first screen and the second screen are oriented in opposite directions, and the direction of the first screen is consistent with the shooting direction of the first camera. The electronic device may include multiple functional modules or units, such as a display unit. Among them,
[0398] The display unit is used to start the first camera to capture images and display the first user interface on the first screen when it is detected that the electronic device is in a first preset posture and the electronic device meets a first preset condition. The first preview display area of the first user interface is used to display the image captured by the first camera; wherein the first preset posture includes a first angle between the second screen and the third screen being within a first preset range, and the first preset condition includes one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the first screen is in a lit state, the electronic device does not receive an input operation acting on the first screen within a second preset time; a human face or a face of a preset user is detected in the image captured by the camera corresponding to the first screen; and a first preset gesture is detected in the image captured by the camera corresponding to the first screen.
[0399] In the embodiment of the present application, the camera corresponding to the first screen and the first camera can be the same camera or different cameras. Optionally, the camera corresponding to the first screen is a low-power camera.
[0400] In some embodiments, the electronic device further comprises a second camera, the orientation of the second screen is consistent with the shooting direction of the second camera, and when the folding screen is folded along the folding edge to form the second screen and the third screen, the third screen and the second camera are located on different sides of the folding edge. The display unit is further configured to, when it is detected that the electronic device is in a second preset posture and the electronic device meets a second preset condition, start the second camera to capture an image and display a second user interface on the second screen, wherein the second preview display area of the second user interface is configured to display the image captured by the second camera; wherein the second preset posture comprises a first angle within a second preset range, and the second preset condition comprises one or more of the following: the pause time of the first angle at the current angle value reaches a first preset time; when the second screen is in the illuminated state, the electronic device does not receive any input operation acting on the second screen within a second preset time; a human face or a face of a preset user is detected in the image captured by the camera corresponding to the second screen; and a second preset gesture is detected in the image captured by the camera corresponding to the second screen.
[0401] In the embodiment of the present application, the camera corresponding to the second screen and the second camera can be the same camera or different cameras. Optionally, the camera corresponding to the second screen is a low-power camera.
[0402] In some embodiments, the electronic device further comprises a second camera, the second screen is oriented in the same direction as the second camera, and when the foldable screen is folded along the folding edge to form the second screen and the third screen, the third screen and the second camera are located on different sides of the folding edge. The display unit is further configured to, upon detecting that the electronic device is in a third preset posture and the electronic device satisfies a third preset condition, activate the second camera to capture an image and display the image in a split-screen manner on the second and third screens, wherein the display content of the second screen includes a third preview display area, and the third preview display area is configured to display the image captured by the second camera. The third preset posture comprises the first angle being within a third preset range, and the third preset condition comprises one or more of the following: the first angle remains within the current angle value for a first preset time; when the second screen and / or the third screen is in the illuminated state, the electronic device does not receive any input operation applied to the second screen or the third screen within a second preset time; a human face or a face of a preset user is detected in the image captured by the camera corresponding to the second screen; and a third preset gesture is detected in the image captured by the camera corresponding to the second screen.
[0403] In some embodiments, the first preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the third screen and the Z axis of the geographic coordinate system is less than 90°, and the angle within the first preset range is greater than 0° and less than 120°; or, the first preset posture also includes: the second angle is within the fourth preset range, the angle between the orientation of the third screen and the Z axis of the geographic coordinate system is greater than 90°, and the angle within the first preset range is greater than 180° and less than 300°; or, the first preset posture also includes: the difference between the third angle and the second angle is within a fifth preset range, the third angle is the angle between the second screen and the horizontal plane, the angle between the orientation of the third screen and the Z axis of the geographic coordinate system is greater than 90°, and the angle within the first preset range is greater than 0° and less than 180°.
[0404] In some embodiments, the first preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the third screen and the Z axis of the geographic coordinate system is less than 90°, and the angle within the first preset range is less than 120°; the above-mentioned display unit displays the first user interface on the first screen, including: the display unit displays the first user interface rotated 180° on the first screen.
[0405] In some embodiments, the electronic device further includes an identification unit, and before the display unit displays the first user interface on the first screen, the identification unit is used to identify a first area where a preset local feature is located in the image captured by the first camera, and the first preview display area is used to display an enlarged image of the image in the first area.
[0406] In some embodiments, the electronic device further includes a receiving unit, and after the display unit displays the first user interface on the first screen, the receiving unit is used to receive a first input operation from the user; the display unit is also used to display the following one or more interface elements in the first user interface in response to the first input operation: a makeup trial control, a shooting control, a camera switching control, a fill light control, an album control, and a display frame; wherein the makeup trial control is used to add a preset makeup effect to the face in the image displayed in the first preview display area; the shooting control is used to trigger the electronic device to save the image displayed in the first preview display area; the camera switching control is used to switch the camera for capturing images; the fill light control is used to supplement ambient light; the album control is used to trigger the electronic device to display the user interface of the album application; and the display frame is used to display an enlarged image of a preset local feature in the image captured by the first camera.
[0407] In some embodiments, the first camera is an ultraviolet camera, and the image captured by the first camera is used to highlight the area where sunscreen is applied.
[0408] In some embodiments, the display unit is further configured to control the second screen and the third screen to turn off when it is detected that the electronic device is in a first preset posture and the electronic device meets a first preset condition.
[0409] In some embodiments, the second preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is less than 90°, and the angle within the second preset range is greater than 60° and less than 180°; or, the second preset posture also includes: the second angle is within the fourth preset range, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is greater than 90°, and the angle within the second preset range is greater than 240° and less than 360°; or, the second preset posture also includes: the difference between the third angle and the second angle is within a fifth preset range, the third angle is the angle between the second screen and the horizontal plane, the angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is greater than 90°, and the angle within the second preset range is greater than 180° and less than 360°.
[0410] In some embodiments, in the first preset posture and the second preset posture, the first angle does not include 0° and 180°.
[0411] In some embodiments, the display unit is further configured to control the first screen to turn off when it is detected that the electronic device is in a second preset posture and the electronic device meets a second preset condition.
[0412] In some embodiments, the third preset posture also includes: the second angle between the third screen and the horizontal plane is within a fourth preset range, the angle between the orientation of the third screen and the Z axis of the geographic coordinate system is less than 90°, and the angle within the third preset range is greater than 60° and less than 180°.
[0413] In some embodiments, the display content of the third screen includes an enlarged image of a preset local feature in the image captured by the second camera.
[0414] In some embodiments, the above-mentioned display unit performs split-screen display on the second screen and the third screen, including: the display unit performs split-screen display of the third user interface on the second screen and the third display screen; the display content of the second screen includes the third preview display area of the third user interface, and zero, one or more interface elements in the third user interface except the third preview display area, and the display content of the third screen includes one or more interface elements in the third user interface except the display content of the second screen; the third user interface also includes the following one or more interface elements: a makeup trial control, a shooting control, a camera switching control, a fill light control, an album control, and a display frame; wherein the makeup trial control is used to add a preset makeup effect to the face in the image in the preview display area of the third user interface; the shooting control is used to trigger the electronic device to save the image in the preview display area of the third user interface; the camera switching control is used to switch the camera for capturing the image; the fill light control is used to supplement the ambient light; the album control is used to trigger the electronic device to display the user interface of the album application; the display frame is used to display an enlarged image of a preset local feature in the image captured by the second camera.
[0415] The various implementation modes of this application can be combined arbitrarily to achieve different technical effects.
[0416] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described herein are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).
[0417] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
[0418] In short, the above description is only an embodiment of the technical solution of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made based on the disclosure of the present invention should be included in the scope of protection of the present invention.
Claims
1. A display method, characterized in that, Applied to an electronic device, the electronic device includes a first screen, a folding screen, and a first camera. The folding screen can be folded along the folding edge to form a second screen and a third screen. The orientations of the first screen and the second screen are opposite. The orientation of the first screen is the same as the shooting direction of the first camera, and the orientation of the second screen is the same as the shooting direction of the second camera. The method includes: Based on the detected first angle between the second screen and the third screen, determine that the electronic device is in a first preset posture; based on the first preset posture of the electronic device, the electronic device displays a first user interface on the first screen; a first preview display area of the first user interface is used to display the image collected by the first camera. In the first preset posture, the first angle does not include 0° and 180°; Based on the detected first angle, determine that the electronic device is in a second preset posture; based on the second preset posture of the electronic device, the electronic device displays a second user interface on the second screen; a second preview display area of the second user interface is used to display the image collected by the second camera. In the second preset posture, the first angle does not include 0° and 180°.
2. The method according to claim 1, characterized in that, The method further includes: Based on the detected first angle, determine that the electronic device is in a third preset posture; based on the third preset posture of the electronic device, the electronic device performs split-screen display on the second screen and the third screen. The display content of the second screen includes a third preview display area, and the third preview display area is used to display the image collected by the second camera. In the third preset posture, the first angle does not include 0° and 180°.
3. The method according to claim 1 or 2, characterized in that, The step of, based on the first preset posture of the electronic device, the electronic device displays a first user interface on the first screen, includes: When it is detected that the electronic device is in the first preset posture and the electronic device meets a first preset condition, the electronic device starts the first camera to collect an image and displays the first user interface on the first screen; Wherein, the first preset posture includes that the first angle is within a first preset range, and the first preset condition includes one or more of the following: The pause time of the first angle at the current angle value reaches a first preset time; when the first screen is in the lit state, the electronic device does not receive an input operation on the first screen within a second preset time; in the image collected by the camera corresponding to the first screen, a human face or the human face of a preset user is detected; in the image collected by the camera corresponding to the first screen, a first preset gesture is detected.
4. The method according to claim 1 or 2, characterized in that, The step of, based on the second preset posture of the electronic device, the electronic device displays a second user interface on the second screen, includes: When it is detected that the electronic device is in the second preset posture and the electronic device meets a second preset condition, the electronic device starts the second camera to collect an image and displays the second user interface on the second screen; Wherein, the second preset posture includes that the first included angle is within a second preset range, and the second preset condition includes one or more of the following: The pause time of the first included angle at the current included angle value reaches a first preset time; when the second screen is in the lit state, the electronic device does not receive an input operation on the second screen within a second preset time; in the image captured by the camera corresponding to the second screen, a human face or the human face of a preset user is detected; in the image captured by the camera corresponding to the second screen, a second preset gesture is detected.
5. The method according to claim 1 or 2, characterized in that, Based on the third preset posture of the electronic device, the electronic device performs split-screen display on the second screen and the third screen, including: When it is detected that the electronic device is in the third preset posture and the electronic device meets the third preset condition, the electronic device activates the second camera to capture an image and performs split-screen display on the second screen and the third screen; Wherein, the third preset posture includes that the first included angle is within a third preset range, and the third preset condition includes one or more of the following: The pause time of the first included angle at the current included angle value reaches a first preset time; when the second screen and / or the third screen is in the lit state, the electronic device does not receive an input operation on the second screen or the third screen within a second preset time; in the image captured by the camera corresponding to the second screen, a human face or the human face of a preset user is detected; in the image captured by the camera corresponding to the second screen, a third preset gesture is detected.
6. A display method, characterized in that, Applied to an electronic device, the electronic device includes a first screen, a folding screen, and a first camera. The folding screen can be folded along the folding edge to form a second screen and a third screen. The orientations of the first screen and the second screen are opposite, and the orientation of the first screen is the same as the shooting direction of the first camera. The method includes: When it is detected that the electronic device is in a first preset posture and the electronic device meets the first preset condition, the electronic device activates the first camera to capture an image and displays a first user interface on the first screen. The first preview display area of the first user interface is used to display the image captured by the first camera; Wherein, the first preset posture includes that the first included angle between the second screen and the third screen is within a first preset range, and the first preset condition includes one or more of the following: The pause time of the first included angle at the current included angle value reaches a first preset time; when the first screen is in the lit state, the electronic device does not receive an input operation on the first screen within a second preset time; in the image captured by the camera corresponding to the first screen, a human face or the human face of a preset user is detected; in the image captured by the camera corresponding to the first screen, a first preset gesture is detected.
7. The method according to claim 6, characterized in that, The electronic device further includes a second camera. The orientation of the second screen is the same as the shooting direction of the second camera. When the folding screen is folded along the folding edge to form the second screen and the third screen, the third screen and the second camera are located on different sides of the folding edge. The method further includes: When it is detected that the electronic device is in a second preset posture and the electronic device meets a second preset condition, the electronic device activates the second camera to capture an image and displays a second user interface on the second screen. A second preview display area of the second user interface is used to display the image captured by the second camera; Wherein, the second preset posture includes that the first included angle is within a second preset range, and the second preset condition includes one or more of the following: The pause time of the first included angle at the current included angle value reaches a first preset time; when the second screen is in a lit state, the electronic device does not receive an input operation on the second screen within a second preset time; in the image captured by the camera corresponding to the second screen, a human face or the human face of a preset user is detected; in the image captured by the camera corresponding to the second screen, a second preset gesture is detected.
8. The method according to claim 6, characterized in that, The electronic device further includes a second camera. The orientation of the second screen is the same as the shooting direction of the second camera. When the folding screen is folded along the folding edge to form the second screen and the third screen, the third screen and the second camera are located on different sides of the folding edge. The method further includes: When it is detected that the electronic device is in a third preset posture and the electronic device meets a third preset condition, the electronic device activates the second camera to capture an image and performs split-screen display on the second screen and the third screen. The display content of the second screen includes a third preview display area, and the third preview display area is used to display the image captured by the second camera; Wherein, the third preset posture includes that the first included angle is within a third preset range, and the third preset condition includes one or more of the following: The pause time of the first included angle at the current included angle value reaches a first preset time; when the second screen and / or the third screen is in a lit state, the electronic device does not receive an input operation on the second screen or the third screen within a second preset time; in the image captured by the camera corresponding to the second screen, a human face or the human face of a preset user is detected; in the image captured by the camera corresponding to the second screen, a third preset gesture is detected.
9. The method according to any one of claims 6 to 8, characterized in that, The first preset posture further includes: the second included angle between the third screen and the horizontal plane is within a fourth preset range, the included angle between the orientation of the third screen and the Z axis of the geographic coordinate system is less than 90°, and the angle within the first preset range is greater than 0° and less than 120°; Or, the first preset posture further includes: the second included angle is within the fourth preset range, the included angle between the orientation of the third screen and the Z axis of the geographic coordinate system is greater than 90°, and the angle within the first preset range is greater than 180° and less than 300°; Or, the first preset posture further includes: the difference between the third included angle and the second included angle is within a fifth preset range, the third included angle is the included angle between the second screen and the horizontal plane, the included angle between the orientation of the third screen and the Z axis of the geographic coordinate system is greater than 90°, and the angle within the first preset range is greater than 0° and less than 180°.
10. The method according to any one of claims 6 to 8, characterized in that, The first preset posture further includes: a second included angle between the third screen and the horizontal plane is within a fourth preset range, an included angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is less than 90°, and an angle within the first preset range is less than 120°; the displaying the first user interface on the first screen includes: Displaying the first user interface rotated by 180° on the first screen.
11. The method according to any one of claims 6 to 8, characterized in that, The first preset posture includes a first bracket state and a fifth bracket state. When it is detected that the electronic device is in the first preset posture and the electronic device meets the first preset condition, the electronic device activates the first camera to collect an image and displays the first user interface on the first screen, including: When it is detected that the electronic device is in the first bracket state and the electronic device meets the first preset condition, the electronic device activates the first camera to collect an image and displays the first user interface on the first screen; After displaying the first user interface on the first screen, it further includes: When it is detected that the electronic device switches from the first bracket state to the fifth bracket state, the electronic device displays the first user interface rotated by 180° on the first screen.
12. The method according to any one of claims 6 to 8, characterized in that, Before displaying the first user interface on the first screen, it further includes: The electronic device identifies a first area where a preset local feature is located in the image collected by the first camera, and the first preview display area is used to display an enlarged image of the image within the first area.
13. The method according to any one of claims 6 to 8, characterized in that, After displaying the first user interface on the first screen, it further includes: Receiving a first input operation of the user; In response to the first input operation, the electronic device displays one or more of the following interface elements in the first user interface: a makeup trial control, a shooting control, a camera switching control, a fill light control, an album control, a display frame; Wherein, the makeup trial control is used to add a preset makeup effect to the face in the image displayed in the first preview display area; the shooting control is used to trigger the electronic device to save the image displayed in the first preview display area; the camera switching control is used to switch the camera for collecting images; the fill light control is used to supplement the ambient light; the album control is used to trigger the electronic device to display the user interface of the album application; the display frame is used to display an enlarged image of a preset local feature in the image collected by the first camera.
14. The method according to any one of claims 6 to 8, characterized in that, The first camera is an ultraviolet camera, and the image collected by the first camera is used to highlight the area where sunscreen is applied.
15. The method according to any one of claims 6 to 8, characterized in that, When it is detected that the electronic device is in the first preset posture and the electronic device meets the first preset condition, the method further includes: The electronic device controls the second screen and the third screen to turn off.
16. The method according to claim 7, characterized in that, The second preset posture further includes: a second included angle between the third screen and the horizontal plane is within a fourth preset range, an included angle between the orientation of the third screen and the Z-axis of the geographic coordinate system is less than 90°, and an angle within the second preset range is greater than 60° and less than 180°; Alternatively, the second preset posture further includes: the second included angle is within a fourth preset range, the included angle between the orientation of the third screen and the Z-axis of the geographical coordinate system is greater than 90°, and the angle within the second preset range is greater than 240° and less than 360°; Alternatively, the second preset posture further includes: the difference between the third included angle and the second included angle is within a fifth preset range, the third included angle is the included angle between the second screen and the horizontal plane, the included angle between the orientation of the third screen and the Z-axis of the geographical coordinate system is greater than 90°, and the angle within the second preset range is greater than 180° and less than 360°.
17. The method according to claim 7, characterized in that, In the first preset posture and the second preset posture, the first included angle does not include 0° and 180°.
18. The method according to claim 7, characterized in that, When it is detected that the electronic device is in the second preset posture and the electronic device meets the second preset condition, the method further includes: The electronic device controls the first screen to turn off.
19. The method according to claim 8, characterized in that, The third preset posture further includes: the second included angle between the third screen and the horizontal plane is within a fourth preset range, the included angle between the orientation of the third screen and the Z-axis of the geographical coordinate system is less than 90°, and the angle within the third preset range is greater than 60° and less than 180°.
20. The method according to claim 8, characterized in that, The display content of the third screen includes an enlarged image of a preset local feature in the image collected by the second camera.
21. The method according to claim 8, characterized in that, The split-screen display on the second screen and the third screen includes: Performing split-screen display of a third user interface on the second screen and the third display screen; the display content of the second screen includes the third preview display area of the third user interface, and zero, one, or more interface elements in the third user interface other than the third preview display area, and the display content of the third screen includes one or more interface elements in the third user interface other than the display content of the second screen; The third user interface further includes one or more of the following interface elements: a makeup trial control, a shooting control, a camera switching control, a fill light control, an album control, a display frame; wherein, the makeup trial control is used to add a preset makeup effect to the face in the image in the preview display area of the third user interface; the shooting control is used to trigger the electronic device to save the image in the preview display area of the third user interface; the camera switching control is used to switch the camera for collecting images; the fill light control is used to supplement the ambient light; the album control is used to trigger the electronic device to display the user interface of the album application; the display frame is used to display an enlarged image of a preset local feature in the image collected by the second camera.
22. An electronic device, comprising a memory, one or more processors, a plurality of applications, and one or more programs; wherein, The one or more programs are stored in the memory; characterized in that, when the one or more processors execute the one or more programs, the electronic device implements the method according to any one of claims 1-21.
23. A computer-readable storage medium, characterized in that, Including computer instructions, when the computer instructions run on an electronic device, the electronic device is caused to execute the display method according to any one of claims 1-21.
24. A computer program product, characterized in that, When the computer program product runs on a computer, the computer is caused to execute the display method according to any one of claims 1-21.