Photographing method and foldable screen device
By detecting the distance between the user and the camera, it automatically switches to the rear camera selfie mode, solving the problem of insufficient front camera specifications in foldable screen devices, simplifying the operation process, and improving the user experience.
Patent Information
- Application Number
- PCT/CN2025/111458
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-08-01
- Filing Date
- 2025-07-30
- Publication Date
- 2026-02-05
AI Technical Summary
The specifications of the front camera on foldable screen devices are incompatible with those of the rear camera, making the rear camera selfie operation cumbersome and affecting the user experience.
By detecting the distance between the user and the front and rear cameras, the system automatically switches to the rear camera selfie mode, simplifying the operation process and displaying the rear camera's image on a second display screen.
It improves the user experience, simplifies the operation process of taking selfies with the rear camera, and eliminates the need for users to manually switch cameras, thus enhancing user convenience.
Smart Images

Figure CN2025111458_05022026_PF_FP_ABST
Abstract
Description
A photography method and a foldable screen device
[0001] This application claims priority to Chinese Patent Application No. 202411062740.8, filed on August 1, 2024, entitled "A Photographing Method and Foldable Screen Device", the entire contents of which are incorporated herein by reference. Technical Field
[0002] This application relates to the field of terminal and electronic technology, and in particular to a photography method and a foldable screen device. Background Technology
[0003] Currently, foldable screen devices have one or more front-facing cameras and a rear-facing camera. As foldable screen devices have evolved, the specifications of the rear-facing camera have continuously improved; however, due to the decreasing thickness of foldable devices, the specifications of the front-facing camera cannot improve in the same way. Photos taken with the rear-facing camera generally have better image quality (e.g., sharpness, image quality) than those taken with the front-facing camera. To achieve better selfies, users need to use the rear-facing camera. However, currently, accessing the rear-facing camera for selfies on foldable screen devices is not user-friendly, which negatively impacts the user experience.
[0004] Therefore, simplifying the process of taking selfies with the rear camera on foldable screen devices is an urgent problem to be solved. Summary of the Invention
[0005] This application provides a photo-taking method and a foldable screen device. Through this method, the foldable screen device can automatically take a selfie with the rear camera according to the state of the foldable screen device, thereby simplifying the operation of the foldable screen device to take a selfie with the rear camera and improving the user experience.
[0006] In a first aspect, this application provides a method for taking photos, which can be applied to a foldable screen device. The foldable screen device may include a first display screen and at least two cameras. The first display screen can be folded into at least two display areas. The at least two cameras may include a first front-facing camera and a rear-facing camera. The first front-facing camera may be located on the same side as the first display screen, and the rear-facing camera may be located on the back of the first display screen. The method may include: the foldable screen device activating one of the at least two cameras and displaying the image captured by the at least two cameras; receiving and responding to a first operation by a user, automatically setting both the first front-facing camera and the rear-facing camera to an activated state; when the distance between the user and the rear-facing camera is less than the distance between the user and the first front-facing camera, the foldable screen device displays the image captured by the rear-facing camera, the image captured by the rear-facing camera including the user's portrait.
[0007] Using the method provided in the first aspect, the foldable screen device only needs to receive one user input to compare the distance between the user and the rear camera, and the distance between the user and the first front camera. By comparing these distances, it can determine whether the user wants to take a rear-camera selfie. When it is determined that the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device can determine that the user wants to take a rear-camera selfie and then automatically switch to rear-camera selfie mode. This simplifies user operation and improves the user experience.
[0008] In conjunction with the first aspect, in one possible implementation, the foldable screen device may also include a second display screen, which may be located behind the first display screen.
[0009] In this way, foldable screen devices can display the rear-facing selfie image on a second display screen.
[0010] In conjunction with the first aspect, in one possible implementation, the foldable screen device activates one of at least two cameras and displays the image captured by one of the at least two cameras, which may include:
[0011] When the foldable screen device is unfolded, the first front-facing camera is activated, and the image captured by the first front-facing camera is displayed on the first display screen.
[0012] Receive and respond to the user's first action, automatically setting both the front-facing camera and the rear camera to be enabled, which may include:
[0013] Receives and responds to the user's flip operation on the foldable screen device, and the foldable screen device automatically turns on the rear camera;
[0014] When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device displays the image captured by the rear camera, which may include:
[0015] When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device displays the image captured by the rear camera on the second display screen.
[0016] In this way, the foldable screen device can automatically switch from the unfolded state (front-facing selfie mode) to the rear-facing selfie mode when the user flips the device. The rear-facing selfie image can then be displayed on a second screen. Since the rear camera and the second screen are on the same side when the device is unfolded, it allows the user to easily view the rear-facing selfie image.
[0017] In conjunction with the first aspect, in one possible implementation, when the foldable screen device automatically activates the rear camera, the method may further include: the foldable screen device displays the image captured by the first front camera on a first display screen, while the image captured by the rear camera is not displayed.
[0018] In this way, the rear camera only turns on in the background during the user's flipping process, so the user is unaware of it and it does not affect the user's normal use of the shooting function of the foldable screen device.
[0019] In conjunction with the first aspect, in one possible implementation, the foldable screen device activates one of at least two cameras and displays the image captured by one of the at least two cameras, which may include:
[0020] When the foldable device is unfolded, the rear camera is activated, and the image captured by the rear camera is displayed on the first display screen.
[0021] Receiving and responding to the user's first operation, automatically setting both the first front-facing camera and the rear camera to be in an on state, may include:
[0022] Upon receiving and responding to the user's flip operation on the foldable screen device, the foldable screen device automatically activates the first front-facing camera;
[0023] When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device displays the image captured by the rear camera, which may include:
[0024] When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device displays the image captured by the rear camera on the second display screen.
[0025] In this way, the foldable device can switch from its unfolded state, where the rear camera takes a picture and displays the image on the first display screen, to automatically switching to a rear-camera selfie when the user flips the device. The selfie image can then be displayed on the second display screen. Since the rear camera and the second display screen are on the same side when the device is unfolded, it's convenient for the user to view the selfie image.
[0026] In conjunction with the first aspect, in one possible implementation, when the foldable screen device automatically activates the first front-facing camera, the method may further include: the foldable screen device displays the image captured by the rear camera on the first display screen, while the image captured by the first front-facing camera is not displayed.
[0027] In this way, during the user's flipping process, the first front-facing camera is only turned on in the background and is not noticed by the user. This maintains the image captured by the camera selected when the user initially took the picture, and does not affect the user's normal use of the shooting function of the foldable screen device.
[0028] In conjunction with the first aspect, in one possible implementation, at least two cameras also include a second front-facing camera, which is located on the same side as the second display screen. This allows foldable devices to have multiple front-facing cameras, enriching the product form factor of foldable devices.
[0029] In conjunction with the first aspect, in one possible implementation, the foldable screen device activates one of at least two cameras and displays the image captured by one of the at least two cameras, which may include:
[0030] When the foldable screen device is in a folded state, the first display screen is folded, the foldable screen device activates the second front-facing camera, and displays the image captured by the second front-facing camera on the second display screen;
[0031] Receiving and responding to the user's first operation, automatically setting both the first front-facing camera and the rear camera to be in an on state, may include:
[0032] Upon receiving and responding to the user's operation of switching the foldable screen device from the folded state to the unfolded state, the foldable screen device automatically activates the first front-facing camera and the rear-facing camera;
[0033] When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device displays the image captured by the rear camera, which may include:
[0034] When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device displays the image captured by the rear camera on the second display screen.
[0035] In this way, the foldable screen device can automatically switch from the folded state (front-facing selfie mode) to the rear-facing selfie mode when the user detects that the device has been unfolded. The rear-facing selfie image can then be displayed on a second screen. Since the rear camera and the second screen are on the same side when the device is unfolded, it allows for convenient viewing of the rear-facing selfie image.
[0036] In conjunction with the first aspect, in one possible implementation, when the foldable screen device automatically activates the first front-facing camera and the rear-facing camera, the method may further include: the foldable screen device displays the image captured by the first front-facing camera on the first display screen, while the image captured by the rear-facing camera is not displayed.
[0037] In this way, when a user switches the foldable screen device from the folded state to the unfolded state, the rear camera is only turned on in the background, which is imperceptible to the user and does not affect the user's normal use of the foldable screen device's shooting function. It also does not conflict with the existing logic of the foldable screen device.
[0038] In conjunction with the first aspect, in one possible implementation, the method may further include: receiving and responding to a user's operation to switch the foldable screen device from a folded state to an unfolded state, and then turning off the second front-facing camera on the foldable screen device. This way, when entering the rear-facing selfie mode, the camera running in the background can be turned off, saving power consumption of the foldable screen device.
[0039] In conjunction with the first aspect, in one possible implementation, the foldable screen device activates one of at least two cameras and displays the image captured by one of the at least two cameras, which may include:
[0040] When the foldable screen device is in a folded state, the first display screen is folded, the foldable screen device activates the rear camera, and displays the image captured by the rear camera on the second display screen;
[0041] Receive and respond to the user's first action, automatically setting both the front-facing camera and the rear camera to be enabled, which may include:
[0042] Upon receiving and responding to the user's operation of switching the foldable screen device from the folded state to the unfolded state, the foldable screen device automatically turns on the first front-facing camera;
[0043] When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device displays the image captured by the rear camera, which may include:
[0044] When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device displays the image captured by the rear camera on the second display screen.
[0045] In this way, the foldable device can automatically switch from the folded state (when taking a photo with the rear camera) to the unfolded state (when the user detects that the device has been unfolded), and then display the selfie image on a second display screen. Since the rear camera and the second display screen are on the same side when the device is unfolded, it's convenient for the user to view the selfie image.
[0046] In conjunction with the first aspect, in one possible implementation, when the foldable screen device automatically activates the first front-facing camera, the method may further include: the foldable screen device displays the image captured by the rear camera on the first display screen, while the image captured by the first front-facing camera is not displayed.
[0047] In this way, when the user switches the foldable screen device from the folded state to the unfolded state, the first front-facing camera is only turned on in the background, which is not noticed by the user and does not affect the user's normal use of the foldable screen device's shooting function. It also does not conflict with the existing logic of the foldable screen device.
[0048] In conjunction with the first aspect, in one possible implementation, at least two display areas include a first display area and a second display area. When the foldable screen device is in a folded state, the second display area is located behind the first display area, and the first front-facing camera is located on the same side as the first display area. Thus, the foldable screen device can also be an outward-folding foldable screen device.
[0049] In conjunction with the first aspect, in one possible implementation, the foldable screen device activates one of at least two cameras and displays the image captured by one of the at least two cameras, which may include:
[0050] When the foldable screen device is in the unfolded state, the first front-facing camera is activated, and the image captured by the first front-facing camera is displayed on the first display screen;
[0051] Receive and respond to the user's first action, automatically setting both the front-facing camera and the rear camera to be enabled, which may include:
[0052] The device receives and responds to the user's action of switching the foldable screen device from the folded state to the unfolded state, and the foldable screen device automatically turns on the rear camera.
[0053] When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device displays the image captured by the rear camera, which may include:
[0054] When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device displays the image captured by the rear camera in the second display area.
[0055] In this way, when the foldable screen device is in the unfolded state, taking a selfie with the front camera and displaying the image captured by the front camera on the first display screen, it automatically switches to the rear camera for selfies after detecting that the user has switched the foldable screen from the unfolded state to the folded state. The rear camera selfie image can then be displayed in the second display area. Since the rear camera and the second display area are on the same side when the outward-folding foldable screen device is folded, it allows the user to easily view the rear camera selfie image.
[0056] In conjunction with the first aspect, in one possible implementation, the foldable screen device activates one of at least two cameras and displays the image captured by one of the at least two cameras, which may include:
[0057] When the foldable screen device is in a folded state, the first front-facing camera is activated, and the image captured by the first front-facing camera is displayed in the first display area;
[0058] Receive and respond to the user's first action, automatically setting both the front-facing camera and the rear camera to be enabled, which may include:
[0059] Receives and responds to the user's flip operation on the foldable screen device, and the foldable screen device automatically turns on the rear camera;
[0060] When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device displays the image captured by the rear camera, which may include:
[0061] When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device displays the image captured by the rear camera in the second display area.
[0062] In this way, when the foldable screen device is in the folded state and the front-facing camera is being used for a selfie, displaying the image captured by the front camera in the first display area, it automatically switches to a rear-facing camera for a selfie upon detecting the user's flip operation. The rear-facing selfie image can then be displayed in the second display area. Since the rear camera and the second display area are on the same side when the outward-folding foldable screen device is in the folded state, it allows the user to easily view the rear-facing selfie image.
[0063] In conjunction with the first aspect, in one possible implementation, when the foldable screen device automatically activates the rear camera, the method may further include:
[0064] The foldable screen device displays the image captured by the first front-facing camera in the first display area, while the image captured by the rear-facing camera is not displayed or is displayed in the second display area.
[0065] In this way, the rear camera remains open in the background during the user's flipping process, unnoticed by the user and without affecting the normal use of the foldable device's shooting function. Alternatively, the image captured by the rear camera can be displayed in another display area without affecting the user's viewing of the image captured by the selected camera.
[0066] In conjunction with the first aspect, in one possible implementation, the foldable screen device activates one of at least two cameras and displays the image captured by one of the at least two cameras, which may include:
[0067] When the foldable screen device is in a folded state, the rear camera is activated, and the image captured by the rear front camera is displayed in the first display area;
[0068] Receive and respond to the user's first action, automatically setting both the front-facing camera and the rear camera to be enabled, which may include:
[0069] Upon receiving and responding to the user's flip operation on the foldable screen device, the foldable screen device automatically activates the first front-facing camera;
[0070] When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device displays the image captured by the rear camera, which may include:
[0071] When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device displays the image captured by the rear camera in the second display area.
[0072] In this way, when the foldable screen device is in the folded state and the rear camera is taking a picture, displaying the image captured by the rear camera in the first display area, it automatically switches to rear-camera selfie mode upon detecting the user's flip operation. The rear-camera selfie image can then be displayed in the second display area. Since the rear camera and second display area are on the same side when the outward-folding foldable screen device is folded, it allows the user to easily view the rear-camera selfie image.
[0073] In conjunction with the first aspect, in one possible implementation, when the foldable screen device automatically activates the first front-facing camera, the method further includes: the foldable screen device displays the image captured by the rear camera in a first display area, while the image captured by the first front-facing camera is not displayed or is displayed in a second display area.
[0074] In this way, the front-facing camera remains open in the background during the user's flipping process, unnoticed by the user and without affecting the normal use of the foldable device's shooting function. Alternatively, the image captured by the front-facing camera can be displayed in another display area, without affecting the user's viewing of the image captured by the camera selected by the user.
[0075] In conjunction with the first aspect, in one possible implementation, the method may further include: when the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device powers down the first display area, so that the first display area is in a screen-off state.
[0076] This can save power consumption of electronic devices.
[0077] In conjunction with the first aspect, in one possible implementation, the method may further include:
[0078] When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the foldable screen device turns off the first front camera. This saves power consumption for the electronic device.
[0079] In conjunction with the first aspect, in one possible implementation, after the foldable screen device displays the image captured by the rear camera when the distance between the user and the rear camera is less than the distance between the user and the first front camera, the method may further include: after detecting a flip operation on the foldable screen device, activating the first front camera; and when the distance between the user and the rear camera is greater than the distance between the user and the first front camera, deactivating the rear camera and displaying the image captured by the first front camera on the first display screen. In this way, the foldable screen device can automatically exit the rear-camera selfie mode.
[0080] In conjunction with the first aspect, in one possible implementation, when the first front-facing camera and the rear-facing camera are both on, the method may further include: when the face size in the image captured by the first front-facing camera is smaller than the face size in the image captured by the rear-facing camera, determining that the distance between the user and the rear-facing camera is less than the distance between the user and the first front-facing camera; and when the face size in the image captured by the first front-facing camera is larger than the face size in the image captured by the rear-facing camera, determining that the distance between the user and the rear-facing camera is greater than the distance between the user and the first front-facing camera.
[0081] In a second aspect, a foldable screen device is provided, which may include: at least one display screen, at least two cameras, one or more processors, and one or more memories; the at least one display screen includes a first display screen, the first display screen is foldable, the first display screen, the at least two cameras, and one or more memories are respectively coupled to one or more processors; the one or more memories are used to store computer program code, the computer program code including computer instructions; when the computer instructions are executed on the processor, the foldable screen device causes the foldable screen device to perform the method as described in any possible implementation of the first aspect above.
[0082] Thirdly, this application provides a foldable screen device that may include one or more functional modules that perform the methods in any of the possible implementations of the first aspect described above.
[0083] Fourthly, this application provides a computer-readable storage medium including computer instructions that, when executed on a computer, cause the computer to perform the method in any possible implementation of the first aspect described above.
[0084] Fifthly, this application provides a computer program product that, when run on a computer, causes the computer to perform the method in any possible implementation of the first aspect described above.
[0085] In a sixth aspect, this application provides a chip or chip system for use in an electronic device, including a processing circuit and an interface circuit. The interface circuit is used to receive code instructions and transmit them to the processing circuit, and the processing circuit is used to execute the code instructions to perform the method in any possible implementation of the first aspect described above.
[0086] Understandably, the foldable screen device provided in the second and third aspects, the computer-readable storage medium provided in the fourth aspect, the computer program product provided in the fifth aspect, and the chip or chip system provided in the sixth aspect are all used to execute the method provided in this application. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods, and will not be repeated here. Attached Figure Description
[0087] Figure 1 is a schematic diagram of a product form of the foldable screen device provided in an embodiment of this application;
[0088] Figure 2A is a set of user interface diagrams of a foldable screen device provided in an embodiment of this application;
[0089] Figure 2B is another set of user interface diagrams of the foldable screen device provided in the embodiments of this application;
[0090] Figure 3A is another set of user interface diagrams of the foldable screen device provided in the embodiments of this application;
[0091] Figure 3B is another set of user interface diagrams of the foldable screen device provided in the embodiments of this application;
[0092] Figure 4 is a flowchart illustrating a shooting method provided in an embodiment of this application;
[0093] Figure 5A is a schematic diagram of the user interface of the foldable screen device provided in this application embodiment, which enters the rear camera selfie mode from state 1.
[0094] Figure 5B is a schematic diagram of a scene captured by the rear camera of the foldable screen device provided in the embodiment of this application in a multi-person scenario;
[0095] Figure 5C is a schematic diagram of face images at different zoom levels provided in the embodiments of this application;
[0096] Figure 5D is a schematic diagram of face images of different sizes provided in the embodiments of this application;
[0097] Figure 6 is a flowchart illustrating a shooting method provided in an embodiment of this application;
[0098] Figure 7 is a schematic diagram of the user interface of the foldable screen device provided in this application embodiment, which enters the rear camera selfie mode from state 2.
[0099] Figure 8 is a flowchart illustrating a shooting method provided in an embodiment of this application;
[0100] Figure 9 is a set of user interface diagrams of the foldable screen device provided in the embodiment of this application entering the rear camera selfie mode from state 3;
[0101] Figure 10 is a flowchart illustrating a shooting method provided in an embodiment of this application;
[0102] Figure 11 is a set of user interface diagrams of the foldable screen device provided in the embodiment of this application entering the rear camera selfie mode from state 4;
[0103] Figure 12 is a flowchart illustrating a shooting method provided in an embodiment of this application;
[0104] Figure 13 is a schematic diagram of the user interface related to the foldable screen device exiting the rear camera selfie mode provided in the embodiment of this application;
[0105] Figure 14 is a schematic diagram of the product form of the outward-folding folding screen device provided in the embodiment of this application;
[0106] Figure 15 is a schematic diagram of the foldable screen device automatically entering the rear selfie mode according to the embodiment of this application;
[0107] Figure 16 is a schematic diagram of the foldable screen device automatically entering the rear selfie mode according to an embodiment of this application;
[0108] Figure 17 is a schematic diagram of the foldable screen device automatically entering the rear selfie mode according to an embodiment of this application;
[0109] Figure 18 is a schematic diagram of another product form of the foldable screen device provided in the embodiment of this application;
[0110] Figure 19 is a schematic diagram of the foldable screen device automatically entering the rear selfie mode according to an embodiment of this application;
[0111] Figure 20 is a schematic diagram of the foldable screen device automatically entering the rear selfie mode according to an embodiment of this application;
[0112] Figure 21 is a structural schematic diagram of the foldable screen device provided in an embodiment of this application;
[0113] Figure 22 is a schematic diagram of the hardware and software architecture of the camera service on a foldable screen device provided in an embodiment of this application. Detailed Implementation
[0114] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0115] The terminology used in the following embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to include the plural expressions as well, unless the context clearly indicates otherwise. The terms “first” and “second” are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as “first” or “second” may explicitly or implicitly include one or more of that feature. “First” and “second,” etc., are used to distinguish different objects, not to describe a particular order of objects. For example, a first object and a second object are used to distinguish different objects, not to describe a particular order of objects.
[0116] In the description of the embodiments in this application, unless otherwise stated, "multiple" means two or more. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.
[0117] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or related scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of the terms "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.
[0118] The term "and / or" in this application is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A existing alone, A and B existing simultaneously, and B existing alone.
[0119] The term "user interface (UI)" used in the following embodiments of this application refers to the medium interface through which an application or operating system interacts and exchanges information with the user. It realizes the conversion between the internal form of information and the form that the user can accept. The user interface is source code written in a specific computer language such as Java or Extensible Markup Language (XML). The interface source code is parsed and rendered on the electronic device, ultimately presenting content that the user can recognize. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be visible interface elements such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets displayed on the screen of an electronic device.
[0120] This application provides a shooting method that can be applied to foldable screen devices. These foldable screen devices include, but are not limited to, inward-folding foldable screen devices, outward-folding foldable screen devices, and vertically folding foldable screen devices.
[0121] The following section will first introduce the inward-folding folding screen device, and then, taking the inward-folding folding screen device as an example, will detail a shooting method provided in the embodiments of this application.
[0122] In some possible implementations, the foldable screen device provided in this application embodiment can be an inward-folding foldable screen device. The foldable screen device has at least two displays, which may include a first display and a second display. The first display can be folded into two display areas, for example, a first display area and a second display area. The second display can be located behind the first display.
[0123] The foldable screen device may include at least three sets of cameras, such as a first front-facing camera, a second front-facing camera, and a rear-facing camera. The first front-facing camera may be located on the same side as the first display screen. The second front-facing camera may be located on the same side as the second display screen. The rear-facing camera may be located on the back of the first display screen.
[0124] The first front-facing camera may include one or more cameras, the second front-facing camera may include one or more cameras, and the rear-facing camera may include one or more cameras. This application embodiment does not limit the number of cameras included in the first front-facing camera, the second front-facing camera, and the rear-facing camera.
[0125] In this embodiment, the first front-facing camera can be referred to as the inner screen front-facing camera, and the second front-facing camera can be referred to as the outer screen front-facing camera.
[0126] For example, the product form of the foldable screen device provided in this application embodiment can be as shown in Figure 1. Figure 1 shows a schematic diagram of one product form of the foldable screen device 100.
[0127] Figures 1(a) and (b) are schematic diagrams of the foldable screen device 100 in its folded state. As shown in Figures 1(a) and (b), the foldable screen device 100 may include a display screen 101 and a display screen 102. When the foldable screen device 100 is in the folded state, the display screen 102 is not visible to the user, while the display screen 101 is visible to the user. The foldable screen device 100 may also include a camera 103, which may be located on the same side as the display screen 102. The foldable screen device 100 can be folded or unfolded along the folding screen. The foldable screen device 100 can be an inward-folding foldable screen device 100.
[0128] Figures 1(c) and (d) are schematic diagrams of the unfolded form of the foldable screen device 100. As shown in Figures 1(c) and (d), the foldable screen device 100 also includes cameras 104 and 105. Camera 104 is located on the back of display screen 102, and display screen 101 is located on the back of display screen 102. Similarly, using the folding edge as a dividing line, display screen 102 can be divided into display area 1021 and display area 1022. Camera 105 can be on the same side as display area 1021. The back of display area 1021 can be display screen 101, and the back of display area 1022 can be camera 104.
[0129] Alternatively, in some other examples, the camera 105 may also be on the same side as the display area 1022. The positions of the external screen front camera, the internal screen front camera, and the rear camera shown in FIG1 above in the foldable screen device 100 are only illustrative, and the specific positions of the external screen front camera, the internal screen front camera, and the rear camera in the foldable screen device 100 are not limited in this embodiment.
[0130] For example, the foldable screen device 100 in this application embodiment can be a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, or other device that includes the aforementioned foldable screen, one or more front-facing cameras, and a rear-facing camera. This application embodiment does not impose any special limitations on the specific type or form of the foldable screen device 100.
[0131] In this embodiment, the process of a user's face being captured by a camera (such as an external screen front camera, an internal screen front camera, or a rear camera) of a foldable screen device 100 and the captured facial information being displayed in a preview interface on the display screen is called a selfie. The user refers to the user operating the foldable screen device 100, or the user on the same side of the display screen when the foldable screen device 100 is in a lit state. Depending on the camera used in the selfie process, this embodiment refers to the process of taking a selfie using the external screen front camera as an external screen front-facing selfie, the process of taking a selfie using the rear camera as a rear-facing selfie, and the process of taking a selfie using the internal screen front camera as an internal screen front-facing selfie.
[0132] When the foldable device 100 is in the folded state, the inner screen of the foldable device 100 can be in a screen-off state (or a screen-off state). Users can choose to take a selfie using the front-facing camera on the outer screen or to take a picture of the back of the outer screen using the rear-facing camera in the camera interface displayed on the outer screen. When the foldable device 100 is in the unfolded state, the outer screen of the foldable device 100 can be in a screen-off state, and users can choose to take a selfie using the front-facing camera on the inner screen or to take a picture of the back of the inner screen using the rear-facing camera in the camera interface displayed on the inner screen. Alternatively, users can choose to take a selfie using the rear-facing camera; when taking a selfie using the rear-facing camera, the foldable device can display a preview of the image captured by the rear-facing camera on the outer screen.
[0133] The foldable screen device 100 can switch to the rear camera for selfies in different states and display the preview image captured by the rear camera on the outer screen. The following describes in detail the process by which the foldable screen device 100 switches to the rear camera for selfies in various states, including selfies with the front camera on the outer screen in the folded state, selfies with the rear camera in the folded state, selfies with the front camera on the inner screen in the unfolded state, and selfies with the rear camera in the unfolded state, and displays the preview image captured by the rear camera on the outer screen.
[0134] In one possible implementation, the process of switching from taking a selfie with the front-facing camera on the outer screen of the folded device 100 to taking a selfie with the rear-facing camera, and displaying the preview image captured by the rear-facing camera on the outer screen, can be illustrated in Figure 2A. As shown in Figure 2A(a), the folded device 100 is in a folded state, the outer screen is on, and the inner screen is off. The front-facing camera on the outer screen of the folded device 100 is turned on, and the preview image 206 captured by the front-facing camera is displayed on the preview interface 200 of the outer screen. The preview interface 200 may include a echo control 201, a shooting control 202, a camera switching control 203, one or more shooting mode controls (e.g., a night scene shooting mode control 204A, a portrait shooting mode control 240B, a photo mode control 204C, a video recording mode control 204D, and a more mode control 204E), and a rear-facing selfie switching control 205 for entering the rear-facing camera selfie mode.
[0135] As shown in Figure 2A(a), the camera mode control 204C is selected, and the foldable screen device 100 is in camera mode. The preview interface 200 displays a preview image 206 captured by the front-facing camera on the outer screen in camera mode. The echo control 201 can be used to trigger the display of the captured image or video. The shooting control 202 can be used to save the image captured by the camera. The camera switching control 203 can be used to switch the camera used to capture images on the foldable screen (for example, when the foldable screen device 100 is in a folded state, the front-facing camera on the outer screen switches to the rear camera, and the rear camera switches to the front-facing camera on the outer screen).
[0136] The shooting mode controls can be used to trigger the image processing flow corresponding to that shooting mode. For example, the night scene shooting mode control 204A can be used to trigger the increase of brightness and color richness in the captured image. The portrait shooting mode control 204B can be used to trigger the foldable screen device 100 to beautify the portrait in the captured image. The photo mode control 204C can be used to trigger the foldable screen device 100 to capture an image using default parameters and to process the image captured by the camera (e.g., the external screen front camera) using the default image processing flow. The video recording mode control can be used to trigger the foldable screen device 100 to record video through the camera (e.g., the external screen front camera). The more modes control 204E can be used to trigger the foldable screen device 100 to display more shooting modes.
[0137] As shown in Figure 2A(a), the user is currently taking a selfie using the front-facing camera on the external screen. When the user wants to switch to the rear-facing camera for a selfie, they need to click the rear-facing selfie switch control 205 in the preview interface 200 and unfold the foldable screen device 100. In response to the user clicking the rear-facing selfie switch control 205 and unfolding the foldable screen device 100, the foldable screen device 100 can turn on the rear-facing camera and turn off the front-facing camera on the external screen, displaying a preview of the shot taken by the rear-facing camera on the external screen.
[0138] As shown in Figure 2A(b), the foldable screen device 100 is in the unfolded state, with the inner screen off and the outer screen on. The outer screen displays a preview interface 210, which shows a preview image 207 captured by the rear camera. This preview image 207 contains the user's facial information captured by the rear camera. The preview interface 210 may also include a feedback control 201, a shooting control 202, a camera switching control 203, controls for one or more shooting modes, and a rear selfie switching control 205 for entering the rear camera selfie mode. The feedback control 201, shooting control 202, camera switching control 203, controls for one or more shooting modes, and the rear selfie switching control 205 for entering the rear camera selfie mode can be referred to the description of Figure 2A(a) above, and will not be repeated here.
[0139] In one possible implementation, the process by which the foldable screen device 100 switches from taking a photo with the rear camera in the folded state to taking a selfie with the rear camera, and displays the preview image captured by the rear camera on the outer screen, can be illustrated as shown in Figure 2B. As shown in Figure 2B(a), the foldable screen device 100 is in the folded state, the outer screen is on, the inner screen is off, the rear camera is on, and a preview interface 200 is displayed on the outer screen. This preview interface 200 may include the preview image 208 captured by the rear camera.
[0140] At this point, although the rear camera of the foldable device 100 is on and capturing images, the user's face is not within the camera's field of view, so the rear camera cannot take a selfie. The foldable device 100 needs to be switched to the unfolded state, and the rear camera needs to be pointed at the user's face for the rear camera to capture the user's facial information. The existing logic for the foldable device 100 is that when it switches from a folded state to an unfolded state, the inner screen switches from off to on, and the outer screen switches from on to off. However, when taking a selfie with the rear camera, the user cannot see the preview displayed on the inner screen; only the preview displayed on the outer screen is visible. Therefore, to avoid conflicting with the existing logic, when the user needs to take a selfie with the rear camera and the preview displayed on the outer screen, the user needs to click the rear selfie switch control 205 and unfold the foldable device 100.
[0141] In response to the user's action, the foldable screen device 100 can display a preview interface 210 as shown in Figure 2B(b). The preview interface 210 displays a preview image 207 captured by the rear camera. The preview image 207 contains the user's facial information captured by the rear camera.
[0142] As shown in Figure 2B(b), the foldable screen device 100 is in the unfolded state, the inner screen is in the off state, and the outer screen is in the on state.
[0143] For details regarding (b) in Figure 2B, please refer to the description of (b) in Figure 2A above; it will not be repeated here.
[0144] In one possible implementation, the process by which the foldable screen device 100 switches from taking a selfie with the front-facing camera on the inner screen in its unfolded state to taking a selfie with the rear-facing camera, and displays the preview image captured by the rear-facing camera on the outer screen, can be illustrated in Figure 3A. As shown in Figure 3A(a), the foldable screen device 100 is in its unfolded state, the inner screen is on, and the outer screen is off. The front-facing camera on the inner screen of the foldable screen device 100 is turned on, and the preview image 301 captured by the front-facing camera is displayed on the preview interface 300 of the inner screen. The preview interface 300 may also include a feedback control 201, a shooting control 202, a camera switching control 203, one or more shooting mode controls, and a rear-facing selfie switching control 205 for entering the rear-facing camera selfie mode. The echo control 201, shooting control 202, camera switching control 203, one or more shooting mode controls, and rear selfie switching control 205 for entering the rear camera selfie mode can be referred to the description of Figure 2A(a) above, and will not be repeated here.
[0145] As shown in Figure 3A(a), the user is currently taking a selfie using the front-facing camera on the inner screen. When the user wants to switch to the rear-facing camera for a selfie, they need to click the rear-facing selfie switch control 205 in the preview interface 300 and flip the foldable screen device 100. This ensures that the rear-facing camera and outer screen of the foldable screen device 100 face the user, allowing the rear-facing camera to capture the user's face and the outer screen to be visible to the user. In response to the user clicking the rear-facing selfie switch control 205 and unfolding the foldable screen device 100, the foldable screen device 100 can activate the rear-facing camera and deactivate the front-facing camera on the inner screen, displaying the preview image captured by the rear-facing camera on the outer screen.
[0146] As shown in Figure 3A(b), the foldable screen device 100 is in the unfolded state, with the inner screen off and the outer screen on. The outer screen displays a preview interface 210, which shows a preview image 207 captured by the rear camera. This preview image 207 contains the user's facial information captured by the rear camera.
[0147] For details regarding (b) in Figure 3A, please refer to the description of (b) in Figure 2A above; it will not be repeated here.
[0148] In one possible implementation, the process of the foldable screen device 100 switching from taking a photo with the rear camera in the unfolded state to taking a selfie with the rear camera, and displaying the preview image captured by the rear camera on the outer screen, can be illustrated in Figure 3B. As shown in Figure 3B(a), the foldable screen device 100 is in the unfolded state, the inner screen is on, and the outer screen is off. The rear camera of the foldable screen device 100 is turned on, and the preview image 208 captured by the rear camera can be displayed in the preview interface 310 on the inner screen. The preview interface 310 may also include a feedback control 201, a shooting control 202, a camera switching control 203, one or more shooting mode controls, and a rear selfie switching control 205 for entering the rear camera selfie mode. The feedback control 201, shooting control 202, camera switching control 203, one or more shooting mode controls, and the rear selfie switching control 205 for entering the rear camera selfie mode can be referred to the description of Figure 2A(a) above, and will not be repeated here.
[0149] As shown in Figure 3B(a), the user is currently taking a photo using the rear camera. When the user wants to switch to the rear camera for a selfie, the user needs to click the rear selfie switching control 205 in the preview interface 300 and flip the foldable screen device 100. In response to the user clicking the rear selfie switching control 205 and unfolding the foldable screen device 100, the foldable screen device 100 can display a preview image taken by the rear camera on the outer screen.
[0150] As shown in Figure 3B(b), the foldable screen device 100 is in the unfolded state, with the inner screen off and the outer screen on. The outer screen displays a preview interface 210, which shows a preview image 207 captured by the rear camera. This preview image 207 contains the user's facial information captured by the rear camera.
[0151] For details regarding (b) in Figure 3B, please refer to the description of (b) in Figure 2A above; it will not be repeated here.
[0152] In the process of switching from different scenarios to rear-facing selfie mode, as shown in Figures 2A, 2B, 3A, and 3B, the user must click on the control to enter rear-facing selfie mode and change the orientation of the foldable device (e.g., from folded to unfolded, or by flipping the folded screen) before the foldable device 100 enters rear-facing selfie mode. This increases the number of steps required and negatively impacts the user experience.
[0153] Furthermore, the camera app homepage of the foldable device 100 requires an additional control for accessing the rear camera selfie mode, resulting in a less streamlined layout. On some foldable devices, this control is not easily noticed by users. This negatively impacts the user experience when switching the foldable device to the rear camera for selfies.
[0154] This application provides a shooting method applied to a foldable screen device. The method may include: the foldable screen device 100 detecting a switch from a first state to a second state; the foldable screen device determining that the facial information captured by the rear camera is greater than the facial information captured by the first camera; the foldable screen device 100 turning off the first camera; and displaying the facial information captured by the rear camera on the outer screen.
[0155] The first state can include at least any of the following:
[0156] State 1: The foldable screen device 100 is in a folded state, the inner screen is off, the outer screen is on, the front-facing camera on the outer screen is turned on, and the facial information captured by the front-facing camera is displayed on the outer screen. See Figure 2A(a) for an example of the foldable screen device 100.
[0157] State 2: The foldable screen device 100 is in a folded state, the inner screen is off, the outer screen is on, the rear camera is on, and the outer screen displays a preview image of the user's opposite side captured by the rear camera. See Figure 2B(a) for an example of the foldable screen device 100.
[0158] State 3: The foldable screen device 100 is in the unfolded state, the inner screen is on, the outer screen is off, the front-facing camera on the inner screen is turned on, and the preview image captured by the front-facing camera on the inner screen is displayed. See Figure 3A(a) for the foldable screen device 100 shown here.
[0159] State 4: The foldable screen device 100 is in the unfolded state, the inner screen is on, the outer screen is off, the rear camera is on, and the inner screen displays a preview image of the user's opposite side captured by the rear camera. See Figure 3B(a) for an example of the foldable screen device 100.
[0160] The second state can be when the foldable screen device is unfolded and the rear camera is facing the user.
[0161] The first camera is either an internal screen front-facing camera or an external screen front-facing camera.
[0162] The method provided in this application embodiment eliminates the need for users to manually click on the control for entering the rear-facing selfie camera on the foldable screen device 100. The foldable screen device 100 can automatically and intelligently enter the rear-facing selfie camera mode based on detected state changes and the size of the face captured by the rear camera. This simplifies user operation and improves the user experience.
[0163] The following will describe in detail the process by which the foldable screen device 100 enters the rear-facing selfie mode when switching to the second state, which is in the first state as described in states 1, 2, 3 and 4 above.
[0164] Figures 4 and 5A illustrate the specific process by which the foldable screen device 100 enters the rear selfie mode when it switches from state 1 to the second state.
[0165] Figure 4 exemplarily illustrates a shooting method provided by an embodiment of this application. As shown in Figure 4, when the foldable screen device 100 switches from the above-described state 1 to the second state, the shooting method provided by this embodiment of the application may include the following steps:
[0166] S401. The foldable screen device 100 is in a folded state, the inner screen is in a turned-off state, and the outer screen is in a turned-on state. The foldable screen device 100 turns on the front-facing camera on the outer screen and displays a preview interface 1 on the outer screen. The preview interface 1 displays a preview image 1 captured by the front-facing camera on the outer screen.
[0167] When the foldable screen device 100 is in a folded state, the outer screen is powered on and the inner screen is powered off. Therefore, when the device is folded, the outer screen is on and the inner screen is off.
[0168] When a user clicks the camera app icon on the desktop displayed on the outer screen, the foldable screen device 100 can display a preview interface of the camera app in response to the user's operation. This preview interface can be the preview interface 200 shown in Figure 5A(a). For details about the preview interface 200, please refer to the description of Figure 2A(a) above. The preview screen 206 shown in the preview interface 200 is the preview image captured by the front-facing camera on the outer screen. That is, the foldable screen device 100 is using the front-facing camera on the outer screen at this time. Of course, the user can also use the rear camera to take pictures. For example, the user can click the camera switching control 203. In response to the user's operation, the foldable screen device 100 can power down the front-facing camera on the outer screen and power on the rear camera to start taking pictures. For the scenario of using the rear camera to take pictures when the foldable screen device 100 is in the folded state, please refer to the description of Figures 6 and 7 below, which will not be repeated here.
[0169] In other words, the foldable screen device 100 is currently in the state described above 1.
[0170] S402, the foldable screen device 100 switches from the folded state to the unfolded state based on the user's unfolding operation. The inner screen switches from the off state to the on state, and the outer screen switches from the on state to the off state. The front and rear cameras of the inner screen are turned on, and the preview interface 2 is displayed on the inner screen. The preview interface 2 displays the preview image 2 captured by the front camera of the inner screen.
[0171] The foldable screen device 100 can switch from a folded state to an unfolded state based on the user's unfolding operation. During the unfolding process, the foldable screen device 100 can detect changes in posture. When the foldable screen device 100 detects that its posture has changed from a folded state to an unfolded state, it can power on the inner screen and power off the outer screen. That is, the inner screen of the foldable screen device 100 switches from a screen-off state to a screen-on state, and the outer screen switches from a screen-on state to a screen-off state. For example, as shown in Figure 5A(b), when the foldable screen device 100 detects a change from a folded state to an unfolded state, the inner screen of the foldable screen device 100 switches from a screen-off state to a screen-on state, and the outer screen switches from a screen-on state to a screen-off state.
[0172] In one possible implementation, taking the foldable screen device 100 as shown in Figure 1 as an example, the foldable screen device 100 can determine whether it is currently in a folded or unfolded state based on the angle (i.e., the folding angle) between the display areas 1021 and 1022 of the inner screen. For example, when the foldable screen device 100 is in a folded state, the angle (i.e., the folding angle) α between the display areas 1021 and 1022 is [0°, P]. When the foldable screen device 100 is in an unfolded state, the angle (i.e., the folding angle) α between the display areas 1021 and 1022 is (P, 180°). Where 0° < P < 180°.
[0173] In some feasible examples, the foldable screen device 100 may contain one or more gyroscope sensors, which can detect the angle between the display areas 1021 and 1022 of the inner screen. When the foldable screen device 100 detects an angle α ∈ [0°, P] between the display areas 1021 and 1022 through one or more gyroscope sensors, the foldable screen device 100 determines that it is in a folded state. When the foldable screen device 100 detects an angle α ∈ (P, 180°) between the display areas 1021 and 1022 through one or more gyroscope sensors, the foldable screen device 100 determines that it is in an unfolded state.
[0174] Alternatively, in other feasible examples, the foldable screen device 100 may detect the angle between display area 1021 and display area 1022 using one or more gyroscope sensors and one or more other sensors. For example, the foldable screen device 100 may detect the angle between display area 1021 and display area 1022 using one or more gyroscope sensors and an accelerometer.
[0175] Optionally, in some feasible examples, the foldable screen device 100 may contain one or more Hall sensors, which can detect the angle between the display area 1021 and the display area 1022 of the inner screen.
[0176] Alternatively, in some other feasible examples, an angle sensor is installed on the folding portion of the folding edge of the folding screen device 100 (e.g., on the hinge), and the folding screen device 100 can measure the angle between the display area 1021 and the display area 1022 by means of the angle sensor provided at the folding portion.
[0177] This application does not limit the specific method by which the foldable screen device 100 detects the foldable screen posture (folded state and unfolded state).
[0178] When the foldable screen device 100 unfolds from its folded state, it can also activate the front and rear cameras on the inner screen and deactivate the front camera on the outer screen. The foldable screen device 100 can display a preview interface 2 on the inner screen, which displays a preview image 2 captured by the inner screen's front camera. For example, this preview interface 2 can be the preview interface 300 shown in Figure 3A, and the preview image 2 can be the preview image 301 displayed in the preview interface 300. For details, please refer to the description of Figure 3A(a) above; it will not be repeated here.
[0179] S403. The foldable screen device 100 determines whether the facial information captured by the rear camera is greater than the facial information captured by the front camera on the inner screen. If yes, proceed to step S404; otherwise, proceed to step S405.
[0180] Both the rear camera and the inner screen front camera of the foldable screen device 100 are activated and can capture images. When the user faces the inner screen towards their face, the inner screen front camera can capture the user's facial information. When the user faces the rear camera towards their face, the rear camera can capture the user's facial information. Since the foldable screen device 100 cannot directly determine whether the rear camera or the front camera is facing the user's face based on changes in the device's posture, it needs to compare the facial information captured by the rear camera with that captured by the inner screen front camera. If the foldable screen device 100 determines that the facial information captured by the rear camera is greater than that captured by the inner screen front camera, it can activate the rear camera selfie function, i.e., execute step S404 below. If the foldable screen device 100 determines that the facial information captured by the rear camera is less than that captured by the inner screen front camera, it can choose not to activate the rear camera selfie function and execute step S405 below.
[0181] When the rear camera captures facial information, but the front-facing camera on the inner screen does not capture facial information, the foldable device 100 can determine that it is entering the rear-facing selfie mode. However, when both the front and rear cameras can capture facial information simultaneously, it is necessary to compare the facial information captured by the rear camera with that captured by the front-facing camera on the inner screen. For example, as shown in Figure 5B, a user can use the rear camera of the foldable device to take a picture of someone else. The foldable device 100 can display a preview interface 500 on the outer screen (display 101), which can include the image 502 captured by the rear camera. This image 502 can contain multiple facial images. Therefore, if the foldable device 100 still enters the rear-facing selfie mode based on the facial information captured by the rear camera when both the front and rear cameras can capture facial information simultaneously, then the foldable device 100 may mistakenly trigger the rear-facing selfie mode, meaning the user enters the rear-facing selfie mode without actually using the rear camera, which will affect the user experience. Therefore, the foldable screen device 100 compares the facial information captured by the rear camera with the facial information captured by the front camera. Only when the facial information captured by the rear camera is greater than that captured by the front camera will the foldable screen device 100 switch to rear-camera selfie mode. This avoids the foldable screen device 100 accidentally triggering the rear-camera selfie mode.
[0182] In one possible implementation, the foldable screen device 100 compares the facial information captured by the rear camera and the facial information captured by the front camera on the inner screen, which may include: the foldable screen device 100 comparing the facial size captured by the rear camera and the facial size captured by the front camera on the inner screen.
[0183] In one possible implementation, the foldable screen device 100 can determine that the face size captured by the rear camera is the size of the face frame in the image captured by the rear camera, and determine that the face size captured by the inner screen front camera is the size of the face frame in the image captured by the inner screen front camera. The foldable screen device 100 can obtain the face frame sizes of the images captured by the rear camera and the inner screen front camera. When the foldable screen device 100 determines that the face frame in the image captured by the rear camera is larger than the face frame in the image captured by the inner screen front camera, the foldable screen device 100 can activate the rear camera selfie function and execute the following step S404. When the foldable screen device 100 determines that the face frame in the image captured by the rear camera is smaller than the face frame in the image captured by the inner screen front camera, the foldable screen device 100 can choose not to activate the rear camera selfie function and execute the following step S405.
[0184] Optionally, in some feasible examples, the rear camera or the front camera on the inner screen of the foldable screen device 100 can capture multiple faces. Taking the rear camera capturing multiple faces as an example, when comparing the size of the face bounding box in the image captured by the rear camera with the size of the face bounding box in the image captured by the front camera on the inner screen, the foldable screen device 100 can compare the face bounding box of the largest face among the multiple faces captured by the rear camera with the face bounding box in the image captured by the front camera on the inner screen.
[0185] In some examples, when the image captured by the rear camera does not contain a face, the foldable screen device 100 can determine that the face bounding box size in the image captured by the rear camera is 0. When the image captured by the rear camera includes a face, the foldable screen device 100 can perform face detection on the image captured by the rear camera and determine the face bounding box size in the image captured by the rear camera. For example, after the rear camera captures an image, the rear camera can send the captured image to the camera hardware abstraction layer. The camera hardware abstraction layer can determine the face bounding box size in the image captured by the rear camera through face detection, for example, the face bounding box 501 shown in Figure 5A(a).
[0186] It is understood that the face frames in the images containing faces captured by the various cameras in the foldable screen device 100 may or may not be displayed in the preview interface and may not be visible to the user. This application embodiment does not limit this.
[0187] Because the resolution and field of view (FOV) of the various cameras in a foldable screen device differ, the size of a face captured by different cameras at the same distance will vary. A higher camera resolution results in a higher resolution image. For a face captured at the same distance, a higher resolution camera will capture a larger face. Similarly, a larger FOV camera will capture a larger face. As shown in Figure 5C, (a) is image 503 captured by the camera at 0.9x magnification, with a face bounding box of 5031. (b) is image 504 captured by the camera at 1.97x magnification, with a face bounding box of 5041. Images 503 and 504 were captured at the same distance, but due to the different zoom levels (i.e., different FOVs), the face bounding boxes are different sizes. As shown in Figure 5D, in Figure 5D(a), the resolution of image 503 is 1920*1440, and in Figure 5D(b), the resolution of image 505 is 640*480. That is, the resolution of the camera that captures image 503 is different from the resolution of the camera that captures image 505. However, the shooting distance and zoom ratio of images 503 and 505 are the same, which still results in the face bounding box 5031 in image 503 being different in size from the face bounding box 5051 in image 505.
[0188] In some scenarios, the rear camera has a higher resolution and a larger field of view than the front-facing camera on the inner screen. When a user takes a selfie using the front-facing camera, but there is another person present in the scene, and the rear camera can also capture this other person, and this other person is at the same distance from the rear camera as the user is, the face captured by the rear camera will appear larger than the face captured by the front-facing camera. This can cause the foldable device to mistakenly trigger the rear-facing selfie mode.
[0189] To reduce or avoid accidental triggering of the rear selfie mode due to differences in camera resolution and field of view (FOV) in the foldable screen device 100, the foldable screen device 100 can normalize the FOV and normalize the image size and face frame size of each camera.
[0190] Generally, the inner and outer front-facing cameras in the foldable screen device 100 each contain only one camera module. Therefore, the foldable screen device 100 can normalize the FOV (Field of View) of the inner and outer front-facing cameras to a fixed value. For example, the foldable screen device 100 can normalize the FOV of the inner and outer front-facing cameras to 86°. However, the rear camera typically has multiple modules with different zoom ratios. The foldable screen device 100 can normalize the FOV of the rear camera by multiplying the original FOV by a normalization coefficient FOV_radio. FOV_radio is related to the equivalent focal length of the camera module and the zoom ratio of the user interface.
[0191] The foldable screen device 100 can also normalize faces in images captured by the camera to a fixed-resolution image, and then determine the size of the face bounding box in the fixed-resolution image. For example, the fixed resolution can be 640*480, but this embodiment does not limit the specific value of the fixed resolution. For instance, the foldable screen device 100 can normalize faces in images captured by the rear camera to a 640*480 resolution image, and then determine the size of the face bounding box in the 640*480 resolution image. Similarly, the foldable screen device 100 can normalize faces in images captured by the front-facing camera on the inner screen to a 640*480 resolution image. Then, the foldable screen device 100 compares the sizes of the face bounding boxes in the two normalized images.
[0192] For example, the size of the face bounding box in the normalized image can be represented by the following formula: cameraface = UX magnification / module base magnification * reported face bounding box / original image's longer side * 640 (Formula 1)
[0193] In Formula 1 above, `cameraface` represents the size of the face bounding box in the normalized image. The reported face bounding box is the size of the face bounding box detected by the camera hardware abstraction layer in the original image captured by the camera. This reported face bounding box size can be configured by the camera application. The longer side of the original image refers to the resolution of the longer side of the original image output by the camera. For example, if the original image size is 1920*1440, then the longer side of the original image is 1920. The UX magnification is the zoom magnification displayed in the preview interface of the camera application on the foldable screen device 100, such as 0.75x, 1.0x, 2.0x, etc. When the camera is a rear wide-angle module, the base magnification of this module is 0.7, and the corresponding resolution of the longer side of the original image output can be 4160. When the camera is a rear main camera module, the base magnification of this module is 1, and the corresponding resolution of the longer side of the original image output can be 4096. When the camera is a rear telephoto module, the module's base magnification is 3.2, and the resolution of the longer side of the output image can be 3264.
[0194] In this way, through the above normalization, the calculated face frame size can be consistent for people of the same height, at the same distance, and captured by different cameras. This avoids the possibility of foldable screen devices accidentally triggering the rear selfie mode due to differences in camera resolution and field of view.
[0195] Optionally, in one possible implementation, after the camera of the foldable screen device 100 captures an image, the foldable screen device 100 needs to perform eye gaze detection or face orientation detection on the captured image. If the foldable screen device 100 detects eye gaze or a face facing the camera in the image captured by the camera, the foldable screen device 100 can determine the size of the face frame in the image according to Formula 1 above. If the foldable screen device 100 does not detect eye gaze or a face facing the camera in the image captured by the camera, the foldable screen device 100 can determine that the size of the face frame in the image is 0. In this way, it can avoid the rear camera capturing passersby and mistakenly triggering the rear selfie mode.
[0196] In this way, the foldable screen device 100 can determine whether the user is closer to the rear camera or the inner screen front camera by comparing the face size captured by the rear camera and the inner screen front camera. When the distance between the user and the rear camera is less than the distance between the user and the inner screen front camera, the foldable screen device 100 can determine that the user wants to take a selfie with the rear camera and therefore automatically switches to rear camera selfie mode. When the distance between the user and the inner screen front camera is less than the distance between the user and the rear camera, the foldable screen device 100 can determine that the user is taking a selfie with the inner screen front camera. At this time, the foldable screen device 100 can turn off the rear camera.
[0197] Alternatively, in another possible implementation, the determination by the foldable screen device 100 of whether the distance between the user and the rear camera is less than the distance between the user and the front camera on the inner screen may not be limited to comparing the face size captured by the rear camera and the face size captured by the front camera on the inner screen. The foldable screen device 100 can also measure the distance between the user and the rear camera, and the distance between the user and the front camera on the inner screen, using distance-measuring sensors (e.g., proximity sensors, infrared sensors, etc.). For example, a proximity sensor may be present at the rear camera of the foldable screen device 100, and a proximity sensor may also be stored at the front camera on the inner screen. Then, the foldable screen device 100 can determine the distance between the user and the rear camera based on the proximity sensor at the rear camera; and determine the distance between the user and the front camera on the inner screen based on the proximity sensor at the front camera. In this way, the foldable screen device 100 can determine whether the distance to the rear camera is less than the distance between the user and the front camera on the inner screen, or whether the distance to the rear camera is greater than the distance between the user and the front camera on the inner screen.
[0198] Furthermore, if the foldable screen device 100 determines through distance-measuring sensors that the distance to the rear camera is less than the distance between the user and the inner screen front camera, or the distance to the rear camera is greater than the distance between the user and the inner screen front camera, then when the foldable screen device 100 detects a change from a folded state to an unfolded state, the foldable screen device 100 does not need to activate the rear camera in the background; it only needs to activate the distance-measuring sensors at both the rear camera and the inner screen front camera. If the distance to the rear camera is determined to be less than the distance between the user and the inner screen front camera, the foldable screen device 100 activates the rear camera, deactivates the inner screen front camera, and enters rear-camera selfie mode. If the distance to the rear camera is determined to be greater than the distance between the user and the inner screen front camera, the foldable screen device 100 uses the inner screen front camera for selfies.
[0199] S404, the foldable screen device 100 switches the outer screen from off state to on state, switches the inner screen from on state to off state, turns off the front camera of the inner screen, and displays a preview interface 1 on the outer screen. The preview interface 1 displays a preview image 3 captured by the rear camera, and the preview image 3 contains facial information captured by the rear camera.
[0200] If the foldable screen device 100 determines that the facial information captured by the rear camera is larger than the facial information captured by the front camera, the foldable screen device 100 can activate the rear camera for selfies. That is, the foldable screen device 100 switches the outer screen from off to on, the inner screen from on to off, disables the front camera on the inner screen, and displays preview interface 1 on the outer screen. Preview interface 1 displays a preview image 3 captured by the rear camera, and preview image 3 contains the facial information captured by the rear camera. For example, as shown in Figure 5A(c), the outer screen of the foldable screen device 100 is on and displays preview interface 210. This preview interface 210 displays a preview image of a selfie taken with the rear camera, which may contain the user's facial information captured by the rear camera. The inner screen of the foldable screen device 100 is off.
[0201] S405. The foldable screen device 100 determines whether the duration for which the face information captured by the rear camera is less than the duration for which the face information captured by the front camera on the inner screen is greater than a preset duration. If yes, then proceed to step S406; otherwise, proceed to step S403.
[0202] If the foldable screen device 100 determines that the facial information captured by the rear camera is less than the facial information captured by the front camera on the inner screen, the foldable screen device 100 can keep the rear camera on. Then, the inner screen remains on, displaying a preview image captured by the front camera on the inner screen, and continuously compares the facial information captured by the rear camera with that captured by the front camera on the inner screen. If, within a preset time period, the foldable screen device 100 determines that the facial information captured by the rear camera is consistently less than that captured by the front camera on the inner screen, then the foldable screen device 100 does not enter the rear selfie mode and proceeds to step S406. In other words, the foldable screen device 100 determines whether the facial information captured by the rear camera is less than that captured by the front camera on the inner screen for a period longer than a preset time period. If yes, it proceeds to step S406; otherwise, it continues to step S403.
[0203] The preset duration can be configured by the system of the foldable screen device 100. The preset duration is a positive number greater than 0, for example, the preset duration can be 5 seconds. This application embodiment does not limit the specific value of the preset duration.
[0204] S406, The foldable screen device 100 turns off the rear camera, keeps the inner screen on, keeps the outer screen off, and displays a preview interface 2 on the inner screen, which shows the preview image 2 captured by the front camera of the inner screen.
[0205] If the foldable screen device 100 determines that it will not enter the rear selfie mode, the foldable screen device 100 can maintain the front-facing selfie camera on the inner screen. That is, the foldable screen device 100 turns off the rear camera, keeps the front-facing camera on the inner screen, keeps the inner screen on, keeps the outer screen off, and displays a preview interface 2 on the inner screen. This preview interface 2 displays a preview image 2 captured by the front-facing camera on the inner screen. This preview interface 2 can be the preview interface 300 shown in Figure 3A(a). For details about this preview interface 300, please refer to the description of Figure 3A(a) above, which will not be repeated here.
[0206] The shooting method provided in this application embodiment allows the foldable screen device 100 to automatically switch to rear-facing selfie mode when transitioning from state 1 to the second state. For example, the foldable screen device 100 switches from the state shown in FIG. 5A(a) to the rear-facing selfie state shown in FIG. 5A(c). This eliminates the need for the user to click on a control in the camera application's preview interface to enter rear-facing selfie mode. This simplifies the process of entering rear-facing selfie mode, thereby improving the user experience.
[0207] Figures 6 and 7 illustrate the specific process by which the foldable screen device 100 enters the rear selfie mode when it switches from state 2 to the second state.
[0208] Figure 6 exemplarily illustrates a shooting method provided by an embodiment of this application. As shown in Figure 6, when the foldable screen device 100 switches from the above-described state 2 to the second state, the shooting method provided by this embodiment of the application may include the following steps:
[0209] S601, the foldable screen device 100 is in a folded state, the inner screen is in a turned-off state, the outer screen is in a turned-on state, the rear camera is turned on, and the preview interface 1 is displayed on the outer screen. The preview interface 1 displays the preview image 4 captured by the rear camera.
[0210] When the foldable screen device 100 is in a folded state, the outer screen is powered on and the inner screen is powered off. Therefore, when the device is folded, the outer screen is on and the inner screen is off.
[0211] Users can choose to take photos using the rear camera when the foldable screen device 100 is in the folded state. In response to the user opening the camera application or clicking the camera switching control 203, the foldable screen device 100 can activate the rear camera to take photos and display a preview interface 1 on the outer screen, which displays a preview image 4 captured by the rear camera. For example, the preview interface 1 can be the preview interface 200 shown in Figure 7(a), which displays a preview image 208 captured by the rear camera. For details regarding the display of the preview interface 200 on the outer screen when the foldable screen device 100 is in the folded state, please refer to the above description of Figure 2B(a), which will not be repeated here.
[0212] In other words, the foldable screen device 100 is currently in the state 2 described above.
[0213] S602, the foldable screen device 100 switches from the folded state to the unfolded state based on the user's unfolding operation. The inner screen switches from the off state to the on state, the outer screen switches from the on state to the off state, the front camera of the inner screen is turned on, and the rear camera is kept on. The preview interface 2 is displayed on the inner screen, and the preview screen 4 captured by the rear camera is displayed in the preview interface 2.
[0214] The foldable screen device 100 can switch from a folded state to an unfolded state based on the user's unfolding operation. During the unfolding process, the foldable screen device 100 can detect changes in posture. When the foldable screen device 100 detects that its posture has changed from a folded state to an unfolded state, it can power on the inner screen and power off the outer screen. That is, the inner screen of the foldable screen device 100 switches from a screen-off state to a screen-on state, and the outer screen switches from a screen-on state to a screen-off state. For example, as shown in Figure 7(b), when the foldable screen device 100 detects a change from a folded state to an unfolded state, the inner screen of the foldable screen device 100 switches from a screen-off state to a screen-on state, and the outer screen switches from a screen-on state to a screen-off state.
[0215] For details on how the foldable screen device 100 detects the change from a folded state to an unfolded state, please refer to the description in step S402 above, which will not be repeated here.
[0216] When the foldable screen device 100 unfolds from its folded state, it can also activate the front-facing camera on the inner screen and keep the rear camera on. The foldable screen device 100 can display a preview interface 2 on the inner screen, which shows a preview image 4 captured by the rear camera. For example, the preview interface 2 can be the preview interface 310 shown in FIG. 3B, and the preview image 4 can be the preview image 208 shown in the preview interface 310. For details, please refer to the description of FIG. 3B(a) above; it will not be repeated here.
[0217] S603. The foldable screen device 100 determines whether the facial information captured by the rear camera is greater than the facial information captured by the front camera on the inner screen. If yes, then proceed to step S604; otherwise, proceed to step S605.
[0218] Both the rear camera and the inner screen front camera of the foldable screen device 100 are activated and can capture images. When the user faces the inner screen towards their face, the inner screen front camera can capture the user's facial information. When the user faces the rear camera towards their face, the rear camera can capture the user's facial information. Since the foldable screen device 100 cannot directly determine whether the rear camera or the front camera is facing the user's face based on changes in the device's posture, it needs to compare the facial information captured by the rear camera with that captured by the inner screen front camera. If the foldable screen device 100 determines that the facial information captured by the rear camera is greater than that captured by the inner screen front camera, it can activate the rear camera selfie function, i.e., execute step S604 below. If the foldable screen device 100 determines that the facial information captured by the rear camera is less than that captured by the inner screen front camera, it can choose not to activate the rear camera selfie function and execute step S605 below.
[0219] Step S603 can be referred to the description in step S403, and will not be repeated here.
[0220] S604, the foldable screen device 100 switches the outer screen from off state to on state, switches the inner screen from on state to off state, turns off the front camera on the inner screen, and displays a preview interface 1 on the outer screen. The preview interface 1 displays a preview image 3 captured by the rear camera, and the preview image 3 contains facial information captured by the rear camera.
[0221] If the foldable screen device 100 determines that the facial information captured by the rear camera is larger than the facial information captured by the front camera, the foldable screen device 100 can activate the rear camera for selfies. That is, the foldable screen device 100 switches the outer screen from off to on, the inner screen from on to off, disables the front camera on the inner screen, and displays preview interface 1 on the outer screen. Preview interface 1 displays a preview image 3 captured by the rear camera, and preview image 3 contains the facial information captured by the rear camera. For example, as shown in Figure 7(c), the outer screen of the foldable screen device 100 is on and displays preview interface 210. This preview interface 210 displays a preview image of a selfie taken with the rear camera, which may contain the user's facial information captured by the rear camera. The inner screen of the foldable screen device 100 is off.
[0222] S605. The foldable screen device 100 determines whether the duration for which the face information captured by the rear camera is less than the duration for which the face information captured by the front camera on the inner screen is greater than a preset duration. If yes, then proceed to step S606; otherwise, proceed to step S603.
[0223] If the foldable screen device 100 determines that the facial information captured by the rear camera is less than the facial information captured by the front camera on the inner screen, the foldable screen device 100 can keep both the front and rear cameras on the inner screen continuously active. Then, the inner screen of the foldable screen device 100 is on, displaying a preview image captured by the rear camera, and continuously comparing the facial information captured by the rear camera with that captured by the front camera on the inner screen. If, within a preset time period, the foldable screen device 100 determines that the facial information captured by the rear camera is consistently less than that captured by the front camera on the inner screen, then the foldable screen device 100 does not enter the rear selfie mode and proceeds to step S606. In other words, the foldable screen device 100 determines whether the facial information captured by the rear camera is less than that captured by the front camera on the inner screen for a period longer than a preset time period. If yes, it proceeds to step S606; otherwise, it continues to step S603.
[0224] Step S605 can be referred to the description in step S405, and will not be repeated here.
[0225] S606, the foldable screen device 100 turns off the front camera on the inner screen, the inner screen is on, the outer screen is off, and the preview interface 2 is displayed on the inner screen. The preview interface 2 displays the preview image 4 captured by the rear camera.
[0226] If the foldable screen device 100 determines that it will not enter the rear-facing selfie mode, the foldable screen device 100 can maintain the rear-facing camera's shooting mode. That is, the foldable screen device 100 turns off the inner screen's front-facing camera while keeping the rear-facing camera on, the inner screen remains on, the outer screen remains off, and a preview interface 2 is displayed on the inner screen. This preview interface 2 displays a preview image 4 captured by the rear-facing camera. This preview interface 2 can be the preview interface 310 shown in Figure 3B, and the preview image 4 can be the preview image 208 shown in the preview interface 310. For details, please refer to the description of Figure 3B(a) above, which will not be repeated here.
[0227] That is, the preview interface 2 displayed on the inner screen in step S606 is the same as the preview interface 2 displayed on the inner screen in step S602.
[0228] The shooting method provided in this application embodiment allows the foldable screen device 100 to automatically switch to rear-facing selfie mode when switching from state 2 to the second state. For example, the foldable screen device 100 switches from the state shown in FIG. 7(a) to the rear-facing selfie state shown in FIG. 7(c). Users do not need to click on the control for entering rear-facing selfie mode in the camera application's preview interface. This simplifies the operation of entering rear-facing selfie mode, thereby improving the user experience.
[0229] Figures 8 and 9 illustrate the specific process by which the foldable screen device 100 enters the rear selfie mode when it switches from state 3 to the second state.
[0230] Figure 8 exemplarily illustrates a shooting method provided by an embodiment of this application. As shown in Figure 8, when the foldable screen device 100 switches from the above-described state 3 to the second state, the shooting method provided by this embodiment of the application may include the following steps:
[0231] S801, the foldable screen device 100 is in the unfolded state, the inner screen is in the on state, the outer screen is in the off state, the front camera of the inner screen is turned on, and the preview interface 2 is displayed on the inner screen, which displays the preview image captured by the front camera of the inner screen.
[0232] The foldable screen device 100 can be in an unfolded state. In the unfolded state, the foldable screen device 100 powers on the inner screen and powers off the outer screen. Therefore, in the folded state, the inner screen of the foldable screen device 100 is on, and the outer screen is off.
[0233] In the unfolded state, the user can click the camera application icon in the foldable screen device 100 and select the inner screen front camera for selfie. In response to the user's operation, the foldable screen device 100 can turn on the inner screen front camera and display a preview interface 2 of the camera application on the inner screen. The preview interface 2 can display a preview image 2 captured by the inner screen front camera.
[0234] For example, the unfolded foldable screen device 100 can be as shown in Figure 9(a), and the preview interface 2 can be the preview interface 300 shown in Figure 9(a). The preview screen 2 can be the preview screen 301 shown in Figure 9(a). For details about the preview interface 300 and the preview screen 301, please refer to the description of Figure 3A(a) above, which will not be repeated here.
[0235] In other words, the foldable screen device 100 is currently in the state 3 described above.
[0236] S802, the foldable screen device 100 turns on the rear camera based on the user's flip operation; the inner screen is on, the outer screen is off, the front camera of the inner screen remains on, and the inner screen displays a preview interface 2, which displays a preview image 2 captured by the front camera of the inner screen.
[0237] Users can flip the foldable screen device 100. For example, as shown in FIG9, users can flip the foldable screen device 100 from the posture shown in FIG9(a) to the posture shown in FIG9(b).
[0238] In other words, the user can flip the foldable device 100 from having the inner screen facing the user so that the outer screen and rear camera face the user. The foldable device 100 can detect the user's flipping operation and, based on this operation, activate the rear camera. At this time, the rear camera is only activated in the background, and the foldable device 100 does not display the preview image captured by the rear camera. The inner screen of the foldable device 100 is in a lit state, the outer screen is in a lit state, the front camera on the inner screen remains activated, and the inner screen displays a preview interface 2, which displays a preview image 2 captured by the front camera on the inner screen. For details about the preview interface 2 and the preview image 2, please refer to the description in step S801 above, which will not be repeated here.
[0239] In one possible implementation, the foldable screen device 100 can detect that it has been flipped based on a Hall sensor and / or an accelerometer. Alternatively, the foldable screen device 100 can detect that it has been flipped based on a gyroscope sensor and / or an accelerometer. For details on how the foldable screen device 100 specifically detects the flipping, please refer to the relevant descriptions in the prior art, which will not be repeated here.
[0240] S803. The foldable screen device 100 determines whether the facial information captured by the rear camera is greater than the facial information captured by the front camera on the inner screen. If yes, then proceed to step S804; otherwise, proceed to step S805.
[0241] If the foldable screen device 100 determines that the facial information captured by the rear camera is greater than the facial information captured by the front camera on the inner screen, the foldable screen device 100 can activate the rear camera selfie function, i.e., execute step S804 below. If the foldable screen device 100 determines that the facial information captured by the rear camera is less than the facial information captured by the front camera on the inner screen, the foldable screen device 100 can choose not to activate the rear camera selfie function, and execute step S805 below.
[0242] Step S803 can be referred to the description in step S403, and will not be repeated here.
[0243] S804, the foldable screen device 100 switches the outer screen from off state to on state, switches the inner screen from on state to off state, turns off the front camera of the inner screen, and displays a preview interface 1 on the outer screen. The preview interface 1 displays a preview image 3 captured by the rear camera, and the preview image 3 contains facial information captured by the rear camera.
[0244] If the foldable screen device 100 determines that the facial information captured by the rear camera is greater than the facial information captured by the front camera, the foldable screen device 100 can activate the rear camera for selfies. That is, the foldable screen device 100 switches the outer screen from off to on, the inner screen from on to off, disables the front camera on the inner screen, and displays preview interface 1 on the outer screen. Preview interface 1 displays a preview image 3 captured by the rear camera, which contains the facial information captured by the rear camera. For example, as shown in Figure 9(b), the outer screen of the foldable screen device 100 is on and displays preview interface 210. This preview interface 210 displays a preview image of a selfie taken with the rear camera, which may contain the user's facial information captured by the rear camera. The inner screen of the foldable screen device 100 is off.
[0245] S805. The foldable screen device 100 determines whether the duration for which the face information captured by the rear camera is less than the duration for which the face information captured by the front camera on the inner screen is greater than a preset duration. If yes, then proceed to step S806; otherwise, proceed to step S803.
[0246] If the foldable screen device 100 determines that the facial information captured by the rear camera is less than the facial information captured by the front camera on the inner screen, the foldable screen device 100 can keep the rear camera on. Then, the inner screen remains on and displays a preview image captured by the front camera on the inner screen. The device continuously compares the facial information captured by the rear camera with that captured by the front camera on the inner screen. If, within a preset time period, the foldable screen device 100 determines that the facial information captured by the rear camera is consistently less than that captured by the front camera on the inner screen, then the foldable screen device 100 does not enter the rear selfie mode and proceeds to step S806. In other words, the foldable screen device 100 determines whether the facial information captured by the rear camera is less than that captured by the front camera on the inner screen for a period longer than a preset time period. If yes, it proceeds to step S806; otherwise, it continues to step S803.
[0247] Step S805 can be referred to the description in step S405, and will not be repeated here.
[0248] S806, the foldable screen device 100 turns off the rear camera, the inner screen is on, the outer screen is off, and the preview interface 2 is displayed on the inner screen, which displays the preview image 2 captured by the front camera of the inner screen.
[0249] If the foldable screen device 100 determines that it will not enter the rear selfie mode, the foldable screen device 100 can turn off the rear camera and maintain its initial state, which is the state of the foldable screen device 100 in step S801. That is, the inner screen of the foldable screen device 100 is in a lit state, the outer screen is in a turned-off state, and the preview screen 2 is displayed on the inner screen. The preview screen 2 displays the preview image captured by the front camera of the inner screen. For details, please refer to the description in step S801 above, which will not be repeated here.
[0250] The shooting method provided in this application embodiment allows the foldable screen device 100 to automatically switch to rear-facing selfie mode when switching from state 3 to the second state. For example, the foldable screen device 100 switches from the state shown in FIG9(a) to the rear-facing selfie state shown in FIG9(b). Users do not need to click on the control for entering rear-facing selfie mode in the camera application's preview interface. This simplifies the operation of entering rear-facing selfie mode, thereby improving the user experience.
[0251] Figures 10 and 11 illustrate the specific process by which the foldable screen device 100 enters the rear selfie mode when it switches from state 4 to the second state.
[0252] Figure 10 exemplarily illustrates a shooting method provided by an embodiment of this application. As shown in Figure 10, when the foldable screen device 100 switches from the above-described state 4 to the second state, the shooting method provided by this embodiment of the application may include the following steps:
[0253] S1001, The foldable screen device 100 is in the unfolded state, the inner screen is in the on state, the outer screen is in the off state, the rear camera is turned on, and the preview interface 2 is displayed on the inner screen. The preview interface 2 displays the preview image 4 captured by the rear camera.
[0254] The foldable screen device 100 can be in an unfolded state. In the unfolded state, the foldable screen device 100 powers on the inner screen and powers off the outer screen. Therefore, in the folded state, the inner screen of the foldable screen device 100 is on, and the outer screen is off.
[0255] In the unfolded state, the user can click the camera application icon in the foldable screen device 100 and select the rear camera to take a picture. In response to the user's operation, the foldable screen device 100 can turn on the rear camera and display a preview interface 2 of the camera application on the inner screen. The preview interface 2 can display a preview image 4 captured by the rear camera.
[0256] For example, the unfolded foldable screen device 100 can be as shown in Figure 11(a), and the preview interface 2 can be the preview interface 310 shown in Figure 11(a). The preview screen 4 can be the preview screen 208 shown in Figure 11(a). For details about the preview interface 310 and the preview screen 208, please refer to the description of Figure 3B(a) above, which will not be repeated here.
[0257] In other words, the foldable screen device 100 is currently in the state described above 4.
[0258] S1002, the foldable screen device 100 turns on the front camera of the inner screen based on the user's flip operation; the inner screen is in the on state, the outer screen is in the off state, the rear camera remains on, the inner screen displays a preview screen 2, and the preview screen 2 displays a preview screen 4 captured by the rear camera.
[0259] Users can flip the foldable screen device 100. For example, as shown in FIG11, users can flip the foldable screen device 100 from the posture shown in FIG11(a) to the posture shown in FIG11(b).
[0260] In other words, the user can flip the foldable device 100 so that the outer screen and rear camera face the user from the inner screen. The foldable device 100 can detect the user's flipping operation and, based on this operation, activate the inner screen's front-facing camera. At this time, the inner screen's front-facing camera is only activated in the background, and the foldable device 100 does not display the preview image captured by the inner screen's front-facing camera. The inner screen of the foldable device 100 is in a lit state, the outer screen is in a turned-off state, the rear camera remains on, and the inner screen displays a preview interface 2, which displays the preview image 4 captured by the rear camera. For details about preview interface 2 and preview image 4, please refer to the description in step S1001 above, which will not be repeated here.
[0261] For details on how the foldable screen device 1000 detects that the foldable screen device 100 has been flipped, please refer to the description in step S802, which will not be repeated here.
[0262] S1003. The foldable screen device 100 determines whether the facial information captured by the rear camera is greater than the facial information captured by the front camera on the inner screen. If yes, then proceed to step S1004; otherwise, proceed to step S1005.
[0263] If the foldable screen device 100 determines that the facial information captured by the rear camera is greater than the facial information captured by the front camera on the inner screen, the foldable screen device 100 can activate the rear camera selfie function, i.e., perform step S1004 below. If the foldable screen device 100 determines that the facial information captured by the rear camera is less than the facial information captured by the front camera on the inner screen, the foldable screen device 100 can choose not to activate the rear camera selfie function, and perform step S1005 below.
[0264] Step S1003 can be referred to the description in step S403, and will not be repeated here.
[0265] S1004, the foldable screen device 100 switches the outer screen from the off state to the on state, switches the inner screen from the on state to the off state, turns off the front camera of the inner screen, and displays the preview interface 3 on the outer screen. The preview interface 3 displays the preview image 3 captured by the rear camera, and the preview image 3 contains the facial information captured by the rear camera.
[0266] If the foldable screen device 100 determines that the facial information captured by the rear camera is greater than the facial information captured by the front camera, the foldable screen device 100 can activate the rear camera for selfies. That is, the foldable screen device 100 switches the outer screen from off to on, the inner screen from on to off, disables the front camera on the inner screen, and displays a preview interface 3 on the outer screen. This preview interface 3 displays a preview image 3 captured by the rear camera, which includes the facial information captured by the rear camera. For example, as shown in Figure 11(b), the outer screen of the foldable screen device 100 is on and displays a preview interface 210. This preview interface 210 displays a preview image of a selfie taken with the rear camera, which may include the user's facial information captured by the rear camera. The inner screen of the foldable screen device 100 is off.
[0267] S1005. The foldable screen device 100 determines whether the duration for which the face information captured by the rear camera is less than the duration for which the face information captured by the front camera on the inner screen is greater than a preset duration. If yes, then proceed to step S1006; otherwise, proceed to step S1003.
[0268] If the foldable screen device 100 determines that the facial information captured by the rear camera is less than the facial information captured by the inner screen front camera, the foldable screen device 100 can keep both the inner screen front camera and the rear camera on. Then, the inner screen of the foldable screen device 100 is on and displays a preview image captured by the rear camera, continuously comparing the facial information captured by the rear camera with that captured by the inner screen front camera. If, within a preset time period, the foldable screen device 100 determines that the facial information captured by the rear camera is consistently less than that captured by the inner screen front camera, then the foldable screen device 100 does not enter the rear selfie mode and proceeds to step S1006. That is, the foldable screen device 100 determines whether the facial information captured by the rear camera is less than that captured by the inner screen front camera for a period longer than a preset time period. If yes, it proceeds to step S1006; otherwise, it continues to step S1003.
[0269] Step S1005 can be referred to the description in step S405, and will not be repeated here.
[0270] S1006, The foldable screen device 100 turns off the front camera on the inner screen, the inner screen is on, the outer screen is off, and the preview interface 2 is displayed on the inner screen. The preview interface 2 displays the preview image 4 captured by the rear camera.
[0271] If the foldable screen device 100 determines that it will not enter the rear-facing selfie mode, the foldable screen device 100 can maintain the rear-facing camera's shooting mode. That is, the foldable screen device 100 turns off the inner screen's front-facing camera while keeping the rear-facing camera on, the inner screen remains on, the outer screen remains off, and a preview interface 2 is displayed on the inner screen. This preview interface 2 displays a preview image 4 captured by the rear-facing camera. This preview interface 2 can be the preview interface 310 shown in Figure 3B, and the preview image 4 can be the preview image 208 shown in the preview interface 310. For details, please refer to the description of Figure 3B(a) above, which will not be repeated here.
[0272] That is, the preview interface 2 displayed on the inner screen in step S1006 is the same as the preview interface 2 displayed on the inner screen in step S1001.
[0273] The shooting method provided in this application embodiment allows the foldable screen device 100 to automatically switch to rear-facing selfie mode when transitioning from state 4 to the second state. For example, the foldable screen device 100 switches from the state shown in FIG11(a) to the rear-facing selfie state shown in FIG11(b). This eliminates the need for the user to click on a control in the camera application's preview interface to enter rear-facing selfie mode. This simplifies the process of entering rear-facing selfie mode, thereby improving the user experience.
[0274] The shooting method provided in this application embodiment allows the foldable screen device 100 to take photos whether it is in a folded state (rear camera shooting, folded outer screen front camera selfie shooting, unfolded rear camera shooting, or unfolded inner screen front camera shooting). When the user unfolds or flips the unfolded foldable screen device 100, the foldable screen device 100 can activate both the inner screen front camera and the rear camera, and compare the facial information captured by the inner screen front camera with that captured by the rear camera. If the foldable screen device 100 determines that the facial information captured by the rear camera is greater than that captured by the front camera, the foldable screen device 100 can activate the rear camera selfie mode. In this way, the foldable screen device 100 can automatically enter the rear camera selfie mode regardless of its state, simplifying user operation and improving user experience.
[0275] Once the foldable screen device 100 enters rear selfie mode, it can also exit rear selfie mode. This allows it to meet different shooting needs of users.
[0276] In one possible implementation, when the foldable screen device 100 enters the rear-camera selfie mode, the user can click a control to exit the rear-camera selfie mode or change the foldable screen device 100 from an unfolded state to a folded state. In response to this user operation, the foldable screen device 100 can exit the rear-camera selfie mode. For example, as shown in Figure 2A(b), the foldable screen device 100 is in rear-camera selfie mode, and a preview interface 210 of the rear-camera selfie is displayed on the outer screen. The user can change the foldable screen device 100 from a folded state to an unfolded state. In response to this user operation, the foldable screen device 100 can exit the rear-camera selfie mode and display a preview image captured by the rear camera on the outer screen. That is, the foldable screen device 100 returns to the state shown in Figure 2B(a), as detailed in the description of 2B(a) above, which will not be repeated here. Again, as shown in Figure 2A(b), the foldable screen device 100 is in rear-camera selfie mode, and a preview interface 210 of the rear-camera selfie is displayed on the outer screen. The user can click the rear selfie switching control 205 in the preview interface 210. In response to the user's operation, the foldable screen device 100 can exit the rear selfie mode, switch the outer screen from the on state to the off state, and switch the inner screen from the off state to the on state, displaying the preview image captured by the rear camera on the inner screen. That is, the foldable screen device 100 is in the state shown in Figure 3B(a). For details, please refer to the description of Figure 3B(a) above, which will not be repeated here.
[0277] In another possible implementation, when the foldable screen device 100 is in rear-facing selfie mode, it can activate the inner screen front-facing camera upon detecting a user's flip operation. When the foldable screen device 100 determines that the facial information captured by the inner screen front-facing camera is larger than the facial information captured by the rear camera, the foldable screen device 100 can exit rear-facing selfie mode and enter inner screen front-facing selfie mode. Figures 12 and 13 in this embodiment specifically illustrate the process of the foldable screen device 100 exiting rear-facing selfie mode and entering inner screen front-facing selfie mode.
[0278] Figure 12 exemplarily illustrates a shooting method provided by an embodiment of this application. As shown in Figure 12, the foldable screen device 100 switches from rear-facing selfie mode to inner-screen front-facing selfie mode, which may include the following steps:
[0279] S1201, the foldable screen device 100 is in the unfolded state, the outer screen is in the on state, the inner screen is in the off state, the rear camera is turned on, and the preview interface 1 is displayed on the outer screen. The preview interface 1 displays the preview image 3 captured by the rear camera, and the preview image 3 contains the facial information captured by the rear camera.
[0280] The foldable screen device 100 is in rear-facing selfie mode. That is, the foldable screen device 100 is in an unfolded state, the outer screen is on, the inner screen is off, the rear camera is activated, and a preview interface 1 is displayed on the outer screen. Preview interface 1 displays a preview image 3 captured by the rear camera, and preview image 3 includes facial information captured by the rear camera. For example, the foldable screen device 100 in rear-facing selfie mode can be as shown in Figure 13(a). Preview interface 1 can be preview interface 210 shown in Figure 13(a), and preview image 3 can be preview image 207 shown in Figure 13(a).
[0281] S1202, the foldable screen device 100 turns on the front camera of the inner screen based on the user's flip operation, the outer screen is on, the inner screen is off, the rear camera is kept on, the outer screen displays a preview interface 1, and the preview interface 1 displays a preview image 3 captured by the rear camera.
[0282] Users can flip the foldable screen device 100. For example, as shown in FIG13, users can flip the foldable screen device 100 from the posture shown in FIG13(a) to the posture shown in FIG13(b).
[0283] In other words, the user can flip the foldable device 100 so that the outer screen and rear camera face the user, and the inner screen faces the user. The foldable device 100 can detect the user's flipping operation and, based on this operation, activate the inner screen's front-facing camera. At this time, the inner screen's front-facing camera is only activated in the background, and the foldable device 100 does not display the preview image captured by the inner screen's front-facing camera. The foldable device 100 still maintains the rear-facing selfie mode, that is, the outer screen of the foldable device 100 is in a lit state, the inner screen is in a lit state, the rear camera remains activated, the outer screen displays a preview interface 1, and the preview interface 1 displays the preview image 3 captured by the rear camera.
[0284] S1203, The foldable screen device 100 determines whether the facial information captured by the front camera of the inner screen is greater than the facial information captured by the rear camera; if yes, then proceed to step S1204; if no, then proceed to step S1205.
[0285] If the foldable screen device 100 determines that the facial information captured by the front-facing camera on the inner screen is greater than the facial information captured by the rear camera, the foldable screen device 100 can switch from rear-facing selfie to inner-screen front-facing selfie, i.e., execute step S1204 below. If the foldable screen device 100 determines that the facial information captured by the front-facing camera on the inner screen is less than the facial information captured by the rear camera, the foldable screen device 100 can continue to maintain rear-facing selfie, and execute step S1205 below.
[0286] Step S1203 can be referred to the description in step S403, and will not be repeated here.
[0287] S1204, the foldable screen device 100 switches the inner screen from the off state to the on state, and the outer screen from the on state to the off state. The rear camera is turned off, and the preview interface 2 is displayed on the inner screen. The preview interface 2 displays the preview image captured by the front camera of the inner screen, and the preview image 2 contains the facial information captured by the front camera of the inner screen.
[0288] When the foldable screen device 100 determines that the facial information captured by the front-facing camera on the inner screen is greater than the facial information captured by the rear camera, the foldable screen device 100 can switch from rear-facing selfie to inner-screen front-facing selfie. That is, the foldable screen device 100 switches the inner screen from off to on, the outer screen from on to off, turns off the rear camera, and displays preview interface 2 on the inner screen. Preview interface 2 displays a preview image captured by the inner-screen front-facing camera, which includes the facial information captured by the inner-screen front-facing camera. The outer screen of the foldable screen device 100 is on, the inner screen is off, the rear camera remains on, and preview interface 2 is displayed on the outer screen, which displays a preview image 3 captured by the rear camera. As shown in Figure 13, after the foldable screen device 100 flips from the rear-facing selfie state shown in Figure 13(a), it switches to the inner-screen front-facing selfie mode shown in Figure 13(b). Preview interface 2 can be preview interface 300 shown in Figure 13(b), and preview screen 2 can be preview interface 301 shown in Figure 13(b). For details about preview interface 300 and preview screen 301, please refer to the description of Figure 3A(a) above, which will not be repeated here.
[0289] S1205, the foldable screen device 100 determines whether the duration for which the face information captured by the front camera of the inner screen is less than the duration for which the face information captured by the rear camera is greater than a preset duration; if yes, then proceed to step S1206; if no, then proceed to step S1203.
[0290] If the foldable screen device 100 determines that the facial information captured by the rear camera is smaller than the facial information captured by the inner screen front camera, the foldable screen device 100 can keep both the inner screen front camera and the rear camera on. Furthermore, the foldable screen device 100 remains in rear-facing selfie mode. However, the foldable screen device 100 will continuously compare the size of the facial information captured by the inner screen front camera with that captured by the rear camera for a preset duration. If the duration during which the foldable screen device 100 determines that the facial information captured by the inner screen front camera is smaller than that captured by the rear camera exceeds the preset duration, the foldable screen device 100 can execute step S1206; otherwise, it executes step S1203.
[0291] S1206, The foldable screen device 100 turns off the front camera on the inner screen, turns on the outer screen, turns off the inner screen, and displays a preview interface 1 on the outer screen. The preview interface 1 displays a preview image 3 captured by the rear camera.
[0292] If the foldable screen device 100 decides not to exit the rear selfie mode, it can turn off the front camera on the inner screen and continue to maintain the rear selfie mode. That is, the outer screen of the foldable screen device 100 is on, the inner screen is off, and the preview interface 1 on the outer screen displays the preview image 3 captured by the rear camera.
[0293] According to the shooting method provided in this application embodiment, when the foldable screen device 100 is in rear selfie mode, the foldable screen device 100 can detect that the user has flipped the foldable screen device 100. Then, the foldable screen device 100 can determine whether to automatically exit the rear selfie mode and switch to the front selfie mode based on the comparison result of the size of the facial information of the rear camera and the facial information of the front camera on the inner screen. In this way, user operations can be reduced, thereby improving user experience.
[0294] Alternatively, in another possible implementation, the foldable screen device provided in this application embodiment can be an outward-folding foldable screen device. This foldable screen device may include a first display screen, a first front-facing camera, and a rear-facing camera. The first display screen can be folded into at least two display areas, a first display area and a second display area. The two first front-facing cameras can be located on the same side as the first display screen. The rear-facing camera can be located on the back of the first display screen. Exemplarily, the product form of this outward-folding foldable screen device can be as shown in Figure 14.
[0295] Figure 14 illustrates, exemplarily, a schematic diagram of the product form of an outward-folding foldable screen device 100.
[0296] Figures 14(a) and (b) show the foldable screen device 100 in its unfolded state. The foldable screen device 100 may include a display screen 115, which can be divided into two display areas by folding, for example, display area 1151 and display area 1152. The foldable screen device 100 may also include a camera 116, which may be located on the same side as display area 1152.
[0297] The display area 1151 of the foldable screen device 100 can be folded outward along the folding direction, so that the foldable screen device 100 changes from an unfolded state to a folded state.
[0298] Figures 14(c) and (d) show the foldable screen device 100 in its unfolded state. When the foldable screen device 100 is in the folded state, the display area 1151 is located behind the display area 1152. The foldable screen device 100 may also include a camera 117. When the foldable screen device 100 is in the folded state, the camera 117 may be located behind the display area 1152, on the same side as the display area 1151.
[0299] When the foldable screen device 100 is in the unfolded state, the camera 117 can be located on the back of the display screen 115.
[0300] Taking the outward-folding foldable screen device 100 shown in Figure 14 as an example, the following will describe in detail how the outward-folding foldable screen device 100 automatically switches to the rear selfie mode from different states.
[0301] Figure 15 exemplarily illustrates that when the foldable screen device 100 switches from an unfolded state to a folded state, it automatically switches to the rear selfie mode.
[0302] As shown in Figure 15(a), the foldable screen device 100 is in the unfolded state, and the foldable screen device 100 uses the front-facing camera (camera 116) to take a selfie. The display screen 115 of the foldable screen device 100 displays a preview interface 1500, which includes the image 1501 captured by the front-facing camera.
[0303] When the foldable screen device 100 switches from an unfolded state to a folded state, if the foldable screen device 100 detects that the face size captured by the rear camera (camera 117) is larger than the face size captured by the front camera, the foldable screen device 100 activates the rear camera selfie mode. For example, as shown in Figure 15(b), the foldable screen device 100 is in a folded state. The foldable screen device 100 automatically switches from front camera to rear camera selfie mode. A preview interface 1510 is displayed in the display area 1151 of the foldable screen device 100, which includes the image 1511 captured by the rear camera selfie.
[0304] Figure 16 illustrates, for example, that when the foldable screen device 100 is in a folded state and a selfie is taken using the front-facing camera, it automatically switches to the rear-facing selfie mode after the foldable screen device 100 is flipped.
[0305] As shown in Figure 16(a), the foldable screen device 100 is in a folded state and takes a selfie using the front-facing camera (camera 116). The display area 1152 of the foldable screen device 100 displays a preview interface 1600, which includes the image 1601 captured by the front-facing camera.
[0306] When the user flips the foldable screen device 100, if the foldable screen device 100 detects that the face size captured by the rear camera (camera 117) is larger than the face size captured by the front camera, the foldable screen device 100 activates the rear camera selfie mode. For example, as shown in Figure 16(b), the foldable screen device 100 is in a folded state. The foldable screen device 100 automatically switches from front camera to rear camera selfie mode. A preview interface 1510 is displayed in the display area 1151 of the foldable screen device 100, which includes the image 1511 captured by the rear camera selfie.
[0307] Figure 17 illustrates, for example, that when the foldable screen device 100 is in a folded state and the rear camera is used to take a picture, the device automatically switches to the rear selfie mode after being flipped.
[0308] As shown in Figure 17(a), the foldable screen device 100 is in a folded state and uses a rear camera (camera 117) to take pictures. The display area 1152 of the foldable screen device 100 displays a preview interface 1700, which includes the image 1701 captured by the rear camera.
[0309] When the user flips the foldable screen device 100, if the foldable screen device 100 detects that the face size captured by the rear camera (camera 117) is larger than the face size captured by the front camera, the foldable screen device 100 activates the rear camera selfie mode. For example, as shown in Figure 17(b), the foldable screen device 100 is in a folded state. The foldable screen device 100 automatically switches from front camera to rear camera selfie mode. A preview interface 1510 is displayed in the display area 1151 of the foldable screen device 100, which includes the image 1511 captured by the rear camera selfie.
[0310] When the foldable screen device 100 enters the rear-camera selfie mode, if it switches from a folded state to an unfolded state, it can exit the rear-camera selfie mode and switch to the front-camera selfie mode. Alternatively, when the foldable screen device 100 enters the rear-camera selfie mode, if it detects that the user has flipped the foldable screen device 100 and the face size captured by the front-camera is larger than the face size captured by the rear-camera, the foldable screen device 100 can exit the rear-camera selfie mode and switch to the front-camera selfie mode.
[0311] Optionally, in another possible implementation, the foldable screen device provided in this application embodiment can be a vertically foldable screen device. This foldable screen device may include a first display screen, a second display screen, and at least two sets of cameras, such as a front-facing camera and a rear-facing camera. The front-facing camera may be located on the same side as the first display screen, and the rear-facing camera may be located on the same side as the second display screen. The second display screen may be located behind the first display screen. Exemplarily, the product form of the foldable screen device provided in this application embodiment can be as shown in Figure 18.
[0312] Figure 18 illustrates an alternative product form of the foldable screen device 100.
[0313] Figure 18(a) shows the foldable screen device 100 in its unfolded state. The foldable screen device 100 can be folded along the folding edge in the lateral direction of the folding screen to form the posture shown in Figure 18(b) or Figure 18(c). As shown in Figures 18(a), (b), and (c), the foldable screen device 100 may include a display screen 111, which can be divided into two display areas by the folding edge, for example, display area 1111 and display area 1112. A camera 112 may also be included on the same side of the display screen 111. A camera 113 and a display screen 114 are also included on the back of the display screen 111. This application embodiment does not limit the specific positions of the cameras 112 and 113 in the foldable screen device 100. This application embodiment also does not limit the shape and size of the display screen 114.
[0314] Taking the vertically foldable screen device 100 shown in Figure 18 as an example, the following will describe in detail how the vertically foldable screen device 100 automatically switches to the rear selfie mode from different states.
[0315] Figure 19 illustrates, for example, that when the foldable screen device 100 is in the unfolded state and the front-facing camera is used for selfies, the device automatically switches to the rear-facing selfie mode after being flipped.
[0316] As shown in Figure 19(a), the foldable screen device 100 is in the unfolded state, with the front-facing camera taking a selfie. The inner screen is on, and the outer screen is off. The preview interface 1900 displayed on the inner screen shows a preview image 1901 captured by the front-facing camera. In Figure 19(a), the front-facing camera can also be referred to as the inner screen front-facing camera.
[0317] When the user flips the foldable screen device 100, if the foldable screen device 100 detects that the face size captured by the rear camera (camera 113) is larger than the face size captured by the front camera, the foldable screen device 100 activates the rear camera selfie mode. As shown in Figure 19, the user can flip the foldable screen device 100 from the posture shown in Figure 19(a) to the posture shown in Figure 19(b). As shown in Figure 19(b), the foldable screen device 100 is in the unfolded state, switching from front camera selfie to rear camera selfie mode. The inner screen of the foldable screen device 100 is in the off state, and the outer screen is in the on state. The display screen 114 of the foldable screen device 100 displays the image 1902 captured by the rear camera.
[0318] Figure 20 illustrates, for example, that when the foldable screen device 100 is in the unfolded state, and the rear camera is used to take a picture, the device automatically switches to the rear selfie mode after being flipped.
[0319] As shown in Figure 20(a), the foldable screen device 100 is in the unfolded state, with the inner screen on and the outer screen off. The preview interface 2000 displayed on the inner screen shows a preview image 2001 captured by the rear camera.
[0320] When the user flips the foldable screen device 100, if the foldable screen device 100 detects that the face size captured by the rear camera (camera 113) is larger than the face size captured by the front camera, the foldable screen device 100 activates the rear camera selfie mode. As shown in Figure 20, the user can flip the foldable screen device 100 from the posture shown in Figure 20(a) to the posture shown in Figure 20(b). As shown in Figure 20(b), the foldable screen device 100 is in the unfolded state, switching from the front camera selfie mode to the rear camera selfie mode. The inner screen of the foldable screen device 100 is in the off state, and the outer screen is in the on state. The display screen 114 of the foldable screen device 100 displays the image 1902 captured by the rear camera.
[0321] When the foldable screen device 100 enters the rear selfie mode, if it detects that the user flips the foldable screen device 100 and the face size captured by the front camera is larger than the face size captured by the rear camera, the foldable screen device 100 can exit the rear selfie mode and switch to the front camera selfie mode.
[0322] In this embodiment, display screens 101 and 111 can both be referred to as outer screens, and display screens 102, 114, and 115 can all be referred to as inner screens. Camera 103 can be referred to as the front-facing camera on the outer screen, and cameras 104, 113, and 117 can all be referred to as rear cameras, while cameras 105, 112, and 116 can all be referred to as the front-facing cameras on the inner screen.
[0323] It should be noted that, in this embodiment, the inner screen (e.g., display screen 102, display screen 111, display screen 114) is folded to form at least two display areas (e.g., display area 1021 and display area 1022, or display area 1111 and display area 1112, or display area 1151 and display area 1152). These two display areas can be on two independently existing display screens. That is, the inner screen can contain multiple independent display screens, or it can be a single, integrated display screen that is folded to form at least two parts.
[0324] For example, the inner screen can be a flexible folding screen, which includes folding edges made of a flexible material. Part or all of this flexible folding screen is made of a flexible material. The two display areas formed after the folding screen is folded are a single, integrated screen structure, simply folded into at least two parts.
[0325] The embodiments of this application do not specify the specific materials of the inner and outer screens.
[0326] In this embodiment, the first display screen may be display screen 102 shown in FIG. 1, display screen 115 shown in FIG. 14, or display screen 111 shown in FIG. 18. The second display screen may be display screen 101 shown in FIG. 1 or display screen 114 shown in FIG. 18. The first front-facing camera may be camera 105 shown in FIG. 1, camera 116 shown in FIG. 14, or camera 112 shown in FIG. 18. The second front-facing camera may be camera 103 shown in FIG. 1. The rear-facing camera may be camera 104 shown in FIG. 1, camera 117 shown in FIG. 14, or camera 113 shown in FIG. 18.
[0327] The following describes an exemplary foldable screen device 100 provided in an embodiment of this application.
[0328] Figure 21 is a structural schematic diagram of the foldable screen device 100 provided in an embodiment of this application.
[0329] The following description uses a foldable screen device 100 as an example to illustrate the embodiment. It should be understood that the foldable screen device 100 may have more or fewer components than shown in the figures, may combine two or more components, or may have different component configurations. The various components shown in the figures can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.
[0330] The foldable screen device 100 may include: a processor 110, internal memory 120, camera 130, display screen 140, and sensor module 150, etc. The sensor module 150 may include a gyroscope sensor 150A, an accelerometer sensor 150B, a Hall sensor 150C, etc.
[0331] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the foldable screen device 100. In other embodiments of this application, the foldable screen device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0332] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0333] The controller can serve as the central nervous system and command center of the foldable screen device 100. The controller can generate operation control signals based on instruction operation codes and timing signals to control the fetching and execution of instructions.
[0334] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0335] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0336] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL).
[0337] The I2S interface can be used for audio communication.
[0338] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals.
[0339] The UART interface is a general-purpose serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication.
[0340] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 140 and the camera 130. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 130 communicate via the CSI interface to enable the shooting function of the foldable screen device 100. The processor 110 and the display screen 140 communicate via the DSI interface to enable the display function of the foldable screen device 100.
[0341] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 130, a display screen 140, a sensor module 150, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0342] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the foldable screen device 100. In other embodiments of this application, the foldable screen device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0343] The foldable screen device 100 implements display functions through a GPU, a display screen 140, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 140 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0344] Display screen 140 is used to display images, videos, etc. Display screen 140 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc.
[0345] In this embodiment of the application, the foldable screen device 100 may include N displays 140, where N is a positive integer greater than 1. In some examples, the value of N can be 2, and the foldable screen device 100 may include 2 displays 140. For example, the foldable screen device 100 shown in FIG1 has two displays: an inner screen and an outer screen.
[0346] The foldable screen device 100 can achieve shooting functions through ISP, camera 130, video codec, GPU, display 140 and application processor.
[0347] The ISP is used to process data fed back from the camera 130. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and color. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 130.
[0348] Camera 130 is used to capture still images or videos. An object is projected onto a photosensitive element through the lens, generating an optical image. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to the ISP (Image Signal Processor) for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP (Digital Signal Processor) for processing. The DSP converts the digital image signal into standard RGB, YUV, or other image signal formats.
[0349] In this embodiment of the application, the foldable screen device 100 may include M cameras 130, where M is a positive integer greater than 1.
[0350] In some examples, the value of M can be 3, such as the foldable screen device 100 shown in Figure 1, which may contain 3 cameras, such as a rear camera, an inner screen front camera, and an outer screen front camera.
[0351] In other examples, M can be 2, for example, the foldable screen device 100 shown in Figure 14 or Figure 18, which may include two cameras, such as a rear camera and a front camera.
[0352] A digital signal processor (DSP) is used to process digital signals. Besides digital image signals, it can also process other digital signals. For example, when the foldable screen device 100 selects a frequency, the DSP performs Fourier transforms on the frequency energy.
[0353] Video codecs are used to compress or decompress digital video. The foldable screen device 100 can support one or more video codecs. Thus, the foldable screen device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.
[0354] NPU stands for Neural Network (NN) Computing Processor. By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs can enable intelligent cognitive applications in foldable screen devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0355] The internal memory 120 can be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the foldable screen device 100 by running the instructions stored in the internal memory 120. The internal memory 120 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application required for a function (such as facial recognition, fingerprint recognition, mobile payment, etc.). The data storage area may store data created during the use of the foldable screen device 100 (such as facial information template data, fingerprint information templates, etc.). Furthermore, the internal memory 120 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0356] The gyroscope sensor 150A can be used to determine the motion posture of the foldable screen device 100. In some embodiments, the gyroscope sensor 150A can determine the angular velocity of the foldable screen device 100 about three axes (i.e., the x, y, and z axes). The gyroscope sensor 150A can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 150A detects the angle of the shake of the foldable screen device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the foldable screen device 100 through reverse movement, thus achieving image stabilization. The gyroscope sensor 150A can also be used in navigation and motion-sensing gaming scenarios.
[0357] The accelerometer 150B can detect the magnitude of acceleration of the foldable screen device 100 in various directions (typically three axes). When the foldable screen device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.
[0358] The Hall sensor 150C can be used to detect whether the foldable screen device 100 has been flipped, and to detect the angle between the two display areas of the inner screen.
[0359] In this embodiment, the foldable screen device 100 can determine its state—whether it is folded or unfolded—based on a gyroscope sensor 150A and / or an accelerometer sensor 150B. The foldable screen device 100 can detect a user's flip operation based on an accelerometer sensor 150B and / or a Hall effect sensor 150C. Alternatively, the foldable screen device 100 can detect a user's flip operation based on a gyroscope sensor 150A and / or an accelerometer sensor 150B.
[0360] To better understand the software structure of the foldable screen device 100 shown in Figure 21, the software structure of the foldable screen device 100 will be explained below. Before explaining the software structure of the foldable screen device 100, the architecture that the software system of the foldable screen device 100 can adopt will be explained first.
[0361] Specifically, in practical applications, the software system of the foldable screen device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture.
[0362] Furthermore, it is understood that the software systems used by mainstream electronic devices currently include, but are not limited to, Windows, Android, and iOS systems. For ease of explanation, this application embodiment uses the layered architecture of the Android system as an example to exemplify the software structure of the foldable screen device 100.
[0363] Furthermore, the camera request processing method provided in the embodiments of this application is also applicable to other systems in specific implementations.
[0364] Figure 22 shows a schematic diagram of the hardware and software architecture of a camera service on a foldable screen device 100 provided in an embodiment of this application.
[0365] As shown in Figure 22, the hardware and software architecture of the foldable screen device 100 includes a software system and a hardware layer that, together with the software structure, implements related camera functions (e.g., preview, photo taking, video recording, etc.). The layered architecture divides the software system of the foldable screen device 100 into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the system is divided into four layers, from top to bottom: application layer, application framework layer (FWK), hardware abstraction layer (HAL), and driver layer.
[0366] The application layer can include a series of application packages. As shown in Figure 22, an application package can include a camera application.
[0367] Optionally, the application package may also include applications (also referred to as apps) such as gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS. This application does not limit this aspect.
[0368] The application framework layer provides an application programming interface (API) and programming framework for the application packages in the application layer. The application framework layer includes some predefined functions.
[0369] In some embodiments, the application framework layer may include a camera interface. For example, the camera interface may include an image acquisition interface and an interface for continuously acquiring images.
[0370] In some embodiments, the application framework layer may further include a camera server module. The camera server module can receive camera requests sent by the camera application through the camera interface. The camera server module can also forward the received camera requests to the camera hardware abstraction layer (camera HAL).
[0371] In the embodiments of the application, the camera request may include a preview request, a photo request, a video recording request, etc. The embodiments of this application do not limit the specific type of camera request.
[0372] In some embodiments, the application framework layer may further include a rendering process module. The rendering process module can render image frames sent by the camera application and send the rendered results (i.e., the rendered image frames) back to the camera application. The camera application can then display the rendered results.
[0373] In some embodiments, the application framework layer may also be referred to as the application framework layer.
[0374] The Hardware Abstraction Layer (HAL) is an interface layer located between the application framework layer and the driver layer, providing a virtual hardware platform for the operating system.
[0375] The Hardware Abstraction Layer (HAL) can include a Camera Hardware Abstraction Layer. This layer can receive camera requests from the application framework layer and send the camera parameters from those requests to the camera module via the driver layer. The HAL can also call an interface that returns results (e.g., ProcessCaptureResult) to send image frames acquired by the camera module according to the camera parameters to the result processing module in the application framework layer.
[0376] Optionally, the camera hardware abstraction layer can store the image frames acquired by the camera module into the corresponding buffer address requested by the camera, and send the buffer address to the result processing module in the application framework layer.
[0377] In this embodiment, the camera request corresponding to an image frame refers to a camera request that includes camera parameters for acquiring the image frame. That is, the camera can acquire the image frame according to the camera parameters in the camera request. For example, if the camera acquires image frame 1 according to the camera parameters in camera request 1, then camera request 1 can be referred to as the camera request corresponding to image frame 1.
[0378] The driver layer is the layer between hardware and software. It includes drivers for various hardware components. The driver layer can include camera drivers, image processor drivers, and display drivers, among others. Specifically, the camera driver drives the image sensors of one or more cameras in the camera module (e.g., image sensor 1, image sensor 2, etc.) to acquire images and drives the image signal processor to preprocess the images. The image processor driver drives the graphics processor to process the images. The display driver drives the display screen.
[0379] The hardware layer may include multiple camera modules (e.g., a rear camera module, an inner-screen front camera module, and an outer-screen front camera module), an image signal processor (ISP), a display, etc. Any one of the rear camera modules, the inner-screen front camera module, and the outer-screen front camera module, or the rear camera module itself, may include image sensors for one or more cameras (e.g., image sensor 1, image sensor 2, etc.). Optionally, any one of the rear camera modules, the inner-screen front camera module, and the outer-screen front camera module, or the rear camera module itself, may also include a time-of-flight (TOF) sensor, a multispectral sensor, etc. The image signal processor can be used to process image frames acquired by the camera modules. The display screen can be used to display image frames sent by the camera application. The display screen includes an inner screen and an outer screen. The inner screen is a foldable display screen.
[0380] In this embodiment, the camera hardware abstraction layer can also report the size of the face bounding boxes in the images captured by each camera module to the camera service. The camera service can compare the size of the face bounding boxes in the images captured by each camera module. The camera service can also decide which camera module's image to display on the screen.
[0381] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
[0382] As used in the above embodiments, depending on the context, the term "when..." can be interpreted as meaning "if...", "after...", "in response to determining...", or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if (the stated condition or event) is interpreted as meaning "if determining...", "in response to determining...", "when (the stated condition or event) is detected", or "in response to detecting (the stated condition or event)".
[0383] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive), etc.
[0384] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
Claims
1. A photographing method characterized by comprising: The method is applied to a folding screen device, the folding screen device comprises a first display screen and at least two cameras, the first display screen is foldable into at least two display areas, the at least two cameras comprise a first front camera and a rear camera, the first front camera is located on the same side as the first display screen, and the rear camera is located on the back of the first display screen, and the method comprises: The folding screen device opens one of the at least two cameras, and displays a picture taken by the one of the at least two cameras; In response to a first operation of a user, the folding screen device automatically sets the first front camera and the rear camera to be in an open state; When a distance between the user and the rear camera is less than a distance between the user and the first front camera, the folding screen device displays a picture taken by the rear camera, and the picture comprises a portrait of the user.
2. The method of claim 1, wherein, The folding screen device further comprises a second display screen, and the second display screen is located on the back of the first display screen.
3. The method of claim 2, wherein The folding screen device opens one of the at least two cameras, and displays a picture taken by the one of the at least two cameras, comprising: The folding screen device is in an unfolded state, opens the first front camera, and displays a picture taken by the first front camera on the first display screen; In response to a first operation of a user, the folding screen device automatically sets the first front camera and the rear camera to be in an open state, comprising: In response to a flip operation of the folding screen device by the user, the folding screen device automatically opens the rear camera; When a distance between the user and the rear camera is less than a distance between the user and the first front camera, the folding screen device displays a picture taken by the rear camera, comprising: When a distance between the user and the rear camera is less than a distance between the user and the first front camera, the folding screen device displays a picture taken by the rear camera on the second display screen.
4. The method of claim 3, wherein, When the folding screen device automatically opens the rear camera, the method further comprises: The folding screen device displays a picture taken by the first front camera on the first display screen, and a picture taken by the rear camera is not displayed.
5. The method of claim 2, wherein The folding screen device opens one of the at least two cameras, and displays a picture taken by the one of the at least two cameras, comprising: The folding screen device is in an unfolded state, opens the rear camera, and displays a picture taken by the rear camera on the first display screen; In response to a first operation of a user, the folding screen device automatically sets the first front camera and the rear camera to be in an open state, comprising: In response to a flip operation of the folding screen device by the user, the folding screen device automatically opens the first front camera; When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the folding screen device displays the picture taken by the rear camera, comprising: When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the folding screen device displays the picture taken by the rear camera on the second display screen.
6. The method of claim 5, wherein, When the folding screen device automatically turns on the first front camera, the method further comprises: The folding screen device displays the picture taken by the rear camera in the first display screen, and the picture taken by the first front camera is not displayed.
7. The method of claim 2, wherein, The at least two cameras further comprise a second front camera, and the second front camera is located on the same side as the second display screen.
8. The method of claim 7, wherein, When the folding screen device turns on one of the at least two cameras, the folding screen device displays the picture taken by the one of the at least two cameras, comprising: When the folding screen device is in a folded state and the first display screen is folded, the folding screen device turns on the second front camera and displays the picture taken by the second front camera on the second display screen; Receiving and responding to a first operation of the user, the folding screen device automatically sets the first front camera and the rear camera to be in an open state, comprising: Receiving and responding to an operation of the user switching the folding screen device from a folded state to an unfolded state, the folding screen device automatically turns on the first front camera and the rear camera; When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the folding screen device displays the picture taken by the rear camera, comprising: When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the folding screen device displays the picture taken by the rear camera on the second display screen.
9. The method of claim 8, wherein, When the folding screen device automatically turns on the first front camera and the rear camera, the method further comprises: The folding screen device displays the picture taken by the first front camera in the first display screen, and the picture taken by the rear camera is not displayed.
10. The method of claim 9, wherein, The method further comprises: Receiving and responding to an operation of the user switching the folding screen device from a folded state to an unfolded state, the folding screen device turns off the second front camera.
11. The method of claim 2, wherein, When the folding screen device turns on one of the at least two cameras, the folding screen device displays the picture taken by the one of the at least two cameras, comprising: When the folding screen device is in a folded state and the first display screen is folded, the folding screen device turns on the rear camera and displays the picture taken by the rear camera on the second display screen; Receiving and responding to a first operation of the user, the folding screen device automatically sets the first front camera and the rear camera to be in an open state, comprising: In response to receiving an operation of switching the folding screen device from the folded state to the unfolded state by the user, the folding screen device automatically turns on the first front camera; When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the folding screen device displays the picture taken by the rear camera, including: When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the folding screen device displays the picture taken by the rear camera on the second display screen.
12. The method of claim 11, wherein, When the folding screen device automatically turns on the first front camera, the method further includes: The folding screen device displays the picture taken by the rear camera on the first display screen, and the picture taken by the first front camera is not displayed.
13. The method of claim 1, wherein, The at least two display areas include a first display area and a second display area, and when the folding screen device is in the folded state, the second display area is located at the back of the first display area, and the first front camera is located on the same side as the first display area.
14. The method of claim 13, wherein The folding screen device turns on one of the at least two cameras and displays the picture taken by the one of the at least two cameras, including: When the folding screen device is in the unfolded state, the first front camera is turned on, and the picture taken by the first front camera is displayed on the first display screen; In response to receiving a first operation of the user, the first front camera and the rear camera are automatically set to be in the turned-on state, including: In response to receiving an operation of switching the folding screen device from the folded state to the unfolded state by the user, the folding screen device automatically turns on the rear camera; When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the folding screen device displays the picture taken by the rear camera, including: When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the folding screen device displays the picture taken by the rear camera on the second display area.
15. The method of claim 13, wherein The folding screen device turns on one of the at least two cameras and displays the picture taken by the one of the at least two cameras, including: When the folding screen device is in the folded state, the first front camera is turned on, and the picture taken by the first front camera is displayed on the first display area; In response to receiving a first operation of the user, the first front camera and the rear camera are automatically set to be in the turned-on state, including: In response to receiving a flipping operation of the folding screen device by the user, the folding screen device automatically turns on the rear camera; When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the folding screen device displays the picture taken by the rear camera, including: When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the folding screen device displays the picture taken by the rear camera in the second display area.
16. The method according to claim 14 or 15, characterized in that, When the folding screen device automatically turns on the rear camera, the method further includes: The folding screen device displays the picture taken by the first front camera in the first display area, and the picture taken by the rear camera is not displayed or is displayed in the second display area.
17. The method of claim 13, wherein, The folding screen device turns on one of the at least two cameras and displays the picture taken by the one of the at least two cameras, including: When the folding screen device is in a folded state, the folding screen device turns on the rear camera and displays the picture taken by the rear front camera in the first display area; Receiving and responding to a first operation of a user, the folding screen device automatically sets the first front camera and the rear camera to be in an open state, including: Receiving and responding to a flip operation of a user on the folding screen device, the folding screen device automatically turns on the first front camera; When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the folding screen device displays the picture taken by the rear camera, including: When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the folding screen device displays the picture taken by the rear camera in the second display area.
18. The method of claim 17, wherein, When the folding screen device automatically turns on the first front camera, the method further includes: The folding screen device displays the picture taken by the rear camera in the first display area, and the picture taken by the first front camera is not displayed or is displayed in the second display area.
19. The method of any one of claims 14, 15, 18, wherein, The method further includes: When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the folding screen device powers off the first display area, so that the first display area is in an off-screen state.
20. The method of any one of claims 4, 6, 10, 12, 14, 15, 18, wherein, The method further includes: When the distance between the user and the rear camera is less than the distance between the user and the first front camera, the folding screen device turns off the first front camera.
21. The method of claim 20, wherein, After the folding screen device displays the picture taken by the rear camera when the distance between the user and the rear camera is less than the distance between the user and the first front camera, the method further includes: After detecting a flip operation on the folding screen device, turn on the first front camera; When the distance between the user and the rear camera is greater than the distance between the user and the first front camera, turn off the rear camera and display the picture taken by the first front camera on the first display screen.
22. The method of claim 21, wherein, When the first front camera and the rear camera are in an open state, the method further includes: determining that the distance between the user and the rear camera is less than the distance between the user and the first front camera when the face size in the picture taken by the first front camera is less than the face size in the picture taken by the rear camera; determining that the distance between the user and the rear camera is greater than the distance between the user and the first front camera when the face size in the picture taken by the first front camera is greater than the face size in the picture taken by the rear camera.
23. A foldable screen apparatus, characterized by comprising: at least one display screen, at least two cameras, one or more processors, one or more memories; the at least one display screen comprises a first display screen, the first display screen is foldable, the first display screen, the at least two cameras, and the one or more memories are respectively coupled with the one or more processors; the one or more memories are configured to store computer program codes, the computer program codes comprise computer instructions; when the computer instructions run on the processors, the foldable screen device executes the method according to any one of claims 1-22.
24. A foldable screen apparatus, characterized by comprising one or more function modules, the one or more function modules are configured to execute the method according to any one of claims 1-22.
25. A chip, characterized by comprising: a processor and an interface, the processor and the interface cooperate with each other, so that the chip executes the method according to any one of claims 1-22.
26. A computer-readable storage medium, characterized in that, comprising computer instructions, when the computer instructions run on the electronic device, the electronic device executes the method according to claims 1-22.
27. A computer program product, characterised in that, when the computer program product runs on the computer, the computer executes the method according to any one of claims 1-22.
Citation Information
Patent Citations
Screen switching method and device in shooting process
CN117425066A
Screen display method and device and storage medium
CN117714568A
Selfie method and device, terminal and storage medium
CN117835049A
Photographing method and folding screen equipment
CN119653225A
Electronic device
CN217116144U