Photographing method and electronic device

Abstract

Provided in embodiments of the present application are a photographing method and an electronic device. The method is executed by an electronic device, which is a foldable device, and comprises a first screen, a second screen and a rear camera, wherein when the electronic device is in a first form, the second screen and the rear camera are located on the same side, and when the electronic device is in a second form, the second screen and the rear camera are located on different sides. The method comprises: when an electronic device is in a first form, a first screen is in a screen-on state and a second screen is in a screen-off state, receiving a first operation of a user; in response to the first operation, generating a first screen switching instruction, wherein the first screen switching instruction includes an identifier of the second screen; and in response to the first screen switching instruction, controlling the first screen of the electronic device in the first form to turn off, controlling the second screen to turn on, and using the second screen to display an image acquired by a rear camera. The method can achieve rear selfie, improve the photographic quality, and improve the user experience.

Description

Photographing method and electronic device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on July 12, 2023, with application number 202310862068.X and application name “Photographing method and electronic device”, and the Chinese patent application filed with the State Intellectual Property Office on July 12, 2023, with application number 202310855290.7 and application name “Photographing method and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of electronic technology, and in particular to a photographing method and electronic equipment. Background Art

[0003] As people's requirements for mobile phone display and portability gradually increase, foldable screen mobile phones are becoming more and more popular among users.

[0004] Folding screen phones include front cameras and rear cameras. Generally, when using a folding screen phone to take selfies, you can only use the front camera, which has poor shooting effects.

[0005] Summary of the Invention

[0006] The present application provides a photographing method, device, electronic device, chip, computer-readable storage medium and computer program product, which can improve selfie effects and enhance user experience.

[0007] In a first aspect, the present application provides a photographing method, which is performed by an electronic device, the electronic device being a foldable device, the electronic device including a first screen, a second screen, and a rear camera. When the electronic device is in a first form, the second screen and the rear camera are on the same side, and when the electronic device is in a second form, the second screen and the rear camera are on different sides. The method includes:

[0008] When the electronic device is in a first form, the first screen is in a bright state, and the second screen is in an off state, a first operation of the user is received; in response to the first operation, a first screen switching instruction is generated, and the first screen switching instruction includes an identifier of the second screen; in response to the first screen switching instruction, the first screen of the electronic device in the first form is controlled to be off, the second screen is controlled to be bright, and the image obtained by the rear camera is displayed through the second screen.

[0009] Taking an external folding screen device as an example, the external folding screen mobile phone includes a folding screen, and the folding screen includes a first screen and a second screen. The first form is a folded state, and the second form is an unfolded state.

[0010] The first operation is an operation that can trigger the rear-camera selfie function. For example, it can be an operation of clicking the rear-camera selfie control (i.e., the first control) in the photo preview interface (i.e., the first preview interface) in the rear-camera non-selfie scenario, or an operation of turning the electronic device over, or an operation of clicking the rear-camera selfie control (i.e., the third control) in the photo preview interface (i.e., the third preview interface) in the front-camera selfie scenario.

[0011] The first screen switching instruction is used to instruct the electronic device in the first state to turn off the first screen and turn on the second screen.

[0012] The first aspect provides a photographing method, in which, when the electronic device is in a first form, the first screen is in a bright screen state, and the second screen is in an off screen state, the user can trigger the rear selfie function through a first operation, that is, the first screen of the electronic device is off, the second screen is bright, and the image obtained by the rear camera is displayed through the second screen. Since the second screen and the rear camera are on the same side in the first form, the user can use the rear camera to take pictures of people or things on the side of the user (i.e., selfies), and view the preview interface on the second screen, which is convenient for the user to take selfies. Moreover, the image taken by the rear camera is displayed on the second screen, that is, in the rear selfie scene, the image is obtained through the rear camera. The specifications and hardware configuration of the rear camera are relatively high, the image quality captured is relatively high, the shooting effect is relatively good, and the user experience can be improved.

[0013] In one possible implementation, before receiving the user's first operation, the method also includes: receiving the user's operation to open the camera application; in response to the operation to open the camera application, displaying a first preview interface through the first screen, the first preview interface including a first control and an image captured by the rear camera.

[0014] The first preview interface can be a photo preview interface in a non-selfie rear-camera scenario. The first control can be a selfie rear-camera control in the first preview interface. In other words, in the first form, the user can access the selfie rear-camera function from a non-selfie rear-camera scenario. Non-selfie rear-camera scenarios are commonly used by users. This implementation facilitates the use of the selfie rear-camera function and improves the user experience.

[0015] In one possible implementation, the electronic device also includes a front camera, which is located on the same side as the first screen. After displaying the first preview interface through the first screen and before receiving the user's first operation, the method also includes: receiving the user's setting operation, the setting operation is used to set the default selfie mode to front selfie; in response to the setting operation, displaying a second preview interface through the first screen, the second preview interface includes a second control and an image captured by the rear camera; in response to the operation acting on the second control, displaying a third preview interface through the first screen, the third preview interface includes a third control and an image captured by the front camera.

[0016] The second preview interface can be the interface for the front-facing selfie scene. The second control can be a camera flip control. The third preview interface can be the preview interface for the front-facing selfie scene. The third control can be a rear-facing selfie control within the third preview interface. In this implementation, in the first form, the user can enter the front-facing selfie scene from the rear-facing non-selfie scene by clicking the second control.

[0017] In a possible implementation, the first operation is an operation acting on the first control, or an operation of flipping the electronic device, or an operation acting on a third control.

[0018] That is, in the first form, in a non-selfie scenario with the rear camera, the user can access the rear selfie function by operating the first control, or by turning the electronic device over. Furthermore, in a front-facing selfie scenario, the user can access the rear selfie function by operating the third control. This embodiment provides users with multiple ways to access the rear selfie function, facilitating user operation and improving user experience.

[0019] In one possible implementation, before displaying the first preview interface on the first screen, the method further includes: generating a first image acquisition request in response to an operation of opening a camera application, the first image acquisition request including an identifier of the rear camera; and controlling the rear camera to continuously acquire the first image in response to the first image acquisition request.

[0020] The camera identifier may be, for example, a camera number or name. The operation of opening the camera application may be, for example, clicking the camera application icon in the main interface. When a user performs the operation of opening the camera application, the electronic device can respond to the user's operation, start the process, and default to the rear-facing non-selfie scene. Specifically, a first image acquisition request is used to request the rear-facing camera to acquire an image. In this scenario, the image acquired by the rear-facing camera is referred to as the first image.

[0021] In one possible implementation, the first operation is an operation acting on a first control, or an operation of flipping an electronic device. The method also includes: generating a first scene switching instruction in response to the first operation, the first scene switching instruction including an identifier of a first shooting scene; in response to the first scene switching instruction, processing the first image based on a first algorithm corresponding to the first shooting scene to obtain a second image; and displaying the image acquired by the rear camera through the second screen, including: displaying the second image through the second screen.

[0022] The first scene switching instruction is used to instruct to switch the shooting scene from the rear non-selfie scene (ie, the second shooting scene) to the rear selfie scene (ie, the first shooting scene). The first algorithm is also the preset rear selfie algorithm.

[0023] In this implementation, when entering the rear selfie scene from the rear non-selfie scene, there is no need to switch camera instructions. The first scene switching instruction instructs the image obtained by the rear camera to perform relevant processing for the rear non-selfie, thereby realizing the rear selfie function and eliminating the camera switching process, thereby improving the algorithm operation efficiency.

[0024] In one possible implementation, in response to a first scene switching instruction, processing the first image based on a first algorithm corresponding to the first shooting scene to obtain a second image includes: generating first preview stream mirroring parameters and first stream configuration parameters matching the first shooting scene in response to the first scene switching instruction; the first stream configuration parameters include an identifier of the first algorithm; mirroring the first image according to the first preview stream mirroring parameters to obtain a third image; configuring the first algorithm according to the first stream configuration parameters to obtain a first target algorithm; and processing the third image based on the first target algorithm to obtain the second image.

[0025] In this implementation, the first scene switching instruction includes an identifier of the first shooting scene, so the generated first preview stream mirroring parameters and first stream configuration parameters are parameters that match the first shooting scene, which can meet the implementation requirements of the rear selfie function.

[0026] In one possible implementation, before displaying the second preview interface on the first screen and after displaying the first preview interface on the first screen, the method further includes: generating a second image acquisition request in response to an operation acting on the second control, the second image acquisition request including an identifier of the front camera; and controlling the front camera to continuously acquire images in response to the second image acquisition request.

[0027] The operation acting on the second control may be, for example, clicking a flip camera control. When a user clicks the flip camera control, the electronic device can respond to the user's operation and generate a second image acquisition request. The second image request is used to request the front camera to acquire an image.

[0028] In one possible implementation, the first operation is an operation acting on a third control, and the method further includes: in response to the first operation, generating a camera switching instruction and a second scene switching instruction, the camera switching instruction including an identifier of the rear camera, and the second scene switching instruction including an identifier of the first shooting scene; in response to the camera switching instruction, controlling the front camera to stop acquiring images, and controlling the rear camera to continue acquiring a fourth image; in response to the second scene switching instruction, processing the fourth image based on a first algorithm corresponding to the first shooting scene to obtain a fifth image; and displaying the image acquired by the rear camera through the second screen, including: displaying the fifth image through the second screen.

[0029] The second scene switching instruction is used to instruct to switch the shooting scene from the front selfie scene to the rear selfie scene. The first algorithm is also the preset rear selfie algorithm.

[0030] In this implementation, when entering the rear selfie scene from the front selfie scene, the camera is switched through the camera switching instruction, that is, the front camera is switched to the rear camera, and the image obtained by the rear camera is processed related to the rear non-selfie through the second scene instruction, thereby realizing the rear selfie function.

[0031] In one possible implementation, in response to a second scene switching instruction, the fourth image is processed based on a first algorithm corresponding to the first shooting scene to obtain a fifth image, including: in response to the second scene switching instruction, generating second preview stream mirroring parameters and second stream configuration parameters that match the first shooting scene; the second stream configuration parameters include an identifier of the first algorithm; mirroring the fourth image according to the second preview stream mirroring parameters to obtain a sixth image; configuring the first algorithm according to the second stream configuration parameters to obtain a second target algorithm; and processing the sixth image based on the second target algorithm to obtain the fifth image.

[0032] In this implementation, the second scene switching instruction includes the identifier of the first shooting scene, so the generated second preview stream mirror parameters and second stream configuration parameters are parameters that match the first shooting scene, which can meet the implementation requirements of the rear selfie function.

[0033] In one possible implementation, the method also includes: displaying a main interface through the first screen, the main interface including a first icon, the first icon being associated with a first shooting scene; receiving a second operation acting on the first icon; in response to the second operation, controlling the first screen to turn off, controlling the second screen to turn on, and displaying the seventh image obtained by the rear camera through the second screen.

[0034] The first icon may be a selfie option or selfie icon displayed on the main interface when the rear-camera selfie function is enabled or the default selfie mode is the rear-camera selfie. In this implementation, the user can access the rear-camera selfie function through the selfie option on the main interface, without having to open the first preview interface, the second preview interface, or the third preview interface, or click on the rear-camera selfie control on the preview interface. This simplifies the user's access process for the rear-camera selfie function and improves the user experience.

[0035] In one possible implementation, before displaying the seventh image acquired by the rear camera through the second screen, the method further includes: creating a camera process in response to the second operation; generating a third image acquisition request and third preview stream mirror parameters and third stream configuration parameters that match the first shooting scene; the third image acquisition request includes an identifier of the rear camera, and the third stream configuration parameters include an identifier of the first algorithm that matches the first shooting scene; in response to the third image acquisition request, controlling the rear camera to continuously acquire the eighth image; processing the eighth image based on the first algorithm according to the third preview stream mirror parameters and the third stream configuration parameters to obtain the seventh image; displaying the seventh image acquired by the rear camera through the second screen includes: generating interface layout information according to the resource information corresponding to the seventh image and the first shooting scene; and displaying a fourth preview interface through the second screen according to the interface layout information, wherein the fourth preview interface includes the seventh image.

[0036] In this implementation, when a user clicks the selfie option or icon on the main interface, a camera process is created and, through a third image acquisition request, the rear camera is requested to acquire an image. A preset rear selfie algorithm is configured based on the third preview stream mirror parameters and the third stream configuration parameters to perform rear selfie-related processing on the image acquired by the rear camera, generating a seventh image. An interface is laid out based on the seventh image, and the laid-out interface is displayed. This implementation enables the rear selfie function to be directly activated when the camera is launched, simplifying user operations and facilitating user experience.

[0037] In a possible implementation, before generating the interface layout information according to the seventh image and the resource information corresponding to the first shooting scene, the method further includes: determining whether the first function corresponding to the first shooting scene is in an enabled state.

[0038] In one possible implementation, generating a third image acquisition request and third preview stream mirror parameters and third stream configuration parameters that match the first shooting scene includes: obtaining the current form of the electronic device and a configuration file corresponding to the second operation; determining that the current form of the electronic device is the first form, and the configuration file includes an identifier of the rear camera and an identifier of the first shooting scene, generating a third image acquisition request, third preview stream mirror parameters and third stream configuration parameters according to the configuration file.

[0039] In one possible implementation, in response to a first operation, a first screen switching instruction is generated, including: in response to the first operation, determining that the shooting scene corresponding to the first operation is the first shooting scene, and the current form of the electronic device is the first form; based on the first shooting scene and the first form, determining that the target display state of the first screen is the screen-off state, and the target display state of the second screen is the screen-on state; determining that the current display state of the first screen is different from the target display state of the first screen, and the current state of the second screen is different from the target display state of the second screen; and generating the first screen switching instruction.

[0040] In this implementation, the target display state of the screen is monitored based on the electronic device's form and the camera's shooting scene. When the target display state differs from the current display state of the screen, the screen is switched, achieving different screen displays for different scenarios and improving the diversity and practicality of the electronic device's scenarios.

[0041] In one possible implementation, in response to a first screen switching instruction, the first screen of an electronic device in a first form is controlled to turn off, and the second screen is controlled to turn on, including: in response to the screen switching instruction, the first interface is displayed; after the first interface is displayed for a preset period of time, the first screen is controlled to turn off, and the second screen is controlled to turn on.

[0042] The first interface may be a flip guide interface. By displaying the flip guide interface to guide the user to use the rear selfie function, the user can understand how to use the rear selfie function and improve the user experience.

[0043] In one possible implementation, the electronic device is an inward-folding screen device, the first screen is a folding screen, the first form is an unfolded state, and the second form is a folded state. When the electronic device is in the first form, the first screen and the second screen are on different sides.

[0044] In one possible implementation, the electronic device is an outward folding screen device, the electronic device includes a folding screen, the folding screen includes a first screen and a second screen, the first form is a folded state, and the second form is an unfolded state. When the electronic device is in the second form, the first screen and the second screen are on the same side.

[0045] In one possible implementation, the method also includes: when the electronic device is in a first form, the first screen is in an off state, the second screen is in a bright state, and the second screen displays an image captured by the rear camera, when it is detected that the electronic device is unfolded from the first form to the second form, a third scene switching instruction and a second screen switching instruction are generated, the third scene switching instruction includes an identifier of the second shooting scene, and the second screen switching instruction includes identifiers of the first screen and the second screen; in response to the third scene switching instruction, the image captured by the rear camera is processed based on a second algorithm corresponding to the second shooting scene to obtain a ninth image; in response to the second screen switching instruction, the first screen and the second screen are controlled to be bright, and the ninth image is displayed jointly through the first screen and the second screen.

[0046] In this implementation, when using the rear-facing selfie function, if the user unfolds the electronic device (external folding screen device), the camera application exits the rear-facing selfie function and enters the rear-facing non-selfie mode in the unfolded state. When the user unfolds the electronic device to the unfolded state, it indicates that the user no longer needs the rear-facing selfie function, so directly entering the unfolded state rear-facing shooting mode is likely to meet user needs and improve the user experience.

[0047] In one possible implementation, the method also includes: receiving a second operation from the user when the electronic device is in a first form, the first screen is in an off state, the second screen is in a bright state, and the second screen displays an image captured by the rear camera; generating a third scene switching instruction and a third screen switching instruction in response to the second operation, the third scene switching instruction including an identifier of the second shooting scene, and the third screen switching instruction including an identifier of the first screen; in response to the third scene switching instruction, processing the image captured by the rear camera based on a second algorithm corresponding to the second shooting scene to obtain a ninth image; in response to the third screen switching instruction, controlling the second screen to be off, controlling the first screen to be bright, and displaying the ninth image through the first screen.

[0048] The second operation is to exit the rear selfie function, for example, flipping the phone, or clicking to switch the home screen control, or clicking to exit the rear selfie control, etc.

[0049] While using the rear-camera selfie function, the user can exit it with a second operation. After exiting the rear-camera selfie function, the camera app enters the first state of the rear-camera non-selfie mode. The electronic device turns off the second screen and turns on the first screen, displaying the ninth image captured by the rear camera on the first screen. In other words, the user can exit the rear-camera selfie function at any time with one click, facilitating operation and improving the user experience.

[0050] In a second aspect, the present application provides a photographing method, which is performed by an electronic device, the electronic device including a foldable screen and a rear camera, the foldable screen including a first screen and a second screen, the rear camera and the first screen being arranged opposite each other, the first screen and the second screen being on the same side when the electronic device is in an unfolded state, and the second screen and the rear camera being on the same side when the electronic device is in a folded state, the method comprising:

[0051] When the electronic device is in a folded state, the first screen is in a bright state, and the second screen is in an off state, a first operation of the user is received; in response to the first operation, the first screen is controlled to be off, and the second screen is controlled to be brightened, and a first photo preview interface is displayed through the second screen, wherein the first photo preview interface includes an image obtained through the rear camera.

[0052] The electronic device may be an outward-folding screen device, such as an outward-folding screen mobile phone. The first screen is also referred to as the main screen, and the second screen is also referred to as the secondary screen. Optionally, the first screen and the second screen may be two parts of a folding screen.

[0053] In the second aspect, the first photo preview interface is also the photo preview interface in the rear selfie scene, such as the photo preview interface 1106 in the specific implementation.

[0054] Optionally, the first operation can be any one of the following operations: clicking the rear selfie control, flipping the electronic device, clicking the selfie icon or selfie option in the main interface, exiting the camera settings interface after turning on the rear selfie function in the camera settings interface, or setting the default selfie mode to rear selfie in the camera settings interface and then exiting the camera settings interface, etc.

[0055] The first aspect provides a photographing method, in which, when the electronic device is in a folded state, the first screen is in a bright state, and the second screen is in an off state, the user can trigger the rear selfie function through a first operation, that is, the first screen of the electronic device is off, the second screen is on, and the first photographing preview interface in the rear selfie scene is displayed through the second screen. Since the second screen and the rear camera are on the same side in the folded state, the user can use the rear camera to take pictures of people or things on the side of the user (i.e., selfies), and view the first photographing preview interface on the second screen, which is convenient for the user to take selfies. Moreover, the image taken by the rear camera is displayed in the first photographing preview interface, that is, in the rear selfie scene, the image is obtained through the rear camera. The specifications and hardware configuration of the rear camera are relatively high, the image quality captured is relatively high, the shooting effect is relatively good, and the user experience can be improved.

[0056] In a possible implementation, before receiving the user's first operation, the method further includes: displaying a second photo preview interface through the first screen, the second photo preview interface including a first control; and the first operation is an operation acting on the first control.

[0057] In the second aspect, the second photo preview interface can be a photo preview interface for a folded rear-facing non-selfie scenario (e.g., photo preview interface 901 in the specific implementation), or a photo preview interface for a front-facing selfie scenario (e.g., photo preview interface 1501 in the specific implementation). In other words, the user can enter the rear-facing selfie function from a rear-facing non-selfie scenario by performing a first operation on the first control; or the user can enter the rear-facing selfie function from a front-facing selfie scenario by performing a first operation on the first control.

[0058] The operation acting on the first control may, for example, be clicking on the first control. When the user enters the rear-mounted selfie function in a rear-mounted non-selfie scenario, the first control may, for example, be the rear-mounted selfie control in the photo preview interface in the rear-mounted non-selfie scenario, and the operation acting on the first control may be clicking on the rear-mounted selfie control. When the user enters the rear-mounted selfie function in a front-mounted selfie scenario, the first control may, for example, be the setting control or the rear-mounted selfie control in the photo preview interface in the rear-mounted non-selfie scenario. When the first control is a setting control, the operation acting on the first control may sequentially include clicking on the setting control (entering the camera setting interface after clicking), turning on the rear-mounted selfie function switch or selecting the selfie mode as the rear-mounted selfie, and exiting the camera setting interface. When the first control is a rear-mounted selfie control, the first operation may be clicking on the rear-mounted selfie control.

[0059] In this implementation, the user can quickly enter the rear selfie function by performing the first operation on the first control, which facilitates operation and improves user experience.

[0060] In one possible implementation, the electronic device further includes a front camera, which is located on the same side as the first screen, and the second photo preview interface includes an image obtained through the rear camera or an image obtained through the front camera.

[0061] When the second photo preview interface includes an image captured by the rear camera, it corresponds to entering the rear selfie function from the rear non-selfie scene, and the second photo preview interface is the photo preview interface for the rear non-selfie scene. When the second photo preview interface includes an image captured by the front camera, it corresponds to entering the rear selfie function from the front selfie scene, and the second photo preview interface is the photo preview interface for the front selfie scene.

[0062] In this implementation, users can enter the rear selfie function from the front selfie scene, and can also enter the rear selfie function from the rear selfie scene, providing users with multiple ways to enter the rear selfie function, facilitating user operation and improving user experience.

[0063] In one possible implementation, in response to a first operation, the first screen is controlled to turn off, and the second screen is controlled to turn on, and a first photo preview interface is displayed through the second screen, including: in response to the first operation, a first flip guide interface is displayed through the first screen, and the first flip guide interface is used to guide the user to flip the electronic device; after the first flip guide interface is displayed for a first preset time, the first screen is controlled to turn off, and the second screen is controlled to turn on, and the first photo preview interface is displayed through the second screen.

[0064] The first flip guide interface may be, for example, the flip guide interface 1105 in the specific implementation.

[0065] In this implementation, when entering the rear selfie function, before controlling the screen switch, a first flip guide interface is first displayed to guide the user to flip the electronic device, so that the user can know how to use the rear selfie function and improve the user experience.

[0066] Optionally, while the second screen displays the first flip guide interface, the electronic device can block the touch function of the first screen and the second screen. That is, the touch function of the first screen and the second screen is blocked within a preset time (for example, 3 seconds) after the user performs the first operation. This can prevent the user from accidentally touching the screen and affecting the entry into the rear selfie function, thereby improving the user experience.

[0067] In a possible implementation, the second photo preview interface includes an image acquired through the rear camera, and the second photo preview interface also includes guidance information, where the guidance information is used to guide the user to click the first control.

[0068] In this implementation, the user is guided to use the rear selfie function by displaying guidance information, which makes it easier for the user to understand how to use the rear selfie function and improves the user experience.

[0069] In one possible implementation, the second photo preview interface includes an image captured by the rear camera, and the method further includes: in response to a second operation performed by the user on the first control, adding a second control to the second photo preview interface.

[0070] Optionally, the second operation can be a swipe up operation on the area where the first control is located. The second control is also the flip camera control. Clicking the second control enters the front selfie scene.

[0071] In this implementation, the user triggers the display of a second control in the interface through a second operation. In this way, the interface includes both a first control for entering the rear-camera selfie function and a second control for entering the front-camera selfie scene. In this way, the user can choose between rear-camera selfie and front-camera selfie according to usage needs, which is convenient for user use and improves user experience.

[0072] In one possible implementation, the second photo preview interface includes an image captured by the rear camera, and the second photo preview interface also includes a setting control. The method also includes: when the second photo preview interface is displayed on the first screen, in response to a third operation performed by the user on the setting control, displaying a camera setting interface through the first screen, the camera setting interface including setting options for the selfie mode; in response to the user's operation on the setting option, displaying a first pop-up window, the first pop-up window including a front selfie option and a rear selfie option, and the rear selfie option is in a selected state; in response to the user's operation on the front selfie option, the rear selfie option is displayed as unselected, and the front selfie option is displayed as selected; in response to the user's operation of closing the first pop-up window and exiting the camera setting interface, displaying a third photo preview interface through the first screen, the third photo preview interface including the image captured by the rear camera and the second control.

[0073] In the second aspect, the first pop-up window may be, for example, the selfie mode selection pop-up window 2303 in the specific implementation. The third photo preview interface may be, for example, the photo preview interface 2304 in the specific implementation.

[0074] That is, in the rear-facing non-selfie scenario, the user selects the front-facing selfie option in the first pop-up window, changing the default selfie mode from rear-facing selfie to front-facing selfie. After the user exits the camera settings interface, the shooting scene remains the rear-facing non-selfie scene, but the controls displayed in the interface change to the second control (the flip camera control). The user clicks the flip camera control to enter the front-facing selfie scene. In this implementation, the user can independently select the default selfie mode, and the controls in the photo preview interface change based on the user's selection, making the interface display more consistent with the user's preferences and improving the user experience.

[0075] In a possible implementation, the method further includes: in response to the user clicking the second control, displaying a fourth photo preview interface through the first screen, where the fourth photo preview interface includes an image acquired through the front camera.

[0076] In the second aspect, the fourth photo preview interface is also the photo preview interface in the front selfie scenario, such as the photo preview interface 1501 in the specific implementation.

[0077] In one possible implementation, the fourth photo preview interface includes a first control, and the method further includes: in response to a fourth operation performed by the user on the first control in the fourth photo preview interface, displaying a first flip guide interface through the first screen, the first flip guide interface being used to guide the user to flip the electronic device; after the first flip guide interface is displayed for a first preset time, controlling the first screen to turn off, and controlling the second screen to turn on, and displaying the first photo preview interface through the second screen.

[0078] Optionally, the first control may be a rear selfie control or a setting control. The fourth operation may be an operation such as clicking the rear selfie control or setting a selfie mode through the setting control.

[0079] In a possible implementation, before receiving the first operation of the user, the method further includes: displaying a second photo preview interface through the first screen; the first operation is an operation of flipping the electronic device.

[0080] In this implementation, the user can enter the rear selfie function by flipping the electronic device, without the user having to perform operations such as clicking on the rear selfie control in the interface. The rear selfie function can be entered quickly and conveniently, thereby improving the intelligence of the electronic device and thus improving the user experience.

[0081] In a possible implementation, the second photo preview interface includes an image acquired through the rear camera.

[0082] That is to say, users can enter the rear selfie function from the rear selfie scene by flipping the electronic device.

[0083] In a possible implementation, the shooting mode in the first photo preview interface is the same as the shooting mode in the second photo preview interface.

[0084] For example, if the user selects portrait mode in the first photo preview interface, the shooting mode in the second photo preview interface will also be portrait mode, which can inherit the user's selection and improve the user experience. Of course, after entering the rear selfie function, the user can also switch the shooting mode to other modes as needed.

[0085] In one possible implementation, before receiving the user's first operation, the method also includes: displaying a main interface through the first screen, the main interface including an icon of a camera application; in response to the user long pressing the icon of the camera application, displaying a first service card through the first screen, the first service card including a selfie option; the first operation is clicking the selfie option.

[0086] The first service card may be, for example, a shortcut menu of a camera application.

[0087] In this implementation, the user can enter the rear selfie function through the selfie option in the main interface, without the user having to open the second photo preview interface, or click on the rear selfie control or setting control in the second photo preview interface, thereby simplifying the user's operation process of entering the rear selfie function and improving the user experience.

[0088] In one possible implementation, before receiving the user's first operation, the method also includes: displaying a main interface through the first screen, the main interface including an icon of a camera application; in response to the user clicking the icon of the camera application, displaying a first service card through the first screen, the first service card including a selfie option; in response to the user dragging the selfie option to the main interface, displaying a selfie icon corresponding to the selfie option in the main interface; the first operation is clicking the selfie icon.

[0089] In this implementation, the user can enter the rear selfie function through the selfie icon in the main interface, without the user having to open the second photo preview interface, or click on the rear selfie control or setting control in the second photo preview interface, thereby simplifying the user's operation process of entering the rear selfie function and improving the user experience.

[0090] In one possible implementation, in response to a first operation, the first screen is controlled to turn off, and the second screen is controlled to turn on, and a first photo preview interface is displayed through the second screen, including: in response to the first operation, starting a camera application; displaying a first flip guide interface through the first screen, the first flip guide interface is used to guide the user to flip the electronic device; after the first flip guide interface is displayed for a first preset time, the first screen is controlled to turn off, and the second screen is controlled to turn on, and the first photo preview interface is displayed through the second screen.

[0091] In this implementation, the user is guided to use the rear selfie function by displaying the first flip guide interface, which helps the user understand how to use the rear selfie function and improves the user experience.

[0092] In one possible implementation, the method also includes: when the first photo preview interface is displayed on the second screen, in response to the fourth operation performed by the user on the first screen, exiting the camera application to the background; controlling the second screen to turn off, and controlling the first screen to turn on; in response to the fourth operation performed by the user on the first screen, controlling the camera application to run in the foreground, and displaying the first flip guide interface through the first screen; after the first flip guide interface is displayed for a first preset time, controlling the first screen to turn off, and controlling the second screen to turn on, and displaying the first photo preview interface through the second screen.

[0093] The fourth operation is to exit the camera app to the background. In this implementation, if the user exits the camera app to the background, the electronic device can retain the running camera app. When the user re-launches the camera app, the rear-facing selfie function continues to function. This eliminates the need for the user to repeatedly access the rear-facing selfie function, simplifying user operations and improving the user experience.

[0094] In one possible implementation, the first photo preview interface includes a third control, and the third control includes a thumbnail. The method also includes: when the first photo preview interface is displayed on the second screen, in response to the user clicking the third control, the first interface is displayed through the second screen, and the first interface includes an image corresponding to the thumbnail.

[0095] The third control is the thumbnail of the image taken by the user in the photo preview interface. The first interface is the image preview interface in the folded state.

[0096] In this implementation, while using the rear-mounted selfie function, the user can view the captured image through the image thumbnail in the first photo preview interface. The image can be displayed on the second screen. This allows the user to view the image at any time without exiting the rear-mounted selfie function, which is convenient for the user and improves the user experience.

[0097] In one possible implementation, the method also includes: when the first interface is displayed on the second screen, in response to the user unfolding the electronic device to the unfolded state, controlling the first screen to light up, and displaying the second interface through the first screen and the second screen together, the second interface including an image corresponding to the thumbnail.

[0098] The second interface is the image preview interface in the expanded state, such as the image preview interface 2103 in the specific implementation.

[0099] In this implementation, if the rear-mounted selfie function is enabled and the user is viewing an image on the second screen and then unfolds the electronic device to the unfolded state, the image is displayed on both the first and second screens. This means that while viewing an image on the second screen, the user can unfold the foldable screen at any time to display the image simultaneously on the first and second screens, enabling large-scale image previews, facilitating user experience and enhancing user experience.

[0100] In one possible implementation, the method also includes: when the first photo preview interface is displayed on the second screen, in response to the user unfolding the electronic device to the unfolded state, controlling the first screen to light up, and jointly displaying the fifth photo preview interface through the first screen and the second screen, the fifth photo preview interface including the image obtained by the rear camera.

[0101] In the second aspect, the fifth photo preview interface is the photo preview interface for the rear non-selfie scene in the expanded state, such as the photo preview interface 1801 in the specific implementation.

[0102] In this implementation, when using the rear-camera selfie function, if the user unfolds the electronic device, the camera application exits the rear-camera selfie function and enters the rear-camera non-selfie mode in the unfolded state. When the user unfolds the electronic device to the unfolded state, it indicates that the user no longer needs the rear-camera selfie function, so directly entering the unfolded state rear-camera shooting mode is likely to meet user needs and improve the user experience.

[0103] In one possible implementation, the first photo preview interface includes a second control and a fourth control, and the method further includes: when the first photo preview interface is displayed on the second screen, in response to the user clicking the fourth control or the second control, a second flip guide interface is displayed through the second screen, and the second flip guide interface is used to guide the user to flip the electronic device; after the second flip guide interface is displayed for a second preset time, the second screen is controlled to turn off, and the first screen is controlled to turn on, and the second photo preview interface is displayed through the first screen, and the second photo preview interface includes an image obtained through the rear camera.

[0104] The second control may be a flip camera control. The fourth control may be a home screen switch control or a rear selfie exit control. The second flip guide interface may be, for example, the flip guide interface 2201 in the specific embodiment.

[0105] While using the rear-camera selfie function, users can exit it using the home screen switch, flip camera control, or rear selfie exit control in the first photo preview interface. After exiting the rear-camera selfie function, the camera app enters the rear non-selfie mode in the folded state. The electronic device turns off the second screen, lights up the first screen, and displays the second photo preview interface on the first screen. In other words, users can exit the rear-camera selfie function at any time while using it, making it easier for users to operate and use, and improving the user experience.

[0106] In a third aspect, the present application provides a device, which is included in an electronic device, and has the function of implementing the electronic device behavior in the first aspect and the possible implementation of the first aspect, or has the function of implementing the electronic device behavior in the second aspect and the possible implementation of the second aspect. The function can be implemented by hardware, or by hardware executing the corresponding software implementation. The hardware or software includes one or more modules or units corresponding to the above functions. For example, a receiving module or unit, a processing module or unit, etc.

[0107] In a fourth aspect, the present application provides an electronic device, which includes: a processor, a memory, and an interface; the processor, the memory, and the interface cooperate with each other so that the electronic device executes any one of the methods in the technical solutions of the first aspect or the second aspect.

[0108] In a fifth aspect, the present application provides a chip including a processor, wherein the processor is configured to read and execute a computer program stored in a memory to perform the method of the first aspect and any possible implementation thereof, or to perform the method of the second aspect and any possible implementation thereof.

[0109] Optionally, the chip also includes a memory, and the memory is connected to the processor via circuits or wires.

[0110] Further optionally, the chip also includes a communication interface.

[0111] In a sixth aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor executes any one of the methods in the technical solution of the first aspect, or the processor executes any one of the methods in the technical solution of the second aspect.

[0112] In the seventh aspect, the present application provides a computer program product, which includes: computer program code, which, when the computer program code runs on an electronic device, enables the electronic device to execute any one of the methods in the technical solution of the first aspect, and enables the electronic device to execute any one of the methods in the technical solution of the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0113] FIG1 is a schematic structural diagram of an external folding screen mobile phone provided in an embodiment of the present application;

[0114] FIG2 is a schematic diagram of a photo-taking scene of an external foldable screen mobile phone provided in an embodiment of the present application;

[0115] FIG3 is a schematic structural diagram of an inward-folding screen mobile phone provided in an embodiment of the present application;

[0116] FIG4 is a schematic diagram of a photo-taking scene of an inward-folding screen mobile phone provided in an embodiment of the present application;

[0117] FIG5 is a schematic diagram of interface changes during the process of enabling the rear-mounted selfie function according to an embodiment of the present application;

[0118] FIG6 is a schematic diagram of a process for calling a flip camera control according to an embodiment of the present application;

[0119] FIG7 is a schematic diagram of interface changes during the setting process of a flip wake-up function provided in an embodiment of the present application;

[0120] FIG8 is a schematic diagram of an interface change in the process of clicking the rear-mounted selfie control to enter the rear-mounted selfie function according to an embodiment of the present application;

[0121] FIG9 is a schematic diagram of another example of interface changes when clicking on the rear-mounted selfie control to enter the rear-mounted selfie function according to an embodiment of the present application;

[0122] FIG10 is a schematic diagram of an example of interface changes during a flip-over of a mobile phone to wake up a rear-facing selfie camera, provided in an embodiment of the present application;

[0123] FIG11 is a schematic diagram of interface changes during the process of entering the rear selfie function through the desktop shortcut menu according to an embodiment of the present application;

[0124] FIG12 is a schematic diagram of interface changes in another example of a process of entering the rear selfie function through a desktop shortcut menu provided by an embodiment of the present application;

[0125] FIG13 is a schematic diagram showing one of the interface changes during the process of entering the rear-camera selfie function from the front-camera selfie scene according to an embodiment of the present application;

[0126] FIG14 is a second diagram of interface changes during the process of entering the rear-camera selfie function from the front-camera selfie scene, provided in an embodiment of the present application;

[0127] FIG15 is a schematic diagram of the interface changes of a mobile phone when using the rear selfie function according to an embodiment of the present application;

[0128] FIG16 is a schematic diagram of an interface change when a control is clicked to exit the rear selfie function according to an embodiment of the present application;

[0129] FIG17 is a schematic diagram of an interface change for setting a default selfie mode according to an embodiment of the present application;

[0130] FIG18 is a schematic diagram of interface changes during the process of entering the rear-camera selfie function from the front-camera selfie scene according to another example provided by an embodiment of the present application;

[0131] FIG19 is a schematic diagram of an example of interface changes when exiting a camera application during the process of entering a rear-mounted selfie function according to an embodiment of the present application;

[0132] FIG20 is a schematic diagram of an example of an interface change for viewing an image during use of the rear-mounted selfie function provided by an embodiment of the present application;

[0133] FIG21 is a schematic diagram of an example of interface changes based on an inward folding screen mobile phone entering a rear selfie function provided by an embodiment of the present application;

[0134] FIG22 is a schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application;

[0135] FIG23 is a flow chart of a photographing method according to an embodiment of the present application;

[0136] FIG24 is a flow chart of another photographing method provided in an embodiment of the present application;

[0137] FIG25 is a flowchart of another photographing method provided in an embodiment of the present application;

[0138] FIG26 is a schematic diagram of the software architecture of another electronic device provided in an embodiment of the present application;

[0139] FIG27 is a flowchart of another photographing method provided in an embodiment of the present application;

[0140] FIG28 is a flowchart of another photographing method provided in an embodiment of the present application;

[0141] FIG29 is a flowchart of another photographing method provided in an embodiment of the present application;

[0142] FIG30 is a flowchart of another photographing method provided in an embodiment of the present application;

[0143] FIG31 is a flowchart of another photographing method provided in an embodiment of the present application;

[0144] FIG32 is a flowchart of another photographing method provided in an embodiment of the present application;

[0145] FIG33 is a schematic structural diagram of an electronic device 100 provided in an embodiment of the present application. DETAILED DESCRIPTION

[0146] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships can exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0147] In the following, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the quantity of the technical features indicated. Therefore, a feature specified as "first," "second," or "third" may explicitly or implicitly include one or more of the features.

[0148] References to "one embodiment" or "some embodiments" in this specification mean that one or more embodiments of the present application include a particular feature, structure, or characteristic described in conjunction with that embodiment. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in different places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.

[0149] The photographing method provided in the embodiment of the present application can be applied to electronic devices with foldable screens, such as foldable screen mobile phones. For ease of understanding, the structure of the foldable screen mobile phone is first introduced.

[0150] Foldable screen phones are mainly divided into external foldable screen phones and internal foldable screen phones. Both external foldable screen phones and internal foldable screen phones can include several forms, such as folded state, stand state, and unfolded state. Among them, the stand state refers to the state between the folded state and the unfolded state. External foldable screen phones and internal foldable screen phones both include a foldable screen. In the unfolded state, the foldable screen is in the unfolded state. In the unfolded state of an external foldable screen phone, when the foldable screen faces the user, the phone is folded away from the user (called outward folding). The external foldable screen phone's form changes to the stand state. Continuing to fold outward, the form changes to the folded state. In the unfolded state of an internal foldable screen phone, when the foldable screen faces the user, the phone is folded toward the user (called inward folding). The external foldable screen phone's form changes to the stand state. Continuing to fold inward, the form changes to the folded state. Among them, the folded state of the external foldable screen phone is also called the first form, and the unfolded state of the external foldable screen is also called the second form; the unfolded state of the internal foldable screen phone is also called the first form, and the folded state of the internal foldable screen is also called the second form. The following is an explanation with reference to the accompanying drawings.

[0151] 1. External folding screen mobile phone

[0152] For example, Figure 1 is a schematic diagram of the structure of an external folding screen mobile phone provided in an embodiment of the present application. For the sake of clarity, Figure 1 shows the front and back perspectives of the external folding screen mobile phone 10.

[0153] As shown in Figure 1, the external folding screen mobile phone 10 includes a first structural member 11, a second structural member 12 and a connecting component 13 connecting the first structural member 11 and the second structural member 12 (located at the position shown by the dotted line in Figure (a) in Figure 1). The first structural member 11 and the second structural member 12 are flipped and folded through the connecting component 13.

[0154] The first structural member 11 may include a main display screen (hereinafter referred to as the main screen, also referred to as the first screen) 111, a first back housing 112, and a raised portion 113. The main screen 111 is provided with a front camera 1111. The first back housing 112 and the raised portion 113 are provided on the back of the main screen 111. The raised portion 113 may be provided with a rear camera 1122.

[0155] The second structural member 12 may include a sub-display screen (hereinafter referred to as sub-screen, also referred to as second screen) 121 and a second back shell 122. The second back shell 122 is provided at the back of the sub-screen 121.

[0156] During use, the angle between the first structural member 11 and the second structural member 12 is changed by the connecting assembly 13 to realize various configurations of the external folding screen mobile phone 10. It is understood that the secondary screen 121 and the main screen 111 can actually be an integrally formed flexible display screen (i.e., a foldable screen). When the external folding screen mobile phone 10 is folded by the connecting assembly 13, the connecting assembly 13 divides the screen into two parts: the main screen 111 and the secondary screen 121, wherein the main screen 111 and the rear camera 1122 are located on the same side of the connecting assembly 13.

[0157] As shown in Figure (a) in Figure 1, when the angle between the first structural member 11 and the second structural member 12 is approximately 180°, the external folding screen mobile phone 10 is in the unfolded state. At this time, the surface of the first back shell 112 of the first structural member 11 and the surface of the second back shell 122 of the second structural member 12 are approximately in the same plane. The surfaces of the main screen 111 and the secondary screen 121 are approximately in the same plane, that is, the main screen 111 and the secondary screen 121 are on the same side. In the unfolded state, the light emitting direction of the main screen 111 and the secondary screen 121 is the same as the light incoming direction of the rear camera 1122. In the unfolded state, the external folding screen mobile phone 10 displays the content to be displayed through the main screen 111 and the secondary screen 121 at the same time. Optionally, in the unfolded state, the main screen 111 and the secondary screen 121 can jointly display the interface of the same application, or can display the interfaces of different applications in split screen.

[0158] When the external folding screen mobile phone 10 is in the unfolded state as shown in Figure 1 (a), and the main screen 111 and the sub-screen 121 are both on, the user can fold the external folding screen mobile phone 10 outward (in the direction indicated by the arrow in Figure 1 (a)) to put the external folding screen mobile phone 10 into the stand state, as shown in Figure 1 (b).

[0159] When the external folding screen mobile phone 10 is in the stand state, if the angle between the first structural member 11 and the second structural member 12 is greater than 45°, the main screen and the secondary screen are kept on at the same time, as shown in Figure 1 (b). When the angle between the first structural member 11 and the second structural member 12 gradually decreases to about 45°, the secondary screen 121 is turned off, and only the main screen 111 is in the bright screen state, displaying the content to be displayed. In the subsequent folding process, only the main screen 111 is kept on until the angle between the first structural member 11 and the second structural member 12 is about 0°, presenting the folded state shown in Figure 1 (c).

[0160] As shown in Figure 1(c), when the external folding screen mobile phone 10 is in the folded state, the surface of the secondary screen 121 of the second structural member 12 is approximately in the same plane as the surface of the raised portion 113 of the first structural member 11. At this time, the secondary screen 121 and the rear camera 1122 are on the same side. In the folded state, the light output direction of the secondary screen 121 is opposite to the light input direction of the rear camera 1122.

[0161] In the folded state, the external folding screen mobile phone 10 displays the content to be displayed through the main screen 111, and the secondary screen 121 does not display and can be in the off-screen state. It should be noted that in the folded state, when the secondary screen 121 is in the off-screen state, the secondary screen 121 may not receive touch operations, and the user can perform touch operations on the main screen 111.

[0162] When the external folding screen mobile phone 10 is unfolded from the folded state to the unfolded state, the state change of the screen can be the reverse process from the unfolded state to the folded state mentioned above, which will not be repeated.

[0163] With the structural support of the external folding screen mobile phone 10 described in FIG1 , in a photo-taking scenario, when the external folding screen mobile phone 10 is in the unfolded state as shown in FIG1 (a), the user can use the rear camera 1122 to shoot people or objects around him, and the captured image can be displayed simultaneously through the main screen 111 and the sub-screen 122, as shown in FIG2 (a). This shooting scenario is also referred to as the rear non-selfie scene in the unfolded state. At the same time, when the external folding screen mobile phone 10 is in the unfolded state, the user can also use the front camera 1111 to take a selfie, and the captured image can be displayed simultaneously through the main screen 111 and the sub-screen 122, as shown in FIG2 (b). This shooting scenario is also referred to as the front selfie scene in the unfolded state.

[0164] When the external folding screen mobile phone 10 is in the folded state as shown in Figure 1 (c), the user can use the rear camera 1122 to shoot people or objects around, and the captured image is displayed on the main screen 111, as shown in Figure 2 (c). This shooting scene is also called the rear non-selfie scene in the folded state. When the external folding screen mobile phone 10 is in the folded state, the user can also use the front camera 1111 to take a selfie, and the captured image is displayed on the main screen 111, as shown in Figure 2 (d). This shooting scene is also called the front selfie scene in the folded state.

[0165] As can be seen from FIG2 , for an outward-folding screen mobile phone, the user can only take selfies through the front camera 1111. However, the specifications of the front camera of a mobile phone are generally low, and the image quality and effect obtained by using the front camera are poor.

[0166] 2. Inward folding screen mobile phone

[0167] For example, Figure 3 is a schematic diagram of the structure of an inward folding screen mobile phone provided in an embodiment of the present application. For clarity, Figure 3 shows the front and back perspectives of the inward folding screen mobile phone 20.

[0168] As shown in Figure 3, the inward folding screen mobile phone 20 includes a first structural member 21, a second structural member 22 and a connecting component 23 connecting the first structural member 21 and the second structural member 22 (located at the position shown by the dotted line in Figure (a) of Figure 3). The first structural member 21 and the second structural member 22 are flipped and folded through the connecting component 23.

[0169] The first structural member 21 may include a first inner display screen 211 and a back housing 212. A first front camera 2111 is disposed on the first inner display screen 211. The first back housing 212 is disposed on the back of the first inner display screen 211. A rear camera 2122 may be disposed on the back housing 212.

[0170] The second structural member 12 may include a second inner display screen 221 and an outer display screen 222 (also referred to as a second screen). The second inner display screen 221 is disposed opposite the outer display screen 222. The outer display screen 222 may be provided with a second front camera 2221.

[0171] During use, the angle between the first structural member 21 and the second structural member 22 is changed by the connecting assembly 23, thereby realizing various configurations of the inner folding screen mobile phone 20. It is understood that the second inner display screen 221 and the first inner display screen 211 can actually be a single, integrally formed flexible display screen (i.e., a folding screen, also referred to as the inner display screen or first screen of the inner folding screen mobile phone). When the inner folding screen mobile phone 20 is folded via the connecting assembly 23, the connecting assembly 23 divides the screen into two parts: the second inner display screen 221 and the first inner display screen 211.

[0172] As shown in Figure (a) in Figure 3, when the angle between the first structural member 21 and the second structural member 22 is approximately 180°, the inner folding screen mobile phone 20 is in the unfolded state. At this time, the surface of the first back shell 212 and the surface of the outer display screen 222 are approximately in the same plane. At this time, the outer display screen 222 and the rear camera 2122 are on the same side. The surfaces of the first inner display screen 211 and the second inner display screen 221 are approximately in the same plane. In the unfolded state, the light emitting direction of the outer display screen 222 is opposite to the light incoming direction of the rear camera 2122. In the unfolded state, the outer display screen 222 is in the off-screen state, and the inner folding screen mobile phone 20 displays the content to be displayed simultaneously through the first inner display screen 211 and the second inner display screen 221. It should be noted that in the off-screen state, the outer display screen 222 cannot receive user touch operations.

[0173] The inner folding screen mobile phone 20 is in the unfolded state as shown in Figure 3 (a). When the first inner display screen 211 and the second inner display screen 221 are both on, the user can fold the inner folding screen mobile phone 20 inward (in the direction indicated by the arrow in Figure 3 (a)) to put the inner folding screen mobile phone 20 into the stand state, as shown in Figure 3 (b).

[0174] When the inner folding screen mobile phone 20 is in the stand position, if the angle between the first structural member 21 and the second structural member 22 is greater than 45°, the first inner display 211 and the second inner display 221 remain illuminated simultaneously. When the angle between the first structural member 21 and the second structural member 22 gradually decreases to approximately 45°, the first inner display 211 and the second inner display 221 are turned off, and the outer display 222 is illuminated, with the outer display 222 displaying the desired content. During the subsequent folding process, only the outer display 222 remains illuminated until the angle between the first structural member 21 and the second structural member 22 reaches approximately 0°, resulting in the folded position shown in Figure 3 (c).

[0175] As shown in Figure 3(c), when the inner folding screen mobile phone 20 is in the folded state, the first inner display 211 and the second inner display 221 are positioned opposite each other and folded inward, while the outer display 222 is positioned outward. In the folded state, the light emitting direction of the outer display 222 is the same as the light entering direction of the rear camera 2122.

[0176] With the support of the structure of the inner folding screen mobile phone 20 shown in FIG3 , in the unfolded state, in non-selfie scenarios, the user can use the rear camera 2122 to take pictures of people or objects around them, and the captured images can be displayed simultaneously on the first inner display 211 and the second inner display 222, as shown in FIG4 (a). At the same time, in the unfolded state, in selfie scenarios, the user can also use the first front camera 2111 to take pictures of themselves, and the captured images can be displayed simultaneously on the first inner display 211 and the second inner display 221, as shown in FIG4 (b).

[0177] In the folded state, when the rear camera is not in self-portrait mode, the user can use the rear camera 2122 to take pictures of people or objects around them, and the captured image is displayed on the external display screen 222, as shown in Figure 4 (c). In the folded state, when the front camera is in self-portrait mode, the user can also use the second front camera 2221 to take pictures of themselves, and the captured image is displayed on the external display screen 222, as shown in Figure 4 (d).

[0178] As can be seen from Figure 4, for an inward-folding screen mobile phone, a user can take a selfie using the first front camera 2111 or the second front camera 2221. However, the specifications of the front camera of a mobile phone are generally low, and the image quality and effect obtained by using the front camera are poor.

[0179] In other words, whether it is an external folding screen phone or an internal folding screen phone, you can only take selfies with the front camera. The image quality and effect obtained by using the front camera are poor.

[0180] In view of this, an embodiment of the present application provides a method for taking pictures, which provides the user with a rear selfie (also called super selfie or rear super selfie, etc.) function when the external screen mobile phone is in a folded state or the internal folding screen mobile phone is in an unfolded state. After the rear selfie function is enabled, the mobile phone starts the rear camera to capture images, and controls the screen on the same side as the rear camera to light up, and the user can control the photo taking and view the captured images through the screen. Specifically, for the external folding screen mobile phone, after the rear selfie function is enabled, the mobile phone starts the rear camera streaming and controls the secondary screen to light up. For the internal folding screen mobile phone, after the rear selfie function is enabled, the mobile phone starts the rear camera streaming and controls the external display screen to light up. In this way, users can take selfies with the rear camera, improve the shooting quality and shooting effect of selfies, and thus improve the user's shooting experience.

[0181] First, taking a foldable screen mobile phone as an example, the operation process of the rear selfie function and the interface change process in the embodiment of this application are explained.

[0182] To facilitate understanding, several terms involved in the following embodiments are first explained.

[0183] 1. Enable the function

[0184] In the embodiment of the present application, when the foldable screen mobile phone has a certain function, turning on the function means turning on the switch of the function so that the foldable screen mobile phone can use the function. After turning on a certain function, the function is said to be in the turned-on state, the turned-on state, or the function is said to be turned on.

[0185] 2. Turn off the function

[0186] In the embodiment of the present application, when the foldable screen mobile phone has a certain function, turning off the function means turning off the switch of the function so that the foldable screen mobile phone cannot use the function. After turning off a function, the function is said to be in the off state, or the function is said to be turned off.

[0187] 3. Enter function

[0188] In the embodiment of the present application, entering a certain function means starting to use the function through user operation or automatic triggering of the foldable screen mobile phone when the function is turned on. Entering a function is also called enabling a function or starting a function.

[0189] 4. Exit function

[0190] In the embodiment of the present application, exiting a certain function means stopping the use of the function through user operation or automatic triggering of the foldable screen mobile phone when the function is turned on.

[0191] In the implementation of this application, the camera application in the foldable screen mobile phone has a rear selfie function. When the rear selfie function is turned on, the user can take selfies through the rear camera, improving the quality and effect of the selfie images. The following describes the relevant operation process and interface changes based on the use stage of the rear selfie function and the application scenario.

[0192] 1. Turning the rear selfie function on and off

[0193] 1. Enable the rear selfie function

[0194] For example, FIG5 is a schematic diagram of the interface changes in the process of turning on the rear selfie function provided by an embodiment of the present application. Taking the folding screen mobile phone in the folded state as an example, when the rear selfie function is not turned on, after the camera application is started, the folding screen mobile phone obtains photos through the rear camera, and displays the photo preview interface 908 (also called the second preview interface) through the main screen. The photo preview interface 908 includes photos obtained by the rear camera, as shown in Figure (a) in Figure 5. In other words, when the photo preview interface 908 is in the folded state and the rear selfie function is turned off, the preview interface in the rear non-selfie scene. In addition, as shown in Figure (a) in Figure 5, when the rear selfie function is turned on, the photo preview interface 908 includes a flip camera control 909 (also called a second control). The flip camera control 909 is used for the user to control the switching between the rear camera and the front camera.

[0195] The photo preview interface 908 also includes a settings control 903. When a user taps on the settings control 903, the foldable phone displays a camera settings interface 904 in response to the user's operation, as shown in FIG5(b). The camera settings interface 904 includes a rear-mounted selfie option 905. When a user taps on the rear-mounted selfie option 905, the foldable phone displays a rear-mounted selfie settings interface 906 in response to the user's operation, as shown in FIG5(c).

[0196] The rear-mounted selfie setting interface 906 includes a switch control for the rear-mounted selfie function (referred to as the rear-mounted selfie switch) 907. As shown in Figure 5(c), the rear-mounted selfie switch 907 is currently off and grayed out. When the user taps the rear-mounted selfie switch 907, the foldable phone responds to the user's action by turning on the rear-mounted selfie function, and the rear-mounted selfie switch 907 is highlighted, as shown in Figure 5(d).

[0197] Afterwards, the user can perform two return operations, successively exiting the rear selfie setting interface 906 and exiting the camera setting interface 904. The folding screen mobile phone displays the photo preview interface 901 (also called the first preview interface), as shown in Figure (e) in Figure 5. The photo preview interface 901 is the preview interface for the rear non-selfie scene when it is in the folded state and the rear selfie function is turned on. Unlike the photo preview interface 908, the photo preview interface 901 displays the rear selfie control (also called the first control) 902. The rear selfie control is used to enter the rear selfie function. Optionally, the return operation can be, for example, a side sliding operation (i.e., sliding inward from the side of the screen), clicking the return button in the three-button navigation bar, or clicking the return control in the interface, etc. This embodiment of the application does not impose any restrictions on this. The return operation in the following embodiments is also the same and will not be repeated.

[0198] It is understandable that the rear selfie function of the foldable screen mobile phone can also be turned on by default when it leaves the factory. After that, the user can turn off the rear selfie function as needed during use.

[0199] 2. Turn off the rear selfie function

[0200] The process of turning off the rear Selfie function is similar to the above-mentioned turning on process. The difference is that the turning on process is to switch the rear Selfie switch 907 from the off state to the on state, while the turning off process is to switch the rear Selfie switch 907 from the on state to the off state. It will not be repeated here.

[0201] It should be noted that the above description uses the folding screen mobile phone in the folded state as an example to explain the process of turning on and off the rear selfie function. When the folding screen mobile phone is in the unfolded state, the rear selfie function can also be turned on or off. The operation process and the interface change process are similar to the above process and will not be repeated. In addition, in this embodiment, the rear selfie setting interface 906 is entered through the camera setting interface 904 to turn on or off the rear selfie function. In other embodiments, the rear selfie setting interface 906 can also be entered by other means. For example, the rear selfie setting interface 906 can be entered through the setting application of the folding screen mobile phone. This application does not impose any limitation on this.

[0202] In this embodiment, the user can independently set the rear selfie function to be on or off as needed to meet the usage requirements of different scenarios, facilitate user operation, and improve user experience.

[0203] 2. Display of rear selfie controls and flip camera controls

[0204] As shown in Figure 5 (a) above, when the rear-facing selfie function is on, the photo preview interface 901 includes a rear-facing selfie control 902. In another embodiment, the photo preview interface 901 may also include a flip camera control 909. When the user clicks the flip camera control 909, the user enters the front-facing selfie scene, and the photo preview interface 1501 for the front-facing selfie scene is displayed (the same interface as shown in Figure 2 (d)). The front-facing selfie scene refers to the scene of taking a selfie using the front camera. For details about the photo preview interface 1501, please refer to Figure 13 (b) in the subsequent embodiments. In other words, in this embodiment, the photo preview interface 901 may include both controls for entering the rear-facing selfie and controls for entering the front-facing selfie. In this way, the user can choose between the rear-facing selfie and the front-facing selfie according to their needs, which is convenient for the user and improves the user experience.

[0205] In another embodiment, when the foldable screen mobile phone displays the photo preview interface 901 on the main screen, the user can use a preset gesture to call out the flip camera control 909. For example, Figure 6 is a schematic diagram of an example of the process of calling out the flip camera control provided in an embodiment of the present application. As shown in Figure 6 (a), when the foldable screen mobile phone is in the folded state and the rear selfie function is turned on, the camera application is started and the photo preview interface 1901 is displayed.

[0206] The photo preview interface 1901 includes a rear selfie control 902, and an arrow mark 1902 is displayed above the rear selfie control 902. Optionally, the user can click the arrow mark 1902 or swipe up on the rear selfie control 902. In response to the user's operation, the foldable screen mobile phone displays a capsule 1903 in the area where the rear selfie control 902 was originally located, as shown in Figure 6 (b). Capsule 1903 includes the rear selfie control 902 and the flip camera control 909, and the user can choose to click according to needs.

[0207] If the user does not select a control in capsule 1903 after capsule 1903 is displayed for a preset time, that is, the user does not operate capsule 1903 within the preset time, capsule 1903 is hidden and the interface is restored to the photo preview interface 1901, as shown in Figure 6 (c).

[0208] In this embodiment, the user can call out the capsule through a preset operation, and choose to click the rear selfie control 902 or the flip camera control 909 in the capsule to control the camera to enter the rear selfie function or the front selfie scene. In this way, on the one hand, the user can choose the rear selfie or the front selfie according to the usage needs, which is convenient for the user to use and improves the user experience; on the other hand, when the user does not perform the preset gesture, the front selfie scene is not displayed in the interface, which facilitates the arrangement of the controls in the interface, prevents the controls in the interface from being too crowded and affecting the user operation, and further improves the user experience.

[0209] 3. Flip wake-up settings

[0210] In an embodiment of the present application, when the rear selfie function is turned on, the camera application of the foldable screen mobile phone may also have a "flip wake-up rear selfie function" (referred to as the flip wake-up function). The flip wake-up function is off by default, and the user can manually turn on the function. After the flip wake-up function is turned on, when the user performs the flip wake-up operation according to the flip wake-up requirements, that is, the user lifts the phone to face the face and looks at the screen, and then the user flips the phone and lifts the phone to face the face. The foldable screen mobile phone recognizes the face through the front camera, detects that the user flips the phone through the sensor, and then recognizes the face through the rear camera, triggering the camera application to automatically enter the rear selfie function.

[0211] The setting process of the flip wake-up function is similar to that of the rear selfie function, which is briefly described below with reference to the accompanying drawings.

[0212] 1. Turn on the flip wake-up function

[0213] For example, Figure 7 is a schematic diagram of the interface changes during the setup process of the flip wake-up function provided in an embodiment of the present application. As shown in Figure 7 (a), when the foldable screen mobile phone is in the folded state, after the camera application is launched, the user can enter the rear selfie setting interface 906 by following the process shown in Figures 5 (a) to (c). The specific process is shown in the embodiment shown in Figure 5 and will not be repeated here.

[0214] As shown in Figure 7 (a), the rear selfie switch 907 in the rear selfie setting interface 906 is now in the on state and highlighted. The rear selfie setting interface 906 includes a switch control (referred to as the flip wakeup switch) 1001 for flipping to wake up the rear selfie function. The flip wakeup switch 1001 is in the off state by default and is grayed out. The user clicks the flip wakeup switch 1001, and the foldable screen phone responds to the user's operation, turning on the flip wakeup function, and the flip wakeup switch 1001 is highlighted, as shown in Figure 7 (b).

[0215] Afterwards, the user performs two return operations, and the foldable screen mobile phone exits the rear selfie setting interface 906 and the camera setting interface 904 in succession, and restores the display of the photo preview interface 901, as shown in Figure 7 (c).

[0216] 2. Turn off the flip wake function

[0217] The process of turning off the flip wake-up function is similar to the above-mentioned turning on process. The difference is that the turning off process is to switch the flip wake-up switch 1001 from the on state to the off state, which will not be repeated here.

[0218] In this embodiment, the user can independently set the flip wake-up function to be on or off as needed to meet the user's different usage habits, meet the user's needs in different usage scenarios, facilitate user operation, and improve user experience.

[0219] 4. Enabling the rear selfie function

[0220] When the rear-mounted selfie function is turned on, the user can enter the rear-mounted selfie function through the corresponding operation when using the camera application. After entering the rear-mounted selfie function, the main screen of the folding screen mobile phone goes out, the secondary screen lights up, the folding screen mobile phone obtains the image through the rear camera, and displays the photo preview interface 1106 (also called the fourth preview interface) on the secondary screen. The photo preview interface 1106 includes the image obtained by the rear camera. In other words, the photo preview interface 1106 is the photo preview interface in the rear-mounted selfie scenario, that is, the photo preview interface when using the rear-mounted selfie function. When the folding screen mobile phone displays the photo preview interface 1106, the user can take a selfie through the rear camera after flipping the phone. The image quality and effect obtained by the selfie are better, which improves the user experience. Moreover, when using the rear-mounted selfie function, the user can perform selfie-related operations through the secondary screen, which is convenient to use and further improves the user experience.

[0221] In the embodiment of the present application, multiple ways of entering the rear selfie function are provided, which are described below in combination with the scenarios.

[0222] 1. Click the rear selfie control to enter the rear selfie function

[0223] As mentioned above, the rear selfie function of the foldable screen mobile phone is turned on by default when it leaves the factory. When the user starts the camera application of the foldable screen mobile phone, the foldable screen mobile phone starts the photo preview interface 901 by default, and the user can enter the rear selfie by clicking the rear selfie control in the photo preview interface 901.

[0224] For example, FIG8 is a schematic diagram of the interface changes when clicking the rear selfie control to enter the rear selfie function according to an embodiment of the present application. As shown in FIG8 (a), when the foldable screen mobile phone is in the folded state, the secondary screen of the foldable screen mobile phone is in the off state, the main screen is in the on state, and the main screen displays the main interface 1101.

[0225] It should be noted that, generally, when the folded phone is in the main screen state, the user will turn the main screen side of the foldable phone toward the user and the secondary screen side (i.e., the side with the rear camera) away from the user. This example is used in the embodiments of the present application to illustrate the situation before and after the user flips the foldable phone.

[0226] Home screen 1101 includes a camera application icon 1102. A user taps camera application icon 1102 (tapping the camera application icon is also referred to as a second operation) to trigger the launch of the camera application. In response to the user's tap, the foldable phone captures an image through the rear camera by default, and displays a photo preview interface 901 on the home screen, as shown in FIG8(b).

[0227] The user clicks on the rear selfie control 902 in the photo preview interface 901. In response to the user's operation, the foldable screen mobile phone displays a flip guide interface 1105 through the main screen, as shown in Figure 8 (c). The flip guide interface 1105 is used to guide the user to flip the foldable screen mobile phone so that the side where the secondary screen is located (i.e., the side where the rear camera is located) faces the user and the side where the main screen is located faces away from the user. Optionally, the flip guide interface 1105 may include a text prompt message 1151, an arrow 1152 indicating the flip direction, and a foldable screen mobile phone schematic 1153. Optionally, the flip guide interface 1105 may continuously display multiple foldable screen mobile phone schematics 1153 at different angles to present a dynamic picture of the flipped mobile phone, so as to more clearly guide the user to flip the phone and improve the user experience. Optionally, the text prompt message 1151 may be, for example, "Please flip the phone and use the rear selfie."

[0228] After the flip guide interface 1105 is displayed for a preset time (for example, 3 seconds), the camera application enters the rear selfie function. Specifically, the folding screen mobile phone turns off the main screen and controls the secondary screen to light up. At the same time, the image is obtained through the rear camera, and the photo preview interface 1106 is displayed on the secondary screen. The photo preview interface 1106 includes the image obtained by the rear camera. After the user flips the folding screen mobile phone, the side where the secondary screen is located (that is, the side where the rear camera is located) faces the user, and the side where the main screen is located faces away from the user. In this way, the user's own image (that is, the selfie image) obtained by the rear camera can be displayed in the photo preview interface 1106, as shown in Figure (d) of Figure 8.

[0229] Optionally, in some other embodiments, when the main screen displays the flip guide interface 1105, the secondary screen may light up simultaneously, capture an image through the rear camera, and display a photo preview interface 1106 on the secondary screen. In other words, after the user clicks the rear selfie control, the secondary screen displays the flip guide interface 1105, lights up, and displays the photo preview interface 1106 on the secondary screen.

[0230] Optionally, while the secondary screen displays the flip guide interface 1105, the foldable screen mobile phone can block the touch function of the main screen and the secondary screen. That is, the touch function of the main screen and the secondary screen is blocked within a preset time (for example, 3 seconds) after the user clicks the rear selfie control 902. This can prevent users from accidentally touching the screen and improve the user experience.

[0231] The photo preview interface 1106 includes a photo control 1107. When the user clicks the photo control 1107, the electronic device saves the image captured by the rear camera.

[0232] Optionally, the shooting modes supported by the rear-mounted selfie function may include photo mode, video mode, portrait mode, night scene mode, etc. As a possible implementation, after the user enters the rear-mounted selfie function through the above process, the default shooting mode is the same as the shooting mode before entering the rear-mounted selfie function, that is, the shooting mode in the photo preview interface 1106 is the same as the shooting mode in the photo preview interface 901. This can inherit the user's selection and improve the user experience. Of course, after entering the rear-mounted selfie function, the user can also switch the shooting mode to another mode as needed.

[0233] Optionally, when a user first launches the camera app on a foldable phone, a guide message may be displayed in the photo preview interface 901 to guide the user in using the rear-mounted selfie function, making it easier for the user to understand how to use the rear-mounted selfie function and improving the user experience. The process of a user first launching the camera app on a foldable phone can be shown in FIG9 . FIG9 differs from FIG8 in that FIG9 (b) displays a photo preview interface 1103 , which also includes a guide message 1104 . Guide message 1104 is used to guide the user into the rear-mounted selfie function via the rear-mounted selfie control 902 . Optionally, guide message 1104 may be displayed in the form of a bubble, card, or capsule. Guide message 1104 may include prompt text or a prompt image to introduce the rear-mounted selfie function. For example, in FIG9 (b), guide message 1104 may include a prompt image (a selfie of a person) and prompt text such as "Use the rear-mounted selfie super-sensitive portrait lens to take better portraits."

[0234] 2. Flip the phone to wake up the rear selfie function

[0235] As mentioned above, the camera app of a foldable phone can have a flip-to-wake rear selfie function. When both the flip-to-wake rear selfie function and the rear selfie function are enabled at the same time, the foldable phone can automatically detect the user's operation. If it detects that the user has performed a flip-to-wake operation, the camera app automatically enters the rear selfie function. This eliminates the need for the user to perform operations such as clicking on the rear selfie control in the interface, allowing for quick and convenient access to the rear selfie function, improving the phone's intelligence and, in turn, the user experience. This is explained below with reference to the accompanying figures.

[0236] For example, FIG10 is a schematic diagram of the interface changes in the process of waking up the rear selfie by flipping a mobile phone provided in an embodiment of the present application. As shown in FIG10 (a), when the folding screen mobile phone is in the folded state, the secondary screen of the folding screen mobile phone is in the off state, and the main screen is in the bright screen state. When the camera application of the folding screen mobile phone is started and the rear selfie function is turned on but not entered, the main screen displays the photo preview interface 901. At this time, the side where the main screen of the folding screen mobile phone is facing the user, and the side where the secondary screen is facing away from the user.

[0237] If the user wants to use the rear-mounted selfie function, the user performs a flip-to-wake operation, lifts the foldable screen phone, and faces the main screen of the foldable screen phone while looking at the screen. The user then flips the foldable screen phone so that the side with the secondary screen faces the user and the side with the main screen faces away from the user. During this process, the foldable screen phone recognizes the face through the front camera and detects that the user flipped the phone through the sensor. After that, the rear camera recognizes the face and the camera application directly enters the rear-mounted selfie function. The foldable screen phone controls the main screen to turn off, the secondary screen to light up, and displays the photo preview interface 1106 on the secondary screen, as shown in Figure 10 (b).

[0238] When the user wants to exit the rear-mounted selfie function, the user can reverse the above process (referred to as the flip exit operation) by lifting the foldable screen phone so that the secondary screen of the foldable screen phone is facing the face and the user looks at the screen. Then, the foldable screen phone is flipped over so that the side with the main screen faces the user and the side with the secondary screen faces away from the user. The foldable screen phone recognizes the face through the rear camera, detects that the user flips the phone, and recognizes the face through the front camera. It directly exits the rear-mounted selfie function, the secondary screen turns off, the main screen turns on, and the photo preview interface 901 is displayed on the main screen, as shown in Figure 10 (a).

[0239] 3. Enter the rear selfie function through the desktop shortcut menu (also known as the desktop long press menu shut cut)

[0240] In this embodiment, when the rear selfie function is turned on, the user can also directly enter the rear selfie function through the desktop shortcut menu, without the user having to open the photo preview interface 901 or click the rear selfie control in the photo preview interface 901, thereby simplifying the user's operation process of entering the rear selfie function and improving the user experience.

[0241] For example, Figure 11 is a schematic diagram of the interface changes during the process of accessing the rear selfie function through the desktop shortcut menu provided in an embodiment of the present application. When the foldable screen mobile phone is in the folded state, the secondary screen of the foldable screen mobile phone is in the off state, the main screen is in the on state, and the main screen displays the main interface 1101, as shown in Figure 11 (a).

[0242] The main interface 1101 includes a camera application icon 1102. When the user long-presses the camera application icon 1102, the foldable screen phone responds to the user's operation by displaying a mask in the interface and a shortcut menu (also called a first service card) 1301 for the camera application, as shown in Figure 11 (b).

[0243] The shortcut menu 1301 includes a selfie option 1302. When the rear selfie function is turned on, the user clicks the selfie option 1302, the foldable screen phone starts the camera application, and displays the flip guide interface 1105 through the main screen, as shown in Figure 11 (c).

[0244] After flipping the navigation interface 1105 and displaying it for a preset period of time, the camera app enters the rear-facing selfie function. Specifically, the foldable phone turns off the main screen and lights up the secondary screen. Simultaneously, the rear camera captures an image, and the secondary screen displays a photo preview interface 1106, which includes the image captured by the rear camera, as shown in Figure 11 (d).

[0245] It should be noted that when the user clicks on the selfie option 1302, if the rear selfie function is turned off, the foldable screen mobile phone starts the camera application, acquires an image through the front camera, and displays the photo preview interface 1501 (also called the third preview interface) through the main screen. The photo preview interface 1501 displays the image acquired by the front camera. The photo preview interface 1501 is a preview interface for the front selfie scene. The front selfie scene refers to the scene of taking a selfie with the front camera. Regarding the photo preview interface 1501, please refer to the interface 1501 in Figure 13 in the subsequent embodiments.

[0246] For example, Figure 12 is a schematic diagram of the interface changes in another example of the process of entering the rear selfie function through the desktop shortcut menu provided by an embodiment of the present application. Continuing from Figure 11 (b), as shown in Figure 12 (a), when the foldable screen mobile phone displays the shortcut menu 1301 of the camera application, the user can also long press and drag the selfie option 1302 to a certain position in the main interface 1101. After the user raises his hand, the desktop shortcut icon (referred to as the selfie shortcut icon, also called the selfie icon) 1401 of the selfie function is displayed at the position where the hand is raised, as shown in Figure 12 (b).

[0247] With the rear-mounted selfie function enabled, the user taps selfie shortcut icon 1401. The foldable phone responds to the user's action by launching the camera app and displaying a flip guide interface 1105 on the home screen, as shown in Figure 12(c). After flip guide interface 1105 is displayed for a preset period of time, the camera app enters the rear-mounted selfie function and displays a photo preview interface 1106, as shown in Figure 12(d).

[0248] Similarly, when the user clicks the selfie shortcut icon 1401, if the rear selfie function is turned off, the foldable screen mobile phone obtains the image through the front camera and displays the photo preview interface 1501 through the main screen. The photo preview interface 1501 includes the image obtained through the front camera.

[0249] 4. Enter the rear selfie function from the front selfie scene

[0250] When the foldable phone is folded and the rear-facing selfie function is off, the camera app can enter the front-facing selfie scene. In the front-facing selfie scene, the user can turn on the rear-facing selfie function again. After the rear-facing selfie function is turned on, the foldable phone directly guides the user to flip the phone, after which the camera app automatically enters the rear-facing selfie function without the user having to return to the photo preview interface or click the rear-facing selfie control, improving user convenience and further enhancing the user experience.

[0251] Optionally, when the rear selfie function is turned off, the user can enter the front selfie scene by clicking the selfie option 1302 shown in Figure 11 above, or enter the front selfie scene by clicking the selfie shortcut icon 1401 shown in Figure 12 above.

[0252] Optionally, the user can also enter the front selfie scene by flipping the camera control in the photo preview interface 908. The following describes the process of entering the front selfie scene and entering the rear selfie function from the front selfie scene in conjunction with the accompanying drawings.

[0253] Exemplarily, Figures 13 and 14 are schematic diagrams of interface changes in a process of entering a rear selfie function from a front selfie scene provided in an embodiment of the present application, wherein Figure (a) in Figure 14 follows Figure (d) in Figure 13 .

[0254] As shown in Figure 13 (a), the foldable screen phone is in the folded state, the secondary screen of the foldable screen phone is in the off state, and the main screen is in the bright state. When the rear selfie function is turned off, after the camera application of the foldable screen phone is launched, the main screen displays the photo preview interface 908, which includes the image captured by the rear camera.

[0255] The photo preview interface 908 also includes a flip camera control 909. When a user clicks on the flip camera control 909, the foldable screen phone responds to the user's operation by switching from the rear camera to the front camera, capturing an image through the front camera, and displaying the photo preview interface 1501 on the main screen. For example, if a user selects portrait mode in the front-facing selfie mode, the foldable screen phone displays the photo preview interface 1501 shown in Figure 13 (b).

[0256] The photo preview interface 1501 includes a settings control 903. A user taps on the settings control 903. In response to the user's action, the foldable phone displays a camera settings interface 904, as shown in FIG13(c). The camera settings interface 904 includes a rear-mounted selfie option 905. A user taps on the rear-mounted selfie option 905. In response to the user's action, the foldable phone displays a rear-mounted selfie settings interface 906, as shown in FIG13(d).

[0257] The rear selfie setting interface 906 includes a rear selfie switch 907. Rear selfie switch 907 is currently off and grayed out. When a user taps rear selfie switch 907, the foldable phone responds to the user's action by turning on the rear selfie function, with rear selfie switch 907 highlighted, as shown in FIG14(a).

[0258] Afterwards, the user performs a return operation. In response to the user's operation, the foldable screen phone exits the rear selfie settings interface 906 and displays the camera settings interface 904 on the main screen, as shown in Figure 14 (b). Then, the user performs another return operation. In response to the user's operation, the foldable screen phone exits the camera settings interface 904 and displays the flip guidance interface 1105 on the main screen, as shown in Figure 14 (c).

[0259] After the flip guide interface 1105 is displayed for a preset time, the camera application enters the rear selfie function. The folding screen mobile phone controls the main screen to turn off and the secondary screen to light up. At the same time, the image is obtained through the rear camera, and the photo preview interface 1106 is displayed through the secondary screen. The photo preview interface 1106 includes the image obtained by the rear camera, as shown in Figure (d) in Figure 14.

[0260] 5. Exit the rear selfie function

[0261] In the embodiment of the present application, the rear selfie function can be exited in a variety of ways, such as a return operation (such as sliding inward from the side of the screen, clicking a return control, or clicking a return key, etc.), automatically turning off the screen in power saving mode, pressing the power button of the mobile phone, clicking the switch home screen control or the flip camera control in the photo preview interface 1106, unfolding the foldable screen mobile phone to the unfolded state, etc. The following are two examples.

[0262] 1. Expand the phone to exit the rear selfie function

[0263] In this embodiment, when using the rear-mounted selfie function, if the user unfolds the foldable screen mobile phone, the camera application exits the rear-mounted selfie function and enters the rear-mounted non-selfie scene in the unfolded state. The rear-mounted non-selfie scene in the unfolded state means that the foldable screen mobile phone obtains an image through the rear camera, and displays the photo preview interface 1801 through the main screen and the sub-screen. The photo preview interface 1801 includes the image obtained by the rear camera. In other words, the photo preview interface 1801 is the photo preview interface in the unfolded state rear-mounted non-selfie scene. The user unfolds the foldable screen mobile phone to the unfolded state, indicating that the user no longer needs the rear-mounted selfie function, and therefore directly enters the unfolded state rear-mounted shooting scene, which is likely to meet the user's usage needs and improve the user experience.

[0264] For example, Figure 15 is a schematic diagram of the interface changes of an unfolded mobile phone during the use of the rear-mounted selfie function provided in an embodiment of the present application. As shown in Figure 15 (a), the user is using the rear-mounted selfie function, and the foldable screen mobile phone displays a photo preview interface 1106 on the secondary screen. The photo preview interface 1106 includes an image captured by the rear camera. At this time, the side of the foldable screen mobile phone where the secondary screen is located (i.e., the side where the rear camera is located) is facing the user, and the side where the main screen is located is facing away from the user.

[0265] The user unfolds the foldable phone, switching it to the unfolded state. In this manner, the main screen and secondary screen of the foldable phone face the user, while the first back housing, the second back housing, and the rear camera face away from the user. In response to the user's operation, the foldable phone continues to capture images through the rear camera. Simultaneously, the secondary screen lights up, and the main and secondary screens jointly display a photo preview interface 1801, which includes the image captured by the rear camera, as shown in FIG15(b).

[0266] Optionally, when the user unfolds the foldable screen phone through the above process and the foldable screen phone enters the unfolded state and the rear camera shooting scene, the default shooting mode is the same as the shooting mode when using the rear selfie function, that is, the shooting mode in the photo preview interface 1801 is the same as the shooting mode in the photo preview interface 1106. This can inherit the user's selection and improve the user experience.

[0267] 2. Click to switch the main screen controls or flip the camera controls to exit the rear selfie function

[0268] While using the rear-camera selfie function, the user can exit the rear-camera selfie function by using the switch home screen control or the flip camera control in the photo preview interface 1106, or by using the switch home screen control in the photo preview interface. After exiting the rear-camera selfie function, the camera application enters the rear-camera non-selfie mode in the folded state, the folding screen turns off the secondary screen, and the photo preview interface 901 is displayed on the main screen. In other words, the user can exit the rear-camera selfie function at any time while using the function, which facilitates user operation and usage and improves the user experience.

[0269] For example, Figure 16 is a schematic diagram of the interface changes when clicking a control to exit the rear selfie function provided in an embodiment of the present application. As shown in Figure 16 (a), the user is using the rear selfie function, and the foldable screen phone displays a photo preview interface 1106 through the secondary screen. The photo preview interface 1106 includes a switch main screen control 2123 and a flip camera control 909. At this time, the side of the foldable screen phone where the secondary screen is located (i.e., the side where the rear camera is located) is facing the user, and the side where the main screen is located is facing away from the user.

[0270] The user clicks the switch home screen control 2123 or the flip camera control 909. In response to the user's operation, the foldable screen phone displays a flip guidance interface 2201 on the secondary screen, as shown in Figure 16 (b). The flip guidance interface 2201 is used to guide the user to flip the foldable screen phone so that the side with the main screen faces the user and the side with the secondary screen (i.e., the side with the rear camera) faces away from the user. Optionally, the flip guidance interface 2201 may include a text prompt 2211, an arrow 2212 indicating the flip direction, and a schematic diagram 2213 of the foldable screen phone. Optionally, multiple schematic diagrams of the foldable screen phone at different angles may be displayed continuously to present a dynamic image of the flipping phone in the flip guidance interface 2201, so as to more clearly guide the user to flip the phone and improve the user experience. Optionally, unlike the text prompt 1941 in Figure 16, the text prompt 2211 in this interface may be, for example, "The rear selfie has exited. Please flip the phone."

[0271] After the flip guide interface 2201 is displayed for a preset period of time, the camera application exits the rear selfie function. Specifically, the foldable screen phone turns off the secondary screen and controls the main screen to light up. At the same time, the rear camera captures images and displays a photo preview interface 901 on the main screen. The photo preview interface 901 includes the image captured by the rear camera. After the user flips the phone, the photo preview interface 901 can display images of people or objects around the user captured by the rear camera, as shown in Figure 16 (c).

[0272] The above embodiments illustrate an example in which the user can independently control the turning on and off of the rear-mounted selfie function. In other embodiments, the rear-mounted selfie function of the electronic device can also be continuously turned on, that is, the rear-mounted selfie function is continuously available. In this case, the user does not need to control the turning on and off of the rear-mounted selfie function; the rear-mounted selfie control and the flip camera control are displayed simultaneously in the photo preview interface. Alternatively, the user can set the default selfie mode to rear-mounted selfie or rear-mounted non-selfie in the camera settings interface, thereby selecting the rear-mounted selfie control or the flip camera control as the default control displayed in the photo preview interface. This allows the interface display to better suit the user's preferences and improve the user experience. Moreover, after displaying one of the two default controls, the user can call up the other, conveniently and quickly selecting between two selfie modes. This is further explained below with reference to the accompanying figures.

[0273] For example, FIG17 is a schematic diagram of an interface change for setting the default selfie mode provided by an embodiment of the present application. As shown in FIG17 (a), continuing to take the external folding screen mobile phone as an example, the folding screen mobile phone is in the folded state, the main screen is in the off state, and the secondary screen is in the bright state. After the camera application is started, it defaults to the rear non-selfie scene. The folding screen mobile phone captures the image through the rear camera and displays the photo preview interface 1901 on the main screen. The photo preview interface 1901 includes the image captured by the rear camera. Optionally, the default selfie mode of the folding screen mobile phone can be the rear selfie. Therefore, the photo preview interface 1901 includes a rear selfie control 902, and an arrow mark 1902 is displayed above the rear selfie control 902. The user can call out capsule 1903 by clicking the arrow mark 1902 or swiping up. The rear selfie control 902 and the flip camera control 909 in capsule 1903 are specifically shown in the embodiment shown in FIG6.

[0274] The photo preview interface 1901 also includes a setting control 903. When the user clicks the setting control 903, the foldable screen mobile phone responds to the user's operation and displays the camera setting interface 2301, as shown in Figure 17 (b). The camera setting interface 2301 includes a setting option for the selfie mode (referred to as the selfie mode option) 2302. The selfie mode currently displayed in this option is the rear selfie. In addition, the camera setting interface 2301 may also include a flip wake-up rear selfie option 2305, and the user can enter the setting interface of the flip wake-up function by clicking on the option 2305. Optionally, the setting interface of the flip wake-up function may be similar to Figure 7 (a) above, except that the setting interface of the flip wake-up function in this embodiment does not include a rear selfie switch.

[0275] The user clicks on the selfie mode option 2302, and the foldable screen mobile phone responds to the user's operation and displays a selfie mode selection pop-up window 2303, as shown in Figure 17 (c).

[0276] Selfie mode selection pop-up window 2303 includes rear-facing selfie options 2313 and front-facing selfie options 2323. Rear-facing selfie option 2313 is currently selected. The user can tap front-facing selfie option 2323 to select the front-facing camera as the default for selfies. In response to the user's action, the foldable phone displays interface 2304, as shown in Figure 17 (d).

[0277] Afterwards, the user closes the selfie mode selection pop-up window 2303 and exits the camera settings interface 2301. The foldable screen phone responds to the user's operation by displaying a photo preview interface 2304 on the main screen, as shown in Figure 17 (e). The photo preview interface includes an image captured by the rear camera and includes a flip camera control 909. An arrow mark 1902 may be displayed above the flip camera control 909.

[0278] Optionally, the user can click on the arrow mark 1902 or swipe up on the flip camera control 909. In response to the user's operation, the foldable screen phone displays a capsule 2306 in the area where the flip camera control 909 was originally located, as shown in Figure 17 (f). Similar to Figure 6 (b), capsule 2306 includes the rear selfie control 902 and the flip camera control 909. Unlike capsule 1903, the display positions of the rear selfie control 902 and the flip camera control 909 in the capsule are different. In capsule 1903, the rear selfie control 902 is displayed at the bottom and the flip camera control 909 is displayed at the top. In this embodiment, in capsule 2306, the flip camera control 909 is displayed at the bottom and the rear selfie control 902 is displayed at the top. That is to say, when the rear selfie control 902 is displayed by default in the photo preview interface, the user can swipe up to add the flip camera control 909 to the interface; when the flip camera control 909 is displayed by default in the photo preview interface, the user can swipe up to add the rear selfie control 902 to the interface.

[0279] If the user does not select a control in capsule 2306 after capsule 2306 is displayed for a preset time, that is, the user does not operate capsule 2306 within the preset time, capsule 2306 is hidden and the interface returns to the photo preview interface 2304.

[0280] If the rear-facing selfie function is still available, when the camera app is in the front-facing selfie scene, the photo preview interface can also include a rear-facing selfie control to facilitate users to directly click the rear-facing selfie control to enter the rear-facing selfie function.

[0281] For example, Figure 18 is another example of the interface changes during the process of entering the rear-facing selfie function from the front-facing selfie scene provided by an embodiment of the present application. As shown in Figure 18 (a), the foldable screen mobile phone is in the folded state, the main screen is in the bright state, the secondary screen is in the off state, the camera application is activated, and the main screen displays the photo preview interface 2304. The photo preview interface 2304 includes an image captured by the rear camera.

[0282] The photo preview interface 2304 includes a flip camera control 909. The user clicks on the flip camera control 909. In response to the user's operation, the front selfie scene is entered and the photo preview interface 2401 is displayed. The photo preview interface 2401 includes the image obtained by the front camera, as shown in Figure (b) of Figure 18. In addition, the photo preview interface 2401 also includes a rear selfie control 2402 (also called a third control). Optionally, when the folding screen mobile phone detects that it is currently in a dark environment, a prompt message can be displayed at the rear selfie control 2402 to prompt the user to use the rear selfie function. Optionally, the prompt message can be displayed in the form of a bubble or the like for a preset duration. The content of the prompt message can be, for example, "Use the rear super-sensitive lens for selfies for better results".

[0283] The user clicks on the rear selfie control 2402. In response to the user's operation, the foldable screen mobile phone displays the flip guidance interface 1105 through the main screen, as shown in Figure 18 (c).

[0284] After flipping the navigation interface 1105 and displaying it for a preset time, the camera app enters the rear selfie function. Specifically, the foldable phone turns off the main screen and lights up the secondary screen. Simultaneously, the rear camera captures a photo, and the secondary screen displays a photo preview interface 1106, which includes the photo captured by the rear camera, as shown in Figure 18 (d).

[0285] In this embodiment, in the front-facing selfie scenario, the interface includes a rear-facing selfie control, and the user can directly click the control to enter the rear-facing selfie function, which facilitates user operation and improves user experience.

[0286] In another embodiment, when the rear-mounted selfie function is continuously available, the foldable screen mobile phone is in the folded state, the main screen is in the bright screen state, the secondary screen is in the off screen state, the camera application is started, and the main screen displays the photo preview interface 2304 shown in Figure 18 (a), the user can enter the camera settings interface by clicking the setting control in the photo preview interface 2304. In the camera settings interface, the default selfie mode is set to rear-mounted selfie. The user then exits the camera settings interface, and the foldable screen mobile phone displays the flip guide interface 1105. After the flip guide interface 1105 displays for a preset length of time, the camera application enters the rear-mounted selfie function.

[0287] When the rear-camera selfie function continues to be available, when the user enters the rear-camera selfie function through the desktop shortcut menu in the manner of Figure 11 or Figure 12, in response to the user clicking the selfie option 1302 or the selfie shortcut icon 1401, the camera application is started and enters the corresponding photo preview interface according to the default selfie mode set by the user.

[0288] It can be understood that when the rear selfie function continues to be available, the method of entering the rear selfie function through other scenes is the same or similar to the case where the user can set the rear selfie function to be turned on and off, and will not be repeated here.

[0289] It can be seen from the above embodiments that for an outward folding screen mobile phone, when the mobile phone is in a folded state, in response to the user entering the operation of the rear selfie function, the outward folding screen mobile phone can obtain images through the rear camera, control the secondary screen to light up, control the main screen to turn off, and display the photo preview interface 1106 corresponding to the rear selfie function through the secondary screen.

[0290] Specifically, for the external folding screen, referring to the above embodiment, the scene, interface, and running camera before the user enters the rear selfie function, as well as the corresponding operation of entering the rear selfie function can be summarized as shown in Table 1:

[0291] Table 1

[0292] In addition, when the user is using the rear-mounted selfie function to take a photo, in response to the user's operation of exiting the rear-mounted selfie function, the external folding screen mobile phone can exit the current rear-mounted selfie function, control the secondary screen to turn off, control the main screen to turn on, or control the main screen and secondary screen to turn on at the same time, and display the corresponding interface after exiting.

[0293] Among them, for the external folding screen, the user's operation to exit the rear selfie function can be as described in the above embodiment, including: clicking to switch the home screen control, clicking to flip the camera control, flipping to exit, unfolding the external folding screen phone to the unfolded state, etc. Of course, the operation to exit the rear selfie function is not limited to this, for example, it can also include a return operation (such as swiping inward from the side of the screen, clicking the return control or clicking the return button, etc.), automatically turning off the screen in power saving mode, pressing the power button of the phone, etc.

[0294] 6. After entering the rear selfie function, exit the camera application and go to the background

[0295] After entering the rear-camera selfie function using the methods 1, 3, and 4 in "IV. Entering the Rear-Camera Selfie Function" above, if the user exits the camera app and moves it to the background, the foldable phone can retain the memory of the camera app's operation for a preset duration (e.g., 15 minutes). That is, when the user re-activates the camera app within the preset duration, the rear-camera selfie function continues to operate. This eliminates the need for users to repeatedly access the rear-camera selfie function, simplifying operations and improving the user experience.

[0296] For example, FIG19 is a schematic diagram of the interface changes of exiting the camera application during the process of entering the rear-mounted selfie function provided by an embodiment of the present application. As shown in FIG19 (a), the current camera application has entered the rear-mounted selfie function, and the photo preview interface 1106 is displayed on the secondary screen. Afterwards, the user performs the operation of exiting the camera to the background. Among them, the operation of exiting the camera to the background can be, for example: clicking the home button in the three-button navigation bar; after the user performs this operation, the foldable screen mobile phone exits the camera application to the background and displays the main interface (also known as the desktop, main page, etc.). The operation of exiting the camera to the background can also be: swiping up from the bottom of the screen to enter the multitasking interface, and the user clicks on the interface thumbnail of other tasks (applications) in the multitasking interface; after the user performs this operation, the foldable screen mobile phone exits the camera application to the background and displays the interface of other applications. The embodiment of the present application does not impose any restrictions on the operation of exiting the camera to the background.

[0297] Taking the example of a user clicking the home button in the three-button navigation bar, in response to the user's operation, the foldable screen mobile phone controls the secondary screen to turn off and controls the main screen to light up, and displays the main interface 1101 through the main screen, as shown in Figure (b) in Figure 19.

[0298] After performing other operations on the main screen, the user taps the camera app icon 1102 on the main interface 1101 again within a preset time (e.g., 15 minutes). In response to the user's operation, the foldable phone launches the camera app and directly enters the rear-facing selfie function, displaying a flip guide interface 1105, as shown in Figure 19 (c). After the flip guide interface 1105 is displayed for the preset time, the camera app enters the rear-facing selfie function, the foldable phone controls the main screen to turn off, the secondary screen to light up, and the photo preview interface 1106 is displayed on the secondary screen, as shown in Figure 19 (d).

[0299] 7. Viewing images while using the rear selfie function

[0300] In this embodiment, when a user uses the rear-mounted selfie function, they can view the captured image through the image thumbnail in the photo preview interface 1106. The image can be displayed on the secondary screen and supports functions such as favorites, deletion, and zoom display. This allows the user to view the image at any time without exiting the rear-mounted selfie function, which is convenient for the user and improves the user experience.

[0301] Furthermore, when the user unfolds the foldable phone while viewing an image, the image is displayed on both the main and secondary screens, supporting functions such as sharing, saving, editing, and deleting. This means that while viewing an image on the secondary screen, the user can unfold the foldable phone at any time to display the image simultaneously on both the main and secondary screens, enabling large-scale image previews for ease of use and an improved user experience.

[0302] The following is a description with reference to the accompanying drawings.

[0303] For example, Figure 20 is a schematic diagram illustrating changes in the image viewing interface during use of the rear-mounted selfie function provided by an embodiment of the present application. As shown in Figure 20 (a), a user is using the rear-mounted selfie function, and the foldable screen phone displays a photo preview interface 1106 on the secondary screen. The photo preview interface 1106 includes a thumbnail 2101 of the image captured by the user.

[0304] The user clicks on thumbnail 2101, and the foldable screen phone responds to the user's operation by displaying an image preview interface 2102 on the secondary screen. Image preview interface 2102 includes the image corresponding to thumbnail 2101, as shown in Figure 20 (b). In addition, image preview interface 2102 includes a favorites control 2121, a delete control 2126, a switch home screen control 2123, and a return control 2124. The user clicks on the favorites control 2121, and the foldable screen phone adds the image to the favorites. The user clicks on the delete control 2126, and the foldable screen phone deletes the image. The user clicks on the switch home screen control 2123, and the camera app exits the rear-mounted selfie function and enters the rear-mounted non-selfie scene in the folded state. The foldable screen phone displays the photo preview interface 901. The user clicks on the return control 2124, and the foldable screen phone exits the current image preview interface 2102 and resumes displaying the photo preview interface 1106.

[0305] In addition, if the user performs a two-finger zoom operation on the image displayed in the image preview interface 2102, the foldable screen mobile phone will respond to the user's operation and reduce or enlarge the image. Taking the user performing a two-finger zoom operation as an example, the foldable screen mobile phone may display the enlarged image on the secondary screen as shown in Figure 20 (c). The two-finger zoom operation can be, for example, a two-finger pinch operation.

[0306] In another embodiment, when the foldable screen mobile phone displays the interface shown in Figure 20 (b), if the user unfolds the foldable screen to the unfolded state, the main screen and the sub-screen simultaneously display the image preview interface 2103, as shown in Figure 20 (d).

[0307] The above method provided by the present application is described using an external folding screen mobile phone as an example. In some other embodiments, the above method can also be applied to an internal folding screen mobile phone.

[0308] When the inward-folding screen mobile phone implements the functions described in the above embodiments, unlike the outward-folding screen mobile phone, the inward-folding screen, when in the unfolded state, displays the interface of the main screen of the above-mentioned outward-folding screen mobile phone in the folded state through the first inner display and the second inner display. When the camera application enters the rear-mounted selfie function, the first inner display and the second inner display go off, and the outer display lights up, and the photo preview interface under the rear-mounted selfie function is displayed on the outer display. In addition, in the above embodiments, the interface change triggered by unfolding the outward-folding screen mobile phone to the unfolded state can be triggered by folding the inward-folding screen mobile phone to the folded state.

[0309] For example, Figure 21 is a schematic diagram of the interface changes when entering the rear selfie function on an inward-folding screen mobile phone according to an embodiment of the present application. As shown in Figure 21 (a), when the inward-folding screen mobile phone is in the unfolded state, the first inner display and the second inner display of the inward-folding screen mobile phone are both in the bright screen state, the outer display is in the dark screen state, and the first inner display and the second inner display display display a photo preview interface 2205. The photo preview interface 2205 includes a rear selfie control 2202.

[0310] The user taps rear-mounted selfie control 2202. In response to the user's action, the inward-folding screen phone displays a flip guide interface 2203 via both the first and second inner displays, as shown in FIG21(b). The content of flip guide interface 2203 can be similar to that of flip guide interface 1105, except that the structure of inward-folding screen phone schematic 2213 is different.

[0311] After the flip guide interface 2203 is displayed for a preset time (for example, 3 seconds), the camera application enters the rear selfie function. Specifically, the first inner display screen and the second inner display screen of the inner folding screen mobile phone are turned off, and the outer display screen is controlled to light up. At the same time, photos are obtained through the rear camera, and the photo preview interface 2204 is displayed through the outer display screen. The photo preview interface 2204 includes photos obtained by the rear camera. After the user flips the inner folding screen mobile phone, the side where the outer display screen is located (that is, the side where the rear camera is located) faces the user, and the side where the first inner display screen and the second inner display screen are located faces away from the user. In this way, the user's own photos (that is, selfie photos) obtained by the rear camera can be displayed in the photo preview interface 2204, as shown in Figure (c) of Figure 21.

[0312] Similar to the external folding screen, for the internal folding screen, the user's operations to enter the rear selfie function may include: clicking the rear selfie control, flipping the wake-up operation, clicking the selfie option in the shortcut menu, clicking the selfie shortcut icon, turning on the rear selfie switch in the front selfie scene, etc.

[0313] When a user is using the rear-mounted selfie function to take a photo, in response to the user's operation of exiting the rear-mounted selfie function, the inward folding screen mobile phone can exit the current rear-mounted selfie function, control the outer display screen to turn off, control the first inner display screen and the second inner display screen to light up, or control the outer display screen to remain on and control the first inner display screen and the second inner display screen to turn off, and display the corresponding interface after exiting.

[0314] Similar to the external folding screen, for the internal folding screen, the user's operations to exit the rear selfie function may include: clicking to switch the internal screen controls, clicking to flip the camera controls, flipping to exit the operation, folding the internal folding screen phone to the folded state, returning to the operation, automatically turning off the screen in power saving mode, pressing the power button of the phone, etc.

[0315] It is understandable that whether it is an outward-folding screen mobile phone or an inward-folding screen mobile phone, or other electronic devices with a folding screen, when taking pictures based on the rear-mounted selfie function, the software system and hardware structure of the electronic device need to cooperate with each other to achieve the camera conversion, screen switching, interface display, etc. described in the above embodiments. The following will be combined with the structure of the electronic device to explain the specific process of the photo-taking method provided by the embodiment of the present application inside the electronic device.

[0316] First, the hardware structure and software architecture of the electronic device are introduced. It is understood that the photography method provided in the embodiments of the present application can be applied to any electronic device with a foldable screen and a camera application, and is not limited to foldable screen mobile phones, such as foldable screen tablets. The specific hardware structure of the electronic device can be seen in the embodiment shown in Figure 33 below.

[0317] Next, the software system of the electronic device is introduced. The software system of the electronic device can adopt a layered architecture, event-driven architecture, micro-kernel architecture, microservice architecture or cloud architecture. The embodiment of the application takes the Android system with a layered architecture as an example to exemplarily describe the software system of the electronic device.

[0318] As shown in Figure 22, a software system using a layered architecture is divided into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, namely, from top to bottom, the application layer 210, the application framework layer 220, the hardware abstraction layer 230, and the driver layer 240. In the embodiments of the present application, for ease of description, the layer above a certain layer in the software system is called the upper layer, and the layer below a certain layer is called the bottom layer.

[0319] The application layer 210 may include a camera application. In addition, the application layer 210 may also include applications such as gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc., which are not shown in Figure 22.

[0320] The application framework layer 220 provides an application access interface and a programming framework for the applications of the application layer 210 .

[0321] As shown in FIG. 22 , in an embodiment of the present application, the application framework layer 220 may include a display framework, a folding state management framework, a camera framework, a touch framework, and the like.

[0322] Optionally, the display framework is used to control the display of the interface and the switching of the screen (i.e., the display screen). It should be noted that when the display framework controls the screen switching, the screen display state can be switched synchronously with the touch capability. That is to say, the display framework not only controls the display state of the screen, but also controls the touch capability of the screen. Among them, the display state may include an off-screen state and a bright-screen state. Optionally, for an external folding screen mobile phone, when one of the main screen and the secondary screen is in an off-screen state, the screen in the off-screen state may not have touch capability. For an internal folding screen mobile phone, when the inner display screen (including the first inner display screen and the second inner display screen) and one of the outer display screen are in an off-screen state, the screen in the off-screen state may not have touch capability.

[0323] In this embodiment, the display framework may include a window manager (window manager), an activity manager service (AMS), a display manager service (display manager service), and the like.

[0324] A window manager, also known as a window management service (WMS), manages windowed programs. It can obtain the display size, determine whether a status bar is present, lock the screen, and take screenshots.

[0325] The AMS manages all activities within an application, also known as processes. The AMS monitors all activities and has the ability to schedule their lifecycles.

[0326] It is understood that the window manager and the AMS cooperate with each other to realize the interface display. Optionally, the window manager and the AMS can simultaneously manage multiple window programs and multiple activities to realize the display of multiple groups of display content in the interface, for example, realizing the display of display content 0, display content 1, etc.

[0327] The display management service is used to control the switching of screens. In this embodiment, the electronic device is a folding screen device, which may include multiple screens, or include one screen, and the one screen can be divided into multiple parts. Therefore, the display management service may include management modules for multiple screens, each management module being used to manage one screen or a part of a screen. In addition, when controlling the display status of the screen, screen switching can be controlled from several aspects, such as logical display, display device, virtual display, and virtual device. Based on this, as shown in Figure 22, in one embodiment, the display management service may include modules such as logical display 0, display device 0, virtual display 1, and virtual device 1.

[0328] The folding state management framework is used to monitor and manage the folding form of the electronic device, the shooting scene and the target display state of the screen. The target display state of the screen is the state that needs to be displayed after the screen needs to switch the display state. The target display state may include the screen off state (also referred to as the screen off) and the screen on state (also referred to as the screen on). As described in the above embodiment, the folding form may include a folding state, an unfolded state and a stand state. The shooting scene refers to the scene in which the user uses the camera of the electronic device when shooting. The shooting scene may include a rear selfie scene (also referred to as the first shooting scene), a front selfie scene, a rear non-selfie scene (also referred to as the second shooting scene), a collaborative shooting scene, etc.

[0329] Optionally, the folding state management framework may include a sensor service module and a folding screen manager. The sensor service module is configured to monitor the angle and posture information between the first and second structural members based on sensor data provided by the underlying layer (the hardware abstraction layer 230 and / or the driver layer 240). Optionally, the sensor service module may include a posture sensor service unit, a hinge sensor service unit (also known as an angle sensor service unit), and a Hall sensor service unit.

[0330] The folding screen manager is used to monitor and manage the states related to the folding screen in the electronic device, including the folding form, shooting scene, and the target display state of the screen and the camera usage state determined according to the folding form and shooting scene. Among them, the camera usage state represents the folding form of the electronic device and the corresponding shooting scene under the folding form. Optionally, taking an external folding screen mobile phone as an example, the camera usage state may include the rear selfie scene in the folded state (referred to as the folded rear selfie state), the rear non-selfie scene in the folded state (referred to as the folded rear non-selfie state), the front selfie scene in the folded state (referred to as the folded front selfie state), the collaborative shooting scene in the folded state (referred to as the folded collaborative state), the rear non-selfie scene in the unfolded state (referred to as the unfolded rear non-selfie state), the front selfie scene in the unfolded state (referred to as the unfolded front selfie state), the front selfie scene in the stand state (referred to as the stand front selfie state) and the rear non-selfie scene in the stand state (referred to as the stand rear non-selfie state).

[0331] Taking the inward-folding screen mobile phone as an example, the camera usage states may include folded rear-camera non-selfie state, folded front-camera selfie state, unfolded front-camera selfie state, unfolded rear-camera non-selfie state, rear-camera selfie scene in the unfolded state (referred to as unfolded rear-camera selfie state), collaborative shooting scene in the unfolded state (referred to as unfolded collaborative state), stand-front selfie state and stand-rear non-selfie state, etc.

[0332] Optionally, the folding screen manager may include a posture state module and a state decision module. The posture state module is used to obtain the posture information of the electronic device from the sensor service module, and determine the folding form of the electronic device based on the posture information. The posture information may include angle information, posture information, opening and closing information, etc. The state decision module is used to obtain the folding form from the posture state module, the shooting scene obtained from the camera application of the application layer, and decide the camera usage state and the target display state of the display screen based on the folding form and the shooting scene. Optionally, the state decision module can obtain or send the state obtained by decision to other modules in the software architecture, for example, sending the target display state to the display management service, sending the camera usage state to the camera framework and the touch framework, sending the folding form to the camera application of the application layer, etc.

[0333] The camera framework provides access interfaces for camera-related functions and services to enable camera capabilities such as shooting, previewing, and mirroring. Optionally, the camera framework may include a system service module, a rear-mounted selfie service unit, and a camera service module. The system service module acts as a proxy for the hardware camera service, managing the hardware camera. The rear-mounted selfie service unit manages the rear-mounted selfie-related functions of the camera application when other applications call the camera application and use the rear-mounted selfie function, such as enabling or disabling the rear-mounted selfie function in other applications. In one specific embodiment, when the camera usage state changes, the system service module sends a command to the rear-mounted selfie service unit upon determining that the camera usage state has entered or exited the folded rear-mounted selfie state, causing the rear-mounted selfie service unit to enable or disable the rear-mounted selfie function for other applications. The camera service unit transmits camera control commands and data stream-related parameters provided by the camera application to the hardware abstraction layer 230 to enable camera capabilities such as shooting, previewing, and mirroring.

[0334] The touch framework is used to manage the touch status of the electronic device screen. In a specific embodiment, the touch framework can block the touch function of the screen for a preset time (e.g., 3 seconds) when entering or exiting the rear selfie function based on the camera usage status sent by the state decision module in the folding screen manager to prevent the user from accidentally touching it. The details are described in detail in the subsequent embodiments. Among them, blocking the touch function is also called touch screen hiding (touch screen hid).

[0335] In addition to the above modules, the application framework layer 220 may also include a content provider, a view system, a phone manager, a resource manager, a notification manager, etc., which are not shown in the figure.

[0336] The hardware abstraction layer 230 is used to abstract the hardware. In the embodiment of the present application, the hardware abstraction layer 230 may include a display hardware abstraction layer, an angle detection algorithm module, and a camera hardware abstraction layer.

[0337] The display hardware abstraction layer can include an interface layer composition system (surface flinger) and a hardware overlay (HWC). The surface flinger is used to provide the composition and display capabilities of the interface view layer. The hardware overlay, also known as the hardware mixing renderer, is used to synthesize layers received from the interface layer composition system (surface flinger), thereby reducing the amount of synthesis performed by the 3D graphics processing library (for example: OpenGL ES) and the graphics processing unit (GPU). The hardware mixing renderer can abstract objects such as overlays and 2D block transfers to synthesize layers, and communicate with the window composition hardware to synthesize windows.

[0338] The angle detection algorithm module is used to process the data collected by the sensor of the driving layer according to a preset algorithm to obtain the angle data of the first structural member and the second structural member of the folding screen.

[0339] The camera hardware abstraction layer is also called a camera provider, etc. In an embodiment of the present application, the camera hardware abstraction layer may include a rear camera device and a front camera device. On the one hand, the camera hardware abstraction layer is used to process images based on a preset algorithm to generate a photo data stream, a preview data stream, a video data stream, etc. On the other hand, in the case where the camera application has a gesture photo function, the camera hardware abstraction layer may also be integrated with a gesture recognition algorithm. When the user performs a gesture photo, the user gesture is recognized by the gesture recognition algorithm, and the gesture recognition result is reported. Thirdly, the camera hardware abstraction layer can also be used to report the screen fill light data, gesture recognition results, etc. obtained by the hardware layer to the upper layer.

[0340] The driver layer 240 is used to provide drivers for various hardware devices in the hardware layer of the electronic device. In the embodiment of the present application, the driver layer may include display drivers, sensor drivers, and camera drivers.

[0341] Among them, the sensor driver may include an angle sensor driver, a gyroscope sensor, a hall sensor driver, and a touch sensor driver, etc. The touch sensor driver is also called a touch panel (TP) driver. The camera driver may include a rear camera driver and a front camera driver. The angle sensor driver is used to provide a driver for the angle sensor of the hardware layer to detect the angle data between the first structural member and the second structural member of the electronic device. The angle sensor may include, for example, an acceleration sensor, a hinge sensor, etc. The gyroscope sensor is used to provide a driver for the gyroscope sensor of the hardware layer to detect the motion posture of the electronic device. The hall sensor driver is used to provide a driver for the hall sensor of the hardware layer. The touch sensor driver is used to provide a driver for the touch sensor of the hardware layer. The rear camera driver is used to provide a driver for the rear camera of the hardware layer. The front camera driver is used to provide a driver for the front camera of the hardware layer.

[0342] Optionally, the electronic device may include one or more rear cameras. If the electronic device includes multiple rear cameras, the rear camera driver may include one, which drives the multiple rear cameras. The rear camera driver may also include multiple, each rear camera driver corresponding to a rear camera. The same applies to the front camera and its driver, and will not be further described.

[0343] The following is an exemplary description of the workflow of the software system of the electronic device shown in FIG. 22 .

[0344] 1. Status management process

[0345] Referring to FIG. 23 , the electronic device's monitoring and management process for the folding configuration, target display state, and camera usage state can be shown in FIG. 23 , including the following steps S101 to S114 . It should be noted that steps S101 and S114 can be executed continuously, i.e., after the electronic device is powered on, it will execute the following steps to achieve continuous monitoring and management of the state.

[0346] S101 : The sensor driver of the driver layer 240 provides drivers to the sensors of the hardware layer to obtain sensor data.

[0347] Specifically, each sensor in the hardware layer, driven by the drive sensor, collects sensor data and sends the collected data to the sensor driver. The angle sensor collects the angle data between the first structural member and the second structural member and transmits it to the angle sensor driver. The attitude sensor (such as a gyroscope sensor) collects the motion attitude data of the electronic device (referred to as attitude data) and transmits it to the attitude sensor driver. The Hall sensor collects the opening and closing data between the first structural member and the second structural member and transmits it to the attitude sensor driver.

[0348] Specifically, when the electronic device is in a folded state, the angle data between the first structural member and the second structural member collected by the angle sensor is 0°; the motion posture data collected by the posture sensor is "stationary state"; and the opening and closing data of the first structural member and the second structural member detected by the Hall sensor is "completely fitted state".

[0349] When a user unfolds or folds an electronic device, when the electronic device is in a stand state, the angle data between the first structural member and the second structural member collected by the angle sensor is "greater than 0° and less than 180°"; the motion posture data collected by the posture sensor is "motion state"; and the opening and closing data of the first structural member and the second structural member detected by the Hall sensor is "incomplete fitting state".

[0350] If the electronic device is in a bracket state and stationary, the angle data between the first structural member and the second structural member collected by the angle sensor is "greater than 0° and less than 180°"; the motion posture data collected by the posture sensor is "stationary state", and the opening and closing data of the first structural member and the second structural member detected by the Hall sensor is "incomplete fitting state".

[0351] When the electronic device is in the unfolded state, the angle data between the first structural member and the second structural member collected by the angle sensor is 180°; the motion posture data of the posture sensor can be "stationary state"; and the Hall sensor detects that the first structural member and the second structural member are in the "open state".

[0352] S102 : The sensor driver sends the sensor data to the sensor service module of the application framework layer 220 .

[0353] Specifically, the angle sensor driver transmits the angle data to the angle detection algorithm module of the hardware abstraction layer 230. The angle algorithm module processes the angle data according to a preset algorithm to obtain processed angle data. The angle algorithm module then transmits the angle information to the hinge sensor service unit in the sensor service module.

[0354] The attitude sensor driver transmits attitude data to the attitude sensor service unit. The Hall sensor driver transmits opening and closing data to the Hall sensor service unit.

[0355] S103: The sensor service module processes the sensor data and generates posture information.

[0356] As mentioned above, the posture information may include angle information, posture information, and opening and closing information. Specifically, the hinge sensor service unit in the sensor service module can further process the processed angle data to generate angle information that can be recognized and processed by the folding screen manager. The Hall sensor service unit in the sensor service module can process the opening and closing data to generate opening and closing information that can be recognized and processed by the folding screen manager. The posture sensor service unit in the sensor service module can process the posture data to generate posture information.

[0357] S104. The sensor service module sends the posture information to the posture state module in the folding screen manager.

[0358] S105 . The posture state module determines the folding state of the electronic device according to the posture information.

[0359] Specifically, if in the posture information, the angle information is 0°, the posture information is "stationary state", and the opening and closing information is "completely fitted state", the posture module determines that the folding state of the electronic device is the folded state.

[0360] If the angle information in the posture information is "greater than 0° and less than 180°", the posture information is "stationary state" or "moving state", and the opening and closing information is "incompletely fitted state", the posture module determines that the folded form of the electronic device is a stand state.

[0361] If, in the posture information, the angle information is 180°, the posture information is "stationary state", and the opening and closing information is "open state", the posture module determines that the folded state of the electronic device is the unfolded state.

[0362] S106. The posture state module sends the folding state to the state decision module in the folding screen manager.

[0363] S107: When the camera application is started, the state decision module obtains the shooting scene from the camera application of the application layer.

[0364] As described above, the shooting scenes may include rear selfie scenes, front selfie scenes, rear non-selfie scenes, collaborative shooting scenes, etc. The camera application determines the current shooting scene based on the current user's selection and the rules of the camera application operation, and sends the shooting scene to the state decision module.

[0365] S108. The state decision module determines the target display state of the screen and the camera usage state according to the folding form of the electronic device and the shooting scene.

[0366] It can be understood that when the folded state is the stand state, the state decision module can further combine the angle information to determine the screen state.

[0367] Optionally, the shooting scenes supported by the external folding screen mobile phone may include: rear non-selfie scene, front selfie scene, rear selfie scene and collaborative shooting scene, etc. Optionally, the external folding screen mobile phone does not support the rear selfie scene and collaborative shooting scene in the unfolded state and the stand state.

[0368] In one embodiment, the target display state and camera usage state determined by the state decision module for an external folding screen mobile phone in various folding forms and shooting scenarios may be as shown in Table 2.

[0369] Table 2

[0370] It should be noted that Table 2 above shows the target display state of the screen and the camera usage state of the external folding screen mobile phone during the operation of the camera application. When the camera application is not running, the state decision module of the external folding screen mobile phone can also decide the target display state of the screen based solely on the folding form. Specifically, in the folded state, or in the stand state with an angle greater than 0° and less than 45°, the target display state of the screen is: the main screen is on and the secondary screen is off; in the unfolded state, or in the stand state with an angle greater than or equal to 45° and less than 180°, the target display state of the screen is: the main screen and the secondary screen are on at the same time.

[0371] Optionally, the shooting scenes supported by the inward folding screen mobile phone may include: rear non-selfie scene, front selfie scene, rear selfie scene and collaborative shooting scene, etc. Optionally, the inward folding screen mobile phone does not support rear selfie scene and collaborative shooting scene in the folded state and the stand state.

[0372] In one embodiment, for an inward-folding screen mobile phone in various folding forms and shooting scenarios, the target display state and camera usage state determined by the state decision module may be as shown in Table 3.

[0373] Table 3

[0374] Table 3 above shows the target display state of the screen and the camera usage state of the inward folding screen mobile phone during the operation of the camera application. When the camera application is not running, the state decision module of the inward folding screen mobile phone can also decide the target display state of the screen based solely on the folding form. Specifically, in the folded state, or in the stand state with an angle greater than 0° and less than 45°, the target display state of the screen is: the outer display screen is on, and the first inner display screen and the second inner display screen are off; in the unfolded state, or in the stand state with an angle greater than or equal to 45° and less than 180°, the target display state of the screen is: the first inner display screen and the second inner display screen are on, and the outer display screen is off.

[0375] S109: When the camera application is started, the camera application sends a folding state request to the state decision module. The folding state request is used to request the state decision module to send a folding state.

[0376] S110 , the state decision module sends the folding state to the camera application.

[0377] The specific usage scenarios and processes of steps S109 and S110 can be found in steps S401 to S402 of the embodiment shown in Figure 27, and steps S801 to S802 of Figure 30. After the camera application obtains the folded state, it controls the camera to capture images, allocate data, etc. based on the folded state and other parameters to display the photo preview interface. For details, please refer to steps S403 to S425 of Figure 27 and steps S803 to S826 of Figure 30 in the subsequent embodiments.

[0378] S111: When the target display state is different from the current screen display state, the state decision module sends a display state change notification to the display management service of the display framework, wherein the display state change notification carries the target display state.

[0379] The display state change notification is used to notify that the display state of the screen needs to change, that is, the display state of the screen needs to be switched.

[0380] Optionally, the display management service can pre-register a notification callback with the state decision module through an interface, so that the state decision module sends a display state change notification to the display management service when it detects a change in the target display state. Optionally, the display state change notification can include the changed display state of each screen or screen part. For example, the target display state of the main screen after the change is off, and the target display state of the secondary screen after the change is on.

[0381] Taking the foldable phone as an example, if the current display state of the foldable phone is "primary screen on, secondary screen off," and the user unfolds the phone from the folded state to the unfolded state, the state decision module determines, according to Table 2 above, that the target display state is "primary and secondary screens simultaneously on." This is different from the current display state, and the display state needs to be changed. Therefore, the state decision module sends a display state change notification to the display management service. The display state change notification carries the target display state, namely, "primary and secondary screens simultaneously on."

[0382] Taking the inner folding screen as an example, if the current display state of the inner folding screen phone is "the first inner display screen and the second inner display screen are on, and the outer display screen is off", if the user clicks the rear selfie control and the shooting scene changes, the state decision module determines the target display state as "the outer display screen is on, the first inner display screen and the second inner display screen are off" according to Table 3 above. This is different from the current display state and the display state needs to be changed. Therefore, the state decision module sends a display state change notification to the display management service. The display state change notification carries the target display state, that is, "the outer display screen is on, and the first inner display screen and the second inner display screen are off".

[0383] After receiving the display status change notification, the display management service controls the screen switching. For details, see steps S201 to S203 in the subsequent Figure 24.

[0384] S112: When the camera usage status changes, the status decision module sends a camera usage status change notification to the system service module of the camera framework.

[0385] Optionally, the system service module can pre-register a notification callback with the state decision module via an interface (e.g., the E interface). This allows the state decision module to send a camera state change notification to the system service module upon detecting a change in the camera state. Optionally, the camera state change notification can include the changed camera state.

[0386] Optionally, after receiving the state change notification, the system service module can determine the changed camera usage state carried in the state change notification and determine whether to enter the folded rear-camera selfie state or exit the folded rear-camera selfie state. That is, the system service module determines whether the camera usage state has changed from another state to the folded rear-camera selfie state, or from the folded rear-camera selfie state to another state. If so, the system service module sends an instruction to the rear-camera selfie service unit, instructing the rear-camera selfie service unit to enable or disable the rear-camera selfie function of other applications. In short, the camera usage state change notification is used by the system service module to control other applications to enable or disable the rear-camera selfie function.

[0387] S113: When the camera usage status changes, the folding screen decision module sends a camera usage status change notification to the touch control framework of the application framework layer 220. The camera usage status change notification carries the changed camera usage status.

[0388] After the touch framework receives the notification of camera usage changes, it triggers the anti-accidental touch function when the conditions are met. Specifically, referring to FIG. 23 , the implementation process of the anti-accidental touch function includes the following steps:

[0389] S114. The touch frame sends an anti-mistouch enable instruction to the touch sensor driver of the driving layer 240 based on the notification of the change in camera usage status. When it is determined that the camera usage status has changed from other states to the folded rear selfie state, or from the folded rear selfie state to other states, the anti-mistouch enable instruction is used to instruct to enable the anti-mistouch function for the screen.

[0390] Specifically, taking an external folding screen mobile phone as an example, when the folding form of the external folding screen mobile phone is in the folded state, before the user enters the rear selfie function, the camera usage state is the folded rear non-selfie state. After the user enters the rear selfie function, the camera usage state changes to the folded rear selfie state. In this case, the anti-mistouch module sends an anti-mistouch turn-on instruction to the touch sensor driver, and the anti-mistouch turn-on instruction is used to indicate that the touch function of the main screen and the sub-screen is blocked for a preset period of time. That is to say, when the camera application enters the rear selfie function, the touch frame sends an anti-mistouch turn-on instruction to the touch sensor. The preset time length can be 3s, for example.

[0391] Optionally, the anti-accidental touch activation instruction may also instruct to activate the anti-accidental touch function for a portion of the screen, for example, to activate the anti-accidental touch function only for the main screen or the secondary screen.

[0392] S115 : The touch sensor driver responds to the false touch prevention activation instruction and activates the false touch prevention function for the screen.

[0393] It can be understood that the electronic device continuously monitors the target display status, camera usage status and folding form according to the above steps S101 to S108, and when these states change again, executes step S116 and the above steps S111, S112 and S113.

[0394] S116: When the folding form changes, the state decision module sends a folding form change notification to the camera application of the application layer 210. The folding form change notification carries the changed folding form.

[0395] Optionally, the camera application may pre-register a notification callback with the state decision module through an interface, so that the state decision module sends a folding state change notification to the camera application when detecting a change in the folding state of the electronic device.

[0396] During the use of the rear-mounted selfie function, if the camera application receives a notification of a change in folding state, the camera application determines that the folding state has changed from a folded state to an unfolded state, and determines that the rear-mounted selfie function needs to be exited. Therefore, the camera application regenerates the preview stream mirror parameters, regenerates the distribution parameters, and reconfigures the algorithm (i.e., re-distributes the stream) and updates the photo preview interface, etc. For details, please refer to Figure 31 and will not be repeated here.

[0397] When the rear selfie function is not used, if the camera application receives a notification of a folding state change, the camera application determines that the selfie scene has not changed, and thus only controls the update of the photo preview interface. For details, see Figure 32 and will not be repeated here.

[0398] In short, the camera application can notify the control algorithm flow switching and control the update of the photo preview interface according to the changes in the folding shape.

[0399] 2. Display management process

[0400] Referring to FIG. 24 , when using a camera application, the electronic device may manage the display of the screen as shown in FIG. 24 , including:

[0401] S201. In response to a display state change notification, the display management service in the display framework of the application framework layer 220 sends a display state switch notification (also known as a screen switch instruction) to the display hardware abstraction layer in the hardware abstraction layer 230. The display state change notification carries a target display state. The display state switch notification is used to instruct the screen to switch to the target display state.

[0402] Optionally, the display state switching notification may carry the target display state.

[0403] As described in step S111 of the embodiment described in FIG. 23 , when the target display state changes, the state decision module in the folding screen manager sends a display state change notification to the display management service.

[0404] The electronic device monitors the target display state of the screen in real time. When the target display state changes, indicating that the screen needs to switch display states, the state decision module sends a display state change notification. After receiving the display state change notification, the display management service further notifies the display hardware abstraction layer and sends a display state switch notification to the display hardware abstraction layer.

[0405] For example, when a user unfolds a foldable phone from a folded state to an unfolded state, the state decision module sends a display state change notification to the display management service. This notification carries the target display state, meaning "both the primary and secondary screens are on simultaneously." In response, the display management service sends a display state switch notification to the display hardware abstraction layer, carrying the target display state.

[0406] S202 : The display hardware abstraction layer sends a display state switching notification to the display driver in the driver layer 240 .

[0407] S203 : The display driver provides a driver to the corresponding screen in response to the display state switching notification, so as to switch the display state of the screen to the changed display state.

[0408] Continuing with the example of a foldable screen mobile phone, after receiving the display status switching notification carrying the message "the main screen and the secondary screen are on at the same time", the display driver drives the main screen and the secondary screen so that the main screen and the secondary screen are on at the same time.

[0409] It should be noted that, while driving the corresponding screen display interface, the display driver can also drive the touch capability of the screen.

[0410] It can be understood that the above steps S201 to S203 are triggered by the display status change notification and can be executed at any stage of screen display. For example, they can be executed in parallel with the following steps S204 to S209.

[0411] S204 : The camera application of the application layer 210 creates a process according to the operation requirements.

[0412] Optionally, the camera application creates a process in response to a user's startup operation. The startup operation may be clicking the camera application icon, clicking an option in the camera application shortcut menu, or clicking a shortcut icon on the desktop, etc., which is not limited in this embodiment of the present application.

[0413] It is understood that this embodiment mainly describes the process of the camera application controlling the underlying interface display. In fact, after the camera application creates the process, it can also perform other operations, such as sending a folding state request to the state decision module to obtain the folding state, etc. For details, please refer to steps S109 and S110 in Figure 23, as well as steps S402 in Figure 27 and step S802 in Figure 30 in the subsequent embodiments. Other processes besides the interface display are not described in detail here.

[0414] S205 : The camera application sends interface display instructions to the AMS and the window manager in the display framework of the application framework layer 220 respectively based on the established process.

[0415] Specifically, the camera application runs based on the established process and receives user operations, decides the windows and interfaces to be displayed and the screen on which the interfaces need to be displayed according to the user operations, and then sends interface display instructions to the AMS and the window manager.

[0416] In the photo-taking scenario, as described above, the camera application can subscribe to the folding state from the state decision module. When the folding state changes, the state decision module notifies the camera application of the changed folding state. The camera application can decide the screen that needs to display the interface based on the folding state. The information of the screen that needs to display the interface is simply referred to as screen information. For example, in the case of an external folding screen, when the rear selfie function has been entered, if the state decision module notifies that the folding state changes to the unfolded state, the camera application can decide to switch screens, that is, the secondary screen goes out and the main screen lights up. The main screen is the screen that needs to display the interface, and the camera application carries the information of the main screen into the interface display instruction and sends it to the AMS and the window manager. The specific process will be further elaborated in subsequent embodiments.

[0417] S206 : The AMS and the window manager send the interface display instruction to the display hardware abstraction layer of the hardware abstraction layer 230 .

[0418] S207: The display hardware abstraction layer performs layer synthesis and rendering according to the interface display instruction.

[0419] S208 : The display hardware abstraction layer sends the interface display instruction and the layer obtained by synthesis and rendering to the display driver of the display driver layer 240 .

[0420] S209: The display driver displays the interface on the screen in response to the interface display instruction.

[0421] Specifically, the display driver displays the interface to be displayed on the currently lit screen.

[0422] 3. Camera management process

[0423] Referring to FIG. 25 , when a user uses a camera application, the electronic device may manage the camera as shown in FIG. 25 , including:

[0424] S301 : The camera application of the application layer 210 creates a process in response to a camera start operation by a user.

[0425] This step may be the same as the above-mentioned step S204.

[0426] S302: The camera application generates a capture request, preview stream mirror parameters, and stream configuration parameters based on the created process and the running requirements.

[0427] A capture request (also called an image acquisition request) is used to request that a camera capture an image. Optionally, the capture request may include information about the camera used to capture the image. Optionally, the camera information may be represented by a number or other identifier. For example, a camera information value of 1 indicates that the camera used to capture the image is the front-facing camera. A camera information value of 0 indicates that the camera used to capture the image is the rear-facing camera.

[0428] Preview stream mirroring parameters refer to the mirroring parameters required to generate the preview data stream. These parameters may include, for example, whether to mirror horizontally or vertically. Stream configuration parameters, also known as stream allocation parameters, refer to the configuration parameters required to generate the data stream. Data streams include preview data streams, photo data streams, and video data streams. These parameters may include resolution, capture mode, exposure value, image size, and more.

[0429] In an embodiment of the present application, the stream configuration parameters may also carry a flag. The flag is used to identify the type of algorithm to be configured. The algorithm type refers to the type of algorithm used by the underlying layer to process the captured image. Optionally, depending on the camera that captures the image, the algorithm type may include a front algorithm, a rear non-selfie algorithm, and a rear selfie algorithm. The front algorithm is used to process the image captured by the front camera in the front selfie scenario. The rear non-selfie algorithm is used to process the image captured by the rear camera in the rear non-selfie scenario. The rear selfie algorithm is used to process the image captured by the rear camera in the rear selfie scenario.

[0430] In a specific embodiment, the stream configuration parameters may include a post-selfie flag, a pre-selfie flag, and a post-non-selfie flag. Each flag has a corresponding value. A post-selfie flag value of 1 indicates that the post-selfie algorithm needs to be configured, while a post-selfie flag value of 0 indicates that the post-selfie algorithm does not need to be configured. A pre-selfie flag value of 1 indicates that the pre-selfie algorithm needs to be configured, while a pre-selfie flag value of 0 indicates that the pre-selfie algorithm does not need to be configured. If the post-non-selfie flag value is 1, the post-non-selfie algorithm needs to be configured, while a post-non-selfie flag value of 0 indicates that the post-non-selfie algorithm does not need to be configured. For example, if the flag values ​​in the configuration parameters are: the post-selfie flag is 1, the pre-selfie flag is 0, and the post-non-selfie flag is 0, this indicates that the post-selfie algorithm needs to be configured, i.e., the algorithm to be configured is the post-selfie algorithm.

[0431] Optionally, in some other embodiments, the flag bit may be set to a null value to indicate that the corresponding algorithm does not need to be configured.

[0432] Of course, in other embodiments, the flow configuration parameters may only carry flags corresponding to the algorithms to be configured, and the flag values ​​are 1. Algorithms corresponding to flags not carried by the flow configuration parameters do not need to be configured.

[0433] Optionally, the camera application may generate a capture request, preview stream mirroring parameters, and stream configuration parameters based on the shooting mode, shooting scene, and camera information.

[0434] Specifically, the camera application can generate a capture request based on the shooting scene. When the shooting scene is a rear-facing selfie scene, a rear-facing non-selfie scene, or a collaborative shooting scene, the generated capture request carries the rear camera information. When the shooting scene is a front-facing selfie scene, the generated capture request carries the front camera information.

[0435] Optionally, the camera application can generate preview stream mirroring parameters based on the shooting scene and user settings. User settings related to the preview stream mirroring parameters may include whether to enable horizontal mirroring, whether to enable vertical mirroring, etc. For example, when the shooting scene is a rear-facing selfie scene or a front-facing selfie scene, and the user's settings include enabling horizontal mirroring and enabling vertical mirroring, the value of "Whether to Mirror Horizontally" in the preview stream mirroring parameters is "Yes" and the value of "Whether to Mirror Vertically" is "No".

[0436] Optionally, the camera application can generate stream configuration parameters based on the shooting scene, shooting mode, and user settings. User settings related to stream configuration parameters may include image scale, resolution, whether to add a watermark, whether to record geographic location, etc. The camera application generates the corresponding stream configuration parameters based on the current shooting scene, shooting mode, and user settings.

[0437] It is understood that when the camera is started, the camera application can obtain the default shooting scene, shooting mode, and camera information from the configuration file. During camera use, if the user switches shooting modes, changes shooting scenes, or sets shooting parameters, the preview stream mirroring parameters and stream configuration parameters need to be reconfigured.

[0438] For example, when a user clicks to flip the camera control, the shooting scene and shooting mode change. The camera application regenerates the preview stream mirror parameters and stream configuration parameters in response to the user's operation.

[0439] For another example, the user clicks the rear selfie control, the shooting scene changes, and the camera application responds to the user's operation and regenerates the preview stream mirroring parameters and stream configuration parameters.

[0440] S303 : The camera application sends a capture request, preview stream mirroring parameters, and stream configuration parameters to the camera service module in the camera framework of the application framework layer 220 .

[0441] S304 : The camera service module sends the capture request, preview stream mirroring parameters, and stream configuration parameters to the camera hardware abstraction layer of the hardware abstraction layer 230 .

[0442] Specifically, the camera service module can send the capture request and preview stream mirroring parameters to the corresponding camera device based on the camera information carried in the capture request. That is, if the capture request carries information about the front camera, the camera service module sends the capture request and preview stream mirroring parameters to the front camera device in the camera hardware abstraction layer; if the capture request carries information about the rear camera, the camera service module sends the capture request and preview stream mirroring parameters to the rear camera device in the camera hardware abstraction layer.

[0443] Optionally, the camera service module may send the capture request and the preview stream mirror parameters to the camera hardware abstraction layer through a hardware abstraction layer interface definition language (HAL interface definition language, HIDL) interface.

[0444] S305 : The camera hardware abstraction layer sends a capture request to the camera driver of the driver layer 240 .

[0445] Specifically, the front camera device in the camera hardware abstraction layer can send a capture request to the front camera driver in the driver layer 240; the rear camera device in the camera hardware abstraction layer can send a capture request to the rear camera driver in the driver layer 240.

[0446] S306: The camera driver responds to the capture request and drives the corresponding camera to capture images frame by frame.

[0447] S307 : The camera driver sends the captured image to the camera hardware abstraction layer in the hardware abstraction layer 230 .

[0448] S308 : The camera hardware abstraction layer performs mirror processing on the captured image according to the preview stream mirror parameters to obtain a mirrored image.

[0449] Specifically, the camera hardware abstraction layer determines whether to perform horizontal mirroring, vertical mirroring, etc. on the captured image based on the specific values ​​in the preview stream mirroring parameters. If the value of "Whether to Mirror Horizontally" in the preview stream mirroring parameters is "Yes," the camera hardware abstraction layer performs horizontal mirroring on the captured image to obtain a mirrored image. If the value of "Whether to Mirror Vertically" in the preview stream mirroring parameters is "Yes," the camera hardware abstraction layer performs vertical mirroring on the captured image to obtain a mirrored image. If the values ​​of "Whether to Mirror Horizontally" and "Whether to Mirror Vertically" in the preview stream mirroring parameters are both "Yes," the camera hardware abstraction layer performs horizontal and vertical mirroring on the captured image to obtain a mirrored image.

[0450] S309 , the camera hardware abstraction layer configures a preset algorithm according to the stream configuration parameters to obtain a target algorithm, and processes the mirrored image based on the target algorithm to obtain a preview stream.

[0451] Specifically, according to the flag bit with a value of 1 carried in the stream configuration parameter, the corresponding algorithm is configured to obtain the target algorithm. When the value of the post-non-selfie flag bit in the flag bit carried in the stream configuration parameter is 1, the preset post-non-selfie algorithm (also called the second algorithm) is configured according to the specific value in the stream configuration parameter to obtain the target algorithm. When the value of the post-selfie flag bit in the flag bit carried in the stream configuration parameter is 1, the preset post-selfie algorithm (also called the first algorithm) is configured according to the specific value in the stream configuration parameter to obtain the target algorithm. When the value of the pre-selfie flag bit in the flag bit carried in the stream configuration parameter is 1, the preset pre-selfie algorithm is configured according to the specific value in the stream configuration parameter to obtain the target algorithm.

[0452] Based on the target algorithm, the mirrored image is processed to obtain a preview stream. The camera hardware abstraction layer transmits the preview stream to the camera application through the camera framework, and the camera application controls the display of the data stream. I will not go into details here.

[0453] S310: In response to the user clicking the photo control, the camera application sends a photo-taking instruction to the camera service module.

[0454] 8 , the user clicks on the photo control 1107 in the photo preview interface 1106. In response to the user's click, the camera application sends a photo instruction to the camera service module.

[0455] S311. The camera service module sends a photo-taking instruction to the camera hardware abstraction layer.

[0456] S312: The camera hardware abstraction layer saves the current frame image in the preview stream in response to the photo taking instruction.

[0457] For example, Figure 26 is a schematic diagram of the software architecture of another electronic device provided in an embodiment of the present application. Based on the software architecture shown in Figure 22 above, as shown in Figure 26, the camera application may include a startup module, a plug-in manager, a rear selfie module, a camera communication module, and a photo management module.

[0458] The startup module is used to launch the camera application and create a process. The plugin manager is used to load plugins, select shooting modes, and manage the interface display. The rear selfie module is used to control the rear selfie function. The camera communication module is used to communicate with the underlying layer to manage the camera.

[0459] Specifically, the rear selfie module may include a rear selfie function unit and a rear selfie management unit. The rear selfie function unit is responsible for enabling and managing the rear selfie function. The rear selfie management unit is used to determine whether to switch screens, etc. The rear selfie management unit is responsible for communicating with the application framework layer. Optionally, the rear selfie management unit can register the folding screen state with the folding state management framework of the application framework layer. When the folding screen state changes, the folding state management framework sends a folding state change notification to the module.

[0460] The camera communication module may include a camera controller, a mirror parameter generation unit, and a stream parameter generation unit. The camera controller is used to control whether to start or switch the camera. The mirror parameter generation unit is used to generate mirror parameters for the preview stream. The stream parameter generation unit is used to generate stream configuration parameters.

[0461] The photo management module is used to control the storage and management of the captured images.

[0462] The following takes the electronic device as an external folding screen mobile phone as an example, and combines Figure 26 to illustrate the relevant processes of the camera application and the bottom layer to implement the rear selfie function. For the sake of convenience, the camera startup stage, the folding shape change stage, the rear selfie function shooting stage, the exit rear selfie stage, etc. will be described separately. In the following embodiments, the application framework layer, the hardware abstraction layer, and the driver layer are collectively referred to as the bottom layer. The specific implementation of the bottom layer can refer to the embodiments shown in Figures 23 to 25 above, and will not be described in detail.

[0463] 1. Camera startup phase

[0464] For example, Figure 27 is a flowchart of a camera startup phase provided by an embodiment of the present application. In this embodiment, the non-selfie scene of the rear camera in the folded state is used as an example for explanation. As shown in Figure 27, the process includes the following steps S401 to S422:

[0465] First of all, it should be noted that, as described in the embodiment shown in FIG23 above, the electronic device continuously monitors the display status of the screen in accordance with steps S101 to S108 after it is turned on. In the current scenario, the external folding screen mobile phone is in the folded state, the camera application is not started, and the screen display status determined by the relevant modules at the bottom layer is: the main screen is on and the sub-screen is off. The relevant modules at the bottom layer of the electronic device control the display status of the screen to be the main screen on and the sub-screen off in accordance with steps S201 to S203 in the embodiment shown in FIG24.

[0466] S401. When the external folding screen mobile phone is in the folded state, the operation management module of the camera application creates a camera process in response to the user clicking the icon of the camera application.

[0467] Specifically, referring to FIG8 , the user clicks the application icon 1102 on the main interface. In response to the user's click operation, the camera application creates a camera process.

[0468] S402: The operation management module obtains and stores the folded form (folded state) of the electronic device from the bottom layer.

[0469] Specifically, referring to steps S109 to S110 in Figure 23, the operation management module obtains the folding state of the electronic device from the folding state management framework of the application framework layer. In this embodiment, the folding state is the folded state.

[0470] Optionally, the memory may be a memory of a camera application or a memory of an electronic device, and the embodiments of the present application do not impose any limitation on this.

[0471] S403 , the operation management module reads configuration file 1 , in which the shooting mode is the photo mode, the shooting scene is the rear non-selfie scene, and the camera information is the rear camera.

[0472] Optionally, the operation manager reads a camera startup operation configuration file related to the user from the memory in response to the user's camera startup operation.

[0473] Optionally, the configuration file may include information such as shooting mode, shooting scene, camera information (ie, the camera to be started), etc. Of course, in some embodiments, the configuration file may also include user setting information.

[0474] Depending on the camera startup operation performed by the user, the configuration file read by the operation management module can be different, and the values ​​of various types of information in the configuration file can be different. In this embodiment, the user's camera startup operation is to click the camera application icon. The operation management module reads configuration file 1 corresponding to this camera startup operation. Configuration file 1 specifies the shooting mode as photo mode, the shooting scene as rear-facing non-selfie scene, and the camera information as rear-facing camera.

[0475] In some other embodiments, when the user's camera startup operation is to click on the shortcut icon on the desktop or click on an option in the shortcut menu of the camera application, the configuration file read by the operation management module is different depending on the option selected by the user. For example, when the user starts the camera application by clicking on the "Selfie" option in (b) of Figure 11, and the default selfie mode is the rear selfie, the shooting mode in the configuration file read by the operation management module is the photo mode, the shooting scene is the rear selfie scene, and the camera information is the rear camera. For another example, when the user generates a shortcut icon corresponding to the large aperture mode by long pressing and dragging the "Large Aperture" option in (a) of Figure 12, when the user starts the camera application by clicking on the shortcut icon, the shooting mode in the configuration file read by the operation management module is the large aperture mode, the shooting scene is the rear non-selfie scene, and the camera information is the rear camera.

[0476] S404: The operation management module sends a camera control instruction to the camera controller in the camera communication module based on the folding state (folded state) and configuration file 1. The camera control instruction may carry information such as the shooting mode (photo mode), the shooting scene (rear-mounted non-selfie scene), and the camera information (rear-mounted camera).

[0477] The camera control command is used to instruct the camera to capture images and configure preview stream mirroring parameters and stream configuration parameters that match the information carried in the camera control command.

[0478] S405 : The camera controller generates a capture request 1 in response to the camera control instruction according to the camera information (rear camera), where the capture request 1 carries the information of the rear camera.

[0479] S406 : The camera controller sends the capture request 1 to the stream parameter generation unit.

[0480] In other embodiments, the camera controller may also directly send the capture request to the bottom layer. Specifically, the camera controller sends the capture request to the camera service module in the camera framework of the application framework layer.

[0481] S407: The camera controller sends a mirror parameter generation instruction 1 to the mirror parameter generation unit. The mirror parameter generation instruction 1 carries the shooting scene (post-position non-selfie scene).

[0482] Specifically, the camera controller generates a mirror parameter generation instruction 1 based on the shooting scene (rear non-selfie scene) in the camera control instruction, and carries the current shooting scene, i.e., rear non-selfie, in the mirror parameter generation instruction 1. The mirror parameter generation instruction 1 is used to instruct the generation of preview stream mirror parameters that match the rear non-selfie scene.

[0483] S408 : The mirror parameter generation unit generates preview stream mirror parameters 1 matching the post-positioned non-selfie scene in response to the mirror parameter generation instruction 1 .

[0484] S409: The mirroring parameter generation unit sends the preview stream mirroring parameter 1 to the stream parameter generation unit.

[0485] In other embodiments, the mirroring parameter generation unit may also directly send the preview stream mirroring parameter 1 to the bottom layer. Specifically, the mirroring parameter generation unit sends the preview stream mirroring parameter 1 to the camera service module in the camera framework of the application framework layer.

[0486] S410: The camera controller sends a stream parameter generation instruction 1 to the stream parameter generation unit. The stream parameter generation instruction 1 carries a shooting mode (photography mode) and a shooting scene (rear-mounted non-selfie scene).

[0487] Specifically, the camera controller generates a stream parameter generation instruction 1 based on the shooting mode (photo mode) and shooting scene (rear non-selfie scene) in the camera control instruction, and carries the specific values ​​of the shooting mode and shooting scene in the stream parameter generation instruction 1, that is, the photo mode and shooting scene are rear non-selfie scenes.

[0488] The stream parameter generation instruction 1 is used to instruct the generation of stream configuration parameters that match the photo mode and the rear selfie scene.

[0489] S411. The stream parameter generation unit generates a stream configuration parameter 1 that matches the photo mode and the rear non-selfie scene in response to the stream parameter generation instruction 1. The stream configuration parameter 1 carries a rear non-selfie flag with a value of 1.

[0490] Optionally, the stream configuration parameter 1 may also carry a post-selfie flag with a value of 0 and a pre-selfie flag with a value of 0.

[0491] S412: The stream parameter generation unit sends the capture request 1, the preview stream mirror parameter 1, and the stream configuration parameter 1 to the bottom layer.

[0492] S413. The bottom layer responds to capture request 1, captures an image through the rear camera, and mirrors the captured image based on preview stream mirror parameter 1 to obtain a mirrored image; and configures a preset rear non-selfie algorithm according to stream configuration parameter 1 to obtain rear non-selfie algorithm 1, processes the image mirrored by rear non-selfie algorithm 1, and generates a preview stream.

[0493] The specific implementation process of this step can be referred to steps S306 to S309 in the embodiment shown in Figure 25 above, and will not be repeated here.

[0494] S414: The bottom layer returns the preview stream to the plug-in manager.

[0495] The above steps S403 to S414 are the process of generating the preview stream. Before, after, or while executing the above steps S403 to S414, the camera application also loads the plug-in through the following steps S415 to S421. The details are as follows:

[0496] S415: The operation management module sends a plug-in loading instruction to the plug-in manager.

[0497] The plugin loading instruction is used to instruct the loading of a plugin.

[0498] S416 : The plug-in manager responds to the plug-in loading instruction, reads the folding form (folded state) and configuration file 1 , and initializes the basic plug-in according to the folding form (folded state) and the configuration file.

[0499] Basic plugins, also known as init core plugins, are plugins used to implement the basic functions of the camera app. Basic functions include recording, taking photos, and setting functions. Corresponding to basic plugins, the camera app can also include extension plugins. Extension plugins are plugins used to implement extended functions of the camera app. Extended functions include rear-mounted selfie functions, flip-to-wake functions, etc.

[0500] Optionally, the plug-in manager may read data such as the folding form (folded state) and configuration file 1 from the memory.

[0501] S417. The plug-in manager sends a loading request to the rear selfie function unit in the rear selfie module, where the loading request is used to request loading of the rear selfie function.

[0502] S418. The rear selfie function unit determines whether the rear selfie function is available in response to the loading request; if so, execute step S419.

[0503] Optionally, the rear selfie function unit may determine whether the current electronic device supports the rear selfie function. If it is determined that the electronic device supports the rear selfie function, it may further determine whether the rear selfie function is enabled. If the rear selfie function is enabled, it may be determined that the rear selfie function is available.

[0504] S419. The rear selfie function unit sends an instruction message for loading the rear selfie function to the plug-in manager.

[0505] S420: The plug-in manager obtains resources of the rear-mounted selfie function from the rear-mounted selfie function unit in response to the instruction message.

[0506] The resources of the rear selfie function may include, for example, resources of the rear selfie control, etc.

[0507] S421. The plug-in manager refreshes the layout of the photo preview interface according to the folding form, configuration file, resources of the rear selfie function, and preview stream, and loads controls, including the rear selfie control.

[0508] Afterwards, the camera application can call the underlying display framework to display the interface and perform the following steps:

[0509] S422: The plug-in manager sends an interface display instruction to the bottom layer.

[0510] S423: The bottom layer responds to the interface display instruction and displays the photo preview interface 901 on the main screen according to the layout of the photo preview interface, loaded controls, and preview stream.

[0511] The specific implementation process of this step can be found in steps S206 to S209 in Figure 24 above, and will not be repeated here.

[0512] The photo preview interface 901 can be seen in FIG8 (b).

[0513] After that, the user can click the camera control to take a photo and perform the following steps:

[0514] S424: The photo management module sends a photo instruction to the bottom layer in response to the user clicking the photo control in the photo preview interface 901.

[0515] S425: The bottom layer saves the current frame image in the preview stream in response to the photo taking instruction.

[0516] This step can be referred to steps S311 to S312 in FIG. 25 above, and will not be described in detail.

[0517] 2. Enter the stage of rear selfie function

[0518] 1) Enter the rear selfie function in non-selfie scenes

[0519] Referring to Table 1, Figures 8 and 10 above, in the rear non-selfie scenario, the user can enter the rear selfie function by clicking the rear selfie control or by a flip wake-up operation. In this embodiment, clicking the rear selfie control to enter the rear selfie function (Figure 8) is used as an example for explanation.

[0520] 28 , continuing with step S422 above, when the external folding screen mobile phone is in the folded state, the main screen is on, the secondary screen is off, and the main screen displays the photo preview interface 901, the camera application and the underlying layer can enter the rear selfie function according to the following process:

[0521] S501 . In response to a user clicking on the rear-mounted selfie control 902 , the rear-mounted selfie function unit in the rear-mounted selfie module sends a rear-mounted selfie entry instruction to the rear-mounted selfie management unit.

[0522] The rear selfie entry instruction is used to instruct to enter the rear selfie function. Specifically, referring to FIG8 (b) above, the user can click the rear selfie control 902.

[0523] Optionally, the user can trigger the rear-mounted selfie function by performing a flip wake-up operation. Specifically, the rear-mounted selfie function unit can subscribe to the flip wake-up notification from the module responsible for the flip wake-up function in the foldable screen mobile phone. When the user performs the flip wake-up operation, the module notifies the rear-mounted selfie function unit, which then sends a rear-mounted selfie entry instruction to the rear-mounted selfie management unit.

[0524] S502: The rear selfie management unit sends a scene switching notification 1 (switching to the rear selfie scene) to the plug-in manager in response to the rear selfie entry instruction.

[0525] The scene switching notification 1 is used to notify the plug-in manager that the shooting scene has changed. Optionally, the scene switching notification 1 carries the switched shooting scene, that is, the rear selfie scene.

[0526] S503: The plug-in manager sends a stream allocation instruction 1 (carrying a rear selfie scene) to the mirror parameter generation unit in the camera communication module in response to the scene switching notification 1.

[0527] The stream allocation instruction 1 is used to instruct the configuration of preview stream mirror parameters and stream configuration parameters. Optionally, the stream allocation instruction 1 can carry the switched shooting scene (ie, the post-selfie scene).

[0528] S504 : The mirror parameter generation unit generates preview stream mirror parameters 2 that match the post-selfie scene in response to the stream matching instruction 1 .

[0529] S505: The mirroring parameter generation unit sends the preview stream mirroring parameter 2 to the stream parameter generation unit.

[0530] S506. The mirror parameter generation unit sends a stream allocation instruction 1 (carrying a post-selfie scene) to the stream parameter generation unit.

[0531] S507: The stream parameter generation unit generates stream configuration parameters 2 that match the post-selfie scene and the shooting mode (photography mode) before switching in response to the stream configuration instruction 1. The stream configuration parameters 2 carry a post-selfie flag with a value of 1.

[0532] It is understood that after receiving configuration instruction 1, the stream parameter generation unit determines that the configuration instruction 1 does not carry relevant information about the shooting mode, and then uses the previous shooting mode to generate the stream configuration parameters. In this way, after entering the post-selfie function, the user's selection can be inherited, improving the user experience. If the post-selfie function does not support the shooting mode before switching, a default shooting mode can be set according to a preset rule, and the stream configuration parameters are generated according to the default shooting mode.

[0533] S508: The stream parameter generation unit sends the preview stream mirroring parameter 2 and the stream configuration parameter 2 to the bottom layer.

[0534] S509. The bottom layer mirrors the image captured by the rear camera based on the preview stream mirror parameter 2 to obtain a mirrored image; and configures the preset rear selfie algorithm according to the stream configuration parameter 2 to obtain the rear selfie algorithm 1. The mirrored image is processed based on the rear selfie algorithm 1 to generate a preview stream.

[0535] It should be noted that, in this embodiment, the camera is not controlled to be flipped, so the rear camera continues to capture images, and step S509 processes the images captured by the rear camera.

[0536] The specific implementation process of this step can be found in steps S306 to S309 in Figure 25 above.

[0537] S510. The bottom layer monitors the change in the camera usage status and determines that the display status of the screen needs to be changed. Therefore, the screen is switched, the main screen is turned off, the secondary screen is turned on, and the anti-accidental touch function of the main screen and the secondary screen is turned on for a preset time.

[0538] Specifically, in this embodiment, because the user clicked the rear-mounted selfie control, the shooting scene changed, and the target display state of the screens was determined to be: the secondary screen was on, and the primary screen was off. Since the current display state of the screens was: the primary screen was on, and the secondary screen was off, it was determined that the display state needed to be switched. Control was then controlled to switch the screens. Furthermore, it was determined that the camera usage state had changed from the folded rear-mounted non-selfie state to the folded rear-mounted selfie state, and control was controlled to enable the accidental touch protection function for both the primary and secondary screens, which lasted for a preset duration.

[0539] For the specific implementation of "determining that the display status of the screen needs to be changed" in this step, please refer to steps S101 to 108 and S111 in Figure 23 above; for the specific implementation of "controlling the switching of screens, turning off the main screen and lighting up the secondary screen", please refer to steps S201 to S203 in Figure 24 above; for the specific implementation of "turning on the anti-mistouch function for a preset period of time for the main screen and secondary screen", please refer to steps S112 to S114 in Figure 23 above, which will not be repeated here.

[0540] It should be noted that before turning off the main screen, the camera application can also display a flip guide interface 1105 (also called the first interface) on the main screen through the underlying display framework, etc. Optionally, the flip guide interface disappears after being displayed for a preset duration (e.g., 3 seconds), and the main screen turns off. Specifically, when displaying the flip guide interface 1105, the rear-mounted selfie management module can send an interface display request to the plug-in manager. The interface display request is used to request the display of the flip guide interface 1105. In response to the interface display request, the plug-in manager layouts the flip guide interface and sends an interface display instruction to the underlying layer. In response to the interface display instruction, the underlying layer displays the flip guide interface 1105 on the main screen. The specific process here can be seen in steps S205 to S209 in Figure 24. In other embodiments of the present application that enter the rear-mounted selfie function, the flip guide interface 1105 can also be displayed according to this process, which will not be repeated here. The flip guide interface 1105 can be seen in Figure (c) of Figure 8 above.

[0541] S511. The bottom layer feeds back the screen switching result (main screen turns off, secondary screen turns on) and preview stream to the plug-in manager of the camera application.

[0542] S512. After receiving the screen switching result, the plug-in manager filters and selects the required modes and functions according to scene switching notification 1 (switching to the rear selfie scene), refreshes the photo preview interface layout, and updates the controls. The updated controls include the flip camera control and the switch home screen control.

[0543] Specifically, after entering the rear-camera selfie function, some camera functions and modes can be blocked. For example, if the rear-camera selfie function does not support the large aperture mode, the plug-in manager will block the large aperture mode controls and options when laying out the photo preview interface.

[0544] S513: The plug-in manager sends an interface display instruction to the bottom layer.

[0545] S514. The bottom layer responds to the interface display instruction and displays the photo preview interface 1106 on the secondary screen according to the refreshed photo preview interface layout and the updated controls.

[0546] The photo preview interface 1106 can be seen in FIG8 (d).

[0547] In this embodiment, when entering the rear selfie scene from the rear non-selfie scene, there is no need to switch the camera instruction. The scene switching instruction 1 is used to instruct the image obtained by the rear camera to perform relevant processing of the rear non-selfie, thereby realizing the rear selfie function and eliminating the camera switching process, thereby improving the algorithm operation efficiency.

[0548] 2) Enter the rear selfie function in the front selfie scene

[0549] Referring to Table 1, Figures 13, 14, and 18 above, in the front-facing selfie scenario, the user can access the rear-facing selfie function by turning on the rear-facing selfie function switch, clicking the rear-facing selfie control, or setting the default selfie mode to the rear-facing selfie. In this embodiment, the user clicking the rear-facing selfie control 2402 (Figure 18) in the photo preview interface 2401 is used as an example for description.

[0550] 29 , when the external folding screen mobile phone is in the folded state, the main screen is on, the secondary screen is off, and the main screen displays the photo preview interface 2401, the camera application and the underlying layer can enter the rear selfie function according to the following process:

[0551] S601. In response to a user clicking on the rear-mounted selfie control 2402, the rear-mounted selfie function unit in the rear-mounted selfie module sends a rear-mounted selfie entry instruction to the rear-mounted selfie management unit.

[0552] For details, please refer to Figure (b) in Figure 18, where the user clicks on the rear selfie control 2402 in the photo preview interface 2401.

[0553] S602. The rear selfie management unit sends a camera switching instruction to the camera controller in the camera communication module in response to the rear selfie entry instruction. The camera switching instruction carries the camera information (rear camera) and the shooting scene (rear selfie scene).

[0554] The camera switching command is used to instruct the user to switch the camera to the rear camera, capture images through the switched camera, and configure preview stream mirroring parameters and stream configuration parameters that match the information carried in the camera switching command.

[0555] S603: The camera controller generates a capture request 2 in response to the camera switching instruction. The capture request 2 carries information about the rear camera.

[0556] S604: The camera controller sends the capture request 2 to the stream parameter generation unit.

[0557] S605: The camera controller sends a mirror parameter generation instruction 2 to the mirror parameter generation unit. The mirror parameter generation instruction 2 carries a shooting scene (rear-mounted selfie scene).

[0558] S606 : The mirror parameter generation unit generates preview stream mirror parameters 3 matching the post-selfie scene in response to the mirror parameter generation instruction 2 .

[0559] S607: The mirroring parameter generation unit sends the preview stream mirroring parameter 3 to the stream parameter generation unit.

[0560] S608. The mirror parameter generation unit sends a stream parameter generation instruction 2 to the stream parameter generation unit. The stream parameter generation instruction 2 carries the shooting scene (post-selfie scene).

[0561] S609: The stream parameter generation unit generates stream configuration parameters 3 matching the post-selfie scene in response to the stream parameter generation instruction 2. The stream configuration parameters 3 include a post-selfie flag, and the value of the post-selfie flag is 1.

[0562] S610: The stream parameter generation unit sends the capture request 2, the preview stream mirror parameter 2, and the stream configuration parameter 2 to the bottom layer.

[0563] S611. The bottom layer responds to capture request 2, switches the camera to the rear camera, captures an image through the rear camera, and mirrors the captured image based on preview stream mirror parameter 1 to obtain a mirrored image; and configures the preset rear selfie algorithm according to stream configuration parameter 2 to obtain rear selfie algorithm 2 and generate a preview stream.

[0564] S612. The bottom layer monitors the change in the camera usage status and determines that the display status of the screen needs to be changed. Therefore, the screen is switched, the main screen is turned off, the secondary screen is turned on, and the anti-mistouch function of the main screen and the secondary screen is turned on for a preset time.

[0565] S613: The bottom layer feeds back the screen switching result and preview stream to the plug-in manager of the camera application.

[0566] S614: The camera controller sends a layout adjustment request to the plug-in manager, where the layout adjustment request is used to request adjustment of the interface layout.

[0567] S615: The plug-in manager responds to the layout adjustment request, filters and selects the required modes and functions, refreshes the photo preview interface layout, and updates the controls. The updated controls include a flip camera control and a home screen switch control.

[0568] S616: The plug-in manager sends an interface display instruction to the bottom layer.

[0569] S617: The bottom layer responds to the interface display instruction and displays the photo preview interface 1106 on the secondary screen according to the refreshed photo preview interface layout and the updated controls.

[0570] The above steps S609 to S612 and S615 to S617 are similar to steps S508 to S512 in the embodiment shown in FIG. 28 , and are not described again.

[0571] The main difference between this embodiment and the embodiment shown in Figure 28 is that this embodiment uses the rear-facing selfie function in the front-facing selfie scenario, which requires switching cameras. Therefore, the rear-facing selfie management unit sends a camera switching instruction to the camera controller, instructing it to switch cameras and re-assign streams.

[0572] In this embodiment, when entering the rear selfie scene from the front selfie scene, the camera switching is achieved through the camera switching instruction, that is, the front camera is switched to the rear camera, and the image obtained by the rear camera is processed related to the rear non-selfie, thereby realizing the rear selfie function.

[0573] 3) Access the rear selfie function through the quick menu without starting the camera

[0574] Referring to Table 1, Figures 11 and 12 above, when the camera application is not started and the rear-mounted selfie function is turned on (or continuously available), the user can start the camera and directly enter the rear-mounted selfie function by clicking the selfie option in the shortcut menu or clicking the selfie shortcut icon. This embodiment is described by taking the example of a user clicking the selfie shortcut icon to start the camera.

[0575] For example, FIG30 is a flowchart of a camera startup phase provided in an embodiment of the present application. As shown in FIG30 , the process includes:

[0576] S801. When the external folding screen mobile phone is in the folded state, the operation management module of the camera application creates a camera process in response to the operation of clicking the selfie shortcut icon.

[0577] In the current scenario, the underlying related modules control the display status of the screen as follows: the main screen is on and the secondary screen is off.

[0578] Specifically, referring to FIG. 12 ( b ), the user may click on the selfie shortcut icon 1401 .

[0579] S802: The operation management module obtains and stores the folded form (folded state) of the electronic device from the bottom layer.

[0580] S803 , the operation management module reads configuration file 2 , in which the shooting mode is portrait mode, the shooting scene is a rear selfie scene, and the camera information is a rear camera.

[0581] The main difference between Profile 2 and Profile 1 is that the shooting scene in Profile 2 is the rear-facing selfie scene, while the shooting scene in Profile 1 is the rear-facing non-selfie scene. In addition, when the camera application directly enters the rear-facing selfie function after startup, a default shooting mode can be set. This embodiment of the application uses the default "Portrait Mode" as an example. Therefore, the shooting mode in Profile 2 is Portrait Mode.

[0582] S804: The operation management module sends a rear selfie entry instruction to the rear selfie function unit in the rear selfie module according to the folding state (folded state) and configuration file 2. The rear selfie entry instruction may carry the folding state (folded state) and configuration file 2.

[0583] S805. The rear-mounted selfie function unit sends a rear-mounted selfie entry instruction to the rear-mounted selfie management unit.

[0584] S806: The rear selfie management unit sends a camera control instruction to the camera controller in the camera communication module in response to the rear selfie entry instruction. The camera control instruction carries the shooting mode (portrait mode), the shooting scene (rear selfie scene), and the camera information (rear camera).

[0585] S807: The camera controller generates a capture request 3 in response to the camera control instruction. The capture request 3 carries information about the rear camera.

[0586] S808. The camera controller sends the capture request 3 to the stream parameter generation unit.

[0587] S809: The camera controller sends a mirror parameter generation instruction 3 to the mirror parameter generation unit. The mirror parameter generation instruction 3 carries a shooting scene (rear selfie scene).

[0588] The mirror parameter generation instruction 3 is used to instruct the generation of preview stream mirror parameters that match the rear selfie scene.

[0589] S810: The mirror parameter generation unit generates preview stream mirror parameters 4 matching the rear selfie scene in response to the parameter generation instruction 3.

[0590] S811. The mirroring parameter generation unit sends the preview stream mirroring parameter 4 to the stream parameter generation unit.

[0591] S812: The camera controller sends a stream parameter generation instruction 3 to the stream parameter generation unit. The stream parameter generation instruction 3 carries the shooting scene (post-selfie scene).

[0592] S813. The stream parameter generation unit generates stream configuration parameters 4 that match the post-selfie scene and portrait mode in response to the stream parameter generation instruction 3. The stream configuration parameters 4 include a post-selfie flag, and the value of the post-selfie flag is 1.

[0593] S814. The stream parameter generation unit sends the capture request 3, the preview stream mirroring parameter 4, and the stream configuration parameter 4 to the bottom layer.

[0594] S815. The bottom layer responds to the capture request 3, captures an image through the rear camera, and mirrors the captured image based on the preview stream mirror parameter 4 to obtain a mirrored image. The bottom layer configures the preset rear selfie algorithm according to the stream configuration parameter 4 to obtain the rear non-selfie algorithm 3, processes the image mirrored based on the rear selfie algorithm 3, and generates a preview stream.

[0595] S816. Monitoring a change in the camera usage status and determining that the screen display status needs to change, thereby controlling screen switching, turning off the main screen and turning on the secondary screen, and enabling an anti-accidental touch function for the main screen and the secondary screen for a preset time.

[0596] S817: The bottom layer returns the preview stream to the plug-in manager.

[0597] S818. The operation management module sends a plug-in loading instruction to the plug-in manager.

[0598] S819 . The plug-in manager responds to the plug-in loading instruction, reads the folding form and configuration file, and initializes the core plug-in (init core plugins) according to the folding form and configuration file.

[0599] S820. The plug-in manager sends a loading request to the rear selfie function unit in the rear selfie module, where the loading request is used to request loading of the rear selfie function.

[0600] S821. The rear selfie function unit determines whether the rear selfie function is available in response to the loading request; if so, execute step S822.

[0601] S822. The rear selfie function unit sends an instruction message for loading the rear selfie function to the plug-in manager.

[0602] S823: The plug-in manager obtains resources of the rear-mounted selfie function from the rear-mounted selfie function unit in response to the instruction message.

[0603] S824. The plug-in manager refreshes the layout of the photo preview interface according to the folding form, configuration file, resources of the rear selfie function, and preview stream, and loads controls, including a flip camera control and a home screen switch control.

[0604] S825. The plug-in manager sends an interface display instruction to the bottom layer.

[0605] S826. The bottom layer responds to the interface display instruction and displays the photo preview interface 1106 on the secondary screen according to the layout of the photo preview interface, loaded controls, and preview stream.

[0606] The main difference between the above process and the process shown in the embodiment of Figure 27 is that in this embodiment, the user clicks the selfie shortcut icon to start the camera and enter the rear selfie function. Therefore, the shooting scene in the obtained configuration file is different, and the subsequent configured preview stream mirroring parameters and stream configuration parameters are also different. In this embodiment, the screen status switching will be triggered, etc.

[0607] In this embodiment, when a user clicks the selfie option or selfie icon on the main interface, a camera process is created and, through capture request 3, a request is made to the rear-facing camera to capture an image. A preset rear-facing selfie algorithm is configured based on preview stream mirroring parameters 4 and stream configuration parameters 4 to perform rear-facing selfie-related processing on the image captured by the rear-facing camera, generating a preview stream. The interface is laid out based on the preview stream, and a photo preview interface is displayed. This embodiment enables the rear-facing selfie function to be directly activated when the camera is started, simplifying user operations and facilitating user experience.

[0608] 3. Exit the rear selfie function stage

[0609] As described in the above embodiment, when using the rear-mounted selfie function, the user can exit the rear-mounted selfie function by clicking to switch the home screen control, clicking to flip the camera control, flipping to exit, unfolding the foldable phone to the unfolded state, etc. The following mainly uses clicking to switch the home screen control as an example to illustrate the process of exiting the rear-mounted selfie function.

[0610] 31 , when the external folding screen mobile phone is in the folded state, the main screen is off, the secondary screen is on, and the secondary screen displays the photo preview interface 1106 , the camera application and the underlying layer can exit the rear selfie function according to the following process:

[0611] S701: In response to a user's operation of exiting a rear-mounted selfie function, a rear-mounted selfie function unit in a rear-mounted selfie module sends a rear-mounted selfie exit instruction to a rear-mounted selfie management unit. The rear-mounted selfie exit instruction is used to instruct the user to exit the rear-mounted selfie function.

[0612] The interface diagram of this step can be found in the above-mentioned Figure 16. The user can click on the switch main screen control 2123 in the photo preview interface 1106 in Figure 16 (a).

[0613] Optionally, the user can also trigger the exit of the rear-mounted selfie function by performing a flip exit operation. Specifically, the rear-mounted selfie management unit can subscribe to the flip exit notification from the module responsible for the flip wake-up function in the foldable screen mobile phone. When the user performs the flip exit operation, the module notifies the rear-mounted selfie function unit, and the rear-mounted selfie function unit sends a rear-mounted selfie exit instruction to the rear-mounted selfie management unit.

[0614] Optionally, the user can also trigger the exit of the rear selfie function by unfolding the outer folding screen mobile phone to the unfolded state. As described in steps S101 to S108 and S116 in the embodiment shown in Figure 23 above, when the folding state management framework monitors that the folding form of the folding screen mobile phone has changed, a folding form change notification is sent to the rear selfie function unit. The rear selfie function unit receives the folding form change notification and determines that the folding form has changed from the folded state to the unfolded state, and then sends a rear selfie exit instruction to the rear selfie management unit. Other state monitoring that may trigger the exit of the rear selfie function is similar and will not be repeated here.

[0615] In addition, when the foldable screen mobile phone detects that the user clicks the flip camera control or switches the main screen control, or exits the operation, it notifies the rear selfie function unit, and the rear selfie function unit sends a rear selfie exit instruction to the rear selfie management unit.

[0616] S702: The rear selfie management unit sends a scene switching notification 2 (switching to the rear non-selfie scene) to the plug-in manager in response to the rear selfie exit instruction.

[0617] Scene switch notification 2 is used to notify the plug-in manager that the shooting scene has changed. Optionally, scene switch notification 2 carries the switched shooting scene, that is, the rear non-selfie scene.

[0618] S703: The plug-in manager sends a stream allocation instruction 2 (carrying a rear non-selfie scene) to the mirror parameter generation unit in the camera communication module in response to the scene switching notification 2.

[0619] The stream allocation instruction 2 is used to instruct the configuration of preview stream mirror parameters and stream configuration parameters. Optionally, the stream allocation instruction 2 can carry the switched shooting scene (ie, the rear non-selfie scene).

[0620] S704 : The mirror parameter generation unit generates preview stream mirror parameters 5 that match the post-positioned non-selfie scene in response to the stream matching instruction 2 .

[0621] S705: The mirroring parameter generation unit sends the preview stream mirroring parameter 5 to the stream parameter generation unit.

[0622] S706: The mirror parameter generation unit sends a flow allocation instruction 2 to the flow parameter generation unit.

[0623] S707 : The stream parameter generation unit generates stream configuration parameters 5 that match the post-shot non-selfie scene and the shooting mode before switching (eg, portrait mode) in response to the stream configuration instruction 2 .

[0624] S708: The stream parameter generation unit sends the preview stream mirroring parameter 5 and the stream configuration parameter 5 to the bottom layer.

[0625] S709. The bottom layer mirrors the image captured by the rear camera based on the preview stream mirror parameter 5 to obtain a mirrored image; and according to the stream configuration parameter 5, configures the preset rear non-selfie algorithm to obtain the rear non-selfie algorithm 2, and processes the mirrored image based on the rear non-selfie algorithm 2 to generate a preview stream.

[0626] S710. The bottom layer monitors changes in the camera usage status and determines that the screen display status needs to change. Therefore, the screen is switched, the main screen is turned on, and the secondary screen is turned off. The anti-accidental touch function of the main screen and the secondary screen is enabled for a preset time.

[0627] S711. The bottom layer feeds back the screen switching result (main screen turns on, secondary screen turns off) and preview stream to the plug-in manager of the camera application.

[0628] S712. After receiving the screen switching result, the plug-in manager filters and selects the required modes and functions according to scene switching notification 2, refreshes the photo preview interface layout, and updates the controls, including the rear selfie control.

[0629] S713: The plug-in manager sends an interface display instruction to the bottom layer.

[0630] S714. The bottom layer responds to the interface display instruction and displays the photo preview interface 901 on the main screen according to the refreshed photo preview interface layout and the updated controls.

[0631] 4. Folding morphology change stage

[0632] Referring to FIG32 , continuing from step S422 in FIG27 , when the external folding screen mobile phone is in the folded state, the main screen is on, the secondary screen is off, and the main screen displays the photo preview interface 901, as shown in FIG32 , the folding state change stage may include the following steps:

[0633] S423. In response to the user unfolding the foldable phone to the unfolded state, the bottom layer detects the change in the folding state and determines that the display state needs to be changed, thereby controlling the screen switching, and the main screen and the secondary screen are lit at the same time.

[0634] The specific implementation of this step can be found in steps S101 to S108 and S111, S112 to S114 in FIG. 23 ; steps S201 to S203 in FIG. 24 , etc., which will not be repeated here.

[0635] S424: The bottom layer sends a folding state change notification to the plug-in manager in the camera application.

[0636] S425: The plug-in manager refreshes the layout of the photo preview interface in response to the folding state change notification.

[0637] S426: The plug-in manager sends an interface display instruction to the bottom layer.

[0638] S427. The bottom layer responds to the interface display instruction and displays the photo preview interface 1801 on both the main screen and the sub-screen according to the refreshed photo preview interface layout.

[0639] The interface diagram in this embodiment can be found in FIG15 .

[0640] The above describes the implementation of the related processes of the rear selfie function using an external folding screen mobile phone as an example. For an internal folding screen mobile phone, the implementation process is similar to that of an external folding screen mobile phone. The difference is that the internal folding screen mobile phone enters the rear selfie function in the unfolded state, and displays the photo preview interface 2204 (see Figure 21) through the external display screen. After the internal folding screen mobile phone is folded from the unfolded state to the folded state, the rear selfie function is exited, and the photo preview interface 2205 (see Figure 21) is displayed simultaneously through the first internal display screen and the second internal display screen. Therefore, when the software architecture implements the above process, the control of screen switching and the screen where the interface is displayed are slightly different. The implementation principles of the two are similar and will not be repeated here.

[0641] The above describes in detail an example of a photographing method provided by an embodiment of the present application. It is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. Those skilled in the art should readily appreciate that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in hardware or in a manner where computer software drives hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.

[0642] The embodiment of the present application can divide the functional modules of the electronic device according to the above method example. For example, each function can be divided into various functional modules, such as a detection unit, a processing unit, a display unit, etc., or two or more functions can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0643] It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0644] The electronic device provided in this embodiment is used to execute the above-mentioned photographing method, and thus can achieve the same effect as the above-mentioned implementation method.

[0645] For example, FIG33 is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application. The electronic device 100 can be the above-mentioned external folding screen mobile phone or the internal folding screen mobile phone. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 124, a sensor module 180, a camera 193, and a display screen 194. The sensor module 180 may include an angle sensor 180A, a gyroscope sensor 180B, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a touch sensor 180K, etc.

[0646] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0647] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0648] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0649] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly retrieve it from the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0650] The electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing that connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering.

[0651] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1. In the embodiment of the present application, N may be equal to 2, meaning electronic device 100 may include two display screens 194, one of which is a primary screen and the other a secondary screen. The primary screen and secondary screen may be connected as one and made of a flexible material.

[0652] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0653] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and transformed into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0654] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1. In the embodiment of the present application, N may be equal to 2, that is, the electronic device 100 may include 2 cameras, one is a front camera and the other is a rear camera. The front camera is arranged on the main screen, and the rear camera is arranged on the raised portion.

[0655] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0656] The internal memory 124 can be used to store computer executable program codes, which include instructions. The processor 110 executes the instructions stored in the internal memory 124 to execute various functional applications and data processing of the electronic device 100.

[0657] The angle sensor 180A is used to detect the angle between the first structural member and the second structural member, so as to determine whether the electronic device is in a folded state or an unfolded state according to the angle, and then control the states of the main screen and the sub-screen.

[0658] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance through infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focus.

[0659] In the embodiment of the present application, one or more of the gyroscope sensor 180B, the magnetic sensor 180D, the acceleration sensor 180E and the distance sensor 180F cooperate to implement flip detection of the electronic device 100, that is, to detect whether the electronic device has been flipped.

[0660] The touch sensor 180K is also called a "touch panel." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, at a location different from that of the display screen 194.

[0661] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the processor executes the photographing method of any of the above embodiments.

[0662] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, it enables the computer to execute the above-mentioned related steps to implement the photographing method in the above-mentioned embodiment.

[0663] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory to enable the chip to execute the photographing method in the above-mentioned method embodiments.

[0664] Among them, the electronic device, computer-readable storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0665] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0666] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0667] Units described as separate components may or may not be physically separate, and components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0668] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0669] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0670] The above content is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A photographing method, the method being executed by an electronic device, characterized in that: The electronic device is a foldable device, and the electronic device includes a first screen, a second screen, and a rear camera. When the electronic device is in a first form, the second screen and the rear camera are on the same side, and when the electronic device is in a second form, the second screen and the rear camera are on different sides. The method includes: When the electronic device is in the first state, the first screen is in a light-on state, and the second screen is in a light-off state, receiving a first operation from a user; In response to the first operation, generating a first screen switching instruction, wherein the first screen switching instruction includes an identifier of the second screen; In response to the first screen switching instruction, the first screen of the electronic device in the first form is controlled to turn off, the second screen is controlled to turn on, and the image acquired by the rear camera is displayed through the second screen.

2. The method according to claim 1, characterized in that Before receiving the first operation of the user, the method further includes: Receive the user's operation of opening the camera application; In response to the operation of opening the camera application, a first preview interface is displayed through the first screen, and the first preview interface includes a first control and an image acquired by the rear camera.

3. The method according to claim 2, characterized in that The electronic device further includes a front camera, and the front camera and the first screen are located on the same side. After displaying the first preview interface through the first screen and before receiving the first operation of the user, the method further includes: Receiving a setting operation from a user, wherein the setting operation is used to set a default selfie mode to a front-facing selfie; In response to the setting operation, displaying a second preview interface through the first screen, wherein the second preview interface includes a second control and an image acquired by the rear camera; In response to an operation on the second control, a third preview interface is displayed through the first screen, where the third preview interface includes a third control and an image acquired by the front camera.

4. The method according to claim 3, characterized in that The first operation is an operation acting on the first control, or an operation of flipping the electronic device, or an operation acting on the third control.

5. The method according to claim 4, characterized in that Before displaying the first preview interface through the first screen, the method further includes: In response to the operation of opening the camera application, generating a first image acquisition request, wherein the first image acquisition request includes an identifier of the rear camera; In response to the first image acquisition request, the rear camera is controlled to continuously acquire the first image.

6. The method according to claim 5, characterized in that The first operation is an operation acting on the first control, or an operation of flipping the electronic device, and the method further includes: In response to the first operation, generating a first scene switching instruction, wherein the first scene switching instruction includes an identifier of a first shooting scene; In response to the first scene switching instruction, processing the first image based on a first algorithm corresponding to the first shooting scene to obtain a second image; The step of displaying the image acquired by the rear camera through the second screen includes: The second image is displayed through the second screen.

7. The method according to claim 6, characterized in that The step of processing the first image based on a first algorithm corresponding to the first shooting scene to obtain a second image in response to the first scene switching instruction includes: In response to the first scene switching instruction, generating a first preview stream mirroring parameter and a first stream configuration parameter matching the first shooting scene; the first stream configuration parameter includes an identifier of the first algorithm; mirroring the first image according to the mirroring parameters of the first preview stream to obtain a third image; According to the first stream configuration parameters, configure the first algorithm to obtain a first target algorithm; Based on the first target algorithm, the third image is processed to obtain the second image.

8. The method according to claim 4, characterized in that After displaying the first preview interface through the first screen and before displaying the second preview interface through the first screen, the method further includes: In response to the operation on the second control, generating a second image acquisition request, wherein the second image acquisition request includes an identifier of the front camera; In response to the second image acquisition request, the front camera is controlled to continuously acquire images.

9. The method according to claim 8, characterized in that The first operation is an operation acting on the third control, and the method further includes: In response to the first operation, generating a camera switching instruction and a second scene switching instruction, wherein the camera switching instruction includes an identifier of the rear camera, and the second scene switching instruction includes an identifier of the first shooting scene; In response to the camera switching instruction, controlling the front camera to stop acquiring images, and controlling the rear camera to continue acquiring a fourth image; In response to the second scene switching instruction, processing the fourth image based on a first algorithm corresponding to the first shooting scene to obtain a fifth image; The step of displaying the image acquired by the rear camera through the second screen includes: The fifth image is displayed through the second screen.

10. The method according to claim 9, characterized in that The step of processing the fourth image based on a first algorithm corresponding to the first shooting scene to obtain a fifth image in response to the second scene switching instruction includes: In response to the second scene switching instruction, generating a second preview stream mirroring parameter and a second stream configuration parameter matching the first shooting scene; the second stream configuration parameter includes an identifier of the first algorithm; mirroring the fourth image according to the second preview stream mirroring parameter to obtain a sixth image; According to the second stream configuration parameters, configure the first algorithm to obtain a second target algorithm; Based on the second target algorithm, the sixth image is processed to obtain the fifth image.

11. The method according to any one of claims 1 to 10, characterized in that The method further comprises: Displaying a main interface through the first screen, the main interface including a first icon, the first icon being associated with a first shooting scene; receiving a second operation acting on the first icon; In response to the second operation, the first screen is controlled to turn off, the second screen is controlled to turn on, and the seventh image acquired by the rear camera is displayed through the second screen.

12. The method according to claim 11, characterized in that Before displaying the seventh image acquired by the rear camera through the second screen, the method further includes: In response to the second operation, creating a camera process; Generate a third image acquisition request and a third preview stream mirror parameter and a third stream configuration parameter matching the first shooting scene; the third image acquisition request includes an identifier of the rear camera, and the third stream configuration parameter includes an identifier of a first algorithm matching the first shooting scene; In response to the third image acquisition request, controlling the rear camera to continuously acquire an eighth image; Processing the eighth image based on the first algorithm according to the third preview stream mirroring parameter and the third stream configuration parameter to obtain the seventh image; The displaying the seventh image acquired by the rear camera through the second screen includes: generating interface layout information according to the seventh image and the resource information corresponding to the first shooting scene; According to the interface layout information, a fourth preview interface is displayed through the second screen, and the fourth preview interface includes the seventh image.

13. The method according to claim 12, characterized in that Before generating the interface layout information according to the resource information corresponding to the seventh image and the first shooting scene, the method further includes: Determine that a first function corresponding to the first shooting scene is in an enabled state.

14. The method according to claim 12 or 13, characterized in that The generating of the third image acquisition request and the third preview stream mirroring parameters and the third stream configuration parameters matching the first shooting scene includes: Acquire the current state of the electronic device and a configuration file corresponding to the second operation; When it is determined that the current form of the electronic device is the first form, and the configuration file includes an identifier of the rear camera and an identifier of the first shooting scene, the third image acquisition request, the third preview stream mirroring parameters, and the third stream configuration parameters are generated according to the configuration file.

15. The method according to any one of claims 1 to 14, characterized in that The step of generating a first screen switching instruction in response to the first operation includes: In response to the first operation, determining that a shooting scene corresponding to the first operation is a first shooting scene, and a current state of the electronic device is the first state; According to the first shooting scene and the first form, determining that a target display state of the first screen is an off-screen state, and a target display state of the second screen is a bright-screen state; Determining that a current display state of the first screen is different from a target display state of the first screen, and a current state of the second screen is different from a target display state of the second screen; Generate the first screen switching instruction.

16. The method according to any one of claims 1 to 15, characterized in that The step of controlling the first screen of the electronic device in the first state to turn off the first screen and turn on the second screen in response to the first screen switching instruction includes: In response to the screen switching instruction, displaying a first interface; After the first interface is displayed for a preset time, the first screen is controlled to turn off and the second screen is controlled to turn on.

17. The method according to any one of claims 1 to 16, characterized in that The electronic device is an inward-folding screen device, the first screen is a folding screen, the first form is an unfolded state, and the second form is a folded state. When the electronic device is in the first form, the first screen and the second screen are on different sides.

18. The method according to any one of claims 1 to 16, characterized in that The electronic device is an external folding screen device, the electronic device includes a folding screen, the folding screen includes the first screen and the second screen, the first form is a folded state, the second form is an unfolded state, and when the electronic device is in the second form, the first screen and the second screen are on the same side.

19. The method according to claim 18, characterized in that The method further comprises: When the electronic device is in the first form, the first screen is in an off-screen state, the second screen is in an on-screen state, and the second screen displays an image acquired by the rear camera, when it is detected that the electronic device is unfolded from the first form to the second form, a third scene switching instruction and a second screen switching instruction are generated, the third scene switching instruction includes an identifier of the second shooting scene, and the second screen switching instruction includes identifiers of the first screen and the second screen; In response to the third scene switching instruction, processing the image acquired by the rear camera based on a second algorithm corresponding to the second shooting scene to obtain a ninth image; In response to the second screen switching instruction, both the first screen and the second screen are controlled to light up, and the ninth image is displayed through the first screen and the second screen.

20. The method according to claim 18, characterized in that The method further comprises: When the electronic device is in the first state, the first screen is in an off state, the second screen is in an on state, and the second screen displays an image acquired by the rear camera, receiving a second operation of the user; In response to the second operation, generating a third scene switching instruction and a third screen switching instruction, wherein the third scene switching instruction includes an identifier of the second shooting scene, and the third screen switching instruction includes an identifier of the first screen; In response to the third scene switching instruction, processing the image acquired by the rear camera based on a second algorithm corresponding to the second shooting scene to obtain a ninth image; In response to the third screen switching instruction, the second screen is controlled to be turned off, the first screen is controlled to be turned on, and the ninth image is displayed through the first screen.

21. An electronic device, characterized in that: include: Processors, memory, and interfaces; The processor, the memory and the interface cooperate with each other so that the electronic device executes the method as claimed in any one of claims 1 to 20.

22. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor calls instructions so that the electronic device executes the method according to any one of claims 1 to 20.

Images