Photographing method and electronic equipment

Abstract

The embodiment of the invention provides a photographing method and electronic equipment, the method is executed by the electronic equipment, the electronic equipment is foldable equipment, the electronic equipment comprises a first screen, a second screen and a rear camera, and under the condition that the electronic equipment is in a first form, the second screen and the rear camera are located on the same side. When the electronic equipment is in a second form and the second screen and the rear camera are located on different sides, the method comprises the following steps: receiving a first operation of a user when the electronic equipment is in a first form, the first screen is in a screen-on state and the second screen is in a screen-off state; in response to the first operation, a first screen switching instruction is generated, and the first screen switching instruction comprises an identifier of a second screen; and in response to the first screen switching instruction, controlling a first screen of the electronic equipment in the first form to be turned off, controlling a second screen to be turned on, and displaying an image acquired by the rear camera through the second screen. According to the method, rear selfie can be realized, the shooting quality is improved, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of electronic technology, and in particular to a photographing method and an electronic device. Background Art

[0002] As people's requirements for mobile phone display and portability gradually increase, foldable screen mobile phones are becoming more and more popular among users.

[0003] Folding screen mobile phones include front cameras and rear cameras. Generally, when using folding screen mobile phones to take selfies, you can only use the front camera, and the shooting effect is not good. Summary of the invention

[0004] The present application provides a photographing method, device, electronic device, chip, computer-readable storage medium and computer program product, which can improve selfie effects and enhance user experience.

[0005] In a first aspect, the present application provides a photographing method, which is performed by an electronic device, the electronic device being a foldable device, the electronic device comprising a first screen, a second screen, and a rear camera, when the electronic device is in a first form, the second screen and the rear camera are on the same side, when the electronic device is in a second form, the second screen and the rear camera are on different sides, the method comprising:

[0006] When the electronic device is in a first form, with the first screen in a light-on state and the second screen in an off state, a first operation by the user is received; in response to the first operation, a first screen switching instruction is generated, wherein the first screen switching instruction includes an identifier of the second screen; in response to the first screen switching instruction, the first screen of the electronic device in the first form is controlled to be off, the second screen is controlled to be lighted, and an image acquired by the rear camera is displayed through the second screen.

[0007] Taking the electronic device as an external folding screen device as an example, the external folding screen mobile phone includes a folding screen, and the folding screen includes a first screen and a second screen. The first state is a folded state, and the second state is an unfolded state.

[0008] The first operation is an operation that can trigger the entry into the rear-mounted selfie function. For example, it may be an operation of clicking on a rear-mounted selfie control (i.e., a first control) in a photo preview interface (i.e., a first preview interface) in a rear-mounted non-selfie scene, or an operation of flipping the electronic device, or an operation of clicking on a rear-mounted selfie control (i.e., a third control) in a photo preview interface (i.e., a third preview interface) in a front-mounted selfie scene.

[0009] The first screen switching instruction is used to instruct the electronic device in the first state to turn off the first screen and turn on the second screen.

[0010] The first aspect provides a photographing method, in which, when the electronic device is in a first form, the first screen is in a light-on state, and the second screen is in an off-screen state, the user can trigger the rear selfie function through a first operation, that is, the first screen of the electronic device is off, the second screen is on, and the image acquired by the rear camera is displayed through the second screen. Since the second screen and the rear camera are on the same side in the first form, the user can use the rear camera to take pictures of people or things on the side where the user is (i.e., selfies), and view the preview interface on the second screen, which is convenient for the user to take selfies. Moreover, the image taken by the rear camera is displayed through the second screen, that is, in the rear selfie scene, the image is acquired through the rear camera. The specifications and hardware configuration of the rear camera are relatively high, the image quality captured is relatively high, the shooting effect is relatively good, and the user experience can be improved.

[0011] In one possible implementation, before receiving the user's first operation, the method also includes: receiving the user's operation to open a camera application; in response to the operation to open the camera application, displaying a first preview interface through the first screen, the first preview interface including a first control and an image captured by the rear camera.

[0012] The first preview interface may be a photo preview interface in a rear non-selfie scene. The first control may be a rear selfie control in the first preview interface. That is, in the first form, the user can enter the rear selfie function from a rear non-selfie scene, and the rear non-selfie scene is a shooting scene commonly used by the user. This implementation method facilitates the user to use the rear selfie function and improves the user experience.

[0013] In one possible implementation, the electronic device also includes a front camera, which is located on the same side as the first screen. After displaying the first preview interface through the first screen and before receiving the first operation of the user, the method also includes: receiving a setting operation of the user, the setting operation is used to set the default selfie mode to the front selfie; in response to the setting operation, displaying a second preview interface through the first screen, the second preview interface includes a second control and an image captured by the rear camera; in response to the operation acting on the second control, displaying a third preview interface through the first screen, the third preview interface includes a third control and an image captured by the front camera.

[0014] The second preview interface may be an interface in the front selfie scene. The second control may be a camera flip control. The third preview interface may be a preview interface in the front selfie scene. The third control may be a rear selfie control in the third preview interface. In this implementation, in the first form, the user can enter the front selfie scene from the rear non-selfie scene by clicking the second control.

[0015] In a possible implementation, the first operation is an operation acting on the first control, or an operation of flipping the electronic device, or an operation acting on a third control.

[0016] That is, in the first form, in a rear non-selfie scenario, the user can enter the rear selfie function by operating the first control, or by turning the electronic device over to enter the rear selfie function, or in a front selfie scenario, by operating the third control to enter the rear selfie function. This embodiment provides the user with multiple ways to enter the rear selfie function, facilitates user operation, and improves user experience.

[0017] In one possible implementation, before displaying the first preview interface through the first screen, the method also includes: in response to the operation of opening the camera application, generating a first image acquisition request, the first image acquisition request including an identifier of the rear camera; in response to the first image acquisition request, controlling the rear camera to continuously acquire the first image.

[0018] The identification of the camera may be, for example, the number or name of the camera. The operation of opening the camera application may be, for example, clicking the icon of the camera application in the main interface. When the user performs the operation of opening the camera application, the electronic device can respond to the user's operation, start the process, and enter the rear non-selfie scene by default. Specifically, through the first image acquisition request, the rear camera is requested to acquire an image. In this scenario, the image acquired by the rear camera is called the first image.

[0019] In one possible implementation, the first operation is an operation acting on a first control, or an operation of flipping an electronic device, and the method also includes: in response to the first operation, generating a first scene switching instruction, the first scene switching instruction including an identifier of a first shooting scene; in response to the first scene switching instruction, processing the first image based on a first algorithm corresponding to the first shooting scene to obtain a second image; and displaying the image acquired by the rear camera through a second screen, including: displaying the second image through the second screen.

[0020] The first scene switching instruction is used to instruct to switch the shooting scene from the rear non-selfie scene (ie, the second shooting scene) to the rear selfie scene (ie, the first shooting scene). The first algorithm is also a preset rear selfie algorithm.

[0021] In this implementation, when entering the rear selfie scene from the rear non-selfie scene, there is no need to switch camera instructions. The first scene switching instruction instructs the image acquired by the rear camera to be processed related to the rear non-selfie, thereby realizing the rear selfie function and eliminating the camera switching process, thereby improving the algorithm operation efficiency.

[0022] In a possible implementation, in response to a first scene switching instruction, a first image is processed based on a first algorithm corresponding to a first shooting scene to obtain a second image, including: in response to the first scene switching instruction, a first preview stream mirror parameter and a first stream configuration parameter matching the first shooting scene are generated; the first stream configuration parameter includes an identifier of the first algorithm; the first image is mirrored according to the first preview stream mirror parameter to obtain a third image; the first algorithm is configured according to the first stream configuration parameter to obtain a first target algorithm; and the third image is processed based on the first target algorithm to obtain a second image.

[0023] In this implementation, the first scene switching instruction includes an identifier of the first shooting scene, so the generated first preview stream mirroring parameters and first stream configuration parameters are parameters that match the first shooting scene, which can meet the implementation requirements of the post-selfie function.

[0024] In one possible implementation, before the second preview interface is displayed on the first screen and after the first preview interface is displayed on the first screen, the method further includes: generating a second image acquisition request in response to an operation acting on the second control, the second image acquisition request including an identifier of the front camera; and controlling the front camera to continuously acquire images in response to the second image acquisition request.

[0025] The operation acting on the second control may be, for example, clicking on the camera flip control. When the user clicks on the camera flip control, the electronic device can respond to the user's operation and generate a second image acquisition request. The second image request is used to request the front camera to acquire an image.

[0026] In one possible implementation, the first operation is an operation acting on a third control, and the method also includes: in response to the first operation, generating a camera switching instruction and a second scene switching instruction, the camera switching instruction including an identifier of the rear camera, and the second scene switching instruction including an identifier of the first shooting scene; in response to the camera switching instruction, controlling the front camera to stop acquiring images, and controlling the rear camera to continue acquiring a fourth image; in response to the second scene switching instruction, processing the fourth image based on a first algorithm corresponding to the first shooting scene to obtain a fifth image; and displaying the image acquired by the rear camera through the second screen, including: displaying the fifth image through the second screen.

[0027] The second scene switching instruction is used to instruct to switch the shooting scene from the front selfie scene to the rear selfie scene. The first algorithm is also the preset rear selfie algorithm.

[0028] In this implementation, when entering the rear selfie scene from the front selfie scene, the camera is switched through the camera switching instruction, that is, the front camera is switched to the rear camera, and the image obtained by the rear camera is processed related to the rear non-selfie through the second scene instruction, thereby realizing the rear selfie function.

[0029] In a possible implementation, in response to a second scene switching instruction, the fourth image is processed based on a first algorithm corresponding to the first shooting scene to obtain a fifth image, including: in response to the second scene switching instruction, generating a second preview stream mirror parameter and a second stream configuration parameter matching the first shooting scene; the second stream configuration parameter includes an identifier of the first algorithm; mirroring the fourth image according to the second preview stream mirror parameter to obtain a sixth image; configuring the first algorithm according to the second stream configuration parameter to obtain a second target algorithm; and processing the sixth image based on the second target algorithm to obtain a fifth image.

[0030] In this implementation, the second scene switching instruction includes the identifier of the first shooting scene, so the generated second preview stream mirroring parameters and second stream configuration parameters are parameters that match the first shooting scene, which can meet the implementation requirements of the post-selfie function.

[0031] In one possible implementation, the method also includes: displaying a main interface through a first screen, the main interface including a first icon, the first icon being associated with a first shooting scene; receiving a second operation acting on the first icon; in response to the second operation, controlling the first screen to turn off, controlling the second screen to turn on, and displaying the seventh image acquired by the rear camera through the second screen.

[0032] The first icon may be a selfie option or selfie icon displayed in the main interface when the rear selfie function is turned on or the default selfie mode is the rear selfie. In this implementation, the user can enter the rear selfie function through the selfie option in the main interface, without the user having to open the first preview interface, the second preview interface, or the third preview interface, and without the user having to click on the rear selfie control in the preview interface, thereby simplifying the operation process of the user entering the rear selfie function and improving the user experience.

[0033] In one possible implementation, before displaying the seventh image acquired by the rear camera through the second screen, the method also includes: creating a camera process in response to the second operation; generating a third image acquisition request and a third preview stream mirror parameter and a third stream configuration parameter matching the first shooting scene; the third image acquisition request includes an identifier of the rear camera, and the third stream configuration parameter includes an identifier of the first algorithm matching the first shooting scene; in response to the third image acquisition request, controlling the rear camera to continuously acquire the eighth image; processing the eighth image based on the first algorithm according to the third preview stream mirror parameter and the third stream configuration parameter to obtain the seventh image; displaying the seventh image acquired by the rear camera through the second screen includes: generating interface layout information according to the resource information corresponding to the seventh image and the first shooting scene; and displaying a fourth preview interface through the second screen according to the interface layout information, wherein the fourth preview interface includes the seventh image.

[0034] In this implementation, when the user clicks the selfie option or selfie icon in the main interface, a camera process is created, and a third image acquisition request is made to request the rear camera to acquire an image. A preset rear selfie algorithm is configured based on the third preview stream mirror parameter and the third stream configuration parameter to perform rear selfie-related processing on the image acquired by the rear camera to obtain a seventh image. An interface is laid out based on the seventh image, and the laid-out interface is displayed. This implementation enables the rear selfie function to be directly started when the camera is started, thereby simplifying user operations and facilitating user use.

[0035] In a possible implementation, before generating the interface layout information according to the seventh image and the resource information corresponding to the first shooting scene, the method further includes: determining that the first function corresponding to the first shooting scene is in an enabled state.

[0036] In one possible implementation, generating a third image acquisition request and a third preview stream mirroring parameter and a third stream configuration parameter that match the first shooting scene includes: obtaining the current form of the electronic device and a configuration file corresponding to the second operation; determining that the current form of the electronic device is the first form, and the configuration file includes an identifier of the rear camera and an identifier of the first shooting scene, and generating a third image acquisition request, a third preview stream mirroring parameter and a third stream configuration parameter according to the configuration file.

[0037] In one possible implementation, in response to a first operation, a first screen switching instruction is generated, including: in response to the first operation, determining that the shooting scene corresponding to the first operation is the first shooting scene, and the current form of the electronic device is the first form; according to the first shooting scene and the first form, determining that the target display state of the first screen is an off-screen state, and the target display state of the second screen is a bright-screen state; determining that the current display state of the first screen is different from the target display state of the first screen, and the current state of the second screen is different from the target display state of the second screen; generating the first screen switching instruction.

[0038] In this implementation, the target display state of the screen is monitored by the form of the electronic device and the shooting scene of the camera. When the target display state is different from the current display state of the screen, the screen switching is controlled, so that different screen displays are matched in different scenes, and the diversity and practicality of the electronic device scenes are improved.

[0039] In one possible implementation, in response to a first screen switching instruction, a first screen of an electronic device in a first form is controlled to turn off, and a second screen is controlled to turn on, including: in response to the screen switching instruction, a first interface is displayed; after the first interface is displayed for a preset period of time, the first screen is controlled to turn off, and the second screen is controlled to turn on.

[0040] The first interface may be a flip guide interface. By displaying the first flip guide interface to guide the user to use the rear selfie function, the user can understand how to use the rear selfie function, thereby improving the user experience.

[0041] In one possible implementation, the electronic device is an inward-folding screen device, the first screen is a folding screen, the first form is an unfolded state, and the second form is a folded state. When the electronic device is in the first form, the first screen and the second screen are on different sides.

[0042] In one possible implementation, the electronic device is an outward folding screen device, the electronic device includes a folding screen, the folding screen includes a first screen and a second screen, the first form is a folded state, the second form is an unfolded state, and when the electronic device is in the second form, the first screen and the second screen are on the same side.

[0043] In one possible implementation, the method also includes: when the electronic device is in a first form, the first screen is in an off state, the second screen is in a bright state, and the second screen displays an image captured by the rear camera, when it is detected that the electronic device is expanded from the first form to the second form, a third scene switching instruction and a second screen switching instruction are generated, the third scene switching instruction includes an identifier of the second shooting scene, and the second screen switching instruction includes identifiers of the first screen and the second screen; in response to the third scene switching instruction, the image captured by the rear camera is processed based on a second algorithm corresponding to the second shooting scene to obtain a ninth image; in response to the second screen switching instruction, the first screen and the second screen are controlled to be bright, and the ninth image is displayed jointly through the first screen and the second screen.

[0044] In this implementation, when using the rear selfie function, if the user unfolds the electronic device (external folding screen device), the camera application exits the rear selfie function and enters the rear non-selfie scene in the unfolded state. The user unfolds the electronic device to the unfolded state, indicating that the user no longer needs the rear selfie function, so directly entering the unfolded state rear shooting scene is likely to meet the user's usage needs and improve the user experience.

[0045] In one possible implementation, the method also includes: when the electronic device is in a first form, the first screen is in an off state, the second screen is in a bright state, and the second screen displays an image captured by the rear camera, receiving a second operation from the user; in response to the second operation, generating a third scene switching instruction and a third screen switching instruction, the third scene switching instruction including an identifier of the second shooting scene, and the third screen switching instruction including an identifier of the first screen; in response to the third scene switching instruction, processing the image captured by the rear camera based on a second algorithm corresponding to the second shooting scene to obtain a ninth image; in response to the third screen switching instruction, controlling the second screen to be off, controlling the first screen to be bright, and displaying the ninth image through the first screen.

[0046] The second operation is to exit the rear selfie function, for example, flipping the phone, or clicking to switch the main screen control, or clicking to exit the rear selfie control, etc.

[0047] When the user is using the rear Selfie function, the user can exit the rear Selfie function through the second operation. After exiting the rear Selfie function, the camera application enters the rear non-Selfie scene in the first form, the electronic device turns off the second screen, lights up the first screen, and displays the ninth image taken by the rear camera through the first screen. In other words, when the user is using the rear Selfie function, the user can exit the rear Selfie function at any time with one click, which is convenient for user operation and use and improves the user experience.

[0048] In a second aspect, the present application provides a device, which is included in an electronic device, and the device has the function of implementing the electronic device behavior in the above-mentioned first aspect and the possible implementation of the above-mentioned first aspect. The function can be implemented by hardware, or it can be implemented by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above-mentioned functions. For example, a receiving module or unit, a processing module or unit, etc.

[0049] In a third aspect, the present application provides an electronic device, comprising: a processor, a memory, and an interface; the processor, the memory, and the interface cooperate with each other so that the electronic device executes any one of the methods in the technical solution of the first aspect.

[0050] In a fourth aspect, the present application provides a chip, including a processor. The processor is used to read and execute a computer program stored in a memory to perform the method in the first aspect and any possible implementation thereof.

[0051] Optionally, the chip also includes a memory, and the memory is connected to the processor via a circuit or wire.

[0052] Further optionally, the chip also includes a communication interface.

[0053] In a fifth aspect, the present application provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the processor executes any one of the methods in the technical solution of the first aspect.

[0054] In a sixth aspect, the present application provides a computer program product, the computer program product comprising: a computer program code, when the computer program code runs on an electronic device, the electronic device executes any one of the methods in the technical solution of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] Figure 1 is a schematic structural diagram of an external folding screen mobile phone provided in an embodiment of the present application;

[0056] Figure 2 This is a schematic diagram of a photo-taking scene of an external folding screen mobile phone provided in an embodiment of the present application;

[0057] Figure 3 It is a structural schematic diagram of an inward folding screen mobile phone provided in an embodiment of the present application;

[0058] Figure 4 This is a schematic diagram of a photo-taking scene of an inward folding screen mobile phone provided in an embodiment of the present application;

[0059] Figure 5 This is a schematic diagram of interface changes during the process of enabling the rear-mounted selfie function provided in an embodiment of the present application;

[0060] Figure 6 This is a schematic diagram of interface changes during a setting process of a flip wake-up function provided in an embodiment of the present application;

[0061] Figure 7 This is a schematic diagram of an interface change in a process of clicking a rear-mounted selfie control to enter a rear-mounted selfie function provided in an embodiment of the present application;

[0062] Figure 8 This is a schematic diagram of the interface changes during the process of flipping a mobile phone to wake up a rear selfie provided in an embodiment of the present application;

[0063] Fig. 9 This is a schematic diagram of interface changes in a process of entering a rear Selfie function through a desktop shortcut menu provided in an embodiment of the present application;

[0064] Fig.10 is another example of interface changes in the process of entering the rear Selfie function through the desktop shortcut menu provided by an embodiment of the present application;

[0065] Fig.11 This is one of the interface change diagrams of an example of a process of entering a rear selfie function from a front selfie scene provided in an embodiment of the present application;

[0066] Fig.12 This is a second schematic diagram of interface changes in a process of entering a rear-camera selfie function from a front-camera selfie scene provided in an embodiment of the present application;

[0067] Fig.13 This is a schematic diagram of the interface changes of a mobile phone when using the rear selfie function provided in an embodiment of the present application;

[0068] Fig.14 This is a schematic diagram of an interface change of an example of clicking a control to exit a rear selfie function provided in an embodiment of the present application;

[0069] Fig.15 It is a schematic diagram of interface changes in another example of the process of entering the rear selfie function from the front selfie scene provided by an embodiment of the present application;

[0070] Fig.16 This is a schematic diagram of an interface change based on an inward folding screen mobile phone entering a rear selfie function provided in an embodiment of the present application;

[0071] Fig.17 is a schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application;

[0072] Fig.18 It is a flowchart of a photographing method provided in an embodiment of the present application;

[0073] Fig.19is a flowchart of another photographing method provided in an embodiment of the present application;

[0074] Fig. 20 This is a flowchart of another photographing method provided in an embodiment of the present application;

[0075] Fig.21 is a schematic diagram of the software architecture of another electronic device provided in an embodiment of the present application;

[0076] Fig. 22 This is a flowchart of another photographing method provided in an embodiment of the present application;

[0077] Fig.23 This is a flowchart of another photographing method provided in an embodiment of the present application;

[0078] Fig.24 This is a flowchart of another photographing method provided in an embodiment of the present application;

[0079] Fig.25 This is a flowchart of another photographing method provided in an embodiment of the present application;

[0080] Fig.26 This is a flowchart of another photographing method provided in an embodiment of the present application;

[0081] Fig. 27 This is a flowchart of another photographing method provided in an embodiment of the present application;

[0082] Fig.28 It is a structural diagram of an electronic device 100 provided in an embodiment of the present application. DETAILED DESCRIPTION

[0083] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0084] In the following, the terms "first", "second", and "third" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first", "second", and "third" may explicitly or implicitly include one or more of the features.

[0085] References to "one embodiment" or "some embodiments" etc. described in the specification of the present application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in the specification of the present application do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0086] The photographing method provided in the embodiment of the present application can be applied to electronic devices with folding screens such as folding screen mobile phones. For ease of understanding, the structure of the folding screen mobile phone is first introduced.

[0087] Folding screen mobile phones are mainly divided into external folding screen mobile phones and internal folding screen mobile phones. Whether it is an external folding screen mobile phone or an internal folding screen mobile phone, it can include several forms such as folding state, bracket state and unfolded state. Among them, the bracket state refers to the form between the folding state and the unfolded state. Both the external folding screen mobile phone and the internal folding screen mobile phone include a foldable screen. In the unfolded state, the foldable screen is in an unfolded state. When the external folding screen mobile phone is in the unfolded state, when the foldable screen faces the user, the mobile phone is folded to the side away from the user (called outward folding), and the form of the external folding screen mobile phone changes to the bracket state, and continues to fold outward, and the form changes to the folded state. When the internal folding screen mobile phone is in the unfolded state, when the foldable screen faces the user, the mobile phone is folded to the side close to the user (called inward folding), and the form of the external folding screen mobile phone changes to the bracket state, and continues to fold inward, and the form changes to the folded state. Among them, the folding state of the external folding screen mobile phone is also called the first form, and the unfolded state of the external folding screen is also called the second form; the unfolded state of the internal folding screen mobile phone is also called the first form, and the folded state of the internal folding screen is also called the second form. The following is explained in conjunction with the accompanying drawings.

[0088] 1. External folding screen mobile phone

[0089] For example, Figure 1 This is a schematic diagram of the structure of an external folding screen mobile phone provided in an embodiment of the present application. For the sake of clarity, Figure 1 The front and back views of the foldable phone 10 are shown.

[0090] like Figure 1 As shown, the folding screen mobile phone 10 includes a first structural member 11, a second structural member 12, and a connecting component 13 (located at Figure 1 In the figure (a), the first structural member 11 and the second structural member 12 are flipped and folded through the connecting component 13.

[0091] The first structural member 11 may include a main display screen (hereinafter referred to as the main screen, also referred to as the first screen) 111, a first back shell 112 and a raised portion 113. The main screen 111 is provided with a front camera 1111. The first back shell 112 and the raised portion 113 are provided at the back of the main screen 111. The raised portion 113 may be provided with a rear camera 1122.

[0092] The second structural member 12 may include a sub-screen (hereinafter referred to as sub-screen, also referred to as second screen) 121 and a second back shell 122. The second back shell 122 is disposed at the back of the sub-screen 121.

[0093] During use, the angle between the first structural member 11 and the second structural member 12 is changed by the connecting component 13 to realize various forms of the external folding screen mobile phone 10. It can be understood that the secondary screen 121 and the main screen 111 can actually be an integrated flexible display screen (i.e., a foldable screen). When the external folding screen mobile phone 10 is folded by the connecting component 13, the connecting component 13 divides the screen into two parts: the main screen 111 and the secondary screen 121, wherein the main screen 111 and the rear camera 1122 are located on the same side of the connecting component 13.

[0094] like Figure 1 As shown in Figure (a), when the angle between the first structural member 11 and the second structural member 12 is approximately 180°, the external folding screen mobile phone 10 is in the unfolded state. At this time, the surface of the first back shell 112 of the first structural member 11 and the surface of the second back shell 122 of the second structural member 12 are approximately in the same plane. The surfaces of the main screen 111 and the sub-screen 121 are approximately in the same plane, that is, the main screen 111 and the sub-screen 121 are on the same side. In the unfolded state, the light emitting direction of the main screen 111 and the sub-screen 121 is the same as the light incoming direction of the rear camera. In the unfolded state, the external folding screen mobile phone 10 simultaneously displays the content to be displayed through the main screen 111 and the sub-screen 121. Optionally, in the unfolded state, the main screen 111 and the sub-screen 112 can jointly display the interface of the same application, or they can display the interfaces of different applications in split screens.

[0095] The foldable phone 10 is in Figure 1 In the unfolded state shown in FIG. (a), when the main screen 111 and the secondary screen 121 are both on, the user can turn the external folding screen mobile phone 10 outward ( Figure 1 The outer folding screen mobile phone 10 is folded in the direction indicated by the arrow in (a) to enter the support state. Figure 1 As shown in Figure (b).

[0096] When the external folding screen mobile phone 10 is in the support state, if the angle between the first structural member 11 and the second structural member 12 is greater than 45°, the main screen and the secondary screen are kept on at the same time. Figure 1As shown in Figure (b) in the figure. When the angle between the first structural member 11 and the second structural member 12 gradually decreases to about 45°, the secondary screen 121 is turned off, and only the main screen 121 is in the light state, displaying the content to be displayed. In the subsequent folding process, only the main screen 111 is kept on until the angle between the first structural member 11 and the second structural member 12 is about 0°, as shown in Figure (b). Figure 1 The folded state shown in Figure (c).

[0097] like Figure 1 As shown in Figure (c), when the external folding screen mobile phone 10 is in the folded state, the surface of the secondary screen 121 of the second structural member 12 is approximately in the same plane as the surface of the raised portion 113 of the first structural member 11. At this time, the secondary screen 121 and the rear camera 1122 are on the same side. In the folded state, the light emitting direction of the secondary screen 121 is opposite to the light entering direction of the rear camera 1122.

[0098] In the folded state, the external folding screen mobile phone 10 displays the content to be displayed through the main screen 111, and the secondary screen 112 does not display and can be in the off-screen state. It should be noted that in the folded state, when the secondary screen 112 is in the off-screen state, the secondary screen 112 may not receive touch operations, and the user can perform touch operations on the main screen 111.

[0099] When the external folding screen mobile phone 10 is unfolded from the folded state to the unfolded state, the state change of the screen can be the reverse process from the unfolded state to the folded state mentioned above, which will not be repeated.

[0100] In the above Figure 1 With the structural support of the external folding screen mobile phone 10, in the photo shooting scene, when the external folding screen mobile phone 10 is in Figure 1 In the unfolded state shown in FIG. 1 (a), the user can use the rear camera 1122 to shoot people or objects around him, and the shot images can be displayed simultaneously on the main screen 111 and the sub-screen 122, such as Figure 2 As shown in Figure (a) in the figure, this shooting scene is also called the rear non-selfie scene in the unfolded state. At the same time, when the external folding screen mobile phone 10 is in the unfolded state, the user can also use the front camera 1111 to take a selfie, and the captured image can be displayed simultaneously on the main screen 111 and the sub-screen 122, as shown in Figure 1. Figure 2 As shown in Figure (b), this shooting scene is also called a front-facing selfie scene in the unfolded state.

[0101] When the external folding screen mobile phone 10 is in Figure 1 In the folded state shown in FIG. (c) of FIG. 1 , the user can use the rear camera 1122 to shoot people or objects around him, and the shot image is displayed on the main screen 111, as shown in FIG. Figure 2As shown in Figure (c) in FIG. 1 , this shooting scene is also called the rear non-selfie scene in the folded state. When the external folding screen mobile phone 10 is in the folded state, the user can also use the front camera 1111 to take a selfie, and the captured image is displayed on the main screen 111, as shown in FIG. Figure 2 As shown in Figure (d) in the figure, this shooting scene is also called the front-facing selfie scene in the folded state.

[0102] Depend on Figure 2 It can be seen that for an external folding screen mobile phone, the user can only take selfies through the front camera 1111. However, the specifications of the front camera of the mobile phone are generally low, and the image quality and effect taken by using the front camera are poor.

[0103] 2. Inward folding screen mobile phone

[0104] For example, Figure 3 This is a schematic diagram of the structure of an example of an inward folding screen mobile phone provided in an embodiment of the present application. For the sake of clarity, Figure 3 The front and back views of the inward folding screen mobile phone 20 are displayed.

[0105] like Figure 3 As shown, the inner folding screen mobile phone 20 includes a first structural member 21, a second structural member 22, and a connecting component 23 (located at Figure 3 In the position shown by the dotted line in (a) of the figure), the first structural member 21 and the second structural member 22 are flipped and folded through the connecting component 23.

[0106] The first structural member 21 may include a first inner display screen 211 and a back shell 212. The first inner display screen 211 is provided with a first front camera 2111. The first back shell 212 is provided at the back of the first inner display screen 211. The back shell 212 may be provided with a rear camera 2122.

[0107] The second structural member 12 may include a second inner display screen 221 and an outer display screen 222 (also referred to as a second screen). The second inner display screen 221 is disposed opposite to the outer display screen 222. The outer display screen 222 may be provided with a second front camera 2221.

[0108] During use, the angle between the first structural member 21 and the second structural member 22 is changed by the connecting component 23 to realize various forms of the inner folding screen mobile phone 20. It can be understood that the second inner display screen 221 and the first inner display screen 211 can actually be an integrally formed flexible display screen (i.e., a folding screen, also referred to as the inner display screen or the first screen of the inner folding screen mobile phone). When the inner folding screen mobile phone 20 is folded by the connecting component 23, the connecting component 23 divides the screen into two parts: the second inner display screen 221 and the first inner display screen 211.

[0109] like Figure 3 As shown in Figure (a), when the angle between the first structural member 21 and the second structural member 22 is approximately 180°, the inner folding screen mobile phone 20 is in the unfolded state. At this time, the surface of the first back shell 212 and the surface of the outer display screen 222 are approximately in the same plane. At this time, the outer display screen 222 and the rear camera 2122 are on the same side. The surfaces of the first inner display screen 211 and the second inner display screen 221 are approximately in the same plane. In the unfolded state, the light emitting direction of the outer display screen 222 is opposite to the light incoming direction of the rear camera 2122. In the unfolded state, the outer display screen 222 is in the off-screen state, and the inner folding screen mobile phone 20 simultaneously displays the content to be displayed through the first inner display screen 211 and the second inner display screen 221. It should be noted that in the off-screen state, the outer display screen 222 cannot receive the user's touch operation.

[0110] The foldable phone 20 is in Figure 3 In the unfolded state shown in FIG. (a), when the first inner display screen 211 and the second inner display screen 221 are both on, the user can turn the inner folding screen mobile phone 20 inward ( Figure 3 The inner folding screen mobile phone 20 is folded in the direction indicated by the arrow in (a) to put it into the support state. Figure 3 As shown in Figure (b).

[0111] When the inner folding screen mobile phone 20 is in the bracket state, if the angle between the first structural member 21 and the second structural member 22 is greater than 45°, the first inner display screen 211 and the second inner display screen 221 are kept lit at the same time. When the angle between the first structural member 21 and the second structural member 22 gradually decreases to about 45°, the first inner display screen 211 and the second inner display screen 221 are turned off, and the outer display screen 222 is turned on, and the outer display screen 222 displays the content to be displayed. In the subsequent folding process, only the outer display screen 222 is kept lit until the angle between the first structural member 21 and the second structural member 22 is about 0°, as shown in the figure. Figure 3 The folded state shown in Figure (c).

[0112] like Figure 3 As shown in Figure (c), when the inner folding screen mobile phone 20 is in the folded state, the first inner display screen 211 and the second inner display screen 221 are opposite to each other and are folded inward, and the outer display screen 222 is located outside. In the folded state, the light emitting direction of the outer display screen 222 is the same as the light entering direction of the rear camera.

[0113] In the above Figure 3 With the structural support of the inner folding screen mobile phone 20 shown, in the rear non-selfie scene in the unfolded state, the user can use the rear camera 2122 to shoot people or objects around him, and the captured image can be displayed simultaneously through the first inner display screen 211 and the second inner display screen 222, such as Figure 4 At the same time, in the front self-portrait scene in the unfolded state, the user can also use the first front camera 2111 to take a selfie, and the captured image can be displayed simultaneously on the first inner display screen 211 and the second inner display screen 221, as shown in FIG. Figure 4 As shown in Figure (b).

[0114] In the non-selfie scene of the rear camera in the folded state, the user can use the rear camera 2122 to shoot people or objects around him, and the shot image is displayed through the external display screen 222, such as Figure 4 In the folded state, the user can also use the second front camera 2221 to take a selfie, and the captured image is displayed on the external display screen 222, as shown in FIG. Figure 4 As shown in Figure (d).

[0115] Depend on Figure 4 It can be seen that for an inner folding screen mobile phone, a user can take a selfie through the first front camera 2111 or the second front camera 2221. However, the specifications of the front camera of a mobile phone are generally low, and the image quality and effect obtained by using the front camera are poor.

[0116] That is to say, whether it is an external folding screen mobile phone or an internal folding screen mobile phone, you can only take selfies with the front camera. The image quality and effect taken with the front camera are poor.

[0117] In view of this, an embodiment of the present application provides a photographing method, which provides a rear selfie (also called super selfie or rear super selfie, etc.) function for the user when the external screen mobile phone is in a folded state or the internal folding screen mobile phone is in an unfolded state. After the rear selfie function is enabled, the mobile phone starts the rear camera to capture images, and controls the screen on the same side as the rear camera to light up, and the user can control the photo taking and view the captured images through the screen. Specifically, for the external folding screen mobile phone, after the rear selfie function is enabled, the mobile phone starts the rear camera streaming and controls the secondary screen to light up. For the internal folding screen mobile phone, after the rear selfie function is enabled, the mobile phone starts the rear camera streaming and controls the external display screen to light up. In this way, users can take selfies through the rear camera, improve the shooting quality and shooting effect of selfies, and thus improve the user's shooting experience.

[0118] First of all, taking the foldable screen mobile phone as an example, the operation process of the rear selfie function and the interface change process in the embodiment of the present application are explained.

[0119] To facilitate understanding, several terms involved in the following embodiments are first explained.

[0120] 1. Enable the function

[0121] In the embodiment of the present application, when the foldable screen mobile phone has a certain function, turning on the function means turning on the switch of the function so that the foldable screen mobile phone can use the function. After turning on a certain function, the function is said to be in an on state, an on state, or the function is said to be turned on.

[0122] 2. Turn off the function

[0123] In the embodiment of the present application, when the folding screen mobile phone has a certain function, turning off the function means turning off the switch of the function so that the folding screen mobile phone cannot use the function. After turning off a certain function, the function is said to be in a turned-off state, or the function is said to be turned off.

[0124] 3. Enter the function

[0125] In the embodiment of the present application, entering a certain function means starting to use the function through user operation or automatic triggering of the foldable screen mobile phone when the function is turned on. Entering a function is also called enabling a function or starting a function.

[0126] 4. Exit function

[0127] In the embodiment of the present application, exiting a certain function means, when the folding screen mobile phone turns on the function, stopping the use of the function through user operation or automatic triggering of the folding screen mobile phone.

[0128] In the implementation of this application, the camera application in the folding screen mobile phone has a rear selfie function. When the rear selfie function is turned on, the user can take selfies through the rear camera to improve the quality and effect of the selfie image. The following describes the relevant operation process and interface change process based on the use stage of the rear selfie function and the application scenario.

[0129] 1. Turning the rear selfie function on and off

[0130] 1. Enable the rear selfie function

[0131] For example, Figure 5 908 (also called the second preview interface) is displayed on the main screen. The photo preview interface 908 includes the photos captured by the rear camera, such as the photo taken by the rear camera, ... Figure 5 In other words, when the photo preview interface 908 is folded and the rear selfie function is turned off, the rear non-selfie scene preview interface. Figure 5As shown in FIG. 1 (a), when the rear selfie function is turned on, the photo preview interface 908 includes a camera flip control 909 (also referred to as a second control). The camera flip control 909 is used for the user to control the switch between the rear camera and the front camera.

[0132] The photo preview interface 908 also includes a setting control 903. The user clicks the setting control 903, and the folding screen mobile phone responds to the user's operation and displays the camera setting interface 904, such as Figure 5 The camera setting interface 904 includes a rear selfie option 905. The user clicks the rear selfie option 905, and the foldable screen mobile phone responds to the user's operation and displays a rear selfie setting interface 906, as shown in FIG. Figure 5 As shown in Figure (c).

[0133] The rear Selfie setting interface 906 includes a switch control of the rear Selfie function (referred to as the rear Selfie switch) 907. Figure 5 As shown in Figure (c) of FIG. 1 , the rear selfie switch 907 is in the off state and is grayed out. The user clicks the rear selfie switch 907, and the foldable screen mobile phone responds to the user's operation and turns on the rear selfie function, and the rear selfie switch 907 is highlighted. Figure 5 As shown in Figure (d).

[0134] Afterwards, the user can perform two return operations, exiting the rear selfie setting interface 906 and exiting the camera setting interface 904, and the folding screen mobile phone displays the photo preview interface 901 (also called the first preview interface), such as Figure 5 As shown in Figure (e) in the figure. The photo preview interface 901 is a preview interface for the rear non-selfie scene when the photo preview interface 901 is in a folded state and the rear selfie function is turned on. Unlike the photo preview interface 908, the photo preview interface 901 displays a rear selfie control (also called a first control) 902. The rear selfie control is used to enter the rear selfie function. Optionally, the return operation can be, for example, a side-slip operation (i.e., sliding inward from the side of the screen), clicking the return key in the three-button navigation bar, or clicking the return control in the interface, etc., and the embodiments of the present application do not limit this. The same is true for the return operation in the following embodiments, which will not be repeated.

[0135] It is understandable that the rear selfie function of the foldable screen mobile phone can be turned on by default when it leaves the factory. After that, the user can turn off the rear selfie function as needed during use.

[0136] 2. Turn off the rear selfie function

[0137] The process of turning off the rear Selfie function is similar to the above-mentioned turning on process. The difference is that the turning on process is to switch the rear Selfie switch 907 from the off state to the on state, while the turning off process is to switch the rear Selfie switch 907 from the on state to the off state. It will not be repeated here.

[0138] It should be noted that the above-mentioned process of turning on and off the rear selfie function is described by taking the folding screen mobile phone in the folded state as an example. When the folding screen mobile phone is in the unfolded state, the rear selfie function can also be turned on or off. The operation process and the interface change process are similar to the above process and will not be repeated. In addition, in this embodiment, the rear selfie setting interface 906 is entered through the camera setting interface 904 to turn on or off the rear selfie function. In other embodiments, the rear selfie setting interface 906 can also be entered by other means. For example, the rear selfie setting interface 906 can be entered through the setting application of the folding screen mobile phone. This application does not impose any limitation on this.

[0139] In this embodiment, the user can independently set the on and off of the rear selfie function as needed to meet the usage requirements of different scenarios, facilitate user operation, and improve user experience.

[0140] 2. Flip wake-up settings

[0141] In an embodiment of the present application, when the rear selfie function is turned on, the camera application of the foldable screen mobile phone may also have a "flip wake-up rear selfie function" (referred to as the flip wake-up function). The flip wake-up function is off by default, and the user can manually turn on the function. After the flip wake-up function is turned on, when the user performs the flip wake-up operation according to the flip wake-up requirement, that is, the user lifts the phone to face the face and looks at the screen, and then the user flips the phone and lifts the phone to face the face. The foldable screen mobile phone recognizes the face through the front camera, detects that the user flips the phone through the sensor, and then recognizes the face through the rear camera, triggering the camera application to automatically enter the rear selfie function.

[0142] The setting process of the flip wake-up function is similar to that of the rear selfie function, which is briefly described below with reference to the accompanying drawings.

[0143] 1. Enable the flip wake-up function

[0144] For example, Figure 6 This is a schematic diagram of the interface changes during the setting process of the flip wake-up function provided in an embodiment of the present application. Figure 6 As shown in Figure (a), when the foldable screen mobile phone is in the folded state, after the camera application is started, the user can Figure 5 The process shown in Figures (a) to (c) in FIG. 1 enters the rear selfie setting interface 906. For the specific process, see Figure 5The illustrated embodiments will not be described in detail.

[0145] like Figure 6 As shown in Figure (a) in the figure, the rear selfie switch 907 in the rear selfie setting interface 906 is now in the on state and is highlighted. The rear selfie setting interface 906 includes a switch control (referred to as the flip wake-up switch) 1001 for flipping and waking up the rear selfie function. The flip wake-up switch 1001 is in the off state by default and is grayed out. The user clicks the flip wake-up switch 1001, and the foldable screen mobile phone responds to the user's operation and turns on the flip wake-up function, and the flip wake-up switch 1001 is highlighted, as shown in Figure 1. Figure 6 As shown in Figure (b).

[0146] Afterwards, the user performs two return operations, and the foldable screen mobile phone successively exits the rear selfie setting interface 906 and the camera setting interface 904, and restores the photo preview interface 901. Figure 6 As shown in Figure (c).

[0147] 2. Turn off the flip wake function

[0148] The closing process of the flip wake-up function is similar to the above-mentioned opening process, except that the closing process is to switch the flip wake-up switch 1001 from the on state to the off state, which will not be repeated here.

[0149] In this embodiment, the user can independently set the flip wake-up function to be turned on and off as needed to meet the different usage habits of the user, to meet the needs of different usage scenarios of the user, to facilitate user operation, and to improve user experience.

[0150] 3. The introduction of the rear selfie function

[0151] When the rear selfie function is turned on, the user can enter the rear selfie function through the corresponding operation when using the camera application. After entering the rear selfie function, the main screen of the folding screen mobile phone goes out, the sub-screen lights up, the folding screen mobile phone obtains the image through the rear camera, and displays the photo preview interface 1106 (also called the fourth preview interface) on the sub-screen, and the photo preview interface 1106 includes the image obtained by the rear camera. In other words, the photo preview interface 1106 is the photo preview interface in the rear selfie scene, that is, the photo preview interface when the rear selfie function is used. When the folding screen mobile phone displays the photo preview interface 1106, the user can take a selfie through the rear camera after flipping the phone. The image quality and effect obtained by the selfie are better, which improves the user experience. Moreover, in the process of using the rear selfie function, the user can perform selfie-related operations through the sub-screen, which is convenient to use and further improves the user experience.

[0152] In the embodiments of the present application, a variety of ways to enter the rear selfie function are provided, which are described below in combination with the scenarios.

[0153] 1. Click the rear selfie control to enter the rear selfie function

[0154] As described above, the rear Selfie function of the foldable screen mobile phone is turned on by default when it leaves the factory. When the user starts the camera application of the foldable screen mobile phone, the foldable screen mobile phone starts the photo preview interface 901 by default, and the user can enter the rear self-timer by clicking the rear self-timer control in the photo preview interface 901. Optionally, when the user starts the camera application of the foldable screen mobile phone for the first time, guidance information can also be displayed in the photo preview interface 901 to guide the user to use the rear Selfie function, so that the user can understand how to use the rear Selfie function and improve the user experience.

[0155] For example, Figure 7 1 is a schematic diagram of an interface change in the process of clicking the rear Selfie control to enter the rear Selfie function provided by an embodiment of the present application. Figure 7 As shown in Figure (a), when the foldable screen mobile phone is in the folded state, the secondary screen of the foldable screen mobile phone is in the off state, the main screen is in the on state, and the main screen displays the main interface 1101.

[0156] It should be noted that, in general, when the folded phone is in the main screen state, the user will turn the main screen of the foldable phone toward the user and the secondary screen (i.e., the side where the rear camera is) toward the user. The embodiments of this application are described using this as an example to facilitate description of the situation before and after the user flips the foldable phone.

[0157] The main interface 1101 includes a camera application icon 1102. The user clicks the camera application icon 1102 (clicking the camera application icon is also referred to as a second operation) to trigger the camera application to start. In response to the user's operation, the foldable screen mobile phone acquires an image through the rear camera by default, and displays the photo preview interface 901 through the main screen, such as Figure 7 As shown in Figure (b).

[0158] The user clicks on the rear selfie control 902 in the photo preview interface 901. In response to the user's operation, the foldable screen mobile phone displays a flip guide interface 1105 through the main screen, such as Figure 7As shown in Figure (c) in the figure. The flip guide interface 1105 is used to guide the user to flip the folding screen mobile phone so that the side where the secondary screen is located (i.e., the side where the rear camera is located) faces the user and the side where the main screen is located faces away from the user. Optionally, the flip guide interface 1105 may include text prompt information 1151, an arrow 1152 indicating the flip direction, and a schematic diagram 1153 of a folding screen mobile phone. Optionally, the flip guide interface 1105 may continuously display multiple schematic diagrams 1153 of a folding screen mobile phone at different angles to present a dynamic picture of flipping the mobile phone, so as to more clearly guide the user to flip the mobile phone and improve the user experience. Optionally, the text reminder message 1151 may be, for example, "Please flip the phone and use the rear camera for selfie."

[0159] After the flipping guide interface 1105 is displayed for a preset time (for example, 3 seconds), the camera application enters the rear selfie function. Specifically, the folding screen mobile phone turns off the main screen and controls the secondary screen to light up. At the same time, the image is acquired through the rear camera, and the photo preview interface 1106 is displayed through the secondary screen. The photo preview interface 1106 includes the image acquired by the rear camera. After the user flips the folding screen mobile phone, the side where the secondary screen is located (that is, the side where the rear camera is located) faces the user, and the side where the main screen is located faces away from the user. In this way, the user's own image (that is, the selfie image) acquired by the rear camera can be displayed in the photo preview interface 1106. Figure 7 As shown in Figure (d).

[0160] Optionally, in some other embodiments, when the main screen displays the flipping guide interface 1105, the secondary screen may light up at the same time, and acquire an image through the rear camera, and display the photo preview interface 1106 through the secondary screen. In other words, after the user clicks the rear selfie control, the secondary screen displays the flipping guide interface 1105, and the secondary screen lights up, and displays the photo preview interface 1106 through the secondary screen.

[0161] Optionally, while the secondary screen displays the flip guide interface 1105, the folding screen mobile phone can block the touch function of the main screen and the secondary screen. That is, within a preset time (for example, 3 seconds) after the user clicks the rear selfie control 902, the touch function of the main screen and the secondary screen is blocked. This can prevent users from accidentally touching the screen and improve the user experience.

[0162] The photo preview interface 1106 includes a photo control 1107. When the user clicks the photo control 1107, the electronic device saves the image acquired by the rear camera.

[0163] Optionally, the shooting modes supported by the rear Selfie function may include photo mode, video mode, portrait mode, night scene mode, etc. As a possible implementation, after the user enters the rear Selfie function through the above process, the default shooting mode is consistent with the shooting mode before entering the rear self-timer function, that is, the shooting mode in the photo preview interface 1106 is consistent with the shooting mode in the photo preview interface 901. In this way, the user's choice can be inherited and the user experience can be improved. Of course, after entering the rear Selfie function, the user can also switch the shooting mode to other modes as needed.

[0164] 2. Flip the phone to wake up the rear selfie function

[0165] As mentioned above, the camera application of the foldable screen mobile phone can have a flip wake-up rear selfie function. When the flip wake-up rear selfie function and the rear selfie function are turned on at the same time, the foldable screen mobile phone can automatically detect the user's operation. If it is detected that the user performs a flip wake-up operation, the camera application automatically enters the rear selfie function. In this way, the user does not need to perform operations such as clicking on the rear selfie control in the interface, and can quickly and conveniently enter the rear selfie function, thereby improving the intelligence of the mobile phone and thus improving the user experience. The following is an explanation with reference to the accompanying drawings.

[0166] For example, Figure 8 This is a schematic diagram of the interface changes during the process of flipping a mobile phone to wake up the rear selfie provided in an embodiment of the present application. Figure 8 As shown in Figure (a), when the foldable screen mobile phone is in the folded state, the secondary screen of the foldable screen mobile phone is in the off state, and the main screen is in the on state. When the foldable screen mobile phone starts the camera application and the rear selfie function is turned on but not entered, the main screen displays the photo preview interface 901. At this time, the side where the main screen of the foldable screen mobile phone is facing the user, and the side where the secondary screen is facing away from the user.

[0167] If the user wants to use the rear selfie function, the user performs a flip wake-up operation, lifts the foldable screen phone, makes the main screen of the foldable screen phone face the face and stares at the screen, then the user flips the foldable screen phone so that the side with the secondary screen faces the user and the side with the main screen faces away from the user. In this process, the foldable screen phone recognizes the face through the front camera, and detects through the sensor that the user flips the phone, then recognizes the face through the rear camera, the camera application directly enters the rear selfie function, the foldable screen phone controls the main screen to turn off, the secondary screen to light up, and displays the photo preview interface 1106 on the secondary screen, as shown in FIG. Figure 8 As shown in Figure (b).

[0168] When the user wants to exit the rear selfie function, the user can follow the reverse process of the above process (called flip exit operation), lift the foldable screen phone, make the secondary screen of the foldable screen phone face the face and look at the screen, then flip the foldable screen phone so that the main screen is facing the user and the secondary screen is facing away from the user. The foldable screen phone recognizes the face through the rear camera, detects that the user flips the phone, and recognizes the face through the front camera, then directly exits the rear selfie function, the secondary screen turns off, the main screen lights up, and displays the photo preview interface 901 on the main screen, as shown in FIG. Figure 8 As shown in Figure (a).

[0169] 3. Enter the rear selfie function through the desktop shortcut menu (also known as the desktop long press menu shut cut)

[0170] In this embodiment, when the rear-camera selfie function is turned on, the user can also directly enter the rear-camera selfie function through the desktop shortcut menu, without the user having to open the photo preview interface 901 or click on the rear-camera selfie control in the photo preview interface 901, thereby simplifying the user's operation process of entering the rear-camera selfie function and improving the user experience.

[0171] For example, Fig. 9 A schematic diagram of the interface changes in the process of entering the rear selfie function through the desktop shortcut menu provided in an embodiment of the present application. When the foldable screen mobile phone is in the folded state, the secondary screen of the foldable screen mobile phone is in the off state, the main screen is in the on state, and the main screen displays the main interface 1101, such as Fig. 9 As shown in Figure (a).

[0172] The main interface 1101 includes a camera application icon 1102. The user long presses the camera application icon 1102, and the foldable screen mobile phone responds to the user's operation, displays a mask in the interface, and displays a shortcut menu (also called a first service card) 1301 of the camera application, such as Fig. 9 As shown in Figure (b).

[0173] The shortcut menu 1301 includes a selfie option 1302. When the rear selfie function is turned on, the user clicks the selfie option 1302, the foldable screen mobile phone starts the camera application, and displays the flip guide interface 1105 through the main screen, such as Fig. 9 As shown in Figure (c).

[0174] After the flip guide interface 1105 is displayed for a preset time, the camera application enters the rear selfie function. Specifically, the folding screen mobile phone turns off the main screen and controls the secondary screen to light up. At the same time, the image is obtained through the rear camera, and the photo preview interface 1106 is displayed on the secondary screen. The photo preview interface 1106 includes the image obtained by the rear camera, such as Fig. 9 As shown in Figure (d).

[0175] It should be noted that when the user clicks on the selfie option 1302, if the rear selfie function is turned off, the foldable screen mobile phone starts the camera application, obtains the image through the front camera, and displays the photo preview interface 1501 (also called the third preview interface) through the main screen. The photo preview interface 1501 displays the image obtained by the front camera. The photo preview interface 1501 is a preview interface for the front selfie scene. The front selfie scene refers to the scene of taking a selfie with the front camera. For the photo preview interface 1501, please refer to the subsequent embodiments. Fig.11 Interface 1501 in.

[0176] For example, Fig.10 This is another example of the interface changes in the process of entering the rear Selfie function through the desktop shortcut menu provided in the embodiment of the present application. Fig. 9 As shown in Figure (b) Fig.10 As shown in Figure (a) in FIG. 1 , when the foldable screen mobile phone displays the shortcut menu 1301 of the camera application, the user can also long press and drag the selfie option 1302 to a certain position in the main interface 1101. After the user raises his hand, a desktop shortcut icon (referred to as the selfie shortcut icon, also called the selfie icon) 1401 of the selfie function is displayed at the position where the hand is raised. Fig.10 As shown in Figure (b).

[0177] When the rear selfie function is turned on, the user clicks the selfie shortcut icon 1401, and the foldable screen mobile phone responds to the user's operation, starts the camera application, and displays the flip guide interface 1105 through the main screen, such as Fig.10 After the flipping guide interface 1105 displays the preset time, the camera application enters the rear Selfie function and displays the photo preview interface 1106, as shown in FIG. Fig.10 As shown in Figure (d).

[0178] Similarly, when the user clicks on the selfie shortcut icon 1401, if the rear selfie function is turned off, the foldable screen mobile phone obtains the image through the front camera and displays the photo preview interface 1501 through the main screen. The photo preview interface 1501 includes the image obtained through the front camera.

[0179] 4. Enter the rear selfie function from the front selfie scene

[0180] When the foldable phone is in the folded state and the rear selfie function is turned off, the camera app can enter the front selfie scene. In the front selfie scene, the user can turn on the rear selfie function again. After the rear selfie function is turned on, the foldable phone directly guides the user to flip the phone, and then the camera app automatically enters the rear selfie function without the user having to return to the photo preview interface or click on the rear selfie control, which improves user convenience and further improves the user experience.

[0181] Optionally, when the rear selfie function is turned off, the user can Fig. 9 The selfie option 1302 shown in the figure enters the front selfie scene, or you can click the above Fig.10 The selfie shortcut icon 1401 shown enters the front selfie scene.

[0182] Optionally, the user can also enter the front selfie scene by flipping the camera control in the photo preview interface 908. The following is a description of the process of entering the front selfie scene and entering the rear selfie function from the front selfie scene in conjunction with the accompanying drawings.

[0183] For example, Fig.11 and Fig.12 This is a schematic diagram of an interface change in a process of entering a rear selfie function from a front selfie scene provided in an embodiment of the present application, wherein: Fig.12 Figure (a) continues Fig.11 Figure (d) in .

[0184] like Fig.11 As shown in Figure (a), the foldable screen mobile phone is in a folded state, the secondary screen of the foldable screen mobile phone is in an off state, and the main screen is in an on state. When the rear selfie function is turned off, after the camera application of the foldable screen mobile phone is started, the main screen displays a photo preview interface 908, which includes an image obtained by the rear camera.

[0185] The photo preview interface 908 also includes a flip camera control 909. The user clicks the flip camera control 909, and the folding screen mobile phone responds to the user's operation, switches the rear camera to the front camera, obtains an image through the front camera, and displays the photo preview interface 1501 through the main screen. For example, the user selects the portrait mode in the front selfie mode, and the folding screen mobile phone displays the following Fig.11 The photo preview interface 1501 is shown in FIG.

[0186] The photo preview interface 1501 includes a setting control 903. The user clicks the setting control 903, and in response to the user's operation, the folding screen mobile phone displays a camera setting interface 904, such as Fig.11As shown in Figure (c) in FIG. 904, the camera setting interface 904 includes a rear selfie option 905. The user clicks the rear selfie option 905, and in response to the user's operation, the foldable screen mobile phone displays a rear selfie setting interface 906, as shown in FIG. Fig.11 As shown in Figure (d).

[0187] The rear selfie setting interface 906 includes a rear selfie switch 907. The rear selfie switch 907 is currently in an off state and is grayed out. The user clicks the rear selfie switch 907, and the foldable screen mobile phone responds to the user's operation and turns on the rear selfie function, and the rear selfie switch 907 is highlighted. Fig.12 As shown in Figure (a).

[0188] Afterwards, the user performs a return operation. In response to the user's operation, the foldable screen mobile phone exits the rear selfie setting interface 906 and displays the camera setting interface 904 through the main screen. Fig.12 As shown in Figure (b) in the figure. Then, the user performs a return operation again. In response to the user's operation, the foldable screen mobile phone exits the camera setting interface 904 and displays the flip guide interface 1105 through the main screen, as shown in Figure (b). Fig.12 As shown in Figure (c).

[0189] After the flip guide interface 1105 is displayed for a preset time, the camera application enters the rear selfie function, the folding screen mobile phone controls the main screen to turn off, the sub-screen to light up, and at the same time, the image is obtained through the rear camera, and the photo preview interface 1106 is displayed through the sub-screen. The photo preview interface 1106 includes the image obtained by the rear camera, such as Fig.12 As shown in Figure (d).

[0190] 4. Exit the rear selfie function

[0191] In the embodiment of the present application, there are many ways to exit the rear Selfie function, such as returning operation (such as sliding inward from the side of the screen, clicking the return control or clicking the return key, etc.), automatically turning off the screen in power saving mode, pressing the power button of the mobile phone, clicking the switch home screen control or flip camera control in the photo preview interface 1106, unfolding the outer folding screen mobile phone to the unfolded state, etc. Two examples are listed below.

[0192] 1. Unfold the phone to exit the rear selfie function

[0193] In this embodiment, during the use of the rear selfie function, if the user unfolds the folding screen mobile phone, the camera application exits the rear selfie function and enters the rear non-selfie scene in the unfolded state. The rear non-selfie scene in the unfolded state means that the folding screen mobile phone obtains an image through the rear camera, and displays the photo preview interface 1801 through the main screen and the sub-screen, and the photo preview interface 1801 includes the image obtained by the rear camera. In other words, the photo preview interface 1801 is a photo preview interface for the unfolded rear non-selfie scene. The user unfolds the folding screen mobile phone to the unfolded state, which means that the user no longer needs the rear selfie function, so directly entering the unfolded state rear shooting scene is likely to meet the user's usage needs and improve the user experience.

[0194] For example, Fig.13 This is a schematic diagram of the interface changes of a mobile phone during the use of the rear Selfie function provided in an embodiment of the present application. Fig.13 As shown in Figure (a), the user is using the rear selfie function, and the foldable screen mobile phone displays a photo preview interface 1106 through the secondary screen, and the photo preview interface 1106 includes an image obtained by the rear camera. At this time, the side where the secondary screen of the foldable screen mobile phone is located (that is, the side where the rear camera is located) faces the user, and the side where the main screen is located is facing away from the user.

[0195] The user unfolds the foldable screen mobile phone and switches the foldable screen mobile phone to the unfolded state. In this way, the main screen and the secondary screen of the foldable screen mobile phone are facing the user, and the first back shell, the second back shell and the rear camera are facing away from the user. In response to the user's operation, the foldable screen mobile phone continues to obtain images through the rear camera. At the same time, the secondary screen lights up, and the main screen and the secondary screen jointly display the photo preview interface 1801. The photo preview interface 1801 includes the image obtained by the rear camera, such as Fig.13 As shown in Figure (b).

[0196] Optionally, after the user unfolds the foldable screen mobile phone through the above process and the foldable screen mobile phone enters the unfolded state and the rear camera scene, the default shooting mode is consistent with the shooting mode when the rear selfie function is used, that is, the shooting mode in the photo preview interface 1801 is consistent with the shooting mode in the photo preview interface 1106. In this way, the user's choice can be inherited and the user experience can be improved.

[0197] 2. Click to switch the main screen controls or flip the camera controls to exit the rear selfie function

[0198] When the user is using the rear Selfie function, the user can exit the rear Selfie function by switching the main screen control or flipping the camera control in the photo preview interface 1106, or by switching the main screen control in the photo preview interface. After exiting the rear Selfie function, the camera application enters the rear non-Selfie scene in the folded state, the folding screen turns off the secondary screen, and the photo preview interface 901 is displayed on the main screen. In other words, when the user is using the rear Selfie function, the user can exit the function at any time with one click, which is convenient for user operation and use, and improves the user experience.

[0199] For example, Fig.14 This is a schematic diagram of an example of interface changes when clicking a control to exit the rear selfie function provided in an embodiment of the present application. Fig.14 As shown in Figure (a), the user is using the rear selfie function, and the foldable screen mobile phone displays a photo preview interface 1106 through the secondary screen. The photo preview interface 1106 includes a switch main screen control 2123 and a flip camera control 909. At this time, the side where the secondary screen of the foldable screen mobile phone is located (that is, the side where the rear camera is located) faces the user, and the side where the main screen is located is facing away from the user.

[0200] The user clicks the switch main screen control 2123, or clicks the flip camera control 909. In response to the user's operation, the folding screen mobile phone displays the flip guide interface 2201 through the secondary screen, such as Fig.14 As shown in (b) of the figure. The flip guide interface 2201 is used to guide the user to flip the foldable screen mobile phone so that the side where the main screen is located faces the user and the side where the secondary screen is located (i.e., the side where the rear camera is located) faces away from the user. Optionally, the flip guide interface 2201 may include text prompt information 2211, an arrow 2212 indicating the flip direction, and a foldable screen mobile phone schematic diagram 2213. Optionally, multiple foldable screen mobile phone schematic diagrams at different angles can be displayed continuously to present a dynamic picture of flipping the mobile phone in the flip guide interface 2201, so as to more clearly guide the user to flip the mobile phone and improve the user experience. Optionally, with Fig.14 Different from the text reminder message 1941 in the interface, the text reminder message 2211 in this interface may be, for example, "The rear selfie has been exited, please turn over the phone."

[0201] After the flipping guide interface 2201 is displayed for a preset time, the camera application exits the rear selfie function. Specifically, the folding screen mobile phone turns off the secondary screen and controls the main screen to light up. At the same time, the image is acquired through the rear camera, and the photo preview interface 901 is displayed through the main screen. The photo preview interface 901 includes the image acquired by the rear camera. After the user flips the mobile phone, the photo preview interface 901 can display the image of the surrounding people or objects acquired by the rear camera, such as Fig.14 As shown in Figure (c).

[0202] In the above embodiments, the user can independently control the opening and closing of the rear Selfie function as an example. In other embodiments, the rear Selfie function of the electronic device may also be continuously turned on, that is, the rear Selfie function is continuously available. In this case, the user does not need to control the opening and closing of the rear Selfie function, and the rear Selfie control and the camera flip control are displayed simultaneously in the photo preview interface. Alternatively, the user can set the default Selfie mode to rear Selfie or rear non-Selfie in the camera settings interface, thereby selecting the control displayed by default in the shooting preview interface as the rear Selfie control or the camera flip control.

[0203] When the rear selfie function is continuously available, when the camera application is in the front selfie scene, the photo preview interface may further include a rear selfie control, so that the user can directly click on the rear selfie control to enter the rear selfie function.

[0204] For example, Fig.15 This is another example of the interface change process of entering the rear Selfie function from the front Selfie scene provided by the embodiment of the present application. Fig.15 As shown in FIG. 2 (a), the foldable screen mobile phone is in a folded state, the main screen is in a light-on state, the secondary screen is in a light-off state, the camera application is started, and the main screen displays a photo preview interface 2304. The photo preview interface 2304 includes an image obtained by the rear camera.

[0205] The photo preview interface 2304 includes a flip camera control 909. When the user clicks the flip camera control 909, the front selfie scene is entered in response to the user's operation, and the photo preview interface 2401 is displayed. The photo preview interface 2401 includes an image obtained by the front camera, such as Fig.15 As shown in Figure (b) in the figure. In addition, the photo preview interface 2401 also includes a rear selfie control 2402 (also called a third control). Optionally, when the folding screen mobile phone detects that it is currently in a dark environment, a prompt message can be displayed in the rear selfie space 2402 to prompt the user to use the rear selfie function. Optionally, the prompt message can be displayed in the form of a bubble or the like for a preset duration. The content of the prompt message may, for example, be "Use the rear super-sensitive lens for selfies for better results".

[0206] The user clicks on the rear selfie control 2402. In response to the user's operation, the foldable screen mobile phone displays a flip guide interface 1105 through the main screen, such as Fig.15 As shown in Figure (c).

[0207] After the flip guide interface 1105 is displayed for a preset time, the camera application enters the rear selfie function. Specifically, the folding screen mobile phone turns off the main screen and controls the secondary screen to light up. At the same time, photos are obtained through the rear camera, and the photo preview interface 1106 is displayed on the secondary screen. The photo preview interface 1106 includes photos obtained by the rear camera, such as Fig.15 As shown in Figure (d).

[0208] In this embodiment, in the front-camera selfie scenario, the interface includes a rear-camera selfie control, and the user can directly click the control to enter the rear-camera selfie function, which facilitates user operation and improves user experience.

[0209] In another embodiment, when the rear selfie function is continuously available, the foldable screen mobile phone is in a folded state, the main screen is in a light state, the secondary screen is in a light-off state, the camera application is started, and the main screen displays the following Fig.15 When the photo preview interface 2304 shown in FIG. (a) is displayed, the user can enter the camera setting interface by clicking the setting control in the photo preview interface 2304. In the camera setting interface, the default selfie mode is set to the rear selfie. After that, the user exits the camera setting interface, and the foldable screen mobile phone displays the flip guide interface 1105. After the flip guide interface 1105 displays the preset time, the camera application enters the rear selfie function.

[0210] If the rear selfie function is still available, the user can Fig. 9 or Fig.10 In the embodiment of the present invention, when the rear-mounted selfie function is entered through the desktop shortcut menu, in response to the user clicking the selfie option 1302 or the selfie shortcut icon 1401, the camera application is started and enters the corresponding photo preview interface according to the default selfie mode set by the user.

[0211] It can be understood that when the rear-camera selfie function continues to be available, the method of entering the rear-camera selfie function through other scenarios is the same or similar to the case where the user can set the rear-camera selfie function to be turned on and off, and will not be repeated here.

[0212] It can be seen from the above embodiments that for an outward folding screen mobile phone, when the mobile phone is in a folded state, in response to the user entering the operation of the rear selfie function, the outward folding screen mobile phone can acquire images through the rear camera, control the secondary screen to light up, control the main screen to turn off, and display the photo preview interface 1106 corresponding to the rear selfie function through the secondary screen.

[0213] Specifically, for the external folding screen, referring to the above embodiment, the scene, interface, and running camera before the user enters the rear selfie function, and the corresponding operation of entering the rear selfie function can be summarized as shown in Table 1:

[0214] Table 1

[0215]

[0216] In addition, when the user is using the rear-mounted selfie function to take a photo, in response to the user's operation to exit the rear-mounted selfie function, the external folding screen mobile phone can exit the current rear-mounted selfie function, control the secondary screen to turn off, control the main screen to turn on, or control the main screen and secondary screen to turn on at the same time, and display the corresponding interface after exiting.

[0217] Among them, for the external folding screen, the user's operation of exiting the rear selfie function can be as described in the above embodiment, including: clicking to switch the main screen control, clicking to flip the camera control, flipping the exit operation, unfolding the external folding screen mobile phone to the unfolded state, etc. Of course, the operation of exiting the rear selfie function is not limited to this, for example, it can also include a return operation (such as sliding inward from the side of the screen, clicking the return control or clicking the return key, etc.), automatically turning off the screen in power saving mode, pressing the power button of the mobile phone, etc.

[0218] The above method provided by the present application is described by taking an external folding screen mobile phone as an example. In some other embodiments, the above method can also be applied to an internal folding screen mobile phone.

[0219] When the inner folding screen mobile phone realizes the functions described in the above embodiments, unlike the outer folding screen mobile phone, the inner folding screen, when in the unfolded state, displays the interface of the main screen of the outer folding screen mobile phone in the folded state through the first inner display screen and the second inner display screen. When the camera application enters the rear selfie function, the first inner display screen and the second inner display screen are turned off, and the outer display screen is turned on, and the photo preview interface under the rear selfie function is displayed through the outer display screen. In addition, in the above embodiments, the interface change triggered by unfolding the outer folding screen mobile phone to the unfolded state can be triggered by folding the inner folding screen mobile phone to the folded state for the inner folding screen.

[0220] For example, Fig.16 This is a schematic diagram of an example of interface changes based on an inward folding screen mobile phone entering the rear selfie function provided in an embodiment of the present application. Fig.16 As shown in (a) of FIG. 2 , when the inner folding screen mobile phone is in the unfolded state, the first inner display screen and the second inner display screen of the inner folding screen mobile phone are both in the light screen state, the outer display screen is in the off screen state, and the first inner display screen and the second inner display screen display the photo preview interface 2201. The photo preview interface 2201 includes a rear selfie control 902.

[0221] The user clicks on the rear selfie control 2202. In response to the user's operation, the inner folding screen mobile phone displays a flipping guide interface 2203 through the first inner display screen and the second inner display screen. Fig.16The content of the flip guide interface 2203 may be similar to the content of the flip guide interface 1105, except that the structural form of the inner folding screen mobile phone schematic diagram 2213 is different.

[0222] After the flipping guide interface 2203 is displayed for a preset time (for example, 3 seconds), the camera application enters the rear selfie function. Specifically, the first inner display screen and the second inner display screen of the inward folding screen mobile phone are turned off, and the outer display screen is controlled to light up. At the same time, photos are acquired through the rear camera, and the photo preview interface 2204 is displayed through the external display screen. The photo preview interface 2204 includes photos acquired by the rear camera. After the user flips the inward folding screen mobile phone, the side where the outer display screen is located (that is, the side where the rear camera is located) faces the user, and the side where the first inner display screen and the second inner display screen are located faces away from the user. In this way, the user's own photos (that is, selfie photos) acquired through the rear camera can be displayed in the photo preview interface 2204, such as Fig.16 As shown in Figure (c).

[0223] Similar to the external folding screen, for the internal folding screen, the user's operations to enter the rear selfie function may include: clicking the rear selfie control, flipping the wake-up operation, clicking the selfie option in the shortcut menu, clicking the selfie shortcut icon, turning on the rear selfie switch in the front selfie scene, etc.

[0224] When the user is using the rear-mounted selfie function to take a photo, in response to the user's operation of exiting the rear-mounted selfie function, the inward folding screen mobile phone can exit the current rear-mounted selfie function, control the outer display screen to turn off, control the first inner display screen and the second inner display screen to light up, or control the outer display screen to remain on and control the first inner display screen and the second inner display screen to turn off, and display the corresponding interface after exiting.

[0225] Similar to the external folding screen, for the internal folding screen, the user's operations to exit the rear selfie function may include: clicking to switch the internal screen controls, clicking to flip the camera controls, flipping to exit the operation, folding the internal folding screen phone to the folded state, returning to the operation, automatically turning off the screen in power saving mode, pressing the power button of the phone, etc.

[0226] It can be understood that whether it is an external folding screen mobile phone or an internal folding screen mobile phone, or other electronic devices with folding screens, when taking pictures based on the rear selfie function, the software system and hardware structure of the electronic device need to cooperate with each other to achieve the camera conversion, screen switching, interface display, etc. described in the above embodiments. The following will describe the specific process of the photo taking method provided in the embodiment of the present application inside the electronic device in combination with the structure of the electronic device.

[0227] First, the hardware structure and software architecture of the electronic device are introduced. It can be understood that the photographing method provided in the embodiment of the present application can be applied to any electronic device with a foldable screen and a camera application, and is not limited to foldable screen mobile phones, such as foldable screen tablets. The specific hardware structure of the electronic device can be found in the subsequent Fig.28 The embodiment shown.

[0228] Next, the software system of the electronic device is introduced. The software system of the electronic device can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplarily describe the software system of the electronic device.

[0229] like Fig.17 As shown, the software system using a layered architecture is divided into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, which are the application layer 210, the application framework layer 220, the hardware abstraction layer 230 and the driver layer 240 from top to bottom. In the embodiment of the present application, for the convenience of explanation, the layer above a certain layer in the software system is called the upper layer, and the layer below a certain layer is called the bottom layer.

[0230] The application layer 210 may include a camera application. In addition, the application layer 210 may also include applications such as gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc. Fig.17 Not shown.

[0231] The application framework layer 220 provides an application access interface and a programming framework for the application programs of the application layer 210 .

[0232] like Fig.17 As shown, in the embodiment of the present application, the application framework layer 220 may include a display framework, a folding state management framework, a camera framework, a touch control framework, and the like.

[0233] Optionally, the display framework is used to control the display of the interface and the switching of the screen (i.e., the display screen). It should be noted that when the display framework controls the screen switching, the screen display state can be switched synchronously with the touch capability. That is to say, the display framework not only controls the display state of the screen, but also controls the touch capability of the screen. Among them, the display state may include an off-screen state and a bright-screen state. Optionally, for an external folding screen mobile phone, when one of the main screen and the secondary screen is in an off-screen state, the screen in the off-screen state may not have touch capability. For an internal folding screen mobile phone, when the inner display screen (including the first inner display screen and the second inner display screen) and one of the outer display screens are in an off-screen state, the screen in the off-screen state may not have touch capability.

[0234] In this embodiment, the display framework may include a window manager (window manager), an activity manager service (activity manager service, AMS) and a display manager service (display manager service), etc.

[0235] The window manager, also known as the window management service (WMS), is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0236] AMS is responsible for managing all activities in the application, where an activity is also called a process. AMS understands the status of all activities and has the ability to schedule the life cycle of all activities.

[0237] It can be understood that the window manager and AMS cooperate with each other to realize the interface display. Optionally, the window manager and AMS can simultaneously manage multiple window programs and multiple activities to realize the display of multiple groups of display content in the interface, such as realizing the display of display content 0, display content 1, etc.

[0238] The display management service is used to control the switching of screens. In this embodiment, the electronic device is a folding screen device, which may include multiple screens, or include one screen, and the one screen may be divided into multiple parts. Therefore, the display management service may include management modules for multiple screens, each management module being used to manage one screen or a part of a screen. In addition, when controlling the display state of the screen, the screen switching may be controlled from the aspects of logical display, display device, virtual display, and virtual device. Based on this, if Fig.17 As shown, in one embodiment, the display management service may include modules such as logical display 0, display device 0, virtual display 1, virtual device 1, etc.

[0239] The folding state management framework is used to monitor and manage the folding form of the electronic device, the shooting scene, and the target display state of the screen. The target display state of the screen is the state that needs to be displayed after the screen needs to switch the display state. The target display state may include an off-screen state (also referred to as off-screen) and a bright screen state (also referred to as bright screen). As described in the above embodiment, the folding form may include a folded state, an unfolded state, and a bracket state. The shooting scene refers to the scene in which the user uses the camera of the electronic device when shooting. The shooting scene may include a rear selfie scene (also referred to as a first shooting scene), a front selfie scene, a rear non-selfie scene (also referred to as a second shooting scene), a collaborative shooting scene, and the like.

[0240] Optionally, the folding state management framework may include a sensor service module and a folding screen manager. The sensor service module is used to monitor the angle information and posture information between the first structural member and the second structural member according to the sensor data provided by the bottom layer (hardware abstraction layer 230 and / or driver layer 240). Optionally, the sensor service module may include a posture sensor service unit, a hinge sensor service unit (also called an angle sensor service unit) and a Hall sensor service unit.

[0241] The folding screen manager is used to monitor and manage the states related to the folding screen in the electronic device, including the folding form, shooting scene, and the target display state of the screen and the camera usage state determined according to the folding form and shooting scene. Among them, the camera usage state represents the folding form of the electronic device and the corresponding shooting scene under the folding form. Optionally, taking an external folding screen mobile phone as an example, the camera usage state may include the rear selfie scene in the folded state (referred to as the folded rear selfie state), the rear non-selfie scene in the folded state (referred to as the folded rear non-selfie state), the front selfie scene in the folded state (referred to as the folded front selfie state), the collaborative shooting scene in the folded state (referred to as the folded collaborative state), the rear non-selfie scene in the unfolded state (referred to as the unfolded rear non-selfie state), the front selfie scene in the unfolded state (referred to as the unfolded front selfie state), the front selfie scene in the stand state (referred to as the stand front selfie state) and the rear non-selfie scene in the stand state (referred to as the stand rear non-selfie state).

[0242] Taking the inward-folding screen mobile phone as an example, the camera usage states may include folded rear-camera non-selfie state, folded front-camera selfie state, unfolded front-camera selfie state, unfolded rear-camera non-selfie state, rear-camera selfie scene in the unfolded state (referred to as the unfolded rear-camera selfie state), collaborative shooting scene in the unfolded state (referred to as the unfolded collaborative state), stand-front selfie state and stand-rear non-selfie state, etc.

[0243] Optionally, the folding screen manager may include a posture state machine and a state decision module. The posture state module is used to obtain the posture information of the electronic device from the sensor service module, and determine the folding form of the electronic device based on the posture information. Among them, the posture information may include angle information, posture information, opening and closing information, etc. The state decision module is used to obtain the folding form from the posture state module, the shooting scene obtained from the camera application of the application layer, and decide the camera usage state and the target display state of the display screen based on the folding form and the shooting scene. Optionally, the state decision module can obtain or send the state obtained by decision to other modules in the software architecture, for example, sending the target display state to the display management service, sending the camera usage state to the camera framework and the touch framework, sending the folding form to the camera application of the application layer, etc.

[0244] The camera framework is used to provide access interfaces for camera-related functions and services to realize the camera's shooting, preview, mirroring and other capabilities. Optionally, the camera framework may include a system service module, a rear Selfie service unit, and a camera service module, etc. The system service module is used to manage the hardware camera as a proxy for the hardware camera (i.e., camera) service. The rear Selfie service unit is used to manage its rear self-timer related functions when other applications call the camera application and use the rear self-timer function, such as turning on the rear Selfie function in other applications, or turning off the rear Selfie function in other applications. In a specific embodiment, when the camera usage state changes, the system service module sends an instruction to the rear Selfie service unit when determining that the camera usage state enters the folded rear Selfie state or exits the folded rear self-timer state, and the rear Selfie service unit turns on or off the rear Selfie function of other applications. The camera service unit is used to send the control instructions for the camera provided by the camera application, parameters related to the data stream, etc. to the hardware abstraction layer 230 to realize the camera's shooting, preview and mirroring and other capabilities.

[0245] The touch framework is used to manage the touch state of the electronic device screen. In a specific embodiment, the touch framework can block the touch function of the screen for a preset time (e.g., 3 seconds) when entering or exiting the rear selfie function based on the camera usage status sent by the state decision module in the folding screen manager to prevent the user from accidentally touching it. The details are described in detail in the subsequent embodiments. Among them, blocking the touch function is also called touch screen hiding (touch screen hid).

[0246] In addition to the above modules, the application framework layer 220 may also include a content provider, a view system, a phone manager, a resource manager, a notification manager, etc., which are no longer shown in the figure.

[0247] The hardware abstraction layer 230 is used to abstract the hardware. In the embodiment of the present application, the hardware abstraction layer 230 may include a display hardware abstraction layer, an angle detection algorithm module, a camera hardware abstraction layer, and the like.

[0248] The display hardware abstraction layer may include an interface layer synthesis system (surface flinger) and a hardware overlay (HWC). The surface flinger is used to provide synthesis and display capabilities for interface view layers. The hardware overlay, also known as a hardware mixing renderer, is used to synthesize layers received from the interface layer synthesis system (surface flinger), thereby reducing the amount of synthesis performed by the three-dimensional graphics processing library (for example: OpenGL ES) and the graphics processing unit (GPU). The hardware mixing renderer can abstract objects such as overlays and 2D bit block transmitters to synthesize layers, and communicate with the window synthesis hardware to synthesize windows.

[0249] The angle detection algorithm module is used to process the data collected by the sensor of the driving layer according to a preset algorithm to obtain the angle data between the first structural member and the second structural member of the folding screen.

[0250] The camera hardware abstraction layer is also called a camera provider, etc. In an embodiment of the present application, the camera hardware abstraction layer may include a rear camera device and a front camera device. On the one hand, the camera hardware abstraction layer is used to process images based on a preset algorithm to generate a photo data stream, a preview data stream, a video data stream, etc. On the other hand, in the case where the camera application has a gesture photo function, the camera hardware abstraction layer may also be integrated with a gesture recognition algorithm. When the user performs a gesture photo, the user gesture is recognized by the gesture recognition algorithm, and the gesture recognition result is reported. On the third aspect, the camera hardware abstraction layer can also be used to report the screen fill light data, gesture recognition results, etc. obtained by the hardware layer to the upper layer.

[0251] The driver layer 240 is used to provide drivers for various hardware devices in the hardware layer of the electronic device. In the embodiment of the present application, the driver layer may include display drivers, sensor drivers, and camera drivers.

[0252] Among them, the sensor driver may include an angle sensor driver, a gyroscope sensor, a hall sensor driver, and a touch sensor driver. The touch sensor driver is also called a touch panel (TP) driver. The camera driver may include a rear camera driver and a front camera driver. The angle sensor driver is used to provide a driver for the angle sensor of the hardware layer to detect the angle data between the first structural member and the second structural member of the electronic device. The angle sensor may include, for example, an acceleration sensor, a hinge sensor, and the like. The gyroscope sensor is used to provide a driver for the gyroscope sensor of the hardware layer to detect the motion posture of the electronic device. The hall sensor driver is used to provide a driver for the hall sensor of the hardware layer. The touch sensor driver is used to provide a driver for the touch sensor of the hardware layer. The rear camera driver is used to provide a driver for the rear camera of the hardware layer. The front camera driver is used to provide a driver for the front camera of the hardware layer.

[0253] Optionally, the electronic device may include one rear camera or multiple rear cameras. In the case where the electronic device includes multiple rear cameras, the rear camera driver may include one, and the one rear camera drives the multiple rear cameras; the rear camera driver may also include multiple, and each rear camera driver drives one rear camera. The same is true for the front camera and the front camera driver, which will not be described in detail.

[0254] The following is an example Fig.17 The workflow of the software system of the electronic device is shown.

[0255] 1. Status management process

[0256] See also Fig.18 The monitoring and management process of the electronic device on the folding form, target display state and camera use state can be as follows: Fig.18 As shown, the following steps S101 to S114 are included. It should be noted that the following steps S101 and S114 can be continuously executed, that is, after the electronic device is turned on, it runs according to the following steps to achieve continuous monitoring and management of the status.

[0257] S101 . The sensor driver of the driver layer 240 provides a driver to each sensor of the hardware layer to obtain sensor data.

[0258] Specifically, each sensor in the hardware layer collects sensor data under the drive of the driving sensor and sends the collected data to the sensor driver. The angle sensor collects the angle data between the first structural member and the second structural member, and transmits it to the angle sensor driver. The attitude sensor (such as a gyroscope sensor) collects the motion attitude data (abbreviated as attitude data) of the electronic device and transmits it to the attitude sensor driver. The Hall sensor collects the opening and closing data between the first structural member and the second structural member, and transmits it to the attitude sensor driver.

[0259] Specifically, when the electronic device is in a folded state, the angle data between the first structural member and the second structural member collected by the angle sensor is 0°; the motion posture data collected by the posture sensor is "stationary state"; and the opening and closing data of the first structural member and the second structural member detected by the Hall sensor is "fully fitted state".

[0260] When a user unfolds or folds an electronic device and the electronic device is in a bracket state, the angle data between the first structural member and the second structural member collected by the angle sensor is "greater than 0° and less than 180°"; the motion posture data collected by the posture sensor is "motion state"; and the opening and closing data of the first structural member and the second structural member detected by the Hall sensor is "incomplete fitting state".

[0261] If the electronic device is in a bracket state and is stationary, the angle data between the first structural member and the second structural member collected by the angle sensor is "greater than 0° and less than 180°"; the motion posture data collected by the posture sensor is "stationary state", and the opening and closing data of the first structural member and the second structural member detected by the Hall sensor is "incompletely fitted state".

[0262] When the electronic device is in the unfolded state, the angle data between the first structural member and the second structural member collected by the angle sensor is 180°; the motion posture data of the posture sensor can be "stationary state"; the Hall sensor detects that the first structural member and the second structural member are in "open state".

[0263] S102 : The sensor driver sends the sensor data to the sensor service module of the application framework layer 220 .

[0264] Specifically, the angle sensor driver transmits the angle data to the angle detection algorithm module of the hardware abstraction layer 230. The angle algorithm module processes the angle data according to a preset algorithm to obtain processed angle data. The angle algorithm module transmits the angle information to the hinge sensor service unit in the sensor service module.

[0265] The attitude sensor driver transmits attitude data to the attitude sensor service unit. The Hall sensor driver transmits opening and closing data to the Hall sensor service unit.

[0266] S103: The sensor service module processes the sensor data and generates position information.

[0267] As described above, the posture information may include angle information, posture information, and opening and closing information. Specifically, the hinge sensor service unit in the sensor service module may further process the processed angle data to generate angle information that can be recognized and processed by the folding screen manager. The Hall sensor service unit in the sensor service module may process the opening and closing data to generate opening and closing information that can be recognized and processed by the folding screen manager. The posture sensor service unit in the sensor service module may process the posture data to generate posture information.

[0268] S104. The sensor service module sends the posture information to the posture state module in the folding screen manager.

[0269] S105. The posture state module determines the folding state of the electronic device according to the posture information.

[0270] Specifically, if in the posture information, the angle information is 0°, the posture information is "static state", and the opening and closing information is "completely fitted state", the posture module determines that the folding state of the electronic device is the folded state.

[0271] If in the posture information, the angle information is "greater than 0° and less than 180°", the posture information is "stationary state" or "moving state", and the opening and closing information is "incompletely fitted state", the posture module determines that the folded form of the electronic device is a bracket state.

[0272] If, in the posture information, the angle information is 180°, the posture information is "stationary state", and the opening and closing information is "open state", the posture module determines that the folded state of the electronic device is the unfolded state.

[0273] S106. The posture state module sends the folding state to the state decision module in the folding screen manager.

[0274] S107: When the camera application is started, the state decision module obtains the shooting scene from the camera application at the application layer.

[0275] As described above, the shooting scene may include a rear selfie scene, a front selfie scene, a rear non-selfie scene, a collaborative shooting scene, etc. The camera application determines the current shooting scene according to the current user's selection and the rules of the camera application operation, and sends the shooting scene to the state decision module.

[0276] S108. The state decision module determines a target display state of the screen and a camera use state according to the folding form of the electronic device and the shooting scene.

[0277] It can be understood that when the folded state is the bracket state, the state decision module can further combine the angle information to determine the screen state.

[0278] Optionally, the shooting scenes supported by the external folding screen mobile phone may include: rear non-selfie scenes, front selfie scenes, rear selfie scenes and collaborative shooting scenes, etc. Optionally, the external folding screen mobile phone does not support rear selfie scenes and collaborative shooting scenes in the unfolded state and the stand state.

[0279] In one embodiment, for an external folding screen mobile phone in various folding forms and shooting scenarios, the target display state and camera usage state determined by the state decision module may be as shown in Table 2.

[0280] Table 2

[0281]

[0282]

[0283] It should be noted that the above Table 2 shows the target display state of the screen and the camera usage state of the external folding screen mobile phone during the operation of the camera application. When the camera application is not running, the state decision module of the external folding screen mobile phone can also decide the target display state of the screen only according to the folding form. Specifically, in the folded state, or in the stand state with an angle greater than 0° and less than 45°, the target display state of the screen is: the main screen is on and the sub-screen is off; in the unfolded state, or in the stand state with an angle greater than or equal to 45° and less than 180°, the target display state of the screen is: the main screen and the sub-screen are on at the same time.

[0284] Optionally, the shooting scenes supported by the inward folding screen mobile phone may include: rear non-selfie scenes, front selfie scenes, rear selfie scenes and collaborative shooting scenes, etc. Optionally, the inward folding screen mobile phone does not support rear selfie scenes and collaborative shooting scenes in the folded state and the stand state.

[0285] In one embodiment, for an inward-folding screen mobile phone in various folding forms and shooting scenarios, the target display state and camera usage state determined by the state decision module may be as shown in Table 3.

[0286] Table 3

[0287]

[0288] Table 3 above shows the target display state of the screen and the camera usage state of the inward folding screen mobile phone during the operation of the camera application. When the camera application is not running, the state decision module of the inward folding screen mobile phone can also decide the target display state of the screen only according to the folding form. Specifically, in the folded state, or in the stand state with an angle greater than 0° and less than 45°, the target display state of the screen is: the outer display screen is on, and the first inner display screen and the second inner display screen are off; in the unfolded state, or in the stand state with an angle greater than or equal to 45° and less than 180°, the target display state of the screen is: the first inner display screen and the second inner display screen are on, and the outer display screen is off.

[0289] S109: When the camera application is started, the camera application sends a folding state request to the state decision module. The folding state request is used to request the state decision module to send a folding state.

[0290] S110, the state decision module sends the folding state to the camera application.

[0291] The specific usage scenarios and processes of step S109 and step S110 can be found in the following Fig. 22 Steps S401 to S402 in the illustrated embodiment, and Fig.25 After the camera application obtains the folding state, it controls the camera to capture images, distribute streams, etc. according to the folding state and other parameters to display the photo preview interface. For details, please refer to the subsequent embodiments. Fig. 22 Steps S403 to S425, and Fig.25 Steps S803 to S826.

[0292] S111: When the target display state is different from the current screen display state, the state decision module sends a display state change notification to the display management service of the display framework, and the display state change notification carries the target display state.

[0293] The display state change notification is used to notify that the display state of the screen needs to change, that is, the display state of the screen needs to be switched.

[0294] Optionally, the display management service can pre-register a notification callback with the state decision module through an interface, so that the state decision module sends a display state change notification to the display management service when it detects a change in the target display state. Optionally, the display state change notification can carry the display state of each screen or each part of the screen after the change, for example, the target display state of the main screen after the change is the off screen state, and the target display state of the secondary screen after the change is the on screen state, etc.

[0295] Taking the external folding screen as an example, when the current display state of the external folding screen mobile phone is "the main screen is on and the secondary screen is off", if the user unfolds the external folding screen mobile phone from the folded state to the unfolded state, the state decision module determines the target display state as "the main screen and the secondary screen are both on" according to the above Table 2, which is different from the current display state and needs to change the display state. Therefore, the state decision module sends a display state change notification to the display management service. The display state change notification carries the target display state, that is, "the main screen and the secondary screen are both on".

[0296] Taking the inner folding screen as an example, when the current display state of the inner folding screen mobile phone is "the first inner display screen and the second inner display screen are on, and the outer display screen is off", if the user clicks the rear selfie control and the shooting scene changes, the state decision module determines the target display state as "the outer display screen is on, the first inner display screen and the second inner display screen are off" according to the above Table 3. It is different from the current display state and needs to change the display state. Therefore, the state decision module sends a display state change notification to the display management service. The display state change notification carries the target display state, that is, "the outer display screen is on, and the first inner display screen and the second inner display screen are off".

[0297] After receiving the display status change notification, the display management service controls the screen switching. Fig.19 Steps S201 to S203 in .

[0298] S112: When the camera usage status changes, the status decision module sends a camera usage status change notification to the system service module of the camera framework.

[0299] Optionally, the system service module may pre-register a notification callback with the state decision module through an interface (e.g., E interface), so that when the state decision module detects a change in the camera usage state, it sends a camera usage state change notification to the system service module. Optionally, the camera usage state change notification may carry the changed camera usage state.

[0300] Optionally, after receiving the state change notification, the system service module can determine the changed camera usage state carried in the state change notification, and determine whether to enter the folded rear-camera selfie state, or exit the folded rear-camera selfie state. That is, the system service module determines whether the camera usage state changes from other states to the folded rear-camera selfie state, or from the folded rear-camera selfie state to other states. If so, the system service module sends an instruction to the rear-camera selfie service unit, instructing the rear-camera selfie service unit to turn on or off the rear-camera selfie function of other applications. In short, the camera usage state change notification is used by the system service module to control other applications to turn on or off the rear-camera selfie function.

[0301] S113: When the camera usage state changes, the folding screen decision module sends a camera usage state change notification to the touch control framework of the application framework layer 220. The camera usage state change notification carries the changed camera usage state.

[0302] After the touch framework receives the notification of camera usage changes, it will trigger the anti-mistouch function when the conditions are met. For details, see Fig.18 , the implementation process of the anti-mistouch function includes the following steps:

[0303] S114. The touch control framework sends an anti-mistaken touch start instruction to the touch sensor driver of the driving layer 240 based on the notification of the change of the camera usage status. When it is determined that the camera usage status has changed from other states to the folded rear selfie state, or from the folded rear selfie state to other states, the anti-mistaken touch start instruction is used to instruct to turn on the anti-mistaken touch function for the screen.

[0304] Specifically, taking an external folding screen mobile phone as an example, when the folding form of the external folding screen mobile phone is in the folded state, before the user enters the rear selfie function, the camera usage state is in the folded rear non-selfie state. After the user enters the rear selfie function, the camera usage state changes to the folded rear selfie state. In this case, the anti-mistouch module sends an anti-mistouch turn-on instruction to the touch sensor driver, and the anti-mistouch turn-on instruction is used to indicate that the touch function of the main screen and the sub-screen is shielded for a preset time. That is to say, when the camera application enters the rear selfie function, the touch frame sends an anti-mistouch turn-on instruction to the touch sensor. The preset duration can be 3s, for example.

[0305] Optionally, the false touch prevention activation instruction may also indicate to activate the false touch prevention function for a part of the screen, for example, to activate the false touch prevention function only for the main screen or the secondary screen. This embodiment of the application does not impose any limitation on this.

[0306] S115. The touch sensor driver responds to the false touch prevention turning on instruction and turns on the false touch prevention function for the screen.

[0307] It can be understood that the electronic device continuously monitors the target display status, camera usage status and folding form according to the above steps S101 to S108, and when these states change again, executes step S116, as well as the above steps S111, S112 and S113.

[0308] S116: When the folding form changes, the state decision module sends a folding form change notification to the camera application of the application layer 210. The folding form change notification carries the changed folding form.

[0309] Optionally, the camera application may pre-register a notification callback with the state decision module through an interface, so that the state decision module sends a folding state change notification to the camera application when detecting a change in the folding state of the electronic device.

[0310] During the use of the rear-camera selfie function, if the camera application receives a notification of a folding state change, the camera application determines that the folding state has changed from the folded state to the unfolded state, and determines that the rear-camera selfie function needs to be exited. Therefore, the camera application regenerates the preview stream mirror parameters, regenerates the stream allocation parameters, reconfigures the algorithm, etc. (i.e., re-allocates the stream), and updates the photo preview interface, etc. For details, see Fig.26 , no more details.

[0311] When the rear selfie function is not in use, if the camera app receives a notification of a folding state change, the camera app determines that the selfie scene has not changed, and thus only controls the update of the photo preview interface. For details, see Fig. 27 , no more details.

[0312] In short, the camera application can notify the control algorithm flow switching and control the update of the photo preview interface according to the changes in the folding shape.

[0313] 2. Display management process

[0314] See also Fig.19 When using the camera application, the electronic device can manage the display of the screen as follows: Fig.19 As shown, including:

[0315] S201. In response to the display state change notification, the display management service in the display framework of the application framework layer 220 sends a display state switching notification (also called a screen switching instruction) to the display hardware abstraction layer in the hardware abstraction layer 230. The display state change notification carries a target display state. The display state switching notification is used to instruct to switch the state of the screen to the target display state.

[0316] Optionally, the display state switching notification may carry the target display state.

[0317] As mentioned above Fig.18 As described in step S111 of the embodiment, when the target display state changes, the state decision module in the folding screen manager sends a display state change notification to the display management service.

[0318] The electronic device monitors the target display state of the screen in real time. When the target display state changes, it means that the screen needs to switch the display state. The state decision module sends a display state change notification. After receiving the display state change notification, the display management service further notifies the display hardware abstraction layer and sends a display state switch notification to the display hardware abstraction layer.

[0319] Taking the external folding screen as an example, after the user unfolds the external folding screen mobile phone from the folded state to the unfolded state, the state decision module sends a display state change notification to the display management service. The display state change notification carries the target display state, that is, "the main screen and the secondary screen are on at the same time." In response to the display state change notification, the display management service sends a display state switching notification to the display hardware abstraction layer, and the display state switching notification carries the target display state.

[0320] S202 : The display hardware abstraction layer sends a display state switching notification to the display driver in the driver layer 240 .

[0321] S203: The display driver provides a driver to the corresponding screen in response to the display state switching notification, so as to switch the display state of the screen to the changed display state.

[0322] Continuing with the example of the foldable screen mobile phone, after receiving the display status switching notification carrying the message "the main screen and the sub-screen are turned on at the same time", the display driver drives the main screen and the sub-screen so that the main screen and the sub-screen are turned on at the same time.

[0323] It should be noted that, while driving the corresponding screen display interface, the display driver can also drive the touch capability of the screen.

[0324] It can be understood that the above steps S201 to S203 are triggered by the display state change notification and can be executed at any stage of the screen display. For example, they can be executed in parallel with the following steps S204 to S209.

[0325] S204: The camera application of the application layer 210 creates a process according to the running requirements.

[0326] Optionally, the camera application creates a process in response to a user's startup operation. The startup operation may be clicking on the camera application icon, or clicking on an option in the camera application shortcut menu, or clicking on a shortcut icon on the desktop, etc., which is not limited in the present embodiment.

[0327] It can be understood that this embodiment mainly describes the process of the camera application controlling the underlying interface display. In fact, other operations can be performed after the camera application creates a process, such as sending a folding state request to the state decision module to obtain the folding state, etc. For details, please refer to Fig.18 Steps S109 and S110 in the following embodiments Fig. 22 Step S402 in Fig.25 Step S802 in the above description will not be described in detail here for other processes except the interface display.

[0328] S205 . The camera application sends interface display instructions to the AMS and the window manager in the display framework of the application framework layer 220 respectively based on the established process.

[0329] Specifically, the camera application runs based on the established process and receives user operations, decides the windows and interfaces to be displayed and the screen on which the interfaces need to be displayed according to the user operations, and then sends interface display instructions to the AMS and the window manager.

[0330] In the photo-taking scenario, as described above, the camera application can subscribe to the folding state from the state decision module. When the folding state changes, the state decision module notifies the camera application of the changed folding state. The camera application can decide the screen that needs to display the interface based on the folding state. The information of the screen where the interface needs to be displayed is referred to as screen information. For example, in the case of an external folding screen, when the rear selfie function has been entered, if the state decision module notifies that the folding state changes to the unfolded state, the camera application can decide to switch the screen, that is, the secondary screen goes out and the main screen lights up. The main screen is the screen that needs to display the interface. The camera application carries the information of the main screen into the interface display instruction and sends it to the AMS and the window manager. The specific process will be further elaborated in subsequent embodiments.

[0331] S206 : The AMS and the window manager send the interface display instruction to the display hardware abstraction layer of the hardware abstraction layer 230 .

[0332] S207, the display hardware abstraction layer performs layer synthesis and rendering according to the interface display instruction.

[0333] S208 , the display hardware abstraction layer sends the interface display instruction and the layer obtained by synthesis and rendering to the display driver of the display driver layer 240 .

[0334] S209: The display driver displays the interface on the screen in response to the interface display instruction.

[0335] Specifically, the display driver displays the interface to be displayed on the currently lit screen.

[0336] 3. Camera management process

[0337] See also Fig. 20 When a user uses the camera application, the electronic device can manage the camera as follows: Fig. 20 As shown, including:

[0338] S301 . A camera application of the application layer 210 creates a process in response to a camera start operation by a user.

[0339] This step may be the same as the above step S204.

[0340] S302: The camera application generates a capture request (capture request), a preview stream mirror parameter (configuration), and a stream configuration parameter based on the created process and according to the running requirements.

[0341] A capture request (also called an image acquisition request) is used to request the camera to start capturing images. Optionally, the capture request may carry information about the camera used to capture the image. Optionally, the camera information may be represented by identification information such as numbers. For example, if the camera information is 1, it means that the camera used to capture the image is the front camera. If the camera information is 0, it means that the camera used to capture the image is the rear camera.

[0342] The preview stream mirroring parameters refer to the mirroring parameters required when generating the preview data stream. Optionally, the preview mirroring parameters may include, for example, whether to mirror horizontally, whether to mirror vertically, etc. The stream configuration parameters are also called stream configuration parameters, which refer to the configuration parameters required to generate the data stream, where the data stream includes the preview data stream, the photo data stream, the video data stream, etc. Optionally, the stream configuration parameters may include the resolution size, the shooting mode, the exposure value, the image size, etc.

[0343] In an embodiment of the present application, a flag may also be carried in the stream configuration parameters. The flag is used to identify the type of algorithm to be configured. The algorithm type refers to the type of algorithm used by the underlying layer to process the captured image. Optionally, depending on the camera that captures the image, the algorithm type may include a front algorithm, a rear non-selfie algorithm, and a rear selfie algorithm. The front algorithm is used to process the image captured by the front camera in the front selfie scenario. The rear non-selfie algorithm is used to process the image captured by the rear camera in the rear non-selfie scenario. The rear selfie algorithm is used to process the image captured by the rear camera in the rear selfie scenario.

[0344] In a specific embodiment, the stream configuration parameters may include a post-selfie flag, a pre-selfie flag, and a post-non-selfie flag. Each flag has a corresponding value. The value of the post-selfie flag is 1, indicating that the post-selfie algorithm needs to be configured, and the value of the post-selfie flag is 0, indicating that the post-selfie algorithm does not need to be configured. The value of the pre-selfie flag is 1, indicating that the pre-selfie algorithm needs to be configured, and the value of the pre-selfie flag is 0, indicating that the pre-selfie algorithm does not need to be configured. If the value of the post-non-selfie flag is 1, it means that the post-non-selfie algorithm needs to be configured, and the value of the post-non-selfie flag is 0, indicating that the post-non-selfie algorithm does not need to be configured. For example, the values ​​of the flags in the configuration parameters are: the post-selfie flag is 1, the pre-selfie flag is 0, and the post-non-selfie flag is 0, which means that the post-selfie algorithm needs to be configured, that is, the algorithm to be configured is the post-selfie algorithm.

[0345] Optionally, in some other embodiments, the flag bit may be set to a null value to indicate that there is no need to configure the corresponding algorithm.

[0346] Of course, in other embodiments, the flow configuration parameter may only carry the flag bit corresponding to the algorithm to be configured, and the value of the flag bit is 1. The algorithm corresponding to the flag bit not carried by the flow configuration parameter does not need to be configured.

[0347] Optionally, the camera application may generate a capture request, preview stream mirroring parameters, and stream configuration parameters according to the shooting mode, shooting scene, and camera information.

[0348] Specifically, the camera application can generate a capture request based on the shooting scene. When the shooting scene is a rear-facing selfie scene, a rear-facing non-selfie scene, or a collaborative shooting scene, the generated capture request carries the information of the rear camera. When the shooting scene is a front-facing selfie scene, the generated capture request carries the information of the front camera.

[0349] Optionally, the camera application can generate preview stream mirror parameters according to the shooting scene and user settings. Among them, the user settings related to the preview stream mirror parameters may include whether to turn on horizontal mirroring, whether to turn on vertical mirroring, etc. For example, when the shooting scene is a rear selfie scene or a front selfie scene, and the user's settings include turning on horizontal mirroring and turning on vertical mirroring, the value of "Whether to mirror horizontally" in the preview stream mirror parameters is "yes", and the value of "Whether to mirror vertically" is "no".

[0350] Optionally, the camera application may generate stream configuration parameters according to the shooting scene, shooting mode, and user settings. User settings related to the stream configuration parameters may include image scale, resolution, whether to add a watermark, whether to record the geographic location, etc. The camera application generates corresponding stream configuration parameters in combination with the current shooting scene, shooting mode, and user settings.

[0351] It is understandable that when the camera is started, the camera application can obtain the default shooting scene, shooting mode and camera information from the configuration file. During the use of the camera, if the user switches the shooting mode, switches the shooting scene or sets the shooting parameters, the preview stream mirroring parameters and the stream configuration parameters need to be reconfigured.

[0352] For example, when a user clicks to flip the camera control, the shooting scene and shooting mode change, and the camera application regenerates the preview stream mirroring parameters and stream configuration parameters in response to the user's operation.

[0353] For another example, the user clicks on the rear selfie control, the shooting scene changes, and the camera application regenerates the preview stream mirroring parameters and stream configuration parameters in response to the user's operation.

[0354] S303 : The camera application sends a capture request, preview stream mirroring parameters, and stream configuration parameters to the camera service module in the camera framework of the application framework layer 220 .

[0355] S304 . The camera service module sends the capture request, preview stream mirroring parameters, and stream configuration parameters to the camera hardware abstraction layer of the hardware abstraction layer 230 .

[0356] Specifically, the camera service module can send the capture request and preview stream mirror parameters to the corresponding camera device according to the camera information carried in the capture request. That is, if the capture request carries the information of the front camera, the camera service module sends the capture request and preview stream mirror parameters to the front camera device in the camera hardware abstraction layer; if the capture request carries the information of the rear camera, the camera service module sends the capture request and preview stream mirror parameters to the rear camera device in the camera hardware abstraction layer.

[0357] Optionally, the camera service module may send the capture request and the preview stream mirroring parameters to the camera hardware abstraction layer through a hardware abstraction layer interface definition language (HAL interface definition language, HIDL) interface.

[0358] S305 : The camera hardware abstraction layer sends a capture request to the camera driver of the driver layer 240 .

[0359] Specifically, the front camera device in the camera hardware abstraction layer may send a capture request to the front camera driver in the driver layer 240 ; the rear camera device in the camera hardware abstraction layer may send a capture request to the rear camera driver in the driver layer 240 .

[0360] S306: The camera driver responds to the capture request and drives the corresponding camera to capture images frame by frame.

[0361] S307 : The camera driver sends the captured image to the camera hardware abstraction layer in the hardware abstraction layer 230 .

[0362] S308. The camera hardware abstraction layer performs mirror processing on the captured image according to the preview stream mirror parameters to obtain a mirrored image.

[0363] Specifically, the camera hardware abstraction layer determines whether to perform horizontal mirroring, vertical mirroring, etc. on the captured image according to the specific value in the preview stream mirroring parameter. If the value of "Whether to mirror horizontally" in the preview stream mirroring parameter is "yes", the camera hardware abstraction layer performs horizontal mirroring on the captured image to obtain a mirrored image. If the value of "Whether to mirror vertically" in the preview stream mirroring parameter is "yes", the camera hardware abstraction layer performs vertical mirroring on the captured image to obtain a mirrored image. If the values ​​of "Whether to mirror horizontally" and "Whether to mirror vertically" in the preview stream mirroring parameter are both "yes", the camera hardware abstraction layer performs horizontal mirroring and vertical mirroring on the captured image to obtain a mirrored image.

[0364] S309, the camera hardware abstraction layer configures a preset algorithm according to the stream configuration parameters to obtain a target algorithm, and processes the mirrored image based on the target algorithm to obtain a preview stream.

[0365] Specifically, the corresponding algorithm is configured according to the flag bit with a value of 1 carried in the stream configuration parameter to obtain the target algorithm. When the value of the post-non-selfie flag bit in the flag bit carried in the stream configuration parameter is 1, the preset post-non-selfie algorithm (also called the second algorithm) is configured according to the specific value in the stream configuration parameter to obtain the target algorithm. When the value of the post-selfie flag bit in the flag bit carried in the stream configuration parameter is 1, the preset post-selfie algorithm (also called the first algorithm) is configured according to the specific value in the stream configuration parameter to obtain the target algorithm. When the value of the pre-selfie flag bit in the flag bit carried in the stream configuration parameter is 1, the preset pre-selfie algorithm is configured according to the specific value in the stream configuration parameter to obtain the target algorithm.

[0366] Based on the target algorithm, the mirrored image is processed to obtain a preview stream. The camera hardware abstraction layer transmits the preview stream to the camera application through the camera framework, and the camera application controls the display of the data stream, which will not be repeated here.

[0367] S310: In response to the user clicking on the photo control, the camera application sends a photo-taking instruction to the camera service module.

[0368] For details, please refer to the above Figure 7 , the user clicks the photo control 1107 in the photo preview interface 1106. In response to the user's click, the camera application sends a photo instruction to the camera service module.

[0369] S311. The camera service module sends a photo-taking instruction to the camera hardware abstraction layer.

[0370] S312: The camera hardware abstraction layer saves the current frame image in the preview stream in response to the photo taking instruction.

[0371] For example, Fig.21 This is a schematic diagram of the software architecture of another electronic device provided in an embodiment of the present application. Fig. 20 The software architecture shown in Fig.21 As shown, the camera application may include a startup module, a plug-in manager, a rear selfie module, a camera communication module, and a photo management module.

[0372] Among them, the startup module is used to start the camera application and create a process. The plug-in manager is used to load plug-ins, load shooting modes, and manage the display of the interface. The rear selfie module is used to control the implementation of the rear selfie function. The camera communication module is used to communicate with the bottom layer to manage the camera.

[0373] Specifically, the rear selfie module may include a rear selfie function unit and a rear selfie management unit. The rear selfie function unit is responsible for enabling and managing the rear selfie function. The rear selfie management unit is used to determine whether to switch the screen, etc. The rear selfie management unit is responsible for communicating with the application framework layer. Optionally, the rear selfie management unit can register the folding screen state with the folding state management framework of the application framework layer. When the folding screen state changes, the folding state management framework sends a folding state change notification to the module.

[0374] The camera communication module may include a camera controller, a mirror parameter generation unit and a stream parameter generation unit. The camera controller is used to control whether to start or switch the camera. The mirror parameter generation unit is used to generate mirror parameters of the preview stream. The stream parameter generation unit is used to generate stream configuration parameters.

[0375] The photo management module is used to control the storage and management of the captured images.

[0376] The following takes the electronic device as an external folding screen mobile phone as an example. Fig.21 , the relevant processes of the camera application and the bottom layer to realize the rear selfie function are explained. For the convenience of explanation, the camera startup stage, the folding shape change stage, the rear selfie function shooting stage, the exit of the rear selfie stage, etc. are explained separately. In the following embodiments, the application framework layer, the hardware abstraction layer and the driver layer are collectively referred to as the bottom layer. The specific implementation of the bottom layer can refer to the above Figures 18 to 20 The illustrated embodiment will not be described in detail.

[0377] 1. Camera startup phase

[0378] For example, Fig. 22 This is a flowchart of a camera startup phase provided in an embodiment of the present application. In this embodiment, a non-selfie scene of the rear camera in a folded state is used as an example for explanation. Fig. 22 As shown, the process includes the following steps S401 to S422:

[0379] First of all, it should be noted that Fig.18 As described in the embodiment shown, after the electronic device is turned on, it continuously monitors the display status of the screen according to steps S101 to S108. In the current scenario, the external folding screen mobile phone is in the folded state, the camera application is not started, and the screen display status determined by the underlying related modules is: the main screen is on, and the secondary screen is off. Fig.19 In the illustrated embodiment, steps S201 to S203 control the display status of the screen so that the main screen is on and the secondary screen is off.

[0380] S401. When the external folding screen mobile phone is in a folded state, the operation management module of the camera application creates a camera process in response to the user clicking the icon of the camera application.

[0381] For details, please refer to the above Figure 7 , the user clicks the application icon 1102 on the main interface. In response to the user's click operation, the camera application creates a camera process.

[0382] S402: The operation management module obtains and stores the folding form (folded state) of the electronic device from the bottom layer.

[0383] For details, see Fig.18 In steps S109 to S110, the operation management module obtains the folding state of the electronic device from the folding state management framework of the application framework layer. In this embodiment, the folding state is the folded state.

[0384] Optionally, the memory may be a memory of a camera application or a memory of an electronic device, and the embodiments of the present application do not impose any limitation on this.

[0385] S403, the operation management module reads configuration file 1, the shooting mode in configuration file 1 is the photo mode, the shooting scene is the rear non-selfie scene, and the camera information is the rear camera.

[0386] Optionally, the operation manager reads a camera startup operation configuration file related to the user from the memory in response to the user's camera startup operation.

[0387] Optionally, the configuration file may include information such as shooting mode, shooting scene, camera information (ie, the camera to be started), etc. Of course, in some embodiments, the configuration file may also include user setting information.

[0388] The camera startup operation performed by the user is different, and the configuration file read by the operation management module may be different, and the values ​​of various types of information in the configuration file are different. In this embodiment, the user's camera startup operation is to click the icon of the camera application, and the operation management module reads the configuration file 1 corresponding to the camera startup operation. The shooting mode in the configuration file 1 is the photo mode, the shooting scene is the rear non-selfie scene, and the camera information is the rear camera.

[0389] In some other embodiments, when the user's camera startup operation is to click a shortcut icon on the desktop or click an option in the shortcut menu of the camera application, the configuration file read by the operation management module is different according to the option selected by the user. Fig. 9 In (b) of the figure, the "Selfie" option in the camera application is launched, and the default selfie mode is the rear selfie, the shooting mode in the configuration file read by the operation management module is the photo mode, the shooting scene is the rear selfie scene, and the camera information is the rear camera. For another example, the user presses and drags Fig.10 The "Large Aperture" option in (a) generates Fig.10 If the user clicks the shortcut icon shown in Figure (b) to start the camera application, the shooting mode in the configuration file read by the operation management module is the large aperture mode, the shooting scene is the rear non-selfie scene, and the camera information is the rear camera.

[0390] S404, the operation management module sends a camera control instruction to the camera controller in the camera communication module according to the folding state (folding state) and configuration file 1. The camera control instruction may carry shooting mode (photographing mode), shooting scene (rear non-selfie scene), camera information (rear camera) and other information.

[0391] The camera control instruction is used to instruct the camera to capture an image and configure preview stream mirroring parameters and stream configuration parameters that match the information carried in the camera control instruction.

[0392] S405. The camera controller generates a capture request 1 in response to the camera control instruction according to the camera information (rear camera), and the capture request 1 carries the information of the rear camera.

[0393] S406. The camera controller sends the capture request 1 to the stream parameter generation unit.

[0394] In some other embodiments, the camera controller may also directly send the capture request to the bottom layer. Specifically, the camera controller sends the capture request to the camera service module in the camera framework of the application framework layer.

[0395] S407: The camera controller sends a mirror parameter generation instruction 1 to the mirror parameter generation unit. The mirror parameter generation instruction 1 carries a shooting scene (a rear non-selfie scene).

[0396] Specifically, the camera controller generates a mirror parameter generation instruction 1 according to the shooting scene (rear non-selfie scene) in the camera control instruction, and carries the current shooting scene, i.e., rear non-selfie, in the mirror parameter generation instruction 1. The mirror parameter generation instruction 1 is used to instruct the generation of preview stream mirror parameters matching the rear non-selfie scene.

[0397] S408. The mirror parameter generation unit generates a preview stream mirror parameter 1 matching the post-positioned non-selfie scene in response to the mirror parameter generation instruction 1.

[0398] S409: The mirroring parameter generating unit sends the preview stream mirroring parameter 1 to the stream parameter generating unit.

[0399] In other embodiments, the mirroring parameter generation unit may also directly send the preview stream mirroring parameter 1 to the bottom layer. Specifically, the mirroring parameter generation unit sends the preview stream mirroring parameter 1 to the camera service module in the camera framework of the application framework layer.

[0400] S410: The camera controller sends a stream parameter generation instruction 1 to the stream parameter generation unit. The stream parameter generation instruction 1 carries a shooting mode (photographing mode) and a shooting scene (rear-stage non-selfie scene).

[0401] Specifically, the camera controller generates a stream parameter generation instruction 1 according to the shooting mode (photographing mode) and shooting scene (rear non-selfie scene) in the camera control instruction, and carries the specific values ​​of the shooting mode and the shooting scene in the stream parameter generation instruction 1, that is, the photographing mode and the shooting scene are rear non-selfie scenes.

[0402] The stream parameter generation instruction 1 is used to instruct the generation of stream configuration parameters that match the photo mode and the rear selfie scene.

[0403] S411. The stream parameter generation unit generates a stream configuration parameter 1 matching the camera mode and the post-non-selfie scene in response to the stream parameter generation instruction 1. The stream configuration parameter 1 carries a post-non-selfie flag bit with a value of 1.

[0404] Optionally, the stream configuration parameter 1 may also carry a post-selfie flag with a value of 0 and a pre-selfie flag with a value of 0.

[0405] S412. The stream parameter generation unit sends the capture request 1, the preview stream mirroring parameter 1, and the stream configuration parameter 1 to the bottom layer.

[0406] S413. The bottom layer responds to the capture request 1, captures an image through the rear camera, and performs mirror processing on the captured image based on the preview stream mirror parameter 1 to obtain the mirrored image; and configures the preset rear non-selfie algorithm according to the stream configuration parameter 1 to obtain the rear non-selfie algorithm 1, and processes the image mirrored based on the rear non-selfie algorithm 1 to generate a preview stream.

[0407] The specific implementation process of this step can be found in the above Fig. 20 Steps S306 to S309 in the illustrated embodiment are not described in detail here.

[0408] S414: The bottom layer returns the preview stream to the plug-in manager.

[0409] The above steps S403 to S414 are the process of generating the preview stream. Before, after, or while executing the above steps S403 to S414, the camera application also loads the plug-in through the following steps S415 to S421. The details are as follows:

[0410] S415: The operation management module sends a plug-in loading instruction to the plug-in manager.

[0411] The plugin loading instruction is used to instruct the loading of a plugin.

[0412] S416. The plug-in manager responds to the plug-in loading instruction, reads the folding form (folded state) and configuration file 1, and initializes the basic plug-in according to the folding form (folded state) and the configuration file.

[0413] Basic plugins are also called core plugins (init core plugins), which refer to plugins used to implement the basic functions of the camera application. Basic functions include, for example, video recording function, photo taking function, setting function, etc. Corresponding to the basic plugins, the camera application can also include extension plugins. Extension plugins are plugins used to implement extended functions of the camera application. Extended functions include, for example, rear selfie function, flip wake-up function, etc.

[0414] Optionally, the plug-in manager may read data such as the folding form (folded state) and configuration file 1 from the memory.

[0415] S417: The plug-in manager sends a loading request to the rear selfie function unit in the rear selfie module, where the loading request is used to request loading of the rear selfie function.

[0416] S418. The rear selfie function unit determines whether the rear selfie function is available in response to the loading request; if so, execute step S419.

[0417] Optionally, the rear Selfie function unit may determine whether the current electronic device supports the rear Selfie function. If it is determined that the electronic device supports the rear Selfie function, it is further determined whether the rear self-timer function is turned on. If the rear Selfie function is turned on, it is determined that the rear Selfie function is available.

[0418] S419. The rear-mounted selfie function unit sends an instruction message for loading the rear-mounted selfie function to the plug-in manager.

[0419] S420: In response to the instruction message, the plug-in manager obtains resources of the rear-mounted selfie function from the rear-mounted selfie function unit.

[0420] The resources of the rear-mounted selfie function may include, for example, resources of the rear-mounted selfie control, etc.

[0421] S421. The plug-in manager refreshes the layout of the photo preview interface according to the folding form, configuration file, resources of the rear selfie function, and preview stream, and loads controls, including the rear selfie control.

[0422] After that, the camera application can call the underlying display framework to display the interface and perform the following steps:

[0423] S422: The plug-in manager sends an interface display instruction to the bottom layer.

[0424] S423: The bottom layer responds to the interface display instruction and displays the photo preview interface 901 on the main screen according to the layout of the photo preview interface, loaded controls, and preview stream.

[0425] The specific implementation process of this step can be found in the above Fig.19 Steps S206 to S209 in the above are not described in detail.

[0426] The photo preview interface 901 can refer to the above Figure 7 Figure (b) in .

[0427] After that, the user can click the camera control to take a photo and perform the following steps:

[0428] S424. The photo management module sends a photo instruction to the bottom layer in response to the user clicking the photo control in the photo preview interface 901.

[0429] S425: The bottom layer saves the current frame image in the preview stream in response to the photo taking instruction.

[0430] This step can be seen above Fig. 20 Steps S311 to S312 in the above are not described in detail.

[0431] 2. Enter the stage of rear selfie function

[0432] 1) Enter the rear selfie function in non-selfie scenes

[0433] See Table 1 above, Figure 7 and Figure 8 In the non-selfie scene of the rear camera, the user can enter the rear camera selfie function by clicking the rear camera selfie control or by flipping the wake-up operation. In this embodiment, the rear camera selfie function is entered by clicking the rear camera selfie control ( Figure 7 ) as an example.

[0434] See also Fig.23 , continuing with the above step S422, when the external folding screen mobile phone is in the folded state, the main screen is on, the sub-screen is off, and the main screen displays the photo preview interface 901, the camera application and the bottom layer can enter the rear selfie function according to the following process:

[0435] S501. In response to a user clicking on the rear-mounted selfie control 902, a rear-mounted selfie function unit in a rear-mounted selfie module sends a rear-mounted selfie entry instruction to a rear-mounted selfie management unit.

[0436] The rear Selfie entry command is used to instruct to enter the rear Selfie function. For details, please refer to the above Figure 7 In Figure (b), the user can click on the rear selfie control 902.

[0437] Optionally, the user can also trigger the rear selfie function by flipping the wake-up operation. Specifically, the rear selfie function unit can subscribe to the flip wake-up notification to the module responsible for the flip wake-up function in the folding screen mobile phone. When the user performs the flip wake-up operation, the module notifies the rear selfie function unit, and the rear selfie function unit sends a rear selfie entry instruction to the rear selfie management unit.

[0438] S502: The rear-mounted selfie management unit sends a scene switching notification 1 (switching to the rear-mounted selfie scene) to the plug-in manager in response to the rear-mounted selfie entry instruction.

[0439] The scene switching notification 1 is used to notify the plug-in manager that the shooting scene has changed. Optionally, the scene switching notification 1 carries the switched shooting scene, that is, the rear Selfie scene.

[0440] S503: In response to the scene switching notification 1, the plug-in manager sends a stream allocation instruction 1 (carrying a rear selfie scene) to the mirror parameter generation unit in the camera communication module.

[0441] The stream allocation instruction 1 is used to instruct the configuration of preview stream mirror parameters and stream configuration parameters. Optionally, the stream allocation instruction 1 may carry the switched shooting scene (ie, the post-selfie scene).

[0442] S504: The mirror parameter generation unit generates preview stream mirror parameters 2 matching the post-selfie scene in response to the stream matching instruction 1.

[0443] S505. The mirroring parameter generating unit sends the preview stream mirroring parameter 2 to the stream parameter generating unit.

[0444] S506. The mirror parameter generation unit sends a stream allocation instruction 1 (carrying a post-selfie scene) to the stream parameter generation unit.

[0445] S507: The stream parameter generation unit generates stream configuration parameters 2 that match the post-selfie scene and the shooting mode (photographing mode) before switching in response to the stream configuration instruction 1. The stream configuration parameter 2 carries a post-selfie flag bit with a value of 1.

[0446] It can be understood that after receiving the configuration instruction 1, the stream parameter generation unit determines that the configuration instruction 1 does not carry relevant information about the shooting mode, and then uses the previous shooting mode to generate the stream configuration parameters, so that after entering the post-selfie function, the user's choice can be inherited to improve the user experience. If the post-selfie function does not support the shooting mode before switching, the default shooting mode can be set according to the preset rules, and the stream configuration parameters are generated according to the default shooting mode.

[0447] S508. The stream parameter generation unit sends the preview stream mirroring parameter 2 and the stream configuration parameter 2 to the bottom layer.

[0448] S509. The bottom layer performs mirror processing on the image captured by the rear camera based on the preview stream mirror parameter 2 to obtain the mirrored image; and configures the preset rear selfie algorithm according to the stream configuration parameter 2 to obtain the rear selfie algorithm 1, and processes the mirrored image based on the rear selfie algorithm 1 to generate a preview stream.

[0449] It should be noted that, in this embodiment, the camera is not flipped, so the rear camera continues to capture images, and step S509 processes the images captured by the rear camera.

[0450] The specific implementation process of this step can be found in the above Fig. 20 Steps S306 to S309 in .

[0451] S510, the bottom layer monitors the change in the camera usage status and determines that the display status of the screen needs to be changed, so the screen is switched, the main screen is turned off, the sub-screen is turned on, and the anti-mistouch function of the main screen and the sub-screen is turned on for a preset time.

[0452] Specifically, in this embodiment, since the user clicks on the rear selfie control, the shooting scene changes, and thus the target display state of the screen is determined to be: the secondary screen is on, and the primary screen is off. However, the display state of the current screen is that the primary screen is on, and the secondary screen is off, and thus it is determined that the display state needs to be switched. Thus, the screen is switched. In addition, it is determined that the camera usage state changes from the folded rear non-selfie state to the folded rear selfie state, and thus the anti-mistaken touch function is turned on for the primary and secondary screens, and the anti-mistaken touch function lasts for a preset time.

[0453] The specific implementation of "determining that the display state of the screen needs to be changed" in this step can be seen in the above Fig.18 Steps S101 to 108 and S111 in the above; the specific implementation of "controlling the switching screen, turning off the main screen and turning on the secondary screen" can be referred to above Fig.19 Steps S201 to S203 in the above; the specific implementation of "enabling the preset duration of the anti-mistouch function for the main screen and the secondary screen" can be referred to above Fig.18 Steps S112 to S114 in the above are not described in detail.

[0454] It should be noted that before the main screen is turned off, the camera application can also display the flip guide interface 1105 (also called the first interface) on the main screen through the underlying display framework, etc. Optionally, the flip guide interface disappears after being displayed for a preset period of time (for example, 3 seconds), and the main screen is turned off. When the flip guide interface 1105 is specifically displayed, the post-selfie management module can send an interface display request to the plug-in manager, and the interface display request is used to request the display of the flip guide interface 1105. The plug-in manager responds to the interface display request, layouts the flip guide interface, and sends an interface display instruction to the underlying layer. The underlying layer responds to the interface display instruction and displays the flip guide interface 1105 on the main screen. For the specific process here, please refer to Fig.19 In other embodiments of the present application for entering the rear Selfie function, the flip guide interface 1105 may also be displayed according to the process, which will not be described in detail. The flip guide interface 1105 can refer to the above Figure 7 Figure (c) in .

[0455] S511. The bottom layer feeds back the screen switching result (the main screen turns off and the secondary screen turns on) and the preview stream to the plug-in manager of the camera application.

[0456] S512. After receiving the screen switching result, the plug-in manager filters and selects the required modes and functions according to scene switching notification 1 (switching to the rear selfie scene), refreshes the photo preview interface layout, and updates the controls. The updated controls include a flip camera control and a main screen switch control.

[0457] Specifically, after entering the rear selfie function, some functions and modes of the camera can be blocked. For example, if the large aperture mode is not supported under the rear selfie function, the plug-in manager will block the controls and options of the large aperture mode when laying out the photo preview interface.

[0458] S513: The plug-in manager sends an interface display instruction to the bottom layer.

[0459] S514. The bottom layer responds to the interface display instruction and displays the photo preview interface 1106 on the secondary screen according to the refreshed photo preview interface layout and the updated controls.

[0460] The photo preview interface 1106 can refer to the above Figure 7 Figure (d) in .

[0461] In this embodiment, when entering the rear selfie scene from the rear non-selfie scene, there is no need to switch the camera instruction. The scene switching instruction 1 is used to instruct the image acquired by the rear camera to perform relevant processing of the rear non-selfie, thereby realizing the rear selfie function and eliminating the camera switching process, thereby improving the algorithm operation efficiency.

[0462] 2) Enter the rear selfie function in the front selfie scene

[0463] See Table 1 above. Fig.11 , Fig.12 and Fig.15 In the front selfie scene, the user can enter the rear selfie function by turning on the rear selfie function switch and clicking the rear selfie control, or setting the default selfie mode to the rear selfie. In this embodiment, the user clicks the rear selfie control 2402 ( Fig.15 ) as an example.

[0464] See also Fig.24 , when the external folding screen mobile phone is in the folded state, the main screen is on, the sub-screen is off, and the main screen displays the photo preview interface 2401, the camera application and the bottom layer can enter the rear selfie function according to the following process:

[0465] S601. In response to a user clicking on the rear-mounted selfie control 2402, the rear-mounted selfie function unit in the rear-mounted selfie module sends a rear-mounted selfie entry instruction to the rear-mounted selfie management unit.

[0466] For details, please refer to Fig.15 In Figure (b), the user clicks on the rear selfie control 2402 in the photo preview interface 2401.

[0467] S602, the rear selfie management unit sends a camera switching instruction to the camera controller in the camera communication module in response to the rear selfie entry instruction, and the camera switching instruction carries the camera information (rear camera) and the shooting scene (rear selfie scene).

[0468] The camera switching instruction is used to instruct switching the camera to the rear camera, capture an image through the switched camera, and instruct configuration of preview stream mirroring parameters and stream configuration parameters that match the information carried in the camera switching instruction.

[0469] S603: The camera controller generates a capture request 2 in response to the camera switching instruction, where the capture request 2 carries information about the rear camera.

[0470] S604: The camera controller sends the capture request 2 to the stream parameter generation unit.

[0471] S605: The camera controller sends a mirror parameter generation instruction 2 to the mirror parameter generation unit. The mirror parameter generation instruction 2 carries a shooting scene (a rear-mounted selfie scene).

[0472] S606: The mirror parameter generation unit generates preview stream mirror parameters 3 matching the post-selfie scene in response to the mirror parameter generation instruction 2.

[0473] S607: The mirroring parameter generating unit sends the preview stream mirroring parameter 3 to the stream parameter generating unit.

[0474] S608. The mirror parameter generation unit sends a stream parameter generation instruction 2 to the stream parameter generation unit. The stream parameter generation instruction 2 carries a shooting scene (a post-selfie scene).

[0475] S609: The stream parameter generation unit generates stream configuration parameters 3 matching the post-selfie scene in response to the stream parameter generation instruction 2. The stream configuration parameters 3 include a post-selfie flag, and the value of the post-selfie flag is 1.

[0476] S610. The stream parameter generation unit sends the capture request 2, the preview stream mirroring parameter 2, and the stream configuration parameter 2 to the bottom layer.

[0477] S611. The bottom layer responds to capture request 2, switches the camera to the rear camera, captures an image through the rear camera, and performs mirroring on the captured image based on preview stream mirroring parameter 1 to obtain a mirrored image; and configures a preset rear selfie algorithm according to stream configuration parameter 2 to obtain rear selfie algorithm 2 and generate a preview stream.

[0478] S612, the bottom layer monitors the change in the camera usage status and determines that the display status of the screen needs to be changed, so the screen is switched, the main screen is turned off, the sub-screen is turned on, and the anti-mistouch function of the main screen and the sub-screen is turned on for a preset time.

[0479] S613: The bottom layer feeds back the screen switching result and the preview stream to the plug-in manager of the camera application.

[0480] S614: The camera controller sends a layout adjustment request to the plug-in manager, where the layout adjustment request is used to request adjustment of the interface layout.

[0481] S615. The plug-in manager responds to the layout adjustment request, filters and selects the required modes and functions, refreshes the photo preview interface layout, and updates the controls, where the updated controls include a flip camera control and a switch main screen control.

[0482] S616: The plug-in manager sends an interface display instruction to the bottom layer.

[0483] S617: The bottom layer responds to the interface display instruction and displays the photo preview interface 1106 on the secondary screen according to the refreshed photo preview interface layout and the updated controls.

[0484] The above steps S609 to S612, S615 to S617 are the same as the above steps S609 to S612, S615 to S617. Fig.23 Steps S508 to S512 in the illustrated embodiment are similar and will not be described in detail.

[0485] This embodiment is different from the above Fig.23 Compared with the embodiment shown in the figure, the main difference is that in this embodiment, the rear selfie function is entered in the front selfie scene, so the camera needs to be switched. Therefore, the rear selfie management unit sends a camera switching instruction to the camera controller, instructing to switch the camera and re-distribute the stream.

[0486] In this embodiment, when entering the rear-camera selfie scene from the front-camera selfie scene, the camera switching is achieved through the camera switching instruction, that is, the front camera is switched to the rear camera, and the image obtained by the rear camera is processed related to the rear non-selfie, thereby realizing the rear-camera selfie function.

[0487] 3) Enter the rear Selfie function through the quick menu without starting the camera

[0488] See Table 1 above, Fig. 9 , Fig.10 When the camera application is not started and the rear-camera selfie function is turned on (or continuously available), the user can start the camera and directly enter the rear-camera selfie function by clicking the selfie option in the shortcut menu or clicking the selfie shortcut icon. This embodiment is described by taking the example of the user clicking the selfie shortcut icon to start the camera.

[0489] For example, Fig.25 A flowchart of a camera startup phase provided in an embodiment of the present application is shown in FIG. Fig.25 As shown, the process includes:

[0490] S801. When the external folding screen mobile phone is in the folded state, the operation management module of the camera application creates a camera process in response to the operation of clicking the selfie shortcut icon.

[0491] In the current scenario, the underlying related modules control the display status of the screen as follows: the main screen is on and the secondary screen is off.

[0492] For details, see Fig.10 In figure (b), the user can click on the selfie shortcut icon 1401.

[0493] S802: The operation management module obtains and stores the folding form (folded state) of the electronic device from the bottom layer.

[0494] S803, the operation management module reads configuration file 2, the shooting mode in configuration file 2 is portrait mode, the shooting scene is a rear selfie scene, and the camera information is a rear camera.

[0495] The main difference between profile 2 and profile 1 is that the shooting scene in profile 2 is a rear selfie scene, while the shooting scene in profile 1 is a rear non-selfie scene. In addition, when the camera application directly enters the rear selfie function after startup, the default shooting mode can be set. The embodiment of the present application takes the default "portrait mode" as an example for explanation. Therefore, the shooting mode in profile 2 is portrait mode.

[0496] S804, the operation management module sends a rear Selfie entry instruction to the rear Selfie function unit in the rear self-timer module according to the folding form (folded state) and configuration file 2. The rear Selfie entry instruction may carry the folding form (folded state) and configuration file 2.

[0497] S805. The rear-mounted selfie function unit sends a rear-mounted selfie entry instruction to the rear-mounted selfie management unit.

[0498] S806: The rear selfie management unit sends a camera control instruction to the camera controller in the camera communication module in response to the rear selfie entry instruction. The camera control instruction carries a shooting mode (portrait mode), a shooting scene (rear selfie scene), and camera information (rear camera).

[0499] S807: The camera controller generates a capture request 3 in response to the camera control instruction. The capture request 3 carries information of the rear camera.

[0500] S808. The camera controller sends the capture request 3 to the stream parameter generation unit.

[0501] S809: The camera controller sends a mirror parameter generation instruction 3 to the mirror parameter generation unit. The mirror parameter generation instruction 3 carries a shooting scene (rear-mounted selfie scene).

[0502] The mirror parameter generation instruction 3 is used to instruct the generation of preview stream mirror parameters that match the rear selfie scene.

[0503] S810. The mirroring parameter generating unit generates a preview stream mirroring parameter 4 matching the post-selfie scene in response to the parameter generating instruction 3.

[0504] S811. The mirroring parameter generating unit sends the preview stream mirroring parameter 4 to the stream parameter generating unit.

[0505] S812: The camera controller sends a stream parameter generation instruction 3 to the stream parameter generation unit. The stream parameter generation instruction 3 carries a shooting scene (a rear selfie scene).

[0506] S813. The stream parameter generation unit generates a stream configuration parameter 4 matching the post-selfie scene and the portrait mode in response to the stream parameter generation instruction 3. The stream configuration parameter 4 includes a post-selfie flag, and the value of the post-selfie flag is 1.

[0507] S814. The stream parameter generation unit sends the capture request 3, the preview stream mirroring parameter 4 and the stream configuration parameter 4 to the bottom layer.

[0508] S815. The bottom layer responds to the capture request 3, captures an image through the rear camera, and performs mirroring on the captured image based on the preview stream mirroring parameter 4 to obtain the mirrored image; and configures the preset rear selfie algorithm according to the stream configuration parameter 4 to obtain the rear non-selfie algorithm 3, processes the image mirrored based on the rear selfie algorithm 3, and generates a preview stream.

[0509] S816. Monitor the change in the camera usage status and determine that the screen display status needs to be changed, so control the screen switching, turn off the main screen, turn on the sub-screen, and enable the anti-mistouch function for the main screen and the sub-screen for a preset time.

[0510] S817: The bottom layer returns the preview stream to the plug-in manager.

[0511] S818. The operation management module sends a plug-in loading instruction to the plug-in manager.

[0512] S819. The plug-in manager responds to the plug-in loading instruction, reads the folding form and the configuration file, and initializes the core plug-in (init core plugins) according to the folding form and the configuration file.

[0513] S820. The plug-in manager sends a loading request to the rear selfie function unit in the rear selfie module, where the loading request is used to request loading of the rear selfie function.

[0514] S821. The rear selfie function unit determines whether the rear selfie function is available in response to the loading request; if so, execute step S822.

[0515] S822. The rear-mounted selfie function unit sends an instruction message for loading the rear-mounted selfie function to the plug-in manager.

[0516] S823: In response to the instruction message, the plug-in manager obtains resources of the rear-mounted selfie function from the rear-mounted selfie function unit.

[0517] S824. The plug-in manager refreshes the layout of the photo preview interface according to the folding form, configuration file, resources of the rear selfie function, and preview stream, and loads controls, including a camera flip control and a main screen switch control.

[0518] S825. The plug-in manager sends an interface display instruction to the bottom layer.

[0519] S826. The bottom layer responds to the interface display instruction and displays the photo preview interface 1106 on the secondary screen according to the layout of the photo preview interface, loaded controls, and preview stream.

[0520] The above process and Fig. 22 The main difference between the processes shown in the embodiments is that in this embodiment, the user clicks the selfie shortcut icon to start the camera and enter the post-selfie function. Therefore, the shooting scenes in the acquired configuration file are different, and the preview stream mirroring parameters and stream configuration parameters configured subsequently are also different. In this embodiment, the switching of the screen state will be triggered, etc.

[0521] In this embodiment, when the user clicks the selfie option or selfie icon in the main interface, a camera process is created, and the rear camera is requested to obtain an image through capture request 3. A preset rear selfie algorithm is configured based on preview stream mirror parameter 4 and stream configuration parameter 4 to perform rear selfie-related processing on the image obtained by the rear camera to obtain a preview stream. The interface is laid out based on the preview stream, and a photo preview interface is displayed. This embodiment realizes the direct start of the rear selfie function when the camera is started, which simplifies user operations and facilitates user use.

[0522] 3. Exit the rear selfie function stage

[0523] As described in the above embodiment, during the use of the rear selfie function, the user can exit the rear selfie function by clicking to switch the main screen control, clicking to flip the camera control, flipping to exit, unfolding the outer folding screen mobile phone to the unfolded state, etc. The following mainly takes clicking to switch the main screen control as an example to explain the process of exiting the rear selfie function.

[0524] See also Fig.26 When the external folding screen mobile phone is in the folded state, the main screen is off, the secondary screen is on, and the secondary screen displays the photo preview interface 1106, the camera application and the bottom layer can exit the rear selfie function according to the following process:

[0525] S701: In response to a user's operation of exiting a rear-mounted selfie function, a rear-mounted selfie function unit in a rear-mounted selfie module sends a rear-mounted selfie exit instruction to a rear-mounted selfie management unit. The rear-mounted selfie exit instruction is used to instruct to exit the rear-mounted selfie function.

[0526] The interface diagram of this step can be found in the above Fig.14 . Users can Fig.14 In the photo preview interface 1106 in FIG. 8 (a), click to switch the main screen control 2123.

[0527] Optionally, the user can also trigger the exit of the rear selfie function by flipping the exit operation. Specifically, the rear selfie management unit can subscribe to the flip exit notification to the module responsible for the flip wake-up function in the folding screen mobile phone. When the user performs the flip exit operation, the module notifies the rear selfie function unit, and the rear selfie function unit sends a rear selfie exit instruction to the rear selfie management unit.

[0528] Optionally, the user can also trigger the exit of the rear selfie function by unfolding the outer folding screen phone to the unfolded state. Fig.18 As described in steps S101 to S108 and S116 of the illustrated embodiment, when the folding state management framework monitors that the folding state of the folding screen mobile phone has changed, a folding state change notification is sent to the rear selfie function unit. The rear selfie function unit receives the folding state change notification and determines that the folding state has changed from the folded state to the unfolded state, and then sends a rear selfie exit instruction to the rear selfie management unit. Other state monitoring that may trigger the exit of the rear selfie function is similar and will not be repeated.

[0529] In addition, when the foldable screen mobile phone detects that the user clicks on the flip camera control or switches the main screen control, or exits the operation, etc., it notifies the rear selfie function unit, and the rear selfie function unit sends a rear selfie exit instruction to the rear selfie management unit.

[0530] S702: The rear-mounted selfie management unit sends a scene switching notification 2 (switching to the rear-mounted non-selfie scene) to the plug-in manager in response to the rear-mounted selfie exit instruction.

[0531] The scene switching notification 2 is used to notify the plug-in manager that the shooting scene has changed. Optionally, the scene switching notification 2 carries the switched shooting scene, that is, the rear non-selfie scene.

[0532] S703: In response to the scene switching notification 2, the plug-in manager sends a stream allocation instruction 2 (carrying a rear non-selfie scene) to the mirror parameter generation unit in the camera communication module.

[0533] The stream allocation instruction 2 is used to indicate the configuration of preview stream mirror parameters and stream configuration parameters. Optionally, the stream allocation instruction 2 may carry the switched shooting scene (ie, the post-shot non-selfie scene).

[0534] S704. The mirror parameter generation unit generates preview stream mirror parameters 5 that match the post-positioned non-selfie scene in response to the stream matching instruction 2.

[0535] S705. The mirroring parameter generating unit sends the preview stream mirroring parameter 5 to the stream parameter generating unit.

[0536] S706. The mirror parameter generation unit sends a flow allocation instruction 2 to the flow parameter generation unit.

[0537] S707: The stream parameter generation unit generates stream configuration parameters 5 that match the post-shot non-selfie scene and the shooting mode before switching (eg, portrait mode) in response to the stream configuration instruction 2.

[0538] S708. The stream parameter generation unit sends the preview stream mirroring parameter 5 and the stream configuration parameter 5 to the bottom layer.

[0539] S709. The bottom layer performs mirror processing on the image captured by the rear camera based on the preview stream mirror parameter 5 to obtain the mirrored image; and configures the preset rear non-selfie algorithm according to the stream configuration parameter 5 to obtain the rear non-selfie algorithm 2, and processes the mirrored image based on the rear non-selfie algorithm 2 to generate a preview stream.

[0540] S710. The bottom layer monitors the change in the camera usage status and determines that the screen display status needs to be changed, so the screen is switched, the main screen is turned on, the sub-screen is turned off, and the anti-mistouch function of the main screen and the sub-screen is turned on for a preset time.

[0541] S711. The bottom layer feeds back the screen switching result (the main screen turns on and the secondary screen turns off) and the preview stream to the plug-in manager of the camera application.

[0542] S712. After receiving the screen switching result, the plug-in manager filters and selects the required modes and functions according to the scene switching notification 2, refreshes the photo preview interface layout, and updates the controls, wherein the updated controls include the rear selfie controls.

[0543] S713. The plug-in manager sends an interface display instruction to the bottom layer.

[0544] S714. The bottom layer responds to the interface display instruction and displays the photo preview interface 901 on the main screen according to the refreshed photo preview interface layout and the updated controls.

[0545] 4. Folding morphology change stage

[0546] See also Fig. 27 , following the above Fig. 22 In step S422, when the external folding screen mobile phone is in the folded state, the main screen is on, the secondary screen is off, and the main screen displays the photo preview interface 901, as shown in FIG. Fig. 22 As shown, the folding morphology change stage may include the following steps:

[0547] S423. In response to the user unfolding the foldable screen mobile phone to the unfolded state, the bottom layer detects that the folding state has changed, determines that the display state needs to be changed, and thus controls the screen switching, with the main screen and the secondary screen being lit at the same time.

[0548] The specific implementation of this step can be found in the above Fig.18 Steps S101 to 108 and S111, S112 to S114; Fig.19 Steps S201 to S203, etc., will not be repeated here.

[0549] S424. The bottom layer sends a folding state change notification to the plug-in manager in the camera application.

[0550] S425: The plug-in manager refreshes the layout of the photo preview interface in response to the folding state change notification.

[0551] S426: The plug-in manager sends an interface display instruction to the bottom layer.

[0552] S427, the bottom layer responds to the interface display instruction, and displays the photo preview interface 1801 through the main screen and the sub-screen according to the preview interface layout of the photo after refreshing.

[0553] The interface diagram of this embodiment can be found in the above Fig.13 .

[0554] The above describes the implementation of the rear selfie function using an external folding screen mobile phone as an example. For an internal folding screen mobile phone, the implementation process is similar to that of an external folding screen mobile phone. The difference is that the internal folding screen mobile phone enters the rear selfie function in the unfolded state, and displays the photo preview interface 2204 on the external display screen (see Fig.16 ), after the inner folding screen mobile phone is folded from the unfolded state to the folded state, the rear selfie function is exited, and the photo preview interface 2201 is displayed simultaneously through the first inner display screen and the second inner display screen (see Fig.16 ). Therefore, when the software architecture implements the above process, the control of screen switching and the screen where the interface is displayed are slightly different. The implementation principles of the two are similar and will not be repeated here.

[0555] The above describes in detail an example of a photographing method provided by an embodiment of the present application. It is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to exceed the scope of the present application.

[0556] The embodiment of the present application can divide the functional modules of the electronic device according to the above method example. For example, each function can be divided into various functional modules, such as a detection unit, a processing unit, a display unit, etc., or two or more functions can be integrated into one module. The above integrated module can be implemented in the form of hardware or in the form of a software functional module. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0557] It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0558] The electronic device provided in this embodiment is used to execute the above-mentioned photographing method, and thus can achieve the same effect as the above-mentioned implementation method.

[0559] For example, Fig.28 1 is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a sensor module 180, a button 190, a camera 193, and a display screen 194. The sensor module 180 may include an angle sensor 180A, a gyroscope sensor 180B, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a touch sensor 180K, and the like.

[0560] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0561] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0562] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0563] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0564] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering.

[0565] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. In the embodiment of the present application, N may be equal to 2, that is, the electronic device 100 may include 2 display screens 194, one of which is a main screen and the other is a secondary screen. The main screen and the secondary screen may be connected as one and made of a flexible material.

[0566] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0567] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0568] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1. In the embodiment of the present application, N may be equal to 2, that is, the electronic device 100 may include 2 cameras, one is a front camera and the other is a rear camera. Among them, the front camera is arranged on the main screen, and the rear camera is arranged on the raised portion.

[0569] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0570] The internal memory 121 may be used to store computer executable program codes, which include instructions. The processor 110 executes the instructions stored in the internal memory 121 to perform various functional applications and data processing of the electronic device 100.

[0571] The angle sensor 180A is used to detect the angle between the first structural member and the second structural member, so as to determine whether the electronic device is in a folded state or an unfolded state according to the angle, and then control the states of the main screen and the sub-screen.

[0572] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focus.

[0573] In the embodiment of the present application, one or more of the gyroscope sensor 180B, the magnetic sensor 180D, the accelerometer sensor 180E and the distance sensor 180F cooperate to implement flip detection of the electronic device 100, that is, to detect whether the electronic device has been flipped.

[0574] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0575] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the processor executes the photographing method of any of the above embodiments.

[0576] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer executes the above-mentioned related steps to implement the photographing method in the above-mentioned embodiment.

[0577] In addition, an embodiment of the present application also provides a device, which may specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor may execute the computer-executable instructions stored in the memory so that the chip executes the photo-taking method in the above-mentioned method embodiments.

[0578] Among them, the electronic device, computer-readable storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above and will not be repeated here.

[0579] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0580] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0581] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0582] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0583] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0584] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A photographing method, the method being executed by an electronic device, characterized in that: The electronic device is a foldable device, and the electronic device includes a first screen, a second screen, and a rear camera. When the electronic device is in a first form, the second screen and the rear camera are on the same side, and when the electronic device is in a second form, the second screen and the rear camera are on different sides. The method includes: When the electronic device is in the first state, the first screen is in a light-on state, and the second screen is in a light-off state, receiving a first operation from a user; In response to the first operation, generating a first screen switching instruction, wherein the first screen switching instruction includes an identifier of the second screen; In response to the first screen switching instruction, the first screen of the electronic device in the first form is controlled to turn off, the second screen is controlled to turn on, and the image acquired by the rear camera is displayed through the second screen.

2. The method according to claim 1, characterized in that Before receiving the first operation of the user, the method further includes: Receive the user's operation of opening the camera application; In response to the operation of opening the camera application, a first preview interface is displayed through the first screen, and the first preview interface includes a first control and an image acquired by the rear camera.

3. The method according to claim 2, characterized in that The electronic device further includes a front camera, and the front camera and the first screen are located on the same side. After displaying the first preview interface through the first screen and before receiving the first operation of the user, the method further includes: Receiving a setting operation from a user, wherein the setting operation is used to set a default selfie mode to a front-facing selfie; In response to the setting operation, displaying a second preview interface through the first screen, wherein the second preview interface includes a second control and an image acquired by the rear camera; In response to an operation on the second control, a third preview interface is displayed through the first screen, and the third preview interface includes a third control and an image acquired by the front camera.

4. The method according to claim 3, characterized in that The first operation is an operation acting on the first control, or an operation of flipping the electronic device, or an operation acting on the third control.

5. The method according to claim 4, characterized in that Before displaying the first preview interface through the first screen, the method further includes: In response to the operation of opening the camera application, generating a first image acquisition request, wherein the first image acquisition request includes an identifier of the rear camera; In response to the first image acquisition request, the rear camera is controlled to continuously acquire the first image.

6. The method according to claim 5, characterized in that The first operation is an operation acting on the first control, or an operation of flipping the electronic device, and the method further includes: In response to the first operation, generating a first scene switching instruction, wherein the first scene switching instruction includes an identifier of a first shooting scene; In response to the first scene switching instruction, processing the first image based on a first algorithm corresponding to the first shooting scene to obtain a second image; The step of displaying the image acquired by the rear camera through the second screen includes: The second image is displayed through the second screen.

7. The method according to claim 6, characterized in that The step of processing the first image based on a first algorithm corresponding to the first shooting scene to obtain a second image in response to the first scene switching instruction includes: In response to the first scene switching instruction, generating a first preview stream mirroring parameter and a first stream configuration parameter matching the first shooting scene; the first stream configuration parameter includes an identifier of the first algorithm; mirroring the first image according to the mirroring parameters of the first preview stream to obtain a third image; According to the first stream configuration parameters, configure the first algorithm to obtain a first target algorithm; Based on the first target algorithm, the third image is processed to obtain the second image.

8. The method according to claim 4, characterized in that After displaying the first preview interface through the first screen and before displaying the second preview interface through the first screen, the method further includes: In response to the operation on the second control, generating a second image acquisition request, wherein the second image acquisition request includes an identifier of the front camera; In response to the second image acquisition request, the front camera is controlled to continuously acquire images.

9. The method according to claim 8, characterized in that The first operation is an operation acting on the third control, and the method further includes: In response to the first operation, generating a camera switching instruction and a second scene switching instruction, wherein the camera switching instruction includes an identifier of the rear camera, and the second scene switching instruction includes an identifier of the first shooting scene; In response to the camera switching instruction, controlling the front camera to stop acquiring images, and controlling the rear camera to continue acquiring a fourth image; In response to the second scene switching instruction, processing the fourth image based on a first algorithm corresponding to the first shooting scene to obtain a fifth image; The step of displaying the image acquired by the rear camera through the second screen includes: The fifth image is displayed through the second screen.

10. The method according to claim 9, characterized in that The step of processing the fourth image based on a first algorithm corresponding to the first shooting scene to obtain a fifth image in response to the second scene switching instruction includes: In response to the second scene switching instruction, generating a second preview stream mirroring parameter and a second stream configuration parameter matching the first shooting scene; the second stream configuration parameter includes an identifier of the first algorithm; mirroring the fourth image according to the second preview stream mirroring parameter to obtain a sixth image; According to the second stream configuration parameters, configure the first algorithm to obtain a second target algorithm; Based on the second target algorithm, the sixth image is processed to obtain the fifth image.

11. The method according to any one of claims 1 to 10, characterized in that The method further comprises: Displaying a main interface through the first screen, the main interface including a first icon, the first icon being associated with a first shooting scene; receiving a second operation acting on the first icon; In response to the second operation, the first screen is controlled to turn off, the second screen is controlled to turn on, and the seventh image acquired by the rear camera is displayed through the second screen.

12. The method according to claim 11, characterized in that Before displaying the seventh image acquired by the rear camera through the second screen, the method further includes: In response to the second operation, creating a camera process; Generate a third image acquisition request and a third preview stream mirror parameter and a third stream configuration parameter matching the first shooting scene; the third image acquisition request includes an identifier of the rear camera, and the third stream configuration parameter includes an identifier of a first algorithm matching the first shooting scene; In response to the third image acquisition request, controlling the rear camera to continuously acquire an eighth image; Processing the eighth image based on the first algorithm according to the third preview stream mirroring parameter and the third stream configuration parameter to obtain the seventh image; The displaying the seventh image acquired by the rear camera through the second screen includes: generating interface layout information according to the seventh image and the resource information corresponding to the first shooting scene; According to the interface layout information, a fourth preview interface is displayed through the second screen, and the fourth preview interface includes the seventh image.

13. The method according to claim 12, characterized in that Before generating the interface layout information according to the resource information corresponding to the seventh image and the first shooting scene, the method further includes: Determine that a first function corresponding to the first shooting scene is in an enabled state.

14. The method according to claim 12 or 13, characterized in that The generating of the third image acquisition request and the third preview stream mirroring parameters and the third stream configuration parameters matching the first shooting scene includes: Acquire the current state of the electronic device and a configuration file corresponding to the second operation; When it is determined that the current form of the electronic device is the first form, and the configuration file includes an identifier of the rear camera and an identifier of the first shooting scene, the third image acquisition request, the third preview stream mirroring parameters, and the third stream configuration parameters are generated according to the configuration file.

15. The method according to any one of claims 1 to 14, characterized in that The step of generating a first screen switching instruction in response to the first operation includes: In response to the first operation, determining that a shooting scene corresponding to the first operation is a first shooting scene, and a current state of the electronic device is the first state; According to the first shooting scene and the first form, determining that a target display state of the first screen is an off-screen state, and a target display state of the second screen is a bright-screen state; Determining that a current display state of the first screen is different from a target display state of the first screen, and a current state of the second screen is different from a target display state of the second screen; Generate the first screen switching instruction.

16. The method according to any one of claims 1 to 15, characterized in that The step of controlling the first screen of the electronic device in the first state to turn off the first screen and turn on the second screen in response to the first screen switching instruction includes: In response to the screen switching instruction, displaying a first interface; After the first interface is displayed for a preset time, the first screen is controlled to turn off and the second screen is controlled to turn on.

17. The method according to any one of claims 1 to 16, characterized in that The electronic device is an inward-folding screen device, the first screen is a folding screen, the first form is an unfolded state, and the second form is a folded state. When the electronic device is in the first form, the first screen and the second screen are on different sides.

18. The method according to any one of claims 1 to 16, characterized in that The electronic device is an external folding screen device, the electronic device includes a folding screen, the folding screen includes the first screen and the second screen, the first form is a folded state, the second form is an unfolded state, and when the electronic device is in the second form, the first screen and the second screen are on the same side.

19. The method according to claim 18, characterized in that The method further comprises: When the electronic device is in the first form, the first screen is in an off-screen state, the second screen is in an on-screen state, and the second screen displays an image acquired by the rear camera, when it is detected that the electronic device is unfolded from the first form to the second form, a third scene switching instruction and a second screen switching instruction are generated, the third scene switching instruction includes an identifier of the second shooting scene, and the second screen switching instruction includes identifiers of the first screen and the second screen; In response to the third scene switching instruction, processing the image acquired by the rear camera based on a second algorithm corresponding to the second shooting scene to obtain a ninth image; In response to the second screen switching instruction, both the first screen and the second screen are controlled to light up, and the ninth image is displayed through the first screen and the second screen.

20. The method according to claim 18, characterized in that The method further comprises: When the electronic device is in the first state, the first screen is in an off state, the second screen is in an on state, and the second screen displays an image acquired by the rear camera, receiving a second operation of the user; In response to the second operation, generating a third scene switching instruction and a third screen switching instruction, wherein the third scene switching instruction includes an identifier of the second shooting scene, and the third screen switching instruction includes an identifier of the first screen; In response to the third scene switching instruction, processing the image acquired by the rear camera based on a second algorithm corresponding to the second shooting scene to obtain a ninth image; In response to the third screen switching instruction, the second screen is controlled to be turned off, the first screen is controlled to be turned on, and the ninth image is displayed through the first screen.

21. An electronic device, characterized in that: include: Processors, memory, and interfaces; The processor, the memory and the interface cooperate with each other so that the electronic device executes the method as claimed in any one of claims 1 to 20.

22. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor calls instructions so that the electronic device executes the method according to any one of claims 1 to 20.

Images