Photographing method and electronic device

Abstract

A photographing method and an electronic device, relating to the technical field of terminals. Photographing at various angles and panoramic photography at large angles can be flexibly realized by using a folding rotating shaft of an electronic device with a folding screen. Specifically, after entering rotation photography, along with the change of a folding angle during folding or unfolding, a preview interface is always kept displayed on a front screen. In response to a photography operation, an image is photographed by a rear camera.

Description

Shooting method and electronic equipment Technical Field

[0001] The embodiments of the present application relate to the field of terminal technology, and in particular to a shooting method and electronic device. Background Art

[0002] Electronic devices such as mobile phones and tablets usually provide a camera function. For example, a camera application is installed in the electronic device, which can provide the function of taking pictures and videos.

[0003] However, when using the above-mentioned shooting function, if the user wants to take a picture of something from the side or behind, they usually need to turn their body to achieve this. In addition, when using the above-mentioned shooting function, if the user wants to take a picture of the scene in front of them and themselves (or the scene behind them) in one picture, it will be very difficult to achieve without the help of others.

[0004] Summary of the Invention

[0005] The present application provides a shooting method and an electronic device, which can utilize the folding hinge of an electronic device with a folding screen to flexibly achieve shooting at various angles and wide-angle panoramic shooting.

[0006] To achieve the above objectives, this application adopts the following technical solutions:

[0007] In a first aspect, a photographing method is provided, which is applied to an electronic device, such as a mobile phone in form three as shown in Figures 4A and 4B. The electronic device includes a display screen (such as folding screen 401 or folding screen 411 as described below) and a rear camera (such as rear camera 403). The display screen includes a first sub-screen (such as third screen 4013 or third screen 4113 as described below), a second sub-screen (such as second screen 4012 or second screen 4112 as described below), and a third sub-screen (such as first screen 4011 or first screen 4111 as described below). The first sub-screen, the second sub-screen, and the third sub-screen are three different display areas of the display screen. When the display screen is in an unfolded state, the second sub-screen is located between the first sub-screen and the third sub-screen. When the display screen is in a folded state, the display directions of the first sub-screen and the second sub-screen are opposite to each other, and the display directions of the second sub-screen and the third sub-screen are opposite to each other. The rear camera is arranged on the back of the third sub-screen.

[0008] Specifically, a first operation of the user is received, such as a click operation on the camera icon on the desktop. In response to the first operation, the camera application in the electronic device is turned on, and a first interface (i.e., a viewfinder interface for normal shooting, such as interface 602 described below) is displayed on at least one sub-screen of the display screen. The first interface includes a first viewfinder screen and a first control (such as the front and back switch control 6021 in interface 602 or the "more" 7011 in interface 701). It can be understood that the viewfinder screen refers to the real-time view of the camera. The user's second operation on the first control is received. In response to the second operation, a second interface (such as interface 604 described below) is displayed on the first sub-screen. The second interface includes a second viewfinder screen and a rotation shooting logo (such as the shooting entrance 6031 in interface 604). Among them, the rotation shooting logo can be used to indicate that the current mode has been switched to rotation shooting. In other words, the first control can be used to trigger the electronic device to switch from normal shooting to rotation shooting.

[0009] After entering the rotation shooting mode, as the first angle (hereinafter referred to as δ) between the first sub-screen and the second sub-screen changes and / or the second angle (hereinafter referred to as γ) between the second sub-screen and the third sub-screen changes, that is, when the first angle changes and / or the second angle changes, the second interface is kept displayed on the first sub-screen, and the screen displaying the user interface is not switched based on the device posture. A user shooting operation is received, such as a click operation on a shooting button. In response to the shooting operation, an image is captured by the rear camera.

[0010] In summary, using the solution of the present application, an electronic device can provide two shooting modes through the camera application: one is normal shooting, and the other is rotating shooting. Moreover, after triggering the rotation shooting mode, even if the second sub-screen and the third sub-screen are rotated to change the framing range of the rear camera, causing the first angle and the second angle to change, the electronic device will always display the user interface through the first sub-screen. Among them, the first sub-screen is always visible to the user and does not need to rotate with the rear camera. Therefore, it can be ensured that the user can view the viewfinder during the entire rotation shooting process. In this way, in specific shooting scenarios, such as taking a photo of the scene in front of the user and the self in the same photo, or taking a group photo, the user can achieve wide-angle shooting without turning the body or the phone, but only by rotating the second sub-screen and the third sub-screen, and can maintain a good preview effect through the first sub-screen during the shooting process.

[0011] Furthermore, in response to the second operation, the electronic device may record a first identifier (such as identifier a below) to indicate that the current mode has been switched to rotation shooting. Subsequently, when the first identifier is found, the electronic device will continue to display the second interface on the first sub-screen as the first angle and the second angle change. Of course, after exiting the rotation shooting, the electronic device can clear the first identifier, and subsequently, the electronic device can switch the screen based on the device posture, and no longer keep displaying the user interface on the first sub-screen.

[0012] After entering the rotation shooting mode, the electronic device also provides a function of dynamically turning on or off the rear mirror based on the first angle and the second angle (ie, function 2 below).

[0013] In a possible design of the first aspect, the above-mentioned displaying the second interface on the first sub-screen in response to the second operation includes: in response to the second operation, when the orientation angle (θ) of the rear camera is less than the first angle (angle 3 as described below) or greater than the fourth angle (angle 10 as described below), displaying the second interface on the first sub-screen in which the second viewfinder is a mirrored image; when the orientation angle is greater than the second angle (angle 4 as described below) and less than the third angle (angle 9 as described below), displaying the second interface on the first sub-screen in which the second viewfinder is a non-mirror image. The first angle and the second angle are greater than 0° and less than 180°, typically close to 90°, and the first angle is smaller than the second angle; the third angle and the fourth angle are between greater than 180° and less than 360°, typically close to 270°, and the third angle is smaller than the fourth angle.

[0014] The orientation angle includes the lens direction of the rear camera.

[0015] Specifically, the display direction of the first sub-screen can be used as the 0° direction of the orientation angle. During the rotational shooting process, the first sub-screen is usually facing the user. Therefore, using the display direction of the first sub-screen as the 0° direction of the orientation angle can also be understood as using the opposite direction of the user's orientation as the 0° direction of the orientation angle. That is, if the rear camera lens is facing the opposite direction of the user's orientation, the orientation angle is 0°; if the rear camera lens is facing the same direction as the user's orientation, the orientation angle is 180°.

[0016] Of course, in practice, the above 0° direction is not limited. For example, the direction opposite to the display direction of the first sub-screen can also be used as the 0° direction of the orientation angle, or the direction perpendicular to the display direction of the first sub-screen and to the left can be used as the 0° direction of the orientation angle, etc. This embodiment of the application does not specifically limit this.

[0017] Furthermore, based on the 0° direction, the clockwise or counterclockwise direction can be used as the positive direction of the heading angle. Taking clockwise rotation as an example, based on the 0° direction, one clockwise rotation can achieve a change in the heading angle from 0° to 360°; one counterclockwise rotation can achieve a change in the heading angle from 360° to 0°.

[0018] Typically, the electronic device can determine the orientation angle based on the first angle and the second angle.

[0019] For the electronic device of the first aspect, when used in portrait mode with the first sub-screen facing the user: if the orientation angle is greater than the second angle and less than the third angle, the rear camera will be tilted toward the scene in front of the user. In this case, rear mirroring is turned off, which conforms to the user's habit of rear camera usage in normal photo shooting. If the orientation angle is less than the first angle or greater than the fourth angle, the rear camera will be tilted toward the user. In this case, rear mirroring is turned on, and the user can conveniently adjust the captured scene based on the mirroring effect in the viewfinder, which is more in line with the user's habit of selfie preview.

[0020] In a possible design of the first aspect, as a first angle between the first sub-screen and the second sub-screen changes and / or a second angle between the second sub-screen and the third sub-screen changes, maintaining the second interface on the first sub-screen includes: in response to a change in the orientation angle from less than the first angle or greater than a fourth angle to greater than the second angle and less than the third angle, switching the second viewfinder image in the second interface to a non-mirrored image. In response to a change in the orientation angle from greater than the second angle and less than the third angle to less than the first angle or greater than the fourth angle, switching the second viewfinder image in the second interface to a mirrored image.

[0021] That is, as the first angle and the second angle change, resulting in a change in the orientation angle, the electronic device will also switch the state of the rear mirror so that the state of the rear mirror matches the orientation angle.

[0022] In addition, if when switching to rotational shooting, the orientation angle is greater than or equal to the first angle and less than or equal to the second angle, that is, between the first angle and the second angle, or the orientation angle is greater than or equal to the third angle and less than or equal to the fourth angle, that is, between the third angle and the fourth angle, the electronic device can turn off the rear mirror by default, and after the orientation angle changes to less than the first angle or greater than the fourth angle, the electronic device turns on the rear mirror. Subsequently, the electronic device can also switch the second viewfinder screen in the second interface to a non-mirror screen in response to the orientation angle changing from less than the first angle or greater than the fourth angle to greater than the second angle and less than the third angle. In response to the orientation angle changing from greater than the second angle and less than the third angle to less than the first angle or greater than the fourth angle, the second viewfinder screen in the second interface is switched to a mirrored screen. In this way, the electronic device can ensure that when entering rotational shooting at any orientation angle, the rear mirror can be accurately turned on or off based on the change in orientation angle.

[0023] In a possible design of the first aspect, the method further includes: during the process of capturing an image via the rear camera, displaying a third interface (i.e., a preview interface of the capturing phase), wherein the third interface includes a third viewfinder during the capturing phase. In response to the capturing operation, if the second viewfinder in the second interface is a mirrored image, the third viewfinder becomes a mirrored image as the orientation angle changes; and if the second viewfinder in the second interface is a non-mirror image, the third viewfinder becomes a non-mirror image as the orientation angle changes.

[0024] That is to say, after starting to shoot, the electronic device can lock the rear mirror on or off. In this way, it can avoid repeatedly turning the rear mirror on or off during the shooting process, which affects the user's shooting.

[0025] After entering the rotation shooting mode and the panorama mode, the electronic device also provides the function of adjusting the guide arrow (i.e., function three below). The following are introduced respectively:

[0026] In one possible design of the first aspect, after the second interface is displayed on the first sub-screen, the method further includes: receiving a third operation from the user, such as selecting a mode option for panoramic mode. In response to the third operation, the user switches to panoramic mode, and displays a fourth interface (i.e., a preview interface for panoramic shooting) on ​​the first sub-screen based on the current orientation angle. The fourth interface includes a first guide arrow or a second guide arrow. The first guide arrow indicates a first direction (e.g., from left to right), and the second guide arrow indicates a second direction (e.g., from right to left).

[0027] That is, the electronic device can automatically adjust the direction indicated by the guide arrow based on the orientation angle to meet the user's shooting needs.

[0028] In a possible design of the first aspect, the electronic device only adjusts the direction indicated by the guide arrow (such as the guide arrow 36021 below) around 180°.

[0029] Specifically, the above-mentioned display of the fourth interface based on the current orientation angle includes: when the orientation angle is less than the fifth angle (such as angle 11 below), displaying the fourth interface including the first guide arrow in the first sub-screen. When the orientation angle is greater than the sixth angle (such as angle 12 below), displaying the fourth interface including the second guide arrow in the first sub-screen. The fifth angle is greater than 90° and less than 180°, and the sixth angle is greater than 180° and less than 270°. Usually, the fifth angle and the sixth angle are both close to 180°.

[0030] For the electronic device of the first aspect, when used in portrait mode and the first sub-screen is facing the user: if the orientation angle is less than the fifth angle, it indicates that the user wants to shoot while the framing range of the rear camera changes clockwise, similar to shooting from left to right. Therefore, the electronic device displays a first guide arrow to guide the user to shoot from left to right. If the orientation angle is greater than the sixth angle, it indicates that the user wants to shoot while the framing range of the rear camera changes counterclockwise, similar to shooting from right to left. Therefore, the electronic device displays a second guide arrow to guide the user to shoot from right to left. In this way, the direction indicated by the guide arrow can be matched with the user's shooting needs.

[0031] In a possible design of the first aspect, after the fourth interface including the first guide arrow is displayed on the first sub-screen, or after the fourth interface including the second guide arrow is displayed on the first sub-screen, the method further includes: in response to the orientation angle changing from less than a fifth angle to greater than a sixth angle, switching the first guide arrow to the second guide arrow. In response to the orientation angle changing from greater than the sixth angle to less than the fifth angle, switching the second guide arrow to the first guide arrow.

[0032] That is, as the orientation angle changes, the electronic device will also switch the guide arrow so that the direction indicated by the guide arrow matches the orientation angle.

[0033] In addition, if when switching to panoramic mode, the heading angle is greater than or equal to the fifth angle and less than or equal to the sixth angle, that is, between the fifth angle and the sixth angle, the electronic device can display the first guide arrow by default, and after the heading angle changes to greater than the sixth angle, the electronic device switches to display the second guide arrow. Subsequently, the electronic device can also switch the first guide arrow to the second guide arrow in response to the heading angle changing from less than the fifth angle to greater than the sixth angle. In response to the heading angle changing from greater than the sixth angle to less than the fifth angle, the second guide arrow is switched to the first guide arrow. In this way, the electronic device can ensure that when entering panoramic mode at any heading angle, the direction indicated by the guide arrow can be accurately adjusted based on the change in the heading angle.

[0034] In one possible design of the first aspect, the electronic device may further adjust the guide arrow using corresponding angle thresholds based on the user's shooting intent. The shooting intent includes: shooting between [0°, 360°]; shooting between [0°, 180°]; and shooting between [180°, 360°].

[0035] First, the shooting intention is to shoot between [0°, 180°], and the eighth angle (such as angle 5 below) and the ninth angle (such as angle 6 below) are used as angle threshold adjustment guide arrows.

[0036] The above-mentioned display of the fourth interface based on the current orientation angle includes: when the second angle is less than the seventh angle (that is, the second angle is approximately equal to 0°, such as the seventh angle is 5°), and the orientation angle is less than the eighth angle, the fourth interface including the first guide arrow is displayed in the first sub-screen. When the second angle is less than the seventh angle and the orientation angle is greater than the ninth angle, the fourth interface including the second guide arrow is displayed in the first sub-screen. Among them, the eighth angle and the ninth angle are greater than 0° and less than 180°, usually close to 90°, and the eighth angle is less than the ninth angle.

[0037] For the electronic device of the first aspect, when used in portrait mode and the first sub-screen is facing the user: if the second angle is close to 0°, it indicates that the user wants to shoot between [0°, 180°]. Under this shooting intention, if the heading angle is less than the eighth angle, it indicates that the user wants to shoot clockwise between [0°, 180°], similar to shooting from left to right. Therefore, the electronic device displays a first guide arrow to guide the user to shoot from left to right. If the heading angle is greater than the ninth angle, it indicates that the user wants to shoot counterclockwise between [0°, 180°], similar to shooting from right to left. Therefore, the electronic device displays a second guide arrow to guide the user to shoot from right to left. Thereby, the direction indicated by the guide arrow can be matched with the user's shooting needs.

[0038] Second, the shooting intention is to shoot between [180°, 360°], and the tenth angle (such as angle 13 below) and the eleventh angle (such as angle 14 below) are used as angle threshold adjustment guide arrows.

[0039] The above-mentioned display of the fourth interface based on the current orientation angle includes: when the first angle is less than the seventh angle (that is, the first angle is approximately equal to 0°, such as the seventh angle is 5°), and the orientation angle is less than the tenth angle, the fourth interface including the first guide arrow is displayed in the first sub-screen. When the first angle is less than the seventh angle and the orientation angle is greater than the eleventh angle, the fourth interface including the second guide arrow is displayed in the first sub-screen. Wherein, the tenth angle and the eleventh angle are greater than 180° and less than 360°, usually close to 270°, and the tenth angle is less than the eleventh angle.

[0040] For the electronic device of the first aspect, when used in portrait mode and the first sub-screen is facing the user: if the first angle is close to 0°, it indicates that the user wants to shoot between [180°, 360°]. Under this shooting intention, if the facing angle is less than the tenth angle, it indicates that the user wants to shoot clockwise between [180°, 360°], similar to shooting from left to right. Therefore, the electronic device displays a first guide arrow to guide the user to shoot from left to right. If the facing angle is greater than the eleventh angle, it indicates that the user wants to shoot counterclockwise between [180°, 360°], similar to shooting from right to left. Therefore, the electronic device displays a second guide arrow to guide the user to shoot from right to left. Thereby, the direction indicated by the guide arrow can be matched with the user's shooting needs.

[0041] Third, the shooting intention is to shoot between [0°, 360°], and the fifth angle (such as angle 11 below) and the eleventh angle (such as angle 12 below) are used as angle threshold adjustment guide arrows.

[0042] The above-mentioned display of the fourth interface based on the current orientation angle includes: when the first angle and the second angle are both greater than or equal to the seventh angle, and the orientation angle is less than the fifth angle, displaying the fourth interface including the first guide arrow on the first sub-screen. When the first angle and the second angle are both greater than or equal to the seventh angle, and the orientation angle is greater than the sixth angle, displaying the fourth interface including the second guide arrow on the first sub-screen. The fifth angle is greater than 90° and less than 180°, and the sixth angle is greater than 180° and less than 270°. Typically, the fifth angle and the sixth angle are both close to 180°.

[0043] For the electronic device of the first aspect, when used in portrait mode and the first sub-screen is facing the user: if the first angle and the second angle are not close to 0°, it indicates that the user wants to shoot between [0°, 360°]. Under this shooting intention, if the heading angle is less than the fifth angle, it indicates that the user wants to shoot clockwise between [0°, 360°], similar to shooting from left to right. Therefore, the electronic device displays a first guide arrow to guide the user to shoot from left to right. If the heading angle is greater than the sixth angle, it indicates that the user wants to shoot counterclockwise between [0°, 360°], similar to shooting from right to left. Therefore, the electronic device displays a second guide arrow to guide the user to shoot from right to left. Thereby, the direction indicated by the guide arrow can be matched with the user's shooting needs.

[0044] Of course, corresponding to the above three shooting intentions, the electronic device will also adjust the guide arrow as the orientation angle changes. Specifically, in response to the orientation angle changing from less than the low threshold (such as the eighth angle, the tenth angle, the fifth angle) to greater than the high threshold (such as the ninth angle, the eleventh angle, the sixth angle), the first guide arrow is switched to the second guide arrow. In response to the orientation angle changing from greater than the high threshold to less than the low threshold, the second guide arrow is switched to the first guide arrow. In this way, the guide arrow can be switched as the orientation angle changes, so that the direction indicated by the guide arrow matches the orientation angle.

[0045] Furthermore, after switching to panoramic mode, the user's shooting intention may also change. Therefore, after switching to panoramic mode, the electronic device can also update the shooting intention based on the current first angle and / or second angle, and use the corresponding angle threshold to adjust the guide arrow.

[0046] Specifically, in response to the second angle changing from greater than or equal to the seventh angle to less than the seventh angle (i.e., the shooting intention is switched to shooting between [0°, 180°]), the electronic device can use the eighth angle and the ninth angle to switch the guide arrow in the fourth interface. In response to the first angle changing from greater than or equal to the seventh angle to less than the seventh angle (i.e., the shooting intention is switched to shooting between [180°, 360°]), the electronic device can use the tenth angle and the eleventh angle to switch the guide arrow in the fourth interface. In response to both the first angle and the second angle changing to greater than or equal to the seventh angle (i.e., the shooting intention is switched to shooting between [0°, 360°]), the electronic device can use the fifth angle and the sixth angle to switch the guide arrow in the fourth interface.

[0047] In this way, the guide arrow can be switched accurately after the shooting intention is updated.

[0048] In addition, if the heading angle is exactly between the low threshold and the high threshold when the shooting intention is determined, or when the shooting intention is updated, the electronic device can display the first guide arrow by default, and after the heading angle changes to greater than the high threshold, the electronic device can switch to the second guide arrow. Subsequently, as the heading angle changes, the electronic device will also adjust the guide arrow. That is, in response to the heading angle changing from less than the low threshold to greater than the high threshold, the first guide arrow is switched to the second guide arrow. In response to the heading angle changing from greater than the high threshold to less than the low threshold, the second guide arrow is switched to the first guide arrow. In this way, the electronic device can ensure that when the shooting intention is determined at any heading angle, the direction indicated by the guide arrow can be accurately adjusted based on the change in the heading angle.

[0049] In one possible design of the first aspect, the fourth interface includes a direction switch control for triggering the electronic device to adjust a guide arrow. After the fourth interface including the first guide arrow is displayed on the first sub-screen, the method further includes: in response to a fourth operation on the direction switch control, such as a click operation, switching the first guide arrow to a second guide arrow. After the fourth interface including the second guide arrow is displayed on the first sub-screen, the method further includes: in response to the fourth operation on the direction switch control, switching the second guide arrow to the first guide arrow.

[0050] That is to say, in addition to automatically adjusting the guide arrow based on the orientation angle, the electronic device can also provide an entry for manually switching the guide arrow, that is, a direction switching control, so that the user can switch to the desired direction.

[0051] It should be noted that the direction switching control can trigger switching between the first direction and the second direction as well as switching between more directions, such as from top to bottom, from bottom to top, etc.

[0052] In a possible design method of the first aspect, the above-mentioned response to the shooting operation, shooting the image through the rear camera, includes: responding to the shooting operation in the fourth interface, shooting a panoramic photo through the rear camera; wherein, in the process of shooting the panoramic photo, as the orientation angle changes, the guide arrow in the fourth interface is the same as the guide arrow in the fourth preview interface when responding to the shooting operation.

[0053] That is, during the stage of taking the panoramic photo, the electronic device can always lock the direction indicated by the guide arrow as the first direction or the second direction, so as to avoid affecting the taking of the panoramic photo.

[0054] After entering the rotation shooting mode, if the shooting is completed, the electronic device can also exit the camera application and put it into the background (i.e., function 6 below).

[0055] In a possible design of the first aspect, after the second interface is displayed on the first sub-screen, the method further includes: in response to the operation of exiting the camera application to the background, displaying the fifth interface on the first sub-screen. The fifth interface can be a desktop or a gallery interface, etc. For example, if the operation of exiting the camera application to the background is an operation of returning to the desktop, then the fifth interface is the desktop. For another example, if the operation of exiting the camera application to the background is a click operation on the gallery entrance in the second interface (usually located in the lower left corner, which displays a thumbnail of the most recently taken photo), then the fifth interface is the gallery interface.

[0056] For the electronic device provided in the first aspect, the first sub-screen can also be used alone to great effect. For example, in the first sub-screen, it is entirely possible to view, edit, and share the shooting results. Based on this feature, in response to the operation of exiting the camera application to run in the background, regardless of the current device posture, the electronic device will still maintain the user interface on the first sub-screen, such as the desktop, gallery interface, etc. This makes it easy for users to continue to enter the camera application and use rotating shooting after viewing, editing, sharing, etc., without having to switch the display screen in the middle.

[0057] In a possible design of the first aspect, after the fifth interface is displayed on the first sub-screen, the above method also includes: in response to an update of the device posture of the electronic device, displaying the fifth interface on at least one sub-screen based on the current device posture, and the device posture is related to the first angle and the second angle.

[0058] After exiting the camera application running in the foreground, if the device posture is updated, it indicates that the user wants to change the device posture to use the phone. Therefore, the electronic device can decide to display the user interface display screen based on the device posture, rather than maintaining the user interface on the first sub-screen. Exemplarily, after the device posture is updated, the electronic device can clear the first identifier. In the absence of the first identifier, the electronic device can decide to display the user interface display screen based on the device posture.

[0059] It is understandable that: generally, if the attitude sensor reports a new attitude event and / or the Hall sensor reports a new Hall event, it indicates that the attitude of the device has changed.

[0060] In one possible design of the first aspect, the method further includes: predicting that the user will resume rotating the camera before the device posture is updated, and displaying the second interface on the first sub-screen in response to bringing the camera application from the background to the foreground. This facilitates the user to continue rotating the camera. For example, after viewing, editing, or sharing an image, returning to the camera application to continue using rotating the camera to capture a new image.

[0061] After the device posture is updated, it is predicted that the user intends to use the electronic device in the new device posture. The electronic device can then exit the rotation shooting mode. Subsequently, in response to the camera application being brought from the background to the foreground, the first interface is displayed on at least one sub-screen based on the current device posture. In this way, after exiting the rotation shooting mode, the electronic device can ensure that the illuminated display screen is consistent with the device posture.

[0062] After entering the rotation shooting mode, such as when the shooting is completed, the electronic device can also actively trigger the exit of the rotation shooting mode (i.e., function 5 below).

[0063] In one possible design of the first aspect, after the second interface is displayed on the first sub-screen, the method further includes: receiving a fifth user operation on a rotational shooting indicator. That is, the rotational shooting indicator may also be a control. The fifth operation may be a click operation, a long press operation, or the like. In response to the fifth operation, the first interface is displayed on at least one sub-screen based on the current device posture of the electronic device, where the device posture is related to the first angle and the second angle.

[0064] That is, after the user actively exits the rotation shooting, the electronic device can return to the normal shooting and no longer continue to display the user interface on the first sub-screen.

[0065] In one possible design of the first aspect, the first control is a control for switching between the front and rear cameras. The second operation includes a swipe up from the first control and a click on the second control. The second control (e.g., the capture entry 6031 in interface 603) is displayed in response to the swipe up from the first control. In this way, after entering the rotation capture mode, the mode options of various capture modes can be shared with the normal capture mode. For details, see the relevant description of Figure 6B below.

[0066] In a second aspect, the present application further provides an electronic device comprising a display, a rear camera, a memory, and one or more processors. The display, the memory, and the processor are coupled. The memory is configured to store computer program code, which includes computer instructions. When the computer instructions are executed by the processor, the electronic device performs the method according to the first aspect and any possible design method thereof.

[0067] In a third aspect, the present application provides a chip system, which is applied to an electronic device including a display screen and a memory; the chip system includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected by lines; the interface circuit is used to receive signals from the memory of the electronic device and send signals to the processor, the signals including computer instructions stored in the memory; when the processor executes the computer instructions, the electronic device executes the method as in the first aspect and any possible design method thereof.

[0068] In a fourth aspect, the present application provides a computer storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method of the first aspect and any possible design thereof.

[0069] In a fifth aspect, the present application provides a computer program product, which, when executed on a computer, enables the computer to execute the method according to the first aspect and any possible design thereof.

[0070] It can be understood that the beneficial effects that can be achieved by the electronic device of the second aspect, the chip system of the third aspect, the computer storage medium of the fourth aspect, and the computer program product of the fifth aspect provided above can be referred to the beneficial effects in the first aspect and any possible design method thereof, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0071] FIG1 is a hardware structure diagram of an electronic device provided in an embodiment of the present application;

[0072] FIG2 is a schematic diagram of a mobile phone according to a first embodiment of the present application;

[0073] FIG3 is a schematic diagram of a second mobile phone according to an embodiment of the present application;

[0074] FIG4A is a schematic diagram of a third embodiment of a mobile phone according to an embodiment of the present application;

[0075] FIG4B is a second schematic diagram of a mobile phone according to the third embodiment of the present application;

[0076] FIG5 is a schematic diagram of a vertically foldable mobile phone provided in an embodiment of the present application;

[0077] FIG6A is a software architecture diagram of an electronic device provided in an embodiment of the present application;

[0078] FIG6B is one of the mobile phone interface diagrams provided in an embodiment of the present application;

[0079] FIG7 is a second mobile phone interface diagram provided in an embodiment of the present application;

[0080] FIG8 is a schematic diagram showing a first embodiment of the present invention providing a mobile phone for implementing rotational photography;

[0081] FIG9A is a second schematic diagram of the principle of implementing rotational photography in the mobile phone of form 1 provided in an embodiment of the present application;

[0082] FIG9B is a third schematic diagram of the principle of implementing rotational photography in the mobile phone of form 1 provided in an embodiment of the present application;

[0083] FIG10 is a fourth schematic diagram of the principle of implementing rotational shooting of a mobile phone in form 1 provided in an embodiment of the present application;

[0084] FIG11A is a fifth schematic diagram of the principle of implementing rotational photography in a mobile phone according to the first embodiment of the present application;

[0085] FIG11B is a sixth schematic diagram of the principle of implementing rotational photography in the mobile phone of form 1 provided in an embodiment of the present application;

[0086] FIG12 is a seventh schematic diagram of the principle of implementing rotational photography in the mobile phone of form 1 provided in an embodiment of the present application;

[0087] FIG13 is an eighth schematic diagram of the principle of implementing rotational photography in the mobile phone of form 1 provided in an embodiment of the present application;

[0088] FIG14 is a ninth schematic diagram of the principle of implementing rotational photography in the mobile phone of form 1 provided in an embodiment of the present application;

[0089] FIG15A is a tenth schematic diagram of the principle of implementing rotational photography in a mobile phone according to the first embodiment of the present application;

[0090] FIG15B is an eleventh schematic diagram of the principle of implementing rotational photography in the mobile phone of form 1 provided in an embodiment of the present application;

[0091] FIG16A is a twelfth schematic diagram of the principle of implementing rotational photography in the mobile phone of form 1 provided in an embodiment of the present application;

[0092] FIG16B is a thirteenth schematic diagram of the principle of implementing rotational photography of the mobile phone in form 1 provided in an embodiment of the present application;

[0093] FIG17 is a fourteenth schematic diagram of the principle of implementing rotational shooting of a mobile phone in form 1 provided in an embodiment of the present application;

[0094] FIG18 is a fifteenth schematic diagram of the principle of implementing rotational photography in the mobile phone of form 1 provided in an embodiment of the present application;

[0095] FIG19 is a sixteenth schematic diagram of the principle of implementing rotational photography in the mobile phone of form 1 provided in an embodiment of the present application;

[0096] FIG20 is a seventeenth schematic diagram of the principle of implementing rotational photography in the mobile phone of form 1 provided in an embodiment of the present application;

[0097] FIG21A is a schematic diagram showing a third embodiment of a mobile phone according to an embodiment of the present application, illustrating a method for realizing rotational photography;

[0098] FIG21B is a second schematic diagram of the principle of implementing rotational photography in the third form of a mobile phone provided in an embodiment of the present application;

[0099] FIG21C is a third schematic diagram of the principle of implementing rotational photography in the third form of a mobile phone provided in an embodiment of the present application;

[0100] FIG22 is a fourth schematic diagram of the principle of implementing rotational shooting of the mobile phone in form three provided in an embodiment of the present application;

[0101] FIG23 is a fifth schematic diagram of the principle of implementing rotational shooting of the mobile phone in form three provided in an embodiment of the present application;

[0102] FIG24 is a sixth schematic diagram of the principle of implementing rotational shooting of the mobile phone in form three provided in an embodiment of the present application;

[0103] FIG25 is a seventh schematic diagram of the principle of implementing rotational shooting of the mobile phone in form three provided in an embodiment of the present application;

[0104] FIG26 is an eighth schematic diagram of the principle of implementing rotational shooting of the mobile phone in form three provided in an embodiment of the present application;

[0105] FIG27 is a ninth schematic diagram of the principle of implementing rotational photography in the third form of a mobile phone according to an embodiment of the present application;

[0106] FIG28 is a tenth schematic diagram of the principle of implementing rotational shooting of the mobile phone in form three provided in an embodiment of the present application;

[0107] FIG29 is an eleventh schematic diagram of the principle of implementing rotational shooting of a mobile phone in form three provided by an embodiment of the present application;

[0108] FIG30A is a twelfth schematic diagram of the principle of implementing rotational photography in the third form of the mobile phone provided in an embodiment of the present application;

[0109] FIG30B is a thirteenth schematic diagram of the principle of implementing rotational shooting of the mobile phone in form three provided by an embodiment of the present application;

[0110] FIG30C is a fourteenth schematic diagram of the principle of implementing rotational photography of the mobile phone in form three provided in an embodiment of the present application;

[0111] FIG31A is the fifteenth schematic diagram of the principle of implementing rotational photography of the mobile phone in form three provided by an embodiment of the present application;

[0112] FIG31B is a sixteenth schematic diagram of the principle of implementing rotational photography of the mobile phone in form three provided in an embodiment of the present application;

[0113] FIG31C is the seventeenth schematic diagram of the principle of implementing rotational shooting of the mobile phone in form three provided in an embodiment of the present application;

[0114] FIG32A is the eighteenth schematic diagram of the principle of implementing rotational shooting of the mobile phone in form three provided in an embodiment of the present application;

[0115] FIG32B is a nineteenth schematic diagram of the principle of implementing rotational photography of the mobile phone in form three provided in an embodiment of the present application;

[0116] FIG32C is a schematic diagram 20 of the principle of implementing rotational photography in the third form of the mobile phone provided in an embodiment of the present application;

[0117] FIG33 is a twenty-first schematic diagram of the principle of implementing rotational shooting of the mobile phone in form three provided in an embodiment of the present application;

[0118] Figure 34 is the twenty-second schematic diagram of the principle of realizing rotation shooting of the form three mobile phone provided in the embodiment of the present application. DETAILED DESCRIPTION

[0119] The technical solutions in the embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and claims of the present application, the singular expressions "a", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two). The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0120] References to "one embodiment" or "some embodiments" etc. described in this specification mean that the specific features, structures or characteristics described in conjunction with the embodiment are included in one or more embodiments of the present application. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in another way. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in another way. The term "connected" includes direct and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.

[0121] In the embodiments of this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner.

[0122] Conventional technologies require improvements in the user experience of the shooting function provided by electronic devices in the following scenarios:

[0123] Scene 1: The scene in which the scenery in front of you and yourself are photographed in the same photo.

[0124] Example 1: A user visits a scenic spot and sees beautiful scenery both in front of them and behind them. In this scenario, if the user wants to capture both the scenery in front of them and themselves in one photo, conventional photography will typically not produce a good result without assistance.

[0125] In the second example, a user watches a celebrity performance and hopes to take a photo of the celebrity and himself. Again, without asking for help, it is usually impossible to achieve a good effect.

[0126] For example, when a user uses the panoramic shooting mode in the conventional shooting function, he can only capture the front and back scenes in a panoramic photo by turning his body, such as the front and back scenery in Example 1, and the star and the crowd behind him in Example 2, but cannot capture himself in the same panoramic photo, resulting in poor effect.

[0127] For another example, a user uses the multi-lens shooting mode in the conventional shooting function, uses a front camera to shoot himself and the scenery behind him, and uses a rear camera to shoot the scenery in front of him, such as the scenery in front of him in Example 1 and the star in Example 2, and then stiffly stitches the scenes shot by the front camera and the rear camera together, which does not produce a good effect.

[0128] Scene 2: Group photo scene.

[0129] When taking a group photo with a large group of people, using the rear camera either requires one person to take the photo, resulting in one person missing from the photo, or requires help. Some optimized shooting solutions can trigger the rear camera to shoot via gestures or voice, but there's usually no preview available. This means you might need to repeatedly adjust and confirm the photo, resulting in poor results.

[0130] Scene 3: Shooting scenes from the side or behind.

[0131] Typically, it's difficult to capture side or backside shots with the rear camera without turning around or asking for help. In some optimized shooting solutions, electronic devices with outward-folding screens (see Figure 3 below for details) can, when the screen is folded, position the rear camera and back screen (i.e., the first screen in Figure 3) facing the user, providing a preview on the back screen while allowing the user to take selfies with the rear camera. However, this shooting solution doesn't allow for simultaneous side shots while providing a preview.

[0132] To address the issues with conventional photography functions described above, embodiments of the present application provide a photography method for an electronic device with a foldable screen. The foldable screen itself has a hinge for folding or unfolding. During the folding or unfolding of the foldable screen, the rear camera's field of view can change accordingly.

[0133] Based on the above-mentioned characteristics of the foldable screen, in the shooting method provided in the embodiment of the present application, the electronic device can realize rotation shooting as the viewing range of the rear camera changes during the folding or unfolding of the folding screen. Exemplarily, the rotation shooting includes panoramic shooting between the folded state and the unfolded state, so that the scenery in front of you and yourself can be taken in the same photo, and group photos can also be taken. As another example, the rotation shooting can also include taking pictures at any angle between the folded state and the unfolded state, so that the side or back scenes can be flexibly taken.

[0134] In addition, rotation shooting can also include other shooting modes, such as video mode, portrait mode, etc. In response to the selection operation of any shooting mode, the electronic device can switch to the corresponding shooting mode to achieve rotation shooting. This embodiment of the present application does not specifically limit this.

[0135] The above-mentioned electronic device can be a mobile phone, tablet, laptop computer or other device with a foldable screen and a rear camera. The following mainly uses a mobile phone as an example to illustrate the embodiments of the present application.

[0136] 1 , the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0137] It is understood that the structures illustrated in the embodiments of the present invention do not constitute specific limitations on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0138] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0139] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0140] The electronic device implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0141] The display screen 194 is used to display images, videos, etc. In an embodiment of the present application, the display screen 194 includes a foldable screen, which can be folded to form at least two screens. The foldable screen has various forms. For example, according to the number of screens formed by folding, the foldable screen can include a two-fold folding screen and a multi-folding (such as three-folding and above) folding screen. For another example, according to the direction of folding, the folding screen can include an inward folding folding screen, an outward folding screen, and a folding screen that combines inward folding and outward folding, or the folding screen can include a horizontally folding folding screen and a vertically folding folding screen.

[0142] For example, the present application embodiment takes a mobile phone as an example to introduce several typical folding screen forms:

[0143] Form 1: A two-fold folding screen that folds inward horizontally.

[0144] Taking the folding screen 201 in FIG. 2 as an example, the folding screen 201 includes two sub-screens, such as the first screen 2011 and the second screen 2012, and the rotation axis is perpendicular to the width direction 1c of the folding screen. The folding screen 201 can be in the unfolded state shown in FIG. 2 (hereinafter referred to as the unfolded state). In the unfolded state, the angle between the first screen 2011 and the second screen 2012 is approximately 180°. At this time, the folding screen 201 can be used as a large screen to display the user interface. The folding screen 201 folds inward along the rotation axis, such as the first screen 2011 folds along the direction shown in 1a and / or the second screen 2012 folds along the direction shown in 1b, to form the semi-folded state shown in FIG. 2 (hereinafter referred to as the semi-folded state). In the semi-folded state, the angle between the first screen 2011 and the second screen 2012 (referring to the angle along the folding direction, such as α) satisfies 0°<α<180°. The folding screen 201 continues to fold inward along the hinge, such as the first screen 2011 continues to fold along the direction shown in 1a and / or the second screen 2012 continues to fold along the direction shown in 1b, to form the folded state shown in FIG2 (such as folded state 1 or folded state 2, hereinafter referred to as the folded state). In the folded state, the angle between the first screen 2011 and the second screen 2012 is approximately 0°. At this time, the display direction of the first screen 2011 and the display direction of the second screen 2012 are opposite, and the first screen 2011 and the second screen 2012 are not visible to the user.

[0145] The display direction refers to the orientation of the front of the screen, or the direction the front of the screen faces. Furthermore, "opposite display directions" refers to the two screens being in a "face-to-face" position. For example, in the folded positions 1 and 2 shown in FIG2 , the first screen 2011 and the second screen 2012 are in a "face-to-face" position, and therefore, the display directions of the first screen 2011 and the second screen 2012 are opposite.

[0146] It should be noted that the folded state 1 and folded state 2 in Figure 2 are simply different perspectives of the mobile phone with the foldable screen 201. Among them, the folded state 1 is the perspective of the back cover 203 with the rear camera 204, and the folded state 2 is the perspective of the external screen 202.

[0147] Typically, in a mobile phone with a foldable screen 201, the rear camera 204 is located on the back cover behind the second screen 2012. Furthermore, to facilitate use when the foldable screen 201 is folded, an external screen 202 is located opposite the first screen 2011. As shown in Folded State 2 in Figure 2, when the foldable screen 201 is folded, the mobile phone can also display the user interface through the external screen 202.

[0148] It should be understood that in a mobile phone with a foldable screen 201, the external screen 202 is visible to the user when the foldable screen 201 is in the unfolded, semi-folded, or folded state, and the external screen 202 does not rotate with the viewing angle of the rear camera 204. Based on this, in embodiments of the present application, the external screen 202 can be used as the front screen of the mobile phone with a foldable screen 201 to display a preview interface during the rotational shooting process. This ensures that the user can view the viewfinder during the entire rotational shooting process.

[0149] Form 2: A two-fold folding screen that folds horizontally outwards.

[0150] Taking the folding screen 301 in FIG3 as an example, the folding screen 301 includes two sub-screens, such as the first screen 3011 and the second screen 3012, and the rotation axis is perpendicular to the width direction 1c of the folding screen. The folding screen 301 can be in the unfolded state shown in FIG3. In the unfolded state, the angle between the first screen 3011 and the second screen 3012 is approximately 180°. At this time, the folding screen 301 can be used as a large screen to display the user interface. The folding screen 301 is folded outward along the rotation axis, such as the first screen 3011 is folded along the direction shown in 1d and / or the second screen 3012 is folded along the direction shown in 1e, to form the semi-folded state shown in FIG3. In the semi-folded state, the angle between the first screen 3011 and the second screen 3012 (referring to the angle in the direction opposite to the folding direction, such as β) satisfies 0°<β<180°. The folding screen 301 continues to fold inward along the rotation axis, such as the first screen 3011 continues to fold along the direction shown in 1d and / or the second screen 3012 continues to fold along the direction shown in 1e, to form the folded state shown in Figure 3 (such as folded state 1 or folded state 2). In the folded state, the angle between the first screen 3011 and the second screen 3012 is approximately 0°. At this time, the display direction of the first screen 3011 and the display direction of the second screen 3012 are opposite to each other, and the first screen 3011 and the second screen 3012 are both visible to the user.

[0151] Different from the "relative display directions" mentioned above, "opposite display directions" refers to the two screens being in a "back-to-back" position. For example, in Folded State 1 and Folded State 2 shown in FIG3 , the first screen 3011 and the second screen 3012 are in a "back-to-back" position, and therefore, the display directions of the first screen 3011 and the second screen 3012 are opposite each other.

[0152] It should be noted that the folded state 1 and folded state 2 in Figure 3 are just the forms of the mobile phone with the foldable screen 301 seen from different perspectives. Among them, folded state 1 is the perspective of the first screen 3011, and folded state 2 is the perspective of the second screen 3012.

[0153] Typically, in a mobile phone with a foldable screen 301, the rear camera 304 is set in a specific area 305 behind the second screen 3012. Moreover, in the folded state, the specific area 305 and the first screen 3011 can form a whole with the same size as a sub-screen, such as the second screen 3012.

[0154] It should be understood that in a mobile phone with a foldable screen 301, the first screen 3011 is visible to the user when the foldable screen 301 is in the unfolded, semi-folded, or folded state, and the first screen 3011 does not rotate with the viewing angle of the rear camera 304. Based on this, in embodiments of the present application, the first screen 3011 can be used as the front screen of the mobile phone with a foldable screen 301 to display a preview interface during the rotational shooting process. This ensures that the user can view the viewfinder image throughout the entire rotational shooting process.

[0155] Form three is a folding screen that folds three times horizontally, which is a combination of inner folding and outer folding.

[0156] Taking the folding screen 401 in Figure 4A as an example, the folding screen 401 includes three sub-screens, such as the first screen 4011, the second screen 4012, and the third screen 4013, and the two rotation axes (such as the rotation axis 1 and the rotation axis 2) are perpendicular to the width direction 1c of the folding screen. The folding screen 401 can be in the unfolded state shown in Figure 4A. In the unfolded state, the angles between the first screen 4011, the second screen 4012, and the third screen 4013 are all approximately 180 degrees. At this time, the folding screen 401 can be used as a large screen to display the user interface. The first screen 4011 and the second screen 4012 of the folding screen 401 are folded inward along the rotation axis 1, such as the first screen 4011 is folded along the direction indicated by 1f and the second screen 4012 is folded along the direction indicated by 1g, and the second screen 4012 and the third screen 4013 are folded outward along the rotation axis 2, such as the second screen 4012 is folded along the direction indicated by 1g and the third screen 4013 is folded along the direction indicated by 1h, thereby forming the semi-folded state shown in FIG4A. In the semi-folded state, the angle between the first screen 4011 and the second screen 4012 (referring to the angle in the folding direction, such as denoted by γ) satisfies 0°<γ<180°, and the angle between the second screen 4012 and the third screen 4013 (referring to the angle in the direction opposite to the folding direction, such as denoted by δ) satisfies 0°<δ<180°. The first screen 4011 and the second screen 4012 of the folding screen 401 continue to fold inward along the rotation axis 1, and the second screen 4012 and the third screen 4013 fold outward along the rotation axis 2, thereby forming the folded state shown in FIG4A (such as the folded state 1 or the folded state 2). In the folded state, the angle γ between the first screen 4011 and the second screen 4012 is approximately 0°, and the angle δ between the second screen 4012 and the third screen 4013 is also approximately 0°. In the folded state, the display direction of the first screen 4011 and the display direction of the second screen 4012 are opposite, and the first screen 4011 and the second screen 4012 are both invisible to the user; and the display direction of the second screen 4012 and the display direction of the third screen 4013 are opposite, and the third screen 4013 is visible to the user, so that the user interface can be displayed on the third screen 4013.

[0157] It should be noted that the folded state 1 and folded state 2 in FIG4A are merely different perspectives of the mobile phone with foldable screen 401. Folded state 1 is the perspective of the rear cover 402 where the rear camera 403 is located, and folded state 2 is the perspective of the third screen 4013.

[0158] Typically, in a mobile phone with a folding screen 401, the rear camera 403 is provided on the back cover 402 behind the first screen 4011. In this way, when the user interface is displayed on the third screen 4013 in the folded state, the rear camera 403 can also be used to shoot.

[0159] It should be understood that in a mobile phone with a foldable screen 401, the third screen 4013 is visible to the user when the foldable screen 401 is in the unfolded, semi-folded, or folded state, and the third screen 4013 does not rotate with the viewing angle of the rear camera 403. Based on this, in the embodiment of the present application, the third screen 4013 can be used as the front screen of the mobile phone with a foldable screen 401 to display a preview interface during the rotational shooting process. This ensures that the user can view the viewfinder during the entire rotational shooting process.

[0160] At this point, it should be noted that in the foldable screen 401 described above, the first screen 4011 and the second screen 4012 connected by hinge 1 fold inward, such as the first screen 4011 folding along the direction indicated by 1f, and the second screen 4012 folding along the direction indicated by 1g; and the second screen 4012 connected by hinge 2 can fold inward, such as the direction indicated by 1g, and the third screen 4013 can fold outward, such as the direction indicated by 1h. Furthermore, in the foldable screen 401, the rear camera 403 is located on the back of the first screen 4011.

[0161] However, in practice, the folding direction and the position of the rear camera are not limited to those shown in FIG4A. For example, the folding screen that folds horizontally into three parts may also be the folding screen 411 in FIG4B. The difference from the aforementioned folding screen 401 is that: the first screen 4111 and the second screen 4112 connected by the hinge 2 fold inward, such as the first screen 4111 folds along the direction shown in 2h, and the second screen 4112 folds along the direction shown in 2g; the second screen 4112 connected by the hinge 1 can fold inward, such as folding along the direction shown in 2g, and the first screen 4111 folds outward, such as the third screen 4113 folds along the direction shown in 2f. In addition, in the folding screen 411, the rear camera (not shown in the figure) is arranged on the back of the first screen 4111, that is, on the back cover 412.

[0162] In other words, the folding directions of folding screen 401 and folding screen 411 are opposite. Below, in the description of form three, folding screen 401 is mainly used as an example. It should be noted that if folding screen 411 is used instead, it is only necessary to replace first screen 4011 with first screen 4111, second screen 4012 with second screen 4112, and third screen 4013 with third screen 4113.

[0163] The embodiments of the present application can be applied to the various forms of folding screens described above. Of course, the embodiments of the present application can also be applied to folding screens other than those shown in Figures 2 to 4B above.

[0164] For example, the folding screens shown in Figures 2 to 4B above are all folding screens that fold horizontally (i.e., the rotating axis is perpendicular to the width direction of the folding screen), and the embodiments of the present application can also be used for folding screens that fold vertically (i.e., the rotating axis is perpendicular to the height direction of the folding screen). For example, the vertically folding folding screen may be the folding screen 501 shown in Figure 5, and the folding screen 501 includes two sub-screens, such as screen A and screen B, and the rotating axis is perpendicular to the height direction 1i of the folding screen. The folding screen 501 can be folded inward along the rotating axis, such as screen A folding along the direction shown in 1j and / or screen B folding along the direction shown in 1k. As the folding deepens, the angle between screen A and screen B (referring to the angle in the folding direction) gradually decreases.

[0165] It should be noted that for vertically folding foldable screen phones, the rear camera's framing range primarily changes in the vertical direction as the folding or unfolding process progresses. For example, as the folding screen 501 folds, the framing range of the rear camera 503, located on the back cover 502 behind the A-screen, changes from the ground to the front. Of course, if the folding screen 501 is perpendicular to the ground when unfolded, the framing range of the rear camera 503 changes from the front to the sky during the folding process. Typically, the need for rotating photography primarily requires changing the rear camera's framing range in the horizontal direction, not the vertical direction. For example, in Scenarios 1-3 above, the rear camera's framing range required changing in the horizontal direction. While vertically folding foldable screens aren't particularly well-suited for rotating photography, there are scenarios where changing the rear camera's framing range in the vertical direction is necessary. For example, a user might want to capture both the scenery and the sky in a single photo.

[0166] In the following, the embodiments of the present application are mainly described using the folding screen forms shown in Forms 1 to 3 above.

[0167] The electronic device can realize the shooting function through the ISP, camera 193, video codec, GPU, display 194 and application processor.

[0168] The electronic device can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0169] Furthermore, the sensor 180 may include, but is not limited to, a gyro sensor 180B, a magnetic sensor 180D, and an acceleration sensor 180E.

[0170] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device. In some embodiments, the angular velocity of the electronic device around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the electronic device's shake, calculates the distance that the lens module needs to compensate based on the angle, controls the reverse movement of the lens to offset the shake of the electronic device, and achieves anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.

[0171] The accelerometer 180E can detect the magnitude of the electronic device's acceleration in all directions (generally three axes). When the electronic device is stationary, it can also detect the magnitude and direction of gravity. Furthermore, the accelerometer 180E can be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.

[0172] In practice, in an electronic device with a foldable screen (hereinafter referred to as a foldable electronic device), each sub-screen included in the foldable screen is correspondingly provided with a gyroscope sensor 180B and an acceleration sensor 180E. For example, the first screen in Figures 2-4B is correspondingly provided with a gyroscope sensor 180B and an acceleration sensor 180E, the second screen is also correspondingly provided with a gyroscope sensor 180B and an acceleration sensor 180E, and the third screen in Figures 4A and 4B is also correspondingly provided with a gyroscope sensor 180B and an acceleration sensor 180E.

[0173] The magnetic sensor 180D includes a Hall sensor. The electronic device can use the magnetic sensor 180D to detect the opening and closing of a flip case. In some embodiments, when the electronic device is a flip phone, the electronic device can detect the opening and closing of the flip cover based on the magnetic sensor 180D. Based on the detected opening and closing status of the case or flip cover, features such as automatic unlocking of the flip cover can be configured.

[0174] In some possible cases, the Hall sensor can be directly implemented based on a physical Hall, or can be a virtual Hall sensor (also called a digital Hall sensor) implemented based on a magnetometer, and there is no limitation here.

[0175] Taking the virtual Hall sensor as an example, when the electronic device is a foldable electronic device, the virtual Hall sensor can determine whether the two screens are closed or far apart, and the approximate angle range based on the magnetic threshold sensed by the magnetometer.

[0176] In some possible cases, the electronic device may also include a posture sensor (not shown in the figure). The posture sensor can be a physical sensor or a virtual posture sensor implemented using a fusion algorithm by combining sensor data such as angle and acceleration, or combining virtual sensor data of angle. The posture sensor can provide richer and more accurate posture data such as folded state, semi-folded state, unfolded state, tent state, and desk calendar state. The posture data can be used by the electronic device to decide whether to turn on or off each sub-screen.

[0177] That is to say, the electronic device can use the gyroscope sensor 180B and the acceleration sensor 180E correspondingly set on the two sub-screens that constitute the angle to calculate the angle; it can also use a digital Hall sensor to obtain the angle; it can also use a Hall sensor simulated by a magnetometer to map the angle range, for example, the Hall approach state corresponds to an angle within 5°, and the away state corresponds to an angle of more than 10°. The angle values ​​of the various angles (such as α, β, γ, δ) involved below may come from the calculated angle data, or from the angle range corresponding to the Hall approach or away state, or the angle and the Hall state may be used in a logical AND relationship, or the angle and the Hall may be used in a logical OR relationship. The embodiments of the present application do not make specific limitations on this.

[0178] Buttons 190 may include a power button, volume buttons, and the like. Motor 191 may generate vibration notifications. Motor 191 can be used for incoming call vibration notifications or for touch vibration feedback. Indicator 192 may be an indicator light that can indicate charging status, battery level changes, messages, missed calls, and notifications. SIM card interface 195 is used to connect a SIM card.

[0179] The software system of the electronic device can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a microservice architecture, or a cloud architecture. The embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device. The software structure can include at least one subsystem, such as an AP subsystem and a sensor hub subsystem.

[0180] Figure 6A shows a software block diagram of an electronic device according to an embodiment of the present application. As shown in Figure 6A , a layered architecture can divide software into several layers, each with distinct roles and responsibilities. Layers communicate with each other via software interfaces.

[0181] In some embodiments, the AP subsystem is divided into four layers, namely, from top to bottom, the application layer (applications), the application framework layer (framework), the hardware abstract layer (HAL) and the kernel layer (kernel, which may also be called the driver layer). The sensor hub subsystem is divided into two layers, namely, the framework layer (for the sake of distinction, it can be recorded as the co-framework layer) and the kernel layer (for the sake of distinction, it can be recorded as the co-kernel layer). It should be understood that in actual applications, in addition to the layers shown in Figure 6A, the AP subsystem and the sensor hub subsystem may also include more or fewer layers. The embodiments of the present application are not limited to this.

[0182] The application layer may include a series of application packages. For example, it may include application packages such as camera, calendar, WLAN, music, gallery, call, navigation, and Bluetooth. The camera application package is used to provide a shooting function. Furthermore, the shooting function includes rotating shooting.

[0183] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0184] The application framework layer may include device state management services, sensor services, screen management modules, and camera services, etc.

[0185] Among them, each module in the screen management module can be used to receive a notification of lighting up the screen sent by the device status management service, and start the screen lighting process based on the notification. In a specific implementation method, the screen management module may include a power management service, a window management service, etc. The power management service can be used to control the power on and off of the screen during the screen lighting process. The window management service can be used to draw a display window, and after the screen is powered on, the display window is placed on the screen for the user to view. For example, after entering the rotation shooting, the power management service can control the power on of the front screen, such as the above-mentioned external screen 202, the first screen 3011 or the third screen 4013, and the window management service can be used to draw a display window displayed on the front screen.

[0186] After registering the gesture sensor and Hall effect sensor with the sensor service, the device state management service can receive gesture events and Hall effect events reported by the gesture sensor. The device state management service then determines the final device state of the electronic device based on the gesture events and / or Hall effect events. Based on this state, it makes a screen-lighting control decision, triggering the screen management module to initiate the screen-lighting process.

[0187] It is understandable that as the folding screen is unfolded or folded, the angles between the multiple sub-screens of the folding screen, such as the above-mentioned α, β, γ, and δ, will change, and accordingly, the device posture of the electronic device will change. Normally, when the posture sensor reports a new posture event and / or the Hall sensor reports a new Hall event, it indicates that the device posture has changed. Among them, posture events include the postures of the folding screen such as the unfolded state, semi-expanded state / semi-folded state, folded state, tent state, and desk calendar state. Hall events include events of approaching state switching to moving away state, and moving away state switching to approaching state. The electronic device can display the user interface on a screen consistent with the device posture.

[0188] Of course, the device state management can also make a decision to control the screen lighting based solely on gesture events, triggering the screen management module to start the screen lighting process. This embodiment of the present application does not specifically limit this. The following mainly uses the device gesture decision based on gesture events and / or Hall events as an example.

[0189] In a specific implementation, the device status management service can also make a decision to control the front screen to light up after the rotation shooting starts, triggering the screen management module to start the screen light up process to ensure that the preview interface remains displayed on the front screen after the rotation shooting starts.

[0190] The sensor service can be used to report received gesture events and Hall events to the device status management service.

[0191] The camera service can be used for interaction between the camera application and the underlying layer, such as for the camera application to send shooting requests to the layer, and for the underlying layer to transmit preview stream data to the camera application.

[0192] The Hardware Abstraction Layer (HAL) is an interface layer between the kernel layer and the hardware layer (not shown). Its purpose is to abstract the hardware and provide a virtual hardware platform for the operating system. The HAL may include sensor interface services, inter-core communication module A, camera provider HAL, and other components.

[0193] The sensor interface service can be used to register various sensors and receive data from each sensor after registration. For example, the sensor interface service may include a posture sensor interface and a Hall sensor interface. The posture sensor interface can be used to manage registered posture sensors, receive posture events uploaded by the posture sensor, and send the posture events to the sensor service. The Hall sensor interface can be used to manage registered Hall sensors, receive Hall events uploaded by the Hall sensor, and send the Hall events to the sensor service.

[0194] The inter-core communication module A can be used to manage the communication between the AP subsystem and the sensorhub subsystem, allowing the AP subsystem and the sensorhub subsystem to transmit data to each other, such as transmitting gesture events and Hall events.

[0195] The camera HAL provides a standard HAL interface definition language (HIDL) interface to upper layers (such as the camera service) for calls, maintaining normal communication with the upper layer. Furthermore, the camera HAL controls the kernel layer through a standard HAL interface, such as HAL 3.0, and obtains the preview stream data reported by the kernel layer.

[0196] The kernel layer is the layer between hardware and software. This layer may include the camera driver. The camera driver receives notifications from upper layers (such as instructions to turn the camera on or off) and, based on these notifications, sends a stream of function processing parameters to the hardware (e.g., the camera module, ISP). Furthermore, the camera driver transmits preview stream data obtained by the hardware to upper layers.

[0197] The collaborative framework layer may include an event distribution manager, a sensor client manager, an inter-core communication module B, and the like.

[0198] The event distribution manager can be used to receive data uploaded by the core layer and distribute it to other modules registered with it. For example, the event distribution manager can be used to receive gesture events reported by a gesture sensor and then transmit these gesture events to the sensor client manager. The event distribution manager can also be used to receive Hall events reported by a Hall sensor and then transmit these Hall events to the sensor client manager.

[0199] The sensor client manager can be used to register with the event distribution manager and obtain data uploaded by the event distribution manager, such as gesture events and Hall events.

[0200] Inter-core communication module B can be used to manage communication between the application subsystem and the system control subsystem, enabling data transmission between the system control subsystem and the application subsystem. For example, inter-core communication module B can be used to receive gesture events, Hall effect events, and other data transmitted by the sensor client manager and transmit these gesture event and Hall effect events to inter-core communication module A.

[0201] The sensor driver can be used to start sensors, such as gesture sensors, Hall sensors, etc. After starting, the gesture sensor can obtain gesture events and report the gesture events. For example, the first frame gesture event is reported to the event distribution manager. Subsequently, if the current frame gesture event is different from the previous frame gesture event, the current frame gesture event can also be reported to the event distribution manager. After starting, the Hall sensor can obtain Hall events and report the Hall events. For example, the first frame Hall event is reported to the event distribution manager. Subsequently, if the current frame Hall event is different from the previous frame Hall event, the current frame Hall event can also be reported to the event distribution manager.

[0202] It should be understood that FIG6A shows an exemplary software block diagram of an electronic device and should not be construed as limiting the embodiments of the present application. For example, the location of each module (eg, the level to which it belongs) may be different in actual applications.

[0203] The following further describes the shooting method provided by the embodiment of the present application in conjunction with the hardware and software structure shown in FIG6A :

[0204] After starting the rotational shooting, the electronic device can use communication path I in Figure 6A, that is, through the camera application, camera service, camera HAL, and camera driver, to implement interaction between the camera application and hardware (such as the camera module and ISP). For example, the preview stream data obtained by the hardware is processed and ultimately reported to the camera application.

[0205] Furthermore, the electronic device can utilize communication path II in FIG6A , namely, through the camera application, camera service, device state management service, and screen management module, to achieve the goal of always keeping the front screen lit and displaying the preview interface on the front screen after entering the rotation shooting mode. In other words, after entering the rotation shooting mode, the device management service will always keep the front screen lit.

[0206] At the same time, after entering the rotation shooting mode, the electronic device can still use the communication path III in Figure 6A, that is, through the screen management module, device status management service, sensor service, sensor interface service, inter-core communication module A, inter-core communication module B, sensor client manager, event distribution manager, and sensor driver, to achieve normal reporting of posture events and Hall events and determine the device posture. Subsequently, after exiting the rotation shooting mode, the screen can be turned on or off based on the latest device posture. In this way, after exiting the rotation shooting mode, the electronic device can promptly restore the screen to the state based on the device posture, without continuously displaying the user interface on the front screen.

[0207] The shooting method provided in the embodiment of the present application can be implemented in an electronic device having the above hardware structure. In the following, the electronic device is taken as an example to illustrate the embodiment of the present application.

[0208] In the camera function of the mobile phone, such as in the application interface of the camera application, a shooting entrance for rotating shooting is provided. In response to a selection operation on the shooting entrance, the mobile phone will enter the rotating shooting mode.

[0209] Exemplarily, the mobile phone can display the interface 601 shown in Figure 6B, which is the desktop of the mobile phone. Interface 601 includes an application icon 6011 of the camera application. In response to a click operation on the application icon 6011 in interface 601, the mobile phone can display the interface 602 (also referred to as the first interface) shown in Figure 6B, which is the application interface of the camera application. Interface 602 includes mode options for various shooting modes, such as mode options for shooting modes such as photo, portrait, and video. Interface 602 also includes a front and rear switching control 6021. In response to a click operation on the front and rear switching control 6021, the mobile phone can switch from the front camera to the rear camera, or from the rear camera to the front camera.

[0210] In response to a swipe upward from the front / rear switch control 6021, the phone may display interface 603 shown in FIG6B , wherein a rotational shooting entry 6031 is further displayed above the front / rear switch control 6021. In response to a selection operation (e.g., a click operation) on the shooting entry 6031, the phone may enter the rotational shooting mode. For example, in response to a selection operation on the shooting entry 6031, the phone may display interface 604 (also referred to as a second interface) shown in FIG6B , wherein the shooting entry 6031 in interface 604 is located at the original location of the front / rear switch control 6021, indicating that the rotational shooting mode has been entered.

[0211] Furthermore, interface 604 also includes various shooting mode options, such as mode option 6041 for photo mode, mode option 6042 for portrait mode, mode option 6043 for video mode, and mode option 6044 for panorama mode. After entering the rotation shooting mode, the phone defaults to the currently selected shooting mode, such as the photo mode selected by default in interface 604, for rotation shooting. Subsequently, in response to the selection of another mode option, the phone can switch to another shooting mode for rotation shooting. For example, in response to the selection of mode option 6044 for panorama mode, the phone can switch to panorama mode for rotation shooting.

[0212] Of course, the entry point for rotating photography is not limited to that shown in FIG6B . For example, the mobile phone may display interface 701 shown in FIG7 , which is the same as interface 602 described above and will not be further described here. Interface 701 also includes "More" 7011. In response to selecting "More" 7011, the mobile phone may display interface 702, which includes options for more shooting modes provided by the camera, such as high-pixel mode 7021, time-lapse mode 7022, and dual-view video mode 7023. Furthermore, the mode options for more shooting modes also include options for various rotating photography modes, such as rotating photo mode 7024, rotating panorama mode 7025, and rotating video mode 7026. In response to selecting a mode option for a rotating photography mode, the mobile phone may enter the corresponding rotating photography mode. In other words, the mode option for the rotating photography mode serves as the entry point for rotating photography. For example, in response to a selection operation on the mode option 7024 of the rotation photographing mode in the interface 702 , the mobile phone may enter the rotation photographing mode.

[0213] In the following, the embodiment of the present application is mainly described by taking the form of the shooting entrance shown in FIG6B as an example.

[0214] In some embodiments, during the rotational shooting process, the electronic device always keeps the screen visible to the user and does not rotate with the rear camera (hereinafter referred to as the front screen) on, and displays a preview interface on the front screen, so that the user can easily preview the viewfinder image. It should be noted that the viewfinder image refers to the image captured in real time by the rear camera.

[0215] Furthermore, in order to avoid accidental touches, when the preview interface is displayed on the front screen, the electronic device will keep all other screens off.

[0216] The above-mentioned function of always displaying the preview interface on the front screen can be recorded as Function 1. For details, please refer to the introduction of Function 1 in the various product forms (such as Form 1 to Form 3) below. No further explanation will be given here.

[0217] After entering the rotation capture mode, the phone enters the preview phase before starting to capture. Subsequently, in response to a capture operation, such as clicking the capture button, the phone will enter the capture phase. In modes other than panoramic capture that capture single photos (such as still mode, night mode, portrait mode, etc.), the phone will automatically end the capture and enter the preview phase again. In panoramic capture or video capture modes (such as video mode, video mode, etc.), the phone will enter the preview phase again in response to an operation to end the capture, such as clicking the end capture button.

[0218] In some embodiments, during the preview stage of rotational shooting, that is, the stage before shooting starts or after shooting ends, during the folding or unfolding of the folding screen, if the rear camera is biased towards oneself, the electronic device can turn on the mirror function of the rear camera (which can be simply referred to as rear mirror). It is understandable that after turning on the rear mirror, the preview interface can display the same framing effect as looking in the mirror. In this way, when the rear camera captures the user and the scenery behind him, the electronic device can present a mirrored picture on the front screen to facilitate the user to adjust the framing. For example, if the user moves left, the user in the framing picture will also move left. If the rear camera is biased towards the scenery in front of it, the electronic device can turn off the rear mirror so that when the rear camera shoots the scenery in front of it, the front screen displays a picture that is consistent with the direction of the scenery.

[0219] Furthermore, unlike the preview phase, after entering the capture phase, the electronic device can lock the rear mirror on or off. That is, if the rear camera is in the on state for the last frame before capture begins, the rear mirror will remain on during the capture phase; if the rear camera is in the off state, the rear mirror will remain off during the capture phase. This prevents the rear mirror from being repeatedly turned on and off during the capture phase, which could affect the user's capture.

[0220] Furthermore, when the rear camera mirror is turned on or off, the viewfinder in the preview interface will be flipped left and right. Therefore, the phone can display a transition effect when turning the rear camera mirror on or off, such as a blur effect, making the switching process smoother and less abrupt.

[0221] The above-mentioned function of turning on or off the rear mirror can be recorded as Function 2. For details, please refer to the introduction of Function 2 below, and no further explanation will be given here.

[0222] Typically, after switching to panoramic mode, the electronic device may display a guide arrow in the preview interface (also referred to as the fourth interface) to guide the user to move the electronic device to take a panoramic photo. In normal shooting scenes, the direction indicated by the guide arrow is from left to right.

[0223] In some embodiments, at least one of the following reasons is considered:

[0224] Reason 1: When used in portrait mode: For horizontally folding product forms (as shown in Figures 2-4B above), the folding and unfolding of the folding screen usually involves moving the rear camera's viewfinder left and right; for vertically folding product forms (as shown in Figure 5 above), the folding and unfolding of the folding screen usually involves moving the rear camera's viewfinder up and down.

[0225] Of course, the opposite is true in landscape mode, which will not be explained here.

[0226] Reason two: For products of the same form factor, the rear camera's framing changes differently during folding and unfolding. For form one, the rear camera's framing changes counterclockwise during unfolding, and clockwise during folding. For form two, the rear camera's framing changes clockwise during unfolding, and counterclockwise during folding. For the product shown in Figure 4A of form three, the rear camera's framing changes clockwise during unfolding of the first and second screens 4011, 4012, and counterclockwise during folding. The rear camera's framing changes counterclockwise during unfolding of the second and third screens 4012, 4013, and clockwise during folding of the second and third screens 4012, respectively.

[0227] Based on the above reasons, it can be seen that, unlike ordinary shooting scenes, the framing changes of the rear camera can be varied during the rotation shooting process. Therefore, the electronic device can provide a switching entry (such as the direction switching control below) for the user to manually switch the direction of the guide arrow to flexibly achieve rotation shooting in different directions. And / or, the electronic device can also predict the user's shooting needs based on the angles between the various sub-screens of the folding screen (such as α, β, γ, δ, etc.), and automatically adjust the direction indicated by the guide arrow based on the shooting needs, so that the direction indicated by the guide arrow can match the user's shooting needs. Exemplarily, the shooting needs include clockwise shooting and counterclockwise shooting, and the corresponding directions are from left to right and from right to left, respectively.

[0228] Of course, the manual and automatic adjustment methods described above can also be combined. Furthermore, similar to turning the rear mirror on or off, during the panoramic photo capture phase, the electronic device can lock the direction indicated by the guide arrow to either left-to-right or right-to-left. That is, if the guide arrow indicated a left-to-right direction in the last frame before capture, the direction will remain locked to left-to-right during the panoramic photo capture phase; if the guide arrow indicated a right-to-left direction in the last frame before capture, the direction will remain locked to right-to-left during the panoramic photo capture phase. This prevents interference with panoramic photo capture.

[0229] The function of adjusting the direction indicated by the guide arrow can be recorded as function three. For details, please refer to the introduction of function three below, and no further explanation will be given here.

[0230] In some embodiments, after entering the rotational capture mode, the user can adjust the rear camera's framing by folding or unfolding the foldable screen. After adjusting the framing to an appropriate range, the user can perform a capture operation, such as clicking a capture button in the preview interface. In response to the capture operation, the phone can capture an image. The interface in which the capture is in progress can be referred to as the third interface.

[0231] The function of responding to the shooting operation mentioned above can be recorded as function four. For details, please refer to the introduction of function four below, and no further explanation will be given here.

[0232] In some embodiments, after entering the rotating shooting mode, such as after completing the shooting, the mobile phone can exit the rotating shooting mode and enter the normal shooting mode in response to an operation to exit the rotating shooting mode, such as clicking the shooting entry 6031 in the front interface 604. It is understood that the operation to exit the rotating shooting mode can clearly indicate the intention to exit the rotating shooting mode, and thereafter, the user interface does not need to be displayed on the front screen.

[0233] Therefore, in response to the operation of exiting the rotation shooting, the mobile phone can display a user interface based on the device posture decision, such as a screen of a normal shooting interface, instead of always displaying the user interface on the front screen.

[0234] The function of responding to the operation of exiting the rotation shooting can be recorded as function five. For details, please refer to the introduction of function five below, and no further explanation will be given here.

[0235] In some embodiments, immediately after entering the rotation shooting mode, such as after the shooting is completed, in response to the operation of exiting the camera application from the foreground, the mobile phone can exit the camera application running in the foreground, that is, run the camera application in the background.

[0236] However, unlike the operation of exiting the rotating shooting mode, exiting the camera application from the foreground does not clearly indicate that the user wants to exit the rotating shooting mode. Instead, it is very likely that the user just exits the camera application to the background and then further views, edits, or shares the shooting results in the foreground.

[0237] Based on this, in response to the operation of exiting the camera application from the foreground, the mobile phone can decide whether to exit the rotation shooting based on the product form.

[0238] The function of responding to the operation of exiting the camera application from the foreground can be recorded as function six. For details, please refer to the introduction of function six below, and no further explanation will be given here.

[0239] At this point, it should be noted that the above functions 1 to 6 can be flexibly combined. For example, during the preview phase of the panoramic mode, the electronic device can dynamically turn on or off the rear mirror, and can also adjust the direction indicated by the guide arrow. This embodiment of the application does not specifically limit this.

[0240] The following describes the specific implementation of Function 1 and Function 5 for the above-mentioned Form 1 and Form 3 respectively.

[0241] Form 1

[0242] Function 1

[0243] In form 1, the front screen is the outer screen 202. Therefore, after entering the rotation shooting mode, as the angle α between the first screen 2011 and the second screen 2012 of the folding screen 201 changes between 0° and 180°, the phone always keeps the outer screen 202 on and displays the preview interface of the rotation shooting on the outer screen 202.

[0244] For example, after entering the rotation shooting state, starting from the unfolded state shown by the solid line in Figure 8, as the first screen 2011 of the folding screen 201 (hidden by the back cover 203, not shown in the figure) is folded along the direction shown in 1b, α gradually decreases from 180°. When it decreases to 0°, the folded state is reached. During the above process, the phone always displays the preview interface on the outer screen 202.

[0245] It should be noted that during the rotation process, the framing range of the rear camera will change, so the framing image captured in real time will also change. Correspondingly, the real-time framing image can be displayed in the preview interface.

[0246] To ensure that the preview interface is always displayed on the external screen 202, firstly, the mobile phone needs to ensure that the external screen 202 is used for display after receiving the selection operation of the shooting entrance; secondly, the mobile phone needs to ensure that the external screen 202 is used for display until the rotation shooting is exited. The implementation of the above two aspects is described below.

[0247] First aspect:

[0248] In practice, the mobile phone may receive the user's selection operation for the shooting entrance of the rotation shooting when the application interface of the camera application is displayed on the outer screen 202. In this case, when the rotation shooting is entered, the outer screen 202 is in a bright screen state.

[0249] In addition, the phone may also receive a user selection operation of the shooting entry 9011 for rotating shooting when the application interface 901 of the camera application shown in Figure 9A is displayed on the foldable screen 201. It is understandable that when the foldable screen 201 is on, the external screen 202 is usually in the off state as shown in Figure 9A. In this case, when the rotating shooting is started, the external screen 202 is not in the on state, and the preview interface cannot be displayed on the external screen 202.

[0250] Of course, the mobile phone may also display the user interface on both the folding screen 201 and the outer screen 202. In this case, although the conditions for the outer screen 202 to be lit are met, the folding screen 201 is also lit, which can easily lead to accidental touches.

[0251] Therefore, in some embodiments, in response to selecting the capture entry, the phone can check whether only the outer screen 202 is illuminated. If not, the phone can switch to the state shown in FIG9A , where the outer screen 202 is illuminated and the foldable screen 201 is off, and display the rotation capture preview interface on the outer screen 202. If only the outer screen 202 is illuminated, no switching is required. This ensures that only the outer screen 202 is illuminated when the rotation capture function is activated.

[0252] Furthermore, if the outer screen 202 is not the only one that is on, the mobile phone may first display a switching prompt on the currently lit screen (such as the folding screen 201) to prompt the user to switch to the outer screen 202 display and start rotating shooting. For example, in response to the selection operation of the shooting entrance 9011 in the application interface 901 shown in Figure 9A, the mobile phone may first display "about to switch to the outer screen 202 display, enter rotating shooting" on the folding screen 201. Subsequently, after the display time of the switching prompt reaches a preset time (such as 3 seconds), or after receiving the user's confirmation operation, the mobile phone can switch to the state of the outer screen 202 being on and the folding screen 201 being off as shown in Figure 9A.

[0253] Second aspect:

[0254] After entering the rotation shooting mode, the mobile phone needs to keep displaying the preview interface on the outer screen 202. Therefore, in some embodiments, after entering the rotation shooting mode, the mobile phone can record the rotation shooting identifier a to indicate that the rotation shooting mode is being used. When the identifier a is recorded, even if the switching conditions for switching to the folding screen 201 to display the user interface are met, the mobile phone will not switch to the folding screen 201 to display. In this way, the mobile phone can ensure that during the rotation shooting process, it will not switch to the folding screen 201 to display the preview interface, but will always keep displaying the preview interface on the outer screen 202.

[0255] Function 2

[0256] During the preview phase, the mobile phone can dynamically turn on or off the rear mirror based on α, so that the rear mirror is turned on after the rear camera 204 is tilted towards itself, and the rear mirror is turned off after the rear camera 204 is tilted towards the scene in front of it.

[0257] Specifically, the mobile phone can turn on or off the rear mirroring based on angles 3 and 4 shown in Figure 9B. Angles 3 and 4 are close to 90 degrees, and usually angle 3 is less than 90 degrees, and angle 4 is greater than 90 degrees.

[0258] When entering the preview stage, if α is less than angle 3, the phone can turn off the rear mirroring; subsequently, if α is less than angle 3 and changes to α> angle 4, the phone can turn on the rear mirroring. If it changes again from α> angle 4 to α< angle 3, the phone can turn off the rear mirroring, and so on. When entering the preview stage, if α is greater than angle 4, the phone can turn on the rear mirroring; subsequently, if α is greater than angle 4 and changes to α< angle 3, the phone can turn off the rear mirroring. If it changes again from α< angle 3 to α> angle 4, the phone can turn on the rear mirroring, and so on.

[0259] In addition, when entering the preview phase, if the angle is 3 ≤ α ≤ 4, the phone can turn off the rear mirror by default. After the angle changes from 3 ≤ α ≤ 4 to α > 4, the phone can turn on the rear mirror. Subsequently, if the angle changes from α > 4 to α < 3, the phone can turn off the rear mirror. If the angle changes again from α < 3 to α > 4, the phone can turn on the rear mirror, and so on.

[0260] This article mainly explains the situation when α is less than angle 3 or α is greater than angle 4 when entering the preview stage.

[0261] It's understandable that for phones with foldable screens 201, users typically shoot in portrait mode. Based on this, when the user tilts the external screen 202 toward themselves to preview an image, when α > 90°, the rear camera 204 on the back cover 203 will typically tilt toward themselves, as shown in states ①, ②, and ③ in Figure 8. When α < 90°, the rear camera 204 on the back cover 203 will typically tilt toward the scene in front of them, as shown in state ④ in Figure 8.

[0262] In one specific implementation, a following zone X exists between angles 3 and 4. Within following zone X, the phone can maintain the rear mirror status (including both on and off) identical to the previous frame. That is, within following zone X, if the rear mirror status in the previous frame was on, then the rear mirror status in the current frame will also be on; if the rear mirror status in the previous frame was off, then the rear mirror status in the current frame will also be off. This prevents the phone from frequently turning the rear mirror on and off when α jitters within a small angle range.

[0263] For example, when Angle 3 is 87° and Angle 4 is 93°, as shown in Figure 10, when the phone is in the state of α = 86° shown in Figure 11A, α < Angle 3 is satisfied. At this point, rear mirroring is off, and the phone can display the preview interface 1101 shown in Figure 11A on the external screen 202. Subsequently, the second screen 2012 unfolds along the direction of 1m (opposite to the direction of 1b above). Before α > 93° is satisfied, it is in the following zone X shown in Figure 10, and the rear mirroring state remains off. For example, when the phone is in the state of α = 93° shown in Figure 11A, the phone can display the preview interface 1102 shown in Figure 11A on the external screen 202. Clearly, compared to preview interface 1101, the viewfinder in preview interface 1102 has only shifted to the left, and has not been mirrored left or right. Subsequently, the second screen 2012 continues to unfold in the direction of 1m, and when the mobile phone reaches the state of α=94° as shown in Figure 11A, α>93° is satisfied. At this time, the rear mirroring will be turned on, and the mobile phone can display the preview interface 1103 shown in Figure 11A on the external screen 202. The framing screen is mirrored left and right, that is, the preview interface can display the same effect as looking in the mirror.

[0264] After the rear camera 204 is tilted towards oneself (such as α>93°) and the rear mirror is turned on, the user can conveniently adjust the photographed scene according to the mirror effect in the viewfinder. For example, if the user moves to the left, the user in the preview interface will also move to the left; if the user moves to the right, the user in the preview interface will also move to the right. For example, when the mobile phone is in the state of α=94° as shown in Figure 11A, the user feels that the user in the preview interface 1103 is too far to the right, the user can move to the left. After moving to the left, the mobile phone can display the preview interface 1104 shown in Figure 11A on the external screen 202. Obviously, compared with the preview interface 1103: the user in the preview interface 1104 has also moved to the left. It can be seen that after the rear camera 204 is tilted towards oneself, turning on the rear mirror is more in line with the usage habit of selfie preview.

[0265] Similarly, after the rear camera 204 is tilted toward the scene in front of the user (e.g., α < 87°) and the rear mirror is turned off, the user can conveniently adjust the scene being photographed based on the imaging effect in the viewfinder. For example, if the user feels that the scene in the preview interface is too far to the left, the user can simply move the phone to the left. It can be seen that after the rear camera 204 is tilted toward the scene in front of the user, turning off the rear mirror is consistent with the usage habits of the rear camera in normal photo taking.

[0266] During the shooting phase, the phone will always lock the rear mirror on or off.

[0267] Taking Angle 3 as 87° and Angle 4 as 93° as an example, during the preview phase of video recording mode, when the phone is in the state of α = 94° as shown in FIG11B , α > Angle 4. At this point, rear mirroring is enabled, and the phone can display the preview interface 1111 shown in FIG11B on the external screen 202. The viewfinder in preview interface 1111 is a mirrored image. In response to clicking the capture button 11111 in preview interface 1111, the phone can display the capture interface 1112 shown in FIG11B on the external screen 202. Capture interface 1112 includes an end capture button 11121 and a capture timer 11122, indicating that capture has begun. Compared to preview interface 1111, the viewfinder in capture interface 1112 is not flipped left or right, indicating that rear mirroring remains enabled when capture begins. Later, during the shooting phase, α decreases from 94° to 86°. At this point, the angle α > Angle 4 decreases to α < Angle 3, and the phone can display shooting interface 1113 shown in FIG11B on external screen 202. Compared to shooting interface 1112, the viewfinder in shooting interface 1113 does not flip left and right, indicating that after α decreases from 94° to 86°, the rear camera mirroring remains enabled. In other words, during the shooting process, the phone remains locked and enabled for the rear camera mirroring.

[0268] Function three

[0269] After entering the rotation shooting mode, the mobile phone may display a preview interface 1201 shown in FIG12 on the external screen 202. The photo shooting mode is selected in the preview interface 1201, i.e., the current state is the rotation shooting photo shooting mode. In response to the selection operation of the panorama mode option 12011 in the preview interface 1201, the mobile phone may display a preview interface 1202 shown in FIG12 on the external screen 202. The panorama mode is selected in the preview interface 1202, i.e., the current state is the rotation shooting panorama mode.

[0270] 12, in the panorama mode of rotating shooting, the preview interface 1202 includes a guide arrow 12021. The guide arrow 12021 is used to indicate the direction of movement of the panorama shooting. Typically, the guide arrow 12021 indicates movement from left to right by default.

[0271] In order to facilitate users to take panoramic photos in any moving direction, during the preview stage, the mobile phone can provide a direction switching control 12022 in the preview interface 1202 shown in Figure 12. The direction switching control 12022 is used to trigger the mobile phone to switch the direction indicated by the guide arrow 12021.

[0272] Among them, the directions indicated by the guide arrow 12021 include multiple directions from left to right, from right to left, from top to bottom, and from bottom to top.

[0273] In a specific implementation, the above-mentioned multiple directions have a priority order. For example, the priority order from high to low is from left to right, from right to left, from bottom to top, and from top to bottom as shown in Figure 13. In this implementation, in response to a switching operation (such as a click operation) on the direction switching control 12022, the mobile phone can switch in sequence according to the priority order.

[0274] For example, in the panoramic mode of rotating photography, during the preview phase, the mobile phone may display preview interface 1401 shown in FIG. 14 on external screen 202. This interface is similar to preview interface 1202 described above and will not be further described here. In response to a click on direction switch control 12022 in preview interface 1401, the mobile phone may display preview interface 1402 shown in FIG. 14 on external screen 202. Unlike preview interface 1401, the direction indicated by guide arrow 12021 in preview interface 1402 is from right to left. In response to a click on direction switch control 12022 in preview interface 1402, the mobile phone may display preview interface 1403 shown in FIG. 14 on external screen 202. Unlike preview interface 1402, the direction indicated by guide arrow 12021 in preview interface 1403 is from bottom to top. In response to a click on direction switch control 12022 in preview interface 1403, the mobile phone may display preview interface 1404 shown in FIG. 14 on external screen 202. The difference from the preview interface 1403 is that the direction indicated by the guide arrow 12021 in the preview interface 1404 is from top to bottom.

[0275] In another specific implementation, the preset directions have no priority order. In this design, in response to a switching operation (e.g., a click operation) on the direction switching control 12022, the mobile phone may provide multiple direction options for selection. Subsequently, in response to a selection operation on another direction option, the mobile phone may switch to the corresponding direction.

[0276] At this point, it should be noted that the form and display location of the direction switch control 12022 are not limited to those shown in Figures 12 and 14. Of course, the user can also switch the direction indicated by the guide arrow 12021 in other ways. For example, the mobile phone can also switch the direction indicated by the guide arrow 12021 based on the user's switching gesture, such as a double-click gesture, a click gesture in various directions, etc. This embodiment of the present application does not specifically limit this.

[0277] To facilitate users to take panoramic photos in any direction, during the preview phase, the phone can also dynamically adjust the direction indicated by the guide arrow 12021 based on α. ​​Considering that users of mobile phones with foldable screens 201 usually take photos in portrait mode, the following mainly uses left-to-right and right-to-left as examples.

[0278] The mobile phone can turn on or off the rear mirroring based on angles 5 and 6 shown in Figure 15A. Angles 5 and 6 are close to 90 degrees, and usually angle 5 is less than 90 degrees, and angle 6 is greater than 90 degrees.

[0279] Specifically, when switching to panoramic mode, if α is less than angle 5, the direction indicated by the guide arrow 12021 is from right to left; subsequently, if it changes from α < angle 5 to α > angle 6, the mobile phone can switch the direction indicated by the guide arrow 12021 to from left to right. If it changes again from α > angle 6 to α < angle 5, the mobile phone can switch the direction indicated by the guide arrow 12021 to from right to left, and so on. When switching to panoramic mode, if α is greater than angle 6, the direction indicated by the guide arrow 12021 is from left to right; subsequently, if it changes from α > angle 6 to α < angle 5, the mobile phone can switch the direction indicated by the guide arrow 12021 from left to right to right to left. If it changes again from α < angle 5 to α > angle 6, the mobile phone can switch the direction indicated by the guide arrow 12021 to from left to right.

[0280] In addition, when switching to panoramic mode, if angle 5 ≤ α ≤ angle 6, guide arrow 12021 can indicate the default direction from left to right, and after changing from angle 5 ≤ α ≤ angle 6 to α < angle 5, the mobile phone can switch the direction indicated by guide arrow 12021 to from right to left. Subsequently, if it changes from α < angle 5 to α > angle 6, the mobile phone can switch the direction indicated by guide arrow 12021 to from left to right. If it changes again from α > angle 6 to α < angle 5, the mobile phone can switch the direction indicated by guide arrow 12021 to from right to left, and so on.

[0281] This article mainly explains the situation when switching to panoramic mode and α is less than angle 5 or α is greater than angle 6.

[0282] Normally, if α>90°, it indicates that the user wants to start from a state closer to the unfolded state and shoot during the gradual folding process. During this process, the framing range of the rear camera 204 changes from being biased toward the user in a clockwise direction to being biased toward the scenery in front of the user, similar to shooting from left to right. If α<90°, it indicates that the user wants to start from a state closer to the folded state and shoot during the gradual unfolding process. During this process, the framing range of the rear camera 204 changes from being biased toward the scenery in front of the user in a counterclockwise direction to being biased toward the user, similar to shooting from right to left. Therefore, the mobile phone dynamically adjusts the direction indicated by the guide arrow 12021 based on α, so that the direction indicated by the guide arrow 12021 can match the user's shooting intention.

[0283] In one specific implementation, a following zone Y exists between angles 5 and 6. Within following zone Y, the phone can maintain the direction indicated by guide arrow 12021 as it did in the previous frame. That is, within following zone Y, if the direction indicated by guide arrow 12021 in the previous frame was from left to right, then the direction indicated by guide arrow 12021 in the current frame will also be from left to right; if the direction indicated by guide arrow 12021 in the previous frame was from right to left, then the direction indicated by guide arrow 12021 in the current frame will also be from right to left. This prevents the phone from frequently switching the direction indicated by guide arrow 12021 when α jitters within a small angle range.

[0284] For example, if angle 5 is 87° as shown in FIG15B and angle 6 is 93° as shown in FIG15B , when the phone is in the state of α = 94° as shown in FIG16A , α > 93° is satisfied, and the phone can display the preview interface 1601 shown in FIG16A on the external screen 202 , with the direction indicated by the guide arrow 12021 in the preview interface 1601 being from left to right. Subsequently, the second screen 2012 is folded along the direction 1b , and before α < 87° is satisfied, it is in the following zone Y shown in FIG15B , and the direction indicated by the guide arrow 12021 remains from left to right. For example, when the phone is in the state of α = 87° as shown in FIG16A , the phone can display the preview interface 1602 shown in FIG16A on the external screen 202 , and the direction indicated by the guide arrow 12021 in the preview interface 1602 remains from left to right, without switching. Subsequently, the second screen 2012 continues to fold along the direction 1b. When the phone reaches the position α = 86° shown in Figure 16A, the angle changes from α > 93° to α < 87°, indicating that the user's shooting intention is to start from a position closer to the folded state and shoot as it gradually unfolds. Therefore, the phone can display the preview interface 1603 shown in Figure 16A on the external screen 202. The direction indicated by the guide arrow 12021 in the preview interface 1603 is from right to left, that is, the direction indicated by the guide arrow 12021 has switched. This ensures that the direction indicated by the guide arrow 12021 matches the shooting intention.

[0285] During the shooting stage, even if the switching conditions for switching the direction indicated by the guide arrow 12021 are met, such as changing from α < angle 5 to α > angle 6 or from α > angle 6 to α < angle 5, the mobile phone will not switch the direction indicated by the guide arrow 12021, but will remain locked to the direction indicated by the guide arrow 12021 in the last frame before shooting begins.

[0286] Still taking Angle 6 as 93° and Angle 5 as 87° as an example, when the phone is in the state of α = 94° as shown in FIG16B , α > Angle 6 is satisfied, and the phone can display preview interface 1611 as shown in FIG16B on external screen 202. The direction indicated by guide arrow 12021 in preview interface 16011 is from left to right. In response to clicking capture button 16111 in preview interface 1611, the phone can start panoramic shooting, and the phone will maintain the direction indicated by guide arrow 12021 from left to right until the shooting ends. For example, when α=94° during the shooting stage, the mobile phone can display the shooting interface 1612 shown in Figure 16B on the external screen 202, and the direction indicated by the guide arrow 12021 of the shooting interface 1612 is from left to right; when α decreases from 94° to 85°, although the change from α>angle 6 to α<angle 5 is satisfied, since it is in the shooting stage, the mobile phone can display the shooting interface 1613 shown in Figure 16B on the external screen 202, and the direction indicated by the guide arrow 12021 in the shooting interface 1613 is still from left to right.

[0287] Subsequently, when exiting the capture phase to the preview phase, the phone can continue to dynamically adjust the direction indicated by the guide arrow 12021 based on α. ​​Continuing with the example of FIG16B , and taking Angle 5 as 87°, when the phone displays the capture interface 1613 shown in FIG16B on the external screen 202, α < Angle 5 is satisfied. At this point, in response to clicking the End Capture button 16131 in the capture interface 1613, the phone can display the preview interface 1614 shown in FIG16B on the external screen 202. Unlike the capture interface 1613, the direction indicated by the guide arrow 12021 in the preview interface 1614 changes from right to left.

[0288] In practice, the above-mentioned embodiment of manually adjusting the direction indicated by the guide arrow 12021 and the embodiment of the mobile phone dynamically adjusting the direction indicated by the guide arrow 12021 based on α can be combined. Continuing with the example of FIG16A , the mobile phone further includes a direction switching control 12022 in the preview interface displayed on the external screen 202, such as preview interface 1601, preview interface 1602, and preview interface 1603. The user can still switch the direction indicated by the guide arrow 12021 by operating the direction switching control 12022. After the user manually adjusts the direction indicated by the guide arrow 12021, the mobile phone will further adjust the direction indicated by the guide arrow 12021 only when the switching condition is met.

[0289] Function 4

[0290] After entering the rotation shooting mode, the user can adjust the framing range of the rear camera 204 by folding or unfolding the folding screen 201. After adjusting to a suitable framing range, the user can perform a shooting operation, such as clicking a shooting button in the preview interface. In response to the shooting operation, the mobile phone can capture an image.

[0291] In the photo mode, after adjusting to a suitable framing range, in response to a shooting operation, the mobile phone can use the rear camera 204 to capture a picture of the corresponding framing range. In this way, the user does not need to turn around, and the mobile phone can also capture the side and back scenes, as well as the user himself.

[0292] In video recording mode, after adjusting to a suitable framing range, in response to a capture operation, the phone can use the rear camera 204 to start recording from the corresponding framing range. During the recording process, the user can continue to adjust the framing range, and the rear camera 204 can continue to capture images corresponding to the updated framing range. In response to the operation of ending recording, the phone can record a video of the changed framing range. For example, the phone can record a video of the framing range changing from behind to in front of the user. In this way, the phone can flexibly record a video of the changed framing range without the user having to turn around.

[0293] In panoramic mode, after adjusting to a suitable framing range, in response to a shooting operation, the mobile phone can use the rear camera 204 to start panoramic shooting from the corresponding framing range. Furthermore, as the user continues to adjust the framing range, the mobile phone can adjust the position of the guide arrow 12021 in the preview interface and display the synthesized panoramic photo. Continuing with Figure 16B as an example, during the shooting phase, the framing range changes from α = 94° to α = 85°, and the guide arrow 12021 moves from the position in the shooting interface 1612 to the position in the shooting interface 1613, i.e., it moves to the right; and the panoramic photo changes from photo 16121 in the shooting interface 1612 to photo 16132 in the shooting interface 1613.

[0294] Furthermore, in panoramic mode, the mobile phone can calculate the displacement of the guide arrow 12021 in the preview interface through the signals collected by the acceleration sensor (such as the acceleration sensor [180E] mentioned above) and the gyroscope sensor (such as the gyroscope sensor 180B mentioned above) respectively set on the first screen 2011 and the second screen 2012, thereby displaying the guide arrow 12021 in real time.

[0295] The displacement includes left-right displacement and up-and-down displacement. For example, the up-and-down displacement can be used to adjust the up-and-down floating display of the guide arrow 12021 on the mobile phone and prompt the user to move smoothly.

[0296] Furthermore, in panorama mode, the phone can use a panoramic algorithm to combine the images from various framing ranges into a panoramic photo. For example, the panoramic algorithm can extract the common feature areas and pixel differences between the two frames, remove the overlapping areas, stitch them together, and crop the pixels that are jittery and uneven, thereby synthesizing the panoramic photo.

[0297] In a specific implementation, in the panoramic algorithm, the gyroscope sensors respectively provided on the first screen 2011 and the second screen 2012 are used to obtain the angular velocity displacement of the panoramic shooting, and are used to accelerate the feature analysis of the two frames of the framing image, the same feature area and the difference pixel area.

[0298] Function 5

[0299] After entering the rotation shooting mode, such as after the shooting is completed, in response to the operation of exiting the rotation shooting mode, the mobile phone can exit the rotation shooting mode and enter the normal shooting mode. For example, the operation of exiting the rotation shooting mode can be a click operation on the shooting entry 17011 for the rotation shooting mode in the preview interface 1701 shown in FIG17 displayed on the external screen 202 of the mobile phone. In response to the click operation on the shooting entry 17011 for the rotation shooting mode in the preview interface 1701 shown in FIG17, the mobile phone can exit the rotation shooting mode and enter the normal shooting mode.

[0300] In response to the operation of exiting the rotation shooting mode, the mobile phone can decide to use foldable screen 201 or external screen 202 to display the normal shooting interface based on the device posture. Specifically, after exiting the rotation shooting mode, the mobile phone can clear the aforementioned recorded identifier a. In the absence of identifier a, the mobile phone can switch the display of the user interface between foldable screen 201 and external screen 202 based on the device posture.

[0301] Exemplarily, if the device posture is posture m, such as the folded state, the external screen 202 continues to be used to display the normal shooting interface; if the device posture is posture n, such as the unfolded state, the folded screen 201 is switched to display the normal shooting interface.

[0302] Taking the device posture m corresponding to α=4° shown in FIG17 as an example, in response to a click operation on the rotation shooting entry 17011 in the preview interface 1701 shown in FIG17 , the mobile phone can continue to display the normal shooting interface on the external screen 202, such as the preview interface 1702 shown in FIG17 . In the preview interface 1702, the rotation shooting entry is hidden, indicating that the rotation shooting has been turned off and the normal shooting mode has been entered.

[0303] Taking the device posture n corresponding to α = 180° as shown in FIG18 as an example, in response to a click on the rotation shooting entry 18011 in the preview interface 1801 displayed on the external screen 202 shown in FIG18 , the phone can switch to displaying the normal shooting interface on the foldable screen 201, such as displaying the preview interface 1802 shown in FIG18 on the foldable screen 201. In preview interface 1802, the rotation shooting entry is hidden, indicating that rotation shooting has been turned off and normal shooting has been entered. In addition, while preview interface 1802 is displayed, the external screen 202 is turned off. It should be noted that FIG18 is only for the convenience of viewing preview interface 1802, so the phone is turned over in the figure. In practice, the phones shown in FIG18 all have the external screen 202 tilted towards the user and α = 180°, so that the selfie viewfinder image can continue to be displayed in preview interface 1802.

[0304] Furthermore, before switching to using the folding screen 201 to display the normal shooting interface, the mobile phone can also display a switching animation on the external screen 202 to indicate that the user interface will be switched from the external screen 202 to the folding screen 201.

[0305] Function 6

[0306] After entering the rotation shooting mode, in response to the operation of exiting the camera application from the foreground, the mobile phone can exit the camera application running in the foreground, that is, run the camera application in the background. At the same time, in a mobile phone with a folding screen 201, the effect of using the external screen 202 alone is also very good. For example, on the external screen 202, it is entirely possible to view, edit and share the shooting results. Based on this feature, in response to the operation of exiting the camera application from the foreground, regardless of the current device posture, the mobile phone will still maintain the display of the user interface on the external screen 202, such as the desktop, gallery interface, etc.

[0307] For example, the phone is in the device posture shown in FIG19 , which is consistent with the foldable screen 201, meaning that the user interface should be displayed on the foldable screen 201. The operation to remove the camera application from the foreground can be a swipe up (as indicated by the arrow) from the bottom of the preview interface 1901 displayed on the external screen 202 shown in FIG19 . However, in response to the swipe up operation from the bottom of the preview interface 1901, the phone still displays the user interface on the external screen 202, such as the desktop 1902 shown in FIG19 .

[0308] After exiting the camera application running in the foreground, if the device posture is updated as α changes, it indicates that the user wants to change the device posture to use the phone. Subsequently, the phone can switch the display of the user interface between the foldable screen 201 and the external screen 202 based on the device posture decision, rather than maintaining the user interface on the external screen 202. For example, after the device posture is updated, the phone can clear the aforementioned recorded identifier a. In the absence of identifier a, the phone can switch the display of the user interface between the foldable screen 201 and the external screen 202 based on the device posture decision.

[0309] Furthermore, when the camera app is not in the foreground, the phone can disable the rotation shooting function after the device posture is updated. Subsequently, in response to the operation of bringing the camera app from the background to the foreground, the phone will display the normal shooting interface instead of continuing the rotation shooting function.

[0310] Of course, after exiting the camera application running in the foreground, if the mobile phone clears the camera application process in the background, it means that the rotation shooting is ended. Subsequently, the mobile phone can also switch the display user interface between the folding screen 201 and the external screen 202 based on the device posture decision, instead of maintaining the user interface displayed on the external screen 202.

[0311] At this point, it should be noted that the above description of responding to the operation of exiting the camera application from the foreground takes into account that the external screen 202 can also be used alone to achieve good results. In practice, the mobile phone can also respond to the operation of exiting the camera application from the foreground in accordance with the operation of exiting the rotation shooting mentioned above. That is, in response to the operation of exiting the camera application from the foreground, the mobile phone can use the folding screen 201 or the external screen 202 to display the normal shooting interface based on the α decision, without having to keep the normal shooting interface displayed on the external screen 202. The embodiments of the present application do not specifically limit this.

[0312] The embodiment of the above-mentioned form 1 is further described below in conjunction with Figure 20. Taking angles 3 and 5 as 87 degrees, and angles 4 and 6 as 93 degrees as an example, as shown in Figure 20, in a specific implementation, the rotation shooting of the mobile phone of form 1 (i.e., the mobile phone with a foldable screen 201) includes:

[0313] S2001, enter rotation shooting.

[0314] When a camera application is running in the foreground, in response to the selection operation of the shooting entrance of the rotation shooting, the mobile phone will enter the rotation shooting. For details, please refer to Figures 6B and 7 and their related descriptions above, which will not be repeated here.

[0315] S2002, check whether only the outer screen 202 is on; if so, execute the following S2005; if not, execute the following S2003.

[0316] For example, the mobile phone can determine whether only the outer screen 202 is on by querying the status of each display screen.

[0317] If only the external screen 202 is lit, it indicates that there is no need to switch to displaying the preview interface of the rotation shooting on the external screen 202, and all other screens are off. Subsequently, the mobile phone can execute S2005 described below. Conversely, if not only the external screen 202 is lit, it indicates that it is necessary to switch to displaying the preview interface of the rotation shooting on the external screen 202 and control all other screens to be off. Subsequently, the mobile phone can execute S2003 and S2004 described below to switch the display to the external screen 202.

[0318] S2003: Display switching prompt.

[0319] For example, the mobile phone may prompt "about to switch to the external screen 202 display, enter the rotation shooting".

[0320] S2004 , after the prompt duration reaches a preset duration, only the external screen 202 is controlled to be on, and a preview interface of the rotation shooting is displayed on the external screen 202 .

[0321] That is, the mobile phone switches to the external screen 202 to display the preview interface of the rotation shooting.

[0322] In practice, in addition to the reminder duration reaching a preset duration, other events may also trigger the mobile phone to switch to the external screen 202 display. For example, the other event may be an event in which the user performs a confirmation operation on the switch prompt. Alternatively, the mobile phone may not display the switch prompt and directly switch to the external screen 202 display. This embodiment of the present application is not specifically limited to this.

[0323] S2005. Record identification a.

[0324] That is, the mobile phone sets the camera function to rotation shooting, so that the mobile phone can subsequently perform relevant responses of rotation shooting based on the identifier.

[0325] It should be noted that when it is found in S2002 that only the external screen 202 is on, or when it is found in S2003 that not only the external screen 202 is on and the display is switched to the external screen 202 and the other screens are off, S2005 can be executed.

[0326] S2006: When the device posture changes, the device posture is updated but the screen is not switched.

[0327] That is to say, when the identifier a is recorded, the mobile phone will only update the device posture, but will not switch the display screen displaying the user interface based on the device posture. Among them, the device posture is updated to facilitate the subsequent exit of the rotation shooting or the exit of the camera application to the background. The mobile phone can decide the display screen displaying the user interface based on the real-time updated device posture. For details, please refer to Figures 17 to 19 above and their related context descriptions, which will not be repeated here. In addition, the screen is not switched to ensure that the mobile phone always uses the external screen 202 for display during the rotation shooting process.

[0328] It should be noted that S2006 is a continuous action after entering the rotation shooting mode. Once an event indicating that the device posture has changed is received, the device posture will be updated, and is not limited to the execution timing shown in FIG. 20 .

[0329] For the parts not described in detail in the above S2002-S2006, please refer to the relevant descriptions of the first and second aspects above, which will not be repeated here.

[0330] Similar to regular photography, rotating photography offers multiple shooting modes, such as photo mode, video mode, and panorama mode. However, unlike other modes like photo mode and video mode, panorama mode requires the phone to perform additional processing, such as switching the direction indicated by the guide arrow, calculating the guide arrow's displacement, and synthesizing the panoramic photo. Therefore, after entering rotating photography, the phone can execute S2007 below to distinguish between panorama mode and other modes.

[0331] S2007: Detect whether it is a panoramic mode.

[0332] It should be noted that after entering the rotation shooting mode, the mobile phone can switch to the corresponding shooting mode in response to the user's operation to switch the shooting mode. In other words, the shooting mode can be changed after entering the rotation shooting mode. The mobile phone can record the indication information of the current shooting mode to detect whether it is the panoramic mode.

[0333] If it is panoramic mode, the mobile phone uses the following S2008-S2017 processing; if it is not panoramic shooting, the mobile phone uses the following S2018-S2024 processing.

[0334] S2008: Check whether it is in the preview stage.

[0335] In panoramic mode, the phone performs different processing during the preview phase and the shooting phase. For example, during the preview phase, the phone may complete steps S2009-S2015 described below; during the shooting phase, the phone may complete steps S2016-S2017 described below.

[0336] S2009. Obtain α.

[0337] It is understood that as the user moves the phone, the relative positions of the first screen 2011 and the second screen 2012 change, and α will change accordingly. Therefore, during the preview phase, the phone can continuously execute S2009 to obtain a real-time α. Subsequently, the phone can dynamically turn on or off rear mirroring based on α, and switch the direction indicated by the guide arrow 12021.

[0338] When switching to panoramic mode, if α is less than 87°, the phone displays a guide arrow 12021 indicating a direction from right to left; if α is greater than 93°, the phone displays a guide arrow 12021 indicating a direction from left to right. Furthermore, when entering the preview phase, if α is less than 87°, the phone turns off rear mirroring; if α is greater than 93°, the phone turns on rear mirroring.

[0339] S2010: Detect whether α changes from α<87° to α>93°.

[0340] If α changes from < 87° to α > 93°, the mobile phone may execute the following S2011 and S2012.

[0341] If the angle does not change from α<87° to α>93°, the mobile phone may execute the following S2013.

[0342] S2011, turn on rear mirroring.

[0343] In this way, the mobile phone can turn on the rear mirror when the viewing range of the rear camera 204 is biased towards itself. For details, please refer to Figures 10 and 11A above and their related context descriptions, which will not be repeated here.

[0344] S2012. Adjust the direction indicated by the guide arrow from left to right.

[0345] In this way, when the rear camera 204 of the mobile phone starts shooting from the side facing itself, the direction indicated by the guide arrow is from left to right. For details, please refer to Figures 15B and 16A above and their related context descriptions, which will not be repeated here.

[0346] S2013. Detect whether α changes from α>93° to α<87°.

[0347] If α changes from α>93° to α<87°, the mobile phone can execute the following S2014 and S2015.

[0348] If the angle does not change from α>93° to α<87°, the mobile phone may neither switch the state of the rear mirror nor adjust the direction indicated by the guide arrow.

[0349] S2014. Turn off the rear mirror.

[0350] In this way, the mobile phone can turn off the rear mirror when the viewing range of the rear camera 204 is biased towards the scene in front of the eyes. For details, please refer to Figures 10 and 11A above and their related context descriptions, which will not be repeated here.

[0351] S2015. Adjust the direction indicated by the guide arrow from right to left.

[0352] In this way, when the rear camera 204 of the mobile phone starts shooting from the scene in front of the eyes, the direction indicated by the guide arrow is from right to left. For details, please refer to Figures 15B and 16A above and their related context descriptions, which will not be repeated here.

[0353] S2016. Adjust the position of the guide arrow based on the user's movement.

[0354] For example, the position of the guide arrow will move left and right, and will also float up and down.

[0355] At this point, it should be noted that: if the user is not satisfied with the direction indicated by the guide arrow after automatic switching, the direction indicated by the guide arrow can be further adjusted manually. For details, please refer to Figure 14 and the related above and below for instructions on using the direction switching control to adjust the direction indicated by the guide arrow. I will not repeat it here.

[0356] S2017. Take a panoramic photo.

[0357] Regarding the above S2016-S2017, please refer to the previous description on how the mobile phone starts panoramic shooting in response to the shooting operation, which will not be repeated here.

[0358] S2018. Check whether it is in the preview stage.

[0359] In modes other than panoramic mode, such as photo mode and video mode, the phone performs different processing during the preview phase and the shooting phase. For example, during the preview phase, the phone may complete steps S2019-S2023 described below; during the shooting phase, the phone may complete step S2024 described below.

[0360] S2019. Obtain α.

[0361] S2020. Detect whether α changes from α<87° to α>93°.

[0362] S2021. Enable rear mirroring.

[0363] S2022. Detect whether α changes from α>93° to α<87°.

[0364] S2023. Turn off the rear mirror.

[0365] Regarding the above S2019-S2023, please refer to the description of the corresponding steps in the previous S2010-S2015, which will not be repeated here.

[0366] S2024, shoot.

[0367] Regarding S2024, please refer to the previous description about responding to the shooting operation, the mobile phone taking pictures of the corresponding framing range or starting to record video, which will not be repeated here.

[0368] At this point, it should be noted that the execution order of the above-mentioned S2007-S2024 is not limited to that shown in Figure 20. For example, the mobile phone may first adjust the direction indicated by the guide arrow and then switch the state of the rear mirror, such as executing S2012 first and then S2011, or executing S2015 first and then S2014. For another example, the mobile phone may first execute S2013, and if α does not change from α>93° to α<87°, then execute S2010; the mobile phone may also first execute S2022, and if α does not change from α>93° to α<87°, then execute S2020. As another example, the mobile phone can first detect whether it is in the preview stage. When it is detected that it is in the preview stage, the mobile phone turns on or off the rear mirror based on α; then further detects whether it is in panoramic mode. If it is in panoramic mode, the direction indicated by the guide arrow is also adjusted based on α. ​​If it is not panoramic mode, there is no need to adjust the direction indicated by the guide arrow based on α; if it is not in the preview stage, further detect whether it is in panoramic mode. If it is in panoramic mode, execute S2016-S2017. If it is not panoramic mode, execute S2024.

[0369] Furthermore, steps S2007-S2024 are not necessarily required. For example, the phone may not adjust the direction indicated by the guide arrow, i.e., S2012 and S2015 may be omitted. Alternatively, the phone may not switch the rear camera image, i.e., S2011, S2014, S2021, and S2023 may be omitted.

[0370] Furthermore, for other modes such as photo mode and video mode other than panoramic mode, if the mobile phone does not switch the rear mirror, the above S2018-S2023 can be omitted.

[0371] Furthermore, for the panoramic mode, if the mobile phone neither adjusts the direction indicated by the guide arrow nor switches the rear mirror image, the above S2008-S2015 can be omitted.

[0372] After entering the rotation shooting, before starting or after finishing shooting, the user may exit the rotation shooting or switch the camera application to the background. Accordingly, the mobile phone can respond through the following S2025 and subsequent steps.

[0373] It should be noted that in FIG20 , S2025 and its subsequent steps are located after the shooting is completed, such as after S2017 and S2024. In practice, S2025 and its subsequent steps can be triggered and executed at any time after the rotation shooting is started.

[0374] S2025: Detect whether an operation to exit rotation shooting is received.

[0375] If an operation to exit the rotation shooting is received, it indicates that the user no longer wants to use the rotation shooting. In this case, the mobile phone may execute the following S2029 to mark the exit of the rotation shooting.

[0376] If the operation to exit the rotation shooting is not received, the mobile phone can execute the following S2026.

[0377] S2026: Detect whether an operation to exit the camera application from the foreground is received.

[0378] If an operation is received to exit the camera application from the foreground, it indicates that the user wants to keep the rotating shooting in the background. In this case, the mobile phone can execute the following S2027.

[0379] If the operation of exiting the camera application from the foreground is not received, the rotation shooting can continue to be used normally in the foreground, such as the mobile phone can repeatedly execute S2006-S2026.

[0380] It should be noted that the execution order of S2025-S2026 is not limited to that shown in Figure 20. For example, the mobile phone may first execute S2026, and only execute S2025 if it detects that no operation to exit the camera application from the foreground has been received.

[0381] S2027 . Continue to display the user interface on the external screen 202 .

[0382] S2028. Detect whether the posture of the device has changed.

[0383] If the device posture changes, it indicates that the user wants to change the device posture to use the mobile phone. In this case, the mobile phone can execute the following S2029 to mark the exit of rotation shooting.

[0384] If the device posture has not changed, it indicates that the user wants to continue to maintain the device posture under the rotation shooting. In this case, the mobile phone can continue to display the user interface on the external screen 202, that is, repeatedly execute S2027.

[0385] S2029. Clear identification a.

[0386] After clearing the flag a, the mobile phone no longer executes the relevant responses of the rotation shooting, for example, no longer executes S2006-S2028.

[0387] S2030: Check whether the device posture is consistent with the external screen 202 being on.

[0388] If the device posture is consistent with the external screen 202 being on, it indicates that the user interface needs to continue to be displayed on the external screen 202, and the mobile phone can execute S2031.

[0389] If the device posture is inconsistent with the external screen 202 being on, it indicates that it is necessary to switch to the folding screen 201 to display the user interface, and the mobile phone can execute S2032.

[0390] S2031 . Display a user interface on the external screen 202 .

[0391] S2032: Switch to the folding screen 201 to display the user interface.

[0392] Regarding the above-mentioned S2025-S2032, please refer to the previous description of Figures 17-19 and their related context, which will not be repeated here.

[0393] In addition, the mobile phone may not distinguish between the operation of exiting the rotation shooting and the operation of exiting the camera application, but executes S2029-S2032 after receiving the operation of exiting the rotation shooting or the operation of exiting the camera application. This embodiment of the application does not make specific limitations on this.

[0394] Form Three

[0395] In a mobile phone with a foldable screen 401, the user can unfold or fold the foldable screen 401 so that the γ between the first screen 4011 and the second screen 4012 and / or the δ between the second screen 4012 and the third screen 4013 can change between [0°, 180°], thereby causing the viewing range of the rear camera 403 to change.

[0396] As γ gradually increases from 0° to 180°, the viewing range of the rear camera 403 can change by 180° in a clockwise direction. For example, when δ remains unchanged at 180° and the third screen 4013 faces the user, starting from the state of γ = 0° shown in FIG21A , the rear camera 403 faces the user. When γ = 0° changes to γ ​​= 90° shown in FIG21A , the rear camera 403 changes clockwise to face the scene on the left. When γ = 90° changes to γ ​​= 180° shown in FIG21A , the rear camera 403 changes clockwise to face the scene in front of the user.

[0397] Furthermore, as δ gradually decreases from 180° to 0°, the viewing range of the rear camera 403 can also change by 180° in a clockwise direction. Taking the case where γ remains unchanged at 180° and the third screen 4013 faces the user as an example, starting from the state of δ = 180° shown in FIG21B , the rear camera 403 faces the scene in front of it. When δ = 180° changes to δ = 90° as shown in FIG21B , the rear camera 403 changes in a clockwise direction to the scene to the right. When δ = 90° changes to δ = 0° as shown in FIG21B , the rear camera 403 changes in a clockwise direction to face the user.

[0398] Then, if γ gradually increases from 0° to 180° and δ gradually decreases from 180° to 0°, 360° clockwise shooting can be achieved.

[0399] It should be noted that in the examples of Figures 21A and 21B , γ first increases gradually from 0° to 180°, and then δ gradually decreases from 180° to 0°. In practice, δ can also be gradually decreased from 180° to 0°, and then γ can be gradually increased from 0° to 180°. Similarly, 360° clockwise shooting can be achieved.

[0400] For example, the mobile phone can be in the state of γ = 0° as shown in FIG21C . The user can gradually close the entirety formed by closing the first screen 4011 and the second screen 4012 with the third screen 4013, so that δ gradually decreases from 180° to 0°. During this process, clockwise shooting [0°, 180°] can be achieved. After δ decreases to 0°, the mobile phone can be in the state of δ = 0° as shown in FIG21C . The user can gradually increase γ from 0° to 180° by unfolding the first screen 4011 and the second screen 4012. During this process, clockwise shooting [180°, 360°] can continue to be achieved. Thus, 360° clockwise shooting is achieved.

[0401] Furthermore, in the examples of Figures 21A and 21B above, δ is adjusted only after γ increases to 180°, but this is not a limitation in practice. For example, the user can alternately adjust γ and δ. For example, after γ increases to 90°, δ is reduced from 180° to 120°, then γ is increased from 90° to 120°, and then δ is reduced from 120° to 80°. In this way, the framing range of the rear camera 403 can be changed, and 360° clockwise shooting can also be achieved.

[0402] Of course, it is understandable that if γ is gradually reduced from 180° to 0° and δ is gradually increased from 0° to 180°, 360° counterclockwise shooting can be achieved.

[0403] Furthermore, in practice, γ and δ may not always increase or decrease. Specifically, as the user expands the first screen 4011 and the second screen 4012, γ increases; as the user closes the first screen 4011 and the second screen 4012, γ decreases. As the user closes the second screen 4012 and the third screen 4013, δ decreases; as the user expands the second screen 4012 and the third screen 4013, δ increases.

[0404] For mobile phones with foldable screen 401, users typically shoot in portrait mode. After rotating the screen, users will orient the third screen 4013 toward themselves to facilitate image preview. For ease of description, when the third screen 4013 is facing themselves, the orientation of the rear camera 403 (denoted as θ) is 0° when γ = 0° and δ = 180°, and θ is 360° when γ = 180° and δ = 0°. That is, the clockwise direction is the positive direction.

[0405] On this basis, as θ changes in the clockwise direction, rotation shooting from 0° to 360° can be achieved, and as θ changes in the counterclockwise direction, rotation shooting from 360° to 0° can be achieved.

[0406] For example, θ is shown in FIG22 . When the rear camera 403 faces the user, θ = 0° (360°); when the rear camera 403 faces the scene to the left of the phone, θ = 90°; when the rear camera 403 faces the scene in front of the user, θ = 180°; and when the rear camera 403 faces the scene to the right of the phone, θ = 270°.

[0407] Since γ increases from 0° to 180°, the orientation of the rear camera 403 will change in a clockwise direction (i.e., in the positive direction), and δ increases from 0° to 180°, the orientation of the rear camera 403 will change in a counterclockwise direction (i.e., in the reverse direction), then at any moment, the orientation of the rear camera 403 can be: γ+(180°-δ), which can be recorded as the orientation formula.

[0408] Here are a few specific examples to illustrate the effect of using the orientation formula:

[0409] For example, substituting the above orientation formula into the state of γ = 0° shown in Figure 21A, we can calculate θ = 0° + (180° - 180°) = 0°; substituting the above orientation formula into the state of γ = 90° shown in Figure 21A, we can calculate θ = 90° + (180° - 180°) = 90°; substituting the above orientation formula into the state of γ = 180° shown in Figure 21A, we can calculate θ = 180° + (180° - 180°) = 180°. It can be seen that the orientation calculated using the orientation formula for the case of δ = 180° is consistent with the orientation shown in Figure 22 above.

[0410] As another example, substituting the above orientation formula into the state of δ = 180° shown in Figure 21B, we can calculate θ = 180° + (180° - 180°) = 180°; substituting the above orientation formula into the state of δ = 90° shown in Figure 21B, we can calculate θ = 180° + (180° - 90°) = 270°; substituting the above orientation formula into the state of δ = 0° shown in Figure 21B, we can calculate θ = 180° + (180° - 0°) = 360°. It can be seen that the orientation calculated using the orientation formula for the case of γ = 180° is consistent with the orientation shown in Figure 22 above.

[0411] As another example, substituting the above orientation formula into the state of δ = 135° and γ = 45° shown in Figure 23, we can calculate θ = 45° + (180° - 135°) = 90°; substituting the above orientation formula into the state of δ = 90° and γ = 90° shown in Figure 23, we can calculate θ = 90° + (180° - 90°) = 180°; substituting the above orientation formula into the state of δ = 0° and γ = 90° shown in Figure 23, we can calculate θ = 90° + (180° - 0°) = 270°. It can be seen that the orientation calculated using the orientation formula for any combination of δ and γ is consistent with the orientation shown in Figure 22 above.

[0412] Function 1

[0413] In form three, the front screen is third screen 4013. To ensure that the preview interface is always displayed on third screen 4013 regardless of the orientation of rear camera 403, the phone must first ensure that the third screen 4013 is used for display after a selection operation is made on the capture entry; and secondly, the phone must ensure that the third screen 4013 is used for display until the rotation capture function is exited. The implementation of these two aspects is described below.

[0414] First aspect:

[0415] There are three main ways to use a mobile phone with a foldable screen 401: Way 1, using the foldable screen 401 as a large screen to display the user interface, then the first screen 4011, the second screen 4012 and the third screen 4013 are all in the bright screen state; Way 2, displaying the user interface on the screen formed by the first screen 4011 and the second screen 4012, such as displaying the user interface on the screen formed by the first screen 4011 and the second screen 4012 when δ=0° and γ is close to 180°, then the first screen 4011 and the second screen 4012 are both in the bright screen state; Way 3, displaying the user interface on the third screen 4013, such as displaying the user interface through the third screen 4013 in the folded state, then only the third screen 4013 is in the bright screen state.

[0416] Therefore, in some embodiments, in response to selecting the capture entry, the mobile phone may query the status of the first screen 4011, the second screen 4012, and the third screen 4013. If the query finds that the third screen 4013 is not the only screen that is lit, as in the aforementioned methods 1 and 2, the mobile phone may control the third screen 4013 to light up and display the preview interface, while controlling the other screens to be off. If the query finds that only the third screen 4013 is lit, as in the aforementioned method 3, the mobile phone may simply display the user interface on the third screen 4013 without switching screens.

[0417] When the user interface is displayed on the foldable screen 401 shown in FIG24 (before switching), as in method 1, the mobile phone can query that the first screen 4011, the second screen 4012, and the third screen 4013 are all lit. In this case, the mobile phone can switch to a state where the third screen 4013 is lit and the first screen 4011 and the second screen 4012 are both off, and the preview interface 3301 shown in FIG24 (after switching) is displayed on the third screen 4013.

[0418] Of course, as mobile phone usage scenarios continue to evolve, it is possible that the user interface is displayed only on the first screen 4011 or the second screen 4012, or on the first screen 4011 and the second screen 4012, or on the first screen 4011 and the third screen 4013. Accordingly, in response to a selection operation on a shooting entry, the mobile phone may query whether only the third screen 4013 is illuminated; if only the third screen 4013 is illuminated, there is no need to switch screens; if not, the mobile phone may switch to a state where only screen 4013 is illuminated, with both the first screen 4011 and the second screen 4012 being off.

[0419] In this way, the mobile phone can ensure that when entering the rotation shooting mode, only the third screen 4013 is in the bright screen.

[0420] Furthermore, the mobile phone may first display a switching prompt on the display screen of the bright screen, prompting the user to switch to the third screen 4013 and start rotating the camera. Subsequently, after the display duration of the switching prompt reaches a preset duration (e.g., 3 seconds), or after receiving a confirmation operation from the user, the mobile phone may switch to a state where the third screen 4013 is bright and the first screen 4011 and the second screen 4012 are off.

[0421] Second aspect:

[0422] Similar to form one, in form three, the phone can also indicate that it is using rotary capture by recording a rotary capture identifier a. If identifier a is recorded, the phone will not switch screens even if the conditions for switching the user interface are met. This ensures that the phone does not switch screens during the rotary capture process, and the preview interface remains displayed on the third screen 4013.

[0423] Function 2

[0424] During the preview phase, the phone can dynamically turn on or off the rear mirror based on γ and δ. Specifically, the phone can dynamically turn on or off the rear mirror based on the orientation (hereinafter referred to as θ) calculated by γ and δ.

[0425] Based on the orientation shown in the aforementioned FIG. 22 , it can be seen that when θ is in the range of [0°, 90°) and (270°, 360°], the rear camera 403 is biased toward itself, and when θ is in the range of (90°, 270°), the rear camera 403 is biased toward the scene in front of it.

[0426] Based on this, referring to FIG25, when entering the preview stage, if θ < angle 3 or θ > angle 10 (usually close to 270°, but slightly larger than 270°, such as 273°), the mobile phone turns on the rear mirror; subsequently, if it changes from θ < angle 3 to θ > angle 4, or from θ > angle 10 to θ < angle 9 (usually close to 270°, but slightly smaller than 270°, such as 267°), the mobile phone turns off the rear mirror; if it changes from angle 4 < θ < angle 9 to θ < angle 3 or θ > angle 10, the mobile phone turns on the rear mirror, and so on. When entering the preview stage, if angle 4 < θ < angle 9, the mobile phone turns off the rear mirror; subsequently, if it changes from angle 4 < θ < angle 9 to θ < angle 3 or θ > angle 10, the mobile phone turns on the rear mirror; if it changes again from θ < angle 3 to θ > angle 4, or from θ > angle 10 to θ < angle 9, the mobile phone turns off the rear mirror, and so on.

[0427] In addition, when entering the preview stage, if angle 3 ≤ θ ≤ angle 4 or angle 9 ≤ θ ≤ angle 10, the phone can turn off the rear mirror by default, and after changing from angle 3 ≤ θ ≤ angle 4 to θ < angle 3 or from angle 9 ≤ θ ≤ angle 10 to θ > angle 10, the phone can turn on the rear mirror. Subsequently, if it changes from θ < angle 3 to θ > angle 4 or from θ > angle 10 to θ < angle 9, the phone turns off the rear mirror. If it changes from angle 4 < θ < angle 9 to θ < angle 3 or θ > angle 10, the phone turns on the rear mirror, and so on.

[0428] This article mainly explains the situations when θ < angle 3, θ > angle 10, and angle 4 < θ < angle 9 when entering the preview stage.

[0429] Taking Angle 3 of 87°, Angle 4 of 93°, Angle 9 of 267°, and Angle 10 of 273° as an example, when the mobile phone is in the state of θ=180° as shown in Figure 26, Angle 4<θ<Angle 9 is satisfied, and the mobile phone can display the preview interface 3501 on the third screen 4013. The viewfinder image in the preview interface 3501 is not mirrored left and right, that is, the rear mirror is turned off at this time. Subsequently, when the mobile phone changes from θ=180° to the state of θ=0° as shown in Figure 26, θ<Angle 3 is satisfied, and the mobile phone can display the preview interface 3502 on the third screen 4013. The difference from the preview interface 3501 is that the viewfinder image in the preview interface 3502 is mirrored left and right, that is, the rear mirror is turned on at this time.

[0430] In this way, based on θ, in the preview stage, the mobile phone can turn on the rear mirror when the rear camera 403 is tilted towards itself; and the mobile phone can turn off the rear mirror when the rear camera 403 is tilted towards the scene in front of it.

[0431] Function three

[0432] After entering the rotation shooting mode, the mobile phone may display the preview interface 3601 shown in FIG27 on the third screen 4013. The photo mode is selected in the preview interface 3601, i.e., the current state is the rotation shooting photo mode. In response to the selection of the panorama mode option 36011 in the preview interface 3601, the mobile phone may display the preview interface 3602 shown in FIG27 on the third screen 4013. The panorama mode is selected in the preview interface 3602, i.e., the current state is the rotation shooting panorama mode.

[0433] 27 , in the panorama mode of rotating photography, the preview interface 3602 includes a guide arrow 36021. The guide arrow 36021 is used to indicate the direction of movement of the panorama photography. Typically, the guide arrow 36021 indicates from left to right by default.

[0434] In some embodiments, in order to facilitate users to take panoramic photos in any moving direction, during the preview stage, the mobile phone can provide a direction switching control 36022 in the preview interface 3602 shown in Figure 27. The direction switching control 36022 is used to trigger the mobile phone to switch the direction indicated by the guide arrow 36021. For the specific implementation of this embodiment, please refer to the relevant description in the previous form one, which will not be repeated here. Among them, the guide arrow 36021 corresponds to the guide arrow 12021 in form one, and the direction switching control 36022 corresponds to the direction switching control 12022 in form one.

[0435] In other embodiments, to facilitate users to take panoramic photos in any direction, during the preview phase, the mobile phone can also dynamically adjust the direction indicated by the guide arrow 36021 based on γ and δ. Specifically, the mobile phone can dynamically turn on or off the rear mirror based on θ.

[0436] In a specific implementation, the mobile phone can adjust the direction indicated by the guide arrow 36021 only near θ = 180°. Referring to Figure 28, when switching to panoramic mode, if θ < angle 11 (usually close to 180°, but slightly less than 180°, such as 177°), the direction indicated by the guide arrow 36021 is from left to right; subsequently, if θ changes from θ < angle 11 to θ > angle 12 (usually close to 180°, but slightly greater than 180°, such as 183°), the direction indicated by the guide arrow 36021 is switched to from right to left. If θ again changes from θ > angle 12 to θ < angle 11, the direction indicated by the guide arrow 36021 is switched to from left to right, and so on. When switching to panoramic mode, if θ>angle 12, the direction indicated by the guide arrow 36021 is from right to left; subsequently, if it changes from θ>angle 12 to θ<angle 11, the direction indicated by the switch guide arrow 36021 is from left to right, and if it changes from θ<angle 11 to θ>angle 12 again, the direction indicated by the switch guide arrow 36021 is from right to left, and so on.

[0437] In addition, when switching to panoramic mode, if angle 11≤θ≤angle 12, guide arrow 12021 can indicate the default direction from left to right, and after changing from angle 11≤θ≤angle 12 to θ>angle 12, the mobile phone can switch the direction indicated by guide arrow 36021 to from right to left. Subsequently, if it changes from θ>angle 12 to θ<angle 11, the direction indicated by guide arrow 36021 is switched to from left to right. If it changes again from θ<angle 11 to θ>angle 12, the direction indicated by guide arrow 36021 is switched to from right to left, and so on.

[0438] This article mainly explains the situation when β is less than angle 11 or β is greater than angle 12 when switching to panoramic mode.

[0439] In this way, the mobile phone can make the direction indicated by the guide arrow 36021 from left to right when θ does not reach half of 360° (such as less than angle 11), thereby starting from less than 180° and taking pictures while rotating in a clockwise direction greater than 180°; and the mobile phone can make the direction indicated by the guide arrow 36021 from right to left when θ reaches half of 360° (such as greater than angle 12), thereby starting from greater than 180° and taking pictures while rotating counterclockwise to less than 180°.

[0440] In another specific implementation, on the one hand, the mobile phone can adjust the direction indicated by the guide arrow 36021 around θ=180° according to angles 11 and 12 shown in FIG29 . On the other hand, the mobile phone can further adjust the direction indicated by the guide arrow 36021 between [0°, 180°] according to angles 5 and 6 shown in FIG29 , and between [180°, 360°] according to angles 13 and 14 shown in FIG29 .

[0441] Specifically, the phone can determine the user's shooting intent based on γ and δ. These shooting intents include the following: shooting between [0°, 360°]; shooting between [0°, 180°]; and shooting between [180°, 360°]. After determining the shooting intent, the phone can adjust the direction indicated by guide arrow 36021 using an angle threshold that matches the shooting intent.

[0442] If the shooting intention is to shoot between [0°, 360°], the angle thresholds are angles 11 and 12 in Figure 29. If the shooting intention is to shoot between [0°, 180°], the angle thresholds are angles 5 and 6 in Figure 29. If the shooting intention is to shoot between [180°, 360°], the angle thresholds are angles 13 and 14 in Figure 29.

[0443] The embodiment of the present application exemplifies the specific implementation of a mobile phone determining a user's shooting intention based on γ and δ:

[0444] Considering that γ=0°, as shown in the state of γ=0° in Figure 21C, as δ changes between [0°, 180°], shooting at [0°, 180°] can be achieved. Therefore, the mobile phone can determine that the shooting intention is to shoot between [0°, 180°] when γ is close to 0° (such as γ<5°) and δ can reach a larger value (such as δ>10°).

[0445] Also, considering that δ=0°, as shown in the state of δ=0° in Figure 21C, as γ changes between [0°, 180°], shooting at [180°, 360°] can be achieved. Therefore, the mobile phone can determine that the shooting intention is to shoot between [180°, 360°] when δ is close to 0° (such as δ<5°) and γ can reach a larger value (such as γ>10°).

[0446] In addition to the above two cases, the mobile phone can determine that the shooting intention is to shoot between [0°, 360°].

[0447] Of course, the mobile phone can also determine the user's shooting intention based solely on whether γ and δ are close to 0°. The embodiments of the present application do not specifically limit this. For example, if γ is less than 5°, the mobile phone can determine that the shooting intention is to shoot between [0°, 180°]; if δ is less than 5°, the mobile phone can determine that the shooting intention is to shoot between [180°, 360°]; in addition, the mobile phone can determine that the shooting intention is to shoot between [0°, 360°].

[0448] It is understood that the mobile phone can determine the user's shooting intention based on γ and δ when switching to panoramic mode. On this basis, the mobile phone can also update the user's shooting intention based on γ and δ after switching to panoramic mode. In other words, the shooting intention can change after entering panoramic mode.

[0449] For example, when switching to panoramic mode, the phone determines that the shooting intention is to shoot between [0°, 360°]. After switching to panoramic mode, if δ < 5° and γ > 10° are satisfied, the shooting intention can be updated to shoot between [180°, 360°]. If γ < 5° and δ > 10° are satisfied, the shooting intention can be updated to shoot between [0°, 180°].

[0450] The following describes how the mobile phone uses the matching angle threshold to adjust the direction indicated by the guide arrow 36021, taking angle 5 as 87°, angle 6 as 93°, angle 13 as 267°, angle 14 as 273°, angle 11 as 177°, and angle 12 as 183°, for different shooting intentions:

[0451] The first shooting intention is to shoot between [0°, 180°].

[0452] When shooting between [0°, 180°], if θ < angle 5, it indicates that the user wants to shoot clockwise within [0°, 180°], and the direction indicated by the guide arrow 36021 can be from left to right. If θ > angle 6, it indicates that the user wants to shoot counterclockwise within [0°, 180°], and the direction indicated by the guide arrow 36021 can be from right to left. If θ < angle 5 changes to θ > angle 6, it indicates that the user wants to switch to shooting counterclockwise within [0°, 180°], and the direction indicated by the guide arrow 36021 can be switched to from right to left; if θ > angle 6 changes to θ < angle 5, it indicates that the user wants to switch to shooting clockwise within [0°, 180°], and the direction indicated by the guide arrow 36021 can be from left to right.

[0453] Referring to Figure 30A, the mobile phone determines the first shooting intention at time t0. At this time, θ=0°, satisfying θ<angle 5, and the mobile phone can display the direction indicated by the guide arrow 36021 as from left to right (abbreviated as LR in the figure); subsequently, θ changes from 0° at time t0 to 95° at time t1, satisfying the change from θ<angle 5 to θ>angle 6, and the mobile phone can switch the direction indicated by the guide arrow 36021 to from right to left (abbreviated as RL in the figure); subsequently, θ changes from 95° at time t1 to 85° at time t2, satisfying the change from θ>angle 6 to θ<angle 5, and the mobile phone can switch the direction indicated by the guide arrow 36021 to from left to right, and so on.

[0454] Referring to Figure 30B, the mobile phone determines the first shooting intention at time t0, at which time θ=180°, satisfying θ>angle 6, and the direction indicated by the guide arrow 36021 is from right to left; subsequently, θ changes from 180° at time t0 to 85° at time t1, satisfying the change from θ>angle 6 to θ<angle 5, and the mobile phone can switch the direction indicated by the guide arrow 36021 to from left to right; subsequently, θ changes from 85° at time t1 to 95° at time t2, satisfying the change from θ<angle 5 to θ>angle 6, and the mobile phone can switch the direction indicated by the guide arrow 36021 to from right to left, and so on.

[0455] Referring to FIG30C , the phone determines the first shooting intention at time t0. At this point, θ = 90°, meaning θ is neither less than angle 5 nor greater than angle 6, but satisfies angle 5 ≤ θ ≤ angle 6. Guide arrow 36021 can indicate a default left-to-right direction. After θ changes from 90° at time t0 to 95° at time t3, θ > angle 6 is satisfied, and the phone can switch the direction indicated by guide arrow 36021 to right-to-left. Subsequently, the phone can adjust the direction indicated by guide arrow 36021 in the same manner as described above for times t1 and t2 in FIG30B . That is, if θ > angle 6 to θ < angle 5, the phone can switch the direction indicated by guide arrow 36021 to left-to-right; if θ < angle 5 to θ > angle 6, the phone can switch the direction indicated by guide arrow 36021 to right-to-left, and so on.

[0456] The second shooting intention is to shoot between [180°, 360°].

[0457] When shooting between [180°, 360°], if θ < angle 13, it indicates that the user wants to shoot clockwise within [180°, 360°], and the direction indicated by the guide arrow 36021 can be from left to right. If θ > angle 14, it indicates that the user wants to shoot counterclockwise within [180°, 360°], and the direction indicated by the guide arrow 36021 can be from right to left. If θ changes from θ < angle 13 to θ > angle 14, it indicates that the user wants to switch to shooting counterclockwise within [180°, 360°], and the direction indicated by the guide arrow 36021 can be switched to from right to left; if θ changes from θ > angle 14 to θ < angle 13, it indicates that the user wants to switch to shooting clockwise within [180°, 360°], and the direction indicated by the guide arrow 36021 can be from left to right.

[0458] Referring to Figure 31A, the mobile phone determines the second shooting intention at time t4. At this time, θ=180°, satisfying θ<angle 13, and the mobile phone can display the direction indicated by the guide arrow 36021 as from left to right (abbreviated as LR in the figure); subsequently, θ changes from 0° at time t4 to 275° at time t5, satisfying the change from θ<angle 13 to θ>angle 14, and the mobile phone can switch the direction indicated by the guide arrow 36021 to from right to left (abbreviated as RL in the figure); subsequently, θ changes from 275° at time t5 to 265° at time t6, satisfying the change from θ>angle 14 to θ<angle 13, and the mobile phone can switch the direction indicated by the guide arrow 36021 to from left to right, and so on.

[0459] Referring to Figure 31B, the mobile phone determines the second shooting intention at time t4, at this time θ = 360°, satisfying θ>angle 14, and the direction indicated by the guide arrow 36021 is from right to left; subsequently, θ changes from 360° at time t4 to 265° at time t5, satisfying the change from θ>angle 14 to θ<angle 13, and the mobile phone can switch the direction indicated by the guide arrow 36021 to from left to right; subsequently, θ changes from 260° at time t5 to 275° at time t6, satisfying the change from θ<angle 13 to θ>angle 14, and the mobile phone can switch the direction indicated by the guide arrow 36021 to from right to left, and so on.

[0460] Referring to FIG31C , the phone determines the second shooting intention at time t4. At this point, θ = 270°, meaning θ is neither less than angle 13 nor greater than angle 14, but satisfies angle 13 ≤ θ ≤ angle 14. Guide arrow 36021 can indicate a default left-to-right direction. After θ changes from 270° at time t4 to 275° at time t7, θ > angle 14 is satisfied, and the phone can switch the direction indicated by guide arrow 36021 to right-to-left. Subsequently, the phone can adjust the direction indicated by guide arrow 36021 in the same manner as described above for times t5 and t6 in FIG31B . Specifically, if θ > angle 14 to θ < angle 13, the phone can switch the direction indicated by guide arrow 36021 to left-to-right; if θ < angle 13 to θ > angle 14, the phone can switch the direction indicated by guide arrow 36021 to right-to-left, and so on.

[0461] The third shooting intention is to shoot between [0°, 360°].

[0462] When shooting between [0°, 360°], if θ < angle 11, it indicates that the user wants to shoot clockwise within [0°, 360°], and the direction indicated by the guide arrow 36021 can be from left to right. If θ > angle 12, it indicates that the user wants to shoot counterclockwise within [0°, 360°], and the direction indicated by the guide arrow 36021 can be from right to left. If θ changes from θ < angle 11 to θ > angle 12, it indicates that the user wants to switch to shooting counterclockwise within [0°, 360°], and the direction indicated by the guide arrow 36021 can be switched to from right to left; if θ changes from θ > angle 12 to θ < angle 11, it indicates that the user wants to switch to shooting clockwise within [0°, 360°], and the direction indicated by the guide arrow 36021 can be from left to right.

[0463] Referring to Figure 32A, the mobile phone determines the third shooting intention at time t8. At this time, θ=0°, satisfying θ<angle 11, and the mobile phone can display the direction indicated by the guide arrow 36021 as from left to right (abbreviated as LR in the figure); subsequently, θ changes from 0° at time t8 to 185° at time t9, satisfying the change from θ<angle 11 to θ>angle 12, and the mobile phone can switch the direction indicated by the guide arrow 36021 to from right to left (abbreviated as RL in the figure); subsequently, θ changes from 185° at time t9 to 175° at time t10, satisfying the change from θ>angle 12 to θ<angle 11, and the mobile phone can switch the direction indicated by the guide arrow 36021 to from left to right, and so on.

[0464] Referring to Figure 32B, the mobile phone determines the third shooting intention at time t8, at this time θ=360°, satisfying θ>angle 12, and the direction indicated by the guide arrow 36021 is from right to left; subsequently, θ changes from 360° at time t8 to 175° at time t9, satisfying the change from θ>angle 12 to θ<angle 11, and the mobile phone can switch the direction indicated by the guide arrow 36021 to from left to right; subsequently, θ changes from 175° at time t9 to 185° at time t10, satisfying the change from θ<angle 11 to θ>angle 12, and the mobile phone can switch the direction indicated by the guide arrow 36021 to from right to left, and so on.

[0465] Referring to FIG32C , the phone determines the third shooting intention at time t8. At this point, θ = 180°, meaning θ is neither less than angle 11 nor greater than angle 12, but satisfies angle 11 ≤ θ ≤ angle 12. Guide arrow 36021 can indicate a default left-to-right direction. After θ changes from 180° at time t8 to 185° at time t11, θ > angle 12 is satisfied, and the phone can switch the direction indicated by guide arrow 36021 to right-to-left. Subsequently, the phone can adjust the direction indicated by guide arrow 36021 in the same manner as described above for times t9 and t10 in FIG32B . Specifically, if θ > angle 12 becomes θ < angle 11, the phone can switch the direction indicated by guide arrow 36021 to left-to-right; if θ < angle 11 becomes θ > angle 12, the phone can switch the direction indicated by guide arrow 36021 to right-to-left, and so on.

[0466] During the shooting phase, the phone does not switch the direction indicated by guide arrow 36021, but instead remains locked to the direction indicated by guide arrow 36021 in the frame before shooting began. Subsequently, when exiting the shooting phase to the preview phase, the phone can continue to dynamically adjust the direction indicated by guide arrow 36021 based on θ.

[0467] Similarly, the aforementioned embodiment of manually adjusting the direction indicated by guide arrow 36021 and the embodiment of dynamically adjusting the direction indicated by guide arrow 36021 based on θ can be combined. After the user manually adjusts the direction indicated by guide arrow 36021, the phone will automatically adjust the direction indicated by guide arrow 36021 only after a switching condition is met. Furthermore, the aforementioned embodiment of turning on or off rear mirroring and the embodiment of adjusting the direction indicated by guide arrow 36021 can also be combined.

[0468] Function 4

[0469] After entering the rotation shooting mode, the user can adjust the framing range of the rear camera 403 by folding or unfolding the folding screen 401. After adjusting to the appropriate framing range, the user can perform a shooting operation, such as clicking the shooting button in the preview interface. In response to the shooting operation, the mobile phone can capture an image. For more information about this part, please refer to the relevant part of the description in the first form, which will not be repeated here.

[0470] Function 5

[0471] After entering the rotation shooting mode, in response to the operation of exiting the rotation shooting mode, the mobile phone can exit the rotation shooting mode and enter the normal shooting mode. In response to the operation of exiting the rotation shooting mode, the mobile phone can use at least one of the folding screens 401 to display the normal shooting interface based on the device posture, instead of always displaying the user interface on the third screen 4013. For the content of the operation of exiting the rotation shooting mode, please refer to the relevant part of the description in the first form, which will not be repeated here.

[0472] Function 6

[0473] After entering the rotation shooting mode, such as after the shooting is completed, in response to the operation of exiting the camera application from the foreground, the mobile phone can exit the camera application running in the foreground. Similar to the external screen 202 in form one: in form three, the third screen 4013 can also be used independently to view, edit, and share the shooting results. Therefore, in form three, in response to the operation of exiting the camera application from the foreground, the mobile phone can continue to display the user interface on the third screen 4013, such as the desktop and gallery interface.

[0474] For example, the phone is in the device posture consistent with the foldable screen 401 shown in FIG33 , that is, the user interface should be displayed on the foldable screen 401. The operation of withdrawing the camera application from the foreground can be an upward swipe operation (as indicated by the arrow) from the bottom of the preview interface 4201 displayed on the third screen 4013 shown in FIG33 . However, in response to the upward swipe operation from the bottom of the preview interface 4201, the phone still displays the user interface on the third screen 4013, such as displaying the desktop 4202 shown in FIG33 .

[0475] Regarding the parts that are not described in detail in the content of responding to the operation of exiting the rotation shooting or the operation of exiting the camera application from the foreground, you can also refer to the description of the relevant parts in form one, such as Figures 17 and 18 and their related context descriptions, which will not be repeated here.

[0476] The embodiment of the above-mentioned form three is further described below in conjunction with Figure 34. Taking the case where angle 5 is 87°, angle 6 is 93°, angle 13 is 267°, angle 14 is 273°, angle 11 is 177°, angle 12 is 183°, and the mobile phone adjusts the direction indicated by the guide arrow 32021 according to the shooting intention as an example, as shown in Figure 34, in a specific implementation, the rotation shooting of the mobile phone in form three (i.e., the mobile phone with a foldable screen 401) includes:

[0477] S4301, enter rotation shooting.

[0478] S4302. Check whether only the third screen 4013 is on; if so, execute the following S4305; if not, execute the following S4303.

[0479] Among them, only the third screen 4013 is on means that the third screen 4013 is on, and the first screen 4011 and the second screen 4012 are both off.

[0480] S4303. Display switching prompt.

[0481] For example, the mobile phone may prompt "about to switch to the third screen 4013 display, enter the rotation shooting".

[0482] S4304: After the prompt duration reaches the preset duration, only the third screen 4013 is controlled to light up, and a preview interface of the rotation shooting is displayed on the third screen 4013.

[0483] S4305. Record identification a.

[0484] S4306: When the device posture is updated, the device posture is updated but the screen is not switched.

[0485] S4307. Check whether it is panoramic mode; if so, execute S4308; if not, execute S4318.

[0486] For the specific implementation of the above S4301-S4307, please refer to the description of S2001-S2007 in the previous text, which will not be repeated here.

[0487] S4308: Check whether it is in the preview phase. If so, execute S4309; if not, execute S4316.

[0488] In panorama mode, the phone performs different processing during the preview phase and the capture phase. For example, during the preview phase, the phone can turn on or off the rear mirror and adjust the direction of the guide arrow; during the capture phase, the phone can adjust the position of the guide arrow and calculate the panoramic photo.

[0489] S4309. Obtain γ and δ, and calculate θ.

[0490] It is understandable that as the user moves the phone, the relative position of the first screen 3011 and the second screen 3012 will change, and γ will change accordingly; the relative position of the second screen 3012 and the third screen 3013 will change, and δ will change accordingly. Therefore, during the preview phase, the phone can continuously execute S4309 to obtain real-time γ and δ, and calculate θ using the orientation formula. Subsequently, the phone can dynamically turn on or off the rear mirror and switch the direction indicated by the guide arrow.

[0491] It should be noted that when entering the preview phase, if θ is in the range of [0°, 87°) and (273°, 360°], the phone turns on the rear mirror; when entering the preview phase, if θ is in the range of (93°, 267°), the phone turns off the rear mirror. Subsequently, the phone can dynamically turn on or off the rear mirror based on θ.

[0492] S4310: If the angle changes from 93°<θ<267° to θ<87° or θ>273°, the rear mirror is enabled.

[0493] In this way, the mobile phone can turn on the rear mirror when the rear camera 403 is tilted towards itself. For details, please refer to the above description of Figures 25 and 26 and their related context, which will not be repeated here.

[0494] S4311. If the angle changes from θ<87° or θ>273° to 93°<θ<267°, the rear mirror image is turned off.

[0495] In this way, the mobile phone can turn off the rear mirror when the rear camera 403 is tilted towards the scene in front of it. For details, please refer to the above description of Figures 25 and 26 and their related contexts, which will not be repeated here.

[0496] S4312: Detect shooting intention.

[0497] S4313. If the shooting intention is to shoot at [0°, 180°], then: if the angle changes from θ<87° to θ>93°, the direction indicated by the guide arrow is switched from right to left; if the angle changes from θ>93° to θ<87°, the direction indicated by the guide arrow is switched from right to left.

[0498] Thus, when the user wants to shoot clockwise within [0°, 180°], the guide arrow can indicate from left to right; when the user wants to shoot counterclockwise within [0°, 180°], the guide arrow can indicate from right to left. For details, please refer to the relevant descriptions of Figures 30A-30C above, which will not be repeated here.

[0499] S4314. If the shooting intention is to shoot at [180°, 360°], then: if the angle changes from θ<267° to θ>273°, the direction indicated by the guide arrow is switched from right to left; if the angle changes from θ>273° to θ<267°, the direction indicated by the guide arrow is switched from right to left.

[0500] Thus, when the user wants to shoot clockwise within [180°, 360°], the guide arrow can indicate from left to right; when the user wants to shoot counterclockwise within [180°, 360°], the guide arrow can indicate from right to left. For details, please refer to the relevant descriptions of Figures 31A-31C above, which will not be repeated here.

[0501] S4315. If the shooting intention is to shoot at [0°, 360°], then: if the angle changes from θ < 177° to θ > 183°, the direction indicated by the guide arrow is switched from right to left; if the angle changes from θ > 183° to θ < 177°, the direction indicated by the guide arrow is switched from right to left.

[0502] Thus, when the user wants to shoot clockwise within [0°, 360°], the guide arrow can indicate from left to right; when the user wants to shoot counterclockwise within [0°, 360°], the guide arrow can indicate from right to left. For details, please refer to the relevant descriptions of Figures 32A-32C above, which will not be repeated here.

[0503] S4316. Adjust the position of the guide arrow based on the user's movement.

[0504] At this point, it should be noted that if the user is not satisfied with the direction indicated by the guide arrow after automatic switching, the user can further adjust the direction indicated by the guide arrow manually, which will not be described in detail here.

[0505] S4317. Take a panoramic photo.

[0506] Regarding the above S4316-S4317, please refer to the previous description of S2016-S2017 for details, which will not be repeated here.

[0507] S4318: Check whether it is in the preview phase. If so, execute S4319; if not, execute S4324.

[0508] In other modes besides Panorama, such as Photo Mode and Video Mode, the phone performs different processing during the preview phase and the shooting phase. For example, during the preview phase, the phone can dynamically turn on or off the rear mirror; during the shooting phase, the phone can complete the shooting.

[0509] S4319. Obtain γ and δ, and calculate θ.

[0510] S4320: If the angle changes from 93°<θ<267° to θ<87° or θ>273°, the rear mirroring is enabled.

[0511] S4321. If the angle changes from θ<87° or θ>273° to 93°<θ<267°, the rear mirror image is turned off.

[0512] Regarding the above S4319-S4323, please refer to the description of the corresponding steps in the previous S4309-S43112 for details, which will not be repeated here.

[0513] S4324, shoot.

[0514] At this point, it should be noted that the execution order of the above-mentioned S4307-S4324 is not limited to Figure 34. For example, the mobile phone may first adjust the direction indicated by the guide arrow, and then switch the state of the rear mirror, such as first executing S4312-S4315, and then executing S4310-S4311. For another example, the mobile phone may first detect whether it is in the preview phase. If it is detected in the preview phase, the mobile phone turns the rear mirror on or off based on θ; then further detect whether it is in panoramic mode. If it is panoramic mode, the direction indicated by the guide arrow is further adjusted. If it is not panoramic mode, there is no need to adjust the direction indicated by the guide arrow; if it is not preview mode, further detect whether it is in panoramic mode. If it is panoramic mode, execute S4316-S4317. If it is not panoramic mode, execute S4324.

[0515] Furthermore, steps S4307-S4324 are not always required. For example, the phone may not adjust the direction indicated by the guide arrow, i.e., steps S4312-S4314 may be omitted; or the phone may not switch the rear mirror image, i.e., steps S4310-S4311 and S4320-S4321 may be omitted.

[0516] After entering the rotation shooting, before starting shooting or after finishing shooting, the user may exit the rotation shooting or switch the camera application to the background. Accordingly, the mobile phone can respond through the following S4325 and subsequent steps.

[0517] It should be noted that in Figure 34, S4325 and its subsequent steps are located after the shooting is completed, such as after S4317 and S4324. In practice, S4325 and its subsequent steps can be triggered and executed at any time after entering the rotation shooting.

[0518] S4325: Detect whether an operation to exit rotation shooting is received. If yes, execute S4329; if no, execute S4326.

[0519] S4326. Detect whether an operation to exit the camera application from the foreground is received; if so, execute S4327; if not, repeat S4306-S4326.

[0520] It should be noted that the execution order of S4325-S4326 is not limited to that shown in Figure 34. For example, the mobile phone may first execute S4326, and only execute S4325 if it detects that no operation to exit the camera application from the foreground has been received.

[0521] S4327. Continue to display the user interface on the third screen 4013.

[0522] S4328: Check whether the device posture has changed. If so, execute S4329; if not, repeat S4327.

[0523] S4329. Clear identification a.

[0524] After clearing the flag a, the mobile phone no longer executes the relevant responses of the rotation shooting, for example, no longer executes S4306-S2628.

[0525] S4330: Check whether the device posture is consistent with the third screen 4013 being on. If so, execute S4331; if not, execute S4332.

[0526] S4331. Display the user interface on the third screen 4013.

[0527] S4332. Switch to the corresponding screen of the folding screen 401 to display the user interface.

[0528] Regarding the above-mentioned S4325-S4332, please refer to the previous description of Figure 34 and its related context, which will not be repeated here.

[0529] In addition, the mobile phone may not distinguish between the operation of exiting the rotation shooting and the operation of exiting the camera application, but executes S4329-S4332 after receiving the operation of exiting the rotation shooting or the operation of exiting the camera application. This embodiment of the application does not make specific limitations on this.

[0530] An embodiment of the present application further provides an electronic device, which may include: a display screen, a memory, and one or more processors (such as a CPU, GPU, NPU, etc.). The display screen, the memory, and the processor are coupled. The memory is used to store computer program code, which includes computer instructions. When the processor executes the computer instructions, the electronic device can perform the various functions or steps performed by the device in the above method embodiment.

[0531] An embodiment of the present application further provides a chip system, which includes at least one processor and at least one interface circuit. The processor and the interface circuit can be interconnected via lines. For example, the interface circuit can be used to receive signals from other devices (such as a memory of an electronic device). For another example, the interface circuit can be used to send signals to other devices (such as a processor). Exemplarily, the interface circuit can read instructions stored in the memory and send the instructions to the processor. When the instructions are executed by the processor, the electronic device can perform the various steps in the above embodiments. Of course, the chip system can also include other discrete devices, which is not specifically limited in the embodiment of the present application.

[0532] This embodiment further provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the image processing method in the above-mentioned embodiment.

[0533] This embodiment further provides a computer program product. When the computer program product is run on a computer, it enables the computer to execute the above-mentioned related steps to implement the image processing method in the above-mentioned embodiment.

[0534] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory to enable the chip to execute the image processing method in the above-mentioned method embodiments.

[0535] Among them, the electronic device, computer storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0536] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0537] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0538] The units described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0539] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0540] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0541] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application and are not intended to limit the present application. Although the present application has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present application may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present application.

Claims

1. A shooting method, characterized in that: Applied to an electronic device, the electronic device comprises a display screen and a rear camera, the display screen comprises a first sub-screen, a second sub-screen and a third sub-screen, the first sub-screen, the second sub-screen and the third sub-screen are three different display areas of the display screen; When the display screen is in an unfolded state, the second sub-screen is located between the first sub-screen and the third sub-screen; when the display screen is in a folded state, the display directions of the first sub-screen and the second sub-screen are opposite to each other, and the display directions of the second sub-screen and the third sub-screen are opposite to each other; The rear camera is arranged on the back of the third sub-screen, and the method comprises: Receiving a first operation from a user; In response to the first operation, a camera application in the electronic device is started, and a first interface is displayed on at least one sub-screen of the display screen, wherein the first interface includes a first viewfinder screen and a first control; receiving a second operation of the user on the first control; In response to the second operation, displaying a second interface on the first sub-screen, wherein the second interface includes a second viewfinder image and a rotation shooting mark; When a first angle between the first sub-screen and the second sub-screen changes and / or a second angle between the second sub-screen and the third sub-screen changes, the second interface is displayed on the first sub-screen; receiving a shooting operation of the user; In response to the shooting operation, an image is shot by the rear camera.

2. The method according to claim 1, characterized in that The step of displaying a second interface on the first sub-screen in response to the second operation includes: In response to the second operation, when the orientation angle is less than the first angle or greater than the fourth angle, a second interface in which the second viewfinder image is a mirror image is displayed on the first sub-screen; when the orientation angle is greater than the second angle and less than the third angle, a second interface in which the second viewfinder image is a non-mirror image is displayed on the first sub-screen; Among them, the orientation angle includes the lens direction of the rear camera, the first angle and the second angle are greater than 0° and less than 180°, and the first angle is smaller than the second angle; the third angle and the fourth angle are greater than 180° and less than 360°, and the third angle is smaller than the fourth angle.

3. The method according to claim 2, characterized in that The method further comprises: Determining the orientation angle based on the first angle and the second angle; When a first angle between the first sub-screen and the second sub-screen changes and / or a second angle between the second sub-screen and the third sub-screen changes, the second interface is kept displayed on the first sub-screen, comprising: In response to the orientation angle changing from less than the first angle or greater than the fourth angle to greater than the second angle and less than the third angle, switching the second viewfinder image in the second interface to a non-mirror image; In response to the orientation angle changing from being greater than the second angle and less than the third angle to being less than the first angle or greater than the fourth angle, the second viewfinder screen in the second interface is switched to a mirror screen.

4. The method according to claim 2 or 3, characterized in that: The method further comprises: During the process of shooting an image through the rear camera, displaying a third interface, wherein the third interface includes a third viewfinder image being shot; In which, in response to the shooting operation, the second viewfinder in the second interface is a mirror image. In the embodiment, as the orientation angle changes, the third framing screen is a mirror image; in the case where the second framing screen in the second interface is a non-mirror image in response to the shooting operation, as the orientation angle changes, the third framing screen is a non-mirror image.

5. The method according to any one of claims 1 to 4, characterized in that After displaying the second interface on the first sub-screen, the method further includes: receiving a third operation of the user; In response to the third operation, switching to the panoramic mode, displaying a fourth interface in the first sub-screen based on the orientation angle, wherein the fourth interface includes the first guide arrow or the second guide arrow; The orientation angle includes the lens direction of the rear camera, the first guide arrow indicates a first direction, and the second guide arrow indicates a second direction.

6. The method according to claim 5, characterized in that The displaying of the fourth interface based on the orientation angle of the rear camera includes: When the orientation angle is smaller than the fifth angle, displaying a fourth interface including a first guide arrow in the first sub-screen; When the orientation angle is greater than a sixth angle, displaying a fourth interface including a second guide arrow in the first sub-screen; Among them, the fifth angle is greater than 90° and less than 180°, and the sixth angle is greater than 180° and less than 270°.

7. The method according to claim 6, characterized in that After displaying the fourth interface including the first guide arrow in the first sub-screen, or after displaying the fourth interface including the second guide arrow in the first sub-screen, the method further includes: In response to the orientation angle changing from less than the fifth angle to greater than the sixth angle, switching the first guide arrow to the second guide arrow; In response to the orientation angle changing from being greater than the sixth angle to being less than the fifth angle, the second guide arrow is switched to the first guide arrow.

8. The method according to claim 5, characterized in that The displaying of the fourth interface based on the current orientation angle includes: When the second included angle is smaller than the seventh angle and the orientation angle is smaller than the eighth angle, displaying a fourth interface including a first guide arrow in the first sub-screen; When the second included angle is smaller than the seventh angle and the orientation angle is larger than the ninth angle, displaying a fourth interface including a second guide arrow in the first sub-screen; The eighth angle and the ninth angle are greater than 0° and less than 180°, and the eighth angle is smaller than the ninth angle.

9. The method according to claim 5, characterized in that The displaying of the fourth interface based on the current orientation angle includes: When the first included angle is smaller than the seventh angle and the orientation angle is smaller than the tenth angle, displaying a fourth interface including a first guide arrow in the first sub-screen; When the first included angle is smaller than the seventh angle and the orientation angle is larger than the eleventh angle, displaying a fourth interface including a second guide arrow in the first sub-screen; Wherein, the tenth angle and the eleventh angle are greater than 180° and less than 360°, and the tenth angle is less than The eleventh angle.

10. The method according to claim 5, characterized in that The displaying of the fourth interface based on the current orientation angle includes: When the first angle and the second angle are both greater than or equal to the seventh angle, and the orientation angle is less than the fifth angle, displaying a fourth interface including a first guide arrow in the first sub-screen; When the first included angle and the second included angle are both greater than or equal to the seventh angle, and the orientation angle is greater than the sixth angle, displaying a fourth interface including a second guide arrow in the first sub-screen; Among them, the fifth angle is greater than 90° and less than 180°, and the sixth angle is greater than 180° and less than 270°.

11. The method according to any one of claims 8 to 10, characterized in that: The method further comprises: In response to the second angle changing from being greater than or equal to the seventh angle to being less than the seventh angle, switching the guide arrow in the fourth interface using the eighth angle and the ninth angle; In response to the first angle changing from being greater than or equal to the seventh angle to being less than the seventh angle, switching the guide arrow in the fourth interface using a tenth angle and an eleventh angle; In response to the first angle and the second angle both changing to be greater than or equal to the seventh angle, the guide arrow in the fourth interface is switched using the fifth angle and the sixth angle.

12. The method according to any one of claims 5 to 11, characterized in that: The fourth interface includes a direction switching control; After displaying a fourth interface including a first guide arrow in the first sub-screen, the method further includes: In response to a fourth operation on the direction switching control, switching the first guide arrow to the second guide arrow; After displaying a fourth interface including a second guide arrow in the first sub-screen, the method further includes: In response to a fourth operation on the direction switching control, the second guide arrow is switched to the first guide arrow.

13. The method according to any one of claims 5 to 12, characterized in that: In response to the shooting operation, shooting an image by the rear camera includes: In response to a shooting operation in the fourth interface, shooting a panoramic photo through the rear camera; In the process of taking a panoramic photo, as the orientation angle changes, the guide arrow in the fourth interface is the same as the guide arrow in the fourth preview interface in response to the shooting operation.

14. The method according to any one of claims 1 to 13, characterized in that After the first sub-screen displays the second interface, the method further includes: In response to the operation of exiting the camera application to run in the background, a fifth interface is displayed on the first sub-screen.

15. The method according to claim 14, characterized in that After the first sub-screen displays the fifth interface, the method further includes: In response to an update of a device posture of the electronic device, the fifth interface is displayed on the at least one sub-screen based on a current device posture, wherein the device posture is related to the first angle and the second angle.

16. The method according to claim 15, characterized in that The method further comprises: Before the device posture is updated, in response to an operation of bringing the camera application from the background to the foreground, displaying the second interface on the first sub-screen; After the device posture is updated, in response to the operation of bringing the camera application from the background to the foreground, based on The current device posture displays the first interface on the at least one sub-screen.

17. The method according to any one of claims 1 to 16, characterized in that After displaying the second interface on the first sub-screen, the method further includes: receiving a fifth operation of the user on the identification of the rotation shooting; In response to the fifth operation, the first interface is displayed in the at least one sub-screen based on a current device posture of the electronic device, where the device posture is related to the first angle and the second angle.

18. The method according to any one of claims 1 to 17, characterized in that The first control is a switching control for the front and rear cameras, and the second operation includes a sliding operation upward from the first control and a clicking operation on the second control. The second control is displayed in response to the sliding operation upward on the first control.

19. An electronic device, characterized in that: include: a display, a rear camera, one or more processors, and one or more memories; The one or more processors are coupled to the display screen, the rear camera, and the one or more memories; the one or more memories are used to store computer program codes, and the computer program codes include computer instructions. When the one or more processors execute the computer instructions, the electronic device executes the method described in any one of claims 1-18.

20. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the electronic device is caused to execute the method as claimed in any one of claims 1 to 18.

Images