Shooting interface display method and electronic equipment

Abstract

The invention provides a shooting interface display method and electronic equipment, and relates to the technical field of terminals. The electronic device is a folding screen device, after the first operation input by the user is received, it is indicated that the folding screen device needs to enter the rear selfie state, and the folding screen device can be switched to an auxiliary screen for display, that is, the auxiliary screen displays a shooting interface. Afterwards, under the condition that the folding screen equipment is overturned (namely inclined), the control in the shooting interface displayed by the auxiliary screen can be inclined according to the overturning direction, so that the inclination direction in the shooting interface displayed by the auxiliary screen is consistent with the inclination direction of the folding screen equipment, and different display effects of the control in the shooting interface are realized; diversity of display modes is guaranteed, fixed display of the shooting interface is avoided, interestingness is enhanced, and use is facilitated for users.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a shooting interface display method and electronic device. Background Art

[0002] As foldable screen technology matures, more and more users are using foldable screen devices (such as foldable screen mobile phones). Users often use foldable screen mobile phones to shoot, such as taking photos, recording videos, etc. In the shooting scene, the foldable screen mobile phone will display the shooting interface, which includes controls such as settings, gallery, flash, etc. During the use of foldable screen devices, how to achieve the diversity of display methods of controls on the shooting interface has become an urgent problem to be solved. Summary of the invention

[0003] In view of this, the present application provides a shooting interface display method and an electronic device, which are used to realize the rotation of controls in the shooting interface in a rear-mounted selfie scene, thereby ensuring the diversity of control display effects and thus ensuring the diversity of shooting interface display effects.

[0004] In the first aspect, the present application provides a shooting interface display method, which is applied to a folding screen device. The first screen (such as a secondary screen) of the folding screen device displays a first shooting interface, and the first screen and the rear camera of the folding screen device are on the same surface. The first shooting interface includes a target control, and the target control (or preset control) is used to trigger the folding screen device to perform a corresponding action. The first screen and the second screen (such as the main screen) are back to back and face different sides.

[0005] When the folding screen device is flipped, the first screen displays the second shooting interface. The second shooting interface and the first shooting interface include the same controls. The target control in the second shooting interface is rotated relative to the target control in the first shooting interface, and the rotation direction of the target control is consistent with the flipping direction of the folding screen device. The rotation direction of the target control is determined based on the corrected motion data. The motion data is collected by the target motion sensor of the folding screen device.

[0006] Among them, the above-mentioned second shooting interface represents the rotated first shooting interface, that is, the shooting interface including the rotated target control. The second shooting interface has the same controls as the first shooting interface, but because the folding screen device is flipped, the framing screen may be different.

[0007] In the present application, the first screen of the folding screen device displays the first shooting interface, indicating that the folding screen device is in a rear selfie scene. In the case that the folding screen device flips, the folding screen device can use the corrected motion data to determine the flipping direction of the folding screen device (i.e., the first flipping direction), that is, determine the rotation direction of the target control, and accurately determine the flipping direction relative to the orientation (i.e., direction) of the first screen. Afterwards, the folding screen device can rotate the target control on the first shooting interface according to the first flipping direction, so that the rotation direction of the control displayed on the first screen is consistent with the flipping direction of the folding screen device, ensuring the diversity and richness of the control display method, thereby ensuring the richness of the interface display effect and the user's visual experience. Moreover, from the perspective of user use, the rotation direction of the control in the shooting interface is the same as the flipping direction of the folding screen device, which can make the user's line of sight consistent with the display direction of the control, reduce the difficulty of the user to distinguish the control, and facilitate user use.

[0008] In a possible implementation, the target motion sensor may include a gyroscope and / or an acceleration sensor. The gyroscope is used to collect angular velocity data, and the acceleration sensor is used to collect acceleration data.

[0009] In a possible implementation, the direction indicated by the motion data before correction is based on the orientation of the second screen, and the direction indicated by the motion data after correction is based on the orientation of the first screen. The motion data may include motion data in the X direction, motion data in the Y direction, and motion data in the Z direction. Correcting the motion data means inverting the motion data in the X direction and the motion data in the Z direction.

[0010] In the present application, since the first screen and the second screen are inverted front to back and left to right, and the direction indicated by the motion data is based on the orientation (i.e., direction) of the second screen, the direction indicated by the motion data is opposite to that of the first screen. Therefore, the motion data in the X direction and the motion data in the Z direction in the motion data are inverted to achieve correction of the motion data, so that the direction indicated by the corrected motion data is accurate for the first screen.

[0011] In one possible implementation, the folding screen device can determine whether to enter the rear selfie state according to the device state identifier. When the device state identifier is the rear selfie identifier, it indicates that the rear selfie state has been entered, and the folding screen device can correct the motion data to achieve timely correction of the motion data.

[0012] In a possible implementation, the first screen also displays a first control, and the first control (such as exiting the rear selfie control) is used to trigger the folding screen device to exit the rear selfie state. The first control may be located on the first shooting interface or may not be located on the first shooting interface. When the folding screen device is flipped, the first control may also rotate regardless of whether it is on the first shooting interface. That is to say, when the folding screen device is flipped, the controls displayed on the folding screen device may rotate.

[0013] In one possible implementation, the folding method of the folding screen device may be an outward folding method or an inward folding method.

[0014] In a possible implementation, when the folding mode of the folding screen device is an outward folding mode, a side-slide operation input by the user on the first screen is received. When the navigation mode of the folding screen device is a three-button navigation mode, the folding screen mobile phone responds to the side-slide operation, and the second screen of the folding screen device displays a third shooting interface, so that the rear selfie camera can be exited by side-slide in the three-button navigation mode, and a new rear selfie camera exit mode is provided for user convenience.

[0015] In a possible implementation, in order to enable the foldable screen device to support the side-slide exit function and realize the full-screen gesture, the foldable screen device may first destroy the first gesture navigation window on the first screen, the type of the first gesture navigation window is the first type, and the first type is used to prevent the foldable screen device from responding to the user's input operation on the screen part other than the application window on the first screen. The application window is used to display the application interface.

[0016] Afterwards, the folding screen device can create a second gesture navigation window on the first screen. The type of the second gesture navigation window is a target type. The target type is used to enable the folding screen device to respond to operations input by the user on the screen part outside the application window on the first screen, so as to avoid the area for user input gesture operations being limited due to the limited size of the gesture navigation window, affecting user use.

[0017] Afterwards, the foldable screen device can add a slide-out exit logic to the second gesture navigation window. The slide-out exit logic indicates that after a slide-out operation is input in the second gesture navigation window, the foldable screen device responds to exit the post-selfie state.

[0018] In one possible implementation, when the multi-window switch of the foldable screen device is turned on, the foldable screen device can remove the multi-window logic corresponding to the second gesture navigation window. The multi-window logic is used to support the foldable screen device to display the application interfaces of multiple applications at the same time to avoid the multi-window service from affecting the user's use.

[0019] In one possible implementation, when the navigation mode of the folding screen device is gesture navigation, if the multi-window switch of the folding screen device is in the on state, the folding screen device removes the multi-window logic corresponding to the second gesture navigation window. Among them, the second gesture navigation window has corresponding side-slide exit logic. In this application, since the folding screen device originally supports side-slide exit logic under gesture navigation mode, there is no need to add side-slide exit logic to the second gesture navigation window. And considering that in the rear selfie scenario, the possibility of users using multi-window services is low, therefore, in order to avoid the impact of multi-window services on user use, the folding screen device can remove the multi-window logic to improve the user experience.

[0020] In one possible implementation, the first gesture navigation window may include a side navigation window and a bottom navigation window, and the second gesture navigation window may include a side navigation window. Among them, the side navigation window may include a left navigation window and / or a right navigation window. In this application, considering that in the rear selfie scenario, the user is less likely to use the service corresponding to the logic corresponding to the bottom navigation window (such as quick service), therefore, the folding screen device can disable the bottom navigation window, that is, not create the bottom navigation window.

[0021] In a possible implementation, the folding screen device can use the display mode identifier to determine whether to enter the rear selfie state or exit the rear selfie state. When the current display mode identifier is a secondary screen display identifier, and the previous display mode identifier is not a secondary screen display identifier, it indicates that the folding screen device has entered the rear selfie state, and the folding screen device can destroy the first gesture navigation window. Based on this, the rear selfie state of the folding screen device can be accurately and timely determined.

[0022] In one possible implementation, when the current display mode identifier is not the secondary screen display identifier and the previous display mode identifier is the secondary screen display identifier, it indicates that the folding screen device exits the rear selfie state. The folding screen device can destroy the third gesture navigation window on the second screen, that is, the third gesture navigation window corresponding to the third shooting interface. The type of the third gesture navigation window is a target type.

[0023] Afterwards, the folding screen device creates a fourth gesture navigation window on the second screen, that is, a fourth gesture navigation window corresponding to the third shooting interface, and the type of the fourth gesture navigation window is the first type.

[0024] Afterwards, the folding screen device restores the gesture navigation logic corresponding to the fourth gesture navigation window, such as removing the side-slide exit logic corresponding to the fourth gesture navigation window, so that the restored gesture navigation logic corresponding to the fourth gesture navigation window is similar to the gesture navigation logic corresponding to the above-mentioned first gesture navigation window, thereby satisfying the user's needs for using services on the folding screen device in non-rear-mounted selfie scenarios and ensuring normal use by the user.

[0025] In another implementation, the folding screen device can directly process the original gesture navigation window on the secondary screen, that is, the gesture navigation logic corresponding to the first gesture navigation window, such as adding corresponding sideswipe exit logic to the first gesture navigation window.

[0026] Optionally, if the multi-window switch is in an on state, the multi-window logic corresponding to the first gesture navigation window is removed.

[0027] In one implementation, the user may input a first operation on the fourth shooting interface displayed on the second screen. The folding screen device receives the first operation, and in response to the first operation, the folding screen device displays the first shooting interface on the first screen to enter the rear selfie state.

[0028] In a second aspect, the present application provides a shooting interface display method, which is applied to a folding screen device, and the folding method of the folding screen device is an outward folding method.

[0029] Receiving a side-slide operation input by a user on a first screen of a folding screen device; the first screen and a rear camera of the folding screen device are on the same surface;

[0030] When the navigation mode of the folding screen device is a three-button navigation mode, the folding screen mobile phone responds to the side-sliding operation, and the second screen of the folding screen device displays a third shooting interface.

[0031] In a possible implementation, the method further includes:

[0032] The foldable screen device destroys a first gesture navigation window on the first screen, where the type of the first gesture navigation window is a first type, and the first type is used to prevent the foldable screen device from responding to an operation input by a user on a screen portion other than an application window on the first screen; the application window is used to display an application interface;

[0033] The folding screen device creates a second gesture navigation window on the first screen, where the type of the second gesture navigation window is a target type, and the target type is used to enable the folding screen device to respond to an operation input by a user on a screen portion other than an application window on the first screen;

[0034] The folding screen device adds a side-slide exit logic to the second gesture navigation window; wherein the side-slide exit logic indicates that after a side-slide operation is input in the second gesture navigation window, the folding screen device responds to exit the post-selfie state.

[0035] In a possible implementation, the method further includes:

[0036] If the multi-window switch of the folding screen device is in the on state, the folding screen device removes the multi-window logic corresponding to the second gesture navigation window; the multi-window logic is used to support the folding screen device to display the application interfaces of multiple applications at the same time.

[0037] In a possible implementation, the method further includes:

[0038] In the case where the navigation mode of the folding screen device is gesture navigation, if the multi-window switch of the folding screen device is in the on state, the folding screen device removes the multi-window logic corresponding to the second gesture navigation window; wherein the second gesture navigation window has corresponding side-slide exit logic.

[0039] In a possible implementation, the first gesture navigation window includes a side navigation window and a bottom navigation window, and the second gesture navigation window includes a side navigation window.

[0040] In a possible implementation, the folding screen device destroys the first gesture navigation window on the first screen, including:

[0041] When the current display mode identifier is a secondary screen display identifier and the previous display mode identifier is not a secondary screen display identifier, the folding screen device destroys the first gesture navigation window.

[0042] In a possible implementation, the method further includes:

[0043] The folding screen device destroys a third gesture navigation window on the second screen, where the type of the third gesture navigation window is a target type;

[0044] The folding screen device creates a fourth gesture navigation window on the second screen, where the type of the fourth gesture navigation window is the first type;

[0045] The folding screen device removes the slide exit logic corresponding to the fourth gesture navigation window.

[0046] In a possible implementation, the method further includes:

[0047] The folding screen device adds a slide-out exit logic to the first gesture navigation window on the first screen.

[0048] In a possible implementation, the first screen of the folding screen device displays a first shooting interface; the first shooting interface includes a target control;

[0049] When the folding screen device is flipped, the first screen displays a second shooting interface, the second shooting interface and the first shooting interface include the same controls, the target control in the second shooting interface is rotated relative to the target control in the first shooting interface, and the rotation direction of the target control is consistent with the flipping direction of the folding screen device; the rotation direction of the target control is determined based on the corrected motion data; the motion data is collected by the target motion sensor of the folding screen device.

[0050] In a possible implementation, the motion data includes motion data in an X direction, motion data in a Y direction, and motion data in a Z direction; and the correction refers to inverting the motion data in the X direction and the motion data in the Z direction.

[0051] The first screen is back to back with the second screen of the folding screen device; the direction indicated by the motion data before correction is based on the orientation of the second screen, and the direction indicated by the motion data after correction is based on the orientation of the first screen.

[0052] In a possible implementation, the method further includes:

[0053] When the device status identifier is a rear selfie identifier, the folding screen device corrects the motion data.

[0054] In the third aspect, the present application provides an electronic device (or a folding screen device), which includes a display screen, a memory and one or more processors; the display screen, the memory and the processor are coupled; the display screen is used to display an image generated by the processor, the display screen includes a folding screen, and the memory is used to store computer program code, and the computer program code includes computer instructions; when the processor executes the computer instructions, the electronic device executes the shooting interface display method described in any one of the first or second aspects above.

[0055] In a fourth aspect, the present application provides a computer-readable storage medium, comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes a shooting interface display method as described in any one of the above-mentioned first aspects.

[0056] In a fifth aspect, the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the shooting interface display method as described in any one of the above-mentioned first aspects.

[0057] It can be understood that the beneficial effects that can be achieved by the shooting interface display method described in the second aspect, the electronic device described in the third aspect, the computer-readable storage medium described in the fourth aspect, and the computer program product described in the fifth aspect provided above can refer to the beneficial effects in the first aspect and any possible design method thereof, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] Figure 1A Schematic diagram 1 of an unfolded state of a folding screen device provided in an embodiment of the present application;

[0059] Figure 1B A schematic diagram of a folding screen device in a folded state provided in an embodiment of the present application;

[0060] Figure 1C A schematic diagram of an outward folding process of a folding screen device provided in an embodiment of the present application;

[0061] Figure 1D A second schematic diagram of an unfolded state of a folding screen device provided in an embodiment of the present application;

[0062] Figure 1E Schematic diagram 3 of an unfolded state of a folding screen device provided in an embodiment of the present application;

[0063] Figure 2A Schematic diagram 1 of a rear selfie interface display provided in an embodiment of the present application;

[0064] Figure 2B A second schematic diagram of a rear selfie interface display provided in an embodiment of the present application;

[0065] Figure 2C Schematic diagram 3 of a rear selfie interface display provided in an embodiment of the present application;

[0066] Figure 2D Schematic diagram 3 of a rear selfie interface display provided in an embodiment of the present application;

[0067] Figure 3A A schematic diagram 1 of flipping a folding screen device provided in an embodiment of the present application;

[0068] Figure 3B A first schematic diagram of a tilted shooting interface provided in an embodiment of the present application;

[0069] Figure 3C A second schematic diagram of a tilted shooting interface provided in an embodiment of the present application;

[0070] Figure 4 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0071] Figure 5 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application;

[0072] Figure 6 A flowchart of a method for displaying a shooting interface provided in an embodiment of the present application is shown in FIG1 ;

[0073] Figure 7 A schematic diagram of a shooting interface display provided in an embodiment of the present application;

[0074] Figure 8 A third schematic diagram of a tilted shooting interface provided in an embodiment of the present application;

[0075] Fig.9A A second schematic diagram of a folding screen device flipping provided in an embodiment of the present application;

[0076] Fig. 9B A schematic diagram of a tilted shooting interface provided in an embodiment of the present application Figure 4 ;

[0077] Fig.10 A second flowchart of a method for displaying a shooting interface provided in an embodiment of the present application;

[0078] Fig.11A A schematic diagram 1 of a gesture navigation window display provided in an embodiment of the present application;

[0079] Fig. 11B A second schematic diagram of a gesture navigation window display provided in an embodiment of the present application;

[0080] Fig. 11C Schematic diagram 1 of a quick pull-up service provided in an embodiment of the present application;

[0081] Fig.11D Schematic diagram 2 of a quick pull-up service provided in an embodiment of the present application;

[0082] Fig.11E Schematic diagram 1 of a side-slide exit provided in an embodiment of the present application;

[0083] Fig.11F A second schematic diagram of a side-slide exit provided in an embodiment of the present application;

[0084] Fig.11G Schematic diagram 1 of a multi-window service provided in an embodiment of the present application;

[0085] Fig.11H Schematic diagram 2 of a multi-window service provided in an embodiment of the present application;

[0086] Fig.11I Schematic diagram 3 of a multi-window service provided in an embodiment of the present application;

[0087] Fig.12 A schematic diagram of a multi-window switch display provided in an embodiment of the present application;

[0088] Fig.13 A schematic diagram of a navigation mode selection provided in an embodiment of the present application;

[0089] Fig.14A Schematic diagram 3 of a gesture navigation window display provided in an embodiment of the present application;

[0090] Fig. 14B A schematic diagram of a gesture navigation window display provided in an embodiment of the present application Figure 4 ;

[0091] Fig.15 Schematic diagram 3 of a method for displaying a shooting interface provided in an embodiment of the present application;

[0092] Fig.16 A schematic diagram of a motion data correction process provided in an embodiment of the present application;

[0093] Fig.17 A schematic diagram of a shooting interface display process provided in an embodiment of the present application. DETAILED DESCRIPTION

[0094] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0095] A foldable screen device (such as a foldable screen mobile phone) refers to an electronic device with a foldable screen, which is a whole screen that can be folded or unfolded. Correspondingly, there are two device states for a foldable screen device, namely folded state and unfolded state. Among them, there are two folding methods for foldable screen mobile phones, namely external folding method and internal folding method.

[0096] For a folding screen mobile phone that folds outward, when the folding screen is in the unfolded state (such as Figure 1A When the folding screen is in the folded state (as shown), the entire area of ​​the folding screen can be used to display data, such as displaying a shooting interface. Figure 1B), part of the folding screen (such as the main screen 11 or the secondary screen 10) is used to display data, wherein the main screen 11 and the secondary screen 10 are back to back, and the secondary screen 10 can be on the same side as the rear camera of the folding screen mobile phone, and the main screen 11 and the secondary screen 10 constitute a folding screen. Among them, the device states can be switched. For example, the folding screen mobile phone can be switched from the unfolded state to the folded state. Specifically, when the folding screen mobile phone is in the unfolded state, the user folds the folding screen mobile phone (such as Figure 1C As shown, the foldable screen mobile phone is folded outward along the folding edge, that is, the foldable screen mobile phone is folded toward the opposite side where the user interface can be displayed), forming a foldable screen mobile phone in a folded state. Similarly, the foldable screen mobile phone can also be switched from the unfolded state to the folded state.

[0097] For example, when the folding angle of the folding screen (i.e., the angle between the two parts of the screen folded along the folding edge) θ (as mentioned above) Figure 1C The value range of θ) shown in the figure can be [180°, 360°]. When θ is in the range of [180°, X1], it can be determined that the foldable screen mobile phone is in the unfolded state. When θ is in the range of (X1, 360°], it can be determined that the foldable screen mobile phone is in the folded state. Among them, X1 is the first preset angle threshold. X1 can be set by the foldable screen mobile phone before leaving the factory, or it can be set by the user in the foldable screen mobile phone, or it can be determined by the foldable screen mobile phone based on the user's usage habits. This application does not limit the value of X1. For example, X can be set to 265°, 270° or 275°, etc. Assuming that X is set to 270°, when the folding angle θ of the folding screen is greater than or equal to 180° and less than or equal to 270°, it is determined that the foldable screen mobile phone is in the unfolded state; when the folding angle θ of the folding screen is greater than 270°, it is determined that the foldable screen mobile phone is in the folded state.

[0098] For a folding screen mobile phone that folds inward, the folding screen mobile phone may include an inner screen (such as Figure 1D The inner screen 12 shown) and the outer screen (as shown Figure 1E The outer screen 13 shown in the figure is a folding screen, the inner screen is a folding screen, the inner screen and the outer screen are back to back, and the size of the inner screen is larger than that of the outer screen. When the folding screen is in the unfolded state, the inner screen can be used to display data. When the folding screen is in the folded state, the outer screen can be used to display data. The device states of the folding screen mobile phone can also be switched. For example, the folding screen mobile phone can be switched from the unfolded state to the folded state. Specifically, when the folding screen mobile phone is in the unfolded state, the user can follow the above Figure 1D The folding method shown is used to fold the foldable screen mobile phone to form a foldable screen mobile phone in a folded state. Similarly, the foldable screen mobile phone can also be switched from the unfolded state to the folded state.

[0099] Among them, the above-mentioned inner screen can be considered as the main screen, and the outer screen can be considered as the secondary screen.

[0100] For example, when the folding angle of the folding screen (i.e., the angle between the two parts of the screen folded along the folding edge) φ (as mentioned above Figure 1D The value range of φ) shown in the figure can be [0°, 180°]. When φ is in the range of [0°, X2], it can be determined that the foldable mobile phone is in a folded state. When φ is in the range of (X, 180°], it can be determined that the foldable mobile phone is in an unfolded state. Among them, X2 is a second preset angle threshold. X2 can be set by the foldable mobile phone before leaving the factory, or it can be set by the user in the foldable mobile phone, or it can be determined by the foldable mobile phone based on the user's usage habits. This application does not limit the value of X. For example, X2 can be set to 85°, 90° or 95°, etc. Assuming that X2 is set to 90°, when the folding angle θ between the two parts of the inner screen is less than or equal to 90°, it is determined that the foldable mobile phone is in a folded state; when the folding angle θ between the sub-screen a and the sub-screen b is greater than 90°, it is determined that the foldable mobile phone is in an unfolded state.

[0101] It should be noted that the folding method of the above-mentioned folding screen mobile phone can be as follows: Figure 1C or Figure 1D The left-right folding shown can also be folded up and down. The embodiment of the present application does not limit the folding method of the folding screen mobile phone. In addition, the number of folding edges corresponding to the above-mentioned folding screen mobile phone can be as described above. Figure 1A , Figure 1C and Figure 1D The one shown may also be a value greater than 1, such as two. The embodiment of the present application does not limit the number of folded edges.

[0102] Folding screen mobile phones can provide a rear-mounted selfie function, that is, the front-mounted selfie effect is achieved through the rear camera. The user being photographed can directly view the real-time shooting effect on the display screen (such as the secondary screen) of the folding screen mobile phone, which is convenient for the user to take pictures. In one example, for a folding screen mobile phone that folds outward (referred to as an external folding screen mobile phone), the external folding screen mobile phone is in a folded state, and the main screen and the secondary screen of the external folding screen mobile phone are facing each other. After the external folding screen mobile phone is in the shooting state, when the user wants to use the rear-mounted selfie function, the user can click such as Figure 2A The main screen shows a rear selfie control 21 on the shooting interface 20. In response to a click operation on the rear selfie control 21, the external folding screen mobile phone enters the rear selfie state, that is, the secondary screen of the external folding screen mobile phone displays as shown. Figure 2B The shooting interface 22 is shown.

[0103] Among them, optionally, since the width of the secondary screen of the external folding screen mobile phone is smaller than the width of the main screen, in order to improve the aesthetics of the interface display, the size of the shooting interface displayed on the secondary screen can be adjusted according to the size of the shooting interface displayed on the main screen. For example, the width of the shooting interface displayed on the secondary screen is the width of the secondary screen, and the height can be determined based on the width of the shooting interface displayed on the secondary screen and the aspect ratio of the shooting interface displayed on the main screen, such as the height of the shooting interface is the product of the width of the secondary screen and the aspect ratio, so that the aspect ratio of the shooting interface displayed on the secondary screen is consistent with the aspect ratio of the shooting interface displayed on the main screen.

[0104] In another example, for a folding screen mobile phone that folds inward (hereinafter referred to as an inward folding screen mobile phone), the inward folding screen mobile phone is in an unfolded state, the main screen (i.e., the inner screen) and the secondary screen (i.e., the outer screen) of the inward folding screen mobile phone are facing each other, and the rear camera and the secondary screen are on the same side. The inward folding screen mobile phone is in a shooting state, and when the user wants to use the rear selfie function, the user can click Figure 2C The main screen shown in FIG. 1 shows a rear selfie control 24 on the shooting interface 23. In response to a click operation on the rear selfie control 24, the inner folding screen mobile phone enters the rear selfie state, that is, the sub-screen of the inner folding screen mobile phone displays the following: Figure 2D Shooting interface 25.

[0105] Among them, optionally, since the width of the secondary screen of the inward folding screen mobile phone in the unfolded state is smaller than the width of the main screen, in order to improve the aesthetics of the interface display, the size of the shooting interface displayed on the secondary screen of the inward folding screen mobile phone is adjusted according to the size of the shooting interface displayed on the main screen.

[0106] In some embodiments, when the foldable screen mobile phone is in the rear selfie state, if the foldable screen mobile phone is flipped, such as tilting the foldable screen mobile phone, the controls (or target controls) in the shooting interface displayed on the secondary screen of the foldable screen mobile phone can be rotated in the flipping direction, that is, tilted in the tilting direction of the foldable screen mobile phone, so as to achieve a rich shooting interface display effect and enhance the fun, and the display direction of the controls in the shooting interface is consistent with the user's line of sight, which can facilitate user use. For example, taking an external foldable screen mobile phone as an example, if the external foldable screen mobile phone is flipped to the right (such as Figure 3A As shown), the level of the folding screen mobile phone is flipped to the right, that is, rotated counterclockwise, then the controls in the shooting interface displayed on the secondary screen of the external folding screen mobile phone need to be rotated to the right, that is, rotated counterclockwise (as shown Figure 3B Target control 16 rotation direction shown).

[0107] However, when the foldable phone is in the rear-facing selfie mode, the secondary screen of the foldable phone is facing away from the main screen, and the direction of the secondary screen is opposite to that of the main screen. The left side of the main screen is actually the right side of the secondary screen, the right side of the main screen is actually the left side of the secondary screen, the front of the main screen is actually the back of the secondary screen, and the back of the main screen is actually the front of the secondary screen. The motion data of the target motion sensor is based on the direction of the main screen. Therefore, the flipping direction (i.e., the rotation direction) determined based on the motion data of the target motion sensor is actually opposite to the secondary screen, causing the foldable phone to control the controls in the shooting interface displayed on the secondary screen to rotate in the direction opposite to the flipping direction. For example, the foldable phone flips to the right, and the controls in the shooting interface displayed on the secondary screen rotate to the left, that is, clockwise (such as). Figure 3C The rotation direction of the target control 16 shown in the figure) cannot achieve the effect of rotating the controls in the shooting interface displayed on the secondary screen in the flipping direction, resulting in a low visual experience for the user. In addition, if the user uses the folding screen mobile phone at an angle, from the user's perspective, the rotation direction of the shooting interface displayed on the secondary screen (that is, the rotation direction, flipping direction or display direction of the controls in the shooting interface) is opposite to the flipping direction of the folding screen mobile phone, which will increase the difficulty for the user to distinguish the controls, bring inconvenience to the user in using the controls, affect the user's satisfaction, and bring inconvenience to the user's operation. It should be understood that the above Figure 3B and Figure 3C The controls included in the target control 16 shown are only examples, and the present application is not limited thereto.

[0108] Therefore, in response to the above problems, the present application provides a method for displaying a shooting interface. During the period when the main screen of the folding screen device displays the shooting interface, the folding screen device receives a first operation input by the user, and the first operation is used to trigger the folding screen device to enter the post-selfie state. Afterwards, the folding screen device responds to the first operation and controls the secondary screen of the folding screen device to display the shooting interface to realize the post-selfie function. The folding screen device can poll and obtain the motion data of the target motion sensor in the folding screen device (such as the angular velocity data corresponding to the gyroscope, and the acceleration data corresponding to the acceleration sensor). Since the motion data (that is, the direction indicated by the motion data) is accurate relative to the direction of the main screen of the folding screen device, the directions of the main screen and the secondary screen of the folding screen device in the post-selfie state are opposite, so the motion data is inverted front and back and left and right relative to the direction of the secondary screen of the folding screen device, that is, opposite. Based on this, the folding screen device needs to correct the motion data (such as inverting the motion data in the X direction and the Z direction in the motion data). Afterwards, the folding screen device uses the corrected motion data to determine the first flipping direction of the folding screen device, and determines the accurate flipping direction relative to the direction (or described as orientation) of the secondary screen of the folding screen device. Afterwards, the folding screen device can rotate the target control in the shooting interface displayed on the secondary screen according to the first flipping direction, so that the rotation direction of the shooting interface of the secondary screen (that is, the rotation direction of the control in the shooting interface of the secondary screen) is consistent with the flipping direction of the folding screen device, avoiding the rotation direction of the shooting interface displayed on the secondary screen being opposite to the flipping direction of the folding screen device, ensuring the richness of the interface display effect and the user's visual experience. In addition, from the perspective of user use, the tilt direction of the target control in the shooting interface displayed on the secondary screen is the same as the tilt direction of the folding screen mobile phone, so that the user's line of sight is consistent with the display direction of the target control, reducing the difficulty of the user to identify the control, facilitating the user to use the control, and improving user satisfaction.

[0109] In addition, in order to facilitate users to trigger the foldable screen mobile phone to exit the rear-camera selfie state, when entering the rear-camera selfie state, a side-sliding exit logic is added to the side navigation window on the secondary screen. The side-sliding exit logic indicates that when a side-sliding operation input by the user is received, the foldable screen mobile phone responds to exit the rear-camera selfie state, so that the foldable screen device also supports the side-sliding exit function in the three-button navigation mode, providing a new rear-camera selfie exit method for user convenience.

[0110] Exemplarily, the foldable screen device in the embodiments of the present application can be a mobile phone, a tablet computer, a desktop, a laptop, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an augmented reality (AR)\virtual reality (VR) device, and other electronic devices with a foldable screen. The embodiments of the present application do not impose any special restrictions on the specific form of the electronic device.

[0111] For example, Figure 4 FIG. 2 shows a schematic diagram of the structure of the electronic device 200. Figure 4 As shown, the electronic device 200 may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 211, a power management module 212, a battery 213, an antenna 1, an antenna 2, a mobile communication module 240, a wireless communication module 250, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, a button 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a subscriber identification module (SIM) card interface 295, etc.

[0112] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0113] The processor 210 may include one or more processing units, for example, the processor 210 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0114] The controller may be the nerve center and command center of the electronic device 200. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0115] The processor 210 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may store instructions or data that the processor 210 has just used or cyclically used. If the processor 210 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 210, and thus improves the efficiency of the system.

[0116] In some embodiments, the processor 210 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0117] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0118] The charging management module 211 is used to receive charging input from a charger. While the charging management module 211 is charging the battery 213 , it can also power the electronic device through the power management module 212 .

[0119] The wireless communication function of the electronic device 200 can be implemented through the antenna 1, the antenna 2, the mobile communication module 240, the wireless communication module 250, the modem processor and the baseband processor.

[0120] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0121] The mobile communication module 240 may provide solutions for wireless communications including 2G / 3G / 4G / 5G etc. applied to the electronic device 200. The modem processor may include a modulator and a demodulator.

[0122] The wireless communication module 250 can provide wireless communication solutions for application in the electronic device 200, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc.

[0123] The electronic device 200 implements the display function through a GPU, a display screen 294, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 210 may include one or more GPUs, which execute program instructions to generate or change display information.

[0124] The display screen (or screen) 294 is used to display images, videos, etc. The display screen 294 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light emitting diode (QLED), etc. In some embodiments, the electronic device 200 may include 1 or N display screens 294, where N is a positive integer greater than 1.

[0125] In some embodiments, the display screen 294 may be a folding screen. The folding method of the folding screen may be as described above. Figure 1C Alternatively, the folding method of the folding screen may be as described above. Figure 1D The inward folding method shown.

[0126] The electronic device 200 can realize the shooting function through ISP, camera 293, video codec, GPU, display screen 294 and application processor.

[0127] The external memory interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 200.

[0128] The internal memory 221 can be used to store computer executable program codes, which include instructions. The processor 210 executes various functional applications and data processing of the electronic device 200 by running the instructions stored in the internal memory 221. The internal memory 221 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 200 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 221 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0129] The electronic device 200 can implement audio functions such as music playing and recording through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, the headphone jack 270D, and the application processor.

[0130] The buttons 290 include a power button, a volume button, etc. The indicator 292 may be an indicator light.

[0131] The sensor module 280 may include a folding angle detection sensor, a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.

[0132] The gyro sensor may be used to determine the motion posture of the electronic device 200. In some embodiments, the angular velocity of the electronic device 200 around three axes (ie, x, y, and z axes) may be determined by the gyro sensor.

[0133] The acceleration sensor can detect the magnitude of the acceleration of the electronic device 200 in all directions (generally three axes). When the electronic device 200 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0134] The folding angle detection sensor is used to detect the folding angle of the electronic device 200, that is, the screen, as described above. Figure 1C The folding angle θ shown or the above Figure 1D The folding angle φ is shown. Exemplarily, the folding angle detection sensor may be a Hall sensor.

[0135] The software system of the electronic device 200 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The present application embodiment takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 200.

[0136] Figure 5 It is a software structure block diagram of the electronic device 200 according to an embodiment of the present invention.

[0137] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0138] The application layer can include a series of application packages.

[0139] like Figure 5 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0140] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0141] like Figure 5 As shown, the application framework layer may include a window manager, a content provider, a view system, a sensor service, a gesture navigation module, a folding screen management module, etc.

[0142] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0143] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0144] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0145] The sensor service (sensorservice) is used to obtain motion data collected by the motion sensor, correct the motion data, broadcast the motion data, etc. Exemplarily, the sensor service may include a first sensor service module (such as sensorservice.java) and a second sensor service module (such as sensorservice.cpp).

[0146] The folding screen management module (foldscreenmanager) is used to refresh the device status identifier and display mode identifier according to the folding status of the folding screen and the display status of the folding screen.

[0147] The gesture navigation module (gesturenavmanager) is used to implement the exit of the rear-camera selfie state by swiping sideways during a call.

[0148] In addition, the application framework layer may also include other modules or services, such as a phone manager, a resource manager, a notification manager, and the like.

[0149] Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for scheduling and management of the Android system.

[0150] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0151] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0152] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0153] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0154] Understandably, Figure 5 The layers in the structure shown and the components contained in each layer do not constitute a specific limitation on the electronic device 200, i.e., the folding screen device. In other embodiments of the present application, the structure may include more or fewer layers than shown in the figure, and each layer may include more or fewer components, which is not limited in the present application.

[0155] The present application provides a method for displaying a shooting interface. After a folding screen device enters a rear selfie state, when the folding screen device is tilted (or flipped), the target control in the shooting interface displayed on the secondary screen of the folding screen device is controlled to rotate according to the tilt direction of the folding screen device, so as to realize the linkage of the shooting interface displayed on the secondary screen of the folding screen mobile phone when the folding screen mobile phone is tilted, provide a rich display effect of the shooting interface, and facilitate the user to use the target control. In addition, for a folding screen device whose folding mode is an outward folding mode, when the navigation mode of the folding screen device is a three-key navigation mode, the user cannot trigger the folding screen device to exit the rear selfie state through gesture operation, and can only trigger the folding screen device to exit the rear selfie state by clicking the exit rear selfie control. The way to trigger the folding screen device to exit the rear selfie state is single. Therefore, in order to provide a rich exit triggering method for the rear selfie state, the folding screen device can add a side sliding exit logic when the navigation mode is a three-key navigation mode, so as to support the user to trigger the folding screen device to exit the rear selfie state by inputting a side sliding operation, so that the user can choose the way to trigger the folding screen device to exit the rear selfie state according to the use requirements, which is convenient for the user to use.

[0156] The following will take the folding screen device as an example, that is, a folding screen mobile phone, and the folding method is an outward folding method, to first introduce the process of the folding screen mobile phone controlling the rotation of the shooting interface displayed on the secondary screen of the folding screen mobile phone. Figure 6 As shown, the process may include S301-S307.

[0157] S301, the main screen of the foldable screen mobile phone displays a shooting interface 1, and the shooting interface 1 includes a preview area and a rear selfie control. Among them, the rear selfie control is used to trigger the foldable screen mobile phone to enter the rear selfie state. The preview area is used to display the image captured by the camera of the foldable screen mobile phone.

[0158] Exemplarily, the above rear selfie state indicates that the secondary screen of the folding screen mobile phone displays the shooting picture, that is, displays the image captured by the camera. When the folding screen mobile phone is in the folded state, a screen is folded into two parts, namely the main screen and the secondary screen, the main screen and the secondary screen are back to back, and the rear camera is located on the back of the main screen and on the same side as the secondary screen (as mentioned above Figure 1B As shown in the figure, the shooting interface 1 (or the fourth shooting interface) displayed on the main screen may include a rear selfie control, which can trigger the foldable screen mobile phone to enter the rear selfie state. When the foldable screen mobile phone is in the unfolded state, the main screen and the sub-screen are on the same surface, and the rear camera and the sub-screen are on different surfaces. Therefore, there is no rear selfie scene. In other words, the foldable screen mobile phone cannot be triggered to enter the rear selfie state.

[0159] In some embodiments, the shooting state corresponding to the shooting interface 1 may be a video shooting state, that is, the shooting interface 1 may be an interface displayed during the video recording process of the folding screen mobile phone. Optionally, the shooting interface 1 may also include a stop button, which is used to trigger the folding screen mobile phone to stop recording the video and generate a video file. It should be understood that only when the folding screen mobile phone is in the recording state can the user trigger the folding screen mobile phone to stop recording.

[0160] In other embodiments, the shooting state corresponding to the shooting interface 1 may also be a preview state, that is, the shooting interface 1 may be an interface displayed in a preview state. Optionally, the preview state indicates the state of the folding screen mobile phone before starting to shoot in a video shooting state or a photo shooting state, that is, the preview state may include a preview state in a video shooting state and / or a preview state in a photo shooting state.

[0161] Among them, optionally, when the shooting state corresponding to the shooting interface 1 is a preview state, the shooting interface 1 may also include a shooting button, which is used to trigger the folding screen mobile phone to record a video or photo. For example, the shooting state corresponding to the shooting interface 1 is the state before starting to shoot in the video shooting state. The shooting interface 1 may include a video shooting button. When the user clicks the video shooting button, the folding screen mobile phone responds to the video shooting button, switches to the video shooting state, starts recording the video, and the displayed shooting interface may include a stop button.

[0162] It should be noted that the stop button and the video shooting button can be in the same position. Specifically, when the folding screen mobile phone is shooting a video, the button is in the recording state, that is, the video shooting state. The button can be used as a stop button. After the electronic device receives a click operation on the stop button by the user, it can stop recording the video. When the electronic device is in the video shooting state and no video is being shot, the button is in the stop recording state. The button can be used as a video shooting button. After the electronic device receives a click operation on the shooting button by the user, it can start recording the video.

[0163] S302. The foldable screen mobile phone receives a click operation of the user on the above-mentioned rear selfie control.

[0164] S303. In response to a click operation on the rear selfie control, the foldable screen mobile phone displays a shooting interface 2 on the secondary screen of the foldable screen mobile phone, wherein the shooting interface 2 includes a preview area and a target control.

[0165] The target controls are used to trigger the foldable screen mobile phone to perform corresponding actions. For example, the target controls may include gallery controls, HDR controls, flash controls, setting controls, magnification adjustment controls, etc.

[0166] In the embodiment of the present application, when the user wants to use the rear camera of the foldable screen mobile phone to take a selfie, the user can click the rear selfie control on the shooting interface 1 displayed on the main screen. In response to the click operation on the rear selfie control, the foldable screen mobile phone enters the rear selfie state, and the secondary screen of the foldable screen mobile phone displays the shooting interface (i.e., shooting interface 2). The preview area in the shooting interface 2 is used to display the image captured by the rear camera, thereby realizing the rear selfie function.

[0167] In some embodiments, after entering the rear-mounted selfie state, the secondary screen of the folding screen mobile phone may also display an exit rear-mounted selfie control. Among them, the exit rear-mounted selfie control is used to trigger the folding screen mobile phone to exit the rear-mounted selfie state. When the user wants the folding screen mobile phone to exit the rear-mounted selfie state, such as when the user finishes taking a selfie, the user can click to exit the rear-mounted selfie control. In response to the user's click operation on the exit rear-mounted selfie control, the folding screen mobile phone exits the rear-mounted selfie state, the secondary screen of the folding screen mobile phone stops displaying the shooting interface, and the main screen of the folding screen mobile phone continues to display the shooting interface (such as shooting interface 3). The shooting interface 3 also includes a preview area and a rear-mounted selfie control.

[0168] Optionally, the exit post-shooting control displayed on the secondary screen may not be located on the shooting interface 2, such as Figure 2B The exit rear Selfie control shown on the secondary screen can be displayed below the shooting interface 2. Figure 2B The switch to the main screen control shown is to exit the rear selfie control, and the shooting interface 22 is the shooting interface 2 displayed on the secondary screen. Figure 2B The position of the exit post-selfie control shown is only an example. Alternatively, the exit post-selfie control may be located on the shooting interface 2, for example, Figure 7 The switch to main screen control 30 shown is located on the shooting interface 31 , and the shooting interface 31 is the shooting interface 2 .

[0169] Among them, optionally, when the foldable screen mobile phone enters the rear selfie state, the shooting state corresponding to the above-mentioned shooting interface 2 displayed is the same as the above-mentioned shooting interface 1. For example, the shooting state corresponding to the above-mentioned shooting interface 1 is the preview state in the shooting state, and the shooting state corresponding to the displayed shooting interface 2 can be the preview state in the shooting state. Of course, the shooting state corresponding to the above-mentioned shooting interface 2 can also be the default shooting state, which is independent of the shooting state corresponding to the shooting interface 1.

[0170] In addition, the shooting interface 3 and the shooting interface 1 may be the same interface or different interfaces. For example, the shooting state corresponding to the shooting interface 1 is the preview state in the photo state, and the shooting state corresponding to the shooting interface 3 is the preview state in the video shooting state. Specifically, the user clicks the rear selfie button on the shooting interface 1. In response to the user's click operation on the rear selfie button, the secondary screen of the folding screen mobile phone displays the shooting interface 2, and the shooting state corresponding to the shooting interface 2 may be the preview state in the photo state. Afterwards, the user clicks on the video recording control, and the folding screen mobile phone enters the video recording state. Correspondingly, the secondary screen of the folding screen mobile phone displays the shooting interface 4, and the shooting state corresponding to the shooting interface 4 is the preview state in the video shooting state. Afterwards, the user clicks on the exit rear selfie control displayed on the secondary screen, and the secondary screen of the folding screen mobile phone stops displaying the shooting interface 4, and the main screen continues to display the shooting interface, such as displaying the shooting interface 3. At this time, the shooting state corresponding to the shooting interface 3 may be the preview state in the video shooting state.

[0171] It should be noted that when the folding screen secondary screen displays the shooting interface, the main screen of the folding screen mobile phone may not display the shooting interface or may display the shooting interface, and this application does not limit it.

[0172] In some embodiments, the user's click operation on the above-mentioned rear selfie control introduced above is only a possible trigger operation for triggering the folding screen mobile phone to enter the rear selfie state, and the trigger operation (or referred to as trigger operation 1, or referred to as the first operation) for triggering the folding screen mobile phone to enter the rear selfie state may also be other types of trigger operations. For example, the trigger operation 1 may be a preset gesture 1 input by the user in the above-mentioned shooting interface 1. The preset gesture 1 is used to trigger the folding screen mobile phone to enter the rear selfie state. In this embodiment, the shooting interface of the mobile phone may also include the above-mentioned rear selfie control, or may not include the above-mentioned rear selfie control.

[0173] It should be understood that the above-mentioned preset gesture 1 can be pre-configured in the foldable screen mobile phone. In addition, the foldable screen mobile phone can prompt the user with the preset gesture 1 and the function triggered by the preset gesture 1 (i.e., triggering the foldable screen mobile phone to enter the rear selfie state) after starting the camera application. For another example, the trigger operation 1 can be that the user speaks the rear selfie command, and the foldable screen mobile phone responds to the rear selfie command and enters the rear selfie state. Among them, the rear selfie command can be the default of the foldable screen mobile phone or it can be user-defined. Of course, the above-mentioned trigger operation 1 can also be other operations that can trigger the foldable screen mobile phone to enter the rear selfie state, and this application does not limit it.

[0174] S304. The foldable screen mobile phone polls to obtain motion data of a target motion sensor of the foldable screen mobile phone.

[0175] Among them, the above-mentioned target motion sensor is used to measure the movement of the folding screen mobile phone, such as posture and movement direction. When the folding screen mobile phone flips in a certain direction, the target motion sensor can detect the flipping action of the folding screen mobile phone. Exemplarily, the target motion sensor may include an acceleration sensor and / or a gyroscope. Accordingly, the motion data of the target motion sensor may include acceleration data and / or angular velocity data. Among them, the acceleration data is collected by the acceleration sensor, and the angular velocity data is collected by the gyroscope.

[0176] The accelerometer is mainly used to measure the acceleration changes of foldable screen mobile phones on three axes (i.e. (X, Y, Z)). If the foldable screen mobile phone is flipped, the accelerometer can sense this action and output the corresponding acceleration data. The foldable screen mobile phone can determine the movement state of the device by analyzing the acceleration data, for example, whether it has been flipped and the direction of the flip.

[0177] The gyroscope is mainly used to measure the angular velocity changes of foldable screen mobile phones on three axes, including rotation, tilt, etc. When the user flips the foldable screen mobile phone, the gyroscope can detect the angular velocity of the foldable screen mobile phone in (X, Y, Z) rotation and output the corresponding angular velocity data. The foldable screen mobile phone can determine the flip state of the device by analyzing the angular velocity data output by the gyroscope, for example, whether a flip has occurred and the flip direction (or rotation direction).

[0178] Among them, the above-mentioned X-axis can be understood as the axis of the short side of the folding screen mobile phone, the Y-axis can be understood as the axis of the long side of the folding screen mobile phone, and the Z-axis can be understood as the front and back of the folding screen mobile phone.

[0179] Exemplarily, the above polling may refer to the foldable screen mobile phone obtaining the target sensor data of the foldable screen mobile phone at a preset time interval, so as to determine the posture and motion state of the foldable screen mobile phone by using the target motion sensor number, thereby determining the flip information of the foldable screen mobile phone, such as the flip direction, etc. Exemplarily, the flip direction may be flipping right, rotating left, flipping upward, flipping downward, etc.

[0180] In the embodiment of the present application, in order to improve data processing efficiency, the foldable screen mobile phone can poll to obtain angular velocity data collected by the gyroscope or acceleration data collected by the acceleration sensor. In order to improve the accuracy of determining the flip information, the foldable screen mobile phone can poll to obtain angular velocity data and acceleration data, so as to use the angular velocity data and acceleration data to determine the flipping condition of the foldable screen mobile phone.

[0181] S305. The foldable screen mobile phone calibrates the motion data of the target motion sensor.

[0182] S306. The foldable screen mobile phone determines a first flipping direction of the foldable screen mobile phone based on the corrected motion data.

[0183] In the embodiment of the present application, the foldable screen mobile phone can use the motion data of the target motion sensor to normally display the shooting interface on the main screen of the foldable screen mobile phone. That is to say, the motion data of the target motion sensor of the foldable screen mobile phone is based on the direction of the main screen of the foldable screen mobile phone. When the foldable screen mobile phone uses the motion data of the target motion sensor to process the interface displayed on the main screen of the foldable screen mobile phone, there is no need to calibrate the motion data of the target motion sensor, but can directly use it. For example, when the foldable screen mobile phone is not in the rear selfie state, the foldable screen mobile phone is flipped to the right along the long side of the foldable screen mobile phone (as mentioned above). Figure 3A As shown), the folding screen mobile phone analyzes the motion data of the target motion sensor and determines that the flip direction of the folding screen mobile phone is to the right, that is, to rotate counterclockwise. Therefore, the folding screen mobile phone controls the shooting interface displayed on the folding screen main screen to rotate to the right (that is, the controls in the shooting interface rotate counterclockwise) (as shown Figure 8 As shown), when the folding screen mobile phone is in motion, the shooting interface displayed on the main screen of the folding screen mobile phone is linked, which increases the fun and is convenient for users to use.

[0184] For folding screen mobile phones that fold outward, the main screen and the secondary screen of the folding screen mobile phone in the folded state are back to back, that is, the directions of the main screen and the secondary screen are actually opposite. The motion data of the target motion sensor is based on the direction of the main screen. Therefore, the flip direction determined based on the motion data of the target motion sensor is actually opposite to the secondary screen. Based on this, after the folding screen mobile phone enters the rear selfie state, that is, after the secondary screen is used to display the shooting interface (such as the shooting interface 2 mentioned above), if the folding screen mobile phone uses the motion data of the target motion sensor to determine that the folding screen mobile phone has flipped, then the determined direction is correct relative to the direction of the main screen, but the direction is actually opposite to the secondary screen. Therefore, the folding screen mobile phone needs to calibrate the acquired motion data of the target motion sensor so as to use the calibrated motion data of the target motion sensor to determine the accurate flip direction relative to the secondary screen (that is, the first flip direction), and the first flip direction is based on the direction of the secondary screen.

[0185] In some embodiments, the motion data of the target motion sensor may include sensor data in the X direction, sensor data in the Y direction, and sensor data in the Z direction. Since the main screen and the secondary screen are inverted front to back and left to right, the correction process may include: the folding screen mobile phone inverts the sensor data in the Z direction and the sensor data in the X direction respectively. For example, the motion data of the target motion sensor includes angular velocity data (w1, w2, w3). Among them, w1 is the angular velocity data in the X direction, w2 is the angular velocity data in the Y direction, and w3 is the angular velocity data in the Z direction. Correction refers to inverting the angular velocity data in the X direction with the angular velocity data in the Z direction, that is, changing the direction of the data in the X and Z directions. The corrected angular velocity data is (-w1, w2, -w3).

[0186] For another example, the motion data of the target motion sensor may include acceleration data (a1, a2, a3). Where a1 is the acceleration data in the X direction, a2 is the acceleration data in the Y direction, and a3 is the acceleration data in the Z direction. Correction refers to inverting the acceleration data in the X direction and the acceleration data in the Z direction, and the corrected acceleration data is (-a1, a2, -a3).

[0187] For another example, the motion data of the target motion sensor may include angular velocity data (w1, w2, w3) and acceleration data (a1, a2, a3). Correcting the motion data of the target motion sensor means that the angular velocity data in the X direction is inverted with the angular velocity data in the Z direction, and the corrected angular velocity data is (-w1, w2, -w3), and the acceleration data in the X direction is inverted with the acceleration data in the Z direction, and the corrected acceleration data is (-a1, a2, -a3).

[0188] S307, the target control in the shooting interface 2 displayed on the secondary screen of the folding screen mobile phone is rotated toward the first flipping direction of the folding screen mobile phone.

[0189] In the embodiment of the present application, after the foldable screen mobile phone is tilted (or flipped), the foldable screen mobile phone determines the first flipping direction relative to the secondary screen according to the motion data of the calibrated target motion sensor. Afterwards, the foldable screen mobile phone can control the shooting interface (such as shooting interface 2) displayed on the secondary screen of the foldable screen mobile phone to rotate in the first flipping direction, so that the rotation direction of the target control in the shooting interface displayed on the secondary screen of the foldable screen mobile phone is consistent with the flipping direction of the foldable screen mobile phone, avoiding the user's confusion as to why the rotation direction of the control in the shooting interface displayed on the secondary screen of the foldable screen mobile phone is opposite to the flipping direction of the foldable screen mobile phone. In addition, the difficulty for the user to identify the controls in the shooting interface 2 (or the first shooting interface) is reduced, making it easier for the user to use.

[0190] For example, as mentioned above Figure 3AAs shown, the foldable screen mobile phone is flipped to the right. The foldable screen mobile phone determines that the first flipping direction is to flip to the right, that is, to rotate counterclockwise based on the motion data of the calibrated target motion sensor. Therefore, the foldable screen mobile phone can rotate the target control of the shooting interface displayed on the secondary screen to the right (as shown above Figure 3B The target control 16 shown in FIG. Figure 3C The rotation direction of the target control 16 in the shooting interface displayed on the secondary screen is opposite to the flipping direction of the folding screen mobile phone.

[0191] It should be noted that the right flip described above is only an example. The foldable screen mobile phone can not only flip to the right or left, but also flip up or down along the short side of the foldable screen mobile phone. Fig.9A As shown), the target control in the shooting interface displayed on the secondary screen of the folding screen mobile phone is flipped upward (as shown Fig. 9B shown).

[0192] Wherein, optionally, the above flip direction can be represented by a flip angle, which includes a flip angle in the X direction, a flip angle in the Y direction, and a flip angle in the Z direction. Accordingly, the flip angle in the Y direction corresponding to flipping right or left can be 0. The flip angle in the X direction corresponding to flipping up or down can be 0.

[0193] In the embodiment of the present application, taking the above-mentioned flipping direction of flipping to the right as an example, for the main screen of the folding screen mobile phone, it rotates counterclockwise, and accordingly, the target control in the main screen of the folding screen mobile phone will also rotate to the right, that is, counterclockwise. If it is not corrected, then for the secondary screen of the folding screen mobile phone, the folding screen mobile phone is rotated to the left, that is, clockwise, and accordingly, the target control in the secondary screen of the folding screen mobile phone will also rotate to the left, that is, clockwise, resulting in the wrong display direction of the target control. Therefore, after the folding screen mobile phone enters the rear selfie state, the folding screen mobile phone needs to correct the motion data so that after the folding screen mobile phone flips, it can determine that the direction relative to the secondary screen of the folding screen mobile phone is the accurate flipping direction, thereby accurately controlling the display direction of the target control displayed on the secondary screen, that is, the tilting mode, so that the tilting direction of the target control is consistent with the tilting mode of the folding screen mobile phone.

[0194] In some embodiments, after the foldable screen mobile phone exits the rear-mounted selfie state, the secondary screen of the foldable screen mobile phone stops displaying the shooting interface, and the direction of the main screen of the foldable screen mobile phone is consistent with the direction indicated by the motion data of the target motion sensor. Therefore, after the foldable screen mobile phone obtains the motion data of the target motion sensor, there is no need to correct the motion data of the target motion sensor.

[0195] The above takes an outward-folding folding phone as an example to introduce the process of how to move the content displayed on the secondary screen (such as shooting interface 2) when the folding phone is flipped after entering the rear selfie state. For folding phones with inward folding, after entering the rear selfie state, the content displayed on the secondary screen can also be moved according to this process. However, for inward-folding phones, since the main screen and secondary screen of the inward-folding phone are actually two different screens, the main screen can be the inner screen and the secondary screen can be the outer screen. When the inner screen is in the unfolded state, the rear camera and the outer screen are on the same side. Therefore, the device state of the folding phone in the rear selfie state is the unfolded state, not the folded state.

[0196] In an embodiment of the present application, when a user tilts a foldable phone that is in a rear-mounted selfie state, the foldable phone can correct the motion data collected by the target motion sensor so that the direction indicated by the corrected motion data is consistent with the direction of the secondary screen of the foldable phone. The foldable phone can then accurately determine the tilt direction of the foldable phone relative to the secondary screen, that is, the flipping direction, based on the corrected motion data, thereby ensuring the accuracy of the flipping direction, and thereby making the direction of the controls displayed on the secondary screen of the foldable phone consistent with the flipping direction, ensuring that as the phone is flipped, the controls displayed on the secondary screen are oriented correctly, which is convenient for users to use, and makes the motion of the content displayed on the secondary screen match the motion of the foldable phone, providing a richer interface display effect and enhancing interest.

[0197] The above describes the process of rotating the shooting interface displayed on the secondary screen of a foldable screen mobile phone (i.e., the rotation of the controls in the shooting interface). The following will continue to describe the process of exiting the rear selfie state of a foldable screen mobile phone through a side sliding operation. Fig.10 As shown, the process may include S401-S413.

[0198] S401. When the display mode indicator changes, the foldable screen mobile phone determines whether to enter the rear-camera selfie state or exit the rear-camera selfie state.

[0199] Among them, the above-mentioned display mode identifier may include a full-screen display identifier, a main screen identifier and a sub-screen identifier. Among them, the full-screen display identifier indicates that the main screen and the sub-screen are in the display state at the same time, that is, the interface is displayed at the same time. For example, the external folding screen mobile phone is in the unfolded state, and the main screen and the sub-screen are both in the bright screen state, used to display content. The main screen display identifier indicates that the main screen is in the display state, while the sub-screen does not display content, such as the sub-screen is in a black screen state. The sub-screen display identifier indicates that the sub-screen is in the bright screen state, used to display content, while the main screen does not display content and is in a black screen state.

[0200] In some embodiments, the display mode identifier may be displayMode. The full screen display identifier may be 1, the main screen display identifier may be 2, and the secondary screen display identifier may be 3. Of course, this is only an example, and the full screen display identifier, the main screen display identifier, and the secondary screen display identifier may also be other values, as long as the three are different, and there is no limitation on them.

[0201] Exemplarily, the foldable screen mobile phone can obtain the current display mode identifier and the previous display mode identifier (i.e., the previous display mode identifier of the current display mode). For a foldable screen mobile phone that folds outward, after the foldable screen mobile phone enters the rear selfie state, if it is determined that the previous display mode identifier is not the secondary screen display identifier, and the current display identifier is the secondary screen display identifier, the foldable screen mobile phone can determine that it has entered the rear selfie state. For example, the previous display mode identifier is the main screen display identifier, and the current display identifier is the secondary screen display identifier, indicating that the foldable screen mobile phone switches from the main screen display to the secondary screen display and enters the rear selfie state.

[0202] When the foldable screen mobile phone determines that the previous display mode identifier is the secondary screen display identifier and the current display mode is not the secondary screen display identifier, the foldable screen mobile phone can determine that the foldable screen mobile phone has exited the rear selfie state. For example, the previous display mode identifier is the secondary screen display identifier and the next display mode is the main screen display identifier, indicating that the foldable screen mobile phone switches from the secondary screen display to the main screen display and exits the rear selfie state.

[0203] When it is determined that the previous display mode identifier is not a secondary screen display identifier, and the current display mode identifier is not a secondary screen display identifier, the foldable screen mobile phone can determine that the foldable screen mobile phone is neither exiting the rear selfie state nor entering the rear selfie state. For example, the previous display mode identifier is a full-screen display identifier, and the current display mode identifier is a main screen display identifier, indicating that the foldable screen mobile phone has entered the folded state from the unfolded state, and switched from the full-screen display to the main screen display.

[0204] S402: When the foldable screen mobile phone is neither in the rear-camera selfie state nor in the rear-camera selfie state, the foldable screen mobile phone maintains the original gesture navigation logic corresponding to the application window on the foldable screen mobile phone.

[0205] The application window is used to display the application interface. For example, the device state of the folding screen mobile phone is the unfolded state, and the folding screen displays the shooting interface in full screen, and the shooting interface is in the application window of the camera application.

[0206] In the embodiment of the present application, maintaining the original gesture navigation logic corresponding to the application window means maintaining the user's input operation in the gesture navigation window corresponding to the application window to trigger the action executed by the foldable screen mobile phone. Exemplarily, the gesture navigation window may include a bottom navigation window and a side navigation window (such as a left navigation window and / or a right navigation window). For example, when the foldable screen mobile phone is in the folded state, the navigation window on the main screen may be as follows: Fig.11A It should be understood that Fig.11A The position, size and shape of the gesture navigation window shown are only examples and are not limited in this application. Fig. 11B As shown, the bottom navigation window is in a "concave" shape instead of a rectangle.

[0207] In some embodiments, the operation 1 input by the user in the bottom navigation window is used to trigger the foldable screen mobile phone to enter the quick service center. For example, the operation 1 may be an upward swipe operation. The user inputs an upward swipe operation (such as the foldable screen mobile phone in the folded state) at the bottom of the main screen, that is, in the bottom navigation window. Fig. 11C As shown), the folding screen mobile phone responds to the upward sliding operation and displays as shown Fig.11D The quick service center interface shown is used to enter the quick service center. Accordingly, the above-mentioned original gesture navigation logic may include the quick service startup logic corresponding to the bottom navigation window.

[0208] When the navigation mode is gesture navigation, the side sliding operation input by the user in the left navigation window or the right navigation window is used to trigger the folding screen mobile phone to return to the previous interface or display the multi-window menu. Fig.11E As shown, the user inputs a sliding operation from outside to inside on the left or right side of the foldable screen mobile phone (i.e., the left navigation window or the right navigation window), and the foldable screen mobile phone displays as follows Fig.11F The return icon 40 is shown to return to the previous interface.

[0209] The user enters operation 2 in the left or right side of the foldable screen mobile phone (i.e., the left navigation window or the right navigation window), and if operation 2 indicates sliding from the outside to the inside and pausing (such as Fig.11G As shown), the folding screen mobile phone displays Fig.11H The multi-window icon 41 is shown. Afterwards, when certain conditions are met (such as the user continues to input and slides inward, or the pause time exceeds a certain length of time, etc.), the foldable screen mobile phone displays a multi-window menu (or multi-window application bar), such as Fig.11I As shown, the multi-window menu 42 may include an icon of at least one application, and each application icon in the at least one application icon is used to trigger the folding screen mobile phone to split the screen or display a floating window.

[0210] The above-mentioned multi-window icon and multi-window menu are displayed by the foldable screen mobile phone in response to receiving a specific operation input by the user (such as sliding from the outside to the inside and pausing) after the multi-window switch on the foldable screen mobile phone is turned on. Correspondingly, when the navigation mode is gesture navigation, if the multi-window switch is in the turned-on state, the above-mentioned original gesture navigation logic may include the side-slide return logic and multi-window logic corresponding to the side navigation window.

[0211] If the multi-window switch is not turned on, that is, it is in the off state, even if the specific operation is received, the foldable screen mobile phone will not respond to display the multi-window icon or multi-window menu. Correspondingly, when the navigation mode is gesture navigation, if the multi-window switch is in the off state, the above-mentioned original gesture navigation logic may include the side sliding return logic corresponding to the side navigation window.

[0212] Optionally, the user can Fig.12 The multi-window switch control 50 shown triggers the folding screen mobile phone to turn on or off the multi-window switch.

[0213] When the navigation mode is the three-button navigation mode, since the three-button navigation mode originally has a return button, the folding screen mobile phone may not return to the previous interface after receiving the side-swiping operation input by the user in the left navigation window or the right navigation window. If the multi-window switch is in the on state, the operation 2 input by the user in the left navigation window or the right navigation window is used to trigger the folding screen mobile phone to display the multi-window icon. Afterwards, after certain conditions are met, the folding screen mobile phone displays the multi-window menu. If the multi-window switch is in the off state, in response to the operation 2 input by the user in the left navigation window or the right navigation window, the folding screen mobile phone does not perform an action.

[0214] Correspondingly, when the navigation mode is a gesture navigation mode, if the multi-window switch is in an on state, the above-mentioned original gesture navigation logic may include the multi-window logic corresponding to the side navigation window.

[0215] Among them, optionally, the folding screen mobile phone can provide Fig.13 The navigation mode selection interface 51 is shown to allow the user to select a navigation mode.

[0216] In some embodiments, the above-mentioned gesture navigation window can intercept gesture events (startGesture), and the gesture event represents the operation input by the user in the gesture navigation window. In the case where the navigation mode is the three-button navigation mode, not only the bottom navigation window can intercept gesture events, but the monitor monitor also monitors gesture events. The folding screen mobile phone determines whether to display the quick service interface or execute actions such as menu, return to the desktop, or return to the previous interface according to the gesture events intercepted by the bottom navigation window and the gesture events monitored by the monitor. For example, the folding screen mobile phone can determine whether the position corresponding to the gesture event belongs to the valid area corresponding to the key corresponding to the three-button navigation according to whether the position corresponding to the gesture event belongs to the valid area corresponding to the key corresponding to the three-button navigation. If it does not belong (such as the relevant module returns false), the folding screen mobile phone can display the quick service interface. If it does, the folding screen mobile phone can perform actions such as displaying the menu, returning to the desktop, or returning to the previous interface. For example, the user inputs an upward sliding operation in the quick service pull-up hot zone in the bottom navigation window, and the folding screen mobile phone determines that the quick service pull-up hot zone does not belong to the valid area corresponding to the key corresponding to the three-button navigation, and can display the quick service interface. Among them, optionally, the quick service pull-up hot zone can be located in the lower left corner and / or lower right corner of the folding screen mobile phone.

[0217] It should be noted that in the three-button navigation mode, if the multi-window switch is in the off state, the side navigation window of the folding screen mobile phone stopsGesture and stops intercepting events, so there is no need to respond to user input operations in the side navigation window, such as side sliding operations.

[0218] In addition, the width of the above-mentioned side navigation window is fixed, and the height is adapted to the size of the device, that is, the size of the application window; the height of the bottom navigation window is fixed, and the width is adapted to the size of the device, that is, the size of the application window, so that the gesture navigation window can adapt to devices of different sizes and adapt to horizontal and vertical screen scenarios.

[0219] S403: When the foldable screen mobile phone enters the rear-mounted selfie state, the foldable screen mobile phone destroys the first gesture navigation window corresponding to the application window on the secondary screen.

[0220] The above application window refers to an application window of a camera application, which can be used to display the shooting interface 2. Optionally, the application window is also used to display an exit rear Selfie control, which is not on the shooting interface 2.

[0221] Among them, the type of the first gesture navigation window is type 1. When the type of the first gesture navigation window is type 1, the folding screen mobile phone in the rear selfie state cannot respond to the gesture operation input by the user on the screen part outside the application window of the camera application, that is, the size of the gesture hot zone is limited.

[0222] Exemplarily, the above type 1 may be TYPE_NAVIGATION_BAR_PANEL.

[0223] S404: The foldable screen mobile phone creates a second gesture navigation window corresponding to the application window, wherein the type of the second gesture navigation window is a target type.

[0224] The target type is used to enable the foldable screen mobile phone to respond to the gesture operation input by the user on the screen part outside the application window of the camera application, thereby increasing the size of the gesture hotspot. Exemplarily, the target type can be TYPE_MAGNIFICATION_OVERLAY.

[0225] In the embodiment of the present application, after the foldable screen mobile phone enters the rear selfie state, since the size of the shooting interface displayed on the secondary screen of the foldable screen mobile phone is smaller than the size of the shooting interface displayed on the main screen of the foldable screen mobile phone, in other words, the size of the application window of the camera application on the secondary screen of the foldable screen mobile phone is smaller than the size of the application window of the camera application on the main screen, and the size of the gesture navigation window is adapted to the size of the application window, resulting in the gesture navigation window corresponding to the application window on the secondary screen of the foldable screen mobile phone (such as Fig.14A The size of the gesture navigation window corresponding to the application window on the main screen is smaller than the size of the gesture navigation window corresponding to the application window on the secondary screen. Therefore, in order to increase the size of the gesture navigation window on the secondary screen, the foldable screen mobile phone can destroy the original gesture navigation window on the secondary screen. Afterwards, the foldable screen mobile phone can set the type of the gesture navigation window corresponding to the application window of the camera application as the target type, and then the foldable screen mobile phone can create a gesture navigation window corresponding to the application window of the camera application (i.e., the second gesture navigation window), and obtain a gesture navigation window of the target type.

[0226] Since the type of the second gesture navigation window corresponding to the application window is a target type, the folding screen mobile phone in the rear-mounted selfie state can respond to the user's input operations on the screen part outside the application window of the camera application, such as supporting full-screen return, and increasing the size of the gesture navigation window on the secondary screen, avoiding the inability of the folding screen mobile phone to respond normally to the user's input operations due to the small gesture navigation window.

[0227] In some embodiments, the second gesture navigation window may include a left navigation window (eg, Fig. 14B left navigation window as shown) and / or right navigation window as shown Fig. 14B The width of the left navigation window and the right navigation window is fixed, and the height can be adapted to application windows of different sizes.

[0228] Among them, optionally, the above-mentioned second gesture navigation window may include a bottom navigation window. Of course, considering that in the rear selfie scenario, the user's demand for using the quick service center is relatively small, therefore, the above-mentioned second gesture navigation window may not include the bottom navigation window, that is, the folding screen mobile phone may not create a bottom navigation window to disable the bottom navigation window. Accordingly, when the folding screen mobile phone receives the user input operation 1 (such as a swipe up operation) in the bottom area of ​​the folding screen mobile phone, the folding screen mobile phone will not respond to enter the quick service center.

[0229] S405. When the navigation mode of the foldable screen mobile phone is the three-button navigation mode, if the multi-window switch is in the on state, the foldable screen mobile phone removes the multi-window logic corresponding to the second gesture navigation window and adds a side-slide exit logic to the second gesture navigation window.

[0230] In the embodiment of the present application, the navigation mode of the foldable screen mobile phone is a three-button navigation mode, and the multi-window switch is in the on state, indicating that the multi-window logic needs to be run, that is, the foldable screen mobile phone responds to the relevant operations input by the user, displays the multi-window icon, multi-window menu, etc., so that the user can use the multi-window menu to trigger the foldable screen mobile phone to display the interface of other applications in split screen or floating window form. In other words, the multi-window logic is used to trigger the foldable screen mobile phone to display the interfaces of multiple applications at the same time.

[0231] Taking into account that in the photo-taking scenario, the possibility of users using other applications at the same time is small, there is no need to split the screen or display a floating window, so that the foldable screen mobile phone can stop running the multi-window logic, so that even if the user enters related operations in the right navigation window or the left navigation window (such as operation 2), the foldable screen mobile phone will not display the multi-window icon or multi-window menu, thereby avoiding the foldable screen mobile phone mistakenly responding to split screen or displaying a floating window due to the user accidentally touching the application icon in the multi-window menu, thereby affecting user use.

[0232] In order to facilitate users to trigger the foldable screen phone to exit the rear-camera selfie state, the foldable screen phone can add a side-sliding exit logic to the second gesture navigation window, that is, run the side-sliding exit logic, so that after receiving the side-sliding operation input by the user in the second gesture navigation window, the foldable screen phone exits the rear-camera selfie state, realizes the side-sliding exit function under the three-button navigation, provides a new rear-camera selfie exit method, facilitates users to trigger the foldable screen phone to exit the rear-camera selfie, and improves the convenience of user operation.

[0233] Optionally, the above-mentioned side-slide exit logic further indicates that after a side-slide operation is input in the left navigation window or the right navigation window, in response to the side-slide operation, the folding screen mobile phone displays a return icon to exit the rear selfie state. The display of the return icon may be before exiting the rear selfie state or at the same time, and this application does not limit it.

[0234] In some embodiments, since the three-button navigation is achieved by monitoring gesture events, that is, user input operations, even if there is no bottom navigation window on the secondary screen, the folding screen mobile phone can still implement the three-button navigation function normally to ensure normal use by the user.

[0235] S406. When the navigation mode of the foldable screen mobile phone is the three-button navigation mode, if the multi-window switch is in the off state, the foldable screen mobile phone adds a side-slide exit logic for the second gesture navigation window.

[0236] In an embodiment of the present application, in the three-button navigation mode, when the multi-window switch is in the off state, it indicates that the folding screen mobile phone itself is not running the multi-window logic. Therefore, the folding screen mobile phone adds the side-slide exit logic corresponding to the second gesture navigation window without stopping the multi-window logic.

[0237] S407. When the navigation mode of the foldable screen mobile phone is gesture navigation, if the multi-window switch is in the on state, the foldable screen mobile phone removes the multi-window logic corresponding to the second gesture navigation window.

[0238] In the embodiment of the present application, under the gesture navigation mode, the folding screen mobile phone itself runs the side-slide exit logic. Therefore, there is no need to add the side-slide exit logic corresponding to the second gesture navigation window, and it is only necessary to stop running the multi-window logic.

[0239] In some embodiments, when the navigation mode is gesture navigation, if the multi-window switch is in the off state, the second gesture navigation window of the secondary screen of the folding screen mobile phone itself does not have a corresponding multi-window logic, so there is no need to stop running the multi-window logic.

[0240] In some embodiments, in gesture navigation mode or three-button navigation mode, if the multi-window switch is in the on state, the foldable screen mobile phone may not stop running the multi-window logic, that is, the above-mentioned action of removing the multi-window logic corresponding to the second gesture navigation window may not be performed, thereby satisfying the user's need to use multi-window services (i.e., multi-window application bar).

[0241] S408. The foldable screen mobile phone receives a side-slide operation input by the user in the second gesture navigation window.

[0242] S409. The foldable screen mobile phone responds to the above-mentioned side sliding operation and displays a shooting interface 3 on the main screen of the foldable screen mobile phone. The shooting interface 3 includes a preview area and a rear selfie control.

[0243] Among them, the above-mentioned side-sliding operation refers to sliding from the outside to the inside. For example, the user inputs a side-sliding operation on the left side (i.e., the left navigation window) or the right side (i.e., the right navigation window) of the secondary screen of the folding screen mobile phone. Since the gesture navigation windows on the secondary screen (such as the left navigation window and the right navigation window) have corresponding side-sliding exit logic, the folding screen mobile phone can respond to the side-sliding operation, exit the rear selfie state, and switch from the secondary screen display to the main screen display. The shooting interface 3 is displayed on the main screen of the folding screen mobile phone, and the shooting interface 3 (or referred to as the third shooting interface) includes a preview area and a rear selfie control.

[0244] In some embodiments, when the foldable screen mobile phone exits the rear selfie state, the foldable screen mobile phone can update the display mode identifier, such as updating the display mode identifier to the main screen display identifier.

[0245] In an embodiment of the present application, after entering the rear-camera selfie state, since the physical size of the secondary screen has changed, that is, the size of the application window has changed, if the type of the gesture navigation window on the application window of the secondary screen is still consistent with the type of the gesture navigation window on the application window of the main screen, the full-screen gesture cannot be implemented due to the scaling of the application window, thereby limiting the size of the gesture hot zone that can receive user input operations, and further causing the foldable screen mobile phone to not respond to the user's side-swiping operations input in certain areas on the side of the secondary screen, and unable to achieve full-screen return.

[0246] In some embodiments, the foldable screen mobile phone may not destroy the first gesture navigation window, so there is no need to create a second gesture navigation window corresponding to the application window. Accordingly, the second gesture navigation window in S405-S408 above can be replaced with the first gesture navigation window, so that the user can trigger the foldable screen mobile phone to exit the rear selfie control by inputting a side swipe operation in the left navigation window or the right navigation window in the first gesture navigation window.

[0247] In some embodiments, in the rear selfie state, if the secondary screen of the foldable screen mobile phone displays the shooting interface, then after the user inputs the side-slide operation, the foldable screen mobile phone can respond to exit the rear selfie state. If the secondary screen of the foldable screen mobile phone displays other interfaces, such as the user clicks on the gallery (or album) control of the shooting interface, and the foldable screen mobile phone displays the album interface, then after receiving the side-slide operation input by the user, the foldable screen mobile phone responds to the side-slide operation and returns to the previous interface. In other words, in the shooting scene, the side-slide operation is used to trigger the exit of the rear selfie state. In the non-shooting scene, the side-slide operation is used to trigger the return to the previous interface.

[0248] S410. When the foldable screen mobile phone exits the rear selfie state, the main screen of the foldable screen mobile phone displays the shooting interface 3.

[0249] S411. The foldable screen mobile phone destroys the third gesture navigation window corresponding to the shooting interface 3. The type of the third gesture navigation window is a target type.

[0250] S412: The foldable screen mobile phone creates a fourth gesture navigation window corresponding to the shooting interface 3. The type of the fourth gesture navigation window is type 1.

[0251] The third gesture navigation window corresponding to the shooting interface 3 refers to the application window of the main screen, that is, the gesture navigation window on the application window of the camera application.

[0252] In the embodiment of the present application, since the physical size of the main screen of the folding screen mobile phone is larger than the physical size of the secondary screen, that is, the size of the application window of the main screen is larger than the application window of the secondary screen. Therefore, there is no need to make the gesture navigation window on the application window, that is, the type of the gesture navigation window corresponding to the application window, the target type in order to realize the full-screen gesture. Based on this, the folding screen mobile phone can first destroy the third gesture navigation window of the main screen whose type is the target type. After that, the folding screen mobile phone can set the gesture navigation window on the application window of the main screen to be type 1, and then create the corresponding gesture navigation window (that is, the fourth gesture navigation window). Compared with the target type, type 1 has a higher level, thereby ensuring that the gesture navigation window intercepts gesture events.

[0253] Optionally, the third gesture navigation window does not include a bottom navigation window, and the fourth gesture navigation window may include a bottom navigation window. Exemplarily, the fourth gesture navigation window may include a side navigation window and a bottom navigation window, and the side navigation window may include a left navigation window and / or a right navigation window (such as the above Fig.11A or Fig. 11B shown).

[0254] S413. The foldable screen mobile phone restores the original gesture navigation logic corresponding to the fourth gesture navigation window.

[0255] In an embodiment of the present application, since the user has the need to use multi-window service or quick service after exiting the post-selfie state, that is, during the main screen or full-screen display, the folding screen mobile phone can restore the original gesture navigation logic. Among them, the original gesture navigation logic can refer to the description corresponding to S402 above. For example, add quick service startup logic to the bottom navigation curtain in the fourth gesture navigation window. In the three-button navigation mode, if the multi-window switch is in the on state, add multi-window logic to the side navigation window in the fourth gesture navigation window, and remove the side-slide exit logic. If the multi-window switch is in the off state, remove the side-slide exit logic.

[0256] In gesture navigation mode, if the multi-window switch is turned on, add multi-window logic to the side navigation window in the fourth gesture navigation window.

[0257] It should be noted that there is no restriction on the order of execution of the two processes described above, namely, the foldable screen mobile phone controls the rotation of the shooting interface displayed on the secondary screen of the foldable screen mobile phone and the foldable screen mobile phone exits the rear selfie state by sliding sideways. That is to say, the foldable screen mobile phone can exit the rear selfie state by sliding sideways after controlling the rotation of the shooting interface displayed on the secondary screen of the foldable screen mobile phone. Alternatively, the foldable screen mobile phone can first exit the rear selfie state by sliding sideways, and then, after entering the rear selfie state, the foldable screen mobile phone controls the rotation of the shooting interface displayed on the secondary screen of the foldable screen mobile phone. Alternatively, the foldable screen mobile phone can exit the rear selfie state by sliding sideways during the process of controlling the rotation of the shooting interface displayed on the secondary screen of the foldable screen mobile phone.

[0258] Furthermore, the above-described foldable screen mobile phone controlling the rotation of the shooting interface displayed on the secondary screen of the foldable screen mobile phone and the foldable screen mobile phone exiting the rear selfie state through a side swiping operation are two decoupled processes, that is, the foldable screen mobile phone can only execute the process of controlling the rotation of the shooting interface displayed on the secondary screen of the foldable screen mobile phone, or only execute the process of exiting the rear selfie state through a side swiping operation. Alternatively, it can execute both the process of controlling the rotation of the shooting interface displayed on the secondary screen of the foldable screen mobile phone and the process of exiting the rear selfie state through a side swiping operation.

[0259] The following will combine the above Figure 5 The framework shown introduces the specific implementation process of the folding screen mobile phone controlling the rotation of the shooting interface displayed on the secondary screen of the folding screen mobile phone and exiting the rear selfie state through a side sliding operation in the rear selfie scene. The specific implementation process may include Fig.15 S1-S16 shown.

[0260] S1. The camera application receives a user's click operation on the rear selfie control on the shooting interface 1 displayed on the main screen of the foldable screen mobile phone.

[0261] S2. In response to a click operation on the rear selfie control, the camera application calls the switching interface provided by the folding screen management module to switch to the rear selfie state.

[0262] Among them, the switching interface is used to implement screen switching control.

[0263] S3. The folding screen management module updates the display mode identifier to the secondary screen display identifier, and updates the device status identifier to the rear selfie status identifier.

[0264] Exemplarily, the above-mentioned device state identifier (such as foldState, or deviceState) may include at least one of a rear selfie identifier, a flat identifier, and a closed identifier. Among them, the rear selfie identifier indicates that the foldable screen mobile phone is in a rear selfie state, the flat identifier indicates that the device state of the foldable screen mobile phone is an unfolded state, and the closed identifier indicates that the device state of the foldable screen mobile phone is a folded state. Specifically, the field corresponding to the deviceState may be DEVICE_STATE_SUB or DEVICE_STATE_REAR.

[0265] In some embodiments, the above-mentioned rear selfie logo may include an inner folding device rear selfie logo and / or an outer folding device rear selfie logo. Among them, for a folding screen mobile phone whose folding method is an outer folding method, when entering the rear selfie state, the folding screen management module may update the device status logo to the outer folding device rear selfie logo. For a folding screen mobile phone whose folding method is an inner folding method, when entering the rear selfie state, the folding screen management module may update the device status logo to the inner folding device rear selfie logo.

[0266] In the embodiment of the present application, the camera application calls the switching interface provided by the folding screen management module, and the folding screen management module refreshes the display mode identifier and the device status identifier. After refreshing the display mode identifier and the device status identifier, the folding screen management module can broadcast the display mode identifier and the device status identifier to inform the module or device registered to monitor the display mode identifier that the display mode identifier has changed, and the module or period registered to monitor the device status identifier that the device status identifier has changed.

[0267] S1-S3 above introduced the process of refreshing the display mode identifier and the device status identifier after entering the rear selfie state. The following will continue to use the device status identifier to implement the process of exiting the rear selfie state by sliding sideways.

[0268] S4. The gesture navigation module detects that the display mode identifier has changed.

[0269] In some embodiments, the gesture navigation module registers the monitoring display mode identifier. Therefore, after the display mode identifier changes, the gesture navigation module can monitor the corresponding broadcast message in time. Optionally, the gesture navigation module can be registered when the device is turned on.

[0270] S5. When the current display mode identifier is a secondary screen display identifier and the previous display mode identifier is not a secondary screen display identifier, the gesture navigation module calls a destruction interface provided by the window manager to destroy the first gesture navigation window corresponding to the application window of the camera application on the secondary screen.

[0271] S6. The gesture navigation module calls a drawing interface provided by the window manager to draw a second gesture navigation window corresponding to the application window, wherein the second gesture navigation window is of a target type.

[0272] In some embodiments, the above-mentioned destruction interface is used to realize the removal of the gesture navigation window on the secondary screen, and the above-mentioned drawing interface is used to realize the creation of the gesture navigation window on the secondary screen. Exemplarily, the destruction interface and the drawing interface can be related interfaces provided by surfaceflinger.

[0273] S7. When the navigation mode of the foldable screen mobile phone is the three-button navigation mode, if the multi-window switch is on, the gesture navigation module removes the multi-window logic corresponding to the second gesture navigation window and adds the side-slide exit logic.

[0274] S8. When the navigation mode of the foldable screen mobile phone is the three-button navigation mode, if the multi-window switch is in the off state, the gesture navigation module adds a side-slide exit logic for the second gesture navigation window.

[0275] S9. When the navigation mode of the foldable screen mobile phone is gesture navigation, if the multi-window switch is in the on state, the gesture navigation module removes the multi-window logic corresponding to the second gesture navigation window.

[0276] S4-S9 above introduced the process of exiting the rear-camera selfie state within the side-sliding time limit. The following will combine S10-S16 to introduce the specific implementation process of rotating the shooting interface displayed on the secondary screen of a foldable screen mobile phone in the rear-camera selfie state.

[0277] S10: A first sensor service module in the sensor service monitors a change in a device status identifier.

[0278] S11. When the device status identifier is a rear selfie identifier, the first sensor service module sends a rear selfie result to the second sensor service module in the sensor service, wherein the rear selfie result is used to indicate that the folding screen mobile phone enters a rear selfie state.

[0279] In some embodiments, the sensor service (such as the first sensor service module) registers the monitoring device status identifier. Therefore, after the device status identifier changes, the first sensor service module can monitor the corresponding broadcast message in time. Optionally, the first sensor service module can be registered when the device is turned on.

[0280] In the embodiment of the present application, since the sensor service itself has registered the monitoring device status identifier, in order to reduce the amount of modification to the business logic, that is, to reduce the amount of modification to the code, there is no need to change the registration of the sensor service. It is only necessary to add a new device status identifier (that is, the rear-selfie identifier) ​​indicating the rear-selfie status, so that the registered sensor service can be informed that the folding screen mobile phone has entered the rear-selfie state.

[0281] Among them, optionally, the sensor service can also register to monitor the display mode identifier, so as to use the display mode identifier to determine whether the foldable screen mobile phone enters the rear selfie state.

[0282] S12: In response to the post-selfie result, the second sensor service module in the sensor service corrects the acquired motion data of the target motion sensor.

[0283] The second sensor service module may poll and obtain the motion data collected by the target motion sensor.

[0284] S13. The second sensor service module broadcasts the corrected motion data.

[0285] S14, the application registered for monitoring motion data receives the corrected motion data, wherein the application registered for monitoring motion data includes a camera application.

[0286] In some embodiments, applications in the foldable screen mobile phone that need to use motion data can register to monitor the motion data of the target motion sensor when they are started. Of course, they can also register at other times, such as when the phone is turned on.

[0287] It should be understood that after the camera application registers to monitor the motion data, after the sensor service broadcasts the corrected motion data, the camera application can directly receive the corrected motion data.

[0288] S15. The camera application determines a first flipping direction according to the corrected motion data.

[0289] S16. The camera application rotates the target control in the shooting interface 2 displayed on the secondary screen according to the first flipping method.

[0290] In some embodiments, S1-S16 above introduces the process of entering the rear-camera selfie state, and the process of exiting the rear-camera selfie can refer to the relevant description of the process of entering the rear-camera selfie, except that the sensor service does not need to correct the motion data, and the gesture navigation module restores the original gesture navigation logic.

[0291] In the present application embodiment, Fig.16As shown, the sensor service in the foldable screen mobile phone polls the sensor event buffer (sensoreventbuffer) to obtain sensor events, and the sensor event includes the motion data corresponding to the target motion sensor. When it is determined that the foldable screen mobile phone enters the rear selfie state, the sensor service can correct the motion data, that is, the motion data in the X direction and the motion data in the Z direction in the motion data are respectively reversed. Afterwards, the sensor service can broadcast the corrected motion data, that is, broadcast the corrected sensor events, so that the registered listening applications can receive the corrected motion data, so that the applications can obtain accurate motion data.

[0292] When it is determined that the foldable screen mobile phone has exited the rear selfie state, the acquired motion data can be directly broadcast, that is, the sensor event is broadcast, so that the application registered for monitoring can receive the motion data and ensure the accuracy of the motion data.

[0293] In the present application embodiment, Fig.17 As shown, after the camera application receives the user's click operation on the rear selfie control, the device status management module in the folding screen management module updates the device status identifier to the rear selfie identifier, and the camera application calls the switching interface provided by the display management module in the folding screen management module to perform screen switching control, so that the secondary screen of the folding screen mobile phone displays the shooting interface of the camera application. In addition, the display management module updates the display mode identifier to the secondary screen display identifier and broadcasts the display mode identifier.

[0294] Afterwards, after the mobile phone navigation module listens to the broadcast message of the display mode identifier, it determines that the folding screen mobile phone enters the rear selfie state according to the display mode identifier. Afterwards, the gesture navigation module can update the gesture navigation window of the secondary screen (such as removing the original gesture navigation window and creating a new gesture navigation window) and change the gesture navigation logic (such as adding a side-slide exit logic). Afterwards, after the user inputs a side-slide operation on the secondary screen, the sensor service can obtain gesture events (such as side-slide events) based on the sensor channel and using the sensor driver. Afterwards, the sensor service can send the side-slide event to the device status management module. The device status management module updates the device status identifier to a closed identifier. Afterwards, the device status management module sends the side-slide event to the display management module. In response to the side-slide event, the display management module updates the display mode identifier to the main screen display identifier and performs screen switching control, so that the main screen of the folding screen mobile phone displays the shooting interface of the camera application, realizing the exit from the rear selfie state.

[0295] In addition, the sensor service uses the sensor driver based on the sensor channel to obtain the acceleration data collected by the accelerometer and the angular velocity data collected by the gyroscope. After that, the sensor service corrects the acceleration data and angular velocity data and broadcasts the corrected acceleration data and angular velocity data. After the camera application monitors the corrected acceleration data and angular velocity data, it uses the corrected acceleration data and angular velocity data to control the rotation of the target control in the shooting interface displayed on the secondary screen.

[0296] In some embodiments, the present application provides a computer-readable storage medium, including computer instructions, which, when executed on an electronic device, enable the electronic device to execute the method described above.

[0297] In some embodiments, the present application provides a computer program product, which, when executed on an electronic device, enables the electronic device to execute the method described above.

[0298] In addition, an embodiment of the present application also provides a device, which can be a chip, a component or a module, and the device may include a connected processor and a memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory, so that the chip executes the various functions or steps performed by the mobile phone in the above method embodiment. Among them, the electronic device, communication system, computer-readable storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding method provided above, so the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0299] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0300] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0301] The unit described as a separate component may or may not be physically separated, and the component shown as a unit may be one physical unit or multiple physical units, that is, it may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.

[0302] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0303] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of each embodiment method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store program code.

[0304] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present application and are not intended to limit it. Although the present application has been described in detail with reference to the preferred embodiments, a person of ordinary skill in the art should understand that the technical solution of the present application may be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the present application.

Claims

1. A shooting interface display method, characterized in that: Applied to a folding screen device, the method includes: The first screen of the folding screen device displays a first shooting interface; the first screen and the rear camera of the folding screen device are on the same surface; the first shooting interface includes a target control; When the folding screen device is flipped, the first screen displays a second shooting interface, the second shooting interface and the first shooting interface include the same controls, the target control in the second shooting interface is rotated relative to the target control in the first shooting interface, and the rotation direction of the target control is consistent with the flipping direction of the folding screen device; the rotation direction of the target control is determined based on the corrected motion data; the motion data is collected by the target motion sensor of the folding screen device.

2. The method according to claim 1, characterized in that The motion data includes motion data in an X direction, motion data in a Y direction, and motion data in a Z direction; and the correction refers to inverting the motion data in the X direction and the motion data in the Z direction.

3. The method according to claim 1 or 2, characterized in that: The first screen is back to back with the second screen of the folding screen device; the direction indicated by the motion data before correction is based on the orientation of the second screen, and the direction indicated by the motion data after correction is based on the orientation of the first screen.

4. The method according to any one of claims 1 to 3, characterized in that The folding method of the folding screen device is an outward folding method; The method further comprises: Receive a side-slide operation inputted by the user on the first screen; When the navigation mode of the folding screen device is a three-button navigation mode, the folding screen mobile phone responds to the side-sliding operation, and the second screen of the folding screen device displays a third shooting interface.

5. The method according to claim 4, characterized in that The method further comprises: The foldable screen device destroys a first gesture navigation window on the first screen, where the type of the first gesture navigation window is a first type, and the first type is used to prevent the foldable screen device from responding to an operation input by a user on a screen portion other than an application window on the first screen; the application window is used to display an application interface; The folding screen device creates a second gesture navigation window on the first screen, where the type of the second gesture navigation window is a target type, and the target type is used to enable the folding screen device to respond to an operation input by a user on a screen portion other than an application window on the first screen; The folding screen device adds a side-slide exit logic to the second gesture navigation window; wherein the side-slide exit logic indicates that after a side-slide operation is input in the second gesture navigation window, the folding screen device responds to exit the post-selfie state.

6. The method according to claim 5, characterized in that The method further comprises: If the multi-window switch of the folding screen device is in the on state, the folding screen device removes the multi-window logic corresponding to the second gesture navigation window; the multi-window logic is used to support the folding screen device to display the application interfaces of multiple applications at the same time.

7. The method according to claim 5, characterized in that The method further comprises: In the case where the navigation mode of the folding screen device is gesture navigation, if the multi-window switch of the folding screen device is in the on state, the folding screen device removes the multi-window logic corresponding to the second gesture navigation window; wherein the second gesture navigation window has corresponding side-slide exit logic.

8. The method according to any one of claims 5 to 7, characterized in that The first gesture navigation window includes a side navigation window and a bottom navigation window, and the second gesture navigation window includes a side navigation window.

9. The method according to any one of claims 5 to 8, characterized in that The folding screen device destroys the first gesture navigation window on the first screen, including: When the current display mode identifier is a secondary screen display identifier and the previous display mode identifier is not a secondary screen display identifier, the folding screen device destroys the first gesture navigation window.

10. The method according to any one of claims 5 to 9, characterized in that The method further comprises: The folding screen device destroys a third gesture navigation window on the second screen, where the type of the third gesture navigation window is a target type; The folding screen device creates a fourth gesture navigation window on the second screen, where the type of the fourth gesture navigation window is the first type; The folding screen device removes the slide exit logic corresponding to the fourth gesture navigation window.

11. The method according to claim 4, characterized in that The method further comprises: The folding screen device adds a slide-out exit logic to the first gesture navigation window on the first screen.

12. The method according to any one of claims 1 to 11, characterized in that The method further comprises: When the device status identifier is a rear selfie identifier, the folding screen device corrects the motion data.

13. The method according to any one of claims 1 to 12, characterized in that The first screen of the folding screen device displays a first shooting interface, including: The second screen of the folding screen device displays a fourth shooting interface; The folding screen device receives a first operation of the user on the fourth shooting interface; the first operation is used to trigger the folding screen device to enter a rear selfie state; In response to the first operation, the folding screen device displays the first shooting interface on the first screen.

14. An electronic device, characterized in that: The electronic device includes a display screen, a memory and one or more processors; the display screen, the memory and the processor are coupled; the display screen is used to display an image generated by the processor, the display screen includes a folding screen, and the memory is used to store computer program code, and the computer program code includes computer instructions; when the processor executes the computer instructions, the electronic device executes the method described in any one of claims 1 to 13.

15. A computer-readable storage medium, characterized in that: The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method according to any one of claims 1 to 13.

Images