Collaborative shooting method, electronic device, storage medium and program product

Abstract

The embodiments of the present application disclose a collaborative shooting method, an electronic device, a storage medium and a program product, which belong to the field of terminal technology. The method is applied to an electronic device including a first display screen and a second display screen, wherein the first display screen is arranged on the front of the electronic device, and the second display screen is arranged on the back of the electronic device. The electronic device detects a camera opening operation, starts a camera application, and displays a first preview screen taken by the camera application on the first display screen. When the collaborative shooting function is detected to be turned on, the first preview screen is displayed on the second display screen. If it is detected that the current state of the electronic device does not meet the collaborative shooting conditions, the display of the first preview screen on the second display screen is turned off. In this way, the two display screens arranged back to back can synchronously display the camera preview screen, so that the person being photographed can also intuitively see the shooting effect. In addition, by automatically turning off the collaborative display when the collaborative shooting conditions are not met, the flexibility of collaborative shooting is improved.

Description

Technical Field

[0001] The present application relates to the field of electronic technology, and in particular to a collaborative shooting method, electronic equipment, storage medium and program product. Background Art

[0002] Currently, when people use the rear camera of a foldable phone to take photos, the person being photographed cannot view a preview of themselves through the external screen of the foldable phone, and thus cannot directly see the imaging effect of themselves in the rear camera. They can only move their position or adjust their appearance according to the instructions or prompts of others to improve the imaging effect. Figure 1 As shown in Figure (a), the photographer 10 uses the foldable screen mobile phone 100 to take a photo of the subject 20. The external screen A of the foldable screen mobile phone 100 displays a standby screen (such as date and time). The subject 20 cannot view the shooting preview screen through the external screen A of the foldable screen mobile phone 100, resulting in a poor user experience. Summary of the invention

[0003] The present application provides a collaborative shooting method, electronic device, storage medium and program product, which can solve the problem of low flexibility of shooting methods in related technologies. The technical solution is as follows:

[0004] In a first aspect, a collaborative shooting method is provided, which is applied to an electronic device, wherein the electronic device includes a first display screen and a second display screen, wherein the first display screen is disposed on a front side of the electronic device, and the second display screen is disposed on a back side of the electronic device; the method includes:

[0005] When a camera opening operation is detected, the camera application is started; a first preview picture captured by the camera application is displayed on the first display screen; when a collaborative shooting function start operation is detected, the first preview picture is displayed on the second display screen; when a current state of the electronic device is detected not satisfying the collaborative shooting conditions, the display of the first preview picture on the second display screen is turned off.

[0006] By displaying the first preview screen shot on the first display screen on the second display screen when the collaborative shooting function is detected to be turned on, the first display screen and the second display screen can synchronously display the camera preview screen. In this way, when the photographer uses the electronic device to take a photo of the subject, the photographer can intuitively see the shooting effect through the first preview screen displayed on the first display screen, and the subject can also intuitively see the shooting effect through the first preview screen displayed on the second display screen, which is convenient for the subject to adjust his or her posture and position according to the first preview screen to obtain a better shooting effect. In addition, by automatically turning off the display of the first preview screen on the second display screen when the current state of the electronic device does not meet the collaborative shooting conditions, the flexibility of collaborative shooting can be improved and the user's shooting experience can be improved.

[0007] The collaborative shooting function is used to control the second display screen to display collaboratively with the first display screen, that is, to control the second display screen to display the first preview screen of the first display screen.

[0008] In some embodiments, the collaborative shooting function can realize the collaborative display of the second display screen and the first display screen by calling the relevant interface of DisplayManager in the application framework layer. DisplayManager is used to realize the collaborative display of the second display screen and the first display screen.

[0009] The collaborative shooting condition refers to a condition for synchronously displaying the first preview image on the second display screen. For example, the collaborative shooting condition includes one or more of the following conditions: the camera application is in the foreground running state, the shooting mode of the camera application is in the first shooting mode that supports the collaborative shooting function, the shooting mode of the camera application is in the shooting mode that uses the rear camera for shooting, and the foldable screen is in the unfolded state, and the foldable screen is the first display screen or the second display screen.

[0010] The first shooting mode may include one or more of the following shooting modes: photo mode, portrait mode, video mode, and movie mode. Of course, other shooting modes may also be included. The shooting mode of the unsupported collaborative shooting function corresponding to the first shooting mode includes at least a selfie mode, and of course, other shooting modes may also be included.

[0011] Among them, the first preview picture displayed on the second display screen can be obtained by copying or mirroring the shooting picture of the camera application, that is, the first preview picture displayed on the second display screen can be a copy picture or a mirror picture of the shooting picture of the camera application.

[0012] For the sake of convenience, the first preview screen displayed on the first display screen may be referred to as the shooting screen of the first display screen, and the first preview screen displayed on the second display screen may be referred to as the mirrored screen of the shooting screen of the first display screen. The mirrored screen may be a duplicated screen or a mirrored screen of the shooting screen of the first display screen.

[0013] In some embodiments, the first preview picture displayed on the first display screen and the second preview picture displayed on the second display screen may be displayed in the same proportion, that is, displayed in the same aspect ratio.

[0014] In some embodiments, after the collaborative shooting function is detected to be turned on, a second preview screen may be displayed on the second display screen, where the second preview screen is a mirror image of the first preview screen.

[0015] As an example, detecting that the current state of the electronic device does not meet the collaborative shooting condition and turning off display of the first preview image on the second display screen may include one or more of the following situations:

[0016] When a closing operation of the collaborative shooting function is detected, the display of the first preview image on the second display screen is closed;

[0017] Detecting a closing operation of the camera application, closing the display of the first preview image on the second display screen;

[0018] When detecting that the camera application switches from the foreground to the background, closing the display of the first preview image on the second display screen;

[0019] When detecting that the camera application switches from a first shooting mode supporting the collaborative shooting function to a second shooting mode not supporting the collaborative shooting function, turning off display of the first preview image on the second display screen;

[0020] When detecting that the camera application switches from the rear camera shooting mode to the front camera shooting mode, turning off the display of the first preview image on the second display screen;

[0021] When it is detected that the foldable screen of the electronic device switches from an unfolded state to an unfolded state, the display of the first preview screen by the second display screen is turned off. The foldable screen is the first display screen or the second display screen.

[0022] In some embodiments, when a folding operation on a foldable screen of an electronic device is detected, display of the first preview screen on the second display screen can be turned off, the foldable screen can be the first display screen or the second display screen, and the folding operation is used to fold the foldable screen from an unfolded state to an unfolded state.

[0023] In this way, when the user folds the first display screen or the second display screen, the collaborative shooting function can be automatically turned off. When the user folds the foldable screen, it means that the user may not want to use the foldable screen or take camera photos temporarily. At this time, automatically turning off the collaborative shooting function can save power consumption of the electronic device and improve user experience.

[0024] Furthermore, after detecting a folding operation on the foldable screen of the electronic device and closing the display of the first preview screen on the second display screen, it is also possible to detect an unfolding operation on the foldable screen and display the first preview screen on the second display screen, and the unfolding operation is used to unfold the foldable screen from an unexpanded state to an unfolded state.

[0025] In this way, when the user unfolds the first display screen or the second display screen, the collaborative shooting function can be automatically turned off. When the user unfolds the foldable screen, it means that the user may want to use the foldable screen or want to take a photo with the camera. At this time, the collaborative shooting function is automatically turned off, and the user does not need to manually turn on the collaborative shooting function, thereby improving shooting efficiency and the user's shooting experience.

[0026] In some embodiments, when the operation of switching the camera application from the first shooting mode to the second shooting mode is detected, the display of the first preview screen on the second display screen is turned off, that is, the collaborative shooting function is automatically turned off. In addition, if the operation of switching the camera application from the second shooting mode to the first shooting mode is detected, the first preview screen is displayed on the second display screen, that is, the collaborative shooting function is turned on again. In this way, the collaborative shooting function can be turned on or off according to the switching of the shooting mode of the camera application, thereby improving the flexibility of collaborative shooting.

[0027] In some embodiments, when the operation of switching the camera application from the rear camera shooting mode to the front camera shooting mode is detected, the display of the first preview screen on the second display screen is turned off, that is, the collaborative shooting function is automatically turned off. In addition, if the operation of switching the camera application from the front camera shooting mode to the rear camera shooting mode is detected, the first preview screen is displayed on the second display screen, that is, the collaborative shooting function is turned on again. In this way, the collaborative shooting function can be turned on or off according to the mode switching between the other shooting mode and the automatic mode of the camera application, thereby improving the flexibility of collaborative shooting.

[0028] In some embodiments, the application interface of the camera application displays a button to turn off the collaborative shooting function. If a click operation on the button is detected, the display of the first preview screen on the second display screen is turned off, that is, the collaborative shooting function is turned off. In addition, the application interface of the camera application displays a button to turn on the collaborative shooting function. If a click operation on the button is detected, the display of the first preview screen is displayed on the second display screen, that is, the collaborative shooting function is turned on. In this way, the user can flexibly turn on or off the button to turn off the collaborative shooting function through the relevant button of the collaborative shooting function.

[0029] In some embodiments, when the operation of switching the camera application to the background is detected, the display of the first preview image on the second display screen is turned off, that is, the collaborative shooting function is automatically turned off. In addition, when the operation of switching the camera application from the background to the foreground is detected, the first preview image is displayed on the second display screen.

[0030] In some embodiments, when a camera closing operation is detected, the camera application is closed, and the display of the first preview image on the second display screen is closed, that is, the collaborative shooting function is automatically closed. In addition, when a camera opening operation is detected, the camera application is restarted, and the first preview image is displayed on the second display screen, that is, the collaborative shooting function is reopened.

[0031] In some embodiments, after the camera application is started, it can also detect whether the current state of the electronic device meets the collaborative shooting conditions; if it is detected that the current state meets the collaborative shooting conditions, the switch button of the collaborative shooting function is displayed in the application interface of the camera application; if it is detected that the current state of the electronic device does not meet the collaborative shooting conditions, the switch button of the collaborative shooting function is not displayed in the application interface of the camera application.

[0032] In some embodiments, after detecting that the current state of the electronic device does not satisfy the collaborative shooting condition and turning off the display of the first preview screen on the second display screen, the switch button of the collaborative shooting function may not be displayed in the application interface of the camera application.

[0033] For example, after the camera application switches from the first shooting mode to the second shooting mode, the switch button of the collaborative shooting function is not displayed on the application interface of the camera application. Or, after the camera application switches from the rear camera shooting mode to the front camera shooting mode, the switch button of the collaborative shooting function is not displayed on the application interface of the camera application.

[0034] In some embodiments, when it is detected that the current state of the electronic device does not meet the collaborative shooting condition, the second display screen turns off the display of the first preview screen, and if the duration of the state of the electronic device not meeting the collaborative shooting condition is longer than a preset duration, the switch button of the collaborative shooting function is not displayed in the application interface of the camera application. In this way, when the electronic device does not meet the collaborative shooting condition for a long time, the switch button of the collaborative shooting function can be not displayed in the application interface of the camera application.

[0035] For example, after the camera application switches from the first shooting mode to the second shooting mode, if the camera application is in the second shooting mode for a time period longer than a preset time period, the switch button for the collaborative shooting function is not displayed on the application interface of the camera application.

[0036] In a second aspect, a collaborative shooting device is provided, which has the function of implementing the collaborative shooting method in the first aspect. The collaborative shooting device includes at least one module, and the at least one module is used to implement the collaborative shooting method provided in the first aspect.

[0037] In a third aspect, a collaborative shooting device is provided, wherein the structure of the collaborative shooting device includes a processor and a memory, wherein the memory is used to store a program that supports the collaborative shooting device to execute the collaborative shooting method provided in the first aspect, and to store data involved in implementing the collaborative shooting method described in the first aspect. The processor is configured to execute the program stored in the memory. The collaborative shooting device may also include a communication bus, wherein the communication bus is used to establish a connection between the processor and the memory.

[0038] In a fourth aspect, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is executed on a computer, the computer executes the collaborative shooting method described in the first aspect.

[0039] In a fifth aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the collaborative shooting method described in the first aspect.

[0040] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0041] In an embodiment of the present application, the electronic device includes a first display screen and a second display screen, the first display screen is arranged on the front of the electronic device, and the second display screen is arranged on the back of the electronic device. The electronic device detects the camera opening operation, starts the camera application, and displays the first preview screen obtained by shooting through the camera application on the first display screen. When the collaborative shooting function is detected to be turned on, the first preview screen is displayed on the second display screen. Afterwards, if the current state of the electronic device is detected to not meet the collaborative shooting condition, the display of the first preview screen on the second display screen is turned off. By displaying the first preview screen shot on the first display screen on the second display screen when the collaborative shooting function is detected to be turned on, the first display screen and the second display screen can be synchronized to display the camera preview screen. In this way, when the photographer uses the electronic device to take a photo of the photographed person, the photographer can intuitively see the shooting effect through the first preview screen displayed on the first display screen, and the photographed person can also intuitively see the shooting effect through the first preview screen displayed on the second display screen, so that the photographed person can adjust his posture and position according to the first preview screen to obtain a better shooting effect. In addition, by automatically turning off the display of the first preview screen on the second display screen when the current state of the electronic device does not meet the collaborative shooting condition, the flexibility of collaborative shooting can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 A schematic diagram showing a comparison between an application scenario of the current solution and an application scenario of an embodiment of the present application is shown;

[0043] Figure 2A schematic diagram showing the structure of a mobile phone according to an embodiment of the present application is shown;

[0044] Figure 3 A schematic diagram showing an implementation process of enabling the collaborative shooting function of a mobile phone in an embodiment of the present application;

[0045] Figure 4 A schematic diagram showing a process of turning on and off a collaborative shooting function of a camera application during foreground and background switching according to an embodiment of the present application;

[0046] Figure 5 A schematic diagram showing a process of turning on and off a collaborative shooting function during a shooting mode switching process of a camera application in an embodiment of the present application is shown;

[0047] Figure 6 A schematic diagram showing a process of turning on and off a collaborative shooting function during a process of switching shooting modes of front and rear cameras of a camera application according to an embodiment of the present application is shown;

[0048] Figure 7 A schematic diagram showing a process of turning on and off a collaborative shooting function during a change in the unfolded state of a folding screen of a mobile phone according to an embodiment of the present application;

[0049] Figure 8 A flowchart of a collaborative shooting method according to an embodiment of the present application is shown;

[0050] Fig. 9 A flowchart of another collaborative shooting method according to an embodiment of the present application is shown;

[0051] Fig.10 A flowchart of another collaborative shooting method according to an embodiment of the present application is shown;

[0052] Fig.11 According to some embodiments of the present application, a software structure framework diagram of a mobile phone for implementing the collaborative shooting method of the present application is shown;

[0053] Fig.12 Shows Fig.11 An interactive schematic diagram of the cooperation between various software structures to realize the method of the present application;

[0054] Fig.13 Shows Fig.11 Another interactive schematic diagram of the cooperation between various software structures to implement the method of the present application;

[0055] Fig.14 Shows Fig.11 A schematic diagram of another interaction of the method of the present application in which the various software structures cooperate with each other;

[0056] Fig.15 Shows Fig.11A schematic diagram of another interaction of the method of the present application in which the various software structures cooperate with each other;

[0057] Fig.16 Shows Fig.11 A schematic diagram of another interaction of the method of the present application in which the various software structures cooperate with each other;

[0058] Fig.17 A block diagram of a collaborative shooting device according to an embodiment of the present application is shown;

[0059] Fig.18 A schematic diagram of the hardware structure of the mobile phone 100 according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0060] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0061] It should be understood that the "multiple" mentioned in this application refers to two or more. In the description of this application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in order to facilitate the clear description of the technical solution of this application, the words "first" and "second" are used to distinguish between the same items or similar items with basically the same functions and effects. Those skilled in the art can understand that the words "first" and "second" do not limit the quantity and execution order, and the words "first" and "second" do not limit them to be different.

[0062] It should be noted that the collaborative shooting method of the present application is applicable to any multi-screen electronic device with a shooting function and screens on both sides, such as a folding screen mobile phone, a tablet computer, a smart wearable device, etc., and the present application does not limit this. For the sake of convenience of description below, the camera application in the folding screen mobile phone 100 will be used as an example for description, and the folding screen mobile phone 100 will be referred to as mobile phone 100. It can be understood that the technical solution of the present application is also applicable to other applications with shooting functions on electronic devices, not limited to camera applications.

[0063] It is understood that a structure of the mobile phone 100 can be as follows Figure 2 As shown, Figure 2 Figure (a) and Figure 2 (b) in FIG. 1 shows the unfolded state of the mobile phone 100. Figure 2 FIG. (c) in FIG. 1 shows the folded state of the mobile phone 100. Specifically, as shown in FIG. Figure 2As shown in Figure (a), the mobile phone 100 has an external screen A and a housing. The external screen A can display information such as the current time, network status, and power, and a camera P1 is provided on the external screen A. The housing is located on one side of the external screen A, and a camera P3 is provided on the housing. The camera P3 includes one or more cameras, for example, 3 cameras. Figure 2 Figure (b) shows the inner screen B of the mobile phone 100. It can be seen that the inner screen B can be divided into the inner screen area B-1 and the inner screen area B-2 when the mobile phone 100 is in the unfolded state. The camera P2 can be set on the inner screen area B-1 or the inner screen area B-2 of the mobile phone 100, and this application does not limit this. In addition, the back side of the inner screen area B-1 is the outer screen A, and the back side of the inner screen area B-2 is the shell; or, the back side of the inner screen area B-1 is the shell, and the back side of the inner screen area B-2 is the outer screen A.

[0064] Figure 2 Figure (c) shows a schematic diagram of the mobile phone 100 in a folded state. It can be seen that at this time, the inner screen B-1 and the inner screen B-2 are not displayed to the outside, and the outer screen A is displayed to the outside.

[0065] The above are schematic diagrams of the mobile phone 100 in the unfolded state and the folded state. It should be noted that, for the sake of convenience, the inner screen area B-1 and the inner screen area B-2 of the mobile phone 100 are collectively referred to as the inner screen B, and the unfolding angle and unfolding state of the inner screen B of the mobile phone 100 are used as the unfolding angle and unfolding state of the mobile phone 100. For example, Figure 2 In the figure (b), the screen B of the mobile phone 100 is in the unfolded state, and the mobile phone 100 is also in the unfolded state. Figure 2 In Figure (c), the inner screen B of the mobile phone 100 is in a folded state, and the mobile phone 100 is also in a folded state.

[0066] In addition, for the convenience of description, in the following description, it is assumed that the photographer faces the inner screen B and the person being photographed faces the outer screen A. Correspondingly, the camera P2 is called the front camera, and the cameras P1 and P3 are called the rear cameras. Alternatively, when the inner screen B is in the unfolded state, the camera P1 is not enabled, and correspondingly, the camera P2 is called the front camera, and the camera P3 is called the rear camera.

[0067] It can be understood that the collaborative shooting method of the present application is also applicable to the scenario where the shooter faces the external screen A and the person being shot faces the internal screen B. At this time, correspondingly, camera P2 is called the rear camera, and camera P1 and camera P3 are called the front camera 2. Alternatively, camera P1 is not enabled, camera P2 is called the rear camera, and camera P3 is called the front camera. Alternatively, camera P3 is not enabled, camera P2 is called the rear camera, and camera P1 is called the front camera.

[0068] As mentioned in the background technology, when people currently use the rear camera P3 of the mobile phone 100 to take pictures, the person being photographed cannot directly see his or her own imaging effect, which affects the user experience of the person being photographed. In order to solve this technical problem, some embodiments of the present application provide a collaborative shooting method applicable to a foldable screen electronic device.

[0069] Specifically, in the collaborative shooting method of some embodiments of the present application, when taking a photo using the rear camera P3 of the mobile phone 100, the inner screen B displays a first preview image of the content captured by the rear camera P3, and the outer screen A can also display the first preview image. That is, the inner screen B and the outer screen A can synchronously display the same captured content.

[0070] Among them, the first preview picture displayed on the external screen A can be a copy of the first preview picture displayed on the internal screen B, or it can be a mirror picture of the first preview picture. For the convenience of explanation, the first preview picture displayed on the external screen A is referred to as the shooting picture of the external screen A below. The first preview picture displayed on the internal screen B can be the shooting picture of the external screen A, or it can be a mirror picture of the shooting picture of the external screen A. The following takes the example that the first preview picture displayed on the internal screen B is a mirror picture of the shooting picture of the external screen A.

[0071] Specifically, in the collaborative shooting method of some embodiments of the present application, when taking pictures using the rear camera P3 of the mobile phone 100, the mirror image of the shooting picture displayed on the inner screen B of the mobile phone 100 can be displayed on the outer screen A of the folding screen mobile phone 100 (hereinafter referred to as the mirror image), so that the person being photographed can watch the picture currently captured by the camera P3 through the outer screen A of the folding screen mobile phone 100 when taking pictures, which is convenient for the person being photographed to adjust the posture. Among them, the mirror image of the shooting picture displayed on the inner screen B can be obtained by copying or mirroring the shooting picture displayed on the inner screen B.

[0072] For example Figure 1 As shown in (b), when the photographer 10 uses the rear camera P3 of the mobile phone 100 to take a photo of the subject 20, the shooting picture 101a captured by the camera P3 is displayed on the inner screen B facing the photographer, and at the same time, the mirror image 101b of the shooting picture 101a is displayed on the outer screen A of the folding screen mobile phone 100 facing the subject. In this way, the posture of the subject 20 seen by the subject 20 in the mirror image 101b of the outer screen A, the position of the subject 20 in the entire shooting picture, and other information are the same as those seen by the user 10 in the shooting picture 101a of the inner screen. In addition, in order to display the complete mirror image of the shooting picture 101a on the outer screen A, the size ratio (for example, the aspect ratio) of the shooting picture 101a and the mirror image 101b can be the same.

[0073] In this way, when the photographer uses the foldable screen mobile phone 100 to take a photo of the subject, the subject can also intuitively see the shooting effect through the mirror image displayed on the external screen A. In addition, when the mirror image displayed on the external screen A is a mirror image of the internal screen B display image, for the subject, the image displayed on the external screen A is similar to the image displayed when the subject looks in the mirror, so the subject can directly adjust his posture and position according to the image displayed on the external screen A to obtain a better shooting effect.

[0074] However, after the collaborative shooting function is activated, it may conflict with the user's operation of the phone or the status of the phone. In order to avoid conflicts between the user's operation or the phone's status and the collaborative shooting function, the application scenarios of the collaborative shooting function can be optimized to improve the user experience. For example, the application scenarios of the optimized collaborative shooting function may include the following:

[0075] The first application scenario: when the camera application supports the collaborative shooting function, the user turns on or off the collaborative shooting function by clicking a button related to collaborative shooting in the camera application interface.

[0076] For example, Figure 3 FIG. 1 shows an implementation process of the mobile phone 100 enabling the collaborative shooting function. Figure 3 As shown in Figure (a), when the inner screen B is in the unfolded state, when the photographer 10 opens the camera application, the inner screen B of the mobile phone 100 displays the camera application interface, which includes the currently captured shooting picture and some function buttons located on both sides of the camera application interface, and these function buttons include a collaborative shooting button for starting the collaborative shooting function, such as the collaborative shooting button 102 in the closed state. The collaborative shooting button 102 in the closed state is used to indicate that the collaborative shooting function is turned off at this time, and the external screen A displays information such as time. After the user clicks the collaborative shooting button 102, in response to the user's click operation, the mobile phone 100 starts the collaborative shooting function, and the collaborative shooting button 102 in the closed state is switched to the collaborative shooting button 103 in the open state, and the external screen A of the mobile phone 100 displays the mirror image 101b of the shooting picture 101a of the inner screen B mentioned above.

[0077] On the contrary, if the user clicks on the collaborative shooting button 103 that is in the turned-on state, in response to the user's click operation, the mobile phone 100 turns off the collaborative shooting function, and the collaborative shooting button 103 that is in the turned-on state is switched back to the collaborative shooting button 102 that is in the turned-off state, and the external screen A of the mobile phone 100 no longer displays the mirror image 101b of the shooting image 101a of the above-mentioned internal screen B.

[0078] It is understandable that the collaborative shooting button for turning on or off the collaborative shooting function can also be a button of other styles. In addition, the user can also turn on or off the collaborative shooting function by voice commands or gesture commands, etc., which are not limited here.

[0079] In addition, it can be understood that after the collaborative shooting function of the camera application is turned on, the external screen A can also be black without displaying any information.

[0080] The second application scenario: After the collaborative shooting function of the camera application is activated, if the user switches the camera application to the background, the collaborative shooting function is automatically turned off. After the user switches the camera application back to the foreground, the collaborative shooting function is automatically turned on.

[0081] like Figure 4 As shown in Figure (a), when the collaborative shooting function is turned on, the external screen A of the mobile phone 100 displays the mirror image 101b of the shooting image 101a of the internal screen B. Figure 4 As shown in Figure (b), when the user switches the camera application to the background, such as by clicking the navigation key, the camera application automatically turns off the collaborative shooting function. At this time, the inner screen B displays the main interface, which includes application icons of phone, message, camera, gallery, etc., and the outer screen A displays time and other information. The user clicks on the application icon of the camera application. In response to the user's operation, the mobile phone 100 switches the camera application back to the foreground and automatically turns on the collaborative shooting function. Figure 4 As shown in Figure (c), after the camera application switches to the foreground, the inner screen B displays the shooting screen 101a, and the outer screen A displays the mirror image 101b of the shooting screen 101a of the inner screen B.

[0082] It should be understood that after the collaborative shooting function of the camera application is activated, if the user closes the camera application, the collaborative shooting function can also be automatically closed. After the camera application is restarted, the collaborative shooting function is automatically enabled.

[0083] The third application scenario: After the collaborative shooting function of the camera application is activated, if the user selects a shooting mode that does not support the collaborative shooting function, the collaborative shooting function is automatically turned off. If the user reselects a shooting mode that supports the collaborative shooting function, the collaborative shooting function is turned on again.

[0084] After the mobile phone 100 starts the collaborative photography function, the user can also select a specific shooting mode to meet the photography needs through the various function buttons about the shooting mode on the right side of the camera application interface, such as the photo mode button, video recording mode button, time-lapse shooting mode button, portrait mode button and movie mode button (not shown in the figure).

[0085] It should be noted that, according to the user's photography needs, some shooting modes of the camera application support the collaborative shooting function, while other shooting modes do not support the collaborative shooting function. For example, shooting modes such as photo mode, portrait mode, video mode, and movie mode support the collaborative shooting function, while other shooting modes such as panorama mode and selfie mode do not support the collaborative shooting function.

[0086] It can be understood that the shooting mode supporting the collaborative shooting function and the shooting mode not supporting the collaborative shooting function may also be other shooting modes.

[0087] For example, Figure 5 As shown in Figure (a), when the collaborative shooting function is turned on, after the user selects the photo mode in the shooting mode on the right side of the inner screen B of the mobile phone 100, the outer screen A of the mobile phone 100 displays a mirror image 101b of the shooting image 101a. Figure 5 As shown in Figure (b), the user selects the time-lapse shooting mode in the shooting mode on the right side of the inner screen B of the mobile phone 100. In response to the user's selection operation, since the time-lapse shooting mode 106 does not support the collaborative shooting function, the camera application turns off the collaborative shooting function. At this time, the outer screen A no longer displays the mirror image 101b of the shooting image 101a. Figure 5 As shown in Figure (c), the user selects the video recording mode in the shooting mode on the right side of the inner screen B of the mobile phone 100. In response to the user's selection operation, since the video recording mode supports the collaborative shooting function, the camera application restarts the collaborative shooting function. At this time, the external screen A displays a mirror image 101b of the shooting image 101a.

[0088] Fourth application scenario: After the collaborative shooting function of the camera application is activated, if the user selects the front camera shooting mode (selfie mode), the collaborative shooting function is automatically turned off. If the user reselects the rear camera shooting mode (other shooting mode), the collaborative shooting function is restarted.

[0089] The front camera shooting mode refers to a mode for shooting using the front camera, and the rear camera shooting mode refers to a mode for shooting using the rear camera.

[0090] like Figure 6 As shown in Figure (a) in FIG. 1 , when the collaborative shooting function is turned on and the shooting mode is currently being shot using the rear camera P3, after the user selects the photo mode in the shooting mode on the right side of the inner screen B of the mobile phone 100, the outer screen A of the mobile phone 100 displays a mirror image 101b of the shooting image 101a. Figure 6As shown in Figure (b), the user clicks the lens flip button 104 to use the front camera P2 to enter the selfie mode. Since the selfie mode does not support the collaborative shooting function, the camera application turns off the collaborative shooting function. At this time, the external screen A no longer displays the mirror image 101b of the shooting image 101a.

[0091] Furthermore, when the user switches the shooting mode to a shooting mode that does not support the collaborative shooting function, in order to avoid the user accidentally touching the collaborative shooting button, causing the current shooting mode to be unavailable, such as causing the internal screen B of the mobile phone 100 to be black, etc., affecting the user's shooting experience, in some embodiments, when the shooting mode is switched to a shooting mode that does not support the collaborative shooting function, the switch button for the collaborative shooting function may no longer be displayed on the internal screen B of the mobile phone 100.

[0092] In some embodiments, after the shooting mode is switched to a shooting mode that does not support the collaborative shooting function, if the user uses the shooting mode that does not support the collaborative shooting function for a long time (for example, more than 15 minutes), the switch button of the collaborative shooting function will no longer be displayed on the inner screen B of the mobile phone 100. Figure 6 As shown in Figure (c) , the collaborative shooting function button 102 and the collaborative shooting function button 103 will no longer be displayed on the inner screen B of the mobile phone 100.

[0093] That is, the above Figure 6 Figure (c) in the figure can be switched directly to Figure 6 (c) in the figure, you can also switch to Figure 6 (b) in Figure 1, then switch to Figure 6 Figure (c) in .

[0094] The fifth application scenario: After the collaborative shooting function of the camera application is turned on, if the user folds the inner screen B from the unfolded state to the unfolded state, the collaborative shooting function is automatically turned off.

[0095] like Figure 7 As shown, when the collaborative shooting function of the camera application is turned on, if the user moves the inner screen B from Figure 7 Fold the inner screen B to the unfolded state shown in Figure (a) Figure 7 After the unexpanded state shown in Figure (b) in the figure, Figure 7 Figure (b) and Figure 7 As shown in Figure (c), the camera application automatically turns off the collaborative shooting function, the inner screen B displays the collaborative shooting button 103 in the turned-off state, and the outer screen A no longer displays the mirror image 101b of the shooting image 101a of the inner screen B.

[0096] In addition, after the user unfolds the inner screen B from the unfolded state to the unfolded state, the camera application can also restart the collaborative shooting function. At this time, the inner screen B displays the collaborative shooting button 103 in the turned-on state, and the external screen A displays the mirror image 101b of the shooting image 101a of the inner screen B.

[0097] It should be understood that after the user folds the inner screen B from the unfolded state to the unfolded state, the inner screen B can also automatically turn black. After that, if the user unfolds the inner screen B from the unfolded state to the unfolded state again, the inner screen B automatically turns on. After turning on the screen, the inner screen B can display the display screen displayed before the black screen, or it can display the same display screen as the outer screen A.

[0098] Further, in combination with the above-mentioned application scenarios, after the user performs the operation of turning on the collaborative shooting function of the camera application, the camera application can also first determine whether the current state of the mobile phone 100 meets the collaborative shooting conditions, such as whether the current shooting mode of the camera application supports the collaborative shooting function, whether the camera application uses the rear camera for shooting, or whether the internal screen B is in an unfolded state, etc. If the current state meets the collaborative shooting conditions, the collaborative shooting function is turned on. If the current state does not meet the collaborative shooting conditions, the collaborative shooting function is not turned on.

[0099] In addition, in the above application scenarios, after the collaborative shooting function is activated, the shooting picture displayed on the external screen A and the mirrored picture displayed on the internal screen B can also be displayed in the same proportion, that is, displayed in the same aspect ratio. Figure 5 The corresponding aspect ratio of the photo mode is 4:3, and the corresponding aspect ratio of the video mode is 21:9.

[0100] The above describes the application scenarios in which users perform relevant touch operations or folding operations to achieve the above-mentioned collaborative shooting. Figure 8-Figure 10 The specific implementation process of each application scenario in the embodiment of the present application is introduced. It can be understood that the following description still takes the camera application in the mobile phone 100 as an example, and Figure 8-Figure 10 Each step of the method shown can be implemented by the processor 110 of the mobile phone 100 executing a related program. Figure 8 is a flow chart of a collaborative shooting method provided in an embodiment of the present application. Figure 8 As shown, the method comprises the following steps:

[0101] Step 801, after the camera application is started, detecting the on operation of the switch button of the collaborative shooting function displayed in the camera application interface.

[0102] Among them, the collaborative shooting function is used to control the external screen A to display the shooting picture of the internal screen B.

[0103] When the collaborative shooting function is turned off, the switch button of the collaborative shooting function can be Figure 3 The collaborative shooting button 102 is shown in the off state. The on operation of the switch button of the collaborative shooting function may be a click operation on the collaborative shooting button 102 in the off state.

[0104] It is understood that in some embodiments, the switch button of the collaborative shooting function can also be a switch button of other styles, and the display state of the switch button of the collaborative shooting function can change according to whether the collaborative shooting function is turned on or off. For example, when the collaborative shooting function is turned on, the switch button is in a raised state, and when the collaborative shooting function is turned off, the switch button returns to its original state. This application does not limit this.

[0105] Step 802, turn on the collaborative shooting function, triggering the mobile phone 100 to display a mirror image of the shooting image of the internal screen B on the external screen A.

[0106] like Figure 3 As shown, after the user clicks the collaborative shooting button 102 on the inner screen B which is in the closed state, the mobile phone 100 starts the collaborative shooting function and displays the mirror image 101b of the shooting image 101a of the inner screen B on the outer screen A.

[0107] It is understandable that various existing technical solutions can be used to perform mirror processing on the captured image. For example, the mobile phone 100 copies or mirrors the captured image to obtain the above-mentioned mirror image. In some embodiments, the specific method of the mobile phone 100 performing mirror processing on the captured image can be: the mobile phone 100 horizontally flips the captured image to obtain a mirror image of the captured image.

[0108] Furthermore, after detecting the on command of the switch button of the collaborative shooting function displayed in the camera application interface, it is also possible to first determine whether the current shooting mode of the camera application supports the collaborative shooting function. If the current shooting mode supports the collaborative shooting function, the collaborative shooting function is turned on. If the current shooting mode does not support the collaborative shooting function, the collaborative shooting function is not turned on.

[0109] Furthermore, after the collaborative shooting function is turned on, it is also possible to determine whether to display the switch button of the collaborative shooting function on the camera application interface of the inner screen B according to whether the current shooting mode supports the collaborative shooting function. If the current shooting mode supports the collaborative shooting function, the switch button of the collaborative shooting function is displayed on the camera application interface of the inner screen B. If the current shooting mode does not support the collaborative shooting function, the switch button of the collaborative shooting function is not displayed on the camera application interface of the inner screen B.

[0110] Step 803, after the collaborative shooting function is turned on, the shooting picture of the inner screen B is displayed on the outer screen A.

[0111] Step 803, after the collaborative shooting function is turned on, if a turning-off operation of a switch button of the collaborative shooting function displayed in the camera application interface is detected, the collaborative shooting function is turned off.

[0112] Among them, after turning off the collaborative shooting function, the shooting screen of the inner screen B will no longer be displayed on the external screen A.

[0113] After the collaborative shooting function is turned on, the switch button of the collaborative shooting function can be Figure 3 The collaborative shooting button 103 is shown in an on state. The closing operation of the collaborative shooting function switch button may be a click operation on the collaborative shooting button 103. It should be understood that the collaborative shooting function switch button may also be a switch button of other styles.

[0114] For example, Figure 3 As shown in Figure (b), if the user clicks the collaborative shooting button 103 on the inner screen B that is in the turned-on state, the mobile phone 100 turns off the collaborative shooting function, and the external screen A no longer displays the mirror image 101b of the shooting image 101a of the inner screen B.

[0115] Step 804, after the collaborative shooting function is turned on, if an operation of switching the camera application to run in the background is detected, the camera application is switched to run in the background and the collaborative shooting function is turned off.

[0116] The operation of switching the camera application to the background may be an operation of returning to the main interface, an operation of opening other applications, etc. After the camera application is switched to the background, it means that the user does not need to shoot at this time. In this case, the camera application can turn off the collaborative shooting function.

[0117] For example, Figure 4 As shown in Figure (b), if the camera application is switched to the background, the inner screen B displays the main interface, and the outer screen A no longer displays the mirror image 101b of the shooting image 101a of the inner screen B.

[0118] Step 805: If an operation of switching the camera application back to the foreground is detected, the camera application is switched to the foreground and the collaborative shooting function is enabled.

[0119] The operation of switching the camera application from the background to the foreground may be a click operation on the application icon of the camera application, a click operation on the thumbnail of the camera application running in the background, etc. After the camera application is switched from the background to the foreground again, it means that the user needs to take a photo at this time. In this case, the camera application can enable the collaborative shooting function.

[0120] For example, Figure 4As shown in Figure (c), after the camera application is switched to the background, the user clicks the application icon of the camera application to switch the camera application to the foreground again. The external screen A can redisplay the mirror image 101b of the shooting image 101a of the internal screen B.

[0121] In addition, after the collaborative shooting function is turned on, the camera application can be closed and the collaborative shooting function of the camera application can be turned off after detecting a closing operation of the camera application. The camera application can be closed according to the closing operation of the user, and the collaborative shooting function of the camera application can be turned off before the camera application is closed.

[0122] In addition, if the collaborative shooting function of the camera application is turned on before the camera application is closed, the camera application can be started and the collaborative shooting function of the camera application can be turned on again after detecting the start-up operation of the camera application. The camera application can be started according to the start-up operation of the user, and after the camera application is started, the collaborative shooting function of the camera application can be turned on.

[0123] Fig. 9 is a flowchart of another collaborative shooting method provided in an embodiment of the present application. It can be understood that the following description still takes the camera application in the mobile phone 100 as an example, and Fig. 9 Each step of the method shown can be implemented by the processor of the mobile phone 100 executing the relevant program. Fig. 9 As shown, the method comprises the following steps:

[0124] Step 901, the collaborative shooting function of the camera application is turned on, and the shooting picture of the internal screen B is displayed on the external screen A.

[0125] Step 902 : When the collaborative shooting function of the camera application is turned on, a switching operation of switching the current shooting mode of the camera application to the target shooting mode is detected.

[0126] The current shooting mode is a shooting mode that supports the collaborative shooting function. The target shooting mode is a shooting mode other than the current shooting mode. The switching operation of switching the current shooting mode of the camera application to the target shooting mode can be a click operation on the function button corresponding to the target shooting mode on the right side of the camera application interface, or a click operation on the lens flip button in the camera application interface, etc.

[0127] Step 903: determine whether the target shooting mode supports the collaborative shooting function.

[0128] Step 904: If the target shooting mode does not support the collaborative shooting function, switch to the target shooting mode and turn off the collaborative shooting function.

[0129] For example, please refer to Figure 5In Figure (b), if the user clicks the time-lapse shooting button, since the time-lapse shooting mode does not support the collaborative shooting function, the collaborative shooting function can be turned off, so that the external screen A no longer displays the mirror image 101b of the shooting image 101a of the internal screen B.

[0130] Step 905: If the target shooting mode supports the collaborative shooting function, determine whether the target shooting mode is in the front camera shooting mode.

[0131] Among them, the front camera shooting mode refers to the shooting mode using the front camera, also known as the selfie mode. The front camera shooting mode does not support the collaborative shooting function.

[0132] Step 906: If the target shooting mode is in the front camera shooting mode, switch to the target shooting mode and turn off the collaborative shooting function.

[0133] For example, please refer to Figure 6 In Figure (c), if the user clicks the lens flip button 104 to enter the selfie mode, since the selfie mode does not support the collaborative shooting function, the collaborative shooting function can be turned off, so that the external screen A no longer displays the mirror image 101b of the shooting image 101a of the internal screen B.

[0134] Step 907: If the target shooting mode is in the rear camera shooting mode, switch to the target shooting mode without closing the collaborative shooting function.

[0135] Among them, the rear camera shooting mode refers to the shooting mode using the rear camera for shooting, also known as the self-shooting mode. The rear camera shooting mode supports the collaborative shooting function.

[0136] Fig.10 is a flowchart of another collaborative shooting method provided in an embodiment of the present application. It can be understood that the following description still takes the camera application in the mobile phone 100 as an example, and Fig.10 Each step of the method shown can be implemented by the processor of the mobile phone 100 executing the relevant program. Fig.10 As shown, the method comprises the following steps:

[0137] Step 1001: The camera application is started and the camera shooting screen is displayed on the inner screen B.

[0138] The camera application may be started according to a start-up operation of the user, and the start-up operation may be an operation in which the user clicks on an application icon of the camera application.

[0139] Step 1002, after the camera application is started, determine whether the inner screen B is in the unfolded state based on the unfolding angle of the inner screen B.

[0140] It can be understood that since the inner screen B can be at any unfolding angle, in some cases, the inner screen B can be unfolded even if it is not at Figure 2 In the fully unfolded state shown, the mobile phone 100 can also perform coordinated display on the inner and outer screens (A, B). Therefore, in some embodiments, the mobile phone 100 can also determine whether the mobile phone 100 has the conditions for coordinated display based on the unfolding angle of the inner screen B.

[0141] In some embodiments, the mobile phone 100 determines whether the inner screen B of the mobile phone 100 is in the unfolded state by detecting the unfolded angle of the inner screen B of the mobile phone. For example, the correspondence between the unfolded angle of the inner screen B of the mobile phone 100 and the unfolded state of the inner screen B can be shown in the following Table 1:

[0142] Table 1

[0143] Inner screen B expansion angle Inner screen B expanded 0～90° Not Expanded 90°～180° Expand

[0144] That is, when the unfolding angle of the internal screen B of the mobile phone 100 is between 0° and 90°, it indicates that the internal screen B of the mobile phone 100 is in an unfolded state; when the unfolding angle of the internal screen B of the mobile phone 100 is between 90° and 180°, it indicates that the internal screen B of the mobile phone 100 is in an unfolded state.

[0145] It can be understood that in other embodiments, the unfolding angle corresponding to the unfolded state of the internal screen B of the mobile phone 100 may also be other angle values. For example, the internal screen B of the mobile phone 100 is considered to be in the unfolded state only when the unfolding angle of the internal screen B of the mobile phone 100 is equal to 180°.

[0146] Step 1003, if the inner screen B is not in the unfolded state, determine whether the collaborative shooting function of the camera application is turned on.

[0147] Step 1004: If the collaborative shooting function of the camera application is turned on, turn off the collaborative shooting function.

[0148] Please refer to Figure 7 , if the user folds the inner screen B from the unfolded state to Figure 7 In the unfolded state shown in Figure (b), since the collaborative shooting function of the current camera application is turned on, the collaborative shooting function can be turned off, and the external screen A no longer displays the mirror image 101b of the shooting image 101a of the internal screen B.

[0149] In addition, after the collaborative shooting function is turned off, if it is determined that the inner screen has switched from a non-expanded state back to an expanded state based on the expanded angle of the inner screen, the collaborative shooting function can be restarted.

[0150] Fig.11 According to some embodiments of the present application, a software structure framework diagram of a mobile phone 100 for implementing the collaborative shooting method of the present application is shown. Fig.11As shown, the software framework of the mobile phone 100 includes an application layer 10 , an application framework layer 20 , and a hardware layer 40 .

[0151] The application layer 10 includes a camera application 1, which includes multiple shooting modes, such as a photo mode 11, a portrait mode 12, a video mode 13, a movie mode 14, a selfie mode, etc. The photo mode 11, the portrait mode 12, the video mode 13, and the movie mode 14 all support a collaborative shooting function 1105.

[0152] It can be understood that in some embodiments, the photo mode 11 may include functions such as smart object recognition 1101, artificial intelligence (AI) photography 1102, filter function 1103, flash function 1104, collaborative shooting function 1105, etc. Users can select the above functions according to their needs to achieve the corresponding purpose.

[0153] For example, the user can choose to turn on the smart object recognition 1101 function in the camera mode 11 to identify objects in the image. Specifically, after the user turns on the smart object recognition function in the camera mode 11, he only needs to point the camera at the object being photographed. When the mobile phone 100 recognizes the object, the name of the object (such as "azalea") or type ("dog") will be displayed on the internal screen B of the mobile phone. In other embodiments, the user can also turn on the filter function 1103 to beautify the photographed object. This application is not limited to this.

[0154] In some embodiments, the portrait mode 12 may include a collaborative shooting function 1105, and may also include other functions, such as a beauty function, a special effect function (not shown in the figure), etc. When a user selects the portrait mode 12 for shooting, the portrait mode can keep the face of the person being photographed clear while blurring the background, thereby highlighting the subject.

[0155] In some embodiments, the video recording mode 13 may include a multi-scene video recording function 1301, a flash function 1302, a filter function 1303, a collaborative shooting function 1105, etc. Among them, when the user turns on the multi-scene video recording function 1301, the front and rear cameras of the mobile phone 100 are turned on at the same time, allowing the user to use the front and rear cameras to record multiple objects at the same time. For example, after the user turns on the multi-scene video recording function 1301, the image captured by the front camera P2 and the image captured by the rear camera P3 can be recorded at the same time to record the scene in detail. In addition, the user can also turn on the flash function 1302 to improve the imaging effect in darker scenes. For example, when the user shoots in a relatively dim place, the flash function 1302 can be turned on to increase the exposure time and improve the imaging effect of the object being photographed.

[0156] In some embodiments, the movie mode 14 may include a color lookup table (LUT) function 1401, a 4K high-dynamic range (HDR) function 1402, a slow motion function 1403, a flash function 1114, a collaborative shooting function 1115, etc. Among them, the color lookup function 1401 is essentially to implement a color adjustment function for the object photographed by the user, so that the color of the object photographed by the user is richer. In the 4K HDR function 1402, 4K refers to the resolution (4096 pixels × 2160 pixels), and HDR is an image rendering technology that aims to achieve scene lighting and simulate the reflection and refraction of light to make the object appear more realistic. 4K HDR is used to improve the quality of the captured picture, improve the image resolution and the authenticity of the object. The slow motion function 1403 is to increase the fun of shooting. The user can increase the beauty and realism of the captured image through the slow motion function 1403.

[0157] In addition, the camera application 1 controls the opening and closing of the collaborative shooting function through the collaborative shooting function opening and closing rules in the control logic. Among them, the collaborative shooting function opening and closing rules include corresponding control logic to realize the above-mentioned application scenarios of collaborative shooting. For example, the collaborative shooting function opening and closing rules include collaborative shooting switch control logic 1501, camera exit control logic 1502, shooting mode switching control logic 1503, front and rear camera mode control logic 1504, and expansion state change control logic 1505.

[0158] The camera application 1 detects whether the collaborative shooting switch is turned on or off through the collaborative shooting switch control logic 1501, and controls the turning on and off of the collaborative shooting function according to whether the collaborative shooting switch is turned on or off.

[0159] In some embodiments of the present application, the collaborative shooting switch can be Figure 3 The collaborative shooting button 102 or collaborative shooting button 103 shown in FIG. Figure 3 The collaborative shooting button 102 in the closed state on the inner screen B of the mobile phone shown in (a) triggers the collaborative shooting switch control logic 1501 to turn on the collaborative shooting function 1105 of the camera application. In addition, the user can click on Figure 3 The collaborative shooting button 103 in the turned-on state on the inner screen B of the mobile phone shown in (b) triggers the collaborative shooting switch control logic 1501 to turn off the collaborative shooting function 1105 of the camera application.

[0160] It is understood that in some embodiments, the collaborative shooting switch can also be a switch of other styles, and the display state of the collaborative shooting switch can change according to whether the collaborative shooting function is turned on or off. For example, when the collaborative shooting function is turned on, the collaborative shooting switch is in a raised state, and when the collaborative shooting function is turned off, the collaborative shooting switch returns to its original state. This application does not limit this.

[0161] The camera application 1 detects the switching of the camera application running in the foreground and background by coordinating the camera exit control logic 1502, and controls the opening and closing of the collaborative shooting function according to the switching of the camera application running in the foreground and background. Alternatively, the camera application is detected to be opened or closed, and the opening and closing of the collaborative shooting function is controlled according to the opening and closing of the camera application.

[0162] In some embodiments of the present application, the user can switch the camera application to the background to trigger the camera exit control logic 1502 to turn off the collaborative shooting function 1105 of the camera application. In addition, after switching the camera application to the background, the user can also switch the camera application to the foreground again by clicking the application icon of the camera application, thereby triggering the camera exit control logic 1502 to turn on the collaborative shooting function 1105 of the camera application.

[0163] The camera application 1 detects the switching of the shooting mode of the camera application through the shooting mode switching control logic 1503, and controls the opening and closing of the collaborative shooting function according to the switching of the shooting mode of the camera application.

[0164] In some embodiments of the present application, the user can select a shooting mode that does not support the collaborative shooting function through the function buttons for shooting modes on the right side of the camera application interface, triggering the shooting mode switching control logic 1503 to turn off the collaborative shooting function 1105 of the camera application. After the collaborative shooting function 1105 is turned off, the user can also select a shooting mode that supports the collaborative shooting function through the function buttons for shooting modes on the right side of the camera application interface, triggering the shooting mode switching control logic 1503 to turn on the collaborative shooting function 1105 of the camera application.

[0165] The camera application 1 detects the switching of the front and rear shooting modes of the camera application through the front and rear camera mode control logic 1504, and controls the opening and closing of the collaborative shooting function according to the switching of the front and rear shooting modes of the camera application.

[0166] In some embodiments of the present application, Figure 6As shown, when the camera application is in the rear shooting mode using the rear camera for shooting, the user can click the lens flip button 104 in the camera application interface to trigger the front and rear camera mode control logic 1504 to turn off the collaborative shooting function 1105 of the camera application. After the collaborative shooting function 1105 is turned off, the user can also click the lens flip button 104 again to trigger the shooting mode switching control logic 1504 to turn on the collaborative shooting function 1105 of the camera application.

[0167] The camera application 1 detects the change in the unfolded state of the inner screen B through the unfolded state change control logic 1505, and controls the opening and closing of the collaborative shooting function according to the change in the unfolded state of the inner screen B.

[0168] Specifically, the camera application's unfolded state change control logic 1505 determines the change in the unfolded state of the inner screen B through the sensor data of the sensor module 33 of the hardware layer 30, such as determining whether the inner screen B of the mobile phone 100 is in the unfolded state. For example, the sensor module 33 can report the sensor data to the DisplayManager 23, which then sends it to the camera application 1. The specific process is described below in conjunction with Fig.16 Introduction In addition, it can be understood that the application layer 10 can also include other applications, such as video applications, chat applications, etc., and this application does not limit this.

[0169] In some embodiments of the present application, Figure 6 As shown, when the inner screen B is in the unfolded state, the user can fold the inner screen B inward to the unfolded state, triggering the unfolded state change control logic 1505 to turn off the collaborative shooting function 1105 of the camera application. After the collaborative shooting function 1105 is turned off, the user can also unfold the inner screen B to the unfolded state by unfolding the inner screen B again, triggering the unfolded state change control logic 1505 to turn on the collaborative shooting function 1105 of the camera application.

[0170] When the user turns on the collaborative shooting function 1105, the camera application 1 can control the collaborative display of the inner and outer screens A of the mobile phone through the human-computer interaction interface (UI) control 16. The camera application 1 controls the display of the inner screen B of the mobile phone through the inner screen B display module 1601 of the mobile phone, and controls the display of the outer screen A of the mobile phone through the outer screen A display module 1602 of the mobile phone.

[0171] When the user turns on the collaborative shooting function, the collaborative shooting function 1105 of the camera application 1 sends a collaborative shooting instruction to the mobile phone's internal screen B display module 1601. Then, the mobile phone's internal screen B display module 1601 initiates a collaborative display request to the mobile phone's external screen A display module 1602 to control the collaborative display of the external screen A and the internal screen B.

[0172] The application framework layer 20 of the mobile phone 100 includes a camera API 21 , a camera data stream module 22 and a DisplayManager 23 .

[0173] The camera API 21 is a program interface of the camera module 31 of the hardware layer 30 . The camera application 1 can call the camera module 31 to take pictures by calling the camera API 21 .

[0174] The camera data stream module 22 is used to store images or videos captured by the camera application. For example, the camera data stream module 22 includes a photo data stream module, a preview data stream module, and a video data stream module.

[0175] Among them, the photo data stream module is used to store the images captured by the camera application in the photo mode 11, portrait mode 12 and other shooting modes. For example, the image obtained after the user clicks the photo button in the photo mode 11. The video data stream module is used to store the video captured by the camera application in the camera mode 13, movie mode 14 and other camera modes. For example, the user clicks the record button in the video mode 13 to start recording the video. The preview data stream module is used to store the shooting screen of the image captured by the camera application in any of the above shooting modes and displayed on the internal screen B of the mobile phone, that is, the image captured by the camera before the user clicks the photo button or the record button. Among them, it can be understood that in order to realize the above-mentioned collaborative display on the internal and external screens A of the mobile phone, in some embodiments of the present application, the preview data stream module 32 stores the shooting screen of the internal screen B of the mobile phone, and simultaneously copies the shooting screen, so as to generate the above-mentioned mirror screen by copying the shooting screen.

[0176] It is understood that in some embodiments of the present application, the image or video data stored in the camera data stream module 22 may be based on Fig.11 The memory shown is used for implementation, and this application is not limited to this.

[0177] DisplayManager23 is used to realize the coordinated display of the inner screen B and the outer screen A. For example, the coordinated display of the inner screen B and the outer screen A can be realized by creating a split screen management class and an interface base class. In some embodiments, DisplayManager23 can create a corresponding display layer (diaplay) for the outer screen A, and display the layer as a carrier of the mirror image of the shooting picture of the outer screen A on the outer screen A of the mobile phone, and use the layer to display the mirror image of the shooting picture of the outer screen A.

[0178] DisplayManager23 can provide relevant interfaces for the collaborative shooting function 1105 of the camera application. After the collaborative shooting function 1105 is started, the collaborative display of the internal screen B and the external screen A can be achieved by calling the relevant interfaces of DisplayManager23.

[0179] In some embodiments, DisplayManager23 includes View framework and SurfaceFlinger. The View framework is used to create a corresponding display layer for the external screen A, so that the layer can be used to carry the display data that needs to be displayed on the external screen A. The View framework 21 is also used to request SurfaceFlinger to process (such as mirroring) the content displayed in the preview area of ​​the inner screen B and attach it to the generated layer, and then send the layer to the mobile phone external screen A display module 1602 for display. For example, SurfaceFlinger 22 obtains a copy of the shooting picture of the external screen A from the camera data stream module 22, obtains the mirror picture data of the shooting picture according to the copy data of the shooting picture, and sends the mirror picture data to the View framework.

[0180] It is understood that the application framework layer 20 may also include other modules, such as a view manager (not shown in the figure) and a wireless fidelity communication module (wireless fidelity, Wi-Fi) (not shown in the figure), and the present application does not limit this. It is understood that the software framework of the mobile phone 100 may also include a kernel layer (not shown in the figure) and a hardware abstraction layer (not shown in the figure).

[0181] The hardware layer 30 includes a camera module 31 , an image signal processor (ISP) driver 32 , a display port driver 33 and a sensor module 32 .

[0182] In some embodiments of the present application, the camera module 31 includes the camera P1, camera P2 and camera P3 described above. In other embodiments, other cameras may also be included.

[0183] In some embodiments of the present application, the sensor module 32 includes a gyroscope sensor and an acceleration sensor as described below. In other embodiments, the sensor module 32 may also include other sensors, such as a pressure sensor (not shown in the figure), a touch sensor (not shown in the figure), and an image sensor (not shown in the figure), etc., which is not limited by the present application.

[0184] The ISP driver 33 is used to process the signal transmitted by the image sensor of the mobile phone 100. For example, the electrical signal of the image fed back by the image sensor is converted into an image visible to the naked eye. The ISP driver 33 can also perform algorithm optimization on the noise and brightness of the image. The ISP driver 33 can also optimize the exposure, color temperature and other parameters of the shooting scene, or implement anti-shake processing on the image to enhance the display effect of the image.

[0185] The DP driver 34 is an interface for connecting an external display to the mobile phone 100. The mobile phone 100 can connect to the external display through the DP driver 34 and synchronously display the image displayed on the mobile phone 100 on the external display.

[0186] It can be understood that the above software structure is only exemplary and does not constitute a limitation on the software structure of the mobile phone 100. In other embodiments, the mobile phone 100 may have more or fewer structures, and this application does not impose any limitation on this.

[0187] In order to more intuitively understand the process of the above-mentioned software modules cooperating to realize the above-mentioned application scenarios of collaborative shooting, the following is a Fig.12 The interactive diagram shown is used as an example to introduce the process of the mobile phone controlling the turning on and off of the collaborative shooting function according to the turning on and off of the collaborative shooting switch.

[0188] Specifically, Fig.12 As shown, the above process includes:

[0189] Step 1201: The user opens the camera application.

[0190] For example, a user can open a camera application by clicking on the application icon of the camera application. Of course, the camera application can also be opened in other ways, such as by voice commands or gesture commands.

[0191] Step 1202: The camera application starts.

[0192] Step 1203: The camera application determines whether to display a collaborative shooting button on the camera application interface according to the current shooting mode and the shooting modes of the front and rear cameras.

[0193] The collaborative shooting button is used to turn on or off the collaborative shooting switch of the camera application. If the current shooting mode and the front and rear camera shooting modes support the collaborative shooting function, the collaborative shooting button will be displayed on the camera application interface. If the current shooting mode and the front and rear camera shooting modes do not support the collaborative shooting function, the collaborative shooting button will not be displayed on the camera application interface.

[0194] Step 1204: If the current shooting mode and the front and rear camera shooting modes support the collaborative shooting function, a collaborative shooting button is displayed on the camera application interface.

[0195] For example, Figure 3 As shown in FIG. 8 (a), the collaborative shooting button 102 is displayed in a closed state on the camera application interface, indicating that the collaborative shooting function is currently in a closed state.

[0196] Step 1205: The user clicks the collaborative shooting button.

[0197] For example, Figure 3 As shown in FIG. 8( a ), the user clicks the collaborative shooting button 102 which is in a closed state.

[0198] Step 1206: The camera application starts the collaborative shooting function.

[0199] After the user clicks the collaborative shooting button, the camera application can detect the activation instruction of the collaborative shooting button, and activate the collaborative shooting function according to the activation instruction.

[0200] Step 1207: After the collaborative shooting function is turned on, the relevant interface of DisplayManager is called to realize the collaborative display of the internal screen B and the external screen A.

[0201] For example, Figure 3 As shown in Figure (b), after the collaborative shooting function is turned on, the external screen A displays a mirror image 101b of the shooting image 101a of the internal screen B.

[0202] Step 1208: The user clicks the collaborative shooting button.

[0203] For example, Figure 3 As shown in FIG. 1( b ), when the collaborative shooting function is turned on, the camera application interface may display a collaborative shooting button 103 in an turned-on state, indicating that the collaborative shooting function is currently turned on. The user may turn off the collaborative shooting function by clicking the collaborative shooting button 103 .

[0204] Step 1209: The camera application turns off the collaborative shooting function.

[0205] When a user clicks the collaborative shooting button, the camera application can detect the closing instruction of the collaborative shooting button and then turn off the collaborative shooting function according to the closing instruction.

[0206] Step 1210: After the collaborative shooting function is turned off, stop calling the relevant interface of DisplayManager to terminate the collaborative display of the internal screen B and the external screen A.

[0207] In order to more intuitively understand the process of the above-mentioned software modules cooperating to realize the above-mentioned application scenarios of collaborative shooting, the following is a Fig.13The interactive diagram shown is used as an example to introduce the process of turning on and off the collaborative shooting function of the mobile phone according to the switching of the shooting mode of the camera application.

[0208] Specifically, Fig.13 As shown, the above process includes:

[0209] Step 1301: The user opens the camera application.

[0210] Step 1302: The camera application starts.

[0211] Step 1303: The camera application determines whether to display a collaborative shooting button on the camera application interface according to the current shooting mode and the shooting modes of the front and rear cameras.

[0212] Step 1304: If the current shooting mode and the front and rear camera shooting modes support the collaborative shooting function, a collaborative shooting button is displayed on the camera application interface.

[0213] Step 1305: The user clicks the collaborative shooting button.

[0214] Step 1306: The camera application starts the collaborative shooting function.

[0215] Step 1307: After the collaborative shooting function is turned on, the relevant interface of DisplayManager is called to realize the collaborative display of the internal screen B and the external screen A.

[0216] Step 1308: The user selects shooting mode 1.

[0217] Users can select shooting mode 1 by clicking the function button corresponding to shooting mode 1 on the right side of the camera application interface.

[0218] Step 1309: The camera application determines whether shooting mode 1 supports the collaborative shooting function.

[0219] After the user selects shooting mode 1, the camera application can receive a switching instruction to switch the current shooting mode to shooting mode 1, and then determine whether shooting mode 1 supports the collaborative shooting function according to the switching instruction.

[0220] For example, the camera application pre-stores a white list of shooting modes that support the collaborative shooting function. If the shooting mode is in the white list, it is determined that shooting mode 1 supports the collaborative shooting function. If shooting mode 1 is not in the white list, it is determined that shooting mode 1 does not support the collaborative shooting function.

[0221] Among them, the white list supporting the collaborative shooting function can be set by default or customized by the user, and the embodiments of the present application are not limited to this.

[0222] Step 1310: If shooting mode 1 does not support collaborative shooting, the collaborative shooting function is disabled.

[0223] Step 1311: After the collaborative shooting function is turned off, stop calling the relevant interfaces of DisplayManager to terminate the collaborative display of the inner screen B and the outer screen A.

[0224] After the collaborative shooting function is turned off, the camera application will not be able to call the relevant interface of DisplayManager to realize collaborative display. At this time, the external screen A no longer displays the mirror image 101b of the shooting image 101a of the internal screen B.

[0225] Step 1312: The user selects shooting mode 2.

[0226] Step 1313: The camera application determines whether shooting mode 2 supports the collaborative shooting function.

[0227] Step 1314: If shooting mode 2 supports collaborative shooting, the collaborative shooting function is enabled.

[0228] Step 1315: After the collaborative shooting function is turned on, the relevant interface of DisplayManager can be called to realize the collaborative display of the internal screen B and the external screen A.

[0229] In order to more intuitively understand the process of the above-mentioned software modules cooperating to realize the above-mentioned application scenarios of collaborative shooting, the following is a Fig.14 The interactive diagram shown is used as an example to introduce the process of turning on and off the collaborative shooting function of the mobile phone according to the switching of the front and rear shooting modes.

[0230] Specifically, Fig.14 As shown, the above process includes:

[0231] Step 1401: The user opens the camera application.

[0232] Step 1402: The camera application starts.

[0233] Step 1403: The camera application determines whether to display a collaborative shooting button on the camera application interface according to the current shooting mode and the shooting modes of the front and rear cameras.

[0234] Step 1404: If the current shooting mode and the front and rear camera shooting modes support the collaborative shooting function, a collaborative shooting button is displayed on the camera application interface.

[0235] Step 1405: The user clicks the collaborative shooting button.

[0236] Step 1406: The camera application starts the collaborative shooting function.

[0237] Step 1407: After the collaborative shooting function is turned on, the relevant interface of DisplayManager is called to realize the collaborative display of the internal screen B and the external screen A.

[0238] Step 1408: The user clicks the lens flip button in the camera application interface.

[0239] Step 1409: The camera application detects a switch instruction to switch the shooting mode of the rear camera to the shooting mode of the front camera.

[0240] Step 1410: The camera application turns off the collaborative shooting function.

[0241] Since the selfie mode is a pre-set shooting mode that does not support the collaborative shooting function, if it is detected that the current shooting mode is switched to the selfie mode, the collaborative shooting function can be turned off. In this way, the selfie image of the photographer can be prevented from being collaboratively displayed on the external screen A, so that it will not be seen by others.

[0242] Step 1411: After the collaborative shooting function is turned off, stop calling the relevant interfaces of DisplayManager to terminate the collaborative display of the internal screen B and the external screen A.

[0243] Step 1412: The user clicks the lens flip button in the camera application interface again.

[0244] Step 1413: The camera application detects a switch instruction to switch the front camera shooting mode to the rear camera shooting mode.

[0245] Step 1414: The camera application turns on the collaborative shooting function.

[0246] Step 1415: After the collaborative shooting function is turned on, the relevant interface of DisplayManager can be called to realize the collaborative display of the internal screen B and the external screen A.

[0247] In order to more intuitively understand the process of the above-mentioned software modules cooperating to realize the above-mentioned application scenarios of collaborative shooting, the following is a Fig.15 The interactive diagram shown is used as an example to introduce the process of turning on and off the collaborative shooting function according to the foreground and background switching of the camera application on the mobile phone.

[0248] Specifically, Fig.15 As shown, the above process includes:

[0249] Step 1501: The user opens the camera application.

[0250] Step 1502: The camera application starts.

[0251] Step 1503: The camera application determines whether to display a collaborative shooting button on the camera application interface according to the current shooting mode and the shooting modes of the front and rear cameras.

[0252] Step 1504: If the current shooting mode and the front and rear camera shooting modes support the collaborative shooting function, a collaborative shooting button is displayed on the camera application interface.

[0253] Step 1505: The user clicks the collaborative shooting button.

[0254] Step 1506: The camera application starts the collaborative shooting function.

[0255] Step 1507: After the collaborative shooting function is turned on, the relevant interface of DisplayManager is called to realize the collaborative display of the internal screen B and the external screen A.

[0256] Step 1508: The user switches the camera application to the background.

[0257] Step 1509: The camera application turns off the collaborative shooting function.

[0258] Step 1510: After the collaborative shooting function is turned off, stop calling the relevant interface of DisplayManager to terminate the collaborative display of the internal screen B and the external screen A.

[0259] Step 1511: The camera application switches to background operation.

[0260] Please refer to Figure 4 After the camera application switches to the background, the external screen A no longer displays the mirror image 101b of the shooting image 101a of the internal screen B.

[0261] Step 1512: The user switches the camera application from the background to the foreground.

[0262] Step 1513: The camera application is switched to the foreground.

[0263] Step 1514: The camera application turns on the collaborative shooting function.

[0264] Step 1515: After the collaborative shooting function is turned on, the relevant interface of DisplayManager is called to realize the collaborative display of the internal screen B and the external screen A.

[0265] In addition, users can also close the camera app. Before closing the camera app, they can turn off the collaborative shooting function first and then close it. In addition, after reopening the camera app, they can also turn on the collaborative shooting function again.

[0266] In order to more intuitively understand the process of the above-mentioned software modules cooperating to realize the above-mentioned application scenarios of collaborative shooting, the following is a Fig.16 The interactive diagram shown is used as an example to introduce the process of the mobile phone controlling the opening and closing of the collaborative shooting function according to the changes in the expansion state of the inner screen.

[0267] Specifically, Fig.16 As shown, the above process includes:

[0268] Step 1601: When the inner screen B is in the unfolded state, the user opens the camera application.

[0269] Step 1602: The camera application starts.

[0270] Step 1603: The camera application determines whether to display a collaborative shooting button on the camera application interface according to the current shooting mode and the shooting modes of the front and rear cameras.

[0271] Step 1604: If the current shooting mode and the front and rear camera shooting modes support the collaborative shooting function, a collaborative shooting button is displayed on the camera application interface.

[0272] Step 1605: The user clicks the collaborative shooting button.

[0273] For example, Figure 3 As shown in FIG. 8( a ), the user clicks the collaborative shooting button 102 which is in a closed state.

[0274] Step 1606: The camera application starts the collaborative shooting function.

[0275] After the user clicks the collaborative shooting button, the camera application can detect the activation instruction of the collaborative shooting button, and activate the collaborative shooting function according to the activation instruction.

[0276] Step 1607: After the collaborative shooting function is turned on, the relevant interface of DisplayManager is called to realize the collaborative display of the internal screen B and the external screen A.

[0277] For example, Figure 3 As shown in Figure (b), after the collaborative shooting function is turned on, the external screen A displays a mirror image 101b of the shooting image 101a of the internal screen B.

[0278] Step 1608: The user folds inner screen B.

[0279] Step 1609: The inner screen B begins to fold inward from the unfolded state.

[0280] Step 1610: After the camera application is started, the sensor module detects the unfolding angle of the inner screen B.

[0281] Step 1611: The sensor module sends the expansion angle of inner screen B to DisplayManager.

[0282] Step 1612: DisplayManager sends the expansion angle of inner screen B to the camera application.

[0283] For example, DisplayManager calls the relevant callback function to call back the expansion angle of inner screen B to the camera application.

[0284] Step 1616: The camera application determines whether the inner screen B is in the unfolded state based on the unfolded angle of the inner screen B.

[0285] Step 1614: If it is determined that the inner screen B is not in the unfolded state based on the unfolded angle of the inner screen B, the collaborative shooting function is turned off.

[0286] Step 1615: After the collaborative shooting function is turned off, stop calling the relevant interfaces of DisplayManager to terminate the collaborative display of the internal screen B and the external screen A.

[0287] Step 1616: The user unfolds inner screen B.

[0288] Step 1617: The inner screen B unfolds outward.

[0289] Step 1618: The sensor module detects the unfolding angle of inner screen B.

[0290] Step 1619: The sensor module sends the expansion angle of inner screen B to DisplayManager.

[0291] Step 1620: DisplayManager sends the expansion angle of inner screen B to the camera application.

[0292] For example, DisplayManager calls the relevant callback function to call back the expansion angle of inner screen B to the camera application.

[0293] Step 1621: The camera application determines whether the inner screen B is in the unfolded state based on the unfolded angle of the inner screen B.

[0294] Step 1622: If it is determined that the inner screen B is in the unfolded state based on the unfolding angle of the inner screen B, the collaborative shooting function is turned on.

[0295] Step 1623: After the collaborative shooting function is turned on, the relevant interface of DisplayManager is called to realize the collaborative display of the internal screen B and the external screen A.

[0296] Fig.17 1 shows a block diagram of a collaborative shooting device according to an embodiment of the present application, which can be integrated into an electronic device, and the electronic device can be the mobile phone 100 mentioned above. Fig.17As shown, the device includes: a starting module 1701 , a first display module 1702 , a second display module 1703 , and a closing module 1704 .

[0297] A starting module 1701 is used to detect a camera opening operation and start a camera application;

[0298] A first display module 1702, configured to display a first preview image on the first display screen, where the first preview image is captured by the camera application;

[0299] The second display module 1703 is used to detect the collaborative shooting function start operation and display the first preview picture on the second display screen;

[0300] The closing module 1704 is used to detect that the current state of the electronic device does not meet the collaborative shooting condition, and close the display of the first preview image on the second display screen.

[0301] Optionally, the second display module is further used to detect that the current state of the electronic device meets the collaborative shooting condition, and display the first preview picture on the second display screen.

[0302] The above-mentioned starting module 1701, first display module 1702, second display module 1703 and closing module 1704 can realize the several application scenarios of the above-mentioned collaborative shooting.

[0303] Combine the following Fig.18 A hardware structure diagram of the mobile phone 100 for implementing the above method is introduced.

[0304] like Fig.18 As shown, the mobile phone 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a sensor module 180, a button 190, a display screen 194, etc. The sensor module 180 may include a gyroscope sensor 180A, an acceleration sensor 180B, and a touch sensor 180C, etc.

[0305] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the mobile phone 100. In other embodiments of the present application, the mobile phone 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0306] Among them, a memory can also be set in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated access is avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved. In some embodiments of the present application, the processor 110 can be used to implement mirroring of the picture shot by the internal screen B of the above-mentioned mobile phone.

[0307] In some embodiments, the processor 110 may include one or more interfaces. The external memory interface 120 may be used to connect an external memory, such as a Micro SD card, to expand the storage capacity of the mobile phone 100. The external memory communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, the external memory 120 stores a picture taken before the user clicks the camera button or the record button, or stores a video after the user clicks the camera button or the record button and stops recording.

[0308] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store the program code corresponding to the network switching method of the present application, so that when the program code is executed, the mobile phone 100 can execute the collaborative shooting method of the present application, and the data storage area can store the shooting screen or the mirror image of the shooting screen involved in the collaborative shooting method of the present application. In some embodiments, the data storage area can be divided into several logical partitions to store the above-mentioned image or video data involved in the collaborative shooting method of the present application.

[0309] The wireless communication function of the mobile phone 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0310] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied on mobile phone 100. Wireless communication module 160 can provide solutions for wireless communications including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (blue tooth, BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR), etc. applied on mobile phone 100.

[0311] The gyroscope sensor 180A and the acceleration sensor 180B in the sensor module 180 of the mobile phone 100 are used to obtain the unfolding angle of the internal screen B of the mobile phone, so that the mobile phone 100 can judge the unfolding state of the internal screen B of the mobile phone 100 according to the unfolding angle of the internal screen B of the mobile phone.

[0312] In some embodiments, the mobile phone 100 may have multiple gyro sensors 180A and multiple acceleration sensors 180B, which are respectively arranged on the outer screen A and the inner screen B of the inner screen B of the mobile phone 100. For example, a group of sensors {one gyro sensor 180A and one acceleration sensor 180B} are arranged on the outer screen A of the mobile phone 100, and a group of sensors {one gyro sensor 180A and one acceleration sensor 180B} are also arranged on the inner screen B of the mobile phone 100. Then, the mobile phone 100 combines the data collected by the gyro sensors on the inner and outer screens A and the data collected by the acceleration sensors to determine the unfolding angle of the inner screen B of the mobile phone 100.

[0313] Specifically, the mobile phone 100 can obtain the three-axis (X-axis, Y-axis, Z-axis) data (in m / s2, with a sampling frequency of 100Hz) of the mobile phone 100 in the camera coordinate system through the acceleration sensor 180B, and the three-axis data (in rad / d, with a sampling frequency of 100Hz) of the gyroscope sensor 180A after zero bias correction. Then, the mobile phone 100 can extract the acceleration sensor value (in m / s2, with a sampling frequency of 100Hz) and the system time (or timestamp) corresponding to the data from the three-axis data of the acceleration sensors of the inner and outer screens A through a filtering algorithm, and then use these parameters to further calculate through a fusion algorithm to obtain the relative angle (that is, the unfolding angle) of the two screens of the inner screen B. It can be understood that in other embodiments, the mobile phone 100 may also include an angle sensor (not shown in the figure), and the angular velocity sensor may be set at the bending portion of the inner screen B. The mobile phone 100 can measure the bending angle of the inner screen B through the angle sensor set at the bending portion, that is, obtain the unfolding angle of the inner screen B.

[0314] The touch sensor 180C may be disposed on the display screen 194. The touch sensor 180C and the display screen 194 form a touch screen, also known as a "touch screen". The touch sensor 180C is used to detect a touch operation on or near the touch sensor. The touch sensor may transmit the detected touch operation to the application processor to determine the type of touch event. For example, the touch sensor 180C obtains the user's click. Figure 3 In (a) of the figure, the touch operation of the collaborative photography function button 102 is performed, and the operation is then transmitted to the processor 110, and the processor 110 determines that the touch event is "turning on the collaborative photography function". When the user clicks the collaborative photography button 102 again, the touch sensor 180C transmits the operation to the processor 110, and the processor 110 determines that the touch event is "turning off the collaborative photography function". In some embodiments, visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180C can also be set on the surface of the mobile phone 100, which is different from the position of the display screen 194. This application is not limited to this.

[0315] An embodiment of the present application also provides an electronic device, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor implements the steps of any of the above-mentioned method embodiments when executing the computer program.

[0316] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0317] An embodiment of the present application provides a computer program product. When the computer program product runs on a mobile terminal, the mobile terminal can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0318] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the camera / terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0319] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0320] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0321] In the embodiments provided in the present application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0322] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0323] In the above description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0324] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or combinations thereof.

[0325] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0326] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0327] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0328] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0329] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A collaborative shooting method, characterized in that: Applied in an electronic device, the electronic device is a folding screen device, the electronic device comprises a first display screen and a second display screen, the first display screen is arranged on the front side of the electronic device, and the second display screen is arranged on the back side of the electronic device; the method comprises: A camera opening operation is detected, and a camera application is started, wherein the foldable screen of the electronic device is currently in an unfolded state; Wherein, the foldable screen is the first display screen or the second display screen; Displaying a first preview picture on the first display screen, where the first preview picture is taken by the camera application, and displaying time information on the second display screen; The camera application determines whether to display a switch button of a collaborative shooting function on the camera application interface according to the current shooting mode and the front and rear camera shooting modes, the shooting modes including a selfie mode and a third-party shooting mode, and the front and rear camera shooting modes are a front camera shooting mode or a rear camera shooting mode; the collaborative shooting function is used to control the second display screen to display collaboratively with the first display screen; If the current shooting mode is the other-shooting mode, and the front and rear camera shooting modes are the rear camera shooting mode, displaying a switch button for the collaborative shooting function on the camera application interface; Detecting a turn-on operation of a switch button of the collaborative shooting function; In response to the start operation, calling the interface of DisplayManager, wherein the DisplayManager includes the View framework and SurfaceFlinger; After the View framework creates a display layer, the SurfaceFlinger attaches the first preview image to the display layer after mirroring, and the display layer is used to carry display data displayed on the second display screen; The View framework sends the display layer to the second display screen for display; Displaying a second preview picture on the second display screen, where the second preview picture is a mirror image of the first preview picture; detecting that the current state of the electronic device does not satisfy the collaborative shooting condition, and turning off display of the second preview image on the second display screen; The detecting that the current state of the electronic device does not satisfy the collaborative shooting condition and turning off the display of the second preview screen on the second display screen includes: An operation of switching the camera application from a collaborative shooting mode using the rear camera to a selfie mode using the front camera is detected, display of the second preview screen on the second display screen is turned off, and the switch button for the collaborative shooting function is canceled from displaying on the camera application interface.

2. The method according to claim 1, characterized in that The method further comprises: A folding operation on a foldable screen of the electronic device is detected, and display of the second preview screen on the second display screen is turned off. The foldable screen is the first display screen or the second display screen. The folding operation is used to fold the foldable screen from the unfolded state to the unfolded state.

3. The method according to claim 2, characterized in that After detecting a folding operation on the foldable screen of the electronic device and closing the display of the second preview screen on the second display screen, the method further includes: An unfolding operation on the foldable screen is detected, and the second preview screen is displayed on the second display screen, wherein the unfolding operation is used to unfold the foldable screen from the unfolded state to the unfolded state.

4. The method according to claim 1, characterized in that The method further comprises: When an operation of switching the camera application from a rear camera shooting mode to a front camera shooting mode is detected, display of the second preview image on the second display screen is turned off.

5. The method according to claim 4, characterized in that After detecting the operation of switching the camera application from the rear camera shooting mode to the front camera shooting mode and closing the display of the second preview screen on the second display screen, the method further includes: An operation of switching the camera application from the front camera shooting mode to the rear camera shooting mode is detected, and the second preview picture is displayed on the second display screen.

6. The method according to claim 1, characterized in that The method further comprises: Displaying a close button for the collaborative shooting function on the camera application interface; A click operation on the close button is detected, and display of the second preview image on the second display screen is closed.

7. The method according to claim 6, characterized in that After detecting a click operation on the close button and closing the display of the second preview screen on the second display screen, the method further includes: Displaying an activation button for the collaborative shooting function on the camera application interface; A click operation on the start button is detected, and the second preview picture is displayed on the second display screen.

8. The method according to claim 1, characterized in that The method further comprises: An operation of switching the camera application to run in the background is detected, and display of the second preview image on the second display screen is turned off.

9. The method according to claim 8, characterized in that After detecting the operation of switching the camera application to background operation and closing the display of the second preview screen on the second display screen, the method further includes: An operation of switching the camera application from background operation to foreground operation is detected, and the second preview picture is displayed on the second display screen.

10. The method according to any one of claims 1 to 9, characterized in that: After starting the camera application, the method further includes: Detecting whether the current state of the electronic device meets the collaborative shooting condition; If it is detected that the current state of the electronic device meets the collaborative shooting condition, displaying a switch button of the collaborative shooting function on the camera application interface; If it is detected that the current state of the electronic device does not satisfy the collaborative shooting condition, the switch button of the collaborative shooting function is not displayed on the camera application interface.

11. The method according to any one of claims 1 to 9, characterized in that: After detecting that the current state of the electronic device does not satisfy the collaborative shooting condition and closing the display of the second preview screen on the second display screen, the method further includes: The switch button of the collaborative shooting function is not displayed in the camera application interface.

12. The method according to any one of claims 1 to 9, characterized in that: The collaborative shooting conditions include one or more of the following conditions: the camera application is in the foreground running state, the shooting mode of the camera application is in the first shooting mode that supports the collaborative shooting function, the shooting mode of the camera application is in the shooting mode using the rear camera for shooting, and the foldable screen of the electronic device is in the unfolded state.

13. The method according to any one of claims 1 to 9, characterized in that: The method further comprises: When a closing operation of the collaborative shooting function is detected, the display of the second preview screen on the second display screen is closed; Detecting a closing operation on the camera application, and then closing the display of the second preview image on the second display screen; When it is detected that the camera application switches from running in the foreground to running in the background, the display of the second preview image on the second display screen is turned off; detecting that the camera application switches from a first shooting mode supporting the collaborative shooting function to a second shooting mode not supporting the collaborative shooting function, turning off display of the second preview screen on the second display screen; When detecting that the camera application switches from the rear camera shooting mode to the front camera shooting mode, turning off display of the second preview image on the second display screen; When it is detected that the foldable screen of the electronic device switches from an unfolded state to an unfolded state, the display of the second preview screen on the second display screen is turned off, and the foldable screen is the first display screen or the second display screen.

14. An electronic device, characterized in that: The electronic device includes: a first display screen and a second display screen, the first display screen is arranged on the front side of the electronic device, and the second display screen is arranged on the back side of the electronic device; one or more processors; one or more memories; the one or more memories store one or more programs, and when the one or more programs are executed by the one or more processors, the electronic device executes the collaborative shooting method described in any one of claims 1-13.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the collaborative shooting method according to any one of claims 1 to 13.

Images