Shooting method, electronic device and readable storage medium

Abstract

The present application relates to the field of photographing technology, and discloses a photographing method, an electronic device, and a readable storage medium. The method is applied to electronic devices with dual screens, such as folding screen electronic devices or straight electronic devices. The method configures separate shooting parameters and shooting algorithms for the rear selfie mode, and can realize shooting in the rear selfie mode based on the shooting parameters and shooting algorithms corresponding to the rear selfie mode; wherein the shooting parameters are determined based on the shooting effects that meet the selfie requirements, and the shooting algorithm is an algorithm that can meet the selfie requirements. In this method, in the rear selfie mode, shooting is performed based on shooting parameters and shooting algorithms that are more suitable for selfie scenes, which improves the quality of the image obtained by the rear selfie, and further improves the user experience.

Description

Technical Field

[0001] The present application relates to the field of photographing technology, and in particular to a photographing method, an electronic device and a readable storage medium. Background Art

[0002] With the continuous development of mobile phone manufacturing technology, current mobile phones can be roughly divided into the following two categories in terms of form: single-screen mobile phones and dual-screen mobile phones. Among them, single-screen mobile phones can also be called candy-bar mobile phones, and dual-screen mobile phones can also be called folding screen mobile phones.

[0003] Taking foldable screen mobile phones as an example, foldable screen mobile phones usually include a main screen and a secondary screen (or auxiliary screen). Figure 1A FIG. 1 shows a schematic diagram of the structure of the folding screen mobile phone 100 in the folded state. Figure 1A As shown, the foldable screen mobile phone 100 includes a main screen 101, a sub-screen 102 and a front camera 103, and the front camera 103 is located in the upper right corner of the main screen 101. Figure 1B A schematic diagram of the structure of the foldable screen mobile phone 100 in a fully unfolded state is shown. Figure 2 FIG. 1 shows a schematic diagram of the structure of the folding screen mobile phone 100 in a semi-expanded state. Figure 2 As shown, the rear camera 104 of the foldable screen mobile phone 100 is located on the back of the main screen 101, and there is a certain angle between the secondary screen 102 and the main screen 101, so that the foldable screen mobile phone 100 is in a semi-unfolded state.

[0004] Generally, due to the consideration of the thinness of the foldable screen mobile phone 100 itself, the pixel of the front camera 103 is lower than that of the rear camera 104, resulting in the clarity of the image captured by the front camera 103 being lower than that of the image captured by the rear camera 104. Therefore, in order to improve the selfie effect of the user, the rear camera 104 can be used in combination with the secondary screen 102 to perform a rear selfie operation. At present, how to improve the quality of the image obtained by the rear selfie is a technical problem that needs to be solved. Summary of the invention

[0005] The embodiments of the present application provide a shooting method, an electronic device and a readable storage medium. The method shoots based on shooting parameters and shooting algorithms that are more suitable for selfie scenes, improves the quality of images obtained by post-selfie shooting, and further improves the user experience.

[0006] In a first aspect, the present application provides a shooting method, which is applied to an electronic device, and the electronic device includes a first camera. The method includes: displaying a first shooting interface, and using the first camera to shoot based on first shooting parameters and a first shooting algorithm, wherein the first shooting interface is captured by the first camera, and the first shooting interface and the first camera are located on different sides of the electronic device; displaying a second shooting interface, and using the first camera to shoot based on second shooting parameters and a second shooting algorithm, wherein the second shooting interface is captured by the first camera, and the second shooting interface and the first camera are located on the same side of the electronic device.

[0007] The first camera may refer to the rear camera 104 mentioned later in this application, the first shooting interface may refer to the rear shooting interface 1012 mentioned later in this application, and the rear camera 104 and the rear shooting interface 1012 are located on both sides of the electronic device. The second shooting interface may refer to the rear selfie interface 1021 mentioned later in this application, and the rear camera 104 and the rear selfie interface 1021 are located on the same side of the electronic device.

[0008] It can be understood that the shooting mode corresponding to the first shooting interface is the conventional rear-mounted shooting mode mentioned later; the shooting mode corresponding to the second shooting interface is the rear-mounted selfie mode mentioned later. Therefore, based on the above content, the method provided by this application uses the shooting parameters and shooting algorithms corresponding to the rear-mounted selfie mode to shoot in the rear-mounted selfie mode. The shooting parameters and shooting algorithms used are more suitable for the selfie scene, which improves the quality of the image obtained by the rear-mounted selfie, and further improves the user experience.

[0009] In a possible implementation of the first aspect, the second shooting parameters are determined based on the shooting effect of the shooting scene corresponding to the second shooting interface, and the second shooting parameters include auto focus parameters, auto exposure parameters, automatic white balance parameters and image signal processing parameters; and the second shooting algorithm includes at least one of the following contents: high dynamic range imaging algorithm, multi-frame noise reduction algorithm, user selfie portrait segmentation algorithm, portrait detail enhancement algorithm, portrait light and shadow enhancement algorithm, portrait beauty algorithm, portrait blur algorithm, portrait spot algorithm, portrait filter algorithm, portrait zoom algorithm, portrait distortion correction algorithm.

[0010] It can be understood that the second shooting parameters include the 3A parameters and ISP parameters mentioned later in this application. The 3A parameters include auto focus parameters, auto exposure parameters and auto white balance parameters. The ISP parameters are image signal processing parameters, including but not limited to image color correction related parameters, noise optimization related parameters, bad pixel removal related parameters, etc. It can be understood that the above-mentioned shooting parameters are adjusted based on the shooting effect of the rear selfie, so the mobile phone can use the 3A parameters and ISP parameters suitable for the rear selfie mode, so that the shooting parameters used are more adapted to the rear selfie scene, and the quality of the obtained image is also higher.

[0011] In a possible implementation of the first aspect, the portrait blur algorithm includes a dual-camera blur algorithm and a single-camera blur algorithm. When the second shooting algorithm includes the portrait blur algorithm, the method further includes: corresponding to the distance between the photographed object and the electronic device being less than a distance threshold, using the single-camera blur algorithm for shooting; corresponding to the distance between the photographed object and the electronic device being greater than or equal to the distance threshold, using the dual-camera blur algorithm for shooting.

[0012] It can be understood that the dual-camera blur algorithm is implemented by the main camera and wide-angle camera of the mobile phone, and the dual-camera blur algorithm has a better effect on long-distance portraits. The single-camera blur algorithm is implemented by the main camera of the mobile phone. When the distance between the portrait being photographed and the camera of the mobile phone is close, the single-camera blur algorithm can be used. Therefore, by judging the distance between the subject and the rear camera of the mobile phone, it can be determined whether to use the single-camera blur algorithm or the dual-camera blur algorithm.

[0013] In a possible implementation of the first aspect, the electronic device also includes a second camera, and the method also includes: displaying a third shooting interface, wherein the third shooting interface is captured by the second camera; in response to a first operation of a user, the third shooting interface displays a first prompt information, wherein the first prompt information is used to prompt the user to perform a first flip operation on the electronic device; in response to the first flip operation, the first camera is turned on, and the electronic device displays the second shooting interface.

[0014] It can be understood that the third shooting interface can refer to the front Selfie interface 1011 involved in the following text. In addition, the schematic diagram of the third shooting interface displaying the first prompt information can refer to Figure 3D , I will not go into details here.

[0015] In a possible implementation of the first aspect, the first operation includes any one of the following contents: a triggering operation of the first control in the third shooting interface, an operation of a user issuing a voice command, and an operation of a user executing a gesture command.

[0016] The first control may refer to the secondary screen selfie control 106 mentioned later. A voice command may refer to a voice command issued by a user that can control the electronic device to display the second shooting interface. For example, the voice command may be "switch to rear selfie mode". A gesture command may refer to a gesture command issued by a user that can control the electronic device to display the second shooting interface. For example, a user may indicate the electronic device to display the second shooting interface by making a "five" gesture.

[0017] In a possible implementation of the first aspect, the method further includes: after displaying the second shooting interface, locking the controls in the second shooting interface; and unlocking the controls in the second shooting interface in response to detection of a target element in the second shooting interface, wherein the target element is used to reflect the human body features of the subject being photographed.

[0018] The present application does not limit the type of target element. For example, the target element may be a face or an eye, etc., as long as the target element can reflect the characteristics of the human body.

[0019] It can be understood that if the target element is detected in the second shooting interface, it means that the subject (user) has turned the phone over and is facing the second shooting interface of the phone, which means that the subject is ready to be photographed. At this time, the controls in the second shooting interface can be unlocked for subsequent shooting operations.

[0020] In a possible implementation of the first aspect, the electronic device also includes a first screen and a second screen, and the method also includes: in response to a first operation of the user, displaying a third shooting interface on the first screen, and the first flipping operation is an operation in which the user flips the electronic device so that the user faces the second screen.

[0021] In a possible implementation of the first aspect, the electronic device is a foldable device; in a folded state of the electronic device, the second screen and the first camera are located on the same side of the electronic device, and the first screen and the first camera are located on different sides of the electronic device; and, in an unfolded state of the electronic device, the first screen and the second screen are located on the same side of the electronic device.

[0022] For example, taking the electronic device as the folding screen mobile phone 100 described later as an example, the first screen can be the main screen 101 of the folding screen mobile phone 100, the second screen can be the sub-screen 102 of the folding screen mobile phone 100, and the first camera is the rear camera 104 of the folding screen mobile phone 100.

[0023] In a possible implementation of the first aspect, the first shooting interface is displayed on the first screen, and the second shooting interface is displayed on the second screen.

[0024] It can be understood that the first shooting interface displayed on the first screen is the conventional rear shooting interface 1012 displayed on the main screen 101; the second shooting interface displayed on the second screen is the rear selfie interface 1021 displayed on the secondary screen 102.

[0025] In a possible implementation of the first aspect, the second camera and the first screen are located on the same side of the electronic device.

[0026] It can be understood that the second camera is the front camera 103 of the foldable screen mobile phone 100, that is, the front camera 103 and the main screen 101 are located on the same side of the foldable screen mobile phone 100.

[0027] In a possible implementation of the first aspect, the electronic device is a straight-bar device; the first camera and the second screen are located on a first side of the electronic device, and the second camera and the first screen are located on a second side of the electronic device.

[0028] It can be understood that in addition to being a folding screen device, the electronic device can also be a straight-screen device. Taking the straight-screen device as a straight-screen mobile phone as an example, the first camera can be a rear camera, and the second camera can be a front camera.

[0029] In a possible implementation of the first aspect, the first shooting interface is displayed on the first screen, and the second shooting interface is displayed on the second screen.

[0030] In a second aspect, the present application provides an electronic device, comprising: one or more processors; one or more memories; one or more memories storing one or more programs, and when the one or more programs are executed by the one or more processors, the electronic device executes the first aspect and any possible shooting method of the first aspect.

[0031] In a third aspect, the present application provides a computer-readable storage medium having instructions stored thereon, which, when executed on a computer, causes the computer to execute the first aspect and any possible shooting method of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1A According to some embodiments of the present application, a schematic diagram of the structure of a foldable screen mobile phone 100 in a folded state is shown;

[0033] Figure 1B According to some embodiments of the present application, a schematic diagram of the structure of a foldable screen mobile phone 100 in a fully unfolded state is shown;

[0034] Figure 2 According to some embodiments of the present application, a schematic diagram of the structure of a foldable screen mobile phone 100 in a semi-unfolded state is shown;

[0035] Figure 3A According to some embodiments of the present application, a schematic diagram of a main screen interface of a mobile phone 100 in a front selfie mode is shown;

[0036] Figure 3B According to some embodiments of the present application, a schematic diagram of a main screen interface of a mobile phone 100 in a conventional rear-mounted shooting mode is shown;

[0037] Figure 3C According to some embodiments of the present application, a schematic diagram of a secondary screen interface of a mobile phone 100 in a rear selfie mode is shown;

[0038] Figure 3D According to some embodiments of the present application, a schematic diagram of an interface for prompting flip information in a main screen of a mobile phone 100 is shown;

[0039] Figure 3E According to some embodiments of the present application, a schematic diagram of an interface for prompting flip information in a secondary screen of a mobile phone 100 is shown;

[0040] Figure 4 According to some embodiments of the present application, a schematic flow chart of a shooting method is shown;

[0041] Figure 5A According to some embodiments of the present application, a schematic flow chart of another shooting method is shown;

[0042] Figure 5B According to some embodiments of the present application, a schematic flow chart of a traditional shooting method is shown;

[0043] Figure 6 According to some embodiments of the present application, a schematic diagram of a process for determining a blurring algorithm is shown;

[0044] Figure 7 According to some embodiments of the present application, a flow chart of a method for solving the problem of accidental touch in the rear selfie mode is shown;

[0045] Fig. 8A According to some embodiments of the present application, a schematic flow chart of a method for photographing when a target element is a face is shown;

[0046] Figure 8B According to some embodiments of the present application, a flow chart of another traditional shooting method is shown;

[0047] Fig. 9 According to some embodiments of the present application, a schematic structural diagram of a candy-bar mobile phone is shown;

[0048] Fig.10 According to some embodiments of the present application, a structural schematic diagram of a mobile phone 100 is shown. DETAILED DESCRIPTION

[0049] The illustrative embodiments of the present application include but are not limited to a photographing method, an electronic device, and a readable storage medium.

[0050] It is understood that the electronic devices to which the shooting method provided in the embodiments of the present application is applicable include, but are not limited to, any electronic devices with dual screens, front cameras, and rear cameras, such as mobile phones and tablet computers. The embodiments of the present application do not limit the types and forms of electronic devices.

[0051] Taking the electronic device as a foldable screen mobile phone as an example, the foldable screen mobile phone includes a foldable screen mobile phone that can be folded up and down and a foldable screen mobile phone that can be folded left and right. For the convenience of description, this application will take the electronic device as a foldable screen mobile phone 100 that can be folded left and right (hereinafter referred to as mobile phone 100) as an example for subsequent description. Among them, the relevant structural diagram of mobile phone 100 can be found in Figure 1A , Figure 1B And related text description.

[0052] The following first explains the front selfie mode, conventional rear shooting mode and rear selfie mode mentioned in the embodiments of the present application.

[0053] Figure 3A FIG. 1 shows a schematic diagram of the main screen interface of the mobile phone 100 in the front selfie mode. Figure 3A As shown, the front selfie mode refers to a mode in which the user uses the main screen 101 (i.e., the first screen) and the front camera 103 (i.e., the second camera) to take a selfie, that is, in this mode, the user can see his or her own image on the main screen 101. Exemplarily, the user can use the front camera 103 to perform a front selfie operation by clicking the shooting control 105 in the front selfie interface 1011 of the main screen 101. For example, in the photo mode, click the shooting control 105 to take a photo, and in the video mode, click the shooting control 105 to record a video.

[0054] Understandably, Figure 3A Taking the mobile phone 100 in the folded state as an example, a schematic diagram of the main screen interface in the front selfie mode is shown. In addition, in some embodiments, the user can also take a selfie based on the front selfie mode when the mobile phone 100 is in the unfolded state.

[0055] Figure 3B FIG. 1 shows a schematic diagram of the main screen interface of the mobile phone 100 in the conventional rear-mounted shooting mode. Figure 3BAs shown, the conventional rear-mounted shooting mode refers to a mode for shooting using the main screen 101 and the rear-mounted camera 104. Exemplarily, the user can use the rear-mounted camera 104 (i.e., the first camera) to shoot rear-mounted photos by clicking the shooting control 105 in the rear-mounted shooting interface 1012 (i.e., the first shooting interface). For example, in the photo mode, click the shooting control 105 to shoot a photo, and in the video mode, click the shooting control 105 to record a video.

[0056] Figure 3C FIG. 1 shows a schematic diagram of a secondary screen interface of a mobile phone 100 in a rear selfie mode. Figure 3C As shown, the rear selfie mode refers to a mode for taking selfies using the secondary screen 102 (i.e., the second screen) and the rear camera 104, that is, in this mode, the user can see his or her own image in the secondary screen 101. Exemplarily, the user can use the rear camera 104 to take a rear selfie by clicking the shooting control 105 in the rear selfie interface 1021 (i.e., the second shooting interface) of the secondary screen 102. It can be understood that, usually, the user takes a selfie using the rear selfie mode when the mobile phone 100 is folded.

[0057] The following is an exemplary description of the conversion between the front selfie mode and the rear selfie mode.

[0058] In some embodiments, Figure 3A Based on the main screen interface of the mobile phone 100 in the front selfie mode shown in the figure, if the user clicks the secondary screen selfie control 106 (i.e., the first control), the main screen 101 will display Figure 3D The interface shown in the figure is used to inform the user to perform the operation of flipping the mobile phone, and during this process, the rear camera 104 of the mobile phone 100 is turned on. When the user flips the mobile phone 100 so that the secondary screen 102 faces the user, the user can directly use the rear selfie mode to take a selfie.

[0059] In some embodiments, Figure 3C Based on the secondary screen interface of the mobile phone 100 in the rear selfie mode shown in FIG. 1 , if the user clicks to switch to the main screen control 107, the secondary screen 102 will display Figure 3E The interface shown in the figure is used to inform the user to perform the operation of flipping the mobile phone, and during this process, the front camera 103 of the mobile phone 100 is turned on. When the user flips the mobile phone 100 so that the main screen 101 faces the user, the front selfie mode can be directly used to take a selfie.

[0060] It can be understood that the front selfie mode, conventional rear shooting mode and rear selfie mode mentioned in this application are just examples. When the configuration or design of the electronic device is different, the method of implementing the above modes may also be different. For example, a conventional single-screen mobile phone can also be provided with a secondary screen on the back of the phone to realize rear selfie.

[0061] It can be understood that the above-mentioned modes involved in the embodiments of the present application can be applied to photo-taking scenes, video recording scenes, animated image generation scenes, etc., and the present application does not limit this.

[0062] In addition, it is understood that the mobile phone 100 will use corresponding shooting parameters and shooting algorithms during the shooting process, and the shooting parameters and shooting algorithms can improve the shooting performance of the mobile phone 100, thereby improving the quality of the captured image. The captured image can be in the form of a picture or a video.

[0063] In some embodiments, when the user uses the conventional rear-camera shooting mode to shoot (i.e., the content shot by the rear camera is displayed on the main screen, which can also be referred to as main screen shooting), the shooting parameters and shooting algorithms corresponding to the conventional rear-camera shooting mode are used. When the user uses the rear selfie mode to shoot (i.e., the content shot by the rear camera is displayed on the secondary screen, which can also be referred to as secondary screen shooting), the shooting parameters and shooting algorithms corresponding to the conventional rear-camera shooting mode are also used. It can be understood that the cameras used in the conventional rear-camera shooting mode and the rear selfie mode are both the rear camera 104 of the mobile phone 100.

[0064] In conventional post-camera shooting, because the content usually shot is scenery or distant people, the distance between the content shot and the camera is far, so the shooting parameters and shooting algorithms used are more suitable for landscape images, etc. In addition, even when shooting people, the distance between the people shot and the camera is also far, so the shooting parameters and shooting algorithms used do less facial processing on the people shot. However, in the post-camera selfie mode, users usually take selfies at a close distance, such as users holding their mobile phones to take selfies. If the shooting parameters and shooting algorithms corresponding to conventional post-camera shooting are still used at this time, then these shooting parameters and shooting algorithms will not be able to meet the user's selfie needs, such as beauty, blur, etc. This will result in lower quality images obtained in the post-camera selfie mode, such as poor color and beauty effects.

[0065] Therefore, in order to solve the above technical problems, the present application proposes a shooting method, which configures separate shooting parameters and shooting algorithms for the rear selfie mode, so that shooting can be performed in the rear selfie mode based on the shooting parameters and shooting algorithms corresponding to the rear selfie mode. Among them, the shooting parameters corresponding to the rear selfie mode can be determined based on parameters such as the pixels of the rear camera of the mobile phone and the expected shooting effect that meets the selfie requirements, and the shooting algorithm can be algorithms such as portrait segmentation and portrait beauty that meet the selfie requirements.

[0066] Compared with the method of using the shooting parameters and shooting algorithms corresponding to the conventional rear-camera shooting mode in the rear-camera selfie mode, the shooting method provided in the present application uses shooting parameters and shooting algorithms suitable for the rear-camera selfie mode in the rear-camera selfie mode, which can improve the quality of the image obtained by the rear-camera selfie.

[0067] The specific process of the shooting method provided by this application is described below.

[0068] Figure 4 A schematic flow chart of a shooting method is shown. The method can be executed by an electronic device. For ease of understanding, the shooting method provided in the embodiment of the present application is described by taking the electronic device as a folding screen mobile phone 100 as an example. Figure 4 As shown, the specific steps include:

[0069] 401: Detecting an operation of triggering a rear-camera selfie mode, starting the rear-camera selfie mode, and determining that the adopted shooting parameters and shooting algorithm are the shooting parameters and shooting algorithm corresponding to the rear-camera selfie mode.

[0070] In some embodiments, the operation of triggering the rear selfie mode (i.e., the user's first operation) can be the user's operation of triggering the control corresponding to the rear selfie mode (such as the secondary screen selfie control 106 mentioned in this application), or it can be any other operation that can trigger the rear selfie mode, such as triggering the rear selfie mode based on voice commands, or triggering the rear selfie mode based on user gesture commands, etc. The embodiments of the present application are not limited to this.

[0071] Among them, the interface diagrams of the mobile phone 100 corresponding to the front selfie mode and the rear selfie mode and the switching method have been described in detail in the previous text and will not be repeated here.

[0072] After the mobile phone 100 detects the operation of triggering the rear selfie mode, the rear selfie mode is started, that is, the content captured by the rear camera 104 is displayed in the rear selfie interface 1021, and the shooting operation is performed based on the shooting control 105 in the rear selfie interface 1021.

[0073] In addition, after the mobile phone 100 detects the operation of triggering the rear selfie mode, it will also determine that the shooting parameters and shooting algorithms used are the shooting parameters and shooting algorithms corresponding to the rear selfie mode (i.e., the second shooting parameters and the second shooting algorithm). Among them, the shooting parameters include 3A parameters and image signal processing (Image Signal Processing, ISP) parameters. Exemplarily, the 3A parameters include auto focus (Auto Focus, AF) parameters, auto exposure (Auto Exposure, AE) parameters and auto white balance (Auto White Balance, AWB) parameters. ISP parameters include but are not limited to related parameters for image color correction, related parameters for noise optimization, related parameters for bad pixel removal, etc. The above-mentioned shooting parameters are obtained through adjustment based on parameters such as pixels of the rear camera of the mobile phone and the expected shooting effect. Therefore, in the rear selfie mode, the mobile phone 100 can use 3A parameters and ISP parameters suitable for the rear selfie mode, so that the shooting parameters used are more adapted to the rear selfie scene, and the quality of the obtained image is also higher.

[0074] The method of determining the adopted shooting parameters as the shooting parameters corresponding to the rear selfie mode may be to determine based on a sensor mode.

[0075] Exemplarily, the shooting parameters corresponding to the conventional rear selfie mode may correspond to sensor mode_1, and the shooting parameters corresponding to the rear selfie mode may correspond to sensor mode_2. When the application layer in the mobile phone 100 detects that the shooting mode is switched to the rear selfie mode, it sends a message to inform the driver layer in the mobile phone 100 that the current shooting mode is the rear selfie mode. The driver layer adjusts the current sensor mode to sensormode_2 instead of sensor mode_1 based on the fact that the current shooting mode is the rear selfie mode. The hardware abstraction layer calls sensor mode_2, and can shoot based on the shooting parameters corresponding to sensor mode_2.

[0076] In an exemplary embodiment, the shooting algorithms corresponding to the rear selfie mode are also relevant algorithms suitable for selfie scenes, including but not limited to high dynamic range imaging (RAWHDR) algorithm, multi-frame noise reduction (RAWMFNR) algorithm, user selfie portrait segmentation, portrait detail enhancement, portrait light and shadow enhancement, portrait beauty, portrait blur, portrait light spot, portrait filter, portrait zoom, and portrait distortion correction algorithm.

[0077] The above shooting algorithm will be explained in detail later and will not be elaborated here.

[0078] It can be understood that the shooting parameters and shooting algorithms adopted in the embodiment of the present application in the rear selfie mode are more suitable for the rear selfie scene, which is beneficial to improving the quality of the image obtained through the rear selfie operation.

[0079] 402: In response to a shooting instruction from a user, shooting is performed based on shooting parameters and shooting algorithms corresponding to the rear selfie mode.

[0080] The embodiment of the present application does not limit the form of the user's shooting instruction. For example, the shooting instruction can be a trigger operation of the shooting control 105, or a voice instruction, a gesture instruction, etc. Taking the shooting instruction as the trigger operation of the shooting control 105 as an example, after the mobile phone 100 detects the trigger operation of the shooting control 105, it can shoot based on the shooting parameters and shooting algorithms corresponding to the post-selfie mode to obtain images such as pictures and videos.

[0081] like Figure 5A As shown, in this application, when shooting with the main screen (i.e., conventional rear-mounted shooting mode), the main screen shooting parameters and main screen shooting algorithm (i.e., shooting parameters and shooting algorithms corresponding to the conventional rear-mounted shooting mode (first shooting parameters and first shooting algorithms)) are used for shooting; when switching to the secondary screen for shooting (i.e., rear-mounted selfie mode), the secondary screen shooting parameters and secondary screen shooting algorithm (i.e., shooting parameters and shooting algorithms corresponding to the rear-mounted selfie mode) are used for shooting. Compared to Figure 5B The method shown uses the shooting parameters and shooting algorithms corresponding to the conventional rear-camera shooting mode for shooting in both the conventional rear-camera shooting mode and the rear-camera selfie mode. The shooting method provided in the embodiment of the present application uses new shooting parameters and shooting algorithms that are more suitable for selfie scenes in the rear-camera selfie mode. This method is more flexible and adaptable, and can improve the quality of the images obtained by selfies, thereby improving the user experience.

[0082] The following is an explanation of the shooting algorithm corresponding to the rear selfie mode in the embodiment of the present application.

[0083] Based on the above content, in an exemplary embodiment, the shooting algorithms corresponding to the post-selfie mode include but are not limited to RAWHDR algorithm, RAWMFNR algorithm, user selfie portrait segmentation, portrait detail enhancement, portrait light and shadow enhancement, portrait beauty, portrait blur, portrait light spot, portrait filter, portrait zoom, and portrait distortion correction algorithm.

[0084] Among them, the RAWHDR algorithm can synthesize the original (raw) data files of the images collected by the image sensor to enhance the layering and picture details of the final generated image and improve the image quality. The RAWMFNR algorithm can reduce the noise of the image to output an image with stronger image quality.

[0085] The user selfie portrait segmentation algorithm can segment the portrait in a picture to achieve the purpose of portrait cutout, such as replacing a different background image for the portrait. The portrait detail enhancement algorithm can enhance the portrait in the picture by improving the visual effect and magnifying the details in the portrait. The portrait light and shadow enhancement algorithm can enhance the realism and layering of the portrait by adding appropriate light sources and shadows to the image. The portrait beauty algorithm can beautify the portrait in the image, such as making the face thinner and the eyes bigger.

[0086] The portrait filter algorithm can add different filters to the portrait in the image, so that the image presents different colors to enrich the layering of the image. The portrait zoom algorithm can realize the post-selfie function according to the different focal lengths selected by the user, which can meet the needs of enlarging or reducing the proportion of the portrait in the entire image. In addition, during the selfie process, when the portrait is at the edge of the image, the "stretching" operation of the distortion correction may make the area corresponding to the portrait wider, resulting in an imbalance in the portrait proportion. Therefore, at this time, the portrait distortion correction algorithm can be used to adjust the portrait proportion in the image to enhance the visual effect of the image.

[0087] The portrait blur algorithm can keep the designated portrait in the picture clear while blurring the rest of the background to highlight the portrait in the image and increase the beauty of the portrait.

[0088] It can be understood that portrait blur algorithms generally include single-camera blur algorithms and dual-camera blur algorithms. The dual-camera blur algorithm is implemented by the main camera and wide-angle camera of the mobile phone, and the dual-camera blur algorithm works better for long-distance portraits. In other words, when the distance between the portrait being photographed and the camera of the mobile phone is far, the dual-camera blur algorithm can be used. The single-camera blur algorithm is implemented by the main camera of the mobile phone. When the distance between the portrait being photographed and the camera of the mobile phone is close, the single-camera blur algorithm can be used.

[0089] Therefore, in the embodiment of the present application, by judging the distance between the photographed object (ie, the user) and the rear camera of the mobile phone 100, it is determined whether to adopt a single-camera blur algorithm or a dual-camera blur algorithm. Figure 6 A schematic diagram of a flow chart for determining a blurring algorithm is shown. Specifically, Figure 6 As shown, in response to the user's shooting instruction, the distance between the subject and the rear camera is determined. If the distance between the subject and the rear camera is less than the distance threshold, a single-camera blur algorithm is used; if the distance between the subject and the rear camera is greater than or equal to the distance threshold, a dual-camera blur algorithm is used to achieve the best blur effect, thereby improving the quality of the obtained image.

[0090] The embodiment of the present application does not limit the size of the distance threshold. The distance threshold can be set based on experience or flexibly adjusted according to the application scenario. For example, the distance threshold can be 1 meter or 2 meters.

[0091] In addition, the embodiments of the present application do not limit the method of detecting the distance between the photographed object and the rear camera. For example, the mobile phone 100 can emit a laser, and then determine the distance between the photographed object and the rear camera based on the length of time the laser irradiates the photographed object and returns to the relevant sensor in the mobile phone. For another example, the distance between the photographed object and the rear camera can also be determined based on a motor code (code) (for example, the motor code ranges from 0 to 1024). It can be understood that different motor codes can map different distances between the photographed object and the rear camera, and therefore, the distance between the photographed object and the rear camera can be determined by the size of the motor code.

[0092] It can be understood that the above content is only an illustrative example of a method for determining the distance between the photographed object and the rear camera, and does not constitute all limitations of the present application. For example, the distance between the photographed object and the rear camera can also be determined by the proportion of the photographed object occupying the entire image.

[0093] It can be understood that the above-mentioned shooting algorithms are all used in the post-selfie process, and are all related algorithms that can improve the quality of the selfie images taken. In addition, some feature algorithms can also be added in the post-selfie mode, including but not limited to gesture shooting algorithm, smile shooting algorithm, mirror algorithm, and ring fill light algorithm for the secondary screen.

[0094] Among them, the gesture shooting algorithm can determine whether to start shooting by detecting the user's gesture. The gesture shooting algorithm can replace the traditional shooting method in which the user clicks the corresponding shooting control to shoot, which can make the shooting process more convenient. The smile shooting algorithm is similar to the principle of the gesture shooting algorithm. For example, if the mobile phone 100 detects that the user is in a smiling state, it can automatically start shooting. During the shooting process, the mirror algorithm can make the image displayed in the mobile phone interface mirror the user's posture in the display. The annular fill light algorithm for the secondary screen can fill light for the user during the post-selfie process, which can increase the ambient brightness during shooting, thereby improving the image quality.

[0095] It can be understood that the above-mentioned shooting algorithm used in the rear selfie mode is only an exemplary illustration and does not constitute all limitations of the present application. That is to say, in addition to the above-mentioned algorithm, the shooting algorithm involved in the embodiment of the present application may also include other related algorithms suitable for selfie scenes.

[0096] It can be understood that the above-mentioned photo-taking algorithms are all related to the selfie scene. In the rear selfie mode, the above-mentioned algorithms can make the quality of the obtained selfie photos better and enhance the user experience.

[0097] In addition, by FIG. 3A to FIG. 3EIt can be seen that when switching from the front selfie mode to the rear selfie mode, after the user clicks the sub-screen selfie control 106 in the main screen 101, the rear camera 104 of the mobile phone 100 will be turned on to prepare to start shooting. However, if the user has not flipped the mobile phone 100 at this time, or is flipping the mobile phone 100, then the user may accidentally touch the sub-screen 102 when holding the mobile phone 100. For example, accidentally touching the shooting control 105 in the sub-screen 102 causes the user to shoot before facing the rear camera 104. For another example, accidentally touching the video control and the shooting control 105 of the sub-screen results in recording, rather than the picture-taking function that the user wants. Therefore, accidentally touching the sub-screen will greatly reduce the shooting efficiency in the rear selfie mode, thereby reducing the user's experience.

[0098] Therefore, in order to solve the above technical problems, in some other embodiments, the shooting method provided by the present invention can also: in response to the operation of triggering the rear selfie mode, lock the controls in the rear selfie interface included in the secondary screen to prevent the user from accidentally touching the controls in the rear selfie interface when flipping the phone. When the user completely flips the mobile phone 100 so that the rear selfie interface faces the user, if the mobile phone 100 determines that the subject is facing the rear selfie interface by determining the number of target elements (such as faces) reflecting human features contained in the rear selfie interface, the controls in the rear selfie interface can be unlocked to perform subsequent shooting operations.

[0099] In an exemplary embodiment, if Figure 7 As shown, after the mobile phone 100 starts the rear selfie mode, the relevant controls in the rear selfie interface are locked. When the mobile phone 100 detects that the number of target elements in the rear selfie interface meets the number threshold, the locking operation of the relevant controls in the rear selfie interface can be canceled, that is, at this time, in response to the user's shooting instruction, the mobile phone 100 can shoot based on the shooting parameters and shooting algorithms corresponding to the rear selfie mode.

[0100] If the mobile phone detects that the number of target elements in the rear selfie interface does not meet the quantity threshold, the relevant controls in the rear selfie interface will remain locked until the number of target elements meets the quantity threshold, and then the locking operation of the relevant controls can be canceled.

[0101] The embodiment of the present application does not limit the number threshold of the target elements. For example, the number threshold can be 0 or 1. In addition, the embodiment of the present application does not limit the type of the target element. For example, the target element can be a face or a human eye, as long as the target element can reflect the characteristics of the human body.

[0102] For example, if the target element is a face and the quantity threshold is 0, the number of target elements satisfies the quantity threshold, that is, the number of faces in the rear selfie interface is greater than 0. This indicates that there is a subject to be photographed in the rear selfie interface, and the lock operation of the relevant controls can be canceled to prepare for subsequent shooting.

[0103] Taking the target element as a face and the number threshold as 1 as an example, the number of target elements that meets the number threshold means that the number of faces in the rear selfie interface is greater than or equal to 1. This means that there is at least one face in the rear selfie interface, and the user has turned the mobile phone 100 over and is facing the secondary screen of the mobile phone. At this time, the locking operation of the relevant controls can be canceled to prepare for subsequent shooting.

[0104] Fig. 8A FIG. 4 is a schematic diagram showing another shooting process in which the target element is a face and the quantity threshold is 0. Fig. 8A As shown, when the user clicks the secondary screen selfie control in the main screen display interface, the camera application in the mobile phone switches to the secondary screen display, that is, the rear selfie mode is started. Then, the relevant controls in the rear selfie interface corresponding to the secondary screen are locked, and after the user flips the mobile phone 100 to face the secondary screen of the mobile phone, when the mobile phone 100 recognizes that the number of faces in the rear selfie interface is greater than 0, the locking operation of the relevant controls is canceled, and then subsequent shooting is performed.

[0105] Figure 8B As shown in the figure, after the camera application switches to the secondary screen display, the related controls in the rear selfie interface corresponding to the secondary screen are not locked, which may accidentally touch the secondary screen and reduce the shooting efficiency of the rear selfie mode. Figure 8B As shown, in the method provided in the embodiment of the present application, after the mobile phone 100 starts the rear-mounted selfie mode, the relevant controls in the rear-mounted selfie interface are first locked, thereby preventing the user from accidentally touching the secondary screen due to holding the mobile phone 100 before facing the secondary screen, thereby improving the shooting efficiency of the rear-mounted selfie mode and improving the user experience.

[0106] The above content is only described as an electronic device that is a folding screen mobile phone. It can be understood that the electronic device to which the method provided in the embodiment of the present application is applicable can also be a straight-screen device, such as a straight-screen mobile phone, as long as it has dual screens, a front camera and a rear camera. Fig. 9 The schematic diagram of the structure of a straight-bar mobile phone is shown. Fig. 9 As shown, the bar phone may include a first screen 901 and a second screen 902 .

[0107] In summary, the shooting method provided by this application uses the shooting parameters and shooting algorithms corresponding to the rear-camera selfie mode to shoot in the rear-camera selfie mode. Compared with the shooting method using the shooting parameters and shooting algorithms corresponding to the conventional rear-camera shooting mode in the rear-camera selfie mode, the shooting parameters and shooting algorithms used in this application are more suitable for selfie scenes, improve the quality of the image obtained by the rear-camera selfie, and further improve the user experience.

[0108] In addition, the shooting method provided by the present application first locks the controls in the rear selfie interface after switching to the rear selfie mode, so as to prevent the user from accidentally touching the controls in the rear selfie interface when flipping the phone. When the user completely flips the phone, if the phone detects that the rear selfie interface contains target elements that reflect human features, the controls in the rear selfie interface can be unlocked for subsequent shooting operations. This method avoids the phenomenon that the user accidentally touches the rear selfie interface because of holding the phone, improves the shooting efficiency of the rear selfie mode, and also improves the user experience.

[0109] The embodiment of the present application provides an electronic device, which includes: one or more processors; one or more memories; one or more programs stored in the one or more memories, and when the one or more programs are executed by the one or more processors, the electronic device executes the shooting method involved in the above embodiment. In addition, the relevant content of the electronic device to which the method provided by the present application is applicable has been described in detail above and will not be repeated here.

[0110] An embodiment of the present application further provides a computer-readable storage medium, on which instructions are stored. When the instructions are executed on a computer, the computer executes the shooting method involved in the above embodiment.

[0111] Fig.10 A schematic diagram of the structure of an electronic device (taking a mobile phone 100 as an example) provided in an embodiment of the present application is shown.

[0112] It can be understood that the electronic device can be any electronic device with dual screens and rear selfie functions, including but not limited to mobile phones (such as straight-screen mobile phones, folding-screen mobile phones (folded up and down, folded left and right)), wearable devices (such as smart watches, smart bracelets, etc.), tablet computers, desktops, laptops, handheld computers, notebook computers, netbooks, etc., and the embodiments of the present application are not limited to this.

[0113] The mobile phone 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, and the like.

[0114] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the mobile phone 100. In other embodiments of the present application, the mobile phone 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0115] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0116] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0117] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the above-mentioned memory. Repeated access is avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved. The processor may be used to execute the shooting method mentioned in the present application.

[0118] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0119] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the mobile phone 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the mobile phone 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0120] The SIM card interface 195 is used to connect a SIM card.

[0121] It will be understood that, as used herein, the term "module" may refer to or include an application specific integrated circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and / or memory that executes one or more software or firmware programs, a combinational logic circuit, and / or other appropriate hardware components that provide the described functionality, or may be part of these hardware components.

[0122] It is understood that in each embodiment of the present application, the processor may be a microprocessor, a digital signal processor, a microcontroller, etc., and / or any combination thereof. According to another aspect, the processor may be a single-core processor, a multi-core processor, etc., and / or any combination thereof.

[0123] The various embodiments disclosed in the present application may be implemented in hardware, software, firmware, or a combination of these implementation methods. The embodiments of the present application may be implemented as a computer program or program code executed on a programmable system, the programmable system including at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device, and at least one output device.

[0124] Program code can be applied to input instructions to perform the functions described in this application and generate output information. The output information can be applied to one or more output devices in a known manner. For the purposes of this application, a processing system includes any system having a processor such as, for example, a digital signal processor (DSP), a microcontroller, an application specific integrated circuit (ASIC), or a microprocessor.

[0125] Program code can be implemented with high-level programming language or object-oriented programming language to communicate with the processing system. When necessary, program code can also be implemented with assembly language or machine language. In fact, the mechanism described in this application is not limited to the scope of any specific programming language. In either case, the language can be a compiled language or an interpreted language.

[0126] In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried or stored on one or more temporary or non-temporary machine-readable (e.g., computer-readable) storage media, which may be read and executed by one or more processors. For example, instructions may be distributed over a network or through other computer-readable media. Therefore, machine-readable media may include any mechanism for storing or transmitting information in a machine (e.g., computer) readable form, including, but not limited to, floppy disks, optical disks, optical disks, read-only memories (CD-ROMs), magneto-optical disks, read-only memories (ROMs), random access memories (RAMs), erasable programmable read-only memories (EPROMs), electrically erasable programmable read-only memories (EEPROMs), magnetic or optical cards, flash memory, or a tangible machine-readable memory for transmitting information (e.g., carrier waves, infrared signals, digital signals, etc.) using the Internet in electrical, optical, acoustic, or other forms of propagation signals. Therefore, machine-readable media include any type of machine-readable media suitable for storing or transmitting electronic instructions or information in a machine (e.g., computer) readable form.

[0127] In the accompanying drawings, some structural or method features may be shown in a specific arrangement and / or order. However, it should be understood that such a specific arrangement and / or order may not be required. Instead, in some embodiments, these features may be arranged in a manner and / or order different from that shown in the illustrative drawings. In addition, the inclusion of structural or method features in a particular figure does not mean that such features are required in all embodiments, and in some embodiments, these features may not be included or may be combined with other features.

[0128] It should be noted that the units / modules mentioned in the various device embodiments of the present application are all logical units / modules. Physically, a logical unit / module can be a physical unit / module, or a part of a physical unit / module, or can be implemented as a combination of multiple physical units / modules. The physical implementation method of these logical units / modules themselves is not the most important. The combination of functions implemented by these logical units / modules is the key to solving the technical problems proposed by the present application. In addition, in order to highlight the innovative part of the present application, the above-mentioned device embodiments of the present application do not introduce units / modules that are not closely related to solving the technical problems proposed by the present application, which does not mean that there are no other units / modules in the above-mentioned device embodiments.

[0129] It should be noted that in the examples and description of this patent, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "including one" do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0130] Although the present application has been illustrated and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the present application.

Claims

1. A shooting method, characterized in that: Applied to an electronic device, the electronic device includes a first camera, a second camera, a first screen and a second screen, and the method includes: Displaying a first shooting interface on the first screen, and shooting with the first camera based on first shooting parameters and a first shooting algorithm, wherein the first shooting interface is acquired by the first camera; Displaying a third shooting interface on the first screen, where the third shooting interface is captured by the second camera; In response to the user's first operation and the first flipping operation, the first camera is turned on, a second shooting interface is displayed on the second screen, and the first camera is used to shoot based on second shooting parameters and a second shooting algorithm, wherein the second shooting interface is captured by the first camera; The second shooting algorithm includes a portrait blur algorithm, which includes a dual-shot blur algorithm and a single-shot blur algorithm. When the distance between the photographed object and the electronic device is less than a distance threshold, the single-shot blur algorithm is used for shooting. When the distance between the photographed object and the electronic device is greater than or equal to the distance threshold, the dual-shot blur algorithm is used for shooting. After the second shooting interface is displayed, locking the controls in the second shooting interface; In response to detecting a target element in the second shooting interface, the controls in the second shooting interface are unlocked, wherein the target element is used to reflect the human body features of the subject being photographed.

2. The method according to claim 1, characterized in that The second shooting parameters are determined based on the shooting effect of the shooting scene corresponding to the second shooting interface, and the second shooting parameters include automatic focus parameters, automatic exposure parameters, automatic white balance parameters and image signal processing parameters; and, The second shooting algorithm includes at least one of the following: High dynamic range imaging algorithm, multi-frame noise reduction algorithm, user selfie portrait segmentation algorithm, portrait detail enhancement algorithm, portrait light and shadow enhancement algorithm, portrait beauty algorithm, portrait blur algorithm, portrait spot algorithm, portrait filter algorithm, portrait zoom algorithm, portrait distortion correction algorithm.

3. The method according to any one of claims 1-2, characterized in that: In response to the first operation and the first flipping operation of the user, the first camera is turned on, and the step of displaying the second shooting interface on the second screen specifically includes: In response to a first operation of the user, the third shooting interface displays first prompt information, where the first prompt information is used to prompt the user to perform a first flipping operation on the electronic device; In response to the first flipping operation, the first camera is turned on and the electronic device displays the second shooting interface.

4. The method according to claim 3, characterized in that The first operation includes any one of the following: The triggering operation of the first control in the third shooting interface, the operation of the user issuing a voice command, and the operation of the user executing a gesture command.

5. The method according to claim 4, characterized in that The first flipping operation is an operation in which the user flips the electronic device so that the user faces the second screen.

6. The method according to claim 5, characterized in that The electronic device is a foldable device; When the electronic device is in a folded state, the second screen and the first camera are located on the same side of the electronic device, and the first screen and the first camera are located on different sides of the electronic device; and When the electronic device is in an unfolded state, the first screen and the second screen are located on the same side of the electronic device.

7. The method according to claim 6, characterized in that The second camera and the first screen are located on the same side of the electronic device.

8. The method according to claim 5, characterized in that The electronic device is a candy bar device; The first camera and the second screen are located on a first side of the electronic device, and the second camera and the first screen are located on a second side of the electronic device.

9. An electronic device, characterized in that: include: one or more processors; One or more memories; the one or more memories store one or more programs, and when the one or more programs are executed by the one or more processors, the electronic device executes the shooting method according to any one of claims 1 to 8.

10. A readable storage medium, characterized in that: The readable storage medium stores instructions, and when the instructions are executed on an electronic device, the electronic device executes the shooting method according to any one of claims 1 to 8.

Images