Photographing method, readable storage medium, and electronic device

Abstract

The present application relates to the technical field of image processing, and discloses a photographing method, a readable storage medium, and an electronic device. In the method, upon detecting a photographing instruction, an electronic device may first collect a large field-of-view image by means of a first camera and determine photographic subjects within the large field-of-view image; then, the electronic device may display an ROI corresponding to each photographic subject, and determine at least one enhanced photographing region within the large field-of-view image on the basis of an ROI selected by a user, wherein each enhanced photographing region comprises at least part of image content of the photographic subject corresponding to the ROI selected by the user; and the electronic device may respectively acquire, by means of a second camera having a field of view smaller than that of the first camera, a small field-of-view image corresponding to each enhanced photographing region, and fuse the small field-of-view image and the large field-of-view image to obtain a photographing result image. In this way, the number of small field-of-view images to be photographed is reduced, and the speed at which the electronic device photographs and generates the photographing result image is improved.

Description

Photographing method, readable storage medium and electronic device

[0001] The present application claims priority to the Chinese patent application No. 202411096884.5, filed on August 9, 2024, and entitled "Photographing method, readable storage medium and electronic device", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the technical field of image processing, and in particular, to a photographing method, a readable storage medium and an electronic device. BACKGROUND

[0003] In an electronic device, a camera with a small equivalent focal length (for example, a wide-angle camera) is usually configured to meet the demand of a user for photographing an image with a large field of view (hereinafter referred to as a large-view image).

[0004] Generally, the smaller the equivalent focal length of a camera is, the larger the field of view of the camera is, and the smaller the detail capturing capability of the camera for a distant photographing object is with the increase of the field of view. Therefore, in a large-view image photographed by a camera with a small equivalent focal length, the details of a photographing object far away from the electronic device are usually lost. As such, the user may not be able to view the details of the photographing object far away from the electronic device in the large-view image, which affects the user experience. SUMMARY

[0005] In view of the above, the present application provides a photographing method, a readable storage medium and an electronic device.

[0006] In a first aspect, the present application provides a photographing method applied to an electronic device, the electronic device comprising a first camera and a second camera, wherein a field of view of the first camera is larger than a field of view of the second camera; and the method comprises: in response to a detected photographing instruction, photographing a first image by the first camera; identifying a photographing subject in the first image, generating and displaying at least one region of interest corresponding to the photographing subject in a first interface; determining an enhanced region in response to a user operation on the first interface, wherein the enhanced region comprises the at least one region of interest, and / or the enhanced region comprises a user-defined region; photographing at least one second image matched with image content of the enhanced region by the second camera, wherein each second image is matched with at least part of the image content of the enhanced region; fusing the first image and the at least one second image to obtain a target image of the photographing instruction.

[0007] In the method, the electronic device can automatically identify the shooting subjects in the first image (for example, the large field of view image in the following) and the regions of interest corresponding to the shooting subjects, and determine an enhanced region including the regions of interest corresponding to the shooting subjects and / or user-defined regions (for example, regions modified by the user on the regions of interest of the shooting subjects, or regions newly added by the user). Then, the electronic device can use a second image (for example, the small field of view image in the following) matching the image content of the enhanced region, and fuse the second image and the first image to obtain a target image.

[0008] Since the regions of interest of the shooting subjects are obtained by the electronic device automatically (for example, obtained by intelligent identification through a pre-trained model), instead of being manually framed by the user, the interactive process of the user using the electronic device for fusion shooting is optimized, which is conducive to improving the interactive experience of the user and the electronic device. Moreover, since each second image matches at least part of the image content in the enhanced region, images not including the image content of the enhanced region can be avoided, which is conducive to the number of images to be shot by the second camera and improves the speed of the electronic device generating the target image.

[0009] In addition, the enhanced region can also only include user-defined regions, or simultaneously include user-defined regions and at least part of the regions of interest corresponding to the shooting subjects, which increases the selectability of the regions of interest involved in the enhanced region. In this way, the user can edit the regions of interest identified by the electronic device according to needs, which is conducive to improving the user experience.

[0010] In a possible implementation of the first aspect, the enhanced region includes a plurality of sub-shooting regions, and the shooting, by the second camera, of at least one second image matching the image content of the enhanced region includes: displaying, on the second interface, the first image and first information superimposed on a layer above the first image, the first information including a frame of each sub-shooting region and guide information indicating a shooting order of the sub-shooting regions; and in response to the image content captured by the second camera matching the image content in a first sub-shooting region of the plurality of sub-shooting regions, shooting a second image corresponding to the first sub-shooting region.

[0011] In this implementation, the electronic device can display first information guiding the user to shoot the positions and the shooting order of the sub-shooting regions (for example, the enhanced shooting regions in the following), so that the user can move the electronic device according to the guide information to enable the second camera of the electronic device to capture images of different fields of view. Moreover, in response to the image content captured by the second camera matching the image content in a first sub-shooting region of the plurality of sub-shooting regions (which can be any one of the plurality of sub-shooting regions), a second image corresponding to the first sub-shooting region is shot.

[0012] In a possible implementation of the first aspect, the first information further includes a current field of view frame indicating a position of image content currently captured by the second camera in the first image.

[0013] In this implementation, the current field of view frame can indicate the position of the image content currently captured by the second camera in the first image, so that the user can move the electronic device according to the relationship between the current field of view frame and the border of each sub-shooting area, so that the second camera of the electronic device can capture the field of view corresponding to each sub-shooting area.

[0014] In a possible implementation of the first aspect, the determining the enhanced area in response to the operation of the user on the first interface includes: determining a target region of interest in response to the operation of the user on the first interface; and determining an enhanced area corresponding to the target region of interest, wherein the enhanced area includes at least one sub-shooting area, one sub-shooting area covers at least part of the content of the target region of interest, and the at least one sub-shooting area covers all the content of the target region of interest.

[0015] In a possible implementation of the first aspect, the first interface includes an enhanced shooting control; and the determining the target region of interest in response to the operation of the user on the first interface includes: determining at least one region of interest as the target region of interest in response to the operation of the user selecting the enhanced shooting control in the first interface; or determining at least one first region of interest as the target region of interest in response to the operation of the user selecting the enhanced shooting control after selecting at least one first region of interest in the at least one region of interest in the first interface.

[0016] In this implementation, the target region of interest can include part or all of the at least one region of interest automatically identified by the electronic device.

[0017] In a possible implementation of the first aspect, the determining the target region of interest in response to the operation of the user on the first interface includes: displaying a second interface in response to the operation of the user modifying a second region of interest in the at least one region of interest to a first user-defined area in the first interface, wherein the second interface includes other regions of interest except the second region of interest in the at least one region of interest, the first user-defined area, and the enhanced shooting control; and determining the target region of interest in response to the operation of the user selecting the enhanced shooting control after selecting at least one region of interest except the second region of interest in the at least one region of interest and / or the first user-defined area in the second interface.

[0018] In this implementation, the target region of interest can include a region of interest that is automatically identified by the electronic device and that is not modified by the user, and / or a first user-defined region obtained by the user modifying a first region of interest in the at least one region of interest.

[0019] In a possible implementation of the first aspect, in response to the user operation on the first interface, the target region of interest is determined, including: in response to the user operation of adding a second user-defined region in the first interface, displaying a third interface, the third interface including the at least one region of interest, the second user-defined region, and an enhanced shooting control; in response to the user operation of selecting the enhanced shooting control after selecting the at least one region of interest and / or the second user-defined region in the third interface, determining the region of interest selected by the user as the target region of interest.

[0020] In this implementation, the target region of interest can include at least part of the at least one region of interest that is automatically identified by the electronic device, and / or a second user-defined region added by the user.

[0021] In a possible implementation of the first aspect, the first interface, the second interface, or the third interface further includes a distortion correction control; and the method further includes: in response to the user operation of selecting the distortion correction control, displaying a fourth interface, the fourth interface including the first image and a frame of at least one distortion correction region superimposed on the first image; in the process of moving the electronic device, in response to the image content captured by the second camera matching the image content in each distortion correction region, capturing a third image corresponding to each distortion correction region; and performing distortion correction on the first image based on the third images.

[0022] In this implementation, the electronic device can capture, according to the user operation of selecting the distortion correction control, a third image (for example, a small field of view image corresponding to the distortion correction region below) corresponding to the distortion correction region of the edge region of the first image by the second camera, and perform distortion correction on the first image based on the third image.

[0023] In a possible implementation of the first aspect, the first image and the at least one second image are fused to obtain a target image of the shooting instruction, including: fusing the at least one second image and the first image after distortion correction to obtain the target image.

[0024] In this implementation, the target image is obtained by fusing the at least one second image and the first image after distortion correction, which is beneficial to reduce the distortion of the target image.

[0025] In a possible implementation of the first aspect, the fusing the first image and the at least one second image to obtain the target image of the shooting instruction comprises: displaying a fifth interface, the fifth interface comprising the first image and a frame of the at least one distortion correction region superimposed on a layer of the first image; in a process in which the user moves the electronic device, in response to the image content captured by the second camera matching the image content in each distortion correction region, capturing a third image corresponding to each distortion correction region; performing distortion correction on the first image based on the third images; and fusing the at least one second image and the first image after the distortion correction to obtain the target image.

[0026] In this implementation, the target image is obtained by fusing the at least one second image and the first image after the distortion correction, which is beneficial to reducing the distortion of the target image.

[0027] In a possible implementation of the first aspect, the generating and displaying the at least one region of interest corresponding to the shooting subject in the first interface comprises: in response to the shooting subject being a person, taking a region in which a face of the person is located as the region of interest corresponding to the shooting subject; and in response to the shooting subject not including a person, taking a region in which the shooting subject is located as the region of interest corresponding to the shooting subject.

[0028] In a second aspect, the present application provides an electronic device, comprising: a memory configured to store one or more programs; and a processor configured to execute the one or more programs to enable the electronic device to implement the shooting method in the first aspect and any possible implementation of the first aspect.

[0029] In a possible implementation of the second aspect, the electronic device comprises a first camera and a second camera, the first camera being configured to capture a first image, and the second camera being configured to capture a second image.

[0030] In a third aspect, a readable storage medium is provided, the readable storage medium comprising one or more programs, the one or more programs, when executed on an electronic device, enabling the electronic device to implement the shooting method in the first aspect and any possible implementation of the first aspect.

[0031] In a fourth aspect, a program product is provided, the program product, when executed on an electronic device, enabling the electronic device to implement the shooting method in the first aspect and any possible implementation of the first aspect.

[0032] It should be understood that the beneficial effects of the second aspect to the fourth aspect can refer to the beneficial effects described in the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0033] FIG. 1 shows a schematic diagram of a field of view of a camera of a mobile phone, according to some embodiments of the present application.

[0034] FIG. 2A shows a schematic diagram of a process of implementing fusion photography by a mobile phone, according to some embodiments of the present application.

[0035] FIG. 2B shows a schematic diagram of a process of generating a fusion image PF1 by a mobile phone, according to some embodiments of the present application.

[0036] FIG. 3A shows a schematic diagram of a process of implementing fusion photography by a mobile phone based on camera C1 and camera C3, according to some embodiments of the present application.

[0037] FIG. 3B shows a schematic diagram of a mobile phone collecting a small field of view image during a user moving the mobile phone 10, according to some embodiments of the present application.

[0038] FIG. 3C shows a schematic diagram of a process of generating a fusion image PF2 by a mobile phone, according to some embodiments of the present application.

[0039] FIG. 4 shows a schematic diagram of a relationship among a field of view of a first camera, a field of view of a second camera, and a field of view of an enhanced photography region, according to some embodiments of the present application.

[0040] FIG. 5 shows a schematic diagram of an interface displayed during a process of a mobile phone collecting a small field of view image of a distortion correction region, according to some embodiments of the present application.

[0041] FIG. 6 shows a schematic diagram of a flow of a photography method, according to some embodiments of the present application.

[0042] FIG. 7A shows a schematic diagram of a mobile phone modifying a ROI of a photography subject, according to some embodiments of the present application.

[0043] FIG. 7B shows another schematic diagram of a mobile phone modifying a ROI of a photography subject, according to some embodiments of the present application.

[0044] FIG. 8A shows a schematic diagram of a mobile phone determining an enhanced photography region, according to some embodiments of the present application.

[0045] FIG. 8B shows another schematic diagram of a mobile phone determining an enhanced photography region, according to some embodiments of the present application.

[0046] FIG. 8C shows another schematic diagram of a mobile phone determining an enhanced photography region, according to some embodiments of the present application.

[0047] FIG. 8D shows another schematic diagram of a mobile phone determining an enhanced photography region, according to some embodiments of the present application.

[0048] FIG. 9A shows a schematic diagram of a shooting sequence of a mobile phone determining an enhanced shooting area, according to some embodiments of the present application.

[0049] FIG. 9B shows another schematic diagram of a shooting sequence of a mobile phone determining an enhanced shooting area, according to some embodiments of the present application.

[0050] FIG. 10A shows a schematic diagram of a guide shooting interface displayed by a mobile phone, according to some embodiments of the present application.

[0051] FIG. 10B shows another schematic diagram of a guide shooting interface displayed by a mobile phone, according to some embodiments of the present application.

[0052] FIG. 11 shows a schematic diagram of another shooting method, according to some embodiments of the present application.

[0053] FIG. 12 shows a schematic diagram of determining a shooting subject in a large field of view image and a ROI corresponding to the shooting subject, according to some embodiments of the present application.

[0054] FIG. 13 shows a schematic diagram of a shooting subject in a group photo and a ROI corresponding to the shooting subject, according to some embodiments of the present application.

[0055] FIG. 14 shows a schematic diagram of another shooting method, according to some embodiments of the present application.

[0056] FIG. 15 shows a schematic diagram of a structure of a mobile phone, according to some embodiments of the present application. DETAILED DESCRIPTION

[0057] Illustrative embodiments of the present application include, but are not limited to, shooting methods, readable storage media, and electronic devices.

[0058] It should be noted that the photographing method provided by the embodiments of the present application can be applied to any electronic device including multiple cameras, including but not limited to user equipment (user equipment, UE), mobile station (mobile station, MS), mobile terminal (mobile terminal, MT), etc. For example, the electronic device can be a mobile phone, a wearable device, a tablet computer (Pad), a laptop computer, a virtual reality (virtual reality, VR) device, an augmented reality (augmented reality, AR) device, an industrial control device, a car machine, a terminal device in a smart grid, a terminal device in transportation safety, a terminal device in a smart city, etc. For ease of description, the electronic device is taken as a mobile phone 10 in the following, and the technical solutions of the present application are introduced.

[0059] The technical solutions of the embodiments of the present application will be described below with reference to the accompanying drawings.

[0060] As described above, the details of the photographed object far away from the electronic device will be lost in the large field of view image, and the farther the photographed object is from the electronic device, the more details will be lost in the large field of view image. Thus, it can cause the user to be unable to view the details of the photographed object far away from the electronic device in the large field of view image, affecting the user experience.

[0061] To increase the details of the photographed object far away from the electronic device in the large field of view image photographed by the electronic device, some electronic devices provide a fusion photographing (also referred to as multi-camera photographing, dual-camera photographing, etc.) function. Fusion photographing generally refers to a photographing mode in which after a large field of view image is photographed by a camera with a large field of view angle, one or more small field of view images corresponding to part of the image region in the large field of view image are collected by a camera with a small field of view angle, and the large field of view image and the small field of view image are fused into an image.

[0062] In some embodiments, the process of fusion photographing can include:

[0063] The electronic device can first capture a large field of view image through the camera with a large field of view angle, and obtain a rectangular region selected by the user in the large field of view image as an image region (hereinafter referred to as an enhanced shooting region) that needs to be shot through the camera with a small field of view angle, and a division manner (i.e., a manner of dividing the enhanced shooting region into a plurality of continuous sub-regions) of the enhanced shooting region selected by the user. Then, the electronic device can capture small field of view images corresponding to each sub-region of the enhanced shooting region through the camera with a small field of view angle according to the enhanced shooting region and the division manner of the enhanced shooting region. Then, the electronic device can fuse the small field of view images with the large field of view image to obtain a final fused image. In this way, the fused image can not only maintain a large field of view, but also retain the details of the shooting object far away from the electronic device.

[0064] For example, FIG. 1 illustrates a schematic diagram of the field of view angles of the cameras of a mobile phone 10 according to some embodiments of the present application.

[0065] As shown in FIG. 1, the mobile phone 10 includes a camera C1, a camera C2, and a camera C3, wherein the field of view angle of the camera C1 in the X direction is α x1 , the field of view angle of the camera C1 in the Y direction is α y1 , the field of view angle of the camera C2 in the X direction is α x2 , the field of view angle of the camera C2 in the Y direction is α y2 , the field of view angle of the camera C3 in the X direction is α x3 , the field of view angle of the camera C3 in the Y direction is α y3 , and α x1 > α x2 > α x3 > α y1 > α y2 > α y3 . That is, the field of view angle of the camera C1 is greater than the field of view angle of the camera C2, and the field of view angle of the camera C2 is greater than the field of view angle of the camera C3.

[0066] In the process of performing fusion shooting, the mobile phone 10 can shoot a large field of view image through the camera C1, and shoot a small field of view image through the camera C2 and / or the camera C3, or shoot a large field of view image through the camera C2, and shoot a small field of view image through the camera C3.

[0067] Hereinafter, the technical solutions of the present application will be introduced by taking the mobile phone 10 shooting a large field of view image through the camera C1 and shooting a small field of view image through the camera C3 as an example.

[0068] For example, FIG. 2A illustrates a schematic diagram of the process of the mobile phone 10 implementing fusion shooting according to some embodiments of the present application; and FIG. 2B illustrates a schematic diagram of the process of the mobile phone 10 generating a fused image PF1 according to some embodiments of the present application.

[0069] As shown in FIG. 2A, after detecting a click operation of the user on the shooting control U11 in the fusion shooting mode, the mobile phone 10 can capture an image using the camera C1 to obtain a large field of view image PL1, and the shooting object in the large field of view image PL1 can include a building B1 and a building B2.

[0070] After obtaining the large field of view image PL1, the mobile phone 10 can display a region selection interface U12, and display a prompt information "Please select the enhanced shooting region" in the region selection interface U12 to prompt the user to select an image region that needs to be shot by the camera C3. In the region selection interface U12, a grid selection control U13 can be included, and the grid selection control U13 includes preset division manners of the enhanced shooting region, such as 3x3 (dividing the enhanced shooting region into 3 rows and 3 columns of sub-regions), 2x3 (dividing the enhanced shooting region into 2 rows and 3 columns of sub-regions), 2x2 (dividing the enhanced shooting region into 2 rows and 2 columns of sub-regions), and the like. The user can select a division manner of the enhanced shooting region through an operation in the grid selection control U13, for example, the user can select 2x3 as the division manner of the enhanced shooting region.

[0071] If the user needs to retain more details of the building B1 and the building B2 in the shooting result of the fusion shooting, a rectangular region including the building B1 and the building B2 can be selected as the enhanced shooting region through an operation on the region selection interface U12. For example, after detecting an operation of the user sliding from point A to point B on the large field of view image PL1, the mobile phone 10 can determine a rectangular region with AB as the diagonal as the enhanced shooting region D1.

[0072] After detecting a shooting operation of the user on the enhanced shooting region D1 (for example, a click operation of the user on the shooting control U11 in the selection interface U12), the mobile phone 10 can display an enhanced shooting interface U14. In the enhanced shooting interface U14, a grid of the enhanced shooting region (for example, the grid G1 to the grid G6), an arrow A1 indicating the direction of the user moving the mobile phone 10, and a prompt information "Please move the mobile phone in the direction of the arrow to shoot the field of view region corresponding to the grid" can be included. The user can change the image content captured by the camera C3 by moving the mobile phone 10. During the movement of the mobile phone 10 by the user, the mobile phone 10 can capture small field of view images PS1 to PS6 corresponding to the grid G1 to G6, respectively, by the camera C3, in a case that the content captured by the camera C3 matches the content corresponding to the grid G1 to G6, respectively. Referring to FIG. 2B, compared with the building B1 and the building B2 in the large field of view image PL1, the building B1 in the small field of view image PS1 corresponding to the grid G1 includes more details, and the building B2 in the small field of view image PS3 corresponding to the grid G3 includes more details.

[0073] Finally, the mobile phone 10 can fuse the small field of view images PS1-PS6 and the large field of view image PL1 to obtain a fused image PF1. For example, referring to FIG. 2B, the mobile phone 10 can replace the content of the region corresponding to the grid G1, the content of the region corresponding to the grid G2, the content of the region corresponding to the grid G3, the content of the region corresponding to the grid G4, the content of the region corresponding to the grid G5, and the content of the region corresponding to the grid G6 in the large field of view image PL1 with the small field of view images PS1-PS6, respectively, to obtain the fused image PF1. Compared with the large field of view image PL1, the building B1 and the building B2 in the fused image PF1 include more detailed content.

[0074] However, in the foregoing photographing process, the enhanced photographing region is a rectangular region manually selected by the user. If the photographing objects that the user wants to enhance are relatively dispersed, or the enhanced photographing region selected by the user is too large, the mobile phone 10 may collect small field of view images that do not include the photographing objects that the user wants to enhance, thereby increasing the time length of fusing the photographing to obtain the fused image.

[0075] For example, for the photographing process of FIGS. 2A and 2B, the enhanced photographing region D1 selected by the user is a continuous rectangular region including the building B1 and the building B2. The mobile phone 10 needs to use the camera C3 to photograph 6 small field of view images (the small field of view images PS1-PS6) to photograph the image content in the enhanced photographing region D1. The small field of view images PS2 and PS5 do not include the image content of the building B1 and the building B2, and photographing the small field of view images PS2 and PS5 cannot increase the detailed content of the building B1 and the building B2. In this way, the number of small field of view images photographed by the mobile phone 10 is increased, thereby increasing the process of fusing the photographing to obtain the fused image PF1 by the mobile phone 10, and affecting the photographing experience of the user.

[0076] Therefore, an embodiment of the present application provides a photographing method. In the photographing method, the electronic device does not need the user to manually frame the enhanced photographing region, but automatically identifies the photographing subject in the large field of view image, and determines the enhanced photographing region based on the photographing subject in the large field of view image, for example, determines the region where the photographing subject is located in the large field of view image as the enhanced photographing region. In this way, the time length of fusing the photographing by the electronic device caused by the enhanced photographing region manually framed by the user being too large can be avoided.

[0077] Specifically,

[0078] After detecting the instruction of the user to capture the image by fusion shooting, the electronic device can first capture a large field of view image by the first camera and determine the shooting subjects in the large field of view image. Then, the electronic device can display the region of interest (ROI) corresponding to each shooting subject (for example, the image region where the shooting subject is located, the image region where the circumscribed polygon (for example, the circumscribed rectangle) of the shooting subject is located, etc.), and determine at least one enhanced shooting region in the large field of view image according to the ROI selected by the user (the at least one enhanced shooting region can also be referred to as an enhanced region, in other words, all enhanced shooting regions collectively constitute an enhanced region, which can be integral or scattered, and each enhanced shooting region can also be referred to as a sub-shooting region of the enhanced region), wherein each enhanced shooting region includes at least part of the image content of the shooting subject (hereinafter referred to as the target shooting subject) corresponding to the ROI selected by the user (hereinafter referred to as the target ROI). Again, the electronic device can capture a small field of view image corresponding to each enhanced shooting region by the second camera (the field of view angle of the second camera is smaller than that of the first camera), and fuse the small field of view image and the large field of view image to obtain a shooting result image.

[0079] Based on the above method, since the shooting subjects and the ROIs of the shooting subjects are obtained by the electronic device automatically (for example, obtained by intelligent identification by a pre-trained model), rather than manually framed by the user, the interactive process of the user using the electronic device for fusion shooting is optimized, which is beneficial to improve the interactive experience of the user and the electronic device compared with the foregoing manual framing scheme of the user. Moreover, since each enhanced shooting region includes the image content of the target shooting subject, it can avoid shooting a small field of view image that does not include the target shooting subject, which is beneficial to reduce the number of small field of view images shot and improve the speed of the electronic device to shoot and generate a shooting result image.

[0080] For example, FIG. 3A illustrates a process diagram of a mobile phone 10 based on fusion shooting by camera C1 and camera C3 according to some embodiments of the present application.

[0081] As shown in FIG. 3A:

[0082] The mobile phone 10 displays a fusion shooting interface U10, and the fusion shooting interface U10 can include a shooting control U11. After detecting that the user clicks the shooting control U11, the mobile phone 10 can collect and generate the aforementioned large field of view image PL1 through the camera C1. Then, the mobile phone 10 can identify the shooting subjects (the building B1, the building B2, and the building B3) in the large field of view image PL1 and display a subject editing interface U21. In the subject editing interface U21, the ROI R1, the ROI R2, and the ROI R3 corresponding to the building B1, the building B2, and the building B3, respectively, and an editing ROI area control U22 and a start enhancement shooting control U23 can be included.

[0083] In some embodiments, the ROI R1, the ROI R2, and the ROI R3 in the subject editing interface U21 are all selected by default. If the user directly clicks the start enhancement shooting control U23 in the subject editing interface U21, the mobile phone 10 can perform fusion shooting on all the ROIs in the subject editing interface U21 as target ROIs.

[0084] Secondly, after detecting that the user clicks the selection editing ROI area control U22 and then clicks the ROI R3, the mobile phone 10 can cancel the shooting subject of the building B3 and display a subject editing interface U24, and the aforementioned ROI R3 is no longer displayed in the subject editing interface U24.

[0085] Thirdly, after detecting that the user clicks the start enhancement shooting control U23 in the subject editing interface U24, the mobile phone 10 can display an enhancement shooting interface U25. The enhancement shooting interface U25 can include the enhancement shooting area D2 corresponding to the building B1 and the enhancement shooting area D3 corresponding to the building B2, an arrow A2 indicating the user to move the mobile phone 10, and a prompt information “Please move the mobile phone in the direction of the arrow to shoot the field of view area corresponding to the guide frame”.

[0086] Referring to FIG. 3B, the user can adjust the image content collected by the camera C3 by rotating the mobile phone 10 around the X axis. During the process of rotating the mobile phone 10 around the X axis, the mobile phone 10 can shoot an image to obtain a small field of view image PS7 when detecting that the image content collected by the camera C3 matches the image content in the enhancement shooting area D2, and shoot an image to obtain a small field of view image PS8 when detecting that the image content collected by the camera C3 matches the image content in the enhancement shooting area D3.

[0087] Finally, referring to FIG. 3C, the mobile phone 10 can fuse the small field of view image PS7 and the small field of view image PS8 with the large field of view image PL1 to obtain and display a fusion image PF2. Compared with the large field of view image PL1, the building B1 and the building B2 in the fusion image PF2 include more detailed content.

[0088] Based on the above process, compared with the manner shown in FIG. 2A, the mobile phone 10 only needs to collect 2 small field of view images to obtain the same fusion image PF2 as the fusion image PF1, thereby reducing the collection of 4 small field of view images and improving the speed of image shooting by the mobile phone 10 in the fusion shooting manner. In addition, the reduction in the number of small field of view images also reduces the calculation resources consumed by the mobile phone 10 in fusing the small field of view images and the large field of view image, which is conducive to reducing the power consumption of the mobile phone 10.

[0089] In some embodiments, for the mobile phone 10 shown in FIG. 1, when the first camera is the camera C1, the second camera can be the camera C2 and / or the camera C3; when the first camera is the camera C2, the second camera can be the camera C3.

[0090] In some embodiments, the mobile phone 10 can identify the shooting subject in the large field of view image and generate the ROI corresponding to the shooting subject by using a pre-trained model, such as a convolutional neural network model, a target detection model (for example, a fast region-based convolutional network (Fast RCNN), a faster region-based convolutional network (Faster RCNN), a mask region-based convolutional network (Mask RCNN), etc.), a target detection model based on a transformer model (a model based on a self-attention mechanism) (for example, a detection transformer (DETR)), etc. Illustratively, the shooting subject can be a person, an animal, a building, a specific object, etc. in the image.

[0091] In some embodiments, the shape of the ROI corresponding to the shooting subject can be an arbitrary shape, for example, the shape of the ROI can be the same as the shape of the shooting subject, or the shape of the ROI can be a circumscribed polygon, a circumscribed circle, a circumscribed ellipse, etc. of the shooting subject. The embodiments of the present application do not limit the shape of the ROI.

[0092] In some embodiments, the user-selected ROI and / or the user-input custom region constitute the enhanced region, which covers the entire image of the user-selected ROI and / or the user-input custom region. In some embodiments, the enhanced region is determined by enlarging the user-selected ROI and / or the user-input custom region, for example, the enhanced region includes other image regions that are not selected by the user but are associated with the subject in the user-selected region, or the user-selected region is enlarged to form an enhanced region with regular boundaries, for example, the enhanced region is a rectangular region, which facilitates subsequent splitting of the enhanced shooting region and intelligent planning of the shooting order.

[0093] In some embodiments, the enhanced shooting region corresponding to the ROI can be a rectangle.

[0094] In some embodiments, the ROI region corresponding to one shooting subject can be divided into multiple enhanced shooting regions. For example, in the case that the aforementioned second camera cannot shoot the entire ROI of one shooting subject through one small field of view image, the mobile phone 10 can shoot the ROI corresponding to the shooting subject through multiple small field of view images. That is, there can be multiple enhanced shooting regions corresponding to the shooting subject, which can be multiple continuous rectangular regions or multiple rectangular regions with overlaps.

[0095] In some embodiments, in the case that there are multiple enhanced shooting regions, the multiple enhanced shooting regions can be completely independent regions in the large field of view image, and part of the multiple enhanced shooting regions can also have overlaps.

[0096] In some embodiments, one enhanced shooting region can also include one or more ROIs corresponding to shooting subjects.

[0097] In some embodiments, the mobile phone 10 can also adjust the ROI region corresponding to the shooting subject according to the user's operation in the aforementioned subject editing interface, for example, adding a new shooting subject, modifying the range of the ROI of the shooting subject recognized by the mobile phone 10, deleting part of the ROI of the shooting subject, etc.

[0098] In some embodiments, the size of the enhanced shooting region can be determined based on the relationship between the focal length of the second camera and the focal length of the first camera. For example, the equivalent focal length of the first camera when collecting the large field of view image is A, and the equivalent focal length of the second camera is B, then the size of the enhanced shooting region can be any size smaller than A / B times the size of the large field of view image. For another example, if the second camera is a zoom camera, the equivalent focal length range is [B1, B2], then the size of the enhanced shooting region can be any size from A / B2 times the size of the large field of view image to A / B2 times the size of the large field of view image.

[0099] In some embodiments, the size of the enhanced shooting area can also be determined based on the equivalent zoom ratio of the first camera and the equivalent zoom ratio of the first camera. The equivalent zoom ratio, also referred to as the equivalent magnification, refers to the zoom ratio of the shooting object in the image captured by the camera. The larger the equivalent zoom ratio of the camera, the larger the size of the shooting image in the captured image. For the mobile phone 10, the size of the same shooting object in the image captured by different cameras is proportional (or positively correlated) to the equivalent zoom ratio of the camera.

[0100] For example, assuming that the equivalent zoom ratio of the first camera is a, the equivalent zoom ratio of the field of view angle of the second camera is b, and the size of the large field of view image is HxW, the size of the enhanced shooting area is (Hxa / b)x(Wxa / b).

[0101] In some embodiments, the size of each enhanced shooting area can be the same or different. For example, the second camera can be a zoom camera, and the field of view angle of the second camera changes when the equivalent focal length of the second camera changes. Therefore, the field of view angle of the second camera can be adjusted by adjusting the focal length of the second camera, and then different focal lengths are used to capture small field of view images of enhanced shooting areas of different sizes. For example, referring to FIG. 4, the field of view angle of the first camera can be FOV1, the maximum field of view angle of the second camera can be FOV2, and the minimum field of view angle can be FOV3. Based on this, the range of the field of view angle FOV4 corresponding to each enhanced shooting area can be any field of view angle that satisfies FOV3≤FOV4≤FOV2.

[0102] In some embodiments, the position and number of the enhanced shooting areas can be determined based on the size of the enhanced shooting area, the size and position of the ROI of the target shooting subject, and the like. For example, the mobile phone 10 can determine the least number of enhanced shooting areas that can cover all the ROIs of the target shooting subject. In this way, it is beneficial to reduce the number of enhanced shooting areas, so as to reduce the number of small field of view images captured, and then shorten the total time length of the mobile phone 10 to realize fusion shooting. In some embodiments, the position and number of the enhanced shooting areas can be determined by a greedy algorithm or the like. For example, the mobile phone 10 can place the enhanced shooting area in the large field of view image according to the size of the enhanced shooting area, the size and position of the ROI of the target shooting subject, and the like. Each time the enhanced shooting area is placed, the mobile phone 10 can place the enhanced shooting area at a position that can cover the largest area of the ROI of the target shooting subject that has not been covered by the enhanced shooting area, until all the ROIs of the target shooting subject are covered by the enhanced shooting area.

[0103] In some embodiments, the mobile phone 10 can further capture a correction image corresponding to the region at the edge of the large field of view image by the second camera, perform distortion correction on the region at the edge of the large field of view image based on the captured correction image, and obtain the shooting result based on the large field of view image after correction and the small field of view image. In this way, the distortion of the region at the edge of the shooting result image can be reduced.

[0104] In some embodiments, the mobile phone 10 can further perform distortion correction on the edge of the image obtained by fusing the large field of view image and the small field of view image based on the correction image corresponding to the region at the edge of the large field of view image captured by the second camera, and take the corrected image as the shooting result. In this way, the distortion of the region at the edge of the shooting result image can be reduced.

[0105] For example, referring to FIG. 5, for the case shown in FIG. 3A, after detecting that the user double-clicks the ROI R3 in the main editing interface U21, the mobile phone 10 can display the interface U31. Compared with the interface U24, the interface U31 further includes a distortion correction control U32. After detecting that the user clicks the correction control U32, the mobile phone 10 can display the distortion correction interface U33. The distortion correction interface U33 can include a plurality of distortion correction regions (for example, the distortion correction region F1 to the distortion correction region F8) covering the edge region of the field of view image PL1, and an arrow A3 guiding the user to move the mobile phone 10 to shoot a small field of view image corresponding to each distortion correction region. During the movement of the mobile phone 10 according to the arrow A3, the mobile phone 10 can capture a small field of view image corresponding to each distortion correction region when detecting that the image captured by the second camera matches the image content of the distortion correction region, respectively. After capturing the small field of view images corresponding to all the distortion correction regions (or after detecting that the user stops capturing the small field of view images corresponding to the distortion correction regions, for example, after detecting that the user clicks the stop capturing control U34 in the distortion correction interface U33), the mobile phone 10 can perform distortion correction on each distortion correction region in the large field of view image based on the small field of view images corresponding to the distortion correction regions.

[0106] In some embodiments, the mobile phone 10 can perform distortion correction on each distortion correction region in the large field of view image based on the small field of view image in the following manner: performing distortion correction on the corresponding distortion correction region based on the small field of view image by using a pre-trained distortion correction model. The distortion correction model can be a model for performing distortion correction on the large field of view image based on the input small field of view image, the large field of view image, and the position of the small field of view image in the large field of view image.

[0107] In some embodiments, the manner in which the mobile phone 10 corrects the distortion of each distortion correction region in the large field of view image based on the small field of view image can be that, first, a geometric transformation relationship between the key points in the small field of view image and the corresponding key points in the large field of view image is determined. Then, the coordinates of the pixels in the distortion correction region corresponding to the small field of view image in the large field of view image are changed based on the geometric transformation relationship.

[0108] It should be noted that in other embodiments, the mobile phone 10 can also correct the distortion of each distortion correction region in the large field of view image based on the small field of view image in other manners, which are not limited herein. For example, the mobile phone 10 can first determine a plurality of feature points in the small field of view image and the feature points (hereinafter referred to as mapping feature points) corresponding to the plurality of feature points in the large field of view image. Then, the mobile phone 10 can determine an affine transformation matrix for transforming the mapping feature points to the feature points in the small field of view image. Finally, the mobile phone 10 can perform affine transformation on the corresponding distortion correction region in the large field of view image based on the obtained affine transformation matrix, so as to correct the distortion of the distortion correction region.

[0109] In some embodiments, after the enhanced shooting region is determined, the mobile phone 10 can plan the order in which the user shoots the small field of view image of each enhanced shooting region through a path planning algorithm, and prompt the user to collect the small field of view image of each enhanced shooting region in the planned order through display of an arrow or other manners.

[0110] For example, determining the shooting order of the enhanced shooting region can be regarded as a travelling salesman problem (TSP) without returning to the starting point, and thus the shooting order of the enhanced shooting region can be determined through an algorithm capable of solving the TSP, so as to reduce the total displacement of the user moving the mobile phone 10, thereby improving the efficiency of the mobile phone 10 in shooting the small field of view image. For example, the shooting order of the enhanced shooting region can be determined through a greedy algorithm, a dynamic programming algorithm, a branch and bound algorithm, a genetic algorithm, an ant colony algorithm, a simulated annealing algorithm, etc.

[0111] In other embodiments, the mobile phone 10 can also determine the shooting order of each enhanced shooting region in other manners, which are not limited herein.

[0112] In the following, the technical solutions of the present application are described in combination with FIGS. 6 to 15.

[0113] For example, FIG. 6 shows a flowchart of a shooting method according to some embodiments of the present application. The execution subject of the method is the mobile phone 10, as shown in FIG. 6, and the method includes the following steps:

[0114] S601, a fusion shooting instruction is detected, and a large field of view image is shot through a first camera. S602, a small field of view image corresponding to the large field of view image is shot through a second camera.

[0115] The mobile phone 10 can capture a large field of view image through the first camera in a case where a fusion shooting instruction is detected.

[0116] Exemplarily, the mobile phone 10 can detect the fusion shooting instruction and capture a large field of view image through the first camera when detecting that the user clicks a shooting control in the interface corresponding to the fusion shooting or presses a key for triggering the mobile phone 10 to shoot an image. For example, the mobile phone 10 can display the fusion shooting interface U10 shown in FIG. 3A, and detect the fusion shooting instruction after detecting that the user clicks the shooting control U11, and capture a large field of view image through the first camera.

[0117] In some embodiments, the mobile phone 10 can also detect the fusion shooting instruction in other cases, which are not limited herein. For example, the mobile phone 10 can capture voice information of the user, and detect the fusion shooting instruction when the captured voice information includes a voice instruction for fusion shooting. For another example, the mobile phone 10 can obtain a gesture of the user in the air, and detect the fusion shooting instruction when the obtained gesture in the air is a gesture corresponding to the fusion shooting.

[0118] It should be noted that the first camera can be a camera selected by the user, or a camera preset by the mobile phone 10. For example, the first camera can be the camera C1, or the camera C2.

[0119] Exemplarily, different cameras in the mobile phone 10 can correspond to different zoom ratio intervals, and the mobile phone 10 can select a corresponding camera as the first camera to capture a large field of view image according to a zoom ratio selected by the user. For example, the zoom ratio interval corresponding to the camera C1 can be [1X, 1.5X), the zoom ratio interval corresponding to the camera C2 can be [1.5X, 3.5X), and the zoom ratio interval corresponding to the camera C3 can be [3.5X, 10X]. The mobile phone 10 can determine the zoom ratio selected by the user according to the user operation, and select the camera C1 as the first camera to capture a large field of view image in a case where the zoom ratio of the user is in the interval [1X, 1.5X); and select the camera C2 as the first camera to capture a large field of view image in a case where the zoom ratio of the user is in the interval [1.5X, 3.5X).

[0120] It should be noted that the zoom ratio intervals corresponding to the cameras C1 to C3 are only an example, and in other embodiments, the zoom ratio intervals corresponding to the cameras C1 to C3 can be determined according to actual optical parameters (such as optical zoom, digital zoom, etc.) of the cameras C1 to C3, which are not limited herein.

[0121] S602, determine and display the ROIs corresponding to the shooting subjects in the large field of view image.

[0122] After the mobile phone 10 collects the large field of view image through the first camera, it can identify the shooting subjects in the large field of view image through an algorithm or a pre-trained model, and display the ROIs of the shooting subjects. In some embodiments, the ROIs corresponding to the shooting subjects can be superimposed on the upper layer of the large field of view image.

[0123] For example, for the case shown in FIG. 3A, the mobile phone 10 can first determine that the shooting subjects in the large field of view image PL1 include the building B1, the building B2, and the building B3. Then, the mobile phone 10 can display the subject editing interface U21, in which the ROIs R1, R2, and R3 corresponding to the building B1, the building B2, and the building B3 are superimposed on the upper layer of the large field of view image PL1.

[0124] For example, the pre-trained model can be the aforementioned convolutional neural network model, target detection model (such as the aforementioned Fast RCNN, Faster RCNN, Mask RCNN, DETR, etc.), or the like. It should be noted that the mobile phone 10 can also identify the shooting subjects in the large field of view image based on other algorithms or models, and determine and display the ROIs of the shooting subjects.

[0125] In some embodiments, the shooting subjects can include, but are not limited to, persons, animals, buildings, specific objects, etc. in the large field of view image.

[0126] In some embodiments, the interface in which the mobile phone 10 displays the ROIs corresponding to the shooting subjects in the large field of view image can also include a control for triggering distortion correction, such as the distortion correction control U32 shown in FIG. 5.

[0127] S603, determine the target ROI based on user operation.

[0128] After the mobile phone 10 displays the ROIs corresponding to the shooting subjects, it can determine the target ROI according to user operation.

[0129] For example, in the case where the user does not edit the ROI area of the shooting subject, the mobile phone 10 can take the ROIs corresponding to all the shooting subjects in the large field of view image as the target ROIs. For example, in the case where the mobile phone 10 detects that the user clicks the start enhancement shooting control U23 in the aforementioned subject editing interface U21 of FIG. 3A, it can determine the ROI R1 corresponding to the building B1, the ROI R2 corresponding to the building B2, and the ROI R3 corresponding to the building B3 as the target ROIs.

[0130] Exemplarily, after detecting the user's editing operation on the ROI of the shooting subject, the mobile phone 10 can add, delete or modify the ROI of at least part of the shooting subject in response to the user's editing operation. Then, the mobile phone 10 can take the ROI edited by the user as the target ROI.

[0131] For example, for the case shown in FIG. 3A, after detecting the user's operation of canceling the selection of the ROI R3 corresponding to the building B3, the mobile phone 10 can take the ROI R1 corresponding to the building B1 and the ROI R2 corresponding to the building B2 as the target ROIs.

[0132] For another example, referring to FIG. 7A, after detecting the user's operation of circling the tree T1, the mobile phone 10 can display a subject editing interface U41 including the ROI R4 corresponding to the tree T1. After detecting the user's operation of clicking the control U42 for starting the enhancement shooting in the subject editing interface U41, the mobile phone 10 can determine the ROI R1 corresponding to the building B1, the ROI R2 corresponding to the building B2, the ROI R3 corresponding to the building B3 and the ROI R4 corresponding to the tree T1 as the target ROIs.

[0133] For another example, referring to FIG. 7B, after detecting the user's operation of selecting the ROI R3 by clicking and then clicking the control U22 for editing the ROI area in the aforementioned subject editing interface U21, the mobile phone 10 can display an ROI editing interface U43 including an adjustment control U44 for adjusting the ROI R3. The mobile phone 10 can adjust the size of the ROI R3 according to the user's operation on the adjustment control U44. After detecting the user's operation of dragging the lower right corner of the adjustment control U44 upward, the mobile phone 10 can display an ROI editing interface U45 including an adjusted adjustment control U44', a cancel control U46 and an apply control U47. After detecting the user's operation of clicking the apply control U47, the mobile phone 10 can display a subject editing interface U48 in which the ROI corresponding to the building B3 is reduced from the ROI R3 to an ROI R3' relative to the subject editing interface U21. After detecting the user's operation of clicking the control U49 for starting the enhancement shooting in the subject editing interface U48, the mobile phone 10 can determine the ROI R1 corresponding to the building B1, the ROI R2 corresponding to the building B2 and the ROI R3' corresponding to the building B3 as the target ROIs.

[0134] It should be noted that the above-mentioned operation mode of the user's editing on the ROI is only an example, and in other embodiments, the mobile phone 10 can also add, delete or adjust the ROI corresponding to the shooting subject in response to other operations of the user, which is not limited herein.

[0135] That is, the target ROI determined by the electronic device can include an ROI of a shooting subject in the large field of view image recognized by the electronic device, can include a custom area of the user (for example, an ROI added by the user, a custom area obtained by the user modifying an ROI of one or more shooting subjects, etc.), or can include both the ROI of the shooting subject in the large field of view image recognized by the electronic device and the custom area of the user. In this way, the types of target ROIs are enriched, more selection or editing space is provided for the user, and the user experience is improved.

[0136] In S604, an enhanced shooting area corresponding to the target ROI and a shooting order of the enhanced shooting area are determined.

[0137] After determining the target ROI, the mobile phone 10 can determine an enhanced shooting area corresponding to the target ROI and a shooting order of each enhanced shooting area. The shape and size of the enhanced shooting area can be set in the manner described above, and will not be described here.

[0138] In some embodiments, the mobile phone 10 can determine the minimum number of enhanced shooting areas that can cover all ROIs based on the size of the target ROI and the size (or size range) of the enhanced shooting area. In this way, the number of enhanced shooting areas can be reduced, thereby reducing the number of small field of view images collected, and shortening the total time of the mobile phone 10 to implement fusion shooting.

[0139] In some embodiments, for a shooting subject whose ROI size is greater than the size of an enhanced shooting area, multiple enhanced shooting areas can be determined for the ROI of the shooting subject. Optionally, each enhanced shooting area corresponding to the ROI of the shooting subject can also include all or part of the ROIs of other shooting subjects.

[0140] In some embodiments, for multiple shooting subjects whose ROIs can be circumscribed by a rectangle and the size of the rectangle is less than the size of an enhanced shooting area, one enhanced shooting area can be determined for the ROIs of the multiple shooting subjects.

[0141] For example, for the case shown in FIG. 3A, the target ROI includes ROI R1 and ROI R2. Referring to FIG. 8A, the field of view angle FOV5 corresponding to ROI R1 and the field of view angle FOV6 corresponding to ROI R2 are both less than the maximum field of view angle FOV2 of the second camera shown in FIG. 4, and the minimum field of view angle FOV7 (for example, the field of view angle corresponding to the circumscribed rectangle of ROI R1 and ROI R2) including ROI R1 and ROI R2 is greater than FOV2. Based on this, the mobile phone 10 can use two enhanced shooting areas to shoot small field of view images corresponding to ROI R1 and ROI R2 (for example, the enhanced shooting area D2 and the enhanced shooting area D3 shown in FIG. 3A).

[0142] Exemplarily, for the case that the target ROIs include the aforementioned ROIs R1, R2 and R3, with reference to FIG. 8B, the field of view FOV5 corresponding to ROI R1, the field of view FOV6 corresponding to ROI R2, and the field of view FOV8 corresponding to ROI R3 are all smaller than the maximum field of view FOV2 of the second camera shown in FIG. 4, and the minimum field of view FOV9 (for example, the field of view corresponding to the circumscribed rectangular region of the target ROIs) including the target ROIs is greater than FOV2 and smaller than 2 times FOV2. Based on this, the mobile phone 10 can determine to use 2 enhanced shooting regions (for example, the enhanced shooting region D4 and the enhanced shooting region D5 shown in FIG. 8B) to shoot small field of view images of the target ROIs to reduce the number of enhanced shooting regions. Wherein, the enhanced shooting region D4 includes ROI R1 and part of ROI R3, the enhanced shooting region D5 includes ROI R1 and part of ROI R3, the region of ROI R3 in the enhanced shooting region D4 and the region in the enhanced shooting region D5 include the entire ROI R3.

[0143] It should be noted that in some other embodiments, in the case that the corresponding FOV of one ROI is smaller than the maximum FOV of the second camera, only one enhanced shooting region can also be used to collect a small field of view image of the ROI. In this way, the case that the splitting of one ROI into multiple images leads to the existence of distortion in the region corresponding to the ROI after the fusion of the small field of view images and the large field of view images can be avoided. For example, with reference to FIG. 8C, for the case that the target ROIs include the aforementioned ROIs R1, R2 and R3, the mobile phone 10 can also use one enhanced shooting region to shoot small field of view images corresponding to ROI R1, ROI R2 and ROI R3 respectively (for example, the enhanced shooting region D6, the enhanced shooting region D7 and the enhanced shooting region D8 shown in FIG. 8B). Wherein, the enhanced shooting region D6 includes ROI R1, the enhanced shooting region D7 includes ROI R2, and the enhanced shooting region D8 includes ROI R3.

[0144] In some embodiments, the phone 10 can determine the enhanced shooting regions by a greedy algorithm or the like. For example, the phone 10 can place the enhanced shooting regions in the large field of view image one by one according to the size of the enhanced shooting regions, the size and position of the target ROI, and the like, until all regions of the target ROI are covered by the enhanced shooting regions. At each time of placing an enhanced shooting region, the phone 10 can place the enhanced shooting region at a position that can cover the largest area of the target ROI region that has not been covered by the enhanced shooting regions. For example, referring to FIG. 8D, the target ROI includes the aforementioned ROI R1, ROI R2, and ROI R3. The phone 10 can first place the enhanced shooting region D9 that can cover the largest area of the target ROI in the large field of view image, then place the enhanced shooting region D10 that can cover the largest area of the target ROI that has not been covered by the enhanced shooting region D9, and finally place the enhanced shooting region D11 that can cover the largest area of the target ROI that has not been covered by the enhanced shooting regions D9 and D10. In some embodiments, each enhanced shooting region includes at least part of the content of the target ROI.

[0145] In some embodiments, after determining the enhanced shooting regions, the phone 10 can further determine the shooting order of the enhanced regions to reduce the total displacement of the user moving the phone 10. For example, the phone 10 can determine the shooting order of the enhanced shooting regions based on a greedy algorithm, a dynamic programming algorithm, a branch and bound algorithm, a genetic algorithm, an ant colony algorithm, a simulated annealing algorithm, or the like, with the goal of reducing the total displacement of the phone 10.

[0146] For example, for the situation shown in FIG. 8A, referring to FIG. 9A, in the case where the current field of view region of the second camera of the phone 10 is region FC1, the phone 10 can determine that the enhanced shooting region D2 is the first enhanced shooting region to be shot and that the enhanced shooting region D3 is the second enhanced shooting region to be shot; in the case where the current field of view region of the second camera of the phone 10 is region FC2, the phone 10 can determine that the enhanced shooting region D3 is the first enhanced shooting region to be shot and that the enhanced shooting region D2 is the second enhanced shooting region to be shot.

[0147] For example, for the situation shown in FIG. 8A, referring to FIG. 9A, in the case where the current field of view region of the second camera of the phone 10 is region FC1, the phone 10 can determine that the enhanced shooting region D2 is the first enhanced shooting region to be shot and that the enhanced shooting region D3 is the second enhanced shooting region to be shot; in the case where the current field of view region of the second camera of the phone 10 is region FC2, the phone 10 can determine that the enhanced shooting region D3 is the first enhanced shooting region to be shot and that the enhanced shooting region D2 is the second enhanced shooting region to be shot.

[0148] It should be noted that in some other embodiments, the mobile phone 10 can determine the enhanced shooting area in other manners, which are not limited herein.

[0149] S605, display a guide shooting interface, the guide shooting interface including the enhanced shooting area and guide information indicating the shooting order of the enhanced shooting area.

[0150] After determining the enhanced shooting area and the shooting order of the enhanced shooting area, the mobile phone 10 can display a guide shooting interface, the guide shooting interface including the enhanced shooting area and guide information indicating the shooting order of the enhanced shooting area.

[0151] In some embodiments, the mobile phone 10 can display the enhanced shooting area by highlighting or displaying a frame of the enhanced shooting area, a region of the enhanced shooting area, etc. in different colors.

[0152] In some embodiments, the guide information can include numbers, letters, arrows, etc. indicating the shooting order of the enhanced shooting area.

[0153] In some embodiments, the guide information can further include a current field of view frame corresponding to the current field of view area of the second camera of the mobile phone 10 or display the current field of view area of the second camera in different manners.

[0154] For example, referring to FIG. 10A, the mobile phone 10 can display a guide shooting interface U50 for the aforementioned enhanced shooting area D2 and enhanced shooting area D3. In the guide shooting interface U50, a frame corresponding to the enhanced shooting area D2 and the enhanced shooting area D3, an arrow A4 indicating the direction of moving the mobile phone 10 (equivalent to indicating the shooting order of the enhanced shooting area), and a current field of view frame DC1 corresponding to the current field of view area of the second camera of the mobile phone 10 can be included, and the brightness of the display content within the current field of view frame DC1 is higher than that of other regions.

[0155] For another example, referring to FIG. 10B, corresponding to the determined enhanced shooting area being the enhanced shooting area D6, the enhanced shooting area D7, and the enhanced shooting area D8 shown in FIG. 8C, the mobile phone 10 can display a guide shooting interface U54. In the guide shooting interface U54, the frames of the enhanced shooting area D6, the enhanced shooting area D7, and the enhanced shooting area D8 are displayed in gray solid lines, the current field of view frame DC2 corresponding to the current field of view area of the second camera of the mobile phone 10 is displayed by black dashed lines, and the arrow A5 indicating the shooting order of the enhanced shooting area D6, the enhanced shooting area D7, and the enhanced shooting area D8 is displayed.

[0156] It should be noted that in some other embodiments, the guide information can further include other information, which are not limited herein.

[0157] S606, in response to the image captured by the second camera matching the image content of the enhanced shooting area, capturing a small field of view image corresponding to the enhanced shooting area.

[0158] The mobile phone 10 can match the image captured by the second camera with the image content of the enhanced shooting area in response to the user moving the mobile phone 10. In the case where the image captured by the second camera matches the image content of an enhanced shooting area, the mobile phone 10 can capture a small field of view image corresponding to the enhanced shooting area.

[0159] In some embodiments, in the process of capturing a small field of view image corresponding to an enhanced shooting area, one enhanced shooting area can capture one or more small field of view images, and the one or more small field of view images with the best image quality can be taken as the small field of view image corresponding to the enhanced shooting area. In this way, the quality of a single small field of view image can be avoided due to shaking of the mobile phone 10 or other reasons, so as to avoid affecting the quality of the final shooting result image obtained by the mobile phone 10 due to the poor image quality of the small field of view image.

[0160] In some embodiments, the image quality can include the definition of the image.

[0161] In some embodiments, the enhanced shooting areas that have captured small field of view images and the enhanced shooting areas that have not captured small field of view images can be displayed in different ways, such as through different color borders, different color fillings, different border lines, different pattern fillings, etc.

[0162] In some embodiments, after capturing a small field of view image corresponding to an enhanced shooting area, the mobile phone 10 can display the enhanced area in a manner different from the enhanced shooting areas that have not captured small field of view images.

[0163] For example, referring to FIG. 10A:

[0164] In the case where the image captured by the second camera matches the image content of the enhanced shooting area D2 (at this time, the current field of view frame DC1 coincides with the border of the enhanced shooting area D2), the mobile phone 10 can capture a small field of view image PS7 corresponding to the enhanced shooting area D2. After capturing the small field of view image PS7, the border of the enhanced shooting area D2 is switched from gray to black.

[0165] During the movement of the mobile phone 10, the current field of view frame DC1 in the guidance shooting interface displayed by the mobile phone 10 changes with the change of the field of view area corresponding to the current image collected by the second camera of the mobile phone 10, and the tail of the arrow A4 also changes with the change of the current field of view frame DC1 (for example, the tail of the arrow A4 can be kept at a certain position (for example, the center, the edge, etc.) of the current field of view frame DC1). For example, referring to the guidance shooting interface U51 and the guidance shooting interface U52 in FIG. 10A, the tail of the arrow A4 is kept at the center of the current field of view frame DC1, and the head of the arrow A4 is kept at the center of the enhanced shooting area D3.

[0166] During the movement of the mobile phone 10, the mobile phone 10 can collect the small field of view image PS8 corresponding to the enhanced shooting area D3 in the case that the image collected by the second camera matches the image content in the enhanced shooting area D3 (at this time, referring to the guidance shooting interface U54 in FIG. 10A, the current field of view frame DC1 coincides with the frame of the enhanced shooting area D3, and the arrow A4 is no longer displayed).

[0167] In some embodiments, if the instruction of the user to end the collection is detected before the small field of view images corresponding to all the enhanced shooting areas are collected, the mobile phone 10 can also end the collection of the small field of view images.

[0168] In some embodiments, after the small field of view image corresponding to a certain enhanced shooting area is collected, if the collected small field of view image does not meet the image quality requirement (for example, the resolution is low, etc.), the mobile phone 10 can also display the information indicating the user to re-shoot the small field of view image corresponding to the enhanced shooting area.

[0169] In some embodiments, the field of view angle corresponding to the small field of view image can be greater than the field of view angle corresponding to the enhanced shooting area. In this case, it can be avoided that the small field of view image does not include all the image content in the corresponding enhanced shooting area due to the shaking of the mobile phone 10 or other reasons.

[0170] It should be noted that the second camera can be any camera with a field of view angle smaller than the first camera. For example, in the case that the first camera is the camera C1, the second camera can be the camera C2 and / or the camera C3; in the case that the first camera is the camera C2, the second camera can be the camera C3.

[0171] It should be noted that if the sizes of the enhanced shooting areas are different, the mobile phone 10 can also adjust the focal length of the second camera according to the field of view angle corresponding to the enhanced shooting area, so that the field of view angle of the second camera is greater than the field of view angle corresponding to the enhanced shooting area.

[0172] S607, obtaining a shooting result image based on the large field of view image and the small field of view image.

[0173] After the mobile phone 10 collects all the small field-of-view images corresponding to the enhanced shooting areas, the mobile phone 10 can fuse the small field-of-view images and the large field-of-view image to obtain a shooting result image corresponding to the integrated shooting instruction. In the shooting result image, the image content of the area corresponding to the enhanced shooting area is obtained based on the content of the corresponding small field-of-view image, and the content of the area other than the enhanced shooting area is obtained based on the content of the large field-of-view image.

[0174] In an example, the mobile phone 10 can obtain the shooting result image based on an image fusion algorithm. For example, the image fusion algorithm can include but is not limited to an alpha fusion algorithm, a pyramid fusion algorithm, a Poisson fusion algorithm, a principal components analysis (PCA) fusion algorithm (also referred to as a principal component analysis fusion algorithm), a frequency domain fusion algorithm, an integrated algorithm based on an artificial intelligence model (such as a deep learning model, a neural network model, a large model (such as a large language model), etc.), and the like.

[0175] It should be noted that in other embodiments, the mobile phone 10 can also fuse the large field-of-view image and the small field-of-view image in other ways to obtain the shooting result image.

[0176] In some embodiments, if an instruction to end the collection is detected before all the small field-of-view images corresponding to the enhanced shooting areas are collected, the mobile phone 10 can also obtain the shooting result image based on the collected small scene images and the large field-of-view image.

[0177] Based on the above shooting method, in the process of fusing the shooting, the determined enhanced shooting area is obtained based on the target ROI, rather than dividing the rectangular area selected by the user to obtain the preset continuous enhanced shooting area. In this way, it can be avoided to shoot the small field-of-view image that does not include the target ROI, which is beneficial to reduce the number of enhanced shooting areas to be shot by the mobile phone 10, thereby improving the efficiency of the integrated shooting of the mobile phone 10.

[0178] In some embodiments, in the process of fusing the shooting, the mobile phone 10 can also shoot the small field-of-view image of the edge region of the large field-of-view image based on the user operation and correct the distortion of the large field-of-view image (or the shooting result image) to reduce the distortion in the shooting result image.

[0179] For example, FIG. 11 shows a flowchart of a shooting method according to some embodiments of the present application. The execution subject of the method is the mobile phone 10. As shown in FIG. 11, the method includes the following steps:

[0180] S1101, detecting a fusion shooting instruction, and shooting a large field-of-view image through a first camera.

[0181] The mobile phone 10 can capture the large field of view image through the first camera in response to detecting the instruction of the fusion shooting.

[0182] For example, the mobile phone 10 can detect the instruction of the fusion shooting and capture the large field of view image through the first camera in response to detecting that the user clicks the shooting control in the interface corresponding to the fusion shooting or performs the operation of pressing the key for triggering the mobile phone 10 to shoot the image. For details, refer to the foregoing step S601, which will not be repeated here.

[0183] S1102, determining and displaying the ROI corresponding to the shooting subject in the large field of view image.

[0184] After the mobile phone 10 captures the large field of view image through the first camera, the mobile phone 10 can identify the shooting subject in the large field of view image through an algorithm or a pre-trained model, and display the ROI of the shooting subject in the subject editing interface. For details, refer to the foregoing step S602, which will not be repeated here.

[0185] S1103, detecting that the user performs the operation of distortion correction.

[0186] After the mobile phone 10 detects that the user performs the operation of distortion correction, the mobile phone 10 can trigger the mobile phone 10 to perform the distortion correction on the large field of view image.

[0187] For example, the operation of distortion correction performed by the user can be a click operation or other operation of the user on the distortion correction control (for example, the foregoing) in the subject editing interface displayed by the mobile phone 10.

[0188] It should be noted that in other embodiments, the operation of distortion correction performed by the user can also be other operations, which are not limited here.

[0189] S1104, determining the distortion correction region and displaying the distortion correction interface.

[0190] After the mobile phone 10 detects that the user performs the operation of distortion, the mobile phone 10 can determine the distortion correction region of the edge of the large field of view image, and display the distortion correction interface.

[0191] For example, in the distortion correction interface, the distortion correction region, the guide information (for example, arrows, numbers, letters, etc.) indicating the shooting order of the small field of view image of the distortion correction region can be included.

[0192] S1105, in response to the image captured by the second camera matching the image content of the distortion correction region, capturing the small field of view image corresponding to the distortion correction region.

[0193] The mobile phone 10 can match the image captured by the second camera with the image content of the distortion correction region in response to the user moving the mobile phone 10. In a case where the image captured by the second camera matches the image content of a certain distortion correction region, the mobile phone 10 can capture a small field of view image corresponding to the distortion correction region.

[0194] In S1106, the mobile phone 10 can perform distortion correction on the large field of view image based on the small field of view images corresponding to the distortion correction regions, to obtain and display a corrected large field of view image.

[0195] After the mobile phone 10 captures all the small field of view images corresponding to the distortion correction regions, the mobile phone 10 can perform distortion correction on the corresponding distortion correction regions in the large field of view image based on the small field of view images corresponding to the distortion correction regions, to obtain a large field of view image after distortion correction (hereinafter referred to as a corrected large field of view image). Then, the mobile phone 10 can display the corrected large field of view image and the ROI of the shooting subject superimposed on the upper layer of the corrected large field of view image.

[0196] In S1107, the mobile phone 10 can determine the target ROI based on the user operation.

[0197] After the mobile phone 10 displays the ROI corresponding to the shooting subject in the corrected large field of view image, the mobile phone 10 can determine the target ROI according to the user operation. The specific manner in which the mobile phone 10 determines the target ROI can refer to the aforementioned step S603, and will not be described here.

[0198] In S1108, the mobile phone 10 can determine the enhanced shooting region corresponding to the target ROI and the shooting order of the enhanced shooting region.

[0199] After the mobile phone 10 determines the target ROI, the mobile phone 10 can determine the enhanced shooting region corresponding to the target ROI and the shooting order of each enhanced shooting region. The specific manner can refer to the aforementioned step S604, and will not be described here.

[0200] In S1109, the mobile phone 10 can display a guided shooting interface, and the guided shooting interface includes the enhanced shooting region and guided information indicating the shooting order of the enhanced shooting region.

[0201] After the mobile phone 10 determines the enhanced shooting region and the shooting order of the enhanced shooting region, the mobile phone 10 can display a guided shooting interface, and the guided shooting interface includes the enhanced shooting region and guided information indicating the shooting order of the enhanced shooting region. The specific manner can refer to the aforementioned step S605, and will not be described here.

[0202] In S1110, the mobile phone 10 can capture a small field of view image corresponding to the enhanced shooting region in response to the image captured by the second camera matching the image content of the enhanced shooting region.

[0203] The mobile phone 10 can match the image captured by the second camera with the image content of the enhanced shooting area in response to the user moving the mobile phone 10. When the image captured by the second camera matches the image content of an enhanced shooting area, the mobile phone 10 can capture a small field of view image corresponding to the enhanced shooting area. The specific manner can refer to the foregoing step S606, and details are not described herein.

[0204] S1111, obtaining a shooting result image based on the large field of view image and the small field of view image.

[0205] After the mobile phone 10 captures all the small field of view images corresponding to the enhanced shooting areas, the mobile phone 10 can fuse the small field of view images and the corrected large field of view image to obtain a shooting result image corresponding to the integrated shooting instruction. In the shooting result image, the image content of the area corresponding to the enhanced shooting area is obtained based on the content of the corresponding small field of view image, and the content of the area other than the enhanced shooting area is obtained based on the content of the corrected large field of view image.

[0206] Based on the above shooting method, in the process of fusing the shooting, the determined enhanced shooting area is obtained based on the target ROI, rather than dividing the rectangular area selected by the user to obtain the preset continuous enhanced shooting area. In this way, it can be avoided to shoot the small field of view image that does not include the target ROI, which is beneficial to reduce the number of enhanced shooting areas to be shot by the mobile phone 10, thereby improving the efficiency of the mobile phone 10 in integrated shooting. In addition, the mobile phone 10 can also correct the distortion of the large field of view image based on the small field of view image captured by the second camera, so as to reduce the distortion of the shooting result image.

[0207] It should be noted that in some other embodiments, the mobile phone 10 can also capture a small field of view image corresponding to the distortion correction area of the edge of the shooting result image after obtaining the shooting result image based on the process shown in FIG. 6, and correct the distortion of the shooting result image based on the captured small field of view image.

[0208] The following describes an architecture for determining a shooting subject in a large field of view image and a ROI corresponding to the shooting subject by the mobile phone 10.

[0209] Exemplarily, FIG. 12 shows a schematic diagram for determining a shooting subject in a large field of view image and a ROI corresponding to the shooting subject according to some embodiments of the present application.

[0210] Referring to FIG. 12, for a large field of view image, the mobile phone 10 can first determine whether the scene corresponding to the large field of view image is a portrait scene or a non-portrait scene.

[0211] In a case where the scene corresponding to the wide-view image is a portrait scene (i.e., the shooting subject is a person), the mobile phone 10 can perform face region recognition on the wide-view image to determine a face region in the wide-view image, and take the face region as the ROI corresponding to the shooting subject.

[0212] In a case where there is one person in the wide-view image (i.e., the wide-view image is a single-person photo), the mobile phone 10 can take the one person as the shooting subject, and determine a face region of the person as the ROI.

[0213] In a case where there are multiple persons in the wide-view image (i.e., the wide-view image is a group photo), the mobile phone 10 can determine a foreground (image content corresponding to a shooting object close to the mobile phone 10) and a background (image content corresponding to a shooting object far from the mobile phone 10) in the wide-view image, and determine face regions of the persons in the foreground as the ROI regions. For example, referring to FIG. 13, the wide-view image PL2 includes a person PP1, a person PP2, a person PP3, a person PP4, and a person PP5 (i.e., the wide-view image PL2 is a group photo), the mobile phone 10 can determine that the foreground of the wide-view image PL2 includes the person PP4, and the background of the wide-view image PL2 includes the person PP1, the person PP2, the person PP3, and the person PP5. Based on this, the mobile phone 10 can take the person PP4 as the shooting subject, and take a region D12 corresponding to the face of the person PP4 as the ROI corresponding to the person PP4.

[0214] In a case where the scene corresponding to the wide-view image is a portrait scene (i.e., the shooting subject is a person), the mobile phone 10 can perform face region recognition on the wide-view image to determine a face region in the wide-view image, and take the face region as the ROI corresponding to the shooting subject.

[0215] It should be noted that the manner of determining the ROI corresponding to the shooting subject in the wide-view image shown in FIG. 12 is only an example, and in other embodiments, the mobile phone 10 can also determine the ROI corresponding to the shooting subject in the wide-view image in other manners, which are not limited herein.

[0216] The embodiments of the present application also provide a shooting method.

[0217] Exemplarily, FIG. 14 shows a flow diagram of another shooting method according to some embodiments of the present application. The execution subject of the method can be an electronic device, such as the mobile phone 10 described above. As shown in FIG. 14, the method includes the following steps:

[0218] S1401, in response to a detected shooting instruction, capturing a first image by using a first camera.

[0219] Exemplarily, the photographing instruction can be the aforementioned fusion photographing instruction, and the first image can be the aforementioned large-view-field image. The specific manner in which the electronic device detects the photographing instruction and photographs the first image by using the first camera can refer to the content of the aforementioned step S601, and details are not described herein again.

[0220] S1402. Identify a photographing subject in the first image, and generate and display at least one ROI corresponding to the photographing subject in the first interface.

[0221] Exemplarily, the electronic device can first identify the photographing subject in the first image and the ROI corresponding to each photographing subject, and display at least one ROI corresponding to the photographing subject in the first interface. One ROI can correspond to one photographing subject. The specific process in which the electronic device identifies the photographing subject in the first image, generates and displays at least one ROI corresponding to the photographing subject in the first interface can refer to the aforementioned step S602, and details are not described herein again.

[0222] S1403. Determine an enhanced area in response to the operation of the user on the first interface, wherein the enhanced area includes at least one region of interest, and / or the enhanced area includes a user-defined area.

[0223] Exemplarily, the electronic device can determine the target ROI corresponding to the operation of the user on the first interface. Then, the enhanced area corresponding to the target ROI is determined, which can include the enhanced photographing area (or the sub-photographing area of the enhanced area) corresponding to the target ROI, and each enhanced photographing area includes at least part of the content of the target ROI. The specific process in which the electronic device determines the enhanced area in response to the operation of the user on the first interface can refer to the content of the aforementioned steps S603 and S604, and details are not described herein again.

[0224] In some embodiments, the user-defined area can include a newly-added ROI of the user, and / or an ROI obtained by the user modifying the ROI of a certain photographing subject.

[0225] S1404. Photograph at least one second image matching the image content of the enhanced area by using the second camera, and each second image matches at least part of the image content of the enhanced area.

[0226] Exemplarily, after the enhanced area is determined, at least one second image matching the image content of the enhanced area can be photographed by using the second camera, and each second image can correspond to a sub-photographing area (i.e., an enhanced photographing area) of the enhanced area. Details can refer to the aforementioned steps S605 and S606, and details are not described herein again.

[0227] S1405, fuse the first image and the at least one second image to obtain a target image of the shooting instruction.

[0228] After the electronic device collects all the second images corresponding to the enhanced region, the electronic device can fuse the first image and each second image to obtain a target image (or a shooting result image) of the shooting instruction. The specific manner in which the electronic device fuses the first image and the second image can refer to the foregoing step S607, and will not be described here.

[0229] Based on the above method, the electronic device can automatically identify the shooting subjects in the first image and the regions of interest corresponding to each shooting subject, and determine the enhanced region including the regions of interest corresponding to the shooting subjects and / or the user-defined region. Then, the electronic device can use the second image (for example, the small field of view image in the following) matching the image content of the enhanced region, and fuse the second image and the first image to obtain the target image. Since the regions of interest of the shooting subjects are obtained by the electronic device automatically (for example, obtained by intelligent identification by a pre-trained model), rather than manually framed by the user, the interactive process of the user using the electronic device for fusion shooting is optimized, which is conducive to improving the interactive experience of the user and the electronic device. Moreover, since each second image matches at least part of the image content in the enhanced region, the electronic device can avoid shooting images that do not include the image content of the enhanced region, which is conducive to the number of images to be shot by the second camera and improves the speed of the electronic device to generate the target image.

[0230] In addition, the enhanced region can also only include the user-defined region, or simultaneously include the user-defined region and at least part of the regions of interest corresponding to the shooting subjects, which increases the selectability of the regions of interest involved in the enhanced region. In this way, the user can edit the regions of interest automatically identified by the electronic device according to the needs, which is conducive to improving the user experience.

[0231] The embodiments of the present application also provide a program product, which, when executed on an electronic device, can enable the electronic device to implement the shooting method provided by the foregoing embodiments.

[0232] The embodiments of the present application also provide a readable storage medium, which stores one or more programs / instructions, and the one or more programs / instructions, when executed by an electronic device, enable the electronic device to implement the shooting method provided by the foregoing embodiments.

[0233] Further, FIG. 15 shows a structural schematic diagram of a mobile phone 10 according to some embodiments of the present application.

[0234] As shown in FIG. 15, the mobile phone 10 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0235] The processor 110 can include one or more processing units, for example: the processor 110 can include a central processing unit (CPU), an AP, a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a microcontroller unit (MCU), a video codec, a digital signal processor (DSP), a baseband processor, a neural-network processing unit (NPU), a field programmable gate array (FPGA), etc. In some embodiments, different processing units can be independent devices, or can be integrated in one or more processors.

[0236] The processor 110 can also be provided with a memory for storing one or more programs and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can hold one or more programs or data that the processor 110 has just used or recycled. When the processor 110 needs to use the one or more programs or data again, it can be directly called from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thus improving the efficiency of the system.

[0237] In some embodiments, the processor 110 can be configured to execute one or more programs / instructions corresponding to the photographing method provided in the foregoing embodiments.

[0238] The charging management module 140 is configured to receive charging input from a charger. The charging management module 140 can supply power to the electronic device while charging the battery 142.

[0239] The power management module 141 is configured to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to supply power to the processor 110, the internal memory 121, the display 194, the camera 193, and the wireless communication module 160.

[0240] The wireless communication function of the mobile phone 10 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, and a baseband processor.

[0241] The antenna 1 and the antenna 2 are configured to transmit and receive electromagnetic wave signals.

[0242] The mobile communication module 150 can provide a solution for wireless communication, such as 2G / 3G / 4G / 5G, applied to the mobile phone 10. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter, amplify, and the like the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can also amplify signals modulated by the modem processor and convert the signals into electromagnetic waves radiated by the antenna 1. In some embodiments, at least part of the function modules of the mobile communication module 150 can be arranged in the processor 110. In some embodiments, at least part of the function modules of the mobile communication module 150 and at least part of the modules of the processor 110 can be arranged in the same device.

[0243] The wireless communication module 160 can provide solutions for wireless communication applied on the mobile phone 10, including wireless local area networks (WLAN) (such as wireless fidelity network), Bluetooth (BT), global navigation satellite system (GNSS), near field communication (NFC), infrared technology (IR), etc. The wireless communication module 160 can be one or more devices integrated with at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency conversion and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive signals to be sent from the processor 110, perform frequency conversion and amplification, and convert the signals to electromagnetic wave radiation via the antenna 2.

[0244] The mobile phone 10 implements display functions through a GPU, a display screen 194, an application processor, etc. The GPU is a microprocessor for shooting, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs that execute program instructions to generate or change display information.

[0245] The display screen 194 is used to display images. For example, the display screen 194 can be used to display the aforementioned guide shooting interface, subject editing interface, distortion correction interface, etc.

[0246] The camera 193 is used to capture still images or videos. In some embodiments, the mobile phone 10 can include multiple cameras 193 (such as the aforementioned cameras C1, C2 and C3). Among the multiple cameras 193, at least two cameras 193 have different equivalent focal lengths and different field of view angles. In this way, the mobile phone 10 can capture large field of view images through a camera with a larger field of view and small field of view images through a camera with a smaller field of view.

[0247] The external memory interface 120 can be used to connect an external memory card. The external memory card communicates with the processor 110 through the external memory interface 120 to implement data storage functions.

[0248] The internal memory 121 can be used to store one or more programs and corresponding data. The internal memory 121 can include a program storage area and a data storage area. In some embodiments, the program storage area can store an operating system, application programs required by at least one function, etc., such as the programs / instructions corresponding to the photographing method provided by the aforementioned embodiments. The data storage area can store data created during use of the mobile phone 10, such as the data of the large field of view image, the small field of view image, the enhanced photographing area / distortion correction area, etc. In addition, the internal memory 121 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage, etc. The processor 110 executes various function applications of the mobile phone 10 by running one or more programs stored in the internal memory 121 and / or one or more programs stored in the memory disposed in the processor 110.

[0249] The mobile phone 10 can realize audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, the application processor, etc. For example, music playing, etc.

[0250] The audio module 170 is used to convert digital audio information into an analog audio signal output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used to encode and decode audio signals.

[0251] The speaker 170A, also called "loudspeaker", is used to convert an audio electrical signal into a sound signal.

[0252] The receiver 170B, also called "earpiece", is used to convert an audio electrical signal into a sound signal.

[0253] The microphone 170C, also called "microphone", "sound transducer", is used to convert a sound signal into an electrical signal.

[0254] The earphone interface 170D is used to connect a wired earphone.

[0255] The pressure sensor 180A is used to sense a pressure signal, and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. There are many types of pressure sensors 180A, such as a resistance type pressure sensor, an inductance type pressure sensor, a capacitance type pressure sensor, etc. The capacitance type pressure sensor can include at least two parallel plates with conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The mobile phone 10 determines the intensity of the pressure according to the change of the capacitance. When a touch operation acts on the display screen 194, the mobile phone 10 detects the intensity of the touch operation according to the pressure sensor 180A. The mobile phone 10 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A.

[0256] In some embodiments, the processor 110 can detect a selection operation, an editing operation, or the like of the ROI according to the electrical signal detected by the pressure sensor 180A.

[0257] The keys 190 include a power key, a volume key, and the like. The keys 190 can be mechanical keys. Alternatively, the keys 190 can be touch keys. The mobile phone 10 can receive key inputs and generate key signal inputs related to user settings and function control of the mobile phone 10.

[0258] The motor 191 can generate a vibration prompt. The indicator 192 can be an indicator light, which can be used to indicate a charging state, a power change, or the like, or can be used to indicate a message, a notification, or the like.

[0259] The SIM card interface 195 is used to connect a SIM card or an eSIM.

[0260] It can be understood that the structure of the mobile phone 10 shown in the embodiments of the present application does not constitute a specific limitation on electronic devices. In other embodiments of the present application, an electronic device can include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0261] In the drawings, some structural or methodical features can be shown in a particular arrangement and / or order. However, it should be understood that such a particular arrangement and / or order can not be required. Rather, in some embodiments, the features can be arranged in a different manner and / or order than shown in the illustrative drawings. Additionally, inclusion of structural or methodical features in a particular figure is not meant to imply that such features are required in all embodiments, and in some embodiments, these features can not be included or can be combined with other features.

[0262] It should be noted that in the examples and descriptions of the present patent, relational terms such as first and second and the like can merely be used to distinguish one entity or action from another, and do not necessarily require or imply that any such actual relationship or order exists between or among the entities or actions. Also, the term "comprises" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article, or apparatus that comprises a list of elements does not only include those elements, but also includes other elements not expressly listed or inherent to such process, method, article, or apparatus. Without more limitations, an element defined by the statement "comprises one" does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.

[0263] The above merely provides the specific implementation of the present application, but the protection scope of the present application is not limited to this. Any person skilled in the art can easily think of the changes or replacements within the technical range disclosed by the present application, which should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A shooting method applied to electronic devices, characterized in that, The electronic device includes a first camera and a second camera, wherein a field of view angle of the first camera is greater than a field of view angle of the second camera; and the method includes: in response to a detected shooting instruction, shooting a first image through the first camera; identifying a shooting subject in the first image, generating and displaying at least one region of interest corresponding to the shooting subject in a first interface; in response to a user operation on the first interface, determining an enhanced region, wherein the enhanced region includes at least one of the regions of interest, and / or the enhanced region includes a user-defined region; shooting at least one second image through the second camera, which matches image content of the enhanced region, wherein each of the second images matches at least part of the image content of the enhanced region; fusing the first image and the at least one second image to obtain a target image of the shooting instruction.

2. The method of claim 1, wherein, The enhanced region includes a plurality of sub-shooting regions, and the shooting at least one second image through the second camera, which matches image content of the enhanced region, includes: displaying the first image and first information superimposed on a layer of the first image in a second interface, the first information including a frame of each of the sub-shooting regions and guide information indicating a shooting order of the sub-shooting regions; in the process of the user moving the electronic device, in response to the image content collected by the second camera matching the image content in a first sub-shooting region of the plurality of sub-shooting regions, shooting the second image corresponding to the first sub-shooting region.

3. The method of claim 2, wherein, The first information further includes a current field of view frame indicating a position of the image content currently collected by the second camera in the first image.

4. The method of claim 1, wherein, The determining of the enhanced region in response to the user operation on the first interface includes: in response to the user operation on the first interface, determining a target region of interest; and determining the enhanced region corresponding to the target region of interest, wherein the enhanced region includes at least one sub-shooting region, one of the sub-shooting regions covering at least part of the content of the target region of interest, and the at least one sub-shooting region covering all of the content of the target region of interest.

5. The method of claim 4, wherein, The first interface includes an enhanced shooting control; and the determining of the target region of interest in response to the user operation on the first interface includes: in response to the user selecting the enhanced shooting control in the first interface, determining the at least one region of interest as the target region of interest; or in response to the user selecting the enhanced shooting control after selecting at least one first region of interest in the at least one region of interest in the first interface, determining the at least one first region of interest as the target region of interest.

6. The method of claim 4, wherein, The determining of the target region of interest in response to the user operation on the first interface includes: In response to an operation of the user modifying a second region of interest in the at least one region of interest to a first user-defined region on the first interface, a second interface is displayed, wherein the second interface includes the at least one region of interest except the second region of interest, the first user-defined region, and an enhanced shooting control; In response to an operation of the user selecting the enhanced shooting control after selecting at least one region of interest in the at least one region of interest except the second region of interest and / or the first user-defined region on the second interface, the user-selected region is determined as the target region of interest.

7. The method of claim 4, wherein, The operation of the user on the first interface to determine the target region of interest includes: In response to an operation of the user adding a second user-defined region on the first interface, a third interface is displayed, wherein the third interface includes the at least one region of interest, the second user-defined region, and an enhanced shooting control; In response to an operation of the user selecting the enhanced shooting control after selecting at least one region of interest and / or the second user-defined region on the third interface, the user-selected region is determined as the target region of interest.

8. The method according to any one of claims 5 to 7, characterized in that, The first interface, the second interface, or the third interface further includes a distortion correction control; and the method further includes: In response to an operation of the user selecting the distortion correction control, a fourth interface is displayed, wherein the fourth interface includes the first image and a frame of at least one distortion correction region superimposed on the first image; In the process of the user moving the electronic device, in response to image content captured by the second camera matching image content in each distortion correction region, a third image corresponding to each distortion correction region is captured; The first image is corrected for distortion based on each third image.

9. The method of claim 8, wherein, The operation of fusing the first image and the at least one second image to obtain the target image of the shooting instruction includes: The at least one second image is fused with the first image corrected for distortion to obtain the target image.

10. An electronic device, comprising: It includes: a memory for storing one or more programs; a processor for executing the one or more programs to enable the electronic device to implement the shooting method of any one of claims 1 to 9.

11. A readable storage medium, characterized by, The readable storage medium includes one or more programs, and the one or more programs, when executed on an electronic device, enable the electronic device to implement the shooting method of any one of claims 1 to 9.

Images