Shooting method, readable storage medium and electronic equipment

Abstract

The invention relates to the technical field of image processing, and discloses a shooting method, a readable storage medium and electronic equipment. In the method. After the electronic equipment detects a shooting instruction, a large-view-field image can be collected through a first camera and a shooting main body in the large-view-field image is determined. Then, the electronic device can display the ROI corresponding to each shooting subject and determine at least one enhanced shooting area in the large-field-of-view image according to the ROI selected by the user, and each enhanced shooting area comprises at least part of image content of the shooting subject corresponding to the ROI selected by the user. And thirdly, the electronic equipment can collect small-field-of-view images corresponding to the enhanced shooting areas through a second camera of which the field angle is smaller than that of the first camera, and fuse the small-field-of-view images and the large-field-of-view images to obtain a shooting result image. Therefore, the number of shot small-view-field images can be reduced, and the speed of shooting and generating the shooting result image by the electronic equipment is improved.

Description

Technical Field

[0001] This application relates to the field of image processing technology, and in particular to an image capture method, a readable storage medium, and an electronic device. Background Technology

[0002] Electronic devices are typically equipped with cameras with a relatively short equivalent focal length (such as wide-angle cameras) to meet users' needs for capturing images with a large field of view (FOV) (hereinafter referred to as large field of view images).

[0003] Generally, cameras have a smaller equivalent focal length and a larger field of view, and their ability to capture details of distant objects decreases as the field of view increases. Therefore, in wide-field-of-view images captured by cameras with smaller equivalent focal lengths, details of objects farther from electronic devices are often lost. This can prevent users from seeing details of distant objects in a wide-field-of-view image, negatively impacting the user experience. Summary of the Invention

[0004] In view of this, this application provides a shooting method, a readable storage medium, and an electronic device.

[0005] In a first aspect, this application provides a shooting method applied to an electronic device, the electronic device including a first camera and a second camera, wherein the field of view of the first camera is larger than the field of view of the second camera; and the method includes: in response to a detected shooting command, capturing a first image using the first camera; identifying a subject in the first image, generating and displaying at least one region of interest corresponding to the subject in a first interface; determining an enhancement region in response to user operation on the first interface, wherein the enhancement region includes at least one region of interest, and / or, the enhancement region includes a user-defined region; capturing at least one second image matching the image content of the enhancement region using the second camera, wherein each second image matches at least a portion of the image content of the enhancement region; and fusing the first image and at least one second image to obtain a target image of the shooting command.

[0006] In this method, the electronic device can automatically identify the subject and the corresponding region of interest (ROI) in the first image (e.g., the large field-of-view image below), and determine the enhanced region, which includes the ROI corresponding to the subject and / or the user-defined region (e.g., the region obtained by the user modifying the ROI of the subject, or the region added by the user). Then, the electronic device can use a second image (e.g., the small field-of-view image below) that matches the image content of the enhanced region, and fuse the second image and the first image to obtain the target image.

[0007] Since the region of interest of the subject is automatically identified by the electronic device (e.g., through intelligent recognition by a pre-trained model) rather than manually selected by the user, the interaction process of the user using the electronic device for fusion shooting is optimized, which helps to improve the user's interactive experience with the electronic device. Furthermore, since each second image matches at least a portion of the image content in the enhanced region, it avoids capturing images that do not include the enhanced region, thus increasing the number of images that the second camera needs to capture and improving the speed at which the electronic device generates the target image.

[0008] Furthermore, the enhanced area can include only the user-defined area, or both the user-defined area and at least part of the region of interest corresponding to the subject being photographed, increasing the selectivity of the regions of interest included in the enhanced area. This allows users to edit the regions of interest automatically identified by the electronic device according to their needs, thus improving the user experience.

[0009] In one possible implementation of the first aspect described above, the enhanced region includes multiple sub-shooting regions. At least one second image matching the image content of the enhanced region is captured by the second camera, including: displaying a first image and first information superimposed on the first image on a second interface, the first information including the border of each sub-shooting region and guidance information indicating the shooting order of each sub-shooting region; and capturing a second image corresponding to the first sub-shooting region in response to the matching of the image content captured by the second camera with the image content of the first sub-shooting region among the multiple sub-shooting regions during the user's movement of the electronic device.

[0010] In this implementation, the electronic device can display first information guiding the user to capture the location and shooting order of each sub-shooting area (e.g., the enhanced shooting area mentioned below), so that the user can move the electronic device according to the guidance information so that the second camera of the electronic device can capture images of different fields of view. Furthermore, the image content captured by the second camera is matched with the image content of the first sub-shooting area (which can be any one of the multiple sub-shooting areas) among the multiple sub-shooting areas, and a second image corresponding to the first sub-shooting area is captured.

[0011] In one possible implementation of the first aspect described above, the first information further includes a current field of view that indicates the position of the image content currently captured by the second camera in the first image.

[0012] In this implementation, the current field of view can indicate the position of the image content currently captured by the second camera in the first image, so that the user can move the electronic device according to the relationship between the current field of view and the borders of each sub-shooting area, thereby enabling the second camera of the electronic device to capture the field of view corresponding to each sub-shooting area.

[0013] In one possible implementation of the first aspect above, determining the enhanced region in response to the user's operation on the first interface includes: determining a target region of interest in response to the user's operation on the first interface; determining an enhanced region corresponding to the target region of interest, wherein the enhanced region includes at least one sub-shooting region, one sub-shooting region covers at least a portion of the target region of interest, and at least one sub-shooting region covers the entire content of the target region of interest.

[0014] In one possible implementation of the first aspect described above, the first interface includes an enhanced shooting control; and, in response to a user's operation on the first interface, determining a target region of interest includes: in response to a user's operation of selecting the enhanced shooting control on the first interface, determining at least one region of interest as a target region of interest; or in response to a user's operation of selecting at least one first region of interest from at least one region of interest on the first interface and then selecting the enhanced shooting control, determining at least one first region of interest as a target region of interest.

[0015] In this implementation, the target region of interest may include part or all of the above-mentioned regions of interest automatically identified by the electronic device.

[0016] In one possible implementation of the first aspect above, determining the target region of interest in response to a user's operation on the first interface includes: in response to a user's operation on the first interface to modify a second region of interest in at least one region of interest to a first user-defined region, displaying a second interface, wherein the second interface includes at least one region of interest other than the second region of interest, the first user-defined region, and an enhanced shooting control; in response to a user's operation on the second interface to select at least one region of interest other than the second region of interest and / or the first user-defined region and then select the enhanced shooting control, determining the region selected by the user as the target region of interest.

[0017] In this implementation, the target region of interest may include a region of interest that has not been modified by the user from at least one region of interest automatically identified by the electronic device, and / or a first user-defined region obtained by the user modifying the first region of interest from at least one region of interest.

[0018] In one possible implementation of the first aspect above, determining the target region of interest in response to the user's operation on the first interface includes: in response to the user's operation of adding a second user-defined region in the first interface, displaying a third interface, the third interface including at least one region of interest, the second user-defined region, and an enhanced shooting control; in response to the user's operation of selecting at least one region of interest and / or the second user-defined region and then selecting the enhanced shooting control in the third interface, determining the region selected by the user as the target region of interest.

[0019] In this implementation, the target region of interest may include at least a portion of the regions of interest automatically identified by the electronic device, and / or a second user-defined region added by the user.

[0020] In one possible implementation of the first aspect described above, the first interface, the second interface, or the third interface further includes a distortion correction control; and the method further includes: in response to a user's selection operation on the distortion correction control, displaying a fourth interface, the fourth interface including a first image and a border of at least one distortion correction region superimposed on the first image; during the user's movement of the electronic device, in response to matching the image content captured by the second camera with the image content in each distortion correction region, capturing a third image corresponding to each distortion correction region; and performing distortion correction on the first image based on each third image.

[0021] In this implementation, the electronic device can acquire a third image (e.g., a small field-of-view image corresponding to the distortion correction area of ​​the first image edge region) through the second camera based on the user's selection operation of the distortion correction control, and perform distortion correction on the first image based on the third image.

[0022] In one possible implementation of the first aspect above, fusing the first image and at least one second image to obtain the target image of the shooting command includes: fusing at least one second image with the first image after distortion correction to obtain the target image.

[0023] In this implementation, the target image is obtained by fusing at least one second image with a first image after distortion correction, which helps to reduce the distortion of the target image.

[0024] In one possible implementation of the first aspect described above, fusing the first image and at least one second image to obtain the target image for the shooting instruction includes: displaying a fifth interface, the fifth interface including the first image and a border of at least one distortion correction region superimposed on the first image; during the user's movement of the electronic device, in response to matching the image content captured by the second camera with the image content of each distortion correction region, capturing a third image corresponding to each distortion correction region; performing distortion correction on the first image based on each third image; and fusing at least one second image with the first image after distortion correction to obtain the target image.

[0025] In this implementation, the target image is obtained by fusing at least one second image with a first image after distortion correction, which helps to reduce the distortion of the target image.

[0026] In one possible implementation of the first aspect above, generating and displaying at least one region of interest corresponding to the subject being photographed in the first interface includes: when the subject being photographed is a person, using the area where the person's face is located as the region of interest corresponding to the subject being photographed; when the subject being photographed does not include a person, using the area where the subject is located as the region of interest corresponding to the subject being photographed.

[0027] In a second aspect, this application provides an electronic device, comprising: a memory for storing one or more programs; and a processor for executing one or more programs to cause the electronic device to implement the first aspect and any possible implementation of the shooting method provided by the first aspect.

[0028] In one possible implementation of the second aspect above, the electronic device includes a first camera and a second camera, wherein the first camera is used to capture a first image and the second camera is used to capture a second image.

[0029] A third aspect provides a readable storage medium including one or more programs that, when executed on an electronic device, cause the electronic device to implement the first aspect and any possible implementation of the shooting method provided by the first aspect.

[0030] The fourth aspect provides a program product that, when run on an electronic device, enables the electronic device to implement the shooting method provided in the first aspect and any possible implementation of the first aspect.

[0031] It should be understood that the beneficial effects of the second to fourth aspects mentioned above can be referred to the beneficial effects described in the first aspect, and will not be repeated here. Attached Figure Description

[0032] Figure 1According to some embodiments of this application, a schematic diagram of the field of view of a mobile phone camera is shown.

[0033] Figure 2A According to some embodiments of this application, a schematic diagram of a mobile phone implementing fusion shooting is shown.

[0034] Figure 2B According to some embodiments of this application, a schematic diagram of a process for a mobile phone to generate a fused image PF1 is shown.

[0035] Figure 3A According to some embodiments of this application, a schematic diagram of a mobile phone performing fusion shooting based on camera C1 and camera C3 is shown.

[0036] Figure 3B According to some embodiments of this application, a schematic diagram is shown of a mobile phone capturing a small field-of-view image while the user moves the mobile phone 10.

[0037] Figure 3C According to some embodiments of this application, a schematic diagram of a process for a mobile phone to generate a fused image PF2 is shown.

[0038] Figure 4 According to some embodiments of this application, a schematic diagram showing the relationship between the field of view of a first camera, the field of view of a second camera, and the field of view of an enhanced shooting area is shown.

[0039] Figure 5 According to some embodiments of this application, a schematic diagram of the interface displayed during the process of a mobile phone acquiring a small field-of-view image of a distortion correction area is shown.

[0040] Figure 6 According to some embodiments of this application, a schematic flowchart of a shooting method is shown.

[0041] Figure 7A According to some embodiments of this application, a schematic diagram of modifying the ROI of a shooting subject using a mobile phone is shown.

[0042] Figure 7B According to some embodiments of this application, a schematic diagram of another method for modifying the ROI of a photographed subject using a mobile phone is shown.

[0043] Figure 8A According to some embodiments of this application, a schematic diagram of a mobile phone determining an enhanced shooting area is shown.

[0044] Figure 8B According to some embodiments of this application, another schematic diagram of a mobile phone determining an enhanced shooting area is shown.

[0045] Figure 8CAccording to some embodiments of this application, a schematic diagram of another mobile phone determining an enhanced shooting area is shown.

[0046] Figure 8D According to some embodiments of this application, a schematic diagram of another mobile phone determining an enhanced shooting area is shown.

[0047] Figure 9A According to some embodiments of this application, a schematic diagram of a mobile phone determining the shooting sequence of an enhanced shooting area is shown.

[0048] Figure 9B According to some embodiments of this application, another schematic diagram of the shooting sequence for determining the enhanced shooting area by a mobile phone is shown.

[0049] Figure 10A According to some embodiments of this application, a schematic diagram of a guided shooting interface displayed on a mobile phone is shown.

[0050] Figure 10B According to some embodiments of this application, a schematic diagram of a guided shooting interface displayed on another mobile phone is shown.

[0051] Figure 11 According to some embodiments of this application, a flowchart of another shooting method is shown.

[0052] Figure 12 According to some embodiments of this application, a schematic diagram is shown for determining the subject being photographed in a large field-of-view image and the ROI corresponding to the subject being photographed.

[0053] Figure 13 According to some embodiments of this application, a schematic diagram of the subject in a group photo and the corresponding ROI is shown.

[0054] Figure 14 According to some embodiments of this application, a flowchart of yet another shooting method is shown.

[0055] Figure 15 According to some embodiments of this application, a schematic diagram of the structure of a mobile phone is shown. Detailed Implementation

[0056] The illustrative embodiments of this application include, but are not limited to, imaging methods, readable storage media, and electronic devices.

[0057] It should be noted that the shooting method provided in this application can be applied to any electronic device including multiple cameras, including but not limited to user equipment (UE), mobile station (MS), and mobile terminal (MT). For example, the electronic device can be a mobile phone, wearable device, tablet computer, laptop computer, virtual reality (VR) device, augmented reality (AR) device, industrial control device, vehicle-mounted system, terminal device in a smart grid, terminal device in transportation safety, terminal device in a smart city, etc. For ease of description, the following uses a mobile phone 10 as an example to introduce the technical solution of this application.

[0058] The technical solutions of the embodiments of this application are described below with reference to the accompanying drawings.

[0059] As mentioned earlier, details of subjects farther away from electronic devices are lost in wide field-of-view images, and the farther the subject is from the electronic device, the more details are lost in the wide field-of-view image. This may prevent users from seeing details of subjects farther away from the electronic device in a wide field-of-view image, impacting the user experience.

[0060] To enhance the detail of distant subjects in wide-field-of-view images captured by electronic devices, some devices offer fusion shooting (also known as multi-camera shooting, dual-camera shooting, etc.). Fusion shooting typically refers to a shooting method where, after capturing a wide-field-of-view image using a camera with a larger field of view, one or more smaller-field-of-view images corresponding to specific areas within the wide-field-of-view image are captured using a camera with a smaller field of view, and then the wide-field-of-view and small-field-of-view images are merged into a single image.

[0061] In some embodiments, the process of merging images may include:

[0062] The electronic device first acquires a wide field-of-view image using a camera with a large field of view. It then obtains a rectangular area selected by the user within this wide field-of-view image as the image region to be captured by the camera with a smaller field of view (hereinafter referred to as the enhanced shooting area), along with the user-selected method for dividing the enhanced shooting area (i.e., dividing the enhanced shooting area into multiple consecutive sub-regions). Next, based on the enhanced shooting area and its division method, the electronic device acquires small field-of-view images corresponding to each sub-region of the enhanced shooting area using the camera with the smaller field of view. Finally, the electronic device fuses these small field-of-view images with the wide field-of-view image to obtain the final fused image. This allows the fused image to maintain both a large field of view and retain details of objects located at a distance from the electronic device.

[0063] For example, Figure 1 According to some embodiments of this application, a schematic diagram of the field of view of a camera of a mobile phone 10 is shown.

[0064] like Figure 1 As shown, the mobile phone 10 includes camera C1, camera C2, and camera C3, wherein camera C1 has a field of view angle α in the X direction. x1 The field of view angle in the Y direction is α. y1 The field of view of camera C2 in the X direction is α. x2 The field of view angle in the Y direction is α. y2 The field of view of camera C3 in the X direction is α. x3 The field of view angle in the Y direction is α. y3 , and α x1 >α x2 >α x3 α y1 >α y2 >α y3 In other words, the field of view of camera C1 is greater than that of camera C2, and the field of view of camera C2 is greater than that of camera C3.

[0065] During the fusion shooting process, the mobile phone 10 can capture a wide field of view image through camera C1 and a narrow field of view image through camera C2 and / or camera C3, or it can capture a wide field of view image through camera C2 and a narrow field of view image through camera C3.

[0066] The following uses the example of mobile phone 10 capturing a large field-of-view image through camera C1 and a small field-of-view image through camera C3 to introduce the technical solution of this application.

[0067] For example, Figure 2A According to some embodiments of this application, a schematic diagram of a process for a mobile phone 10 to perform fusion shooting is shown; Figure 2BAccording to some embodiments of this application, a schematic diagram of a process by which a mobile phone 10 generates a fused image PF1 is shown.

[0068] like Figure 2A As shown, after the mobile phone 10 detects the user's click operation on the shooting control U11 in the fusion shooting mode, it can use the camera C1 to capture an image to obtain a large field of view image PL1. The shooting objects in the large field of view image PL1 can include building B1 and building B2.

[0069] After obtaining the wide field-of-view image PL1, the mobile phone 10 can display a region selection interface U12, and display the prompt message "Please select an enhanced shooting area" to prompt the user to select the image area to be captured by the camera C3. The region selection interface U12 may include a grid selection control U13, which includes preset division methods for the enhanced shooting area, such as 3×3 (dividing the enhanced shooting area into 3 rows and 3 columns), 2×3 (dividing the enhanced shooting area into 2 rows and 3 columns), 2×2 (dividing the enhanced shooting area into 2 rows and 2 columns), etc. The user can select the division method of the enhanced shooting area through operations in the grid selection control U13; for example, the user can select 2×3 as the division method for the enhanced shooting area.

[0070] If a user needs to retain more details of buildings B1 and B2 in the fusion shooting results, they can select a rectangular area including buildings B1 and B2 as the enhanced shooting area through the area selection interface U12. For example, after detecting the user's sliding operation from point A to point B on the wide field-of-view image PL1, the mobile phone 10 can determine the rectangular area with AB as the diagonal as the enhanced shooting area D1.

[0071] After detecting a user's shooting operation on the enhanced shooting area D1 (e.g., a user's click on the shooting control U11 in the selection interface U12), the mobile phone 10 can display the enhanced shooting interface U14. The enhanced shooting interface U14 may include a grid of enhanced shooting areas (e.g., grids G1 to G6), an arrow A1 indicating the direction for the user to move the mobile phone 10, and a prompt message "Please move the phone in the direction of the arrow to shoot the field of view corresponding to the grid." The user can change the image content captured by the camera C3 by moving the mobile phone 10. During the user's movement of the mobile phone 10, if the content captured by the camera C3 matches the content corresponding to grids G1 to G6, the mobile phone 10 can capture small field-of-view images PS1 to PS6 corresponding to grids G1 to G6 respectively through the camera C3. (Reference) Figure 2BCompared to buildings B1 and B2 in the large field-of-view image PL1, building B1 in the small field-of-view image PS1 corresponding to grid G1 contains more details, and building B2 in the small field-of-view image PS3 corresponding to grid G3 contains more details.

[0072] Finally, the mobile phone 10 can fuse the small field-of-view images PS1 to PS6 with the large field-of-view image PL1 to obtain the fused image PF1. For example, refer to Figure 2B The mobile phone 10 can replace the content of the regions corresponding to grids G1, G2, G3, G4, G5, and G6 in the large field-of-view image PL1 with the small field-of-view images PS1 to PS6 respectively to obtain the fused image PF1. Compared to the large field-of-view image PL1, the fused image PF1 includes more detailed content in buildings B1 and B2.

[0073] However, during the above shooting process, the enhanced shooting area is a rectangular area manually selected by the user. If the subject that the user wants to enhance is relatively scattered, or if the enhanced shooting area selected by the user is too large, the phone 10 will capture a small field of view image that does not include the subject that the user wants to enhance, thereby increasing the time required to obtain the fused image.

[0074] For example, regarding the aforementioned Figure 2A and Figure 2B During the shooting process, the user-selected enhanced shooting area D1 is a continuous rectangular area including buildings B1 and B2. The phone 10 needs to use camera C3 to capture six small field-of-view images (small field-of-view images PS1 to PS6) to capture the entire image content within the enhanced shooting area D1. However, small field-of-view images PS2 and PS5 do not include the image content of buildings B1 and B2, and capturing these images does not add detail to buildings B1 and B2. This increases the number of small field-of-view images captured by the phone 10, thus lengthening the process of obtaining the fused image PF1 through fusion shooting, negatively impacting the user's shooting experience.

[0075] Based on this, embodiments of this application provide a shooting method in which: during the fusion shooting process, the electronic device does not require the user to manually select the enhanced shooting area. Instead, the electronic device automatically identifies the subject in the wide field-of-view image and determines the enhanced shooting area based on the subject, for example, determining the area where the subject is located in the wide field-of-view image as the enhanced shooting area. This avoids the time required for the electronic device to fuse the images due to the user manually selecting an excessively large enhanced shooting area.

[0076] Specifically:

[0077] After detecting the user's instruction to capture an image via image fusion, the electronic device can first acquire a wide field-of-view image using a first camera and identify the subject within that image. Then, the electronic device can display the region of interest (ROI) corresponding to each subject (e.g., the image region where the subject is located, the image region where the subject's circumscribed polygon (e.g., the circumscribed rectangle) is located, and based on the user-selected ROI, determine at least one enhanced shooting region in the wide field-of-view image (this at least one enhanced shooting region can also be called an enhanced region; in other words, all enhanced shooting regions together constitute an enhanced region, which can be a whole or distributed, and each enhanced shooting region can also be called a sub-shooting region of the enhanced region). Each enhanced shooting region includes at least a portion of the image content of the subject (hereinafter referred to as the target subject) corresponding to the user-selected ROI (hereinafter referred to as the target ROI). Next, the electronic device can acquire small field-of-view images corresponding to each enhanced shooting region using a second camera (the second camera's field of view is smaller than the first camera's field of view), and fuse the small field-of-view images with the wide field-of-view image to obtain the final image.

[0078] Based on the above method, since the subject and its ROI are automatically identified by the electronic device (e.g., through intelligent recognition by a pre-trained model) rather than manually selected by the user, the interaction process of the user performing fusion shooting using the electronic device is optimized. Compared to the aforementioned scheme where the user manually selects the subject, this improves the user's interactive experience with the electronic device. Furthermore, since each enhanced shooting area includes the image content of the target subject, it avoids shooting small field-of-view images that do not include the target subject, thus reducing the number of small field-of-view images and increasing the speed at which the electronic device captures and generates the resulting image.

[0079] For example, Figure 3A According to some embodiments of this application, a schematic diagram of a process in which a mobile phone 10 performs fusion shooting based on camera C1 and camera C3 is shown.

[0080] like Figure 3A As shown:

[0081] Mobile phone 10 displays a fusion shooting interface U10, which may include a shooting control U11. After detecting a user's tap on the shooting control U11, mobile phone 10 can capture and generate the aforementioned large field-of-view image PL1 through camera C1. Then, mobile phone 10 can identify the main subjects (buildings B1, B2, and B3) in the large field-of-view image PL1 and display a subject editing interface U21. The subject editing interface U21 may include ROIs R1, R2, and R3 corresponding to buildings B1, B2, and B3, respectively, as well as an ROI area editing control U22 and a start enhanced shooting control U23.

[0082] In some embodiments, ROI R1, ROI R2 and ROI R3 in the main editing interface U21 are all selected by default. If the user directly clicks the start enhanced shooting control U23 in the main editing interface U21, the mobile phone 10 can use all ROIs in the main editing interface U21 as target ROIs for fusion shooting.

[0083] Secondly, after the user clicks to select the ROI area control U22 and then clicks the ROI R3 operation, the phone 10 can cancel the building B3 as the subject of the shot and display the subject editing interface U24. The aforementioned ROI R3 will no longer be displayed in the subject editing interface U24.

[0084] Furthermore, after detecting that the user clicks the start enhanced shooting control U23 on the main editing interface U24, the mobile phone 10 can display the enhanced shooting interface U25. The enhanced shooting interface U25 may include the enhanced shooting area D2 corresponding to building B1 and the enhanced shooting area D3 corresponding to building B2, an arrow A2 instructing the user to move the mobile phone 10, and a prompt message "Please move the phone in the direction of the arrow to shoot the field of view corresponding to the guide frame".

[0085] refer to Figure 3B Users can adjust the image content captured by camera C3 by rotating the phone 10 around the X-axis. During the user's rotation of the phone 10 around the X-axis, the phone 10 can capture an image with a small field of view (PS7) if it detects that the image content captured by camera C3 matches the image content in the enhanced shooting area D2, and capture an image with a small field of view (PS8) if it detects that the image content captured by camera C3 matches the image content in the enhanced shooting area D3.

[0086] Finally, refer to Figure 3CThe phone 10 can fuse the small field-of-view images PS7 and PS8 with the large field-of-view image PL1 to obtain and display the fused image PF2. Compared to the large field-of-view image PL1, the fused image PF2 includes more detailed information about buildings B1 and B2.

[0087] Based on the above process, it can be seen that compared to Figure 2A As shown, the mobile phone 10 only needs to acquire two small field-of-view images to obtain a fused image PF2 with the same effect as the fused image PF1, reducing the acquisition of four small field-of-view images and improving the speed of image capture by the mobile phone 10 through fusion shooting. In addition, the reduction in the number of small field-of-view images also reduces the computing resources consumed by the mobile phone 10 in fusing small and large field-of-view images, which helps to reduce the power consumption of the mobile phone 10.

[0088] In some embodiments, for Figure 1 In the mobile phone 10 shown, if the first camera is camera C1, the second camera can be camera C2 and / or camera C3; if the first camera is camera C2, the second camera can be camera C3.

[0089] In some embodiments, the mobile phone 10 can identify the subject in a large field-of-view image and generate the corresponding ROI for the subject using a pre-trained model, such as a convolutional neural network model, an object detection model (e.g., a fast region-based convolutional network (Fast RCNN), a faster region-based convolutional network (Faster RCNN), a mask region-based convolutional network (Mask RCNN), etc.), or an object detection model based on a transformer model (a model based on a self-attention mechanism) (e.g., DETR (detection transformer)). For example, the subject can be a person, animal, building, or specific object in the image.

[0090] In some embodiments, the shape of the ROI corresponding to the subject being photographed can be any shape. For example, the shape of the ROI can be the same as the shape of the subject being photographed, or the shape of the ROI can be the circumscribed polygon, circumscribed circle, circumscribed ellipse, etc. of the subject being photographed. This application does not limit the shape of the ROI in its embodiments.

[0091] In some embodiments, the user-selected ROI and / or user-inputted custom region constitute the enhancement region, which covers the entire image of the user-selected ROI and / or user-inputted custom region. In some embodiments, the enhancement region is determined by expanding the user-selected ROI and / or user-inputted custom region. For example, the enhancement region includes other image regions not selected by the user but associated with subjects within the user-selected region. Alternatively, the user-selected region is expanded to form an enhancement region with regular boundaries, such as a rectangular region, which facilitates subsequent intelligent planning of the segmentation of the enhancement shooting area and the shooting order.

[0092] In some embodiments, the enhanced shooting area corresponding to the ROI can be a rectangle.

[0093] In some embodiments, the Region of Interest (ROI) corresponding to a subject can be divided into multiple enhanced shooting regions. For example, if the second camera cannot capture the entire ROI of a subject in a single small field-of-view image, the phone 10 can capture the ROI corresponding to the subject using multiple small field-of-view images. That is, there can be multiple enhanced shooting regions for the subject, which can be multiple consecutive rectangular regions or multiple overlapping rectangular regions.

[0094] In some embodiments, when there are multiple enhanced shooting areas, these multiple enhanced shooting areas can be completely independent regions in a large field-of-view image, and some of the multiple enhanced shooting areas may overlap.

[0095] In some embodiments, an enhanced shooting area may also include one or more ROIs corresponding to the shooting subjects.

[0096] In some embodiments, the mobile phone 10 can also adjust the ROI area corresponding to the shooting subject based on the user's operation in the aforementioned subject editing interface, such as adding a new shooting subject, modifying the range of the ROI of the shooting subject recognized by the mobile phone 10, or deleting part of the ROI of the shooting subject.

[0097] In some embodiments, the size of the enhanced shooting area can be determined based on the relationship between the focal length of the second camera and the focal length of the first camera. For example, if the equivalent focal length used by the first camera to capture a wide field-of-view image is A, and the equivalent focal length of the second camera is B, then the size of the enhanced shooting area can be any size less than A / B times the size of the wide field-of-view image. As another example, if the second camera is a zoom camera with an equivalent focal length range of [B1, B2], then the size of the enhanced shooting area can be any size from A / B2 times to A / B2 times the size of the wide field-of-view image.

[0098] In some embodiments, the size of the enhanced shooting area can also be determined based on the equivalent scaling factor of the first camera. The equivalent scaling factor, also known as the equivalent magnification factor, refers to the scaling factor of the subject in the image captured by the camera. The larger the equivalent scaling factor of the camera, the larger the size of the captured image. For mobile phone 10, the size of the same subject in images captured by different cameras is directly proportional (or positively correlated) with the equivalent scaling factor of the camera.

[0099] For example, suppose the equivalent scaling factor of the first camera is a, the equivalent scaling factor of the field of view of the second camera is b, the size of the large field of view image is H×W, and the size of the enhanced shooting area is (H×a / b)×(W×a / b).

[0100] In some embodiments, the sizes of the enhanced shooting areas can be the same or different. For example, the second camera can be a zoom camera, and its field of view changes as the equivalent focal length of the second camera changes. Therefore, the field of view of the second camera can be adjusted by changing its focal length, thereby using different focal lengths to capture small field-of-view images of enhanced shooting areas of different sizes. For example, refer to... Figure 4 The field of view of the first camera can be FOV1, the maximum field of view of the second camera is FOV2, and the minimum field of view is FOV3. Based on this, the range of the field of view FOV4 corresponding to each enhanced shooting area can be any field of view that satisfies FOV3≤FOV4≤FOV2.

[0101] In some embodiments, the location and number of enhanced shooting regions can be determined based on the size of the enhanced shooting regions, the size and location of the ROI of the target subject, etc. For example, the mobile phone 10 can determine the minimum number of enhanced shooting regions that can cover all ROIs of the target subject. This helps to reduce the number of enhanced shooting regions, thereby reducing the number of small field-of-view images captured, and thus shortening the total time for the mobile phone 10 to achieve fusion shooting. In some embodiments, the location and number of enhanced shooting regions can be determined by a greedy algorithm or the like. For example, the mobile phone 10 can place enhanced shooting regions in a large field-of-view image based on the size of the enhanced shooting regions, the size and location of the ROI of the target subject, etc. Each time an enhanced shooting region is placed, the mobile phone 10 can place the enhanced shooting region at the position that can cover the largest area of ​​the ROI of the target subject that has not yet been covered by the enhanced shooting region, until all ROIs of the target subject are covered by the enhanced shooting regions.

[0102] In some embodiments, the mobile phone 10 can also acquire a corrected image corresponding to the region along the edge of the large field-of-view image using the second camera, perform distortion correction on the region along the edge of the large field-of-view image based on the acquired corrected image, and obtain the shooting result based on the corrected large field-of-view image and the small field-of-view image. In this way, the distortion in the region along the edge of the shooting result image can be reduced.

[0103] In some embodiments, the mobile phone 10 can also use the second camera to capture a corrected image corresponding to the edge region of the large field-of-view image, perform distortion correction on the edge of the image obtained by fusing the large field-of-view image and the small field-of-view image, and use the corrected image as the shooting result. In this way, the distortion in the edge region of the shooting result image can be reduced.

[0104] For example, refer to Figure 5 Regarding the aforementioned Figure 3A As shown, after detecting the user's double-click operation on ROI R3 in the main editing interface U21, the mobile phone 10 can display interface U31. Similar to the aforementioned interface U24, interface U31 also includes a distortion correction control U32. After detecting the user's click on the correction control U32, the mobile phone 10 can display a distortion correction interface U33. The distortion correction interface U33 can include multiple distortion correction areas (e.g., distortion correction areas F1 to F8 as shown in the diagram) covering the edge area of ​​the field of view image PL1, and arrows A3 guiding the user to move the mobile phone 10 to capture small field-of-view images corresponding to each distortion correction area. While the mobile phone 10 moves according to arrow A3, it can capture small field-of-view images corresponding to each distortion correction area when it detects that the image captured by the second camera matches the image content of each distortion correction area. After acquiring all the small field-of-view images corresponding to the distortion correction areas (or after detecting that the user has stopped acquiring the small field-of-view images corresponding to the distortion correction areas, for example, after detecting that the user clicks the stop acquisition control U34 in the distortion correction interface U33), the mobile phone 10 can perform distortion correction on each distortion correction area in the large field-of-view image based on the small field-of-view images corresponding to the distortion correction areas.

[0105] In some embodiments, the mobile phone 10 performs distortion correction on each distortion correction region in a large field-of-view image based on a small field-of-view image by: using a pre-trained distortion correction model to perform distortion correction on the corresponding distortion correction region based on the small field-of-view image. This distortion correction model can be a model that performs distortion correction on the large field-of-view image based on the input small field-of-view image, the large field-of-view image, and the position of the small field-of-view image within the large field-of-view image.

[0106] In some embodiments, the mobile phone 10 can perform distortion correction on each distortion correction region in the large field of view based on the small field of view image by first determining the geometric transformation relationship between key points in the small field of view image and the corresponding key points in the large field of view image. Then, based on this geometric transformation relationship, the coordinates of the pixels in the distortion correction region corresponding to the small field of view image in the large field of view image are transformed.

[0107] It should be noted that in other embodiments, the mobile phone 10 can also perform distortion correction on each distortion correction region in the large field of view based on the small field of view image in other ways, which is not limited here. For example, the mobile phone 10 can first determine multiple feature points in the small field of view image, and the corresponding feature points in the large field of view image (hereinafter referred to as mapped feature points). Then, the mobile phone 10 can determine the affine transformation matrix that transforms the mapped feature points to the feature points in the small field of view image. Finally, the mobile phone 10 can perform an affine transformation on the corresponding distortion correction region in the large field of view image based on the obtained affine transformation matrix, thereby realizing the distortion correction of the distortion correction region.

[0108] In some embodiments, after determining the enhanced shooting area, the mobile phone 10 can use a path planning algorithm to plan the order in which the user captures small field-of-view images of each enhanced shooting area, and prompt the user to collect small field-of-view images of each enhanced shooting area in the planned order by displaying arrows or other means.

[0109] For example, determining the shooting order of the enhanced shooting areas can be viewed as a traveling salesman problem (TSP) that does not require returning to the starting point. Therefore, an algorithm capable of solving the TSP can be used to determine the shooting order of the enhanced shooting areas, thereby reducing the total displacement of the user moving the mobile phone 10 and improving the efficiency of the mobile phone 10 in capturing images with a small field of view. For example, greedy algorithms, dynamic programming algorithms, branch and bound algorithms, genetic algorithms, ant colony algorithms, simulated annealing algorithms, etc., can be used to determine the shooting order of the enhanced shooting areas.

[0110] In other embodiments, the mobile phone 10 may also determine the shooting order of each enhanced shooting area in other ways, which are not limited here.

[0111] Below, in conjunction with Figures 6 to 15 The technical solution of this application is described.

[0112] For example, Figure 6 According to some embodiments of this application, a flowchart of a shooting method is shown. The subject of this method is a mobile phone 10, such as... Figure 6 As shown, the method includes the following steps:

[0113] S601 detects a fusion shooting command and captures a wide field-of-view image using the first camera.

[0114] When the phone detects a command to perform a fusion shooting, it can capture a wide field of view image through its first camera.

[0115] For example, when the user taps the shooting control or presses the button to trigger the phone 10 to capture an image on the interface corresponding to the fusion shooting, the phone 10 detects the fusion shooting command and captures a wide field-of-view image through the first camera. For example, the phone 10 can display... Figure 3A The fusion shooting interface U10 shown detects the fusion shooting command after the user clicks the shooting control U11, and captures a wide field-of-view image through the first camera.

[0116] In some embodiments, the mobile phone 10 may also detect the fusion shooting command in other circumstances, which are not limited here. For example, the mobile phone 10 may collect the user's voice information, and when the collected voice information includes a voice command for fusion shooting, the mobile phone 10 may detect the fusion shooting command. As another example, the mobile phone 10 may acquire the user's air gestures, and when the acquired air gestures are gestures corresponding to fusion shooting, the mobile phone 10 may detect the fusion shooting command.

[0117] It should be noted that the first camera can be a camera selected by the user or a camera preset by the phone 10. For example, the first camera can be the aforementioned camera C1 or camera C2.

[0118] For example, different cameras in mobile phone 10 can correspond to different zoom ranges. Mobile phone 10 can select the corresponding camera as the first camera to capture a wide field of view image based on the zoom range selected by the user. For example, the zoom range corresponding to camera C1 can be [1X, 1.5X), the zoom range corresponding to camera C2 can be [1.5X, 3.5X), and the zoom range corresponding to camera C3 can be [3.5X, 10X]. Mobile phone 10 can determine the zoom range selected by the user based on the user's operation, and if the zoom range is within the range [1X, 1.5X), it will use camera C1 as the first camera to capture a wide field of view image; if the zoom range is within the range [1.5X, 3.5X), it will use camera C2 as the first camera to capture a wide field of view image.

[0119] It should be noted that the zoom range corresponding to cameras C1 to C3 mentioned above is only an example. In other embodiments, the zoom range corresponding to cameras C1 to C3 can be determined according to the actual optical parameters of cameras C1 to C3 (such as optical zoom, digital zoom, etc.), which is not limited here.

[0120] S602, Identify and display the ROI corresponding to the subject in the wide field-of-view image.

[0121] After capturing a wide field-of-view image through its first camera, the mobile phone 10 can identify the subject in the wide field-of-view image using an algorithm or a pre-trained model, and display the ROI of the subject. In some embodiments, the ROI corresponding to the subject can be overlaid on top of the wide field-of-view image.

[0122] For example, for Figure 3A As shown, the mobile phone 10 can first determine that the main subjects in the wide field-of-view image PL1 include buildings B1, B2, and B3. Then, the mobile phone 10 can display the subject editing interface U21, in which the ROIs R1, R2, and R3 corresponding to buildings B1, B2, and B3 are superimposed on the wide field-of-view image PL1.

[0123] For example, the pre-trained model can be the aforementioned convolutional neural network model, object detection model (such as Fast R-CNN, Faster R-CNN, Mask R-CNN, DETR, etc.). It should be noted that the mobile phone 10 can also identify the subject in a large field-of-view image based on other algorithms or models, and determine and display the ROI of the subject.

[0124] In some embodiments, the subject of the photograph may include, but is not limited to, people, animals, buildings, specific objects, etc., in a wide-view image.

[0125] In some embodiments, the interface of the ROI corresponding to the subject in the wide field-of-view image displayed on the mobile phone 10 may also include controls for triggering distortion correction, such as... Figure 5 The distortion correction control U32 is shown.

[0126] S603 determines the target ROI based on user actions.

[0127] After displaying the ROI corresponding to the subject being photographed, the phone can determine the target ROI based on the user's actions.

[0128] For example, if the user does not edit the ROI region of the subject being photographed, the mobile phone 10 can use all ROIs corresponding to the subjects in the wide-view image as the target ROI. For instance, the mobile phone 10 can detect when the user is in the aforementioned... Figure 3A When the main editing interface U21 is clicked and the enhanced shooting control U23 is used, the target ROIs are determined as ROI R1 corresponding to building B1, ROI R2 corresponding to building B2, and ROI R3 corresponding to building B3.

[0129] For example, after detecting a user's editing operation on the ROI of the subject, the mobile phone 10 can add, delete, or modify at least part of the ROI of the subject in response to the user's editing operation. Then, the mobile phone 10 can use the user-edited ROI as the target ROI.

[0130] For example, for Figure 3A As shown, after detecting that the user has deselected ROI R1 corresponding to building B3, mobile phone 10 can use ROI R1 corresponding to building B1 and ROI R2 corresponding to building B2 as target ROIs.

[0131] For example, refer to Figure 7A After detecting the user's selection of tree T1, the mobile phone 10 can display the subject editing interface U41, which includes the ROI R4 corresponding to tree T1. After detecting the user's click on the start enhanced shooting control U42 in the subject editing interface U41, the mobile phone 10 can identify the ROI R1 corresponding to building B1, the ROI R2 corresponding to building B2, the ROI R3 corresponding to building B3, and the ROI R4 corresponding to tree T1 as the target ROI.

[0132] For example, refer to Figure 7BAfter detecting that the user selects ROI R3 and then clicks the edit ROI area control U22 in the aforementioned main editing interface U21, the mobile phone 10 can display the ROI editing interface U43, which includes an adjustment control U44 for adjusting ROI R3. The mobile phone 10 can adjust the size of ROI R3 according to the user's operation on the adjustment control U44. After detecting that the user drags the lower right corner of the adjustment control U44 upwards, the mobile phone 10 can display the ROI editing interface U45, which includes an adjustment control U44′ after resizing, a cancel control U46, and an apply control U47. After detecting that the user clicks the apply control U47, the mobile phone 10 can display the main editing interface U48. Compared to the main editing interface U21, the ROI corresponding to building B3 in the main editing interface U48 is reduced from ROI R3 to ROI R3′. After the phone detects that the user clicks the start enhanced shooting control U49 in the main editing interface U48, it can determine the ROI R1 corresponding to building B1, the ROI R2 corresponding to building B2, and the ROI R3′ corresponding to building B3 as the target ROI.

[0133] It should be noted that the above-described method of user editing of ROI is only an example. In other embodiments, the mobile phone 10 can also respond to other user operations to add, delete or adjust the ROI corresponding to the subject being photographed, which is not limited here.

[0134] In other words, the target ROI determined by the electronic device can include the ROI of the subject in the wide field-of-view image identified by the electronic device, or it can include user-defined regions (such as user-added ROIs, user-defined regions obtained by modifying the ROIs of one or more subjects), or it can include both the ROI of the subject in the wide field-of-view image identified by the electronic device and user-defined regions. This enriches the types of target ROIs, providing users with more choices or editing space, which is beneficial to improving the user experience.

[0135] S604, determine the enhanced shooting area of ​​the corresponding target ROI and the shooting order of the enhanced shooting area.

[0136] After identifying the target ROI, the phone can determine the enhanced shooting area for that ROI, as well as the shooting order for each enhanced shooting area. The method for setting the shape and size of the enhanced shooting area can be found in the previous description and will not be repeated here.

[0137] In some embodiments, the mobile phone 10 can determine the minimum number of enhanced shooting areas that can cover the entire ROI based on the size of the target ROI and the size (or size range) of the enhanced shooting area. This helps to reduce the number of enhanced shooting areas, thereby reducing the number of small field-of-view images captured, and thus shortening the total time for the mobile phone 10 to achieve fusion shooting.

[0138] In some embodiments, for a subject whose ROI size is larger than one enhanced shooting area, multiple enhanced shooting areas can be defined for the ROI of the subject. Optionally, each enhanced shooting area corresponding to the ROI of the subject may also include all or part of the ROI of other subjects.

[0139] In some embodiments, for multiple ROIs of shooting subjects whose outer rectangle size is smaller than the size of an enhanced shooting area, an enhanced shooting area can be determined for the ROIs of the multiple shooting subjects.

[0140] For example, for Figure 3A In the scenario shown, the target ROI includes ROI R1 and ROI R2. (Reference) Figure 8A The field of view (FOV5) corresponding to ROI R1 and the field of view (FOV6) ​​corresponding to ROI R2 are both smaller than 1. Figure 4 The second camera shown has a maximum field of view (FOV2), and the minimum field of view (FOV7) including ROI R1 and ROI R2 (e.g., the field of view corresponding to the outer rectangular areas of ROI R1 and ROI R2) is greater than FOV2. Based on this, the phone 10 can use two enhanced shooting areas to capture small field-of-view images corresponding to ROI R1 and ROI R2 respectively (e.g., Figure 3A (The enhanced shooting areas D2 and D3 are shown).

[0141] For example, in the case where the target ROI includes the aforementioned ROI R1, ROI R2, and ROI R3, refer to... Figure 8B The field of view (FOV5) corresponding to ROI R1, the field of view (FOV6) ​​corresponding to ROI R2, and the field of view (FOV8) corresponding to ROI R3 are all smaller than 1. Figure 4 The second camera shown has a maximum field of view (FOV2), and its minimum field of view (FOV9) including the target ROI (e.g., the field of view corresponding to the outer rectangular area of ​​the target ROI) is greater than FOV2 but less than twice FOV2. Based on this, the phone 10 can determine to use two enhanced shooting areas (e.g., Figure 8BEnhanced shooting regions D4 and D5 are shown to capture small field-of-view images of the target ROI to reduce the number of enhanced shooting regions. Enhanced shooting region D4 includes ROI R1 and a portion of ROI R3; enhanced shooting region D5 includes ROI R1 and a portion of ROI R3; the area of ​​ROI R3 within enhanced shooting region D4 and the area within enhanced shooting region D5 include the entire area of ​​ROI 3.

[0142] It should be noted that in some embodiments, when the FOV corresponding to a ROI is smaller than the maximum FOV of the second camera, only one enhanced shooting area can be used to capture the small field-of-view image of that ROI. This avoids the distortion in the region corresponding to the ROI after fusing the small and large field-of-view images caused by splitting an ROI into multiple images. For example, refer to... Figure 8C For target ROIs including the aforementioned ROI R1, ROI R2, and ROI R3, the phone 10 can also use an enhanced shooting area to capture small video images corresponding to ROI R1, ROI R2, and ROI R3 respectively (e.g., Figure 8B The enhanced shooting areas shown are D6, D7, and D8. Enhanced shooting area D6 includes ROI R1, enhanced shooting area D7 includes ROI R2, and enhanced shooting area D8 includes ROI R3.

[0143] In some embodiments, the mobile phone 10 can determine the enhanced shooting area using a greedy algorithm or similar method. For example, the mobile phone 10 can place enhanced shooting areas one by one in the large field-of-view image based on the size of the enhanced shooting area, the size and position of the target ROI, until the entire area of ​​the target ROI is covered by the enhanced shooting area. Each time an enhanced shooting area is placed, the mobile phone 10 can position it at the location that can cover the largest area of ​​the target ROI that is not yet covered by the enhanced shooting area. For example, refer to... Figure 8D The target ROI includes the aforementioned ROI R1, ROI R2, and ROI R3. The mobile phone 10 can first place an enhanced shooting region D9 that covers the largest area of ​​the target ROI in the large field-of-view image, then place an enhanced shooting region D10 that covers the largest area of ​​the target ROI not covered by enhanced shooting region D9, and finally place an enhanced shooting region D11 that covers the largest area of ​​the target ROI not covered by enhanced shooting regions D9 and D10. In some embodiments, each enhanced shooting region includes at least a portion of the target ROI.

[0144] In some embodiments, after determining the enhanced shooting area, the mobile phone 10 can also determine the shooting order of the enhanced shooting area to reduce the total displacement of the user moving the mobile phone 10. For example, the mobile phone 10 can determine the shooting order of the enhanced shooting area based on greedy algorithms, dynamic programming algorithms, branch and bound algorithms, genetic algorithms, ant colony algorithms, simulated annealing algorithms, etc., with the goal of reducing the total displacement of the mobile phone 10.

[0145] For example, for Figure 8A The situation shown is for reference. Figure 9A When the current field of view of the second camera of the mobile phone 10 is region FC1, the mobile phone 10 can determine that the enhanced shooting region D2 is the first enhanced shooting region and the enhanced shooting region D3 is the second enhanced shooting region; when the current field of view of the second camera of the mobile phone 10 is region FC2, the mobile phone 10 can determine that the enhanced shooting region D3 is the first enhanced shooting region and the enhanced shooting region D2 is the second enhanced shooting region.

[0146] For example, regarding Figure 8C The situation shown is for reference. Figure 9B When the current field of view of the second camera of the mobile phone 10 is region FC3, the mobile phone 10 can determine the shooting order of enhanced shooting regions D6 to D8 as: enhanced shooting region D6, enhanced shooting region D8, enhanced shooting region D7; when the current field of view of the second camera of the mobile phone 10 is region FC4, the mobile phone 10 can determine the shooting order of enhanced shooting regions D6 to D8 as: enhanced shooting region D7, enhanced shooting region D8, enhanced shooting region D6.

[0147] It should be noted that in other embodiments, the mobile phone 10 may also determine the enhanced shooting area in other ways, which are not limited here.

[0148] S605 displays a guided shooting interface, which includes enhanced shooting areas and guidance information indicating the shooting order of the enhanced shooting areas.

[0149] After determining the enhanced shooting area and the shooting order of the enhanced shooting area, the mobile phone 10 can display a guided shooting interface, which includes the enhanced shooting area and guidance information indicating the shooting order of the enhanced shooting area.

[0150] In some embodiments, the mobile phone 10 can display the enhanced shooting area by highlighting or displaying the border of the enhanced shooting area, the area of ​​the enhanced shooting area, etc., by using different colors.

[0151] In some embodiments, the guidance information may include numbers, letters, arrows, etc., indicating the shooting order of the enhanced shooting area.

[0152] In some embodiments, the guidance information may also include the current field of view frame corresponding to the current field of view area of ​​the second camera of the mobile phone 10, or display the current field of view area of ​​the second camera in different ways.

[0153] For example, refer to Figure 10A The mobile phone 10 can display a guided shooting interface U50 for the aforementioned enhanced shooting areas D2 and D3. The guided shooting interface U50 may include borders corresponding to the enhanced shooting areas D2 and D3, an arrow A4 indicating the direction in which the user moves the mobile phone 10 (equivalent to indicating the shooting order of the enhanced shooting areas), and a current field of view frame DC1 corresponding to the current field of view area of ​​the second camera of the mobile phone 10, and the brightness of the displayed content within the current field of view frame DC1 is higher than the brightness of other areas.

[0154] For example, refer to Figure 10B The corresponding area for enhanced shooting is Figure 8C The enhanced shooting areas D6, D7, and D8 are shown. Mobile phone 10 can display a guided shooting interface U54. In the guided shooting interface U54, the borders of enhanced shooting areas D6, D7, and D8 are displayed as solid gray lines; the current field of view frame DC2 corresponding to the current field of view area of ​​the second camera of mobile phone 10 is displayed as a black dashed line; and an arrow A5 indicates the shooting order of enhanced shooting areas D6, D7, and D8.

[0155] It should be noted that in some other embodiments, the guidance information may also include other information, which is not limited here.

[0156] S606, in response to matching the image captured by the second camera with the image content of the enhanced shooting area, captures a small field-of-view image corresponding to the enhanced shooting area.

[0157] After displaying the guided shooting interface, the mobile phone 10 can respond to the user's movement of the mobile phone 10 by matching the image captured by the second camera with the image content of the enhanced shooting area. When the image captured by the second camera matches the image content of a certain enhanced shooting area, the mobile phone 10 can capture a small field-of-view image corresponding to that enhanced shooting area.

[0158] In some embodiments, during the process of acquiring a small field-of-view image corresponding to an enhanced shooting area, the mobile phone 10 can acquire one or more small field-of-view images for an enhanced shooting area, and select the one with the best image quality among these one or more small field-of-view images as the small field-of-view image corresponding to that enhanced shooting area. This avoids poor quality of a single small field-of-view image due to mobile phone 10 shaking or other reasons, thereby preventing the poor image quality of the small field-of-view image from affecting the quality of the final image obtained by the mobile phone 10.

[0159] In some embodiments, image quality may include the sharpness of the image.

[0160] In some embodiments, the enhanced shooting area with captured small field-of-view images and the enhanced shooting area without captured small field-of-view images can be displayed in different ways, such as by borders of different colors, fills of different colors, borders of different line types, fills of different patterns, etc.

[0161] In some embodiments, after capturing a small field-of-view image corresponding to an enhanced shooting area, the mobile phone 10 can display the enhanced area in a way that is different from the enhanced shooting area where no small field-of-view image has been captured.

[0162] For example, refer to Figure 10A :

[0163] When the image captured by the second camera of the mobile phone 10 matches the image content in the enhanced shooting area D2 (at this time, the current field of view DC1 coincides with the border of the enhanced shooting area D2), the small field of view image PS7 corresponding to the enhanced shooting area D2 can be captured. After capturing the small field of view image PS7, the border of the enhanced shooting area D2 changes from gray to black.

[0164] As the user moves the phone 10, in the guided shooting interface displayed on the phone 10, the current view frame DC1 changes according to the field of view corresponding to the image currently being captured by the second camera of the phone 10, and the tail of arrow A4 also changes with the change of the current view frame DC1 (for example, the tail of arrow A4 can remain at a certain position in the current view frame DC1 (e.g., center, edge, etc.)). For example, see reference Figure 10A In the guided shooting interfaces U51 and U52, the tail of arrow A4 remains in the center of the current field of view DC1, and the head of arrow A4 remains in the center of the enhanced shooting area D3.

[0165] During the user's movement of mobile phone 10, if the image captured by the second camera of mobile phone 10 matches the image content in the enhanced shooting area D3 (at this time, reference...) Figure 10AIn the guided shooting interface U54, the current field of view DC1 coincides with the border of the enhanced shooting area D3 (arrow A4 is no longer displayed), and the small field of view image PS8 corresponding to the enhanced shooting area D3 can be captured.

[0166] In some embodiments, if a user's instruction to end the acquisition is detected before all small field-of-view images corresponding to the enhanced shooting areas have been acquired, the mobile phone 10 can also end the acquisition of small field-of-view images.

[0167] In some embodiments, after acquiring a small field-of-view image corresponding to a certain enhanced shooting area, if the acquired small field-of-view image does not meet the image quality requirements (e.g., low clarity), the mobile phone 10 may also display information instructing the user to retake the small field-of-view image corresponding to the enhanced shooting area.

[0168] In some embodiments, the field of view corresponding to the small field of view image can be larger than the field of view corresponding to the enhanced shooting area. In this case, it can be avoided that the small field of view image does not include all the image content of the corresponding enhanced shooting area due to phone shaking or other reasons.

[0169] It should be noted that the second camera can be any camera with a smaller field of view than the first camera. For example, if the first camera is camera C1, the second camera can be camera C2 and / or camera C3; if the first camera is camera C2, the second camera can be camera C3.

[0170] It should be noted that if the size of the enhanced shooting area is different, the phone 10 can also adjust the focal length of the second camera according to the field of view corresponding to the enhanced shooting area, so that the field of view of the second camera is larger than the field of view corresponding to the enhanced shooting area.

[0171] The S607 obtains the captured image based on both a large field-of-view image and a small field-of-view image.

[0172] After acquiring small field-of-view images corresponding to all enhanced shooting areas, the mobile phone 10 can fuse the small field-of-view images and the large field-of-view images to obtain the shooting result image corresponding to the integrated shooting command. In the shooting result image, the image content of the area corresponding to the enhanced shooting area is obtained based on the content of the corresponding small field-of-view image, and the content of the area outside the enhanced shooting area is obtained based on the content of the large field-of-view image.

[0173] For example, the mobile phone 10 can use an image fusion algorithm to combine a large field-of-view image and a small field-of-view image to obtain the captured image. For example, the image fusion algorithm may include, but is not limited to, alpha fusion algorithm, pyramid fusion algorithm, Poisson fusion algorithm, principal component analysis (PCA) fusion algorithm (also known as principal component analysis fusion algorithm), frequency domain fusion algorithm, and integration algorithm based on artificial intelligence models (such as deep learning models, neural network models, large models (such as large language models)).

[0174] It should be noted that in other embodiments, the mobile phone 10 can also fuse large field-of-view images and small field-of-view images in other ways to obtain the captured image.

[0175] In some embodiments, if a user's instruction to end the acquisition is detected before all small field-of-view images corresponding to the enhanced shooting areas are acquired, the mobile phone 10 can also obtain the shooting result image based on the acquired small scene images and large field-of-view images.

[0176] Based on the above shooting method, the enhanced shooting area determined by the mobile phone 10 during the fusion shooting process is obtained based on the target ROI, rather than dividing the rectangular area selected by the user to obtain a preset continuous enhanced shooting area. In this way, it can avoid shooting small field-of-view images that do not include the target ROI, which helps to reduce the number of enhanced shooting areas that the mobile phone 10 needs to shoot, thereby improving the efficiency of the mobile phone 10 in fusion shooting.

[0177] In some embodiments, during the process of fusion shooting, the mobile phone 10 can also capture a small field-of-view image at the edge of the large field-of-view image based on user operation and perform distortion correction on the large field-of-view image (or the captured image) to reduce distortion in the captured image.

[0178] For example, Figure 11 According to some embodiments of this application, a flowchart of a shooting method is shown. The subject of this method is a mobile phone 10. Figure 11 As shown, the method includes the following steps:

[0179] S1101, a fusion shooting command was detected, and a wide field-of-view image was captured using the first camera.

[0180] When the phone detects a command to perform a fusion shooting, it can capture a wide field of view image through its first camera.

[0181] For example, when the user taps the shooting control or presses the button to trigger the phone 10 to capture an image on the interface corresponding to the fusion shooting, the phone 10 detects the fusion shooting command and captures a wide field-of-view image through the first camera. For details, please refer to the aforementioned step S601, which will not be elaborated upon here.

[0182] S1102, Identify and display the ROI corresponding to the subject in the wide field-of-view image.

[0183] After capturing a wide field-of-view image through its first camera, the mobile phone 10 can identify the subject in the wide field-of-view image using algorithms or pre-trained models, and display the ROI of the subject in the subject editing interface. For details, please refer to step S602 above, which will not be elaborated upon here.

[0184] S1103, The user was detected performing distortion correction.

[0185] After detecting that the user has performed a distortion correction operation, the mobile phone 10 can trigger the mobile phone 10 to perform distortion correction on the large field of view image.

[0186] For example, the user's operation to perform distortion correction can be a click operation on the distortion correction control (such as the aforementioned) in the main editing interface displayed on the mobile phone 10 or other operations.

[0187] It should be noted that in other embodiments, the user may perform other operations for distortion correction, which are not limited here.

[0188] S1104, Determine the distortion correction area and display the distortion correction interface.

[0189] After detecting that the user has performed a distortion operation, the mobile phone 10 can determine the distortion correction area at the edge of the large field of view image and display the distortion correction interface.

[0190] For example, the distortion correction interface may include a distortion correction area and guidance information (such as arrows, numbers, letters, etc.) indicating the shooting order of small field-of-view images of the distortion correction area.

[0191] S1105, in response to the matching of the image captured by the second camera with the image content of the distortion correction area, acquires the small field-of-view image corresponding to the distortion correction area.

[0192] After displaying the distortion correction interface, the mobile phone 10 can respond to the user's movement of the mobile phone 10 by matching the image captured by the second camera with the image content of the distortion correction area. When the image captured by the second camera matches the image content of a certain distortion correction area, the mobile phone 10 can capture a small field-of-view image corresponding to that distortion correction area.

[0193] S1106, Based on the small field-of-view image corresponding to the distortion correction region, the large field-of-view image is distorted to obtain and display the corrected large field-of-view image.

[0194] After acquiring small field-of-view images corresponding to all distortion correction areas, the mobile phone 10 can perform distortion correction on the corresponding distortion correction areas in the large field-of-view image based on the small field-of-view images corresponding to the distortion correction areas, thus obtaining a large field-of-view image after distortion correction (hereinafter referred to as the corrected large field-of-view image). Then, the mobile phone 10 can display the corrected large field-of-view image and the ROI of the shooting subject superimposed on the corrected large field-of-view image.

[0195] S1107, Determine the target ROI based on user actions.

[0196] After correcting the ROI corresponding to the subject in the wide-view image display, the mobile phone 10 can determine the target ROI based on the user's operation. The specific method by which the mobile phone 10 determines the target ROI can be referred to in the aforementioned step S603, and will not be repeated here.

[0197] S1108, determine the enhanced shooting area of ​​the corresponding target ROI and the shooting order of the enhanced shooting area.

[0198] After identifying the target ROI, the mobile phone 10 can determine the enhanced shooting area for the corresponding target ROI, as well as the shooting order for each enhanced shooting area. For details, please refer to step S604 mentioned above, which will not be elaborated upon here.

[0199] S1109 displays a guided shooting interface, which includes enhanced shooting areas and guidance information indicating the shooting order of the enhanced shooting areas.

[0200] After determining the enhanced shooting area and the shooting order of the enhanced shooting area, the mobile phone 10 can display a guided shooting interface. The guided shooting interface includes the enhanced shooting area and guidance information indicating the shooting order of the enhanced shooting area. The specific method can be referred to the aforementioned step S605, and will not be repeated here.

[0201] S1110, in response to the matching of the image captured by the second camera with the image content of the enhanced shooting area, captures a small field-of-view image corresponding to the enhanced shooting area.

[0202] After displaying the guided shooting interface, the mobile phone 10 can respond to the user's movement of the mobile phone 10 by matching the image captured by the second camera with the image content of the enhanced shooting area. When the image captured by the second camera matches the image content of a certain enhanced shooting area, the mobile phone 10 can capture a small field-of-view image corresponding to that enhanced shooting area. The specific method can be found in the aforementioned step S606, and will not be elaborated upon here.

[0203] S1111, based on the large field-of-view image and the small field-of-view image, obtains the captured image.

[0204] After acquiring small field-of-view images corresponding to all enhanced shooting areas, the mobile phone 10 can fuse the small field-of-view images and the corrected large field-of-view images to obtain the shooting result image corresponding to the integrated shooting command. In the shooting result image, the image content of the area corresponding to the enhanced shooting area is obtained based on the content of the corresponding small field-of-view image, while the content of the area outside the enhanced shooting area is obtained based on the content of the corrected large field-of-view image.

[0205] Based on the above shooting method, during the fusion shooting process, the enhanced shooting area determined by the mobile phone 10 is based on the target ROI, rather than dividing the user-selected rectangular area into a preset continuous enhanced shooting area. This avoids shooting small field-of-view images that do not include the target ROI, reducing the number of enhanced shooting areas that the mobile phone 10 needs to capture, thereby improving the efficiency of the fusion shooting. Furthermore, the mobile phone 10 can also perform distortion correction on the large field-of-view image based on the small field-of-view image captured by the second camera, reducing distortion in the resulting image.

[0206] It should be noted that in some other embodiments, the mobile phone 10 can also be based on Figure 6 After obtaining the captured image through the process shown, a small field-of-view image corresponding to the distortion correction area at the edge of the captured image is acquired, and distortion correction is performed on the captured image based on the acquired small field-of-view image.

[0207] The following describes an architecture for determining the subject and the corresponding ROI in a large-view image using a mobile phone.

[0208] For example, Figure 12 According to some embodiments of this application, a schematic diagram is shown for determining the subject being photographed in a large field-of-view image and the ROI corresponding to the subject being photographed.

[0209] refer to Figure 12 For a wide-view image, the mobile phone 10 can first determine whether the scene corresponding to the wide-view image is a portrait scene or a non-portrait scene.

[0210] When the scene corresponding to the wide-view image is a portrait scene (that is, the subject of the shooting is a person), the mobile phone 10 can perform face region recognition on the wide-view image to determine the face region in the wide-view image and use the face region as the ROI corresponding to the subject of the shooting.

[0211] In some embodiments, when there is only one person in the wide-view image (i.e., when the wide-view image is a single person photo), the mobile phone 10 can take that single person as the subject of the shot and determine the face region of that person as the ROI.

[0212] In some embodiments, when there are multiple people in the wide-view image (i.e., the wide-view image is a group photo), the mobile phone 10 can determine the foreground (image content corresponding to the subject closer to the mobile phone 10) and background (image content corresponding to the subject closer to the mobile phone 10) in the wide-view image, and determine the face regions of each person in the foreground as ROI regions. For example, refer to Figure 13 In the wide-view image PL2, there are people PP1, PP2, PP3, PP4, and PP5 (i.e., the wide-view image PL2 is a group photo). The mobile phone 10 can determine that the person in the foreground of the wide-view image PL2 is person PP4, and the people in the background are people PP1, PP2, PP3, and PP5. Based on this, the mobile phone 10 can identify person PP4 as the main subject and designate the area D12 corresponding to person PP4's face as the ROI for person PP4.

[0213] When the scene corresponding to the wide field of view image is a portrait scene (that is, the subject is a subject other than a person), the mobile phone 10 can identify the subject in the wide field of view image and determine the area where the subject is located as the enhanced shooting area (the area where animals, buildings, specific objects, etc. are located).

[0214] It should be noted that, Figure 12 The method shown for determining the ROI corresponding to the subject in a wide-view image is just one example. In other embodiments, the mobile phone 10 may also determine the ROI corresponding to the subject in a wide-view image in other ways, which are not limited here.

[0215] This application also provides a shooting method.

[0216] For example, Figure 14 According to some embodiments of this application, a flowchart of another shooting method is shown. The subject performing this method can be an electronic device, such as the aforementioned mobile phone 10. Figure 14 As shown, the method includes the following steps:

[0217] S1401, in response to the detected shooting command, captures a first image using the first camera.

[0218] For example, the shooting command can be the aforementioned fusion shooting command, and the first image can be the aforementioned wide field-of-view image. The specific method by which the electronic device detects the shooting command and captures the first image through the first camera can be referred to the content of the aforementioned step S601, and will not be repeated here.

[0219] S1402, identify the subject in the first image, generate and display at least one ROI corresponding to the subject in the first interface.

[0220] For example, the electronic device can first identify the subject in the first image and the corresponding Regions of Interest (ROIs) of each subject, and then display at least one ROI corresponding to the subject on the first interface. Each ROI can correspond to one subject. The specific process by which the electronic device identifies the subject in the first image, generates, and displays at least one ROI corresponding to the subject on the first interface can be referred to in the aforementioned step S602, and will not be repeated here.

[0221] S1403, in response to the user's operation on the first interface, an enhanced region is determined, wherein the enhanced region includes at least one region of interest, and / or, the enhanced region includes a user-defined region.

[0222] For example, the electronic device can determine the target ROI corresponding to the user's operation on the first interface. Then, it determines the enhancement region corresponding to the target ROI. The enhancement region may include the enhanced shooting region (or sub-shooting region of the enhancement region) corresponding to the target ROI, and each enhanced shooting region includes at least a portion of the target ROI. The specific process of the electronic device determining the enhancement region in response to the user's operation on the first interface can be referred to the aforementioned steps S603 and S604, and will not be repeated here.

[0223] In some embodiments, the user-defined area may include a user-added ROI, and / or an ROI obtained by modifying the ROI of a subject being photographed.

[0224] S1404, at least one second image is captured by the second camera that matches the image content of the enhanced area, each second image matching at least a portion of the image content of the enhanced area.

[0225] For example, after determining the enhancement region, at least one second image matching the image content of the enhancement region can be captured by the second camera, wherein each second image corresponds to a sub-capture area (i.e., an enhancement capture area) of the enhancement region. For details, please refer to steps S605 and S606 above, which will not be elaborated upon here.

[0226] S1405, the first image and at least one second image are fused to obtain the target image of the shooting command.

[0227] After acquiring all the second images corresponding to the enhanced area, the electronic device can fuse the first image and each of the second images to obtain the target image (or the image of the shooting result) of the shooting command. The specific method of the electronic device fusing the first image and the second image can be referred to the aforementioned step S607, and will not be repeated here.

[0228] Based on the above method, the electronic device can automatically identify the subject and its corresponding region of interest (ROI) in the first image, and determine the enhanced region, which includes the ROI corresponding to the subject and / or a user-defined region. Then, the electronic device can use a second image (e.g., a small field-of-view image as described below) that matches the image content of the enhanced region, and fuse the second image with the first image to obtain the target image. Since the ROI of the subject is automatically identified by the electronic device (e.g., intelligently identified through a pre-trained model) rather than manually selected by the user, the user's interaction process for fusion shooting using the electronic device is optimized, improving the user's interactive experience. Furthermore, since each second image matches at least a portion of the image content in the enhanced region, it avoids capturing images that do not include the enhanced region, increasing the number of images captured by the second camera and improving the speed at which the electronic device generates the target image.

[0229] Furthermore, the enhanced area can include only the user-defined area, or both the user-defined area and at least part of the region of interest corresponding to the subject being photographed, increasing the selectivity of the regions of interest included in the enhanced area. This allows users to edit the regions of interest automatically identified by the electronic device according to their needs, thus improving the user experience.

[0230] This application also provides a program product that, when executed on an electronic device, enables the electronic device to implement the shooting methods provided in the foregoing embodiments.

[0231] This application also provides a readable storage medium storing one or more programs / instructions, which, when executed by an electronic device, enable the electronic device to implement the shooting methods provided in the foregoing embodiments.

[0232] further, Figure 15 According to some embodiments of this application, a structural schematic diagram of a mobile phone 10 is shown.

[0233] like Figure 15As shown, the mobile phone 10 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0234] Processor 110 may include one or more processing units, such as a central processing unit (CPU), an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a microcontroller unit (MCU), a video codec, a digital signal processor (DSP), a baseband processor, a neural network processing unit (NPU), a field-programmable gate array (FPGA), etc. In some embodiments, different processing units may be independent devices or integrated into one or more processors.

[0235] The processor 110 may also include a memory for storing one or more programs and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store one or more programs or data that the processor 110 has just used or is reusing. When the processor 110 needs to use the one or more programs or data again, it can directly retrieve them from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0236] In some embodiments, the processor 110 may be used to execute one or more programs / instructions corresponding to the shooting methods provided in the foregoing embodiments.

[0237] The charging management module 140 receives charging input from the charger. While charging the battery 142, the charging management module 140 can also supply power to the electronic device through the power management module 141.

[0238] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, internal memory 121, display 194, camera 193, and wireless communication module 160, etc.

[0239] The wireless communication function of mobile phone 10 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0240] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals.

[0241] The mobile communication module 150 can provide solutions for wireless communication applications including 2G / 3G / 4G / 5G on the mobile phone 10. The mobile communication module 150 may include at least one filter, switch, power amplifier, low-noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via the antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via the antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0242] The wireless communication module 160 can provide solutions for wireless communication applications on the mobile phone 10, including wireless local area networks (WLAN) (such as Wi-Fi), Bluetooth (BT), global navigation satellite system (GNSS), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0243] The mobile phone 10 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor that connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0244] The display screen 194 is used to display images. For example, the display screen 194 can be used to display the aforementioned guided shooting interface, subject editing interface, distortion correction interface, etc.

[0245] Camera 193 is used to capture still images or videos. In some embodiments, mobile phone 10 may include multiple cameras 193 (e.g., the aforementioned cameras C1, C2, and C3). Among these multiple cameras 193, at least two cameras 193 have different equivalent focal lengths and different fields of view. Thus, mobile phone 10 can use the camera with a larger field of view to capture images with a large field of view and use the camera with a smaller field of view to capture images with a small field of view.

[0246] The external memory interface 120 can be used to connect an external memory card. The external memory card communicates with the processor 110 through the external memory interface 120 to realize data storage function.

[0247] The internal memory 121 can be used to store one or more programs and corresponding data. The internal memory 121 may include a program storage area and a data storage area. In some embodiments, the program storage area may store the operating system, applications required for at least one function, such as programs / instructions corresponding to the shooting methods provided in the foregoing embodiments. The data storage area may store data created during the use of the mobile phone 10, such as large field-of-view images, small field-of-view images, data on enhanced shooting areas / distortion correction areas, etc. Furthermore, the internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, general-purpose flash memory, etc. The processor 110 executes various functional applications of the mobile phone 10 by running one or more programs stored in the internal memory 121 and / or one or more programs stored in memory disposed in the processor 110.

[0248] The phone 10 can achieve audio functions, such as music playback, through an audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0249] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals.

[0250] The loudspeaker 170A, also known as a "loudspeaker", is used to convert audio electrical signals into sound signals.

[0251] The receiver 170B, also known as the "earpiece", is used to convert audio electrical signals into sound signals.

[0252] The microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals.

[0253] The 170D headphone jack is used to connect wired headphones.

[0254] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A may be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Mobile phone 10 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, mobile phone 10 detects the intensity of the touch operation based on pressure sensor 180A. Mobile phone 10 can also calculate the touch position based on the detection signal from pressure sensor 180A.

[0255] In some embodiments, the processor 110 can detect user operations such as selection and editing of the ROI based on the electrical signal detected by the pressure sensor 180A.

[0256] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch buttons. Mobile phone 10 can receive button input and generate key signal inputs related to user settings and function control of mobile phone 10.

[0257] Motor 191 can generate vibration as a notification. Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, notifications, etc.

[0258] The SIM card interface 195 is used to connect a SIM card or eSIM.

[0259] It is understood that the structure of the mobile phone 10 shown in the embodiments of this application does not constitute a specific limitation on the electronic device. In other embodiments of this application, the electronic device may include more or fewer components than shown, or combine some components, or split some components, or have different component arrangements. The components shown may be implemented in hardware, software, or a combination of software and hardware.

[0260] In the accompanying drawings, some structural or methodological features may be shown in a specific arrangement and / or order. However, it should be understood that such a specific arrangement and / or order may not be necessary. Rather, in some embodiments, these features may be arranged in a manner and / or order different from that shown in the illustrative drawings. Furthermore, the inclusion of structural or methodological features in a particular figure does not imply that such features are required in all embodiments, and in some embodiments, these features may be omitted or may be combined with other features.

[0261] It should be noted that in the examples and description of this patent, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the term "comprising" or any other variations thereof is intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one" does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0262] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A shooting method applied to electronic devices, characterized in that, The electronic device includes a first camera and a second camera, wherein the field of view of the first camera is greater than the field of view of the second camera; and the method includes: In response to a detected shooting command, a first image is captured using the first camera; Identify the subject in the first image, and generate and display at least one region of interest corresponding to the subject in the first interface; An enhanced region is determined in response to a user's operation on the first interface, wherein the enhanced region includes at least one of the regions of interest, and / or the enhanced region includes a user-defined region; At least one second image is captured by the second camera that matches the image content of the enhanced region, wherein each second image matches at least a portion of the image content of the enhanced region; The first image and the at least one second image are fused together to obtain the target image of the shooting command.

2. The method according to claim 1, characterized in that, The enhanced region includes multiple sub-shooting regions, and capturing at least one second image matching the image content of the enhanced region using the second camera includes: The second interface displays the first image and first information superimposed on the first image. The first information includes the border of each of the sub-shooting areas and guidance information indicating the shooting order of each of the sub-shooting areas. As the user moves the electronic device, in response to the matching of the image content captured by the second camera with the image content of the first sub-shooting area among the plurality of sub-shooting areas, the second image corresponding to the first sub-shooting area is captured.

3. The method according to claim 2, characterized in that, The first information also includes a current field of view that indicates the position of the image content currently captured by the second camera in the first image.

4. The method according to claim 1, characterized in that, The process of determining the enhanced area in response to user interaction with the first interface includes: In response to the user's operation on the first interface, a target region of interest is determined; an enhanced region corresponding to the target region of interest is determined, wherein the enhanced region includes at least one sub-shooting region, one of the sub-shooting regions covers at least a portion of the content of the target region of interest, and the at least one sub-shooting region covers the entire content of the target region of interest.

5. The method according to claim 4, characterized in that, The first interface includes enhanced shooting controls; and the step of determining the target region of interest in response to user operations on the first interface includes: In response to the user's selection of the enhanced shooting control on the first interface, the at least one region of interest is determined as the target region of interest; Alternatively, in response to a user selecting at least one first region of interest from the at least one region of interest in the first interface, and then selecting the enhanced shooting control, the at least one first region of interest is determined as the target region of interest.

6. The method according to claim 4, characterized in that, The step of determining the target region of interest in response to the user's operation on the first interface includes: In response to a user's operation of modifying a second region of interest in the at least one region of interest to a first user-defined region on the first interface, a second interface is displayed, wherein the second interface includes other regions of interest besides the second region of interest in the at least one region of interest, the first user-defined region, and enhanced shooting controls; In response to the user selecting at least one region of interest other than the second region of interest and / or the first user-defined region in the second interface and then selecting the enhanced shooting control, the region selected by the user is determined as the target region of interest.

7. The method according to claim 4, characterized in that, The step of determining the target region of interest in response to the user's operation on the first interface includes: In response to the user's operation of adding a second user-defined area in the first interface, a third interface is displayed, the third interface including the at least one region of interest, the second user-defined area, and enhanced shooting controls; In response to the user selecting at least one of the regions of interest and / or the second user-defined region in the third interface and then selecting the enhanced shooting control, the region selected by the user is determined as the target region of interest.

8. The method according to any one of claims 5 to 7, characterized in that, The first interface, the second interface, or the third interface further includes distortion correction controls; and the method further includes: In response to the user's selection of the distortion correction control, a fourth interface is displayed, the fourth interface including the first image and a border of at least one distortion correction area superimposed on the first image. During the process of the user moving the electronic device, in response to the matching of the image content captured by the second camera with the image content in each of the distortion correction areas, a third image corresponding to each distortion correction area is captured; The distortion correction of the first image is performed based on each of the third images.

9. The method according to claim 8, characterized in that, The step of fusing the first image and the at least one second image to obtain the target image of the shooting command includes: The at least one second image is fused with the first image after distortion correction to obtain the target image.

10. An electronic device, characterized in that, include: Memory, used to store one or more programs; A processor for executing the one or more programs to cause the electronic device to implement the shooting method according to any one of claims 1 to 9.

11. A readable storage medium, characterized in that, The readable storage medium includes one or more programs that, when executed on an electronic device, cause the electronic device to perform the shooting method according to any one of claims 1 to 9.

Images